2025-12-04 12:15:56.442868 | Job console starting... 2025-12-04 12:15:56.664787 | Updating repositories 2025-12-04 12:15:57.409996 | Preparing job workspace 2025-12-04 12:16:04.591693 | Running Ansible setup... 2025-12-04 12:16:08.184055 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-12-04 12:16:08.716611 | 2025-12-04 12:16:08.716771 | PLAY [localhost] 2025-12-04 12:16:08.725032 | 2025-12-04 12:16:08.725100 | TASK [Gathering Facts] 2025-12-04 12:16:09.522151 | localhost | ok 2025-12-04 12:16:09.534878 | 2025-12-04 12:16:09.534957 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2025-12-04 12:16:09.853254 | localhost -> localhost | changed 2025-12-04 12:16:09.858627 | 2025-12-04 12:16:09.858725 | TASK [log-inventory : Copy ansible inventory to logs dir] 2025-12-04 12:16:10.521935 | localhost -> localhost | changed 2025-12-04 12:16:10.530001 | 2025-12-04 12:16:10.530067 | TASK [Setup log path fact] 2025-12-04 12:16:10.546722 | localhost | ok 2025-12-04 12:16:10.559847 | 2025-12-04 12:16:10.559979 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-12-04 12:16:10.576603 | localhost | ok 2025-12-04 12:16:10.584039 | 2025-12-04 12:16:10.584105 | TASK [emit-job-header : Print job information] 2025-12-04 12:16:10.610912 | # Job Information 2025-12-04 12:16:10.611027 | Ansible Version: 2.15.12 2025-12-04 12:16:10.611056 | Job: cifmw-molecule-reproducer 2025-12-04 12:16:10.611079 | Pipeline: github-check 2025-12-04 12:16:10.611099 | Executor: ibm-bm3-ze.softwarefactory-project.io 2025-12-04 12:16:10.611119 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3530 2025-12-04 12:16:10.611138 | Log URL (when completed): https://logserver.rdoproject.org/3d5/rdoproject.org/3d57aa174e9d4d5883b52d2f5f8368fd/ 2025-12-04 12:16:10.611157 | Event ID: d8f5f040-d10a-11f0-912a-2d01d3a55c10 2025-12-04 12:16:10.614858 | 2025-12-04 12:16:10.614921 | LOOP [emit-job-header : Print node information] 2025-12-04 12:16:10.697298 | localhost | ok: 2025-12-04 12:16:10.697458 | localhost | # Node Information 2025-12-04 12:16:10.697485 | localhost | Inventory Hostname: controller 2025-12-04 12:16:10.697507 | localhost | Hostname: np0005545596 2025-12-04 12:16:10.697525 | localhost | Username: zuul 2025-12-04 12:16:10.697543 | localhost | Distro: CentOS 9 2025-12-04 12:16:10.697559 | localhost | Provider: ibm-bm3-nodepool 2025-12-04 12:16:10.697575 | localhost | Region: regionOne 2025-12-04 12:16:10.697590 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2025-12-04 12:16:10.697605 | localhost | Product Name: OpenStack Compute 2025-12-04 12:16:10.697620 | localhost | Interface IP: 192.168.25.23 2025-12-04 12:16:10.720484 | 2025-12-04 12:16:10.720577 | PLAY [all] 2025-12-04 12:16:10.726987 | 2025-12-04 12:16:10.727052 | TASK [Gather network facts] 2025-12-04 12:16:11.211007 | controller | ok 2025-12-04 12:16:11.224849 | 2025-12-04 12:16:11.224910 | TASK [include_role : start-zuul-console] 2025-12-04 12:16:11.242465 | controller | ok 2025-12-04 12:16:11.254005 | 2025-12-04 12:16:11.254067 | TASK [start-zuul-console : Start zuul_console daemon.] 2025-12-04 12:16:11.646174 | controller | ok 2025-12-04 12:16:11.661008 | 2025-12-04 12:16:11.661100 | TASK [include_role : add-build-sshkey] 2025-12-04 12:16:11.679408 | controller | ok 2025-12-04 12:16:11.691708 | 2025-12-04 12:16:11.691783 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2025-12-04 12:16:11.890204 | controller -> localhost | ok 2025-12-04 12:16:11.895880 | 2025-12-04 12:16:11.895946 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2025-12-04 12:16:11.916101 | controller | ok 2025-12-04 12:16:11.928214 | controller | included: /var/lib/zuul/builds/3d57aa174e9d4d5883b52d2f5f8368fd/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2025-12-04 12:16:11.933630 | 2025-12-04 12:16:11.933732 | TASK [add-build-sshkey : Create Temp SSH key] 2025-12-04 12:16:12.393157 | controller -> localhost | Generating public/private rsa key pair. 2025-12-04 12:16:12.393327 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/3d57aa174e9d4d5883b52d2f5f8368fd/work/3d57aa174e9d4d5883b52d2f5f8368fd_id_rsa. 2025-12-04 12:16:12.393361 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/3d57aa174e9d4d5883b52d2f5f8368fd/work/3d57aa174e9d4d5883b52d2f5f8368fd_id_rsa.pub. 2025-12-04 12:16:12.393386 | controller -> localhost | The key fingerprint is: 2025-12-04 12:16:12.393408 | controller -> localhost | SHA256:xmjiFy+pLaLPzBD/kyXWEpjnOD050ZqMxO69mHK7Idw zuul-build-sshkey 2025-12-04 12:16:12.393428 | controller -> localhost | The key's randomart image is: 2025-12-04 12:16:12.393447 | controller -> localhost | +---[RSA 3072]----+ 2025-12-04 12:16:12.393465 | controller -> localhost | | | 2025-12-04 12:16:12.393484 | controller -> localhost | | | 2025-12-04 12:16:12.393502 | controller -> localhost | | . o . | 2025-12-04 12:16:12.393521 | controller -> localhost | | = + .o | 2025-12-04 12:16:12.393540 | controller -> localhost | |.o B.B+ S | 2025-12-04 12:16:12.393558 | controller -> localhost | |.o*.&oo= | 2025-12-04 12:16:12.393576 | controller -> localhost | |oooE.B+ . | 2025-12-04 12:16:12.393596 | controller -> localhost | |.*+==+ . | 2025-12-04 12:16:12.393614 | controller -> localhost | |.=X+++. | 2025-12-04 12:16:12.393632 | controller -> localhost | +----[SHA256]-----+ 2025-12-04 12:16:12.393692 | controller -> localhost | ok: Runtime: 0:00:00.134499 2025-12-04 12:16:12.399386 | 2025-12-04 12:16:12.399449 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2025-12-04 12:16:12.418074 | controller | ok 2025-12-04 12:16:12.427344 | controller | included: /var/lib/zuul/builds/3d57aa174e9d4d5883b52d2f5f8368fd/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2025-12-04 12:16:12.434935 | 2025-12-04 12:16:12.434997 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2025-12-04 12:16:12.448407 | controller | skipping: Conditional result was False 2025-12-04 12:16:12.453482 | 2025-12-04 12:16:12.453547 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2025-12-04 12:16:12.948937 | controller | changed 2025-12-04 12:16:12.953628 | 2025-12-04 12:16:12.953710 | TASK [add-build-sshkey : Make sure user has a .ssh] 2025-12-04 12:16:13.244969 | controller | ok 2025-12-04 12:16:13.249854 | 2025-12-04 12:16:13.249917 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2025-12-04 12:16:14.491095 | controller | changed 2025-12-04 12:16:14.496101 | 2025-12-04 12:16:14.496165 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2025-12-04 12:16:15.708228 | controller | changed 2025-12-04 12:16:15.713213 | 2025-12-04 12:16:15.713286 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2025-12-04 12:16:15.726699 | controller | skipping: Conditional result was False 2025-12-04 12:16:15.732332 | 2025-12-04 12:16:15.732409 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2025-12-04 12:16:16.014220 | controller -> localhost | changed 2025-12-04 12:16:16.023225 | 2025-12-04 12:16:16.023284 | TASK [add-build-sshkey : Add back temp key] 2025-12-04 12:16:16.230699 | controller -> localhost | Identity added: /var/lib/zuul/builds/3d57aa174e9d4d5883b52d2f5f8368fd/work/3d57aa174e9d4d5883b52d2f5f8368fd_id_rsa (zuul-build-sshkey) 2025-12-04 12:16:16.231000 | controller -> localhost | ok: Runtime: 0:00:00.006054 2025-12-04 12:16:16.236675 | 2025-12-04 12:16:16.236740 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2025-12-04 12:16:16.592118 | controller | ok 2025-12-04 12:16:16.596873 | 2025-12-04 12:16:16.596938 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2025-12-04 12:16:16.620834 | controller | skipping: Conditional result was False 2025-12-04 12:16:16.630399 | 2025-12-04 12:16:16.630465 | TASK [include_role : validate-host] 2025-12-04 12:16:16.649182 | controller | ok 2025-12-04 12:16:16.666419 | 2025-12-04 12:16:16.666487 | TASK [validate-host : Define zuul_info_dir fact] 2025-12-04 12:16:16.694120 | controller | ok 2025-12-04 12:16:16.698588 | 2025-12-04 12:16:16.698647 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2025-12-04 12:16:16.883912 | controller -> localhost | ok 2025-12-04 12:16:16.889088 | 2025-12-04 12:16:16.889149 | TASK [validate-host : Collect information about the host] 2025-12-04 12:16:17.623799 | controller | ok 2025-12-04 12:16:17.631545 | 2025-12-04 12:16:17.631606 | TASK [validate-host : Sanitize hostname] 2025-12-04 12:16:17.671747 | controller | ok 2025-12-04 12:16:17.676248 | 2025-12-04 12:16:17.676307 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2025-12-04 12:16:18.025328 | controller -> localhost | changed 2025-12-04 12:16:18.030553 | 2025-12-04 12:16:18.030620 | TASK [validate-host : Collect information about zuul worker] 2025-12-04 12:16:18.426505 | controller | ok 2025-12-04 12:16:18.431119 | 2025-12-04 12:16:18.431189 | TASK [validate-host : Write out all zuul information for each host] 2025-12-04 12:16:18.782127 | controller -> localhost | changed 2025-12-04 12:16:18.791463 | 2025-12-04 12:16:18.791526 | TASK [include_role : prepare-workspace-openshift] 2025-12-04 12:16:18.804786 | controller | skipping: Conditional result was False 2025-12-04 12:16:18.809253 | 2025-12-04 12:16:18.809313 | TASK [include_role : remove-zuul-sshkey] 2025-12-04 12:16:18.822143 | controller | skipping: Conditional result was False 2025-12-04 12:16:18.827207 | 2025-12-04 12:16:18.827274 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2025-12-04 12:16:19.094238 | controller | ok: "logs" 2025-12-04 12:16:19.094504 | controller | ok: All items complete 2025-12-04 12:16:19.094539 | 2025-12-04 12:16:19.347104 | controller | ok: "artifacts" 2025-12-04 12:16:19.598898 | controller | ok: "docs" 2025-12-04 12:16:19.606087 | 2025-12-04 12:16:19.606176 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2025-12-04 12:16:19.891308 | controller | changed: "logs" 2025-12-04 12:16:20.142058 | controller | changed: "artifacts" 2025-12-04 12:16:20.391075 | controller | changed: "docs" 2025-12-04 12:16:20.418585 | 2025-12-04 12:16:20.418685 | PLAY RECAP 2025-12-04 12:16:20.418729 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-12-04 12:16:20.418754 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-12-04 12:16:20.418784 | 2025-12-04 12:16:20.484077 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-12-04 12:16:20.484721 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-12-04 12:16:21.002393 | 2025-12-04 12:16:21.002486 | PLAY [all] 2025-12-04 12:16:21.021575 | 2025-12-04 12:16:21.021668 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-12-04 12:16:21.070641 | controller | ok 2025-12-04 12:16:21.075364 | 2025-12-04 12:16:21.075441 | TASK [mirror-info-fork : Create /etc/ci] 2025-12-04 12:16:21.479422 | controller | changed 2025-12-04 12:16:21.484741 | 2025-12-04 12:16:21.484826 | TASK [mirror-info-fork : Install ci_mirror script] 2025-12-04 12:16:22.805410 | controller | changed 2025-12-04 12:16:22.816105 | 2025-12-04 12:16:22.816177 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2025-12-04 12:16:23.242961 | controller | changed: 2025-12-04 12:16:23.243203 | controller | { 2025-12-04 12:16:23.243237 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2025-12-04 12:16:23.243271 | controller | } 2025-12-04 12:16:23.529083 | controller | changed: 2025-12-04 12:16:23.529164 | controller | { 2025-12-04 12:16:23.529192 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2025-12-04 12:16:23.529214 | controller | } 2025-12-04 12:16:23.816856 | controller | changed: 2025-12-04 12:16:23.816919 | controller | { 2025-12-04 12:16:23.816945 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2025-12-04 12:16:23.816965 | controller | } 2025-12-04 12:16:24.099573 | controller | changed: 2025-12-04 12:16:24.099676 | controller | { 2025-12-04 12:16:24.099710 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2025-12-04 12:16:24.099732 | controller | } 2025-12-04 12:16:24.395610 | controller | changed: 2025-12-04 12:16:24.395702 | controller | { 2025-12-04 12:16:24.395730 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2025-12-04 12:16:24.395749 | controller | } 2025-12-04 12:16:24.681553 | controller | changed: 2025-12-04 12:16:24.681642 | controller | { 2025-12-04 12:16:24.681690 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2025-12-04 12:16:24.681714 | controller | } 2025-12-04 12:16:24.970517 | controller | changed: 2025-12-04 12:16:24.970602 | controller | { 2025-12-04 12:16:24.970627 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2025-12-04 12:16:24.970647 | controller | } 2025-12-04 12:16:25.271822 | controller | changed: 2025-12-04 12:16:25.271910 | controller | { 2025-12-04 12:16:25.271937 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2025-12-04 12:16:25.271958 | controller | } 2025-12-04 12:16:25.557291 | controller | changed: 2025-12-04 12:16:25.557387 | controller | { 2025-12-04 12:16:25.557413 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2025-12-04 12:16:25.557433 | controller | } 2025-12-04 12:16:25.870057 | controller | changed: 2025-12-04 12:16:25.870129 | controller | { 2025-12-04 12:16:25.870155 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2025-12-04 12:16:25.870174 | controller | } 2025-12-04 12:16:26.136581 | controller | changed: 2025-12-04 12:16:26.136670 | controller | { 2025-12-04 12:16:26.136703 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2025-12-04 12:16:26.136725 | controller | } 2025-12-04 12:16:26.415540 | controller | changed: 2025-12-04 12:16:26.415623 | controller | { 2025-12-04 12:16:26.415668 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2025-12-04 12:16:26.415698 | controller | } 2025-12-04 12:16:26.697882 | controller | changed: 2025-12-04 12:16:26.697957 | controller | { 2025-12-04 12:16:26.697983 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGpU/BepK3qX0NRf5Np+dOBDqzQEefhNrw2DCZaH3uWW rebtoor@monolith" 2025-12-04 12:16:26.698003 | controller | } 2025-12-04 12:16:26.980875 | controller | changed: 2025-12-04 12:16:26.981004 | controller | { 2025-12-04 12:16:26.981032 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2025-12-04 12:16:26.981052 | controller | } 2025-12-04 12:16:27.264120 | controller | changed: 2025-12-04 12:16:27.264213 | controller | { 2025-12-04 12:16:27.264238 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2025-12-04 12:16:27.264258 | controller | } 2025-12-04 12:16:27.559603 | controller | changed: 2025-12-04 12:16:27.559704 | controller | { 2025-12-04 12:16:27.559740 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2025-12-04 12:16:27.559775 | controller | } 2025-12-04 12:16:27.843741 | controller | changed: 2025-12-04 12:16:27.843924 | controller | { 2025-12-04 12:16:27.843960 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2025-12-04 12:16:27.843982 | controller | } 2025-12-04 12:16:28.127492 | controller | changed: 2025-12-04 12:16:28.127578 | controller | { 2025-12-04 12:16:28.127613 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2025-12-04 12:16:28.127743 | controller | } 2025-12-04 12:16:28.410542 | controller | changed: 2025-12-04 12:16:28.410626 | controller | { 2025-12-04 12:16:28.410666 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2025-12-04 12:16:28.410692 | controller | } 2025-12-04 12:16:28.692464 | controller | changed: 2025-12-04 12:16:28.692543 | controller | { 2025-12-04 12:16:28.692568 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2025-12-04 12:16:28.692587 | controller | } 2025-12-04 12:16:28.988723 | controller | changed: 2025-12-04 12:16:28.988804 | controller | { 2025-12-04 12:16:28.988831 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2025-12-04 12:16:28.988851 | controller | } 2025-12-04 12:16:29.274384 | controller | changed: 2025-12-04 12:16:29.274472 | controller | { 2025-12-04 12:16:29.274497 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2025-12-04 12:16:29.274516 | controller | } 2025-12-04 12:16:29.562211 | controller | changed: 2025-12-04 12:16:29.562300 | controller | { 2025-12-04 12:16:29.562326 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2025-12-04 12:16:29.562348 | controller | } 2025-12-04 12:16:29.846479 | controller | changed: 2025-12-04 12:16:29.846554 | controller | { 2025-12-04 12:16:29.846579 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2025-12-04 12:16:29.846598 | controller | } 2025-12-04 12:16:30.132507 | controller | changed: 2025-12-04 12:16:30.132592 | controller | { 2025-12-04 12:16:30.132618 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2025-12-04 12:16:30.132638 | controller | } 2025-12-04 12:16:30.417807 | controller | changed: 2025-12-04 12:16:30.417892 | controller | { 2025-12-04 12:16:30.417917 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2025-12-04 12:16:30.417937 | controller | } 2025-12-04 12:16:30.439868 | 2025-12-04 12:16:30.439962 | TASK [Set timezone to UTC] 2025-12-04 12:16:30.950259 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2025-12-04 12:16:30.964962 | 2025-12-04 12:16:30.965073 | TASK [Create nodepool directory] 2025-12-04 12:16:31.239199 | controller | changed 2025-12-04 12:16:31.244685 | 2025-12-04 12:16:31.244753 | TASK [Create nodepool sub_nodes file] 2025-12-04 12:16:32.208853 | controller | changed 2025-12-04 12:16:32.214089 | 2025-12-04 12:16:32.214157 | TASK [Create nodepool sub_nodes_private file] 2025-12-04 12:16:33.206333 | controller | changed 2025-12-04 12:16:33.211113 | 2025-12-04 12:16:33.211176 | LOOP [Populate nodepool sub_nodes file] 2025-12-04 12:16:33.239276 | 2025-12-04 12:16:33.239398 | LOOP [Populate nodepool sub_nodes_private file] 2025-12-04 12:16:33.266925 | 2025-12-04 12:16:33.267054 | TASK [Create nodepool primary file] 2025-12-04 12:16:33.289741 | controller | skipping: Conditional result was False 2025-12-04 12:16:33.294675 | 2025-12-04 12:16:33.294747 | TASK [Create nodepool node_private for this node] 2025-12-04 12:16:34.284232 | controller | changed 2025-12-04 12:16:34.289437 | 2025-12-04 12:16:34.289499 | LOOP [Copy ssh keys to nodepool directory] 2025-12-04 12:16:34.653057 | controller | ok: Item: id_rsa Runtime: 0:00:00.004790 2025-12-04 12:16:34.653233 | 2025-12-04 12:16:34.874631 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.004813 2025-12-04 12:16:34.884870 | 2025-12-04 12:16:34.884987 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2025-12-04 12:16:35.806672 | controller | changed 2025-12-04 12:16:35.811558 | 2025-12-04 12:16:35.811631 | TASK [Validate sudoers config after edits] 2025-12-04 12:16:36.092607 | controller | /etc/sudoers: parsed OK 2025-12-04 12:16:36.092659 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2025-12-04 12:16:36.092670 | controller | /etc/sudoers.d/zuul: parsed OK 2025-12-04 12:16:36.092677 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2025-12-04 12:16:36.353841 | controller | ok: Runtime: 0:00:00.004883 2025-12-04 12:16:36.359008 | 2025-12-04 12:16:36.359078 | TASK [Show the environment passed in to job shell scripts] 2025-12-04 12:16:36.619305 | controller | SHELL=/bin/bash 2025-12-04 12:16:36.619350 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2025-12-04 12:16:36.619360 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2025-12-04 12:16:36.619367 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/30/3530/29b0a16c57f7b8e1df1b2a19cc29f382feb0e0da 2025-12-04 12:16:36.619372 | controller | PWD=/home/zuul 2025-12-04 12:16:36.619378 | controller | ZUUL_PIPELINE=github-check 2025-12-04 12:16:36.619384 | controller | LOGNAME=zuul 2025-12-04 12:16:36.619444 | controller | XDG_SESSION_TYPE=tty 2025-12-04 12:16:36.619455 | controller | _=/usr/bin/env 2025-12-04 12:16:36.619461 | controller | MOTD_SHOWN=pam 2025-12-04 12:16:36.619467 | controller | HOME=/home/zuul 2025-12-04 12:16:36.619472 | controller | LANG=en_US.UTF-8 2025-12-04 12:16:36.619477 | controller | SSH_CONNECTION=192.168.25.12 53022 192.168.25.23 22 2025-12-04 12:16:36.619483 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2025-12-04 12:16:36.619492 | controller | ZUUL_CHANGE_IDS=3530,29b0a16c57f7b8e1df1b2a19cc29f382feb0e0da 2025-12-04 12:16:36.619498 | controller | WORKSPACE=/home/zuul/workspace 2025-12-04 12:16:36.619503 | controller | XDG_SESSION_CLASS=user 2025-12-04 12:16:36.619508 | controller | SELINUX_ROLE_REQUESTED= 2025-12-04 12:16:36.619514 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2025-12-04 12:16:36.619520 | controller | USER=zuul 2025-12-04 12:16:36.619525 | controller | ZUUL_VOTING=True 2025-12-04 12:16:36.619531 | controller | BUILD_TIMEOUT=5400000 2025-12-04 12:16:36.619536 | controller | SELINUX_USE_CURRENT_RANGE= 2025-12-04 12:16:36.619542 | controller | SHLVL=1 2025-12-04 12:16:36.619547 | controller | ZUUL_PATCHSET=29b0a16c57f7b8e1df1b2a19cc29f382feb0e0da 2025-12-04 12:16:36.619553 | controller | XDG_SESSION_ID=1 2025-12-04 12:16:36.619559 | controller | ZUUL_BRANCH=main 2025-12-04 12:16:36.619564 | controller | XDG_RUNTIME_DIR=/run/user/1000 2025-12-04 12:16:36.619570 | controller | SSH_CLIENT=192.168.25.12 53022 22 2025-12-04 12:16:36.619577 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2025-12-04 12:16:36.619582 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2025-12-04 12:16:36.619588 | controller | which_declare=declare -f 2025-12-04 12:16:36.619594 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2025-12-04 12:16:36.619600 | controller | SELINUX_LEVEL_REQUESTED= 2025-12-04 12:16:36.619605 | controller | ZUUL_CHANGE=3530 2025-12-04 12:16:36.619610 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2025-12-04 12:16:36.619616 | controller | ZUUL_UUID=3d57aa174e9d4d5883b52d2f5f8368fd 2025-12-04 12:16:36.619621 | controller | BASH_FUNC_which%%=() { ( alias; 2025-12-04 12:16:36.619627 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2025-12-04 12:16:36.619632 | controller | } 2025-12-04 12:16:36.888247 | controller | ok: Runtime: 0:00:00.006102 2025-12-04 12:16:36.893606 | 2025-12-04 12:16:36.893692 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2025-12-04 12:16:36.908186 | controller | skipping: Conditional result was False 2025-12-04 12:16:36.918956 | 2025-12-04 12:16:36.919066 | TASK [Symlink /home/zuul-worker/workspace] 2025-12-04 12:16:37.463424 | controller | skipping: Conditional result was False 2025-12-04 12:16:37.468957 | 2025-12-04 12:16:37.469024 | TASK [Ensure legacy workspace directory] 2025-12-04 12:16:37.720509 | controller | changed 2025-12-04 12:16:37.738300 | 2025-12-04 12:16:37.738363 | PLAY RECAP 2025-12-04 12:16:37.738415 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-12-04 12:16:37.738444 | 2025-12-04 12:16:37.804513 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-12-04 12:16:37.805254 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-12-04 12:16:38.295576 | 2025-12-04 12:16:38.295689 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2025-12-04 12:16:38.315432 | 2025-12-04 12:16:38.315504 | TASK [Create zuul-output directory] 2025-12-04 12:16:38.678637 | controller | changed 2025-12-04 12:16:38.683483 | 2025-12-04 12:16:38.683559 | TASK [Slurp Zuul inventory test] 2025-12-04 12:16:38.939901 | controller -> localhost | ok 2025-12-04 12:16:38.945796 | 2025-12-04 12:16:38.945860 | TASK [Save zuul inventory] 2025-12-04 12:16:40.078058 | controller | changed 2025-12-04 12:16:40.082778 | 2025-12-04 12:16:40.082845 | TASK [Save zuul vars without the change_message] 2025-12-04 12:16:41.033521 | controller | changed 2025-12-04 12:16:41.051212 | 2025-12-04 12:16:41.051263 | PLAY RECAP 2025-12-04 12:16:41.051305 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-12-04 12:16:41.051327 | 2025-12-04 12:16:41.111309 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-12-04 12:16:41.112070 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-12-04 12:16:41.623110 | 2025-12-04 12:16:41.623202 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2025-12-04 12:16:41.641475 | 2025-12-04 12:16:41.641540 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2025-12-04 12:16:41.659581 | controller | ok 2025-12-04 12:16:41.675447 | 2025-12-04 12:16:41.675520 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-12-04 12:16:41.698915 | controller | skipping: Conditional result was False 2025-12-04 12:16:41.703934 | 2025-12-04 12:16:41.703995 | TASK [mirror-info-fork : Create /etc/ci] 2025-12-04 12:16:42.066908 | controller | ok 2025-12-04 12:16:42.072416 | 2025-12-04 12:16:42.072485 | TASK [mirror-info-fork : Install ci_mirror script] 2025-12-04 12:16:42.971720 | controller | ok 2025-12-04 12:16:42.981441 | 2025-12-04 12:16:42.981508 | TASK [Prepare workspace] 2025-12-04 12:16:42.998710 | controller | ok 2025-12-04 12:16:43.014405 | 2025-12-04 12:16:43.014481 | TASK [prepare-workspace : Start zuul_console daemon.] 2025-12-04 12:16:43.398876 | controller | ok 2025-12-04 12:16:43.404371 | 2025-12-04 12:16:43.404433 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2025-12-04 12:16:45.750374 | controller | Output suppressed because no_log was given 2025-12-04 12:16:45.758847 | 2025-12-04 12:16:45.758907 | LOOP [Create zuul-output directory] 2025-12-04 12:16:46.010202 | controller | changed: "/home/zuul/ci-framework-data/logs" 2025-12-04 12:16:46.228872 | controller | ok: "/home/zuul/zuul-output/logs" 2025-12-04 12:16:46.243206 | 2025-12-04 12:16:46.243270 | TASK [Install required packages] 2025-12-04 12:17:14.829248 | controller | ok: Nothing to do 2025-12-04 12:17:14.834117 | 2025-12-04 12:17:14.834200 | TASK [Install venv] 2025-12-04 12:18:13.260980 | controller | changed 2025-12-04 12:18:13.303254 | 2025-12-04 12:18:13.303333 | PLAY RECAP 2025-12-04 12:18:13.303372 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-12-04 12:18:13.303395 | 2025-12-04 12:18:13.363878 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-12-04 12:18:13.364641 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-12-04 12:18:13.861380 | 2025-12-04 12:18:13.861475 | PLAY [Run ci/playbooks/molecule-test.yml] 2025-12-04 12:18:13.880082 | 2025-12-04 12:18:13.880147 | TASK [Gather required facts] 2025-12-04 12:18:14.396034 | controller | ok 2025-12-04 12:18:14.401420 | 2025-12-04 12:18:14.401492 | TASK [Load environment var if instructed to] 2025-12-04 12:18:14.425719 | controller | skipping: Conditional result was False 2025-12-04 12:18:14.430671 | 2025-12-04 12:18:14.430732 | TASK [Ensure group_vars dir exists] 2025-12-04 12:18:14.783732 | controller | ok 2025-12-04 12:18:14.789565 | 2025-12-04 12:18:14.789630 | TASK [Print related variables] 2025-12-04 12:18:14.818457 | controller | ok: 2025-12-04 12:18:14.818572 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2025-12-04 12:18:14.818601 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2025-12-04 12:18:14.823072 | 2025-12-04 12:18:14.823133 | TASK [Run molecule] 2025-12-04 12:18:15.795010 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2025-12-04 12:18:16.080315 | controller | INFO Performing prerun with role_name_check=0... 2025-12-04 12:18:32.222698 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 12:18:32.223159 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 12:18:32.223639 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 12:18:32.224086 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 12:18:32.224590 | controller | WARNING Another version of 'cifmw.general' 1.0.0+29b0a16c was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+29b0a16c (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 12:18:32.225045 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 12:18:32.225511 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 12:18:32.225951 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 12:18:32.226399 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 12:18:32.226847 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 12:18:32.227270 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 12:18:32.227737 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 12:18:32.228176 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 12:18:32.228642 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 12:18:32.229090 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 12:18:32.239373 | controller | INFO Running crc_layout > prepare 2025-12-04 12:18:32.910661 | controller | 2025-12-04 12:18:32.910750 | controller | PLAY [Prepare] ***************************************************************** 2025-12-04 12:18:32.910840 | controller | 2025-12-04 12:18:32.910932 | controller | TASK [Gathering Facts] ********************************************************* 2025-12-04 12:18:32.911026 | controller | Thursday 04 December 2025 12:18:32 +0000 (0:00:00.017) 0:00:00.017 ***** 2025-12-04 12:18:33.767588 | controller | ok: [instance] 2025-12-04 12:18:33.767673 | controller | 2025-12-04 12:18:33.767809 | controller | TASK [Create custom basedir] *************************************************** 2025-12-04 12:18:33.767952 | controller | Thursday 04 December 2025 12:18:33 +0000 (0:00:00.857) 0:00:00.874 ***** 2025-12-04 12:18:34.104740 | controller | changed: [instance] 2025-12-04 12:18:34.104885 | controller | 2025-12-04 12:18:34.105060 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2025-12-04 12:18:34.105144 | controller | Thursday 04 December 2025 12:18:34 +0000 (0:00:00.336) 0:00:01.211 ***** 2025-12-04 12:18:34.122578 | controller | skipping: [instance] 2025-12-04 12:18:34.122660 | controller | 2025-12-04 12:18:34.122762 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2025-12-04 12:18:34.122864 | controller | Thursday 04 December 2025 12:18:34 +0000 (0:00:00.018) 0:00:01.230 ***** 2025-12-04 12:18:34.164047 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2025-12-04 12:18:34.164103 | controller | 2025-12-04 12:18:34.164218 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2025-12-04 12:18:34.164366 | controller | Thursday 04 December 2025 12:18:34 +0000 (0:00:00.041) 0:00:01.271 ***** 2025-12-04 12:18:34.458373 | controller | ok: [instance] 2025-12-04 12:18:34.458424 | controller | 2025-12-04 12:18:34.458570 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2025-12-04 12:18:34.458647 | controller | Thursday 04 December 2025 12:18:34 +0000 (0:00:00.294) 0:00:01.565 ***** 2025-12-04 12:18:34.671993 | controller | ok: [instance] 2025-12-04 12:18:34.672041 | controller | 2025-12-04 12:18:34.672159 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2025-12-04 12:18:34.672264 | controller | Thursday 04 December 2025 12:18:34 +0000 (0:00:00.213) 0:00:01.779 ***** 2025-12-04 12:18:35.384266 | controller | ok: [instance] => (item=ubi-9-appstream) 2025-12-04 12:18:35.384357 | controller | ok: [instance] => (item=ubi-9-baseos) 2025-12-04 12:18:35.384469 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2025-12-04 12:18:35.384562 | controller | 2025-12-04 12:18:35.384656 | controller | TASK [Deploy repo-setup] ******************************************************* 2025-12-04 12:18:35.384738 | controller | Thursday 04 December 2025 12:18:35 +0000 (0:00:00.711) 0:00:02.491 ***** 2025-12-04 12:18:35.445273 | controller | 2025-12-04 12:18:35.445385 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-12-04 12:18:35.445524 | controller | Thursday 04 December 2025 12:18:35 +0000 (0:00:00.061) 0:00:02.552 ***** 2025-12-04 12:18:36.018633 | controller | changed: [instance] => (item=tmp) 2025-12-04 12:18:36.018728 | controller | changed: [instance] => (item=artifacts/repositories) 2025-12-04 12:18:36.018853 | controller | changed: [instance] => (item=venv/repo_setup) 2025-12-04 12:18:36.018964 | controller | 2025-12-04 12:18:36.019092 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-12-04 12:18:36.019207 | controller | Thursday 04 December 2025 12:18:36 +0000 (0:00:00.572) 0:00:03.125 ***** 2025-12-04 12:18:36.880230 | controller | ok: [instance] 2025-12-04 12:18:36.880580 | controller | 2025-12-04 12:18:37.965452 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-12-04 12:18:37.965512 | controller | Thursday 04 December 2025 12:18:36 +0000 (0:00:00.861) 0:00:03.986 ***** 2025-12-04 12:18:37.965525 | controller | changed: [instance] 2025-12-04 12:18:37.965532 | controller | 2025-12-04 12:18:37.965548 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-12-04 12:18:45.586486 | controller | Thursday 04 December 2025 12:18:37 +0000 (0:00:01.085) 0:00:05.072 ***** 2025-12-04 12:18:45.586562 | controller | changed: [instance] 2025-12-04 12:18:46.341830 | controller | 2025-12-04 12:18:46.341864 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-12-04 12:18:46.341871 | controller | Thursday 04 December 2025 12:18:45 +0000 (0:00:07.620) 0:00:12.693 ***** 2025-12-04 12:18:46.341881 | controller | changed: [instance] 2025-12-04 12:18:46.376240 | controller | 2025-12-04 12:18:46.376274 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-12-04 12:18:46.376282 | controller | Thursday 04 December 2025 12:18:46 +0000 (0:00:00.755) 0:00:13.448 ***** 2025-12-04 12:18:46.376291 | controller | skipping: [instance] 2025-12-04 12:18:47.246290 | controller | 2025-12-04 12:18:47.246320 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-12-04 12:18:47.246328 | controller | Thursday 04 December 2025 12:18:46 +0000 (0:00:00.034) 0:00:13.483 ***** 2025-12-04 12:18:47.246337 | controller | changed: [instance] 2025-12-04 12:18:47.284335 | controller | 2025-12-04 12:18:47.284366 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-12-04 12:18:47.284374 | controller | Thursday 04 December 2025 12:18:47 +0000 (0:00:00.869) 0:00:14.353 ***** 2025-12-04 12:18:47.284383 | controller | skipping: [instance] 2025-12-04 12:18:47.284683 | controller | 2025-12-04 12:18:47.284702 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-12-04 12:18:47.319039 | controller | Thursday 04 December 2025 12:18:47 +0000 (0:00:00.038) 0:00:14.391 ***** 2025-12-04 12:18:47.319058 | controller | skipping: [instance] 2025-12-04 12:18:47.354441 | controller | 2025-12-04 12:18:47.354480 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-12-04 12:18:47.354490 | controller | Thursday 04 December 2025 12:18:47 +0000 (0:00:00.034) 0:00:14.425 ***** 2025-12-04 12:18:47.354503 | controller | skipping: [instance] 2025-12-04 12:18:47.354535 | controller | 2025-12-04 12:18:47.354544 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-12-04 12:18:47.354570 | controller | Thursday 04 December 2025 12:18:47 +0000 (0:00:00.035) 0:00:14.461 ***** 2025-12-04 12:18:47.889057 | controller | changed: [instance] 2025-12-04 12:18:48.349420 | controller | 2025-12-04 12:18:48.349466 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-12-04 12:18:48.349476 | controller | Thursday 04 December 2025 12:18:47 +0000 (0:00:00.534) 0:00:14.995 ***** 2025-12-04 12:18:48.349489 | controller | changed: [instance] 2025-12-04 12:18:48.349545 | controller | 2025-12-04 12:18:48.349556 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-12-04 12:18:48.380429 | controller | Thursday 04 December 2025 12:18:48 +0000 (0:00:00.460) 0:00:15.456 ***** 2025-12-04 12:18:48.380476 | controller | skipping: [instance] 2025-12-04 12:18:48.409355 | controller | 2025-12-04 12:18:48.409378 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-12-04 12:18:48.409387 | controller | Thursday 04 December 2025 12:18:48 +0000 (0:00:00.030) 0:00:15.487 ***** 2025-12-04 12:18:48.409403 | controller | skipping: [instance] 2025-12-04 12:18:48.409446 | controller | 2025-12-04 12:18:48.409757 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-12-04 12:18:48.438215 | controller | Thursday 04 December 2025 12:18:48 +0000 (0:00:00.029) 0:00:15.516 ***** 2025-12-04 12:18:48.438233 | controller | skipping: [instance] 2025-12-04 12:18:48.476176 | controller | 2025-12-04 12:18:48.476191 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-12-04 12:18:48.476198 | controller | Thursday 04 December 2025 12:18:48 +0000 (0:00:00.028) 0:00:15.545 ***** 2025-12-04 12:18:48.476206 | controller | ok: [instance] 2025-12-04 12:18:48.503354 | controller | 2025-12-04 12:18:48.503379 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-12-04 12:18:48.503388 | controller | Thursday 04 December 2025 12:18:48 +0000 (0:00:00.037) 0:00:15.583 ***** 2025-12-04 12:18:48.503416 | controller | skipping: [instance] 2025-12-04 12:18:48.529841 | controller | 2025-12-04 12:18:48.529878 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-12-04 12:18:48.529891 | controller | Thursday 04 December 2025 12:18:48 +0000 (0:00:00.027) 0:00:15.610 ***** 2025-12-04 12:18:48.529907 | controller | skipping: [instance] 2025-12-04 12:18:48.529920 | controller | 2025-12-04 12:18:48.530139 | controller | TASK [Download the RPM] ******************************************************** 2025-12-04 12:18:48.530211 | controller | Thursday 04 December 2025 12:18:48 +0000 (0:00:00.027) 0:00:15.637 ***** 2025-12-04 12:18:48.559204 | controller | skipping: [instance] 2025-12-04 12:18:48.559381 | controller | 2025-12-04 12:18:48.559552 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-12-04 12:18:48.559674 | controller | Thursday 04 December 2025 12:18:48 +0000 (0:00:00.029) 0:00:15.666 ***** 2025-12-04 12:18:48.588051 | controller | skipping: [instance] 2025-12-04 12:18:48.588275 | controller | 2025-12-04 12:18:48.588515 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-12-04 12:18:48.588610 | controller | Thursday 04 December 2025 12:18:48 +0000 (0:00:00.028) 0:00:15.695 ***** 2025-12-04 12:18:48.613836 | controller | skipping: [instance] 2025-12-04 12:18:48.614056 | controller | 2025-12-04 12:18:48.614354 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-12-04 12:18:48.614478 | controller | Thursday 04 December 2025 12:18:48 +0000 (0:00:00.025) 0:00:15.721 ***** 2025-12-04 12:18:48.643514 | controller | skipping: [instance] 2025-12-04 12:18:48.643756 | controller | 2025-12-04 12:18:48.643869 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-12-04 12:18:48.644025 | controller | Thursday 04 December 2025 12:18:48 +0000 (0:00:00.029) 0:00:15.750 ***** 2025-12-04 12:18:48.669697 | controller | skipping: [instance] 2025-12-04 12:18:48.669915 | controller | 2025-12-04 12:18:48.670137 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-12-04 12:18:48.670302 | controller | Thursday 04 December 2025 12:18:48 +0000 (0:00:00.026) 0:00:15.777 ***** 2025-12-04 12:18:48.866290 | controller | ok: [instance] 2025-12-04 12:18:49.075395 | controller | 2025-12-04 12:18:49.075442 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-12-04 12:18:49.075451 | controller | Thursday 04 December 2025 12:18:48 +0000 (0:00:00.195) 0:00:15.973 ***** 2025-12-04 12:18:49.075464 | controller | changed: [instance] 2025-12-04 12:18:49.295806 | controller | 2025-12-04 12:18:49.295835 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-12-04 12:18:49.295843 | controller | Thursday 04 December 2025 12:18:49 +0000 (0:00:00.209) 0:00:16.182 ***** 2025-12-04 12:18:49.295854 | controller | changed: [instance] 2025-12-04 12:18:49.317701 | controller | 2025-12-04 12:18:49.317717 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-12-04 12:18:49.317723 | controller | Thursday 04 December 2025 12:18:49 +0000 (0:00:00.220) 0:00:16.402 ***** 2025-12-04 12:18:49.317731 | controller | skipping: [instance] 2025-12-04 12:18:49.339970 | controller | 2025-12-04 12:18:49.339986 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-12-04 12:18:49.339993 | controller | Thursday 04 December 2025 12:18:49 +0000 (0:00:00.022) 0:00:16.425 ***** 2025-12-04 12:18:49.340001 | controller | skipping: [instance] 2025-12-04 12:18:49.361836 | controller | 2025-12-04 12:18:49.361854 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-12-04 12:18:49.361861 | controller | Thursday 04 December 2025 12:18:49 +0000 (0:00:00.022) 0:00:16.447 ***** 2025-12-04 12:18:49.361877 | controller | skipping: [instance] 2025-12-04 12:18:49.384026 | controller | 2025-12-04 12:18:49.384042 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-12-04 12:18:49.384048 | controller | Thursday 04 December 2025 12:18:49 +0000 (0:00:00.021) 0:00:16.469 ***** 2025-12-04 12:18:49.384056 | controller | skipping: [instance] 2025-12-04 12:18:49.405971 | controller | 2025-12-04 12:18:49.405987 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-12-04 12:18:49.406000 | controller | Thursday 04 December 2025 12:18:49 +0000 (0:00:00.022) 0:00:16.491 ***** 2025-12-04 12:18:49.406008 | controller | skipping: [instance] 2025-12-04 12:18:49.429343 | controller | 2025-12-04 12:18:49.429379 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-12-04 12:18:49.429387 | controller | Thursday 04 December 2025 12:18:49 +0000 (0:00:00.021) 0:00:16.513 ***** 2025-12-04 12:18:49.429398 | controller | skipping: [instance] 2025-12-04 12:18:49.446857 | controller | 2025-12-04 12:18:49.446876 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-12-04 12:18:49.446884 | controller | Thursday 04 December 2025 12:18:49 +0000 (0:00:00.023) 0:00:16.536 ***** 2025-12-04 12:18:49.446892 | controller | skipping: [instance] 2025-12-04 12:18:49.476126 | controller | 2025-12-04 12:18:49.476141 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-12-04 12:18:49.476148 | controller | Thursday 04 December 2025 12:18:49 +0000 (0:00:00.017) 0:00:16.554 ***** 2025-12-04 12:18:49.476156 | controller | skipping: [instance] 2025-12-04 12:18:49.476314 | controller | 2025-12-04 12:18:49.476473 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-12-04 12:18:49.476616 | controller | Thursday 04 December 2025 12:18:49 +0000 (0:00:00.029) 0:00:16.583 ***** 2025-12-04 12:18:49.493919 | controller | skipping: [instance] 2025-12-04 12:18:49.494094 | controller | 2025-12-04 12:18:49.494228 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-12-04 12:18:49.494385 | controller | Thursday 04 December 2025 12:18:49 +0000 (0:00:00.017) 0:00:16.601 ***** 2025-12-04 12:18:49.514632 | controller | skipping: [instance] 2025-12-04 12:18:49.514768 | controller | 2025-12-04 12:18:49.514902 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2025-12-04 12:18:49.515036 | controller | Thursday 04 December 2025 12:18:49 +0000 (0:00:00.020) 0:00:16.622 ***** 2025-12-04 12:18:49.542778 | controller | skipping: [instance] 2025-12-04 12:18:49.542930 | controller | 2025-12-04 12:18:49.543073 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2025-12-04 12:18:49.543219 | controller | Thursday 04 December 2025 12:18:49 +0000 (0:00:00.028) 0:00:16.650 ***** 2025-12-04 12:18:49.570779 | controller | skipping: [instance] 2025-12-04 12:18:49.571055 | controller | 2025-12-04 12:18:49.571359 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2025-12-04 12:18:49.571647 | controller | Thursday 04 December 2025 12:18:49 +0000 (0:00:00.027) 0:00:16.678 ***** 2025-12-04 12:18:49.599544 | controller | skipping: [instance] 2025-12-04 12:18:49.599816 | controller | 2025-12-04 12:18:49.600086 | controller | TASK [test_deps : Install additional packages] ********************************* 2025-12-04 12:18:49.600441 | controller | Thursday 04 December 2025 12:18:49 +0000 (0:00:00.028) 0:00:16.706 ***** 2025-12-04 12:18:49.629012 | controller | skipping: [instance] 2025-12-04 12:18:49.629324 | controller | 2025-12-04 12:18:49.629519 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2025-12-04 12:18:49.629648 | controller | Thursday 04 December 2025 12:18:49 +0000 (0:00:00.029) 0:00:16.736 ***** 2025-12-04 12:19:36.217045 | controller | ok: [instance] 2025-12-04 12:19:37.392722 | controller | 2025-12-04 12:19:37.392751 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2025-12-04 12:19:37.392759 | controller | Thursday 04 December 2025 12:19:36 +0000 (0:00:46.587) 0:01:03.323 ***** 2025-12-04 12:19:37.392769 | controller | ok: [instance] 2025-12-04 12:19:37.424332 | controller | 2025-12-04 12:19:37.424355 | controller | TASK [test_deps : Install extra packages] ************************************** 2025-12-04 12:19:37.424362 | controller | Thursday 04 December 2025 12:19:37 +0000 (0:00:01.175) 0:01:04.499 ***** 2025-12-04 12:19:37.424372 | controller | skipping: [instance] 2025-12-04 12:19:37.424545 | controller | 2025-12-04 12:19:37.424564 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-12-04 12:19:37.466234 | controller | Thursday 04 December 2025 12:19:37 +0000 (0:00:00.032) 0:01:04.531 ***** 2025-12-04 12:19:37.466287 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2025-12-04 12:19:37.485303 | controller | 2025-12-04 12:19:37.485322 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-12-04 12:19:37.485330 | controller | Thursday 04 December 2025 12:19:37 +0000 (0:00:00.041) 0:01:04.573 ***** 2025-12-04 12:19:37.485338 | controller | ok: [instance] => 2025-12-04 12:19:37.485873 | controller | cifmw_ci_setup_packages: 2025-12-04 12:19:37.485888 | controller | - bash-completion 2025-12-04 12:19:37.485894 | controller | - ca-certificates 2025-12-04 12:19:37.485899 | controller | - git-core 2025-12-04 12:19:37.485904 | controller | - make 2025-12-04 12:19:37.485912 | controller | - tar 2025-12-04 12:19:41.803637 | controller | - tmux 2025-12-04 12:19:41.803667 | controller | - python3-pip 2025-12-04 12:19:41.803675 | controller | 2025-12-04 12:19:41.803681 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-12-04 12:19:41.803692 | controller | Thursday 04 December 2025 12:19:37 +0000 (0:00:00.018) 0:01:04.592 ***** 2025-12-04 12:19:41.803702 | controller | changed: [instance] 2025-12-04 12:19:42.353986 | controller | 2025-12-04 12:19:42.354015 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-12-04 12:19:42.354023 | controller | Thursday 04 December 2025 12:19:41 +0000 (0:00:04.318) 0:01:08.910 ***** 2025-12-04 12:19:42.354033 | controller | ok: [instance] 2025-12-04 12:19:42.544841 | controller | 2025-12-04 12:19:42.544868 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-12-04 12:19:42.544876 | controller | Thursday 04 December 2025 12:19:42 +0000 (0:00:00.550) 0:01:09.461 ***** 2025-12-04 12:19:42.544885 | controller | changed: [instance] 2025-12-04 12:19:48.486293 | controller | 2025-12-04 12:19:48.486325 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-12-04 12:19:48.486333 | controller | Thursday 04 December 2025 12:19:42 +0000 (0:00:00.190) 0:01:09.651 ***** 2025-12-04 12:19:48.486342 | controller | changed: [instance] 2025-12-04 12:19:48.521071 | controller | 2025-12-04 12:19:48.521102 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-12-04 12:19:48.521110 | controller | Thursday 04 December 2025 12:19:48 +0000 (0:00:05.941) 0:01:15.593 ***** 2025-12-04 12:19:48.521120 | controller | ok: [instance] 2025-12-04 12:19:48.521144 | controller | 2025-12-04 12:19:48.521284 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-12-04 12:19:48.521443 | controller | Thursday 04 December 2025 12:19:48 +0000 (0:00:00.035) 0:01:15.628 ***** 2025-12-04 12:19:48.775913 | controller | changed: [instance] 2025-12-04 12:19:49.040212 | controller | 2025-12-04 12:19:49.040243 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-12-04 12:19:49.040273 | controller | Thursday 04 December 2025 12:19:48 +0000 (0:00:00.254) 0:01:15.882 ***** 2025-12-04 12:19:49.040284 | controller | changed: [instance] 2025-12-04 12:19:49.057143 | controller | 2025-12-04 12:19:49.057165 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-12-04 12:19:49.057174 | controller | Thursday 04 December 2025 12:19:49 +0000 (0:00:00.264) 0:01:16.147 ***** 2025-12-04 12:19:49.057185 | controller | skipping: [instance] 2025-12-04 12:19:49.073298 | controller | 2025-12-04 12:19:49.073320 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-12-04 12:19:49.073327 | controller | Thursday 04 December 2025 12:19:49 +0000 (0:00:00.017) 0:01:16.164 ***** 2025-12-04 12:19:49.073337 | controller | skipping: [instance] 2025-12-04 12:19:49.073427 | controller | 2025-12-04 12:19:49.073493 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-12-04 12:19:49.073623 | controller | Thursday 04 December 2025 12:19:49 +0000 (0:00:00.016) 0:01:16.180 ***** 2025-12-04 12:19:49.090105 | controller | skipping: [instance] 2025-12-04 12:19:49.105743 | controller | 2025-12-04 12:19:49.105763 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-12-04 12:19:49.105772 | controller | Thursday 04 December 2025 12:19:49 +0000 (0:00:00.016) 0:01:16.197 ***** 2025-12-04 12:19:49.105783 | controller | skipping: [instance] 2025-12-04 12:19:49.121898 | controller | 2025-12-04 12:19:49.121915 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-12-04 12:19:49.121929 | controller | Thursday 04 December 2025 12:19:49 +0000 (0:00:00.015) 0:01:16.213 ***** 2025-12-04 12:19:49.121938 | controller | skipping: [instance] 2025-12-04 12:19:49.141860 | controller | 2025-12-04 12:19:49.141880 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-12-04 12:19:49.141888 | controller | Thursday 04 December 2025 12:19:49 +0000 (0:00:00.016) 0:01:16.229 ***** 2025-12-04 12:19:49.141898 | controller | skipping: [instance] 2025-12-04 12:19:50.079316 | controller | 2025-12-04 12:19:50.079347 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-12-04 12:19:50.079355 | controller | Thursday 04 December 2025 12:19:49 +0000 (0:00:00.019) 0:01:16.249 ***** 2025-12-04 12:19:50.079365 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2025-12-04 12:19:50.079389 | controller | changed: [instance] => (item=/opt/basedir/logs) 2025-12-04 12:19:50.079398 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2025-12-04 12:19:50.079941 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2025-12-04 12:19:50.406364 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2025-12-04 12:19:50.406398 | controller | 2025-12-04 12:19:50.406407 | controller | TASK [Create secret file] ****************************************************** 2025-12-04 12:19:50.406415 | controller | Thursday 04 December 2025 12:19:50 +0000 (0:00:00.937) 0:01:17.186 ***** 2025-12-04 12:19:50.406427 | controller | changed: [instance] 2025-12-04 12:19:50.406455 | controller | 2025-12-04 12:19:50.406463 | controller | PLAY RECAP ********************************************************************* 2025-12-04 12:19:50.406470 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2025-12-04 12:19:50.406477 | controller | 2025-12-04 12:19:50.406499 | controller | Thursday 04 December 2025 12:19:50 +0000 (0:00:00.326) 0:01:17.513 ***** 2025-12-04 12:19:50.407326 | controller | =============================================================================== 2025-12-04 12:19:50.407367 | controller | test_deps : Install selinux python libs -------------------------------- 46.59s 2025-12-04 12:19:50.407378 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.62s 2025-12-04 12:19:50.407385 | controller | ci_setup : Install openshift client ------------------------------------- 5.94s 2025-12-04 12:19:50.407391 | controller | ci_setup : Install needed packages -------------------------------------- 4.32s 2025-12-04 12:19:50.407398 | controller | test_deps : Install python yaml libs ------------------------------------ 1.18s 2025-12-04 12:19:50.407404 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.09s 2025-12-04 12:19:50.407411 | controller | ci_setup : Manage directories ------------------------------------------- 0.94s 2025-12-04 12:19:50.407417 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.87s 2025-12-04 12:19:50.407426 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.86s 2025-12-04 12:19:50.407450 | controller | Gathering Facts --------------------------------------------------------- 0.86s 2025-12-04 12:19:50.408386 | controller | repo_setup : Install repo-setup package --------------------------------- 0.76s 2025-12-04 12:19:50.462347 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.71s 2025-12-04 12:19:50.462385 | controller | repo_setup : Ensure directories are present ----------------------------- 0.57s 2025-12-04 12:19:50.462393 | controller | ci_setup : Gather version of openshift client --------------------------- 0.55s 2025-12-04 12:19:50.462398 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.53s 2025-12-04 12:19:50.462403 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.46s 2025-12-04 12:19:50.462409 | controller | Create custom basedir --------------------------------------------------- 0.34s 2025-12-04 12:19:50.462414 | controller | Create secret file ------------------------------------------------------ 0.33s 2025-12-04 12:19:50.462419 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.29s 2025-12-04 12:19:50.462429 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.26s 2025-12-04 12:19:50.462439 | controller | INFO Running crc_layout > converge 2025-12-04 12:19:51.032735 | controller | 2025-12-04 12:19:51.032952 | controller | PLAY [Converge] **************************************************************** 2025-12-04 12:19:51.033116 | controller | 2025-12-04 12:19:51.033309 | controller | TASK [Gathering Facts] ********************************************************* 2025-12-04 12:19:51.033469 | controller | Thursday 04 December 2025 12:19:51 +0000 (0:00:00.026) 0:00:00.026 ***** 2025-12-04 12:19:51.835394 | controller | ok: [instance] 2025-12-04 12:19:51.835447 | controller | 2025-12-04 12:19:51.835457 | controller | TASK [Load networking definition from scenario file] *************************** 2025-12-04 12:19:51.835467 | controller | Thursday 04 December 2025 12:19:51 +0000 (0:00:00.802) 0:00:00.829 ***** 2025-12-04 12:19:51.858748 | controller | ok: [instance] 2025-12-04 12:19:53.434197 | controller | 2025-12-04 12:19:53.434225 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-12-04 12:19:53.434233 | controller | Thursday 04 December 2025 12:19:51 +0000 (0:00:00.023) 0:00:00.852 ***** 2025-12-04 12:19:53.434242 | controller | changed: [instance] 2025-12-04 12:19:53.460337 | controller | 2025-12-04 12:19:53.460358 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-12-04 12:19:53.460365 | controller | Thursday 04 December 2025 12:19:53 +0000 (0:00:01.575) 0:00:02.427 ***** 2025-12-04 12:19:53.460374 | controller | ok: [instance] 2025-12-04 12:19:53.460486 | controller | 2025-12-04 12:19:53.460517 | controller | TASK [reproducer : Load CI job environment] ************************************ 2025-12-04 12:19:53.460535 | controller | Thursday 04 December 2025 12:19:53 +0000 (0:00:00.026) 0:00:02.454 ***** 2025-12-04 12:19:53.481050 | controller | skipping: [instance] 2025-12-04 12:19:53.556262 | controller | 2025-12-04 12:19:53.556291 | controller | TASK [Build final libvirt layout] ********************************************** 2025-12-04 12:19:53.556299 | controller | Thursday 04 December 2025 12:19:53 +0000 (0:00:00.020) 0:00:02.474 ***** 2025-12-04 12:19:53.556308 | controller | 2025-12-04 12:19:53.633445 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2025-12-04 12:19:53.633483 | controller | Thursday 04 December 2025 12:19:53 +0000 (0:00:00.075) 0:00:02.550 ***** 2025-12-04 12:19:53.633505 | controller | ok: [instance] 2025-12-04 12:19:53.692459 | controller | 2025-12-04 12:19:53.692486 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2025-12-04 12:19:53.692508 | controller | Thursday 04 December 2025 12:19:53 +0000 (0:00:00.076) 0:00:02.626 ***** 2025-12-04 12:19:53.692519 | controller | skipping: [instance] 2025-12-04 12:19:53.692597 | controller | 2025-12-04 12:19:53.692628 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2025-12-04 12:19:53.692640 | controller | Thursday 04 December 2025 12:19:53 +0000 (0:00:00.059) 0:00:02.686 ***** 2025-12-04 12:19:53.718446 | controller | ok: [instance] 2025-12-04 12:19:53.718642 | controller | 2025-12-04 12:19:53.718834 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2025-12-04 12:19:53.719019 | controller | Thursday 04 December 2025 12:19:53 +0000 (0:00:00.026) 0:00:02.712 ***** 2025-12-04 12:19:53.741962 | controller | ok: [instance] => changed=false 2025-12-04 12:19:53.742145 | controller | msg: All assertions passed 2025-12-04 12:19:53.742324 | controller | 2025-12-04 12:19:53.742499 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2025-12-04 12:19:53.742650 | controller | Thursday 04 December 2025 12:19:53 +0000 (0:00:00.023) 0:00:02.736 ***** 2025-12-04 12:19:53.782312 | controller | ok: [instance] 2025-12-04 12:19:53.782483 | controller | 2025-12-04 12:19:53.782668 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2025-12-04 12:19:53.782804 | controller | Thursday 04 December 2025 12:19:53 +0000 (0:00:00.040) 0:00:02.776 ***** 2025-12-04 12:19:54.225389 | controller | ok: [instance] => (item=artifacts) 2025-12-04 12:19:54.225422 | controller | ok: [instance] => (item=logs) 2025-12-04 12:19:54.225432 | controller | 2025-12-04 12:19:54.225439 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2025-12-04 12:19:54.225457 | controller | Thursday 04 December 2025 12:19:54 +0000 (0:00:00.442) 0:00:03.218 ***** 2025-12-04 12:19:54.300858 | controller | 2025-12-04 12:19:54.490937 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2025-12-04 12:19:54.490962 | controller | Thursday 04 December 2025 12:19:54 +0000 (0:00:00.075) 0:00:03.294 ***** 2025-12-04 12:19:54.490973 | controller | ok: [instance] 2025-12-04 12:19:54.745303 | controller | 2025-12-04 12:19:54.745332 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2025-12-04 12:19:54.745340 | controller | Thursday 04 December 2025 12:19:54 +0000 (0:00:00.189) 0:00:03.484 ***** 2025-12-04 12:19:54.745350 | controller | changed: [instance] 2025-12-04 12:19:55.025882 | controller | 2025-12-04 12:19:55.025910 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2025-12-04 12:19:55.025918 | controller | Thursday 04 December 2025 12:19:54 +0000 (0:00:00.254) 0:00:03.739 ***** 2025-12-04 12:19:55.025928 | controller | ok: [instance] 2025-12-04 12:19:55.056128 | controller | 2025-12-04 12:19:55.056148 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2025-12-04 12:19:55.056155 | controller | Thursday 04 December 2025 12:19:55 +0000 (0:00:00.280) 0:00:04.019 ***** 2025-12-04 12:19:55.056164 | controller | skipping: [instance] 2025-12-04 12:19:55.074347 | controller | 2025-12-04 12:19:55.074382 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2025-12-04 12:19:55.074390 | controller | Thursday 04 December 2025 12:19:55 +0000 (0:00:00.030) 0:00:04.049 ***** 2025-12-04 12:19:55.074400 | controller | skipping: [instance] 2025-12-04 12:19:55.074481 | controller | 2025-12-04 12:19:55.074520 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2025-12-04 12:19:55.074534 | controller | Thursday 04 December 2025 12:19:55 +0000 (0:00:00.018) 0:00:04.068 ***** 2025-12-04 12:19:55.095433 | controller | ok: [instance] 2025-12-04 12:19:55.123456 | controller | 2025-12-04 12:19:55.123489 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2025-12-04 12:19:55.123507 | controller | Thursday 04 December 2025 12:19:55 +0000 (0:00:00.020) 0:00:04.089 ***** 2025-12-04 12:19:55.123518 | controller | skipping: [instance] 2025-12-04 12:19:55.123546 | controller | 2025-12-04 12:19:55.123554 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2025-12-04 12:19:55.123685 | controller | Thursday 04 December 2025 12:19:55 +0000 (0:00:00.027) 0:00:04.117 ***** 2025-12-04 12:20:03.597583 | controller | changed: [instance] 2025-12-04 12:20:03.808339 | controller | 2025-12-04 12:20:03.808368 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2025-12-04 12:20:03.808376 | controller | Thursday 04 December 2025 12:20:03 +0000 (0:00:08.473) 0:00:12.591 ***** 2025-12-04 12:20:03.808386 | controller | changed: [instance] 2025-12-04 12:20:04.298878 | controller | 2025-12-04 12:20:04.298907 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2025-12-04 12:20:04.298915 | controller | Thursday 04 December 2025 12:20:03 +0000 (0:00:00.210) 0:00:12.801 ***** 2025-12-04 12:20:04.298925 | controller | changed: [instance] 2025-12-04 12:20:04.298969 | controller | 2025-12-04 12:20:04.299087 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2025-12-04 12:20:04.299196 | controller | Thursday 04 December 2025 12:20:04 +0000 (0:00:00.490) 0:00:13.292 ***** 2025-12-04 12:20:04.868999 | controller | changed: [instance] 2025-12-04 12:20:04.869053 | controller | 2025-12-04 12:20:04.869396 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2025-12-04 12:20:05.059313 | controller | Thursday 04 December 2025 12:20:04 +0000 (0:00:00.570) 0:00:13.862 ***** 2025-12-04 12:20:05.059341 | controller | ok: [instance] 2025-12-04 12:20:05.059366 | controller | 2025-12-04 12:20:05.059375 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2025-12-04 12:20:05.059498 | controller | Thursday 04 December 2025 12:20:05 +0000 (0:00:00.190) 0:00:14.053 ***** 2025-12-04 12:20:05.698962 | controller | ok: [instance] 2025-12-04 12:20:06.572065 | controller | 2025-12-04 12:20:06.572094 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2025-12-04 12:20:06.572109 | controller | Thursday 04 December 2025 12:20:05 +0000 (0:00:00.639) 0:00:14.692 ***** 2025-12-04 12:20:06.572119 | controller | changed: [instance] 2025-12-04 12:20:06.671420 | controller | 2025-12-04 12:20:06.671458 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2025-12-04 12:20:06.671468 | controller | Thursday 04 December 2025 12:20:06 +0000 (0:00:00.873) 0:00:15.565 ***** 2025-12-04 12:20:06.671481 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2025-12-04 12:20:06.671532 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2025-12-04 12:20:06.671545 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2025-12-04 12:20:06.672412 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2025-12-04 12:20:06.995329 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2025-12-04 12:20:06.995359 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2025-12-04 12:20:06.995368 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2025-12-04 12:20:06.995375 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2025-12-04 12:20:06.995382 | controller | 2025-12-04 12:20:06.995389 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2025-12-04 12:20:06.995397 | controller | Thursday 04 December 2025 12:20:06 +0000 (0:00:00.099) 0:00:15.665 ***** 2025-12-04 12:20:06.995407 | controller | ok: [instance] 2025-12-04 12:20:06.995433 | controller | 2025-12-04 12:20:06.995443 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2025-12-04 12:20:06.995528 | controller | Thursday 04 December 2025 12:20:06 +0000 (0:00:00.323) 0:00:15.989 ***** 2025-12-04 12:20:07.311356 | controller | ok: [instance] 2025-12-04 12:20:07.311411 | controller | 2025-12-04 12:20:07.311424 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2025-12-04 12:20:07.311501 | controller | Thursday 04 December 2025 12:20:07 +0000 (0:00:00.316) 0:00:16.305 ***** 2025-12-04 12:20:07.622144 | controller | ok: [instance] 2025-12-04 12:20:07.929932 | controller | 2025-12-04 12:20:07.929962 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2025-12-04 12:20:07.929970 | controller | Thursday 04 December 2025 12:20:07 +0000 (0:00:00.310) 0:00:16.615 ***** 2025-12-04 12:20:07.929980 | controller | ok: [instance] 2025-12-04 12:20:08.241802 | controller | 2025-12-04 12:20:08.241832 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2025-12-04 12:20:08.241842 | controller | Thursday 04 December 2025 12:20:07 +0000 (0:00:00.307) 0:00:16.923 ***** 2025-12-04 12:20:08.241853 | controller | ok: [instance] 2025-12-04 12:20:08.552733 | controller | 2025-12-04 12:20:08.552763 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2025-12-04 12:20:08.552771 | controller | Thursday 04 December 2025 12:20:08 +0000 (0:00:00.311) 0:00:17.235 ***** 2025-12-04 12:20:08.552782 | controller | ok: [instance] 2025-12-04 12:20:08.860029 | controller | 2025-12-04 12:20:08.860061 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2025-12-04 12:20:08.860069 | controller | Thursday 04 December 2025 12:20:08 +0000 (0:00:00.310) 0:00:17.546 ***** 2025-12-04 12:20:08.860079 | controller | ok: [instance] 2025-12-04 12:20:09.170687 | controller | 2025-12-04 12:20:09.170716 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2025-12-04 12:20:09.170724 | controller | Thursday 04 December 2025 12:20:08 +0000 (0:00:00.307) 0:00:17.853 ***** 2025-12-04 12:20:09.170745 | controller | ok: [instance] 2025-12-04 12:20:09.474797 | controller | 2025-12-04 12:20:09.474830 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2025-12-04 12:20:09.474840 | controller | Thursday 04 December 2025 12:20:09 +0000 (0:00:00.310) 0:00:18.164 ***** 2025-12-04 12:20:09.474852 | controller | ok: [instance] 2025-12-04 12:20:09.779398 | controller | 2025-12-04 12:20:09.779433 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2025-12-04 12:20:09.779442 | controller | Thursday 04 December 2025 12:20:09 +0000 (0:00:00.303) 0:00:18.468 ***** 2025-12-04 12:20:09.779454 | controller | ok: [instance] 2025-12-04 12:20:09.779487 | controller | 2025-12-04 12:20:09.779709 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2025-12-04 12:20:10.088352 | controller | Thursday 04 December 2025 12:20:09 +0000 (0:00:00.304) 0:00:18.773 ***** 2025-12-04 12:20:10.088394 | controller | ok: [instance] 2025-12-04 12:20:10.088434 | controller | 2025-12-04 12:20:10.088444 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2025-12-04 12:20:10.088453 | controller | Thursday 04 December 2025 12:20:10 +0000 (0:00:00.308) 0:00:19.081 ***** 2025-12-04 12:20:10.400036 | controller | ok: [instance] 2025-12-04 12:20:10.701350 | controller | 2025-12-04 12:20:10.701382 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2025-12-04 12:20:10.701390 | controller | Thursday 04 December 2025 12:20:10 +0000 (0:00:00.311) 0:00:19.393 ***** 2025-12-04 12:20:10.701400 | controller | ok: [instance] 2025-12-04 12:20:10.701421 | controller | 2025-12-04 12:20:10.701427 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2025-12-04 12:20:10.701435 | controller | Thursday 04 December 2025 12:20:10 +0000 (0:00:00.301) 0:00:19.695 ***** 2025-12-04 12:20:11.021355 | controller | ok: [instance] 2025-12-04 12:20:11.342768 | controller | 2025-12-04 12:20:11.342803 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2025-12-04 12:20:11.342813 | controller | Thursday 04 December 2025 12:20:11 +0000 (0:00:00.319) 0:00:20.014 ***** 2025-12-04 12:20:11.342824 | controller | ok: [instance] 2025-12-04 12:20:11.654378 | controller | 2025-12-04 12:20:11.654415 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2025-12-04 12:20:11.654424 | controller | Thursday 04 December 2025 12:20:11 +0000 (0:00:00.321) 0:00:20.336 ***** 2025-12-04 12:20:11.654437 | controller | ok: [instance] 2025-12-04 12:20:11.978375 | controller | 2025-12-04 12:20:11.978421 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2025-12-04 12:20:11.978430 | controller | Thursday 04 December 2025 12:20:11 +0000 (0:00:00.311) 0:00:20.648 ***** 2025-12-04 12:20:11.978441 | controller | ok: [instance] 2025-12-04 12:20:12.288222 | controller | 2025-12-04 12:20:12.288272 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2025-12-04 12:20:12.288283 | controller | Thursday 04 December 2025 12:20:11 +0000 (0:00:00.323) 0:00:20.972 ***** 2025-12-04 12:20:12.288294 | controller | ok: [instance] 2025-12-04 12:20:12.595883 | controller | 2025-12-04 12:20:12.595911 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2025-12-04 12:20:12.595919 | controller | Thursday 04 December 2025 12:20:12 +0000 (0:00:00.309) 0:00:21.281 ***** 2025-12-04 12:20:12.595929 | controller | ok: [instance] 2025-12-04 12:20:12.897342 | controller | 2025-12-04 12:20:12.897377 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2025-12-04 12:20:12.897387 | controller | Thursday 04 December 2025 12:20:12 +0000 (0:00:00.308) 0:00:21.589 ***** 2025-12-04 12:20:12.897399 | controller | ok: [instance] 2025-12-04 12:20:12.897430 | controller | 2025-12-04 12:20:12.897458 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2025-12-04 12:20:12.897648 | controller | Thursday 04 December 2025 12:20:12 +0000 (0:00:00.301) 0:00:21.891 ***** 2025-12-04 12:20:13.201357 | controller | ok: [instance] 2025-12-04 12:20:13.201463 | controller | 2025-12-04 12:20:13.201488 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2025-12-04 12:20:13.201508 | controller | Thursday 04 December 2025 12:20:13 +0000 (0:00:00.303) 0:00:22.195 ***** 2025-12-04 12:20:13.510181 | controller | ok: [instance] 2025-12-04 12:20:13.818851 | controller | 2025-12-04 12:20:13.818885 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2025-12-04 12:20:13.818893 | controller | Thursday 04 December 2025 12:20:13 +0000 (0:00:00.308) 0:00:22.503 ***** 2025-12-04 12:20:13.818903 | controller | ok: [instance] 2025-12-04 12:20:14.122266 | controller | 2025-12-04 12:20:14.122298 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2025-12-04 12:20:14.122312 | controller | Thursday 04 December 2025 12:20:13 +0000 (0:00:00.308) 0:00:22.812 ***** 2025-12-04 12:20:14.122322 | controller | ok: [instance] 2025-12-04 12:20:14.142036 | controller | 2025-12-04 12:20:14.142059 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2025-12-04 12:20:14.142068 | controller | Thursday 04 December 2025 12:20:14 +0000 (0:00:00.303) 0:00:23.115 ***** 2025-12-04 12:20:14.142080 | controller | skipping: [instance] 2025-12-04 12:20:14.409393 | controller | 2025-12-04 12:20:14.409433 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2025-12-04 12:20:14.409443 | controller | Thursday 04 December 2025 12:20:14 +0000 (0:00:00.019) 0:00:23.135 ***** 2025-12-04 12:20:14.409456 | controller | ok: [instance] 2025-12-04 12:20:14.765735 | controller | 2025-12-04 12:20:14.765766 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2025-12-04 12:20:14.765774 | controller | Thursday 04 December 2025 12:20:14 +0000 (0:00:00.267) 0:00:23.403 ***** 2025-12-04 12:20:14.765783 | controller | ok: [instance] 2025-12-04 12:20:15.060996 | controller | 2025-12-04 12:20:15.061030 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2025-12-04 12:20:15.061038 | controller | Thursday 04 December 2025 12:20:14 +0000 (0:00:00.356) 0:00:23.759 ***** 2025-12-04 12:20:15.061048 | controller | changed: [instance] 2025-12-04 12:20:15.331368 | controller | 2025-12-04 12:20:15.331402 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2025-12-04 12:20:15.331409 | controller | Thursday 04 December 2025 12:20:15 +0000 (0:00:00.295) 0:00:24.054 ***** 2025-12-04 12:20:15.331419 | controller | [WARNING]: Reset is not implemented for this connection 2025-12-04 12:20:15.341414 | controller | changed: [instance] 2025-12-04 12:20:15.341467 | controller | 2025-12-04 12:20:15.341476 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2025-12-04 12:20:15.341482 | controller | Thursday 04 December 2025 12:20:15 +0000 (0:00:00.264) 0:00:24.319 ***** 2025-12-04 12:20:15.341488 | controller | 2025-12-04 12:20:15.341502 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2025-12-04 12:20:15.341509 | controller | Thursday 04 December 2025 12:20:15 +0000 (0:00:00.015) 0:00:24.334 ***** 2025-12-04 12:20:15.412390 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2025-12-04 12:20:15.452400 | controller | 2025-12-04 12:20:15.452439 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2025-12-04 12:20:15.452449 | controller | Thursday 04 December 2025 12:20:15 +0000 (0:00:00.071) 0:00:24.406 ***** 2025-12-04 12:20:15.452460 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2025-12-04 12:20:15.452468 | controller | 2025-12-04 12:20:15.452475 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 12:20:15.452484 | controller | Thursday 04 December 2025 12:20:15 +0000 (0:00:00.040) 0:00:24.446 ***** 2025-12-04 12:20:15.500245 | controller | ok: [instance] => (item=compute) 2025-12-04 12:20:15.540377 | controller | ok: [instance] => (item=controller) 2025-12-04 12:20:15.540403 | controller | ok: [instance] => (item=crc) 2025-12-04 12:20:15.540413 | controller | 2025-12-04 12:20:15.540421 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 12:20:15.540429 | controller | Thursday 04 December 2025 12:20:15 +0000 (0:00:00.047) 0:00:24.493 ***** 2025-12-04 12:20:15.540441 | controller | ok: [instance] 2025-12-04 12:20:15.540463 | controller | 2025-12-04 12:20:15.540473 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-04 12:20:15.540594 | controller | Thursday 04 December 2025 12:20:15 +0000 (0:00:00.040) 0:00:24.534 ***** 2025-12-04 12:20:15.579048 | controller | ok: [instance] => changed=false 2025-12-04 12:20:15.579311 | controller | msg: All assertions passed 2025-12-04 12:20:15.579535 | controller | 2025-12-04 12:20:15.579740 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2025-12-04 12:20:15.579919 | controller | Thursday 04 December 2025 12:20:15 +0000 (0:00:00.038) 0:00:24.573 ***** 2025-12-04 12:20:15.638317 | controller | 2025-12-04 12:20:15.638574 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2025-12-04 12:20:15.638790 | controller | Thursday 04 December 2025 12:20:15 +0000 (0:00:00.059) 0:00:24.632 ***** 2025-12-04 12:20:15.711009 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2025-12-04 12:20:15.711227 | controller | ok: [instance] => (item={}) 2025-12-04 12:20:15.711337 | controller | 2025-12-04 12:20:15.711463 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2025-12-04 12:20:15.711608 | controller | Thursday 04 December 2025 12:20:15 +0000 (0:00:00.072) 0:00:24.704 ***** 2025-12-04 12:20:15.727534 | controller | skipping: [instance] 2025-12-04 12:20:15.727712 | controller | 2025-12-04 12:20:15.727834 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2025-12-04 12:20:15.728016 | controller | Thursday 04 December 2025 12:20:15 +0000 (0:00:00.016) 0:00:24.721 ***** 2025-12-04 12:20:15.939322 | controller | ok: [instance] 2025-12-04 12:20:16.276354 | controller | 2025-12-04 12:20:16.276395 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2025-12-04 12:20:16.276405 | controller | Thursday 04 December 2025 12:20:15 +0000 (0:00:00.211) 0:00:24.932 ***** 2025-12-04 12:20:16.276418 | controller | changed: [instance] 2025-12-04 12:20:16.276460 | controller | 2025-12-04 12:20:16.276470 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2025-12-04 12:20:16.276580 | controller | Thursday 04 December 2025 12:20:16 +0000 (0:00:00.337) 0:00:25.270 ***** 2025-12-04 12:20:16.997706 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2025-12-04 12:20:17.024865 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2025-12-04 12:20:17.024888 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2025-12-04 12:20:17.024897 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2025-12-04 12:20:17.024905 | controller | 2025-12-04 12:20:17.024913 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2025-12-04 12:20:17.024920 | controller | Thursday 04 December 2025 12:20:16 +0000 (0:00:00.720) 0:00:25.990 ***** 2025-12-04 12:20:17.024931 | controller | skipping: [instance] 2025-12-04 12:20:17.387495 | controller | 2025-12-04 12:20:17.387534 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2025-12-04 12:20:17.387544 | controller | Thursday 04 December 2025 12:20:17 +0000 (0:00:00.027) 0:00:26.018 ***** 2025-12-04 12:20:17.387556 | controller | changed: [instance] 2025-12-04 12:20:17.387587 | controller | 2025-12-04 12:20:17.387597 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2025-12-04 12:20:17.387942 | controller | Thursday 04 December 2025 12:20:17 +0000 (0:00:00.353) 0:00:26.372 ***** 2025-12-04 12:20:17.815030 | controller | 2025-12-04 12:20:17.815061 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-04 12:20:17.815070 | controller | Thursday 04 December 2025 12:20:17 +0000 (0:00:00.008) 0:00:26.380 ***** 2025-12-04 12:20:17.815087 | controller | changed: [instance] 2025-12-04 12:20:17.891452 | controller | 2025-12-04 12:20:17.891475 | controller | TASK [Ensure no default networks exists] *************************************** 2025-12-04 12:20:17.891495 | controller | Thursday 04 December 2025 12:20:17 +0000 (0:00:00.427) 0:00:26.808 ***** 2025-12-04 12:20:17.891505 | controller | 2025-12-04 12:20:19.047957 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2025-12-04 12:20:19.047985 | controller | Thursday 04 December 2025 12:20:17 +0000 (0:00:00.076) 0:00:26.885 ***** 2025-12-04 12:20:19.047998 | controller | ok: [instance] 2025-12-04 12:20:19.274007 | controller | 2025-12-04 12:20:19.274036 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2025-12-04 12:20:19.274044 | controller | Thursday 04 December 2025 12:20:19 +0000 (0:00:01.156) 0:00:28.041 ***** 2025-12-04 12:20:19.274053 | controller | ok: [instance] 2025-12-04 12:20:19.755337 | controller | 2025-12-04 12:20:19.755371 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2025-12-04 12:20:19.755380 | controller | Thursday 04 December 2025 12:20:19 +0000 (0:00:00.226) 0:00:28.267 ***** 2025-12-04 12:20:19.755392 | controller | ok: [instance] 2025-12-04 12:20:19.755422 | controller | 2025-12-04 12:20:19.755634 | controller | TASK [libvirt_manager : Removing default] ************************************** 2025-12-04 12:20:19.973379 | controller | Thursday 04 December 2025 12:20:19 +0000 (0:00:00.481) 0:00:28.749 ***** 2025-12-04 12:20:19.973427 | controller | ok: [instance] 2025-12-04 12:20:19.973448 | controller | 2025-12-04 12:20:19.973456 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2025-12-04 12:20:19.973464 | controller | Thursday 04 December 2025 12:20:19 +0000 (0:00:00.218) 0:00:28.967 ***** 2025-12-04 12:20:21.152490 | controller | ok: [instance] 2025-12-04 12:20:21.152550 | controller | 2025-12-04 12:20:21.152832 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2025-12-04 12:20:21.447754 | controller | Thursday 04 December 2025 12:20:21 +0000 (0:00:01.179) 0:00:30.146 ***** 2025-12-04 12:20:21.447793 | controller | ok: [instance] 2025-12-04 12:20:21.746577 | controller | 2025-12-04 12:20:21.746609 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2025-12-04 12:20:21.746617 | controller | Thursday 04 December 2025 12:20:21 +0000 (0:00:00.294) 0:00:30.441 ***** 2025-12-04 12:20:21.746633 | controller | changed: [instance] 2025-12-04 12:20:22.044332 | controller | 2025-12-04 12:20:22.044370 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2025-12-04 12:20:22.044379 | controller | Thursday 04 December 2025 12:20:21 +0000 (0:00:00.298) 0:00:30.739 ***** 2025-12-04 12:20:22.044389 | controller | changed: [instance] 2025-12-04 12:20:22.044413 | controller | 2025-12-04 12:20:22.044420 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2025-12-04 12:20:22.044535 | controller | Thursday 04 December 2025 12:20:22 +0000 (0:00:00.298) 0:00:31.038 ***** 2025-12-04 12:20:22.595994 | controller | changed: [instance] => (item=arptables) 2025-12-04 12:20:22.899823 | controller | changed: [instance] => (item=iptables) 2025-12-04 12:20:22.899853 | controller | changed: [instance] => (item=ip6tables) 2025-12-04 12:20:22.899861 | controller | 2025-12-04 12:20:22.899867 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2025-12-04 12:20:22.899873 | controller | Thursday 04 December 2025 12:20:22 +0000 (0:00:00.551) 0:00:31.589 ***** 2025-12-04 12:20:22.899883 | controller | ok: [instance] 2025-12-04 12:20:22.988379 | controller | 2025-12-04 12:20:22.988418 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2025-12-04 12:20:22.988428 | controller | Thursday 04 December 2025 12:20:22 +0000 (0:00:00.304) 0:00:31.893 ***** 2025-12-04 12:20:22.988439 | controller | ok: [instance] 2025-12-04 12:20:22.988478 | controller | 2025-12-04 12:20:22.988651 | controller | TASK [Ensure the required network configurations are applied] ****************** 2025-12-04 12:20:23.031357 | controller | Thursday 04 December 2025 12:20:22 +0000 (0:00:00.088) 0:00:31.982 ***** 2025-12-04 12:20:23.031431 | controller | 2025-12-04 12:20:23.053186 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2025-12-04 12:20:23.053222 | controller | Thursday 04 December 2025 12:20:23 +0000 (0:00:00.042) 0:00:32.025 ***** 2025-12-04 12:20:23.053233 | controller | skipping: [instance] 2025-12-04 12:20:23.073305 | controller | 2025-12-04 12:20:23.073327 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2025-12-04 12:20:23.073335 | controller | Thursday 04 December 2025 12:20:23 +0000 (0:00:00.021) 0:00:32.046 ***** 2025-12-04 12:20:23.073351 | controller | skipping: [instance] 2025-12-04 12:20:23.073572 | controller | 2025-12-04 12:20:23.073594 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-04 12:20:23.093343 | controller | Thursday 04 December 2025 12:20:23 +0000 (0:00:00.020) 0:00:32.067 ***** 2025-12-04 12:20:23.093375 | controller | skipping: [instance] 2025-12-04 12:20:23.093716 | controller | 2025-12-04 12:20:23.118722 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2025-12-04 12:20:23.118747 | controller | Thursday 04 December 2025 12:20:23 +0000 (0:00:00.020) 0:00:32.087 ***** 2025-12-04 12:20:23.118759 | controller | skipping: [instance] 2025-12-04 12:20:23.176446 | controller | 2025-12-04 12:20:23.176492 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2025-12-04 12:20:23.176500 | controller | Thursday 04 December 2025 12:20:23 +0000 (0:00:00.025) 0:00:32.112 ***** 2025-12-04 12:20:23.176510 | controller | ok: [instance] 2025-12-04 12:20:23.176657 | controller | 2025-12-04 12:20:23.176808 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2025-12-04 12:20:23.176947 | controller | Thursday 04 December 2025 12:20:23 +0000 (0:00:00.058) 0:00:32.170 ***** 2025-12-04 12:20:23.208405 | controller | skipping: [instance] 2025-12-04 12:20:23.208609 | controller | 2025-12-04 12:20:23.208783 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2025-12-04 12:20:23.208953 | controller | Thursday 04 December 2025 12:20:23 +0000 (0:00:00.031) 0:00:32.202 ***** 2025-12-04 12:20:23.229175 | controller | skipping: [instance] 2025-12-04 12:20:23.229371 | controller | 2025-12-04 12:20:23.229539 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2025-12-04 12:20:23.229682 | controller | Thursday 04 December 2025 12:20:23 +0000 (0:00:00.020) 0:00:32.223 ***** 2025-12-04 12:20:23.283599 | controller | ok: [instance] 2025-12-04 12:20:23.283796 | controller | 2025-12-04 12:20:23.283972 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2025-12-04 12:20:23.284148 | controller | Thursday 04 December 2025 12:20:23 +0000 (0:00:00.054) 0:00:32.277 ***** 2025-12-04 12:20:23.303992 | controller | skipping: [instance] 2025-12-04 12:20:23.304180 | controller | 2025-12-04 12:20:23.304387 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2025-12-04 12:20:23.304552 | controller | Thursday 04 December 2025 12:20:23 +0000 (0:00:00.020) 0:00:32.298 ***** 2025-12-04 12:20:23.350045 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2025-12-04 12:20:23.350236 | controller | 2025-12-04 12:20:23.350472 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-12-04 12:20:23.350634 | controller | Thursday 04 December 2025 12:20:23 +0000 (0:00:00.045) 0:00:32.344 ***** 2025-12-04 12:20:23.659392 | controller | ok: [instance -> localhost] 2025-12-04 12:20:23.659597 | controller | 2025-12-04 12:20:23.659615 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2025-12-04 12:20:28.667970 | controller | Thursday 04 December 2025 12:20:23 +0000 (0:00:00.309) 0:00:32.653 ***** 2025-12-04 12:20:28.668004 | controller | changed: [instance -> localhost] 2025-12-04 12:20:28.864408 | controller | 2025-12-04 12:20:28.864446 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-12-04 12:20:28.864454 | controller | Thursday 04 December 2025 12:20:28 +0000 (0:00:05.008) 0:00:37.661 ***** 2025-12-04 12:20:28.864464 | controller | changed: [instance] 2025-12-04 12:20:28.864482 | controller | 2025-12-04 12:20:28.864536 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2025-12-04 12:20:28.864651 | controller | Thursday 04 December 2025 12:20:28 +0000 (0:00:00.196) 0:00:37.858 ***** 2025-12-04 12:20:29.206119 | controller | changed: [instance] 2025-12-04 12:20:29.206193 | controller | 2025-12-04 12:20:29.206397 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2025-12-04 12:20:29.206498 | controller | Thursday 04 December 2025 12:20:29 +0000 (0:00:00.341) 0:00:38.200 ***** 2025-12-04 12:20:30.800019 | controller | changed: [instance -> localhost] 2025-12-04 12:20:31.150408 | controller | 2025-12-04 12:20:31.150456 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2025-12-04 12:20:31.150467 | controller | Thursday 04 December 2025 12:20:30 +0000 (0:00:01.593) 0:00:39.793 ***** 2025-12-04 12:20:31.150479 | controller | changed: [instance] 2025-12-04 12:20:31.180944 | controller | 2025-12-04 12:20:31.180976 | controller | TASK [reproducer : Select right domain] **************************************** 2025-12-04 12:20:31.180986 | controller | Thursday 04 December 2025 12:20:31 +0000 (0:00:00.350) 0:00:40.144 ***** 2025-12-04 12:20:31.180997 | controller | ok: [instance] 2025-12-04 12:20:31.295654 | controller | 2025-12-04 12:20:31.295673 | controller | TASK [Create the virtual networks] ********************************************* 2025-12-04 12:20:31.295680 | controller | Thursday 04 December 2025 12:20:31 +0000 (0:00:00.030) 0:00:40.174 ***** 2025-12-04 12:20:31.295688 | controller | 2025-12-04 12:20:31.315366 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2025-12-04 12:20:31.315394 | controller | Thursday 04 December 2025 12:20:31 +0000 (0:00:00.114) 0:00:40.289 ***** 2025-12-04 12:20:31.315407 | controller | ok: [instance] 2025-12-04 12:20:31.315447 | controller | 2025-12-04 12:20:31.315458 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2025-12-04 12:20:31.315579 | controller | Thursday 04 December 2025 12:20:31 +0000 (0:00:00.020) 0:00:40.309 ***** 2025-12-04 12:20:31.502869 | controller | ok: [instance] 2025-12-04 12:20:31.531093 | controller | 2025-12-04 12:20:31.531113 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2025-12-04 12:20:31.531120 | controller | Thursday 04 December 2025 12:20:31 +0000 (0:00:00.187) 0:00:40.496 ***** 2025-12-04 12:20:31.531129 | controller | skipping: [instance] 2025-12-04 12:20:31.559094 | controller | 2025-12-04 12:20:31.559112 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2025-12-04 12:20:31.559119 | controller | Thursday 04 December 2025 12:20:31 +0000 (0:00:00.028) 0:00:40.524 ***** 2025-12-04 12:20:31.559128 | controller | skipping: [instance] 2025-12-04 12:20:31.613859 | controller | 2025-12-04 12:20:31.613877 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2025-12-04 12:20:31.613884 | controller | Thursday 04 December 2025 12:20:31 +0000 (0:00:00.027) 0:00:40.552 ***** 2025-12-04 12:20:31.613893 | controller | ok: [instance] 2025-12-04 12:20:31.735326 | controller | 2025-12-04 12:20:31.735358 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2025-12-04 12:20:31.735366 | controller | Thursday 04 December 2025 12:20:31 +0000 (0:00:00.055) 0:00:40.607 ***** 2025-12-04 12:20:31.735377 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-04 12:20:31.735401 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-04 12:20:31.735407 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-04 12:20:31.735413 | controller | 2025-12-04 12:20:31.735428 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2025-12-04 12:20:31.735467 | controller | Thursday 04 December 2025 12:20:31 +0000 (0:00:00.121) 0:00:40.728 ***** 2025-12-04 12:20:31.767825 | controller | skipping: [instance] 2025-12-04 12:20:32.100832 | controller | 2025-12-04 12:20:32.100864 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2025-12-04 12:20:32.100873 | controller | Thursday 04 December 2025 12:20:31 +0000 (0:00:00.032) 0:00:40.761 ***** 2025-12-04 12:20:32.100893 | controller | changed: [instance] 2025-12-04 12:20:32.235882 | controller | 2025-12-04 12:20:32.235902 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2025-12-04 12:20:32.235909 | controller | Thursday 04 December 2025 12:20:32 +0000 (0:00:00.332) 0:00:41.094 ***** 2025-12-04 12:20:32.235926 | controller | changed: [instance] => (item=Adding compute-0 to computes) 2025-12-04 12:20:32.259379 | controller | changed: [instance] => (item=Adding controller-0 to controllers) 2025-12-04 12:20:32.259407 | controller | changed: [instance] => (item=Adding crc-0 to ocps) 2025-12-04 12:20:32.259427 | controller | 2025-12-04 12:20:32.259435 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-04 12:20:32.259442 | controller | Thursday 04 December 2025 12:20:32 +0000 (0:00:00.135) 0:00:41.229 ***** 2025-12-04 12:20:32.259453 | controller | skipping: [instance] 2025-12-04 12:20:32.259651 | controller | 2025-12-04 12:20:32.282772 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-04 12:20:32.282789 | controller | Thursday 04 December 2025 12:20:32 +0000 (0:00:00.023) 0:00:41.253 ***** 2025-12-04 12:20:32.282799 | controller | skipping: [instance] 2025-12-04 12:20:32.306440 | controller | 2025-12-04 12:20:32.306479 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-04 12:20:32.306490 | controller | Thursday 04 December 2025 12:20:32 +0000 (0:00:00.023) 0:00:41.276 ***** 2025-12-04 12:20:32.306503 | controller | skipping: [instance] 2025-12-04 12:20:32.331089 | controller | 2025-12-04 12:20:32.331114 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-04 12:20:32.331123 | controller | Thursday 04 December 2025 12:20:32 +0000 (0:00:00.023) 0:00:41.300 ***** 2025-12-04 12:20:32.331134 | controller | skipping: [instance] 2025-12-04 12:20:32.349217 | controller | 2025-12-04 12:20:32.349237 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-04 12:20:32.349274 | controller | Thursday 04 December 2025 12:20:32 +0000 (0:00:00.024) 0:00:41.324 ***** 2025-12-04 12:20:32.349290 | controller | ok: [instance] 2025-12-04 12:20:32.349500 | controller | 2025-12-04 12:20:32.349643 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-04 12:20:32.349783 | controller | Thursday 04 December 2025 12:20:32 +0000 (0:00:00.018) 0:00:41.343 ***** 2025-12-04 12:20:32.446598 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-12-04 12:20:32.446758 | controller | 2025-12-04 12:20:32.446901 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-04 12:20:32.447037 | controller | Thursday 04 December 2025 12:20:32 +0000 (0:00:00.097) 0:00:41.440 ***** 2025-12-04 12:20:32.489741 | controller | skipping: [instance] 2025-12-04 12:20:32.489921 | controller | 2025-12-04 12:20:32.490116 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-04 12:20:32.490312 | controller | Thursday 04 December 2025 12:20:32 +0000 (0:00:00.043) 0:00:41.483 ***** 2025-12-04 12:20:32.695325 | controller | changed: [instance] 2025-12-04 12:20:32.695398 | controller | 2025-12-04 12:20:32.695408 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-04 12:20:32.695426 | controller | Thursday 04 December 2025 12:20:32 +0000 (0:00:00.205) 0:00:41.689 ***** 2025-12-04 12:20:33.095022 | controller | changed: [instance] 2025-12-04 12:20:33.155481 | controller | 2025-12-04 12:20:33.155529 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-04 12:20:33.155543 | controller | Thursday 04 December 2025 12:20:33 +0000 (0:00:00.399) 0:00:42.088 ***** 2025-12-04 12:20:33.155560 | controller | ok: [instance] 2025-12-04 12:20:33.186190 | controller | 2025-12-04 12:20:33.186210 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-04 12:20:33.186218 | controller | Thursday 04 December 2025 12:20:33 +0000 (0:00:00.060) 0:00:42.149 ***** 2025-12-04 12:20:33.186227 | controller | ok: [instance] 2025-12-04 12:20:33.560653 | controller | 2025-12-04 12:20:33.560676 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-04 12:20:33.560684 | controller | Thursday 04 December 2025 12:20:33 +0000 (0:00:00.030) 0:00:42.179 ***** 2025-12-04 12:20:33.560693 | controller | changed: [instance] 2025-12-04 12:20:33.639160 | controller | 2025-12-04 12:20:33.639179 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2025-12-04 12:20:33.639186 | controller | Thursday 04 December 2025 12:20:33 +0000 (0:00:00.374) 0:00:42.554 ***** 2025-12-04 12:20:33.639195 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2025-12-04 12:20:33.690378 | controller | 2025-12-04 12:20:33.690420 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2025-12-04 12:20:33.690430 | controller | Thursday 04 December 2025 12:20:33 +0000 (0:00:00.078) 0:00:42.633 ***** 2025-12-04 12:20:33.690441 | controller | ok: [instance] => (item=public) 2025-12-04 12:20:33.690469 | controller | ok: [instance] => (item=osp_trunk) 2025-12-04 12:20:33.690828 | controller | 2025-12-04 12:20:34.118278 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2025-12-04 12:20:34.118306 | controller | Thursday 04 December 2025 12:20:33 +0000 (0:00:00.051) 0:00:42.684 ***** 2025-12-04 12:20:34.118318 | controller | changed: [instance] => (item=cifmw-public) 2025-12-04 12:20:34.680452 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-04 12:20:34.680483 | controller | 2025-12-04 12:20:34.680491 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2025-12-04 12:20:34.680498 | controller | Thursday 04 December 2025 12:20:34 +0000 (0:00:00.427) 0:00:43.111 ***** 2025-12-04 12:20:34.680507 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 12:20:35.107869 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 12:20:35.107893 | controller | 2025-12-04 12:20:35.107901 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2025-12-04 12:20:35.107907 | controller | Thursday 04 December 2025 12:20:34 +0000 (0:00:00.561) 0:00:43.673 ***** 2025-12-04 12:20:35.107916 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 12:20:35.547125 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 12:20:35.547160 | controller | 2025-12-04 12:20:35.547168 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2025-12-04 12:20:35.547175 | controller | Thursday 04 December 2025 12:20:35 +0000 (0:00:00.427) 0:00:44.101 ***** 2025-12-04 12:20:35.547190 | controller | changed: [instance] => (item=cifmw-public) 2025-12-04 12:20:35.603702 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-04 12:20:35.603721 | controller | 2025-12-04 12:20:35.603728 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2025-12-04 12:20:35.603734 | controller | Thursday 04 December 2025 12:20:35 +0000 (0:00:00.439) 0:00:44.540 ***** 2025-12-04 12:20:35.603743 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2025-12-04 12:20:35.780119 | controller | 2025-12-04 12:20:35.780138 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2025-12-04 12:20:35.780145 | controller | Thursday 04 December 2025 12:20:35 +0000 (0:00:00.056) 0:00:44.597 ***** 2025-12-04 12:20:35.780154 | controller | ok: [instance] 2025-12-04 12:20:36.149917 | controller | 2025-12-04 12:20:36.149955 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2025-12-04 12:20:36.149963 | controller | Thursday 04 December 2025 12:20:35 +0000 (0:00:00.176) 0:00:44.773 ***** 2025-12-04 12:20:36.149973 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 12:20:36.217728 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 12:20:36.217750 | controller | 2025-12-04 12:20:36.217758 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2025-12-04 12:20:36.217764 | controller | Thursday 04 December 2025 12:20:36 +0000 (0:00:00.369) 0:00:45.143 ***** 2025-12-04 12:20:36.217773 | controller | 2025-12-04 12:20:36.253144 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-12-04 12:20:36.253164 | controller | Thursday 04 December 2025 12:20:36 +0000 (0:00:00.068) 0:00:45.211 ***** 2025-12-04 12:20:36.253174 | controller | skipping: [instance] 2025-12-04 12:20:37.461068 | controller | 2025-12-04 12:20:37.461104 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2025-12-04 12:20:37.461112 | controller | Thursday 04 December 2025 12:20:36 +0000 (0:00:00.035) 0:00:45.246 ***** 2025-12-04 12:20:37.461122 | controller | ok: [instance] 2025-12-04 12:20:37.662659 | controller | 2025-12-04 12:20:37.662686 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-12-04 12:20:37.662694 | controller | Thursday 04 December 2025 12:20:37 +0000 (0:00:01.207) 0:00:46.454 ***** 2025-12-04 12:20:37.662704 | controller | ok: [instance] 2025-12-04 12:20:38.025109 | controller | 2025-12-04 12:20:38.025140 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2025-12-04 12:20:38.025148 | controller | Thursday 04 December 2025 12:20:37 +0000 (0:00:00.201) 0:00:46.656 ***** 2025-12-04 12:20:38.025158 | controller | changed: [instance] 2025-12-04 12:20:39.685869 | controller | 2025-12-04 12:20:39.685905 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2025-12-04 12:20:39.685915 | controller | Thursday 04 December 2025 12:20:38 +0000 (0:00:00.362) 0:00:47.018 ***** 2025-12-04 12:20:39.685927 | controller | changed: [instance] 2025-12-04 12:20:40.036010 | controller | 2025-12-04 12:20:40.036035 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2025-12-04 12:20:40.036043 | controller | Thursday 04 December 2025 12:20:39 +0000 (0:00:01.660) 0:00:48.679 ***** 2025-12-04 12:20:40.036052 | controller | changed: [instance] 2025-12-04 12:20:40.069370 | controller | 2025-12-04 12:20:40.069420 | controller | TASK [Create extra network configuration] ************************************** 2025-12-04 12:20:40.069430 | controller | Thursday 04 December 2025 12:20:40 +0000 (0:00:00.350) 0:00:49.029 ***** 2025-12-04 12:20:40.069440 | controller | skipping: [instance] 2025-12-04 12:20:40.096985 | controller | 2025-12-04 12:20:40.097003 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2025-12-04 12:20:40.097010 | controller | Thursday 04 December 2025 12:20:40 +0000 (0:00:00.032) 0:00:49.062 ***** 2025-12-04 12:20:40.097023 | controller | skipping: [instance] 2025-12-04 12:20:40.538367 | controller | 2025-12-04 12:20:40.538422 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2025-12-04 12:20:40.538438 | controller | Thursday 04 December 2025 12:20:40 +0000 (0:00:00.028) 0:00:49.090 ***** 2025-12-04 12:20:40.538451 | controller | ok: [instance] 2025-12-04 12:20:40.684784 | controller | 2025-12-04 12:20:40.684803 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2025-12-04 12:20:40.684810 | controller | Thursday 04 December 2025 12:20:40 +0000 (0:00:00.441) 0:00:49.531 ***** 2025-12-04 12:20:40.684818 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 12:20:41.888726 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 12:20:41.888756 | controller | 2025-12-04 12:20:41.888764 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2025-12-04 12:20:41.888769 | controller | Thursday 04 December 2025 12:20:40 +0000 (0:00:00.146) 0:00:49.678 ***** 2025-12-04 12:20:41.888779 | controller | ok: [instance] 2025-12-04 12:20:45.582010 | controller | 2025-12-04 12:20:45.582043 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2025-12-04 12:20:45.582051 | controller | Thursday 04 December 2025 12:20:41 +0000 (0:00:01.203) 0:00:50.882 ***** 2025-12-04 12:20:45.582061 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2025-12-04 12:20:45.799441 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2025-12-04 12:20:45.799474 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2025-12-04 12:20:45.799484 | controller | 2025-12-04 12:20:45.799491 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2025-12-04 12:20:45.799499 | controller | Thursday 04 December 2025 12:20:45 +0000 (0:00:03.693) 0:00:54.575 ***** 2025-12-04 12:20:45.799513 | controller | changed: [instance] 2025-12-04 12:20:46.157751 | controller | 2025-12-04 12:20:46.157779 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2025-12-04 12:20:46.157787 | controller | Thursday 04 December 2025 12:20:45 +0000 (0:00:00.217) 0:00:54.792 ***** 2025-12-04 12:20:46.157797 | controller | changed: [instance] 2025-12-04 12:20:46.544386 | controller | 2025-12-04 12:20:46.544425 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2025-12-04 12:20:46.544435 | controller | Thursday 04 December 2025 12:20:46 +0000 (0:00:00.358) 0:00:55.151 ***** 2025-12-04 12:20:46.544447 | controller | changed: [instance] 2025-12-04 12:20:46.575406 | controller | 2025-12-04 12:20:46.575433 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2025-12-04 12:20:46.575441 | controller | Thursday 04 December 2025 12:20:46 +0000 (0:00:00.386) 0:00:55.538 ***** 2025-12-04 12:20:46.575452 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2025-12-04 12:20:46.957348 | controller | 2025-12-04 12:20:46.957410 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2025-12-04 12:20:46.957421 | controller | Thursday 04 December 2025 12:20:46 +0000 (0:00:00.031) 0:00:55.569 ***** 2025-12-04 12:20:46.957436 | controller | changed: [instance] 2025-12-04 12:20:46.957480 | controller | 2025-12-04 12:20:46.957615 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2025-12-04 12:20:46.957650 | controller | Thursday 04 December 2025 12:20:46 +0000 (0:00:00.382) 0:00:55.951 ***** 2025-12-04 12:20:46.976954 | controller | skipping: [instance] 2025-12-04 12:20:47.010385 | controller | 2025-12-04 12:20:47.010416 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2025-12-04 12:20:47.010425 | controller | Thursday 04 December 2025 12:20:46 +0000 (0:00:00.019) 0:00:55.970 ***** 2025-12-04 12:20:47.010435 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2025-12-04 12:20:47.010461 | controller | 2025-12-04 12:20:47.010729 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2025-12-04 12:20:47.366378 | controller | Thursday 04 December 2025 12:20:47 +0000 (0:00:00.033) 0:00:56.004 ***** 2025-12-04 12:20:47.366413 | controller | changed: [instance] 2025-12-04 12:20:47.366504 | controller | 2025-12-04 12:20:47.366537 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2025-12-04 12:20:47.366549 | controller | Thursday 04 December 2025 12:20:47 +0000 (0:00:00.355) 0:00:56.360 ***** 2025-12-04 12:20:47.385172 | controller | skipping: [instance] 2025-12-04 12:20:47.589286 | controller | 2025-12-04 12:20:47.589320 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2025-12-04 12:20:47.589329 | controller | Thursday 04 December 2025 12:20:47 +0000 (0:00:00.018) 0:00:56.378 ***** 2025-12-04 12:20:47.589340 | controller | ok: [instance] => (item=127.0.0.2) 2025-12-04 12:20:48.245276 | controller | 2025-12-04 12:20:48.245307 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2025-12-04 12:20:48.245316 | controller | Thursday 04 December 2025 12:20:47 +0000 (0:00:00.203) 0:00:56.582 ***** 2025-12-04 12:20:48.245326 | controller | changed: [instance] 2025-12-04 12:20:48.265802 | controller | 2025-12-04 12:20:48.265824 | controller | TASK [dnsmasq : Stop service] ************************************************** 2025-12-04 12:20:48.265839 | controller | Thursday 04 December 2025 12:20:48 +0000 (0:00:00.656) 0:00:57.238 ***** 2025-12-04 12:20:48.265851 | controller | skipping: [instance] 2025-12-04 12:20:48.285096 | controller | 2025-12-04 12:20:48.285117 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2025-12-04 12:20:48.285125 | controller | Thursday 04 December 2025 12:20:48 +0000 (0:00:00.020) 0:00:57.259 ***** 2025-12-04 12:20:48.285135 | controller | skipping: [instance] 2025-12-04 12:20:48.315911 | controller | 2025-12-04 12:20:48.315929 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2025-12-04 12:20:48.315936 | controller | Thursday 04 December 2025 12:20:48 +0000 (0:00:00.019) 0:00:57.278 ***** 2025-12-04 12:20:48.315945 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-12-04 12:20:48.431735 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2025-12-04 12:20:48.431759 | controller | skipping: [instance] 2025-12-04 12:20:48.431767 | controller | 2025-12-04 12:20:48.431773 | controller | TASK [Create dnsmasq networks] ************************************************* 2025-12-04 12:20:48.431779 | controller | Thursday 04 December 2025 12:20:48 +0000 (0:00:00.030) 0:00:57.309 ***** 2025-12-04 12:20:48.431787 | controller | 2025-12-04 12:20:48.459376 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-12-04 12:20:48.459433 | controller | Thursday 04 December 2025 12:20:48 +0000 (0:00:00.116) 0:00:57.425 ***** 2025-12-04 12:20:48.459456 | controller | ok: [instance] => changed=false 2025-12-04 12:20:48.459705 | controller | msg: All assertions passed 2025-12-04 12:20:48.459739 | controller | 2025-12-04 12:20:48.498204 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-12-04 12:20:48.498223 | controller | Thursday 04 December 2025 12:20:48 +0000 (0:00:00.027) 0:00:57.452 ***** 2025-12-04 12:20:48.498233 | controller | ok: [instance] => changed=false 2025-12-04 12:20:48.498419 | controller | msg: All assertions passed 2025-12-04 12:20:48.498559 | controller | 2025-12-04 12:20:48.498698 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-12-04 12:20:48.498834 | controller | Thursday 04 December 2025 12:20:48 +0000 (0:00:00.039) 0:00:57.492 ***** 2025-12-04 12:20:48.928517 | controller | changed: [instance] 2025-12-04 12:20:48.928683 | controller | 2025-12-04 12:20:48.928851 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-12-04 12:20:48.928998 | controller | Thursday 04 December 2025 12:20:48 +0000 (0:00:00.430) 0:00:57.922 ***** 2025-12-04 12:20:48.948746 | controller | skipping: [instance] 2025-12-04 12:20:48.948888 | controller | 2025-12-04 12:20:48.949025 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-12-04 12:20:48.949163 | controller | Thursday 04 December 2025 12:20:48 +0000 (0:00:00.020) 0:00:57.942 ***** 2025-12-04 12:20:48.973389 | controller | skipping: [instance] 2025-12-04 12:20:48.973560 | controller | 2025-12-04 12:20:48.973725 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-12-04 12:20:48.973869 | controller | Thursday 04 December 2025 12:20:48 +0000 (0:00:00.024) 0:00:57.967 ***** 2025-12-04 12:20:49.003834 | controller | ok: [instance] => changed=false 2025-12-04 12:20:49.003986 | controller | msg: All assertions passed 2025-12-04 12:20:49.004117 | controller | 2025-12-04 12:20:49.004293 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-12-04 12:20:49.004459 | controller | Thursday 04 December 2025 12:20:49 +0000 (0:00:00.030) 0:00:57.998 ***** 2025-12-04 12:20:49.040916 | controller | ok: [instance] => changed=false 2025-12-04 12:20:49.041112 | controller | msg: All assertions passed 2025-12-04 12:20:49.041318 | controller | 2025-12-04 12:20:49.041522 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-12-04 12:20:49.041708 | controller | Thursday 04 December 2025 12:20:49 +0000 (0:00:00.037) 0:00:58.035 ***** 2025-12-04 12:20:49.467717 | controller | changed: [instance] 2025-12-04 12:20:49.488369 | controller | 2025-12-04 12:20:49.488391 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-12-04 12:20:49.488401 | controller | Thursday 04 December 2025 12:20:49 +0000 (0:00:00.426) 0:00:58.461 ***** 2025-12-04 12:20:49.488412 | controller | skipping: [instance] 2025-12-04 12:20:49.488440 | controller | 2025-12-04 12:20:49.488450 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-12-04 12:20:49.488536 | controller | Thursday 04 December 2025 12:20:49 +0000 (0:00:00.020) 0:00:58.482 ***** 2025-12-04 12:20:49.512927 | controller | skipping: [instance] 2025-12-04 12:20:49.543844 | controller | 2025-12-04 12:20:49.543864 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2025-12-04 12:20:49.543873 | controller | Thursday 04 December 2025 12:20:49 +0000 (0:00:00.024) 0:00:58.506 ***** 2025-12-04 12:20:49.543883 | controller | skipping: [instance] 2025-12-04 12:20:50.006719 | controller | 2025-12-04 12:20:50.006749 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2025-12-04 12:20:50.006757 | controller | Thursday 04 December 2025 12:20:49 +0000 (0:00:00.030) 0:00:58.537 ***** 2025-12-04 12:20:50.006772 | controller | changed: [instance] => (item=cifmw-public) 2025-12-04 12:20:50.042217 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-04 12:20:50.042236 | controller | 2025-12-04 12:20:50.042244 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-04 12:20:50.042271 | controller | Thursday 04 December 2025 12:20:50 +0000 (0:00:00.462) 0:00:59.000 ***** 2025-12-04 12:20:50.042281 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2025-12-04 12:20:50.373757 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2025-12-04 12:20:50.373787 | controller | 2025-12-04 12:20:50.373795 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-04 12:20:50.373801 | controller | Thursday 04 December 2025 12:20:50 +0000 (0:00:00.035) 0:00:59.035 ***** 2025-12-04 12:20:50.373810 | controller | ok: [instance] 2025-12-04 12:20:50.408917 | controller | 2025-12-04 12:20:50.408951 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-12-04 12:20:50.408959 | controller | Thursday 04 December 2025 12:20:50 +0000 (0:00:00.331) 0:00:59.367 ***** 2025-12-04 12:20:50.408970 | controller | ok: [instance] 2025-12-04 12:20:50.605347 | controller | 2025-12-04 12:20:50.605378 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-04 12:20:50.605387 | controller | Thursday 04 December 2025 12:20:50 +0000 (0:00:00.035) 0:00:59.402 ***** 2025-12-04 12:20:50.605397 | controller | ok: [instance] 2025-12-04 12:20:50.605421 | controller | 2025-12-04 12:20:50.605429 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-12-04 12:20:50.605629 | controller | Thursday 04 December 2025 12:20:50 +0000 (0:00:00.196) 0:00:59.599 ***** 2025-12-04 12:20:50.641293 | controller | ok: [instance] 2025-12-04 12:20:50.976799 | controller | 2025-12-04 12:20:50.976828 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2025-12-04 12:20:50.976836 | controller | Thursday 04 December 2025 12:20:50 +0000 (0:00:00.035) 0:00:59.635 ***** 2025-12-04 12:20:50.976851 | controller | changed: [instance] 2025-12-04 12:20:51.319181 | controller | 2025-12-04 12:20:51.319207 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2025-12-04 12:20:51.319215 | controller | Thursday 04 December 2025 12:20:50 +0000 (0:00:00.335) 0:00:59.970 ***** 2025-12-04 12:20:51.319224 | controller | changed: [instance] 2025-12-04 12:20:51.662013 | controller | 2025-12-04 12:20:51.662040 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2025-12-04 12:20:51.662048 | controller | Thursday 04 December 2025 12:20:51 +0000 (0:00:00.342) 0:01:00.312 ***** 2025-12-04 12:20:51.662058 | controller | changed: [instance] 2025-12-04 12:20:51.754679 | controller | 2025-12-04 12:20:51.754699 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2025-12-04 12:20:51.754707 | controller | Thursday 04 December 2025 12:20:51 +0000 (0:00:00.342) 0:01:00.655 ***** 2025-12-04 12:20:51.754715 | controller | ok: [instance] 2025-12-04 12:20:52.083915 | controller | 2025-12-04 12:20:52.083940 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2025-12-04 12:20:52.083948 | controller | Thursday 04 December 2025 12:20:51 +0000 (0:00:00.092) 0:01:00.748 ***** 2025-12-04 12:20:52.083958 | controller | changed: [instance] 2025-12-04 12:20:52.106356 | controller | 2025-12-04 12:20:52.106394 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-04 12:20:52.106404 | controller | Thursday 04 December 2025 12:20:52 +0000 (0:00:00.328) 0:01:01.077 ***** 2025-12-04 12:20:52.106416 | controller | skipping: [instance] 2025-12-04 12:20:52.106447 | controller | 2025-12-04 12:20:52.106456 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-04 12:20:52.106575 | controller | Thursday 04 December 2025 12:20:52 +0000 (0:00:00.022) 0:01:01.100 ***** 2025-12-04 12:20:52.128002 | controller | skipping: [instance] 2025-12-04 12:20:52.150163 | controller | 2025-12-04 12:20:52.150181 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-04 12:20:52.150189 | controller | Thursday 04 December 2025 12:20:52 +0000 (0:00:00.021) 0:01:01.121 ***** 2025-12-04 12:20:52.150197 | controller | skipping: [instance] 2025-12-04 12:20:52.177928 | controller | 2025-12-04 12:20:52.177946 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-04 12:20:52.177954 | controller | Thursday 04 December 2025 12:20:52 +0000 (0:00:00.022) 0:01:01.143 ***** 2025-12-04 12:20:52.177962 | controller | skipping: [instance] 2025-12-04 12:20:52.196992 | controller | 2025-12-04 12:20:52.197010 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-04 12:20:52.197018 | controller | Thursday 04 December 2025 12:20:52 +0000 (0:00:00.027) 0:01:01.171 ***** 2025-12-04 12:20:52.197027 | controller | ok: [instance] 2025-12-04 12:20:52.282576 | controller | 2025-12-04 12:20:52.282609 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-04 12:20:52.282631 | controller | Thursday 04 December 2025 12:20:52 +0000 (0:00:00.019) 0:01:01.190 ***** 2025-12-04 12:20:52.282651 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-12-04 12:20:52.282960 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-12-04 12:20:52.283183 | controller | 2025-12-04 12:20:52.283348 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-04 12:20:52.283481 | controller | Thursday 04 December 2025 12:20:52 +0000 (0:00:00.085) 0:01:01.276 ***** 2025-12-04 12:20:52.299462 | controller | skipping: [instance] 2025-12-04 12:20:52.299731 | controller | 2025-12-04 12:20:52.299991 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-04 12:20:52.300198 | controller | Thursday 04 December 2025 12:20:52 +0000 (0:00:00.016) 0:01:01.293 ***** 2025-12-04 12:20:52.494319 | controller | ok: [instance] 2025-12-04 12:20:52.883415 | controller | 2025-12-04 12:20:52.883448 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-04 12:20:52.883458 | controller | Thursday 04 December 2025 12:20:52 +0000 (0:00:00.194) 0:01:01.488 ***** 2025-12-04 12:20:52.883470 | controller | changed: [instance] 2025-12-04 12:20:52.942937 | controller | 2025-12-04 12:20:52.942974 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-04 12:20:52.942984 | controller | Thursday 04 December 2025 12:20:52 +0000 (0:00:00.388) 0:01:01.876 ***** 2025-12-04 12:20:52.942996 | controller | ok: [instance] 2025-12-04 12:20:52.976878 | controller | 2025-12-04 12:20:52.976896 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-04 12:20:52.976903 | controller | Thursday 04 December 2025 12:20:52 +0000 (0:00:00.059) 0:01:01.936 ***** 2025-12-04 12:20:52.976912 | controller | ok: [instance] 2025-12-04 12:20:53.375769 | controller | 2025-12-04 12:20:53.375795 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-04 12:20:53.375803 | controller | Thursday 04 December 2025 12:20:52 +0000 (0:00:00.034) 0:01:01.970 ***** 2025-12-04 12:20:53.375813 | controller | changed: [instance] 2025-12-04 12:20:53.404437 | controller | 2025-12-04 12:20:53.404479 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2025-12-04 12:20:53.404493 | controller | Thursday 04 December 2025 12:20:53 +0000 (0:00:00.398) 0:01:02.369 ***** 2025-12-04 12:20:53.404509 | controller | ok: [instance] 2025-12-04 12:20:53.404550 | controller | 2025-12-04 12:20:53.404563 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2025-12-04 12:20:53.423402 | controller | Thursday 04 December 2025 12:20:53 +0000 (0:00:00.028) 0:01:02.398 ***** 2025-12-04 12:20:53.423437 | controller | ok: [instance] 2025-12-04 12:20:53.423479 | controller | 2025-12-04 12:20:53.423493 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2025-12-04 12:20:53.423529 | controller | Thursday 04 December 2025 12:20:53 +0000 (0:00:00.019) 0:01:02.417 ***** 2025-12-04 12:20:53.443114 | controller | ok: [instance] 2025-12-04 12:20:53.519454 | controller | 2025-12-04 12:20:53.519497 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2025-12-04 12:20:53.519510 | controller | Thursday 04 December 2025 12:20:53 +0000 (0:00:00.019) 0:01:02.436 ***** 2025-12-04 12:20:53.519526 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2025-12-04 12:20:53.519568 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2025-12-04 12:20:53.519579 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2025-12-04 12:20:53.519588 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2025-12-04 12:20:53.519597 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2025-12-04 12:20:53.519606 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2025-12-04 12:20:53.519618 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2025-12-04 12:20:53.519652 | controller | 2025-12-04 12:20:53.519835 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 12:20:53.654291 | controller | Thursday 04 December 2025 12:20:53 +0000 (0:00:00.076) 0:01:02.513 ***** 2025-12-04 12:20:53.654344 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2025-12-04 12:20:53.733546 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2025-12-04 12:20:53.733568 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2025-12-04 12:20:53.733578 | controller | 2025-12-04 12:20:53.733586 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 12:20:53.733594 | controller | Thursday 04 December 2025 12:20:53 +0000 (0:00:00.134) 0:01:02.647 ***** 2025-12-04 12:20:53.733605 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2025-12-04 12:20:53.733797 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2025-12-04 12:20:53.733943 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2025-12-04 12:20:53.734078 | controller | skipping: [instance] 2025-12-04 12:20:53.734204 | controller | 2025-12-04 12:20:53.734371 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 12:20:53.734517 | controller | Thursday 04 December 2025 12:20:53 +0000 (0:00:00.079) 0:01:02.727 ***** 2025-12-04 12:20:53.813300 | controller | skipping: [instance] => (item=compute-0 - storage) 2025-12-04 12:20:53.813524 | controller | skipping: [instance] => (item=controller-0 - storage) 2025-12-04 12:20:53.813709 | controller | skipping: [instance] => (item=crc-0 - storage) 2025-12-04 12:20:53.813886 | controller | skipping: [instance] 2025-12-04 12:20:53.814039 | controller | 2025-12-04 12:20:53.814173 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 12:20:53.814352 | controller | Thursday 04 December 2025 12:20:53 +0000 (0:00:00.079) 0:01:02.807 ***** 2025-12-04 12:20:53.924195 | controller | skipping: [instance] => (item=compute-0 - tenant) 2025-12-04 12:20:53.924428 | controller | skipping: [instance] => (item=controller-0 - tenant) 2025-12-04 12:20:53.924605 | controller | skipping: [instance] => (item=crc-0 - tenant) 2025-12-04 12:20:53.924776 | controller | skipping: [instance] 2025-12-04 12:20:53.924930 | controller | 2025-12-04 12:20:53.925103 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 12:20:53.925268 | controller | Thursday 04 December 2025 12:20:53 +0000 (0:00:00.110) 0:01:02.918 ***** 2025-12-04 12:20:54.005939 | controller | skipping: [instance] => (item=compute-0 - external) 2025-12-04 12:20:54.006102 | controller | skipping: [instance] => (item=controller-0 - external) 2025-12-04 12:20:54.006273 | controller | skipping: [instance] => (item=crc-0 - external) 2025-12-04 12:20:54.006436 | controller | skipping: [instance] 2025-12-04 12:20:54.006566 | controller | 2025-12-04 12:20:54.006701 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 12:20:54.006833 | controller | Thursday 04 December 2025 12:20:54 +0000 (0:00:00.081) 0:01:03.000 ***** 2025-12-04 12:20:54.086580 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2025-12-04 12:20:54.086798 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2025-12-04 12:20:54.086988 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2025-12-04 12:20:54.087167 | controller | skipping: [instance] 2025-12-04 12:20:54.087392 | controller | 2025-12-04 12:20:54.087559 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 12:20:54.087689 | controller | Thursday 04 December 2025 12:20:54 +0000 (0:00:00.080) 0:01:03.080 ***** 2025-12-04 12:20:54.252092 | controller | ok: [instance] => (item=compute-0 - public) 2025-12-04 12:20:54.252274 | controller | ok: [instance] => (item=controller-0 - public) 2025-12-04 12:20:54.252446 | controller | ok: [instance] => (item=crc-0 - public) 2025-12-04 12:20:54.252580 | controller | 2025-12-04 12:20:54.252715 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2025-12-04 12:20:54.252846 | controller | Thursday 04 December 2025 12:20:54 +0000 (0:00:00.165) 0:01:03.246 ***** 2025-12-04 12:20:54.361335 | controller | 2025-12-04 12:20:54.361636 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2025-12-04 12:20:54.361899 | controller | Thursday 04 December 2025 12:20:54 +0000 (0:00:00.109) 0:01:03.355 ***** 2025-12-04 12:20:54.431300 | controller | ok: [instance] 2025-12-04 12:20:54.431499 | controller | 2025-12-04 12:20:54.431676 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2025-12-04 12:20:54.431842 | controller | Thursday 04 December 2025 12:20:54 +0000 (0:00:00.070) 0:01:03.425 ***** 2025-12-04 12:20:54.532041 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:1b:52:18', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-12-04 12:20:54.532203 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:29:89:36', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-12-04 12:20:54.532386 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:5f:68:69', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-12-04 12:20:54.532535 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:95:0a:c4', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-12-04 12:20:54.532695 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:3c:34:64', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-12-04 12:20:54.532837 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:85:1c:d1', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-12-04 12:20:54.532961 | controller | 2025-12-04 12:20:54.533092 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2025-12-04 12:20:54.533221 | controller | Thursday 04 December 2025 12:20:54 +0000 (0:00:00.100) 0:01:03.526 ***** 2025-12-04 12:20:54.584456 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2025-12-04 12:20:54.584610 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2025-12-04 12:20:54.584747 | controller | 2025-12-04 12:20:54.584880 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-12-04 12:20:54.585011 | controller | Thursday 04 December 2025 12:20:54 +0000 (0:00:00.052) 0:01:03.578 ***** 2025-12-04 12:20:54.763190 | controller | ok: [instance] 2025-12-04 12:20:54.788288 | controller | 2025-12-04 12:20:54.788341 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-12-04 12:20:54.788358 | controller | Thursday 04 December 2025 12:20:54 +0000 (0:00:00.178) 0:01:03.756 ***** 2025-12-04 12:20:54.788369 | controller | ok: [instance] 2025-12-04 12:20:54.969036 | controller | 2025-12-04 12:20:54.969055 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-12-04 12:20:54.969062 | controller | Thursday 04 December 2025 12:20:54 +0000 (0:00:00.024) 0:01:03.781 ***** 2025-12-04 12:20:54.969071 | controller | ok: [instance] 2025-12-04 12:20:54.993949 | controller | 2025-12-04 12:20:54.993967 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-12-04 12:20:54.993974 | controller | Thursday 04 December 2025 12:20:54 +0000 (0:00:00.180) 0:01:03.962 ***** 2025-12-04 12:20:54.993983 | controller | ok: [instance] 2025-12-04 12:20:55.013629 | controller | 2025-12-04 12:20:55.013646 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2025-12-04 12:20:55.013652 | controller | Thursday 04 December 2025 12:20:54 +0000 (0:00:00.025) 0:01:03.987 ***** 2025-12-04 12:20:55.013661 | controller | ok: [instance] 2025-12-04 12:20:55.200235 | controller | 2025-12-04 12:20:55.200279 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2025-12-04 12:20:55.200290 | controller | Thursday 04 December 2025 12:20:55 +0000 (0:00:00.019) 0:01:04.007 ***** 2025-12-04 12:20:55.200300 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:1b:52:18', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-12-04 12:20:55.238132 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:29:89:36', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-12-04 12:20:55.238153 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:5f:68:69', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-12-04 12:20:55.238161 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:95:0a:c4', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-12-04 12:20:55.238168 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:3c:34:64', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-12-04 12:20:55.238175 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:85:1c:d1', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-12-04 12:20:55.238182 | controller | 2025-12-04 12:20:55.238188 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2025-12-04 12:20:55.238195 | controller | Thursday 04 December 2025 12:20:55 +0000 (0:00:00.186) 0:01:04.193 ***** 2025-12-04 12:20:55.238205 | controller | ok: [instance] 2025-12-04 12:20:57.270322 | controller | 2025-12-04 12:20:57.270358 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2025-12-04 12:20:57.270368 | controller | Thursday 04 December 2025 12:20:55 +0000 (0:00:00.038) 0:01:04.231 ***** 2025-12-04 12:20:57.270381 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:1b:52:18', 'entry': 'set:compute,52:54:00:1b:52:18,192.168.140.100,compute-0', 'state': 'present'}) 2025-12-04 12:20:57.270414 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:29:89:36', 'entry': 'set:controller,52:54:01:29:89:36,192.168.140.9,controller-0', 'state': 'present'}) 2025-12-04 12:20:57.271135 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:5f:68:69', 'entry': 'set:ocp,52:54:02:5f:68:69,192.168.140.10,crc-0', 'state': 'present'}) 2025-12-04 12:20:57.293911 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:95:0a:c4', 'entry': 'set:compute,52:54:00:95:0a:c4,192.168.101.100,compute-0', 'state': 'present'}) 2025-12-04 12:20:57.293934 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:3c:34:64', 'entry': 'set:controller,52:54:01:3c:34:64,192.168.101.9,controller-0', 'state': 'present'}) 2025-12-04 12:20:57.293943 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:85:1c:d1', 'entry': 'set:ocp,52:54:02:85:1c:d1,192.168.101.10,crc-0', 'state': 'present'}) 2025-12-04 12:20:57.293956 | controller | 2025-12-04 12:20:57.293963 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2025-12-04 12:20:57.293971 | controller | Thursday 04 December 2025 12:20:57 +0000 (0:00:02.032) 0:01:06.264 ***** 2025-12-04 12:20:57.293981 | controller | skipping: [instance] 2025-12-04 12:20:57.502355 | controller | 2025-12-04 12:20:57.502390 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2025-12-04 12:20:57.502406 | controller | Thursday 04 December 2025 12:20:57 +0000 (0:00:00.023) 0:01:06.287 ***** 2025-12-04 12:20:57.502417 | controller | ok: [instance] => (item=compute-0) 2025-12-04 12:20:57.502443 | controller | ok: [instance] => (item=controller-0) 2025-12-04 12:20:57.502450 | controller | ok: [instance] => (item=crc-0) 2025-12-04 12:20:57.502866 | controller | 2025-12-04 12:20:57.620881 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2025-12-04 12:20:57.620916 | controller | Thursday 04 December 2025 12:20:57 +0000 (0:00:00.208) 0:01:06.496 ***** 2025-12-04 12:20:57.620934 | controller | 2025-12-04 12:20:57.663445 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-04 12:20:57.663478 | controller | Thursday 04 December 2025 12:20:57 +0000 (0:00:00.118) 0:01:06.614 ***** 2025-12-04 12:20:57.663496 | controller | ok: [instance] 2025-12-04 12:20:57.663751 | controller | 2025-12-04 12:20:57.664008 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-04 12:20:57.664295 | controller | Thursday 04 December 2025 12:20:57 +0000 (0:00:00.043) 0:01:06.657 ***** 2025-12-04 12:20:57.867657 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-04 12:20:57.867834 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-04 12:20:57.867981 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-12-04 12:20:57.868124 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-12-04 12:20:57.868326 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-12-04 12:20:57.868478 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-12-04 12:20:57.868622 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-12-04 12:20:57.868770 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 12:20:57.868915 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 12:20:57.869061 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-12-04 12:20:57.869199 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-04 12:20:57.869374 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-04 12:20:57.869515 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-12-04 12:20:57.869649 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-12-04 12:20:57.869788 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-12-04 12:20:57.869921 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-12-04 12:20:57.870045 | controller | 2025-12-04 12:20:57.870174 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-04 12:20:57.870337 | controller | Thursday 04 December 2025 12:20:57 +0000 (0:00:00.203) 0:01:06.861 ***** 2025-12-04 12:21:01.077441 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-04 12:21:01.078372 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-04 12:21:01.078408 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-12-04 12:21:01.078419 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-12-04 12:21:01.078426 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-12-04 12:21:01.078433 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-12-04 12:21:01.078440 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-12-04 12:21:01.078452 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 12:21:01.078483 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 12:21:01.078491 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-12-04 12:21:01.078498 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-04 12:21:01.078505 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-04 12:21:01.078512 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-12-04 12:21:01.078519 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-12-04 12:21:01.078525 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-12-04 12:21:01.078532 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-12-04 12:21:01.078541 | controller | 2025-12-04 12:21:01.078630 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2025-12-04 12:21:01.078665 | controller | Thursday 04 December 2025 12:21:01 +0000 (0:00:03.208) 0:01:10.070 ***** 2025-12-04 12:21:01.097989 | controller | ok: [instance] 2025-12-04 12:21:01.142375 | controller | 2025-12-04 12:21:01.142422 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2025-12-04 12:21:01.142436 | controller | Thursday 04 December 2025 12:21:01 +0000 (0:00:00.021) 0:01:10.091 ***** 2025-12-04 12:21:01.142452 | controller | skipping: [instance] => (item=compute) 2025-12-04 12:21:01.172777 | controller | skipping: [instance] => (item=controller) 2025-12-04 12:21:01.172804 | controller | skipping: [instance] => (item=crc) 2025-12-04 12:21:01.172814 | controller | skipping: [instance] 2025-12-04 12:21:01.172822 | controller | 2025-12-04 12:21:01.172829 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2025-12-04 12:21:01.172836 | controller | Thursday 04 December 2025 12:21:01 +0000 (0:00:00.043) 0:01:10.135 ***** 2025-12-04 12:21:01.172848 | controller | skipping: [instance] 2025-12-04 12:21:01.172912 | controller | 2025-12-04 12:21:01.173095 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2025-12-04 12:21:01.173226 | controller | Thursday 04 December 2025 12:21:01 +0000 (0:00:00.031) 0:01:10.166 ***** 2025-12-04 12:21:01.554344 | controller | changed: [instance] 2025-12-04 12:21:02.355115 | controller | 2025-12-04 12:21:02.355146 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2025-12-04 12:21:02.355154 | controller | Thursday 04 December 2025 12:21:01 +0000 (0:00:00.368) 0:01:10.535 ***** 2025-12-04 12:21:02.355160 | controller | 2025-12-04 12:21:02.355165 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-12-04 12:21:02.355171 | controller | Thursday 04 December 2025 12:21:01 +0000 (0:00:00.010) 0:01:10.546 ***** 2025-12-04 12:21:02.355181 | controller | changed: [instance] 2025-12-04 12:21:02.700392 | controller | 2025-12-04 12:21:02.700427 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-04 12:21:02.700437 | controller | Thursday 04 December 2025 12:21:02 +0000 (0:00:00.802) 0:01:11.348 ***** 2025-12-04 12:21:02.700449 | controller | changed: [instance] 2025-12-04 12:21:03.054291 | controller | 2025-12-04 12:21:03.054331 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2025-12-04 12:21:03.054342 | controller | Thursday 04 December 2025 12:21:02 +0000 (0:00:00.345) 0:01:11.694 ***** 2025-12-04 12:21:03.054355 | controller | changed: [instance] 2025-12-04 12:21:03.407089 | controller | 2025-12-04 12:21:03.407128 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2025-12-04 12:21:03.407137 | controller | Thursday 04 December 2025 12:21:03 +0000 (0:00:00.353) 0:01:12.047 ***** 2025-12-04 12:21:03.407150 | controller | changed: [instance] 2025-12-04 12:21:03.772383 | controller | 2025-12-04 12:21:03.772418 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2025-12-04 12:21:03.772426 | controller | Thursday 04 December 2025 12:21:03 +0000 (0:00:00.352) 0:01:12.400 ***** 2025-12-04 12:21:03.772436 | controller | changed: [instance] 2025-12-04 12:21:03.772469 | controller | 2025-12-04 12:21:03.772477 | controller | TASK [Build utility records dataset] ******************************************* 2025-12-04 12:21:03.772485 | controller | Thursday 04 December 2025 12:21:03 +0000 (0:00:00.365) 0:01:12.766 ***** 2025-12-04 12:21:03.835777 | controller | 2025-12-04 12:21:03.927428 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-04 12:21:03.927467 | controller | Thursday 04 December 2025 12:21:03 +0000 (0:00:00.063) 0:01:12.829 ***** 2025-12-04 12:21:03.927481 | controller | ok: [instance] 2025-12-04 12:21:03.927513 | controller | 2025-12-04 12:21:03.927522 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-04 12:21:03.927657 | controller | Thursday 04 December 2025 12:21:03 +0000 (0:00:00.091) 0:01:12.921 ***** 2025-12-04 12:21:04.025404 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-12-04 12:21:04.025995 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 12:21:04.494389 | controller | 2025-12-04 12:21:04.494426 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-04 12:21:04.494436 | controller | Thursday 04 December 2025 12:21:04 +0000 (0:00:00.097) 0:01:13.018 ***** 2025-12-04 12:21:04.494455 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-12-04 12:21:04.494488 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 12:21:04.494497 | controller | 2025-12-04 12:21:04.494504 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-12-04 12:21:04.494513 | controller | Thursday 04 December 2025 12:21:04 +0000 (0:00:00.457) 0:01:13.476 ***** 2025-12-04 12:21:04.494779 | controller | 2025-12-04 12:21:04.954948 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-04 12:21:04.954979 | controller | Thursday 04 December 2025 12:21:04 +0000 (0:00:00.010) 0:01:13.487 ***** 2025-12-04 12:21:04.954990 | controller | changed: [instance] 2025-12-04 12:21:04.955017 | controller | 2025-12-04 12:21:04.955265 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-04 12:21:05.307360 | controller | Thursday 04 December 2025 12:21:04 +0000 (0:00:00.460) 0:01:13.948 ***** 2025-12-04 12:21:05.307410 | controller | changed: [instance] 2025-12-04 12:21:05.307445 | controller | 2025-12-04 12:21:05.307456 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2025-12-04 12:21:05.307602 | controller | Thursday 04 December 2025 12:21:05 +0000 (0:00:00.352) 0:01:14.301 ***** 2025-12-04 12:21:05.341129 | controller | skipping: [instance] 2025-12-04 12:21:05.416933 | controller | 2025-12-04 12:21:05.416950 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2025-12-04 12:21:05.416958 | controller | Thursday 04 December 2025 12:21:05 +0000 (0:00:00.033) 0:01:14.334 ***** 2025-12-04 12:21:05.416966 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2025-12-04 12:21:05.604439 | controller | 2025-12-04 12:21:05.604481 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2025-12-04 12:21:05.604491 | controller | Thursday 04 December 2025 12:21:05 +0000 (0:00:00.075) 0:01:14.410 ***** 2025-12-04 12:21:05.604505 | controller | ok: [instance] 2025-12-04 12:21:05.604536 | controller | 2025-12-04 12:21:05.604546 | controller | TASK [Deploy CRC if needed] **************************************************** 2025-12-04 12:21:05.604640 | controller | Thursday 04 December 2025 12:21:05 +0000 (0:00:00.187) 0:01:14.598 ***** 2025-12-04 12:21:05.625235 | controller | skipping: [instance] 2025-12-04 12:21:05.965188 | controller | 2025-12-04 12:21:05.965217 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2025-12-04 12:21:05.965225 | controller | Thursday 04 December 2025 12:21:05 +0000 (0:00:00.020) 0:01:14.618 ***** 2025-12-04 12:21:05.965234 | controller | ok: [instance] 2025-12-04 12:21:06.203662 | controller | 2025-12-04 12:21:06.203694 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2025-12-04 12:21:06.203702 | controller | Thursday 04 December 2025 12:21:05 +0000 (0:00:00.339) 0:01:14.958 ***** 2025-12-04 12:21:06.203712 | controller | ok: [instance] 2025-12-04 12:21:06.422015 | controller | 2025-12-04 12:21:06.422047 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2025-12-04 12:21:06.422056 | controller | Thursday 04 December 2025 12:21:06 +0000 (0:00:00.238) 0:01:15.197 ***** 2025-12-04 12:21:06.422066 | controller | ok: [instance] 2025-12-04 12:21:06.651658 | controller | 2025-12-04 12:21:06.651687 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2025-12-04 12:21:06.651695 | controller | Thursday 04 December 2025 12:21:06 +0000 (0:00:00.218) 0:01:15.415 ***** 2025-12-04 12:21:06.651705 | controller | ok: [instance] 2025-12-04 12:21:06.873347 | controller | 2025-12-04 12:21:06.873382 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2025-12-04 12:21:06.873392 | controller | Thursday 04 December 2025 12:21:06 +0000 (0:00:00.229) 0:01:15.645 ***** 2025-12-04 12:21:06.873404 | controller | ok: [instance] 2025-12-04 12:21:06.873433 | controller | 2025-12-04 12:21:06.873443 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-04 12:21:06.873527 | controller | Thursday 04 December 2025 12:21:06 +0000 (0:00:00.221) 0:01:15.867 ***** 2025-12-04 12:21:06.913381 | controller | 2025-12-04 12:21:07.108602 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-12-04 12:21:07.108633 | controller | Thursday 04 December 2025 12:21:06 +0000 (0:00:00.039) 0:01:15.907 ***** 2025-12-04 12:21:07.108652 | controller | ok: [instance] 2025-12-04 12:21:07.108672 | controller | 2025-12-04 12:21:07.108912 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-12-04 12:21:07.132224 | controller | Thursday 04 December 2025 12:21:07 +0000 (0:00:00.194) 0:01:16.102 ***** 2025-12-04 12:21:07.132244 | controller | ok: [instance] 2025-12-04 12:21:07.157066 | controller | 2025-12-04 12:21:07.157084 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-12-04 12:21:07.157091 | controller | Thursday 04 December 2025 12:21:07 +0000 (0:00:00.023) 0:01:16.126 ***** 2025-12-04 12:21:07.157099 | controller | skipping: [instance] 2025-12-04 12:21:07.441925 | controller | 2025-12-04 12:21:07.441948 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2025-12-04 12:21:07.441956 | controller | Thursday 04 December 2025 12:21:07 +0000 (0:00:00.024) 0:01:16.150 ***** 2025-12-04 12:21:07.441965 | controller | ok: [instance] 2025-12-04 12:21:07.665424 | controller | 2025-12-04 12:21:07.665477 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2025-12-04 12:21:07.665486 | controller | Thursday 04 December 2025 12:21:07 +0000 (0:00:00.284) 0:01:16.435 ***** 2025-12-04 12:21:07.665496 | controller | ok: [instance] 2025-12-04 12:21:07.838734 | controller | 2025-12-04 12:21:07.838759 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2025-12-04 12:21:07.838767 | controller | Thursday 04 December 2025 12:21:07 +0000 (0:00:00.223) 0:01:16.659 ***** 2025-12-04 12:21:07.838777 | controller | ok: [instance] 2025-12-04 12:21:07.896779 | controller | 2025-12-04 12:21:07.896806 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2025-12-04 12:21:07.896817 | controller | Thursday 04 December 2025 12:21:07 +0000 (0:00:00.173) 0:01:16.832 ***** 2025-12-04 12:21:07.896829 | controller | 2025-12-04 12:21:07.940826 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-12-04 12:21:07.940845 | controller | Thursday 04 December 2025 12:21:07 +0000 (0:00:00.058) 0:01:16.890 ***** 2025-12-04 12:21:07.940855 | controller | ok: [instance] => changed=false 2025-12-04 12:21:08.117224 | controller | msg: All assertions passed 2025-12-04 12:21:08.117243 | controller | 2025-12-04 12:21:08.117279 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-12-04 12:21:08.117287 | controller | Thursday 04 December 2025 12:21:07 +0000 (0:00:00.043) 0:01:16.934 ***** 2025-12-04 12:21:08.117295 | controller | ok: [instance] 2025-12-04 12:21:08.306416 | controller | 2025-12-04 12:21:08.306459 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-12-04 12:21:08.306470 | controller | Thursday 04 December 2025 12:21:08 +0000 (0:00:00.176) 0:01:17.110 ***** 2025-12-04 12:21:08.306484 | controller | ok: [instance] 2025-12-04 12:21:08.306522 | controller | 2025-12-04 12:21:08.306533 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-12-04 12:21:08.330382 | controller | Thursday 04 December 2025 12:21:08 +0000 (0:00:00.189) 0:01:17.300 ***** 2025-12-04 12:21:08.330426 | controller | ok: [instance] => changed=false 2025-12-04 12:21:08.330468 | controller | msg: All assertions passed 2025-12-04 12:21:08.330701 | controller | 2025-12-04 12:21:08.330724 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-12-04 12:21:08.514391 | controller | Thursday 04 December 2025 12:21:08 +0000 (0:00:00.024) 0:01:17.324 ***** 2025-12-04 12:21:08.514432 | controller | ok: [instance] 2025-12-04 12:21:08.514461 | controller | 2025-12-04 12:21:08.514469 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-12-04 12:21:08.514476 | controller | Thursday 04 December 2025 12:21:08 +0000 (0:00:00.183) 0:01:17.507 ***** 2025-12-04 12:21:08.681171 | controller | ok: [instance] 2025-12-04 12:21:08.729221 | controller | 2025-12-04 12:21:08.729296 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-12-04 12:21:08.729317 | controller | Thursday 04 December 2025 12:21:08 +0000 (0:00:00.167) 0:01:17.674 ***** 2025-12-04 12:21:08.729334 | controller | ok: [instance] 2025-12-04 12:21:09.099194 | controller | 2025-12-04 12:21:09.099226 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2025-12-04 12:21:09.099234 | controller | Thursday 04 December 2025 12:21:08 +0000 (0:00:00.047) 0:01:17.722 ***** 2025-12-04 12:21:09.099244 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2025-12-04 12:21:09.118866 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2025-12-04 12:21:09.118885 | controller | 2025-12-04 12:21:09.118897 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2025-12-04 12:21:09.118904 | controller | Thursday 04 December 2025 12:21:09 +0000 (0:00:00.370) 0:01:18.092 ***** 2025-12-04 12:21:09.118913 | controller | skipping: [instance] 2025-12-04 12:21:09.142988 | controller | 2025-12-04 12:21:09.143003 | controller | TASK [Load the architecture local kustomize patches] *************************** 2025-12-04 12:21:09.143009 | controller | Thursday 04 December 2025 12:21:09 +0000 (0:00:00.019) 0:01:18.112 ***** 2025-12-04 12:21:09.143017 | controller | skipping: [instance] 2025-12-04 12:21:09.295054 | controller | 2025-12-04 12:21:09.295075 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2025-12-04 12:21:09.295084 | controller | Thursday 04 December 2025 12:21:09 +0000 (0:00:00.024) 0:01:18.136 ***** 2025-12-04 12:21:09.295095 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2025-12-04 12:21:09.321440 | controller | 2025-12-04 12:21:09.321474 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2025-12-04 12:21:09.321483 | controller | Thursday 04 December 2025 12:21:09 +0000 (0:00:00.152) 0:01:18.288 ***** 2025-12-04 12:21:09.321495 | controller | skipping: [instance] 2025-12-04 12:21:09.321531 | controller | 2025-12-04 12:21:09.321540 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2025-12-04 12:21:09.321548 | controller | Thursday 04 December 2025 12:21:09 +0000 (0:00:00.026) 0:01:18.315 ***** 2025-12-04 12:21:09.729335 | controller | changed: [instance] 2025-12-04 12:21:09.729818 | controller | 2025-12-04 12:21:10.209365 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2025-12-04 12:21:10.209403 | controller | Thursday 04 December 2025 12:21:09 +0000 (0:00:00.407) 0:01:18.723 ***** 2025-12-04 12:21:10.209419 | controller | changed: [instance] 2025-12-04 12:21:10.209515 | controller | 2025-12-04 12:21:10.209551 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2025-12-04 12:21:10.209560 | controller | Thursday 04 December 2025 12:21:10 +0000 (0:00:00.468) 0:01:19.191 ***** 2025-12-04 12:21:10.209566 | controller | 2025-12-04 12:21:10.209571 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-04 12:21:10.209581 | controller | Thursday 04 December 2025 12:21:10 +0000 (0:00:00.011) 0:01:19.202 ***** 2025-12-04 12:21:10.647735 | controller | changed: [instance] 2025-12-04 12:21:10.647787 | controller | 2025-12-04 12:21:10.647948 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-12-04 12:21:11.459876 | controller | Thursday 04 December 2025 12:21:10 +0000 (0:00:00.438) 0:01:19.641 ***** 2025-12-04 12:21:11.459912 | controller | changed: [instance] 2025-12-04 12:21:11.492386 | controller | 2025-12-04 12:21:11.492421 | controller | TASK [Deploy virtualbmc] ******************************************************* 2025-12-04 12:21:11.492430 | controller | Thursday 04 December 2025 12:21:11 +0000 (0:00:00.811) 0:01:20.453 ***** 2025-12-04 12:21:11.492442 | controller | skipping: [instance] 2025-12-04 12:21:11.492473 | controller | 2025-12-04 12:21:11.492483 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2025-12-04 12:21:11.492579 | controller | Thursday 04 December 2025 12:21:11 +0000 (0:00:00.033) 0:01:20.486 ***** 2025-12-04 12:21:11.526327 | controller | skipping: [instance] 2025-12-04 12:21:11.526373 | controller | 2025-12-04 12:21:11.526395 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2025-12-04 12:21:11.526406 | controller | Thursday 04 December 2025 12:21:11 +0000 (0:00:00.033) 0:01:20.520 ***** 2025-12-04 12:21:12.089355 | controller | changed: [instance] => (item=workload) 2025-12-04 12:21:12.498765 | controller | changed: [instance] => (item=reproducer-inventory) 2025-12-04 12:21:12.498797 | controller | ok: [instance] => (item=volumes) 2025-12-04 12:21:12.498805 | controller | 2025-12-04 12:21:12.498815 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2025-12-04 12:21:12.498821 | controller | Thursday 04 December 2025 12:21:12 +0000 (0:00:00.562) 0:01:21.082 ***** 2025-12-04 12:21:12.498831 | controller | changed: [instance] => (item=workload) 2025-12-04 12:21:12.522397 | controller | changed: [instance] => (item=volumes) 2025-12-04 12:21:12.522443 | controller | 2025-12-04 12:21:12.522457 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2025-12-04 12:21:12.522468 | controller | Thursday 04 December 2025 12:21:12 +0000 (0:00:00.409) 0:01:21.492 ***** 2025-12-04 12:21:12.522485 | controller | skipping: [instance] 2025-12-04 12:21:13.538232 | controller | 2025-12-04 12:21:13.538285 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2025-12-04 12:21:13.538293 | controller | Thursday 04 December 2025 12:21:12 +0000 (0:00:00.023) 0:01:21.516 ***** 2025-12-04 12:21:13.538302 | controller | changed: [instance] => (item=compute) 2025-12-04 12:21:13.915129 | controller | changed: [instance] => (item=controller) 2025-12-04 12:21:13.915160 | controller | changed: [instance] => (item=crc) 2025-12-04 12:21:13.915167 | controller | 2025-12-04 12:21:13.915173 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2025-12-04 12:21:13.915178 | controller | Thursday 04 December 2025 12:21:13 +0000 (0:00:01.015) 0:01:22.531 ***** 2025-12-04 12:21:13.915191 | controller | changed: [instance] 2025-12-04 12:21:13.953382 | controller | 2025-12-04 12:21:13.953417 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2025-12-04 12:21:13.953427 | controller | Thursday 04 December 2025 12:21:13 +0000 (0:00:00.376) 0:01:22.908 ***** 2025-12-04 12:21:13.953438 | controller | skipping: [instance] 2025-12-04 12:21:14.015410 | controller | 2025-12-04 12:21:14.015446 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2025-12-04 12:21:14.015456 | controller | Thursday 04 December 2025 12:21:13 +0000 (0:00:00.038) 0:01:22.947 ***** 2025-12-04 12:21:14.015469 | controller | skipping: [instance] => (item=crc) 2025-12-04 12:21:14.015500 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2025-12-04 12:21:14.015508 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2025-12-04 12:21:14.015516 | controller | 2025-12-04 12:21:14.015526 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-12-04 12:21:14.015662 | controller | Thursday 04 December 2025 12:21:14 +0000 (0:00:00.061) 0:01:23.008 ***** 2025-12-04 12:21:14.220222 | controller | changed: [instance] 2025-12-04 12:21:14.395733 | controller | 2025-12-04 12:21:14.395763 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-12-04 12:21:14.395772 | controller | Thursday 04 December 2025 12:21:14 +0000 (0:00:00.204) 0:01:23.213 ***** 2025-12-04 12:21:14.395781 | controller | ok: [instance] 2025-12-04 12:21:34.692371 | controller | 2025-12-04 12:21:34.692414 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-12-04 12:21:34.692422 | controller | Thursday 04 December 2025 12:21:14 +0000 (0:00:00.175) 0:01:23.389 ***** 2025-12-04 12:21:34.692433 | controller | changed: [instance] 2025-12-04 12:21:34.692459 | controller | 2025-12-04 12:21:34.692687 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-12-04 12:21:34.891080 | controller | Thursday 04 December 2025 12:21:34 +0000 (0:00:20.296) 0:01:43.686 ***** 2025-12-04 12:21:34.891110 | controller | ok: [instance] 2025-12-04 12:21:34.931990 | controller | 2025-12-04 12:21:34.932013 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-12-04 12:21:34.932030 | controller | Thursday 04 December 2025 12:21:34 +0000 (0:00:00.198) 0:01:43.884 ***** 2025-12-04 12:21:34.932041 | controller | ok: [instance] => changed=false 2025-12-04 12:21:35.137383 | controller | msg: All assertions passed 2025-12-04 12:21:35.137422 | controller | 2025-12-04 12:21:35.137432 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-12-04 12:21:35.137440 | controller | Thursday 04 December 2025 12:21:34 +0000 (0:00:00.040) 0:01:43.925 ***** 2025-12-04 12:21:35.137452 | controller | changed: [instance] 2025-12-04 12:21:35.137483 | controller | 2025-12-04 12:21:35.137684 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-12-04 12:21:35.342329 | controller | Thursday 04 December 2025 12:21:35 +0000 (0:00:00.205) 0:01:44.131 ***** 2025-12-04 12:21:35.342372 | controller | ok: [instance] 2025-12-04 12:21:35.342409 | controller | 2025-12-04 12:21:35.342616 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-12-04 12:21:35.542244 | controller | Thursday 04 December 2025 12:21:35 +0000 (0:00:00.204) 0:01:44.336 ***** 2025-12-04 12:21:35.542295 | controller | ok: [instance] 2025-12-04 12:21:35.564366 | controller | 2025-12-04 12:21:35.564408 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-12-04 12:21:35.564419 | controller | Thursday 04 December 2025 12:21:35 +0000 (0:00:00.199) 0:01:44.535 ***** 2025-12-04 12:21:35.564433 | controller | skipping: [instance] 2025-12-04 12:21:35.564476 | controller | 2025-12-04 12:21:35.564776 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-12-04 12:21:35.757325 | controller | Thursday 04 December 2025 12:21:35 +0000 (0:00:00.022) 0:01:44.558 ***** 2025-12-04 12:21:35.757361 | controller | ok: [instance] 2025-12-04 12:21:35.757386 | controller | 2025-12-04 12:21:35.757395 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-12-04 12:21:35.757525 | controller | Thursday 04 December 2025 12:21:35 +0000 (0:00:00.192) 0:01:44.751 ***** 2025-12-04 12:21:35.827502 | controller | ok: [instance] => changed=false 2025-12-04 12:21:35.827561 | controller | msg: All assertions passed 2025-12-04 12:21:35.827572 | controller | 2025-12-04 12:21:35.827582 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-12-04 12:21:35.827724 | controller | Thursday 04 December 2025 12:21:35 +0000 (0:00:00.070) 0:01:44.821 ***** 2025-12-04 12:21:36.035369 | controller | ok: [instance] 2025-12-04 12:21:36.035420 | controller | 2025-12-04 12:21:36.035431 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2025-12-04 12:21:36.035576 | controller | Thursday 04 December 2025 12:21:36 +0000 (0:00:00.207) 0:01:45.029 ***** 2025-12-04 12:21:36.212289 | controller | ok: [instance] 2025-12-04 12:21:36.564987 | controller | 2025-12-04 12:21:36.565010 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2025-12-04 12:21:36.565018 | controller | Thursday 04 December 2025 12:21:36 +0000 (0:00:00.176) 0:01:45.205 ***** 2025-12-04 12:21:36.565027 | controller | changed: [instance] 2025-12-04 12:21:36.740435 | controller | 2025-12-04 12:21:36.740457 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2025-12-04 12:21:36.740465 | controller | Thursday 04 December 2025 12:21:36 +0000 (0:00:00.352) 0:01:45.558 ***** 2025-12-04 12:21:36.740475 | controller | ok: [instance] 2025-12-04 12:21:36.926884 | controller | 2025-12-04 12:21:36.926916 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2025-12-04 12:21:36.926924 | controller | Thursday 04 December 2025 12:21:36 +0000 (0:00:00.175) 0:01:45.734 ***** 2025-12-04 12:21:36.926934 | controller | ok: [instance] 2025-12-04 12:21:37.329926 | controller | 2025-12-04 12:21:37.329957 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2025-12-04 12:21:37.329965 | controller | Thursday 04 December 2025 12:21:36 +0000 (0:00:00.186) 0:01:45.920 ***** 2025-12-04 12:21:37.329976 | controller | changed: [instance] 2025-12-04 12:21:37.350178 | controller | 2025-12-04 12:21:37.350197 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2025-12-04 12:21:37.350206 | controller | Thursday 04 December 2025 12:21:37 +0000 (0:00:00.403) 0:01:46.323 ***** 2025-12-04 12:21:37.350221 | controller | ok: [instance] 2025-12-04 12:21:37.572780 | controller | 2025-12-04 12:21:37.572800 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2025-12-04 12:21:37.572807 | controller | Thursday 04 December 2025 12:21:37 +0000 (0:00:00.020) 0:01:46.344 ***** 2025-12-04 12:21:37.572815 | controller | ok: [instance] 2025-12-04 12:21:38.030403 | controller | 2025-12-04 12:21:38.030447 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2025-12-04 12:21:38.030457 | controller | Thursday 04 December 2025 12:21:37 +0000 (0:00:00.222) 0:01:46.566 ***** 2025-12-04 12:21:38.030470 | controller | ok: [instance] 2025-12-04 12:21:38.030491 | controller | 2025-12-04 12:21:38.030499 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2025-12-04 12:21:38.030508 | controller | Thursday 04 December 2025 12:21:38 +0000 (0:00:00.457) 0:01:47.023 ***** 2025-12-04 12:21:38.149408 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-04 12:21:38.149564 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-04 12:21:38.149597 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-04 12:21:38.149604 | controller | 2025-12-04 12:21:38.149610 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2025-12-04 12:21:38.149620 | controller | Thursday 04 December 2025 12:21:38 +0000 (0:00:00.119) 0:01:47.143 ***** 2025-12-04 12:21:38.404293 | controller | changed: [instance] 2025-12-04 12:21:38.625933 | controller | 2025-12-04 12:21:38.625962 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2025-12-04 12:21:38.625970 | controller | Thursday 04 December 2025 12:21:38 +0000 (0:00:00.254) 0:01:47.397 ***** 2025-12-04 12:21:38.625980 | controller | changed: [instance] 2025-12-04 12:21:38.915213 | controller | 2025-12-04 12:21:38.915244 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2025-12-04 12:21:38.915272 | controller | Thursday 04 December 2025 12:21:38 +0000 (0:00:00.221) 0:01:47.619 ***** 2025-12-04 12:21:38.915283 | controller | changed: [instance] 2025-12-04 12:21:38.944998 | controller | 2025-12-04 12:21:38.945019 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2025-12-04 12:21:38.945028 | controller | Thursday 04 December 2025 12:21:38 +0000 (0:00:00.289) 0:01:47.908 ***** 2025-12-04 12:21:38.945040 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-04 12:21:38.991396 | controller | 2025-12-04 12:21:38.991454 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-04 12:21:38.991469 | controller | Thursday 04 December 2025 12:21:38 +0000 (0:00:00.029) 0:01:47.938 ***** 2025-12-04 12:21:38.991489 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-04 12:21:38.991705 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-04 12:21:38.991729 | controller | 2025-12-04 12:21:39.222237 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 12:21:39.222285 | controller | Thursday 04 December 2025 12:21:38 +0000 (0:00:00.046) 0:01:47.985 ***** 2025-12-04 12:21:39.222299 | controller | ok: [instance] 2025-12-04 12:21:39.266399 | controller | 2025-12-04 12:21:39.266435 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 12:21:39.266444 | controller | Thursday 04 December 2025 12:21:39 +0000 (0:00:00.230) 0:01:48.215 ***** 2025-12-04 12:21:39.266457 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 12:21:39.266493 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 12:21:39.266504 | controller | 2025-12-04 12:21:39.266513 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 12:21:39.266608 | controller | Thursday 04 December 2025 12:21:39 +0000 (0:00:00.044) 0:01:48.260 ***** 2025-12-04 12:21:39.499011 | controller | ok: [instance] 2025-12-04 12:21:39.698865 | controller | 2025-12-04 12:21:39.698892 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 12:21:39.698900 | controller | Thursday 04 December 2025 12:21:39 +0000 (0:00:00.232) 0:01:48.492 ***** 2025-12-04 12:21:39.698909 | controller | ok: [instance] 2025-12-04 12:21:39.986786 | controller | 2025-12-04 12:21:39.986818 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2025-12-04 12:21:39.986828 | controller | Thursday 04 December 2025 12:21:39 +0000 (0:00:00.199) 0:01:48.692 ***** 2025-12-04 12:21:39.986840 | controller | changed: [instance] 2025-12-04 12:21:40.217978 | controller | 2025-12-04 12:21:40.218002 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 12:21:40.218010 | controller | Thursday 04 December 2025 12:21:39 +0000 (0:00:00.287) 0:01:48.980 ***** 2025-12-04 12:21:40.218019 | controller | ok: [instance] 2025-12-04 12:21:40.261816 | controller | 2025-12-04 12:21:40.261840 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 12:21:40.261848 | controller | Thursday 04 December 2025 12:21:40 +0000 (0:00:00.231) 0:01:49.211 ***** 2025-12-04 12:21:40.261857 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 12:21:40.495963 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 12:21:40.495996 | controller | 2025-12-04 12:21:40.496004 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 12:21:40.496011 | controller | Thursday 04 December 2025 12:21:40 +0000 (0:00:00.044) 0:01:49.255 ***** 2025-12-04 12:21:40.496021 | controller | ok: [instance] 2025-12-04 12:21:40.698706 | controller | 2025-12-04 12:21:40.698733 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 12:21:40.698741 | controller | Thursday 04 December 2025 12:21:40 +0000 (0:00:00.233) 0:01:49.489 ***** 2025-12-04 12:21:40.698751 | controller | ok: [instance] 2025-12-04 12:21:40.984932 | controller | 2025-12-04 12:21:40.984958 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2025-12-04 12:21:40.984965 | controller | Thursday 04 December 2025 12:21:40 +0000 (0:00:00.203) 0:01:49.692 ***** 2025-12-04 12:21:40.984975 | controller | changed: [instance] 2025-12-04 12:21:41.005494 | controller | 2025-12-04 12:21:41.005531 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2025-12-04 12:21:41.005542 | controller | Thursday 04 December 2025 12:21:40 +0000 (0:00:00.285) 0:01:49.978 ***** 2025-12-04 12:21:41.005555 | controller | skipping: [instance] 2025-12-04 12:21:41.005589 | controller | 2025-12-04 12:21:41.005600 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2025-12-04 12:21:41.005629 | controller | Thursday 04 December 2025 12:21:41 +0000 (0:00:00.020) 0:01:49.999 ***** 2025-12-04 12:21:41.033154 | controller | skipping: [instance] 2025-12-04 12:21:41.060717 | controller | 2025-12-04 12:21:41.060739 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2025-12-04 12:21:41.060749 | controller | Thursday 04 December 2025 12:21:41 +0000 (0:00:00.027) 0:01:50.026 ***** 2025-12-04 12:21:41.060760 | controller | skipping: [instance] 2025-12-04 12:21:41.086408 | controller | 2025-12-04 12:21:41.086482 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2025-12-04 12:21:41.086497 | controller | Thursday 04 December 2025 12:21:41 +0000 (0:00:00.027) 0:01:50.054 ***** 2025-12-04 12:21:41.086517 | controller | skipping: [instance] 2025-12-04 12:21:41.086575 | controller | 2025-12-04 12:21:41.086672 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-04 12:21:41.086697 | controller | Thursday 04 December 2025 12:21:41 +0000 (0:00:00.025) 0:01:50.080 ***** 2025-12-04 12:21:41.301333 | controller | changed: [instance] 2025-12-04 12:21:41.301674 | controller | 2025-12-04 12:21:41.336155 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-04 12:21:41.336183 | controller | Thursday 04 December 2025 12:21:41 +0000 (0:00:00.214) 0:01:50.295 ***** 2025-12-04 12:21:41.336196 | controller | ok: [instance] 2025-12-04 12:21:41.388879 | controller | 2025-12-04 12:21:41.388896 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-04 12:21:41.388903 | controller | Thursday 04 December 2025 12:21:41 +0000 (0:00:00.034) 0:01:50.329 ***** 2025-12-04 12:21:41.388912 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-12-04 12:21:41.584136 | controller | 2025-12-04 12:21:41.584154 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-12-04 12:21:41.584162 | controller | Thursday 04 December 2025 12:21:41 +0000 (0:00:00.052) 0:01:50.382 ***** 2025-12-04 12:21:41.584174 | controller | ok: [instance] 2025-12-04 12:21:41.643400 | controller | 2025-12-04 12:21:41.643438 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-12-04 12:21:41.643448 | controller | Thursday 04 December 2025 12:21:41 +0000 (0:00:00.195) 0:01:50.577 ***** 2025-12-04 12:21:41.643460 | controller | ok: [instance] 2025-12-04 12:21:41.643766 | controller | 2025-12-04 12:21:41.643787 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-12-04 12:21:41.686540 | controller | Thursday 04 December 2025 12:21:41 +0000 (0:00:00.059) 0:01:50.637 ***** 2025-12-04 12:21:41.686564 | controller | ok: [instance] 2025-12-04 12:21:41.686722 | controller | 2025-12-04 12:21:41.686880 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-12-04 12:21:41.687031 | controller | Thursday 04 December 2025 12:21:41 +0000 (0:00:00.043) 0:01:50.680 ***** 2025-12-04 12:21:41.726401 | controller | skipping: [instance] 2025-12-04 12:21:41.726570 | controller | 2025-12-04 12:21:41.726729 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-12-04 12:21:41.726878 | controller | Thursday 04 December 2025 12:21:41 +0000 (0:00:00.039) 0:01:50.720 ***** 2025-12-04 12:21:41.765072 | controller | skipping: [instance] 2025-12-04 12:21:41.765407 | controller | 2025-12-04 12:21:41.765553 | controller | TASK [Call the config_drive role] ********************************************** 2025-12-04 12:21:41.765684 | controller | Thursday 04 December 2025 12:21:41 +0000 (0:00:00.038) 0:01:50.759 ***** 2025-12-04 12:21:41.823368 | controller | 2025-12-04 12:21:41.824034 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-12-04 12:21:42.261981 | controller | Thursday 04 December 2025 12:21:41 +0000 (0:00:00.058) 0:01:50.817 ***** 2025-12-04 12:21:42.262013 | controller | ok: [instance] => (item=artifacts) 2025-12-04 12:21:43.439945 | controller | ok: [instance] => (item=logs) 2025-12-04 12:21:43.439978 | controller | 2025-12-04 12:21:43.439986 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-12-04 12:21:43.439993 | controller | Thursday 04 December 2025 12:21:42 +0000 (0:00:00.438) 0:01:51.255 ***** 2025-12-04 12:21:43.440003 | controller | ok: [instance] 2025-12-04 12:21:43.657221 | controller | 2025-12-04 12:21:43.657279 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-12-04 12:21:43.657291 | controller | Thursday 04 December 2025 12:21:43 +0000 (0:00:01.177) 0:01:52.433 ***** 2025-12-04 12:21:43.657301 | controller | changed: [instance] 2025-12-04 12:21:44.036060 | controller | 2025-12-04 12:21:44.036103 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-12-04 12:21:44.036112 | controller | Thursday 04 December 2025 12:21:43 +0000 (0:00:00.217) 0:01:52.650 ***** 2025-12-04 12:21:44.036122 | controller | changed: [instance] 2025-12-04 12:21:44.413899 | controller | 2025-12-04 12:21:44.413930 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-12-04 12:21:44.413939 | controller | Thursday 04 December 2025 12:21:44 +0000 (0:00:00.378) 0:01:53.029 ***** 2025-12-04 12:21:44.413949 | controller | changed: [instance] 2025-12-04 12:21:44.458837 | controller | 2025-12-04 12:21:44.458859 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-12-04 12:21:44.458868 | controller | Thursday 04 December 2025 12:21:44 +0000 (0:00:00.377) 0:01:53.407 ***** 2025-12-04 12:21:44.458884 | controller | skipping: [instance] 2025-12-04 12:21:44.660392 | controller | 2025-12-04 12:21:44.660427 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-12-04 12:21:44.660437 | controller | Thursday 04 December 2025 12:21:44 +0000 (0:00:00.045) 0:01:53.452 ***** 2025-12-04 12:21:44.660450 | controller | ok: [instance] 2025-12-04 12:21:44.703892 | controller | 2025-12-04 12:21:44.703919 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-12-04 12:21:44.703926 | controller | Thursday 04 December 2025 12:21:44 +0000 (0:00:00.201) 0:01:53.654 ***** 2025-12-04 12:21:44.703936 | controller | skipping: [instance] 2025-12-04 12:21:44.939849 | controller | 2025-12-04 12:21:44.939870 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-12-04 12:21:44.939878 | controller | Thursday 04 December 2025 12:21:44 +0000 (0:00:00.043) 0:01:53.697 ***** 2025-12-04 12:21:44.939887 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2025-12-04 12:21:45.218238 | controller | changed: [instance] 2025-12-04 12:21:45.218284 | controller | 2025-12-04 12:21:45.218294 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-04 12:21:45.218301 | controller | Thursday 04 December 2025 12:21:44 +0000 (0:00:00.236) 0:01:53.933 ***** 2025-12-04 12:21:45.218316 | controller | changed: [instance] 2025-12-04 12:21:45.263031 | controller | 2025-12-04 12:21:45.263069 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-04 12:21:45.263076 | controller | Thursday 04 December 2025 12:21:45 +0000 (0:00:00.278) 0:01:54.211 ***** 2025-12-04 12:21:45.263084 | controller | skipping: [instance] 2025-12-04 12:21:45.290399 | controller | 2025-12-04 12:21:45.290452 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2025-12-04 12:21:45.290463 | controller | Thursday 04 December 2025 12:21:45 +0000 (0:00:00.044) 0:01:54.256 ***** 2025-12-04 12:21:45.290478 | controller | skipping: [instance] 2025-12-04 12:21:45.534366 | controller | 2025-12-04 12:21:45.534398 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2025-12-04 12:21:45.534406 | controller | Thursday 04 December 2025 12:21:45 +0000 (0:00:00.027) 0:01:54.284 ***** 2025-12-04 12:21:45.534418 | controller | changed: [instance] 2025-12-04 12:21:45.754402 | controller | 2025-12-04 12:21:45.754433 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2025-12-04 12:21:45.754444 | controller | Thursday 04 December 2025 12:21:45 +0000 (0:00:00.244) 0:01:54.528 ***** 2025-12-04 12:21:45.754456 | controller | changed: [instance] 2025-12-04 12:21:46.042790 | controller | 2025-12-04 12:21:46.042812 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2025-12-04 12:21:46.042821 | controller | Thursday 04 December 2025 12:21:45 +0000 (0:00:00.219) 0:01:54.747 ***** 2025-12-04 12:21:46.042830 | controller | changed: [instance] 2025-12-04 12:21:46.072913 | controller | 2025-12-04 12:21:46.072933 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2025-12-04 12:21:46.072940 | controller | Thursday 04 December 2025 12:21:46 +0000 (0:00:00.288) 0:01:55.036 ***** 2025-12-04 12:21:46.072953 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-04 12:21:46.118392 | controller | 2025-12-04 12:21:46.118426 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-04 12:21:46.118436 | controller | Thursday 04 December 2025 12:21:46 +0000 (0:00:00.030) 0:01:55.066 ***** 2025-12-04 12:21:46.118449 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-04 12:21:46.347337 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-04 12:21:46.347375 | controller | 2025-12-04 12:21:46.347385 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 12:21:46.347393 | controller | Thursday 04 December 2025 12:21:46 +0000 (0:00:00.045) 0:01:55.112 ***** 2025-12-04 12:21:46.347410 | controller | ok: [instance] 2025-12-04 12:21:46.392376 | controller | 2025-12-04 12:21:46.392399 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 12:21:46.392408 | controller | Thursday 04 December 2025 12:21:46 +0000 (0:00:00.228) 0:01:55.341 ***** 2025-12-04 12:21:46.392419 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 12:21:46.393081 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 12:21:46.626282 | controller | 2025-12-04 12:21:46.626318 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 12:21:46.626331 | controller | Thursday 04 December 2025 12:21:46 +0000 (0:00:00.045) 0:01:55.386 ***** 2025-12-04 12:21:46.626347 | controller | ok: [instance] 2025-12-04 12:21:46.828942 | controller | 2025-12-04 12:21:46.828961 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 12:21:46.828968 | controller | Thursday 04 December 2025 12:21:46 +0000 (0:00:00.233) 0:01:55.619 ***** 2025-12-04 12:21:46.828977 | controller | ok: [instance] 2025-12-04 12:21:47.106341 | controller | 2025-12-04 12:21:47.106378 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2025-12-04 12:21:47.106386 | controller | Thursday 04 December 2025 12:21:46 +0000 (0:00:00.202) 0:01:55.822 ***** 2025-12-04 12:21:47.106398 | controller | changed: [instance] 2025-12-04 12:21:47.106603 | controller | 2025-12-04 12:21:47.106624 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 12:21:47.333322 | controller | Thursday 04 December 2025 12:21:47 +0000 (0:00:00.277) 0:01:56.099 ***** 2025-12-04 12:21:47.333348 | controller | ok: [instance] 2025-12-04 12:21:47.377160 | controller | 2025-12-04 12:21:47.377177 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 12:21:47.377183 | controller | Thursday 04 December 2025 12:21:47 +0000 (0:00:00.226) 0:01:56.326 ***** 2025-12-04 12:21:47.377192 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 12:21:47.600396 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 12:21:47.600427 | controller | 2025-12-04 12:21:47.600435 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 12:21:47.600441 | controller | Thursday 04 December 2025 12:21:47 +0000 (0:00:00.043) 0:01:56.370 ***** 2025-12-04 12:21:47.600451 | controller | ok: [instance] 2025-12-04 12:21:47.797816 | controller | 2025-12-04 12:21:47.797852 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 12:21:47.797866 | controller | Thursday 04 December 2025 12:21:47 +0000 (0:00:00.223) 0:01:56.594 ***** 2025-12-04 12:21:47.797900 | controller | ok: [instance] 2025-12-04 12:21:47.797931 | controller | 2025-12-04 12:21:47.797944 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2025-12-04 12:21:47.798059 | controller | Thursday 04 December 2025 12:21:47 +0000 (0:00:00.197) 0:01:56.791 ***** 2025-12-04 12:21:48.086146 | controller | changed: [instance] 2025-12-04 12:21:48.086209 | controller | 2025-12-04 12:21:48.086351 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2025-12-04 12:21:48.086455 | controller | Thursday 04 December 2025 12:21:48 +0000 (0:00:00.288) 0:01:57.080 ***** 2025-12-04 12:21:48.109080 | controller | skipping: [instance] 2025-12-04 12:21:48.138452 | controller | 2025-12-04 12:21:48.138468 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2025-12-04 12:21:48.138476 | controller | Thursday 04 December 2025 12:21:48 +0000 (0:00:00.022) 0:01:57.102 ***** 2025-12-04 12:21:48.138484 | controller | skipping: [instance] 2025-12-04 12:21:48.166209 | controller | 2025-12-04 12:21:48.166230 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2025-12-04 12:21:48.166239 | controller | Thursday 04 December 2025 12:21:48 +0000 (0:00:00.029) 0:01:57.132 ***** 2025-12-04 12:21:48.166273 | controller | skipping: [instance] 2025-12-04 12:21:48.193545 | controller | 2025-12-04 12:21:48.193583 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2025-12-04 12:21:48.193593 | controller | Thursday 04 December 2025 12:21:48 +0000 (0:00:00.027) 0:01:57.159 ***** 2025-12-04 12:21:48.193611 | controller | skipping: [instance] 2025-12-04 12:21:48.407829 | controller | 2025-12-04 12:21:48.407851 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-04 12:21:48.407859 | controller | Thursday 04 December 2025 12:21:48 +0000 (0:00:00.026) 0:01:57.186 ***** 2025-12-04 12:21:48.407869 | controller | changed: [instance] 2025-12-04 12:21:48.407920 | controller | 2025-12-04 12:21:48.408025 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-04 12:21:48.408140 | controller | Thursday 04 December 2025 12:21:48 +0000 (0:00:00.215) 0:01:57.401 ***** 2025-12-04 12:21:48.445198 | controller | ok: [instance] 2025-12-04 12:21:48.445261 | controller | 2025-12-04 12:21:48.445420 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-04 12:21:48.445496 | controller | Thursday 04 December 2025 12:21:48 +0000 (0:00:00.037) 0:01:57.439 ***** 2025-12-04 12:21:48.496384 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-12-04 12:21:48.496493 | controller | 2025-12-04 12:21:48.496512 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-12-04 12:21:48.496525 | controller | Thursday 04 December 2025 12:21:48 +0000 (0:00:00.050) 0:01:57.490 ***** 2025-12-04 12:21:48.691196 | controller | ok: [instance] 2025-12-04 12:21:48.751372 | controller | 2025-12-04 12:21:48.751411 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-12-04 12:21:48.751421 | controller | Thursday 04 December 2025 12:21:48 +0000 (0:00:00.194) 0:01:57.684 ***** 2025-12-04 12:21:48.751433 | controller | ok: [instance] 2025-12-04 12:21:48.751465 | controller | 2025-12-04 12:21:48.751475 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-12-04 12:21:48.751503 | controller | Thursday 04 December 2025 12:21:48 +0000 (0:00:00.060) 0:01:57.745 ***** 2025-12-04 12:21:48.795059 | controller | ok: [instance] 2025-12-04 12:21:48.837772 | controller | 2025-12-04 12:21:48.837790 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-12-04 12:21:48.837798 | controller | Thursday 04 December 2025 12:21:48 +0000 (0:00:00.043) 0:01:57.788 ***** 2025-12-04 12:21:48.837807 | controller | skipping: [instance] 2025-12-04 12:21:48.880068 | controller | 2025-12-04 12:21:48.880090 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-12-04 12:21:48.880099 | controller | Thursday 04 December 2025 12:21:48 +0000 (0:00:00.042) 0:01:57.831 ***** 2025-12-04 12:21:48.880110 | controller | skipping: [instance] 2025-12-04 12:21:48.940977 | controller | 2025-12-04 12:21:48.940995 | controller | TASK [Call the config_drive role] ********************************************** 2025-12-04 12:21:48.941003 | controller | Thursday 04 December 2025 12:21:48 +0000 (0:00:00.042) 0:01:57.873 ***** 2025-12-04 12:21:48.941011 | controller | 2025-12-04 12:21:49.338377 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-12-04 12:21:49.338410 | controller | Thursday 04 December 2025 12:21:48 +0000 (0:00:00.060) 0:01:57.934 ***** 2025-12-04 12:21:49.338429 | controller | ok: [instance] => (item=artifacts) 2025-12-04 12:21:49.338458 | controller | ok: [instance] => (item=logs) 2025-12-04 12:21:49.338467 | controller | 2025-12-04 12:21:49.338474 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-12-04 12:21:49.338483 | controller | Thursday 04 December 2025 12:21:49 +0000 (0:00:00.397) 0:01:58.332 ***** 2025-12-04 12:21:50.494223 | controller | ok: [instance] 2025-12-04 12:21:50.707714 | controller | 2025-12-04 12:21:50.707745 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-12-04 12:21:50.707754 | controller | Thursday 04 December 2025 12:21:50 +0000 (0:00:01.155) 0:01:59.487 ***** 2025-12-04 12:21:50.707764 | controller | changed: [instance] 2025-12-04 12:21:51.074801 | controller | 2025-12-04 12:21:51.074834 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-12-04 12:21:51.074843 | controller | Thursday 04 December 2025 12:21:50 +0000 (0:00:00.213) 0:01:59.701 ***** 2025-12-04 12:21:51.074853 | controller | changed: [instance] 2025-12-04 12:21:51.483236 | controller | 2025-12-04 12:21:51.483284 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-12-04 12:21:51.483298 | controller | Thursday 04 December 2025 12:21:51 +0000 (0:00:00.367) 0:02:00.068 ***** 2025-12-04 12:21:51.483308 | controller | changed: [instance] 2025-12-04 12:21:51.573401 | controller | 2025-12-04 12:21:51.573440 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-12-04 12:21:51.573450 | controller | Thursday 04 December 2025 12:21:51 +0000 (0:00:00.408) 0:02:00.476 ***** 2025-12-04 12:21:51.573464 | controller | skipping: [instance] 2025-12-04 12:21:51.573496 | controller | 2025-12-04 12:21:51.573507 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-12-04 12:21:51.573660 | controller | Thursday 04 December 2025 12:21:51 +0000 (0:00:00.090) 0:02:00.567 ***** 2025-12-04 12:21:51.773720 | controller | ok: [instance] 2025-12-04 12:21:51.817402 | controller | 2025-12-04 12:21:51.817445 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-12-04 12:21:51.817456 | controller | Thursday 04 December 2025 12:21:51 +0000 (0:00:00.200) 0:02:00.767 ***** 2025-12-04 12:21:51.817469 | controller | skipping: [instance] 2025-12-04 12:21:51.817506 | controller | 2025-12-04 12:21:51.817829 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-12-04 12:21:52.050966 | controller | Thursday 04 December 2025 12:21:51 +0000 (0:00:00.043) 0:02:00.811 ***** 2025-12-04 12:21:52.051000 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2025-12-04 12:21:52.330823 | controller | changed: [instance] 2025-12-04 12:21:52.330856 | controller | 2025-12-04 12:21:52.330866 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-04 12:21:52.330873 | controller | Thursday 04 December 2025 12:21:52 +0000 (0:00:00.233) 0:02:01.044 ***** 2025-12-04 12:21:52.330885 | controller | changed: [instance] 2025-12-04 12:21:52.378201 | controller | 2025-12-04 12:21:52.378235 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-04 12:21:52.378244 | controller | Thursday 04 December 2025 12:21:52 +0000 (0:00:00.279) 0:02:01.324 ***** 2025-12-04 12:21:52.378281 | controller | skipping: [instance] 2025-12-04 12:21:52.406407 | controller | 2025-12-04 12:21:52.406443 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2025-12-04 12:21:52.406453 | controller | Thursday 04 December 2025 12:21:52 +0000 (0:00:00.047) 0:02:01.371 ***** 2025-12-04 12:21:52.406470 | controller | skipping: [instance] 2025-12-04 12:21:52.652099 | controller | 2025-12-04 12:21:52.652130 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2025-12-04 12:21:52.652138 | controller | Thursday 04 December 2025 12:21:52 +0000 (0:00:00.028) 0:02:01.400 ***** 2025-12-04 12:21:52.652147 | controller | changed: [instance] 2025-12-04 12:21:52.874200 | controller | 2025-12-04 12:21:52.874233 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2025-12-04 12:21:52.874241 | controller | Thursday 04 December 2025 12:21:52 +0000 (0:00:00.245) 0:02:01.645 ***** 2025-12-04 12:21:52.874269 | controller | changed: [instance] 2025-12-04 12:21:53.163349 | controller | 2025-12-04 12:21:53.163384 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2025-12-04 12:21:53.163394 | controller | Thursday 04 December 2025 12:21:52 +0000 (0:00:00.222) 0:02:01.867 ***** 2025-12-04 12:21:53.163407 | controller | changed: [instance] 2025-12-04 12:21:53.163437 | controller | 2025-12-04 12:21:53.163690 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2025-12-04 12:21:53.192865 | controller | Thursday 04 December 2025 12:21:53 +0000 (0:00:00.289) 0:02:02.157 ***** 2025-12-04 12:21:53.192906 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-04 12:21:53.236375 | controller | 2025-12-04 12:21:53.236414 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-04 12:21:53.236423 | controller | Thursday 04 December 2025 12:21:53 +0000 (0:00:00.029) 0:02:02.186 ***** 2025-12-04 12:21:53.236435 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-04 12:21:53.237052 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-04 12:21:53.468987 | controller | 2025-12-04 12:21:53.469029 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 12:21:53.469040 | controller | Thursday 04 December 2025 12:21:53 +0000 (0:00:00.043) 0:02:02.230 ***** 2025-12-04 12:21:53.469051 | controller | ok: [instance] 2025-12-04 12:21:53.514391 | controller | 2025-12-04 12:21:53.514435 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 12:21:53.514446 | controller | Thursday 04 December 2025 12:21:53 +0000 (0:00:00.232) 0:02:02.462 ***** 2025-12-04 12:21:53.514458 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 12:21:53.744974 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 12:21:53.745006 | controller | 2025-12-04 12:21:53.745023 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 12:21:53.745029 | controller | Thursday 04 December 2025 12:21:53 +0000 (0:00:00.045) 0:02:02.507 ***** 2025-12-04 12:21:53.745039 | controller | ok: [instance] 2025-12-04 12:21:53.951345 | controller | 2025-12-04 12:21:53.951375 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 12:21:53.951384 | controller | Thursday 04 December 2025 12:21:53 +0000 (0:00:00.230) 0:02:02.738 ***** 2025-12-04 12:21:53.951394 | controller | ok: [instance] 2025-12-04 12:21:53.951400 | controller | 2025-12-04 12:21:53.951406 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2025-12-04 12:21:53.951413 | controller | Thursday 04 December 2025 12:21:53 +0000 (0:00:00.206) 0:02:02.945 ***** 2025-12-04 12:21:54.237376 | controller | changed: [instance] 2025-12-04 12:21:54.237429 | controller | 2025-12-04 12:21:54.237441 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 12:21:54.237551 | controller | Thursday 04 December 2025 12:21:54 +0000 (0:00:00.286) 0:02:03.231 ***** 2025-12-04 12:21:54.473400 | controller | ok: [instance] 2025-12-04 12:21:54.520381 | controller | 2025-12-04 12:21:54.520403 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 12:21:54.520413 | controller | Thursday 04 December 2025 12:21:54 +0000 (0:00:00.235) 0:02:03.466 ***** 2025-12-04 12:21:54.520424 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 12:21:54.520455 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 12:21:54.520465 | controller | 2025-12-04 12:21:54.520712 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 12:21:54.754748 | controller | Thursday 04 December 2025 12:21:54 +0000 (0:00:00.047) 0:02:03.514 ***** 2025-12-04 12:21:54.754787 | controller | ok: [instance] 2025-12-04 12:21:54.956379 | controller | 2025-12-04 12:21:54.956406 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 12:21:54.956414 | controller | Thursday 04 December 2025 12:21:54 +0000 (0:00:00.233) 0:02:03.748 ***** 2025-12-04 12:21:54.956423 | controller | ok: [instance] 2025-12-04 12:21:55.241774 | controller | 2025-12-04 12:21:55.241806 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2025-12-04 12:21:55.241814 | controller | Thursday 04 December 2025 12:21:54 +0000 (0:00:00.201) 0:02:03.950 ***** 2025-12-04 12:21:55.241824 | controller | changed: [instance] 2025-12-04 12:21:55.263411 | controller | 2025-12-04 12:21:55.263449 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2025-12-04 12:21:55.263459 | controller | Thursday 04 December 2025 12:21:55 +0000 (0:00:00.285) 0:02:04.235 ***** 2025-12-04 12:21:55.263471 | controller | skipping: [instance] 2025-12-04 12:21:55.263661 | controller | 2025-12-04 12:21:55.263691 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2025-12-04 12:21:55.290976 | controller | Thursday 04 December 2025 12:21:55 +0000 (0:00:00.021) 0:02:04.257 ***** 2025-12-04 12:21:55.291029 | controller | skipping: [instance] 2025-12-04 12:21:55.317361 | controller | 2025-12-04 12:21:55.317394 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2025-12-04 12:21:55.317409 | controller | Thursday 04 December 2025 12:21:55 +0000 (0:00:00.027) 0:02:04.284 ***** 2025-12-04 12:21:55.317421 | controller | skipping: [instance] 2025-12-04 12:21:55.317453 | controller | 2025-12-04 12:21:55.317467 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2025-12-04 12:21:55.317567 | controller | Thursday 04 December 2025 12:21:55 +0000 (0:00:00.026) 0:02:04.311 ***** 2025-12-04 12:21:55.343333 | controller | skipping: [instance] 2025-12-04 12:21:55.343599 | controller | 2025-12-04 12:21:55.343624 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-04 12:21:55.558225 | controller | Thursday 04 December 2025 12:21:55 +0000 (0:00:00.026) 0:02:04.337 ***** 2025-12-04 12:21:55.558281 | controller | changed: [instance] 2025-12-04 12:21:55.595970 | controller | 2025-12-04 12:21:55.596009 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-04 12:21:55.596019 | controller | Thursday 04 December 2025 12:21:55 +0000 (0:00:00.214) 0:02:04.551 ***** 2025-12-04 12:21:55.596029 | controller | ok: [instance] 2025-12-04 12:21:55.622556 | controller | 2025-12-04 12:21:55.622600 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-04 12:21:55.622611 | controller | Thursday 04 December 2025 12:21:55 +0000 (0:00:00.037) 0:02:04.589 ***** 2025-12-04 12:21:55.622623 | controller | skipping: [instance] 2025-12-04 12:21:55.622645 | controller | 2025-12-04 12:21:55.622654 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-04 12:21:55.622687 | controller | Thursday 04 December 2025 12:21:55 +0000 (0:00:00.026) 0:02:04.616 ***** 2025-12-04 12:21:55.650610 | controller | skipping: [instance] 2025-12-04 12:21:55.650704 | controller | 2025-12-04 12:21:55.650812 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-04 12:21:55.650918 | controller | Thursday 04 December 2025 12:21:55 +0000 (0:00:00.028) 0:02:04.644 ***** 2025-12-04 12:21:55.699207 | controller | skipping: [instance] 2025-12-04 12:21:55.724933 | controller | 2025-12-04 12:21:55.724955 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2025-12-04 12:21:55.724964 | controller | Thursday 04 December 2025 12:21:55 +0000 (0:00:00.048) 0:02:04.692 ***** 2025-12-04 12:21:55.724982 | controller | skipping: [instance] 2025-12-04 12:21:55.725016 | controller | 2025-12-04 12:21:55.725133 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2025-12-04 12:21:55.725284 | controller | Thursday 04 December 2025 12:21:55 +0000 (0:00:00.026) 0:02:04.719 ***** 2025-12-04 12:21:55.787852 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2025-12-04 12:21:56.029126 | controller | 2025-12-04 12:21:56.029157 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2025-12-04 12:21:56.029167 | controller | Thursday 04 December 2025 12:21:55 +0000 (0:00:00.062) 0:02:04.781 ***** 2025-12-04 12:21:56.029178 | controller | ok: [instance] => (item=crc) 2025-12-04 12:21:58.102056 | controller | 2025-12-04 12:21:58.102090 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2025-12-04 12:21:58.102098 | controller | Thursday 04 December 2025 12:21:56 +0000 (0:00:00.241) 0:02:05.022 ***** 2025-12-04 12:21:58.102109 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-04 12:21:58.655382 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-04 12:21:58.655448 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-04 12:21:58.655462 | controller | 2025-12-04 12:21:58.655473 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-04 12:21:58.655484 | controller | Thursday 04 December 2025 12:21:58 +0000 (0:00:02.072) 0:02:07.095 ***** 2025-12-04 12:21:58.655511 | controller | changed: [instance] 2025-12-04 12:21:59.130530 | controller | 2025-12-04 12:21:59.130562 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-04 12:21:59.130570 | controller | Thursday 04 December 2025 12:21:58 +0000 (0:00:00.553) 0:02:07.648 ***** 2025-12-04 12:21:59.130580 | controller | changed: [instance] 2025-12-04 12:21:59.623502 | controller | 2025-12-04 12:21:59.623535 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-04 12:21:59.623544 | controller | Thursday 04 December 2025 12:21:59 +0000 (0:00:00.475) 0:02:08.123 ***** 2025-12-04 12:21:59.623554 | controller | changed: [instance] 2025-12-04 12:22:00.351851 | controller | 2025-12-04 12:22:00.351881 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2025-12-04 12:22:00.351889 | controller | Thursday 04 December 2025 12:21:59 +0000 (0:00:00.492) 0:02:08.616 ***** 2025-12-04 12:22:00.351899 | controller | changed: [instance] => (item=compute-0.utility) 2025-12-04 12:22:23.412088 | controller | changed: [instance] => (item=controller-0.utility) 2025-12-04 12:22:23.412140 | controller | changed: [instance] => (item=crc-0.utility) 2025-12-04 12:22:23.412149 | controller | 2025-12-04 12:22:23.412155 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2025-12-04 12:22:23.412162 | controller | Thursday 04 December 2025 12:22:00 +0000 (0:00:00.728) 0:02:09.345 ***** 2025-12-04 12:22:23.412174 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-12-04 12:22:23.604134 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2025-12-04 12:22:23.604182 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2025-12-04 12:22:23.604189 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2025-12-04 12:22:23.604195 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2025-12-04 12:22:23.604201 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2025-12-04 12:22:23.604207 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j386355092843.21104', 'results_file': '/home/zuul/.ansible_async/j386355092843.21104', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2025-12-04 12:22:23.604221 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j874207496645.21121', 'results_file': '/home/zuul/.ansible_async/j874207496645.21121', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2025-12-04 12:22:23.604226 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-12-04 12:22:23.604232 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j11204018292.21137', 'results_file': '/home/zuul/.ansible_async/j11204018292.21137', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2025-12-04 12:22:23.604238 | controller | 2025-12-04 12:22:23.604244 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2025-12-04 12:22:23.604271 | controller | Thursday 04 December 2025 12:22:23 +0000 (0:00:23.059) 0:02:32.404 ***** 2025-12-04 12:22:23.604282 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-04 12:22:23.635584 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-04 12:22:23.635622 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-04 12:22:23.635630 | controller | 2025-12-04 12:22:23.635637 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-04 12:22:23.635644 | controller | Thursday 04 December 2025 12:22:23 +0000 (0:00:00.192) 0:02:32.597 ***** 2025-12-04 12:22:23.635672 | controller | skipping: [instance] 2025-12-04 12:22:23.680409 | controller | 2025-12-04 12:22:23.680444 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2025-12-04 12:22:23.680454 | controller | Thursday 04 December 2025 12:22:23 +0000 (0:00:00.031) 0:02:32.628 ***** 2025-12-04 12:22:23.680467 | controller | 2025-12-04 12:22:23.772007 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-04 12:22:23.772036 | controller | Thursday 04 December 2025 12:22:23 +0000 (0:00:00.045) 0:02:32.674 ***** 2025-12-04 12:22:23.772054 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-12-04 12:22:24.025316 | controller | 2025-12-04 12:22:24.025360 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-04 12:22:24.025369 | controller | Thursday 04 December 2025 12:22:23 +0000 (0:00:00.091) 0:02:32.765 ***** 2025-12-04 12:22:24.025380 | controller | changed: [instance] 2025-12-04 12:22:24.262959 | controller | 2025-12-04 12:22:24.262999 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-04 12:22:24.263007 | controller | Thursday 04 December 2025 12:22:24 +0000 (0:00:00.252) 0:02:33.018 ***** 2025-12-04 12:22:24.263019 | controller | changed: [instance] 2025-12-04 12:22:24.691752 | controller | 2025-12-04 12:22:24.691804 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2025-12-04 12:22:24.691814 | controller | Thursday 04 December 2025 12:22:24 +0000 (0:00:00.237) 0:02:33.256 ***** 2025-12-04 12:22:24.691826 | controller | changed: [instance] 2025-12-04 12:22:24.723670 | controller | 2025-12-04 12:22:24.723704 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2025-12-04 12:22:24.723712 | controller | Thursday 04 December 2025 12:22:24 +0000 (0:00:00.428) 0:02:33.684 ***** 2025-12-04 12:22:24.723723 | controller | skipping: [instance] 2025-12-04 12:22:24.756038 | controller | 2025-12-04 12:22:24.756057 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-04 12:22:24.756064 | controller | Thursday 04 December 2025 12:22:24 +0000 (0:00:00.032) 0:02:33.717 ***** 2025-12-04 12:22:24.756073 | controller | skipping: [instance] 2025-12-04 12:22:24.812466 | controller | 2025-12-04 12:22:24.812503 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2025-12-04 12:22:24.812511 | controller | Thursday 04 December 2025 12:22:24 +0000 (0:00:00.032) 0:02:33.749 ***** 2025-12-04 12:22:24.812522 | controller | skipping: [instance] 2025-12-04 12:22:24.862695 | controller | 2025-12-04 12:22:24.862714 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2025-12-04 12:22:24.862722 | controller | Thursday 04 December 2025 12:22:24 +0000 (0:00:00.055) 0:02:33.805 ***** 2025-12-04 12:22:24.862730 | controller | skipping: [instance] 2025-12-04 12:22:24.888602 | controller | 2025-12-04 12:22:24.888628 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-04 12:22:24.888636 | controller | Thursday 04 December 2025 12:22:24 +0000 (0:00:00.050) 0:02:33.856 ***** 2025-12-04 12:22:24.888645 | controller | skipping: [instance] 2025-12-04 12:22:24.928716 | controller | 2025-12-04 12:22:24.928740 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2025-12-04 12:22:24.928748 | controller | Thursday 04 December 2025 12:22:24 +0000 (0:00:00.025) 0:02:33.882 ***** 2025-12-04 12:22:24.928757 | controller | 2025-12-04 12:22:25.019714 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-04 12:22:25.019736 | controller | Thursday 04 December 2025 12:22:24 +0000 (0:00:00.040) 0:02:33.922 ***** 2025-12-04 12:22:25.019754 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-12-04 12:22:25.019950 | controller | 2025-12-04 12:22:25.019963 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-04 12:22:25.020078 | controller | Thursday 04 December 2025 12:22:25 +0000 (0:00:00.090) 0:02:34.013 ***** 2025-12-04 12:22:25.248054 | controller | ok: [instance] 2025-12-04 12:22:25.248129 | controller | 2025-12-04 12:22:25.248140 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-04 12:22:25.248157 | controller | Thursday 04 December 2025 12:22:25 +0000 (0:00:00.228) 0:02:34.241 ***** 2025-12-04 12:22:25.485860 | controller | ok: [instance] 2025-12-04 12:22:25.485931 | controller | 2025-12-04 12:22:25.485999 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2025-12-04 12:22:25.486110 | controller | Thursday 04 December 2025 12:22:25 +0000 (0:00:00.237) 0:02:34.479 ***** 2025-12-04 12:22:25.907634 | controller | changed: [instance] 2025-12-04 12:22:25.907706 | controller | 2025-12-04 12:22:25.907760 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2025-12-04 12:22:25.907883 | controller | Thursday 04 December 2025 12:22:25 +0000 (0:00:00.421) 0:02:34.900 ***** 2025-12-04 12:22:25.948989 | controller | skipping: [instance] 2025-12-04 12:22:25.949059 | controller | 2025-12-04 12:22:25.949160 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-04 12:22:25.949301 | controller | Thursday 04 December 2025 12:22:25 +0000 (0:00:00.041) 0:02:34.942 ***** 2025-12-04 12:22:25.988992 | controller | skipping: [instance] 2025-12-04 12:22:27.734702 | controller | 2025-12-04 12:22:27.734769 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2025-12-04 12:22:27.734779 | controller | Thursday 04 December 2025 12:22:25 +0000 (0:00:00.040) 0:02:34.982 ***** 2025-12-04 12:22:27.734792 | controller | changed: [instance -> controller-0.instance] 2025-12-04 12:22:28.989752 | controller | 2025-12-04 12:22:28.989801 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2025-12-04 12:22:28.989809 | controller | Thursday 04 December 2025 12:22:27 +0000 (0:00:01.744) 0:02:36.727 ***** 2025-12-04 12:22:28.989820 | controller | changed: [instance -> controller-0.instance] 2025-12-04 12:22:29.034204 | controller | 2025-12-04 12:22:29.034232 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-04 12:22:29.034240 | controller | Thursday 04 December 2025 12:22:28 +0000 (0:00:01.255) 0:02:37.982 ***** 2025-12-04 12:22:29.034268 | controller | 2025-12-04 12:22:29.258760 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-12-04 12:22:29.258791 | controller | Thursday 04 December 2025 12:22:29 +0000 (0:00:00.045) 0:02:38.027 ***** 2025-12-04 12:22:29.258802 | controller | ok: [instance] 2025-12-04 12:22:29.291084 | controller | 2025-12-04 12:22:29.291148 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-12-04 12:22:29.291157 | controller | Thursday 04 December 2025 12:22:29 +0000 (0:00:00.224) 0:02:38.252 ***** 2025-12-04 12:22:29.291172 | controller | ok: [instance] 2025-12-04 12:22:29.325971 | controller | 2025-12-04 12:22:29.325999 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-12-04 12:22:29.326008 | controller | Thursday 04 December 2025 12:22:29 +0000 (0:00:00.032) 0:02:38.284 ***** 2025-12-04 12:22:29.326018 | controller | skipping: [instance] 2025-12-04 12:22:29.375222 | controller | 2025-12-04 12:22:29.375241 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2025-12-04 12:22:29.375268 | controller | Thursday 04 December 2025 12:22:29 +0000 (0:00:00.034) 0:02:38.319 ***** 2025-12-04 12:22:29.375280 | controller | 2025-12-04 12:22:29.375429 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-04 12:22:29.375563 | controller | Thursday 04 December 2025 12:22:29 +0000 (0:00:00.049) 0:02:38.369 ***** 2025-12-04 12:22:29.462623 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2025-12-04 12:22:29.462777 | controller | 2025-12-04 12:22:29.462920 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-04 12:22:29.463046 | controller | Thursday 04 December 2025 12:22:29 +0000 (0:00:00.087) 0:02:38.456 ***** 2025-12-04 12:22:29.718561 | controller | ok: [instance] 2025-12-04 12:22:29.718707 | controller | 2025-12-04 12:22:29.718867 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-04 12:22:29.718998 | controller | Thursday 04 December 2025 12:22:29 +0000 (0:00:00.255) 0:02:38.712 ***** 2025-12-04 12:22:29.938717 | controller | ok: [instance] 2025-12-04 12:22:30.370853 | controller | 2025-12-04 12:22:30.370907 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2025-12-04 12:22:30.370917 | controller | Thursday 04 December 2025 12:22:29 +0000 (0:00:00.219) 0:02:38.932 ***** 2025-12-04 12:22:30.370929 | controller | changed: [instance] 2025-12-04 12:22:31.433346 | controller | 2025-12-04 12:22:31.433393 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2025-12-04 12:22:31.433402 | controller | Thursday 04 December 2025 12:22:30 +0000 (0:00:00.431) 0:02:39.363 ***** 2025-12-04 12:22:31.433427 | controller | changed: [instance] 2025-12-04 12:22:31.462493 | controller | 2025-12-04 12:22:31.462523 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-04 12:22:31.462531 | controller | Thursday 04 December 2025 12:22:31 +0000 (0:00:01.062) 0:02:40.426 ***** 2025-12-04 12:22:31.462541 | controller | skipping: [instance] 2025-12-04 12:22:31.508865 | controller | 2025-12-04 12:22:31.508899 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2025-12-04 12:22:31.508907 | controller | Thursday 04 December 2025 12:22:31 +0000 (0:00:00.030) 0:02:40.456 ***** 2025-12-04 12:22:31.508926 | controller | skipping: [instance] 2025-12-04 12:22:31.569936 | controller | 2025-12-04 12:22:31.569976 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2025-12-04 12:22:31.569985 | controller | Thursday 04 December 2025 12:22:31 +0000 (0:00:00.046) 0:02:40.502 ***** 2025-12-04 12:22:31.569998 | controller | skipping: [instance] 2025-12-04 12:22:31.627687 | controller | 2025-12-04 12:22:31.627942 | controller | TASK [Create VBMC entity] ****************************************************** 2025-12-04 12:22:31.627951 | controller | Thursday 04 December 2025 12:22:31 +0000 (0:00:00.061) 0:02:40.563 ***** 2025-12-04 12:22:31.627961 | controller | skipping: [instance] => (item=compute-0) 2025-12-04 12:22:31.898031 | controller | skipping: [instance] => (item=controller-0) 2025-12-04 12:22:31.898062 | controller | skipping: [instance] => (item=crc-0) 2025-12-04 12:22:31.898070 | controller | skipping: [instance] 2025-12-04 12:22:31.898076 | controller | 2025-12-04 12:22:31.898082 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2025-12-04 12:22:31.898088 | controller | Thursday 04 December 2025 12:22:31 +0000 (0:00:00.056) 0:02:40.619 ***** 2025-12-04 12:22:31.898098 | controller | ok: [instance] 2025-12-04 12:22:32.291017 | controller | 2025-12-04 12:22:32.291107 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2025-12-04 12:22:32.291118 | controller | Thursday 04 December 2025 12:22:31 +0000 (0:00:00.271) 0:02:40.891 ***** 2025-12-04 12:22:32.291135 | controller | changed: [instance] 2025-12-04 12:22:32.332178 | controller | 2025-12-04 12:22:32.332210 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2025-12-04 12:22:32.332218 | controller | Thursday 04 December 2025 12:22:32 +0000 (0:00:00.391) 0:02:41.283 ***** 2025-12-04 12:22:32.332228 | controller | skipping: [instance] 2025-12-04 12:22:32.369466 | controller | 2025-12-04 12:22:32.369500 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2025-12-04 12:22:32.369513 | controller | Thursday 04 December 2025 12:22:32 +0000 (0:00:00.041) 0:02:41.325 ***** 2025-12-04 12:22:32.369523 | controller | skipping: [instance] 2025-12-04 12:22:32.408589 | controller | 2025-12-04 12:22:32.408642 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2025-12-04 12:22:32.408650 | controller | Thursday 04 December 2025 12:22:32 +0000 (0:00:00.037) 0:02:41.363 ***** 2025-12-04 12:22:32.408661 | controller | skipping: [instance] 2025-12-04 12:22:33.137533 | controller | 2025-12-04 12:22:33.137578 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2025-12-04 12:22:33.137587 | controller | Thursday 04 December 2025 12:22:32 +0000 (0:00:00.038) 0:02:41.401 ***** 2025-12-04 12:22:33.137598 | controller | changed: [instance] 2025-12-04 12:22:33.137628 | controller | 2025-12-04 12:22:33.137636 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2025-12-04 12:22:33.137787 | controller | Thursday 04 December 2025 12:22:33 +0000 (0:00:00.728) 0:02:42.130 ***** 2025-12-04 12:22:33.913270 | controller | changed: [instance] 2025-12-04 12:22:33.955656 | controller | 2025-12-04 12:22:33.955686 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2025-12-04 12:22:33.955694 | controller | Thursday 04 December 2025 12:22:33 +0000 (0:00:00.775) 0:02:42.905 ***** 2025-12-04 12:22:33.955704 | controller | skipping: [instance] 2025-12-04 12:22:34.019635 | controller | 2025-12-04 12:22:34.019662 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2025-12-04 12:22:34.019670 | controller | Thursday 04 December 2025 12:22:33 +0000 (0:00:00.043) 0:02:42.949 ***** 2025-12-04 12:22:34.019680 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2025-12-04 12:22:34.082534 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2025-12-04 12:22:34.082577 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2025-12-04 12:22:34.082584 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2025-12-04 12:22:34.082591 | controller | 2025-12-04 12:22:34.082597 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2025-12-04 12:22:34.082602 | controller | Thursday 04 December 2025 12:22:34 +0000 (0:00:00.063) 0:02:43.012 ***** 2025-12-04 12:22:34.082613 | controller | skipping: [instance] 2025-12-04 12:22:34.120477 | controller | 2025-12-04 12:22:34.120509 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2025-12-04 12:22:34.120517 | controller | Thursday 04 December 2025 12:22:34 +0000 (0:00:00.062) 0:02:43.075 ***** 2025-12-04 12:22:34.120527 | controller | skipping: [instance] 2025-12-04 12:22:34.164526 | controller | 2025-12-04 12:22:34.164562 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2025-12-04 12:22:34.164571 | controller | Thursday 04 December 2025 12:22:34 +0000 (0:00:00.038) 0:02:43.114 ***** 2025-12-04 12:22:34.164581 | controller | skipping: [instance] 2025-12-04 12:22:34.208797 | controller | 2025-12-04 12:22:34.208852 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2025-12-04 12:22:34.208862 | controller | Thursday 04 December 2025 12:22:34 +0000 (0:00:00.043) 0:02:43.158 ***** 2025-12-04 12:22:34.208873 | controller | skipping: [instance] 2025-12-04 12:22:34.904225 | controller | 2025-12-04 12:22:34.904276 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2025-12-04 12:22:34.904293 | controller | Thursday 04 December 2025 12:22:34 +0000 (0:00:00.044) 0:02:43.202 ***** 2025-12-04 12:22:34.904304 | controller | changed: [instance] 2025-12-04 12:22:34.948549 | controller | 2025-12-04 12:22:34.948575 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2025-12-04 12:22:34.948585 | controller | Thursday 04 December 2025 12:22:34 +0000 (0:00:00.694) 0:02:43.897 ***** 2025-12-04 12:22:34.948597 | controller | skipping: [instance] 2025-12-04 12:22:34.997426 | controller | 2025-12-04 12:22:34.997493 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2025-12-04 12:22:34.997501 | controller | Thursday 04 December 2025 12:22:34 +0000 (0:00:00.044) 0:02:43.941 ***** 2025-12-04 12:22:34.997515 | controller | skipping: [instance] 2025-12-04 12:22:35.047058 | controller | 2025-12-04 12:22:35.047098 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2025-12-04 12:22:35.047106 | controller | Thursday 04 December 2025 12:22:34 +0000 (0:00:00.045) 0:02:43.987 ***** 2025-12-04 12:22:35.047116 | controller | skipping: [instance] 2025-12-04 12:22:35.083737 | controller | 2025-12-04 12:22:35.083765 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-12-04 12:22:35.083772 | controller | Thursday 04 December 2025 12:22:35 +0000 (0:00:00.052) 0:02:44.039 ***** 2025-12-04 12:22:35.083781 | controller | skipping: [instance] 2025-12-04 12:22:35.126279 | controller | 2025-12-04 12:22:35.126315 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-12-04 12:22:35.126323 | controller | Thursday 04 December 2025 12:22:35 +0000 (0:00:00.037) 0:02:44.077 ***** 2025-12-04 12:22:35.126333 | controller | skipping: [instance] 2025-12-04 12:22:35.126457 | controller | 2025-12-04 12:22:35.126469 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-12-04 12:22:35.126825 | controller | Thursday 04 December 2025 12:22:35 +0000 (0:00:00.041) 0:02:44.119 ***** 2025-12-04 12:22:35.167196 | controller | skipping: [instance] 2025-12-04 12:22:35.214282 | controller | 2025-12-04 12:22:35.214307 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-12-04 12:22:35.214315 | controller | Thursday 04 December 2025 12:22:35 +0000 (0:00:00.041) 0:02:44.160 ***** 2025-12-04 12:22:35.214323 | controller | skipping: [instance] 2025-12-04 12:22:35.259424 | controller | 2025-12-04 12:22:35.259452 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-12-04 12:22:35.259460 | controller | Thursday 04 December 2025 12:22:35 +0000 (0:00:00.047) 0:02:44.208 ***** 2025-12-04 12:22:35.259469 | controller | skipping: [instance] 2025-12-04 12:22:35.295433 | controller | 2025-12-04 12:22:35.295456 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-12-04 12:22:35.295463 | controller | Thursday 04 December 2025 12:22:35 +0000 (0:00:00.045) 0:02:44.253 ***** 2025-12-04 12:22:35.295472 | controller | skipping: [instance] 2025-12-04 12:22:35.345066 | controller | 2025-12-04 12:22:35.345093 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-12-04 12:22:35.345102 | controller | Thursday 04 December 2025 12:22:35 +0000 (0:00:00.036) 0:02:44.289 ***** 2025-12-04 12:22:35.345113 | controller | skipping: [instance] 2025-12-04 12:22:35.345201 | controller | 2025-12-04 12:22:35.345321 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2025-12-04 12:22:35.345340 | controller | Thursday 04 December 2025 12:22:35 +0000 (0:00:00.049) 0:02:44.339 ***** 2025-12-04 12:22:35.379205 | controller | skipping: [instance] 2025-12-04 12:22:35.532543 | controller | 2025-12-04 12:22:35.532582 | controller | TASK [reproducer : Configure Controller node] ********************************** 2025-12-04 12:22:35.532590 | controller | Thursday 04 December 2025 12:22:35 +0000 (0:00:00.033) 0:02:44.373 ***** 2025-12-04 12:22:35.532601 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2025-12-04 12:22:37.042430 | controller | 2025-12-04 12:22:37.042504 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-12-04 12:22:37.042514 | controller | Thursday 04 December 2025 12:22:35 +0000 (0:00:00.152) 0:02:44.525 ***** 2025-12-04 12:22:37.042530 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-12-04 12:22:37.071484 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-12-04 12:22:37.071525 | controller | 2025-12-04 12:22:37.071535 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-12-04 12:22:37.071542 | controller | Thursday 04 December 2025 12:22:37 +0000 (0:00:01.509) 0:02:46.035 ***** 2025-12-04 12:22:37.071562 | controller | skipping: [instance] 2025-12-04 12:22:37.071594 | controller | 2025-12-04 12:22:37.071604 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-04 12:22:37.071676 | controller | Thursday 04 December 2025 12:22:37 +0000 (0:00:00.029) 0:02:46.064 ***** 2025-12-04 12:22:37.779407 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:22:37.819243 | controller | 2025-12-04 12:22:37.819288 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-04 12:22:37.819296 | controller | Thursday 04 December 2025 12:22:37 +0000 (0:00:00.707) 0:02:46.772 ***** 2025-12-04 12:22:37.819306 | controller | skipping: [instance] 2025-12-04 12:22:37.863313 | controller | 2025-12-04 12:22:37.863335 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-04 12:22:37.863344 | controller | Thursday 04 December 2025 12:22:37 +0000 (0:00:00.040) 0:02:46.812 ***** 2025-12-04 12:22:37.863354 | controller | skipping: [instance] 2025-12-04 12:22:37.905323 | controller | 2025-12-04 12:22:37.905344 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-04 12:22:37.905352 | controller | Thursday 04 December 2025 12:22:37 +0000 (0:00:00.043) 0:02:46.856 ***** 2025-12-04 12:22:37.905361 | controller | skipping: [instance] 2025-12-04 12:22:37.957870 | controller | 2025-12-04 12:22:37.957888 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-04 12:22:37.957896 | controller | Thursday 04 December 2025 12:22:37 +0000 (0:00:00.042) 0:02:46.898 ***** 2025-12-04 12:22:37.957905 | controller | skipping: [instance] 2025-12-04 12:22:37.999314 | controller | 2025-12-04 12:22:37.999375 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2025-12-04 12:22:37.999383 | controller | Thursday 04 December 2025 12:22:37 +0000 (0:00:00.052) 0:02:46.951 ***** 2025-12-04 12:22:37.999397 | controller | skipping: [instance] 2025-12-04 12:22:38.041025 | controller | 2025-12-04 12:22:38.041066 | controller | TASK [reproducer : Install repos] ********************************************** 2025-12-04 12:22:38.041076 | controller | Thursday 04 December 2025 12:22:37 +0000 (0:00:00.040) 0:02:46.991 ***** 2025-12-04 12:22:38.041089 | controller | skipping: [instance] 2025-12-04 12:22:38.075353 | controller | 2025-12-04 12:22:38.075377 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2025-12-04 12:22:38.075386 | controller | Thursday 04 December 2025 12:22:38 +0000 (0:00:00.042) 0:02:47.034 ***** 2025-12-04 12:22:38.075398 | controller | skipping: [instance] 2025-12-04 12:22:38.109921 | controller | 2025-12-04 12:22:38.109940 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2025-12-04 12:22:38.109948 | controller | Thursday 04 December 2025 12:22:38 +0000 (0:00:00.034) 0:02:47.069 ***** 2025-12-04 12:22:38.109958 | controller | skipping: [instance] 2025-12-04 12:22:39.263279 | controller | 2025-12-04 12:22:39.263339 | controller | TASK [reproducer : Install some tools] ***************************************** 2025-12-04 12:22:39.263348 | controller | Thursday 04 December 2025 12:22:38 +0000 (0:00:00.034) 0:02:47.103 ***** 2025-12-04 12:22:39.263361 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:22:40.510399 | controller | 2025-12-04 12:22:40.510445 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2025-12-04 12:22:40.510456 | controller | Thursday 04 December 2025 12:22:39 +0000 (0:00:01.152) 0:02:48.256 ***** 2025-12-04 12:22:40.510470 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:22:40.510512 | controller | 2025-12-04 12:22:40.510545 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2025-12-04 12:22:40.510757 | controller | Thursday 04 December 2025 12:22:40 +0000 (0:00:01.247) 0:02:49.503 ***** 2025-12-04 12:22:41.231217 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:22:42.266548 | controller | 2025-12-04 12:22:42.266599 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2025-12-04 12:22:42.266607 | controller | Thursday 04 December 2025 12:22:41 +0000 (0:00:00.720) 0:02:50.224 ***** 2025-12-04 12:22:42.266627 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:22:43.551673 | controller | 2025-12-04 12:22:43.551711 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2025-12-04 12:22:43.551720 | controller | Thursday 04 December 2025 12:22:42 +0000 (0:00:01.035) 0:02:51.259 ***** 2025-12-04 12:22:43.551732 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-12-04 12:22:44.322116 | controller | skipping: [instance] => (item=compute-0) 2025-12-04 12:22:44.322155 | controller | skipping: [instance] => (item=controller-0) 2025-12-04 12:22:44.322163 | controller | skipping: [instance] => (item=crc-0) 2025-12-04 12:22:44.322169 | controller | 2025-12-04 12:22:44.322176 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2025-12-04 12:22:44.322182 | controller | Thursday 04 December 2025 12:22:43 +0000 (0:00:01.284) 0:02:52.544 ***** 2025-12-04 12:22:44.322194 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-12-04 12:22:46.305649 | controller | skipping: [instance] => (item=compute-0) 2025-12-04 12:22:46.305690 | controller | skipping: [instance] => (item=controller-0) 2025-12-04 12:22:46.305698 | controller | skipping: [instance] => (item=crc-0) 2025-12-04 12:22:46.305704 | controller | 2025-12-04 12:22:46.305711 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2025-12-04 12:22:46.305717 | controller | Thursday 04 December 2025 12:22:44 +0000 (0:00:00.770) 0:02:53.314 ***** 2025-12-04 12:22:46.305734 | controller | skipping: [instance] => (item=instance) 2025-12-04 12:22:46.948352 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2025-12-04 12:22:46.948394 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-12-04 12:22:46.948402 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2025-12-04 12:22:46.948408 | controller | 2025-12-04 12:22:46.948414 | controller | TASK [reproducer : Create kube directory] ************************************** 2025-12-04 12:22:46.948420 | controller | Thursday 04 December 2025 12:22:46 +0000 (0:00:01.983) 0:02:55.298 ***** 2025-12-04 12:22:46.948431 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:22:46.948853 | controller | 2025-12-04 12:22:47.975358 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2025-12-04 12:22:47.975409 | controller | Thursday 04 December 2025 12:22:46 +0000 (0:00:00.643) 0:02:55.941 ***** 2025-12-04 12:22:47.975424 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:22:49.014657 | controller | 2025-12-04 12:22:49.014696 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2025-12-04 12:22:49.014704 | controller | Thursday 04 December 2025 12:22:47 +0000 (0:00:01.026) 0:02:56.968 ***** 2025-12-04 12:22:49.014716 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:22:49.051527 | controller | 2025-12-04 12:22:49.051561 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2025-12-04 12:22:49.051569 | controller | Thursday 04 December 2025 12:22:49 +0000 (0:00:01.039) 0:02:58.007 ***** 2025-12-04 12:22:49.051580 | controller | skipping: [instance] 2025-12-04 12:22:49.694592 | controller | 2025-12-04 12:22:49.694631 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2025-12-04 12:22:49.694640 | controller | Thursday 04 December 2025 12:22:49 +0000 (0:00:00.037) 0:02:58.045 ***** 2025-12-04 12:22:49.694651 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:22:50.316164 | controller | 2025-12-04 12:22:50.316202 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2025-12-04 12:22:50.316211 | controller | Thursday 04 December 2025 12:22:49 +0000 (0:00:00.642) 0:02:58.687 ***** 2025-12-04 12:22:50.316223 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:22:50.316433 | controller | 2025-12-04 12:22:50.316599 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2025-12-04 12:22:50.316750 | controller | Thursday 04 December 2025 12:22:50 +0000 (0:00:00.622) 0:02:59.309 ***** 2025-12-04 12:22:50.416962 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:22:50.417180 | controller | 2025-12-04 12:22:50.417374 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2025-12-04 12:22:50.417529 | controller | Thursday 04 December 2025 12:22:50 +0000 (0:00:00.100) 0:02:59.410 ***** 2025-12-04 12:22:50.486177 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2025-12-04 12:22:50.486461 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2025-12-04 12:22:50.486661 | controller | 2025-12-04 12:22:50.486875 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-12-04 12:22:50.487042 | controller | Thursday 04 December 2025 12:22:50 +0000 (0:00:00.069) 0:02:59.480 ***** 2025-12-04 12:22:50.544859 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 12:22:50.545041 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2025-12-04 12:22:50.545188 | controller | 2025-12-04 12:22:50.545357 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-12-04 12:22:50.545502 | controller | Thursday 04 December 2025 12:22:50 +0000 (0:00:00.058) 0:02:59.538 ***** 2025-12-04 12:22:50.598952 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 12:22:50.599152 | controller | _secret_file: '' 2025-12-04 12:22:50.599319 | controller | 2025-12-04 12:22:50.599473 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-12-04 12:22:50.599612 | controller | Thursday 04 December 2025 12:22:50 +0000 (0:00:00.054) 0:02:59.593 ***** 2025-12-04 12:22:50.652421 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 12:22:50.652575 | controller | _secret_content: my-default-location-place 2025-12-04 12:22:50.652707 | controller | 2025-12-04 12:22:50.652864 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-12-04 12:22:50.653001 | controller | Thursday 04 December 2025 12:22:50 +0000 (0:00:00.053) 0:02:59.646 ***** 2025-12-04 12:22:50.705108 | controller | skipping: [instance] 2025-12-04 12:22:50.705320 | controller | 2025-12-04 12:22:50.705503 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-12-04 12:22:50.705659 | controller | Thursday 04 December 2025 12:22:50 +0000 (0:00:00.052) 0:02:59.699 ***** 2025-12-04 12:22:50.759325 | controller | skipping: [instance] 2025-12-04 12:22:50.759548 | controller | 2025-12-04 12:22:50.759563 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-12-04 12:22:50.811206 | controller | Thursday 04 December 2025 12:22:50 +0000 (0:00:00.053) 0:02:59.753 ***** 2025-12-04 12:22:50.811230 | controller | skipping: [instance] 2025-12-04 12:22:50.811440 | controller | 2025-12-04 12:22:50.811455 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-12-04 12:22:50.811464 | controller | Thursday 04 December 2025 12:22:50 +0000 (0:00:00.050) 0:02:59.804 ***** 2025-12-04 12:22:51.904917 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:22:51.964595 | controller | 2025-12-04 12:22:51.964630 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-12-04 12:22:51.964640 | controller | Thursday 04 December 2025 12:22:51 +0000 (0:00:01.093) 0:03:00.898 ***** 2025-12-04 12:22:51.964653 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 12:22:52.019839 | controller | _secret_dest: /home/zuul/ipmi-things 2025-12-04 12:22:52.019868 | controller | 2025-12-04 12:22:52.019877 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-12-04 12:22:52.019883 | controller | Thursday 04 December 2025 12:22:51 +0000 (0:00:00.059) 0:03:00.958 ***** 2025-12-04 12:22:52.019894 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 12:22:52.073058 | controller | _secret_file: /tmp/ipmi-things 2025-12-04 12:22:52.073084 | controller | 2025-12-04 12:22:52.073091 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-12-04 12:22:52.073105 | controller | Thursday 04 December 2025 12:22:52 +0000 (0:00:00.055) 0:03:01.013 ***** 2025-12-04 12:22:52.073116 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 12:22:52.073293 | controller | _secret_content: '' 2025-12-04 12:22:52.073447 | controller | 2025-12-04 12:22:52.073593 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-12-04 12:22:52.073732 | controller | Thursday 04 December 2025 12:22:52 +0000 (0:00:00.053) 0:03:01.067 ***** 2025-12-04 12:22:52.130052 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2025-12-04 12:22:52.130297 | controller | msg: All assertions passed 2025-12-04 12:22:52.130443 | controller | 2025-12-04 12:22:52.130583 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-12-04 12:22:52.130731 | controller | Thursday 04 December 2025 12:22:52 +0000 (0:00:00.056) 0:03:01.124 ***** 2025-12-04 12:22:52.712200 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:22:52.712482 | controller | 2025-12-04 12:22:52.712656 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-12-04 12:22:52.712818 | controller | Thursday 04 December 2025 12:22:52 +0000 (0:00:00.581) 0:03:01.705 ***** 2025-12-04 12:22:53.817276 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:22:53.876011 | controller | 2025-12-04 12:22:53.876048 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-12-04 12:22:53.876056 | controller | Thursday 04 December 2025 12:22:53 +0000 (0:00:01.104) 0:03:02.810 ***** 2025-12-04 12:22:53.876067 | controller | skipping: [instance] 2025-12-04 12:22:54.463400 | controller | 2025-12-04 12:22:54.463438 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2025-12-04 12:22:54.463446 | controller | Thursday 04 December 2025 12:22:53 +0000 (0:00:00.058) 0:03:02.869 ***** 2025-12-04 12:22:54.463457 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:22:55.096448 | controller | 2025-12-04 12:22:55.096486 | controller | TASK [reproducer : Check if async file is still available] ********************* 2025-12-04 12:22:55.096495 | controller | Thursday 04 December 2025 12:22:54 +0000 (0:00:00.587) 0:03:03.456 ***** 2025-12-04 12:22:55.096506 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:08.221516 | controller | 2025-12-04 12:24:08.221970 | controller | TASK [reproducer : Check package install status] ******************************* 2025-12-04 12:24:08.221979 | controller | Thursday 04 December 2025 12:22:55 +0000 (0:00:00.633) 0:03:04.089 ***** 2025-12-04 12:24:08.221990 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2025-12-04 12:24:08.222158 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2025-12-04 12:24:08.222326 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2025-12-04 12:24:08.222474 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2025-12-04 12:24:08.222615 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2025-12-04 12:24:08.222748 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2025-12-04 12:24:08.222875 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2025-12-04 12:24:08.223002 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2025-12-04 12:24:08.223136 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). 2025-12-04 12:24:08.223294 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left). 2025-12-04 12:24:08.223439 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (90 retries left). 2025-12-04 12:24:08.223588 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (89 retries left). 2025-12-04 12:24:08.223749 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (88 retries left). 2025-12-04 12:24:08.223889 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:08.224013 | controller | 2025-12-04 12:24:08.224144 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2025-12-04 12:24:08.224298 | controller | Thursday 04 December 2025 12:24:08 +0000 (0:01:13.120) 0:04:17.209 ***** 2025-12-04 12:24:08.937324 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:12.221364 | controller | 2025-12-04 12:24:12.221418 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2025-12-04 12:24:12.221426 | controller | Thursday 04 December 2025 12:24:08 +0000 (0:00:00.720) 0:04:17.930 ***** 2025-12-04 12:24:12.221440 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:12.221461 | controller | 2025-12-04 12:24:12.221489 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2025-12-04 12:24:12.221637 | controller | Thursday 04 December 2025 12:24:12 +0000 (0:00:03.284) 0:04:21.214 ***** 2025-12-04 12:24:12.281306 | controller | skipping: [instance] 2025-12-04 12:24:12.281414 | controller | 2025-12-04 12:24:12.281534 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2025-12-04 12:24:12.281655 | controller | Thursday 04 December 2025 12:24:12 +0000 (0:00:00.060) 0:04:21.274 ***** 2025-12-04 12:24:12.348727 | controller | skipping: [instance] 2025-12-04 12:24:12.348820 | controller | 2025-12-04 12:24:12.348927 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2025-12-04 12:24:12.349034 | controller | Thursday 04 December 2025 12:24:12 +0000 (0:00:00.066) 0:04:21.341 ***** 2025-12-04 12:24:13.164478 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:13.164562 | controller | 2025-12-04 12:24:13.164786 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2025-12-04 12:24:13.873102 | controller | Thursday 04 December 2025 12:24:13 +0000 (0:00:00.816) 0:04:22.157 ***** 2025-12-04 12:24:13.873172 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:14.252912 | controller | 2025-12-04 12:24:14.252959 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2025-12-04 12:24:14.252968 | controller | Thursday 04 December 2025 12:24:13 +0000 (0:00:00.707) 0:04:22.865 ***** 2025-12-04 12:24:14.252981 | controller | changed: [instance] 2025-12-04 12:24:15.059002 | controller | 2025-12-04 12:24:15.059050 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2025-12-04 12:24:15.059059 | controller | Thursday 04 December 2025 12:24:14 +0000 (0:00:00.375) 0:04:23.240 ***** 2025-12-04 12:24:15.059071 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:16.313729 | controller | 2025-12-04 12:24:16.313782 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2025-12-04 12:24:16.313791 | controller | Thursday 04 December 2025 12:24:15 +0000 (0:00:00.810) 0:04:24.051 ***** 2025-12-04 12:24:16.313804 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:16.362518 | controller | 2025-12-04 12:24:16.362593 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-04 12:24:16.362605 | controller | Thursday 04 December 2025 12:24:16 +0000 (0:00:01.254) 0:04:25.306 ***** 2025-12-04 12:24:16.362619 | controller | skipping: [instance] 2025-12-04 12:24:16.362640 | controller | 2025-12-04 12:24:16.362649 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-04 12:24:16.362688 | controller | Thursday 04 December 2025 12:24:16 +0000 (0:00:00.050) 0:04:25.356 ***** 2025-12-04 12:24:16.410156 | controller | skipping: [instance] 2025-12-04 12:24:16.410220 | controller | 2025-12-04 12:24:16.410395 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-04 12:24:16.410514 | controller | Thursday 04 December 2025 12:24:16 +0000 (0:00:00.047) 0:04:25.404 ***** 2025-12-04 12:24:16.458593 | controller | skipping: [instance] 2025-12-04 12:24:16.515859 | controller | 2025-12-04 12:24:16.515885 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2025-12-04 12:24:16.515893 | controller | Thursday 04 December 2025 12:24:16 +0000 (0:00:00.047) 0:04:25.452 ***** 2025-12-04 12:24:16.515905 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:16.563004 | controller | 2025-12-04 12:24:16.563028 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2025-12-04 12:24:16.563036 | controller | Thursday 04 December 2025 12:24:16 +0000 (0:00:00.057) 0:04:25.509 ***** 2025-12-04 12:24:16.563048 | controller | skipping: [instance] 2025-12-04 12:24:16.607761 | controller | 2025-12-04 12:24:16.607785 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2025-12-04 12:24:16.607793 | controller | Thursday 04 December 2025 12:24:16 +0000 (0:00:00.046) 0:04:25.556 ***** 2025-12-04 12:24:16.607805 | controller | skipping: [instance] 2025-12-04 12:24:16.652446 | controller | 2025-12-04 12:24:16.652475 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2025-12-04 12:24:16.652483 | controller | Thursday 04 December 2025 12:24:16 +0000 (0:00:00.044) 0:04:25.601 ***** 2025-12-04 12:24:16.652495 | controller | skipping: [instance] 2025-12-04 12:24:17.332459 | controller | 2025-12-04 12:24:17.332547 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2025-12-04 12:24:17.332564 | controller | Thursday 04 December 2025 12:24:16 +0000 (0:00:00.044) 0:04:25.645 ***** 2025-12-04 12:24:17.332580 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:17.519992 | controller | 2025-12-04 12:24:17.520017 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2025-12-04 12:24:17.520025 | controller | Thursday 04 December 2025 12:24:17 +0000 (0:00:00.679) 0:04:26.325 ***** 2025-12-04 12:24:17.520035 | controller | skipping: [instance] => (item=secret) 2025-12-04 12:24:18.592404 | controller | skipping: [instance] => (item=configmap) 2025-12-04 12:24:18.592520 | controller | skipping: [instance] => (item=pod) 2025-12-04 12:24:18.592531 | controller | skipping: [instance] => (item=service) 2025-12-04 12:24:18.592538 | controller | skipping: [instance] => (item=route) 2025-12-04 12:24:18.592543 | controller | skipping: [instance] 2025-12-04 12:24:18.592549 | controller | 2025-12-04 12:24:18.592556 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2025-12-04 12:24:18.592561 | controller | Thursday 04 December 2025 12:24:17 +0000 (0:00:00.187) 0:04:26.512 ***** 2025-12-04 12:24:18.592592 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:19.745971 | controller | 2025-12-04 12:24:19.746018 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2025-12-04 12:24:19.746026 | controller | Thursday 04 December 2025 12:24:18 +0000 (0:00:01.072) 0:04:27.584 ***** 2025-12-04 12:24:19.746038 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:19.793941 | controller | 2025-12-04 12:24:19.793971 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2025-12-04 12:24:19.793980 | controller | Thursday 04 December 2025 12:24:19 +0000 (0:00:01.153) 0:04:28.738 ***** 2025-12-04 12:24:19.793990 | controller | skipping: [instance] 2025-12-04 12:24:19.838737 | controller | 2025-12-04 12:24:19.838758 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2025-12-04 12:24:19.838766 | controller | Thursday 04 December 2025 12:24:19 +0000 (0:00:00.048) 0:04:28.787 ***** 2025-12-04 12:24:19.838776 | controller | skipping: [instance] 2025-12-04 12:24:19.943296 | controller | 2025-12-04 12:24:19.943317 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2025-12-04 12:24:19.943324 | controller | Thursday 04 December 2025 12:24:19 +0000 (0:00:00.045) 0:04:28.832 ***** 2025-12-04 12:24:19.943333 | controller | skipping: [instance] => (item=secret) 2025-12-04 12:24:19.944100 | controller | skipping: [instance] => (item=configmap) 2025-12-04 12:24:19.988104 | controller | skipping: [instance] => (item=service) 2025-12-04 12:24:19.988126 | controller | skipping: [instance] => (item=route) 2025-12-04 12:24:19.988140 | controller | skipping: [instance] 2025-12-04 12:24:19.988147 | controller | 2025-12-04 12:24:19.988159 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2025-12-04 12:24:19.988165 | controller | Thursday 04 December 2025 12:24:19 +0000 (0:00:00.104) 0:04:28.937 ***** 2025-12-04 12:24:19.988174 | controller | skipping: [instance] 2025-12-04 12:24:21.731912 | controller | 2025-12-04 12:24:21.731973 | controller | TASK [podman : Ensure podman is installed] ************************************* 2025-12-04 12:24:21.731983 | controller | Thursday 04 December 2025 12:24:19 +0000 (0:00:00.044) 0:04:28.981 ***** 2025-12-04 12:24:21.731994 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:22.617348 | controller | 2025-12-04 12:24:22.617399 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2025-12-04 12:24:22.617408 | controller | Thursday 04 December 2025 12:24:21 +0000 (0:00:01.742) 0:04:30.724 ***** 2025-12-04 12:24:22.617419 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:22.668146 | controller | 2025-12-04 12:24:22.668185 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2025-12-04 12:24:22.668194 | controller | Thursday 04 December 2025 12:24:22 +0000 (0:00:00.885) 0:04:31.609 ***** 2025-12-04 12:24:22.668205 | controller | skipping: [instance] 2025-12-04 12:24:22.715694 | controller | 2025-12-04 12:24:22.715723 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2025-12-04 12:24:22.715732 | controller | Thursday 04 December 2025 12:24:22 +0000 (0:00:00.052) 0:04:31.661 ***** 2025-12-04 12:24:22.715741 | controller | skipping: [instance] 2025-12-04 12:24:22.760807 | controller | 2025-12-04 12:24:22.760836 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2025-12-04 12:24:22.760844 | controller | Thursday 04 December 2025 12:24:22 +0000 (0:00:00.047) 0:04:31.709 ***** 2025-12-04 12:24:22.760853 | controller | skipping: [instance] 2025-12-04 12:24:34.070592 | controller | 2025-12-04 12:24:34.070628 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2025-12-04 12:24:34.070637 | controller | Thursday 04 December 2025 12:24:22 +0000 (0:00:00.045) 0:04:31.754 ***** 2025-12-04 12:24:34.070647 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:35.836201 | controller | 2025-12-04 12:24:35.836263 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2025-12-04 12:24:35.836275 | controller | Thursday 04 December 2025 12:24:34 +0000 (0:00:11.309) 0:04:43.063 ***** 2025-12-04 12:24:35.836288 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:37.113018 | controller | 2025-12-04 12:24:37.113066 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-12-04 12:24:37.113074 | controller | Thursday 04 December 2025 12:24:35 +0000 (0:00:01.765) 0:04:44.829 ***** 2025-12-04 12:24:37.113086 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-12-04 12:24:37.165330 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-12-04 12:24:37.165387 | controller | 2025-12-04 12:24:37.165395 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2025-12-04 12:24:37.165415 | controller | Thursday 04 December 2025 12:24:37 +0000 (0:00:01.276) 0:04:46.106 ***** 2025-12-04 12:24:37.165427 | controller | skipping: [instance] 2025-12-04 12:24:37.874170 | controller | 2025-12-04 12:24:37.874221 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2025-12-04 12:24:37.874230 | controller | Thursday 04 December 2025 12:24:37 +0000 (0:00:00.052) 0:04:46.158 ***** 2025-12-04 12:24:37.874242 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:37.917754 | controller | 2025-12-04 12:24:37.917778 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2025-12-04 12:24:37.917801 | controller | Thursday 04 December 2025 12:24:37 +0000 (0:00:00.708) 0:04:46.867 ***** 2025-12-04 12:24:37.917812 | controller | skipping: [instance] 2025-12-04 12:24:37.976581 | controller | 2025-12-04 12:24:37.976604 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2025-12-04 12:24:37.976612 | controller | Thursday 04 December 2025 12:24:37 +0000 (0:00:00.044) 0:04:46.911 ***** 2025-12-04 12:24:37.976777 | controller | skipping: [instance] 2025-12-04 12:24:38.028818 | controller | 2025-12-04 12:24:38.028836 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-12-04 12:24:38.028844 | controller | Thursday 04 December 2025 12:24:37 +0000 (0:00:00.058) 0:04:46.970 ***** 2025-12-04 12:24:38.028853 | controller | skipping: [instance] 2025-12-04 12:24:38.072524 | controller | 2025-12-04 12:24:38.072542 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-12-04 12:24:38.072562 | controller | Thursday 04 December 2025 12:24:38 +0000 (0:00:00.052) 0:04:47.022 ***** 2025-12-04 12:24:38.072571 | controller | skipping: [instance] 2025-12-04 12:24:38.214224 | controller | 2025-12-04 12:24:38.214259 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2025-12-04 12:24:38.214272 | controller | Thursday 04 December 2025 12:24:38 +0000 (0:00:00.043) 0:04:47.066 ***** 2025-12-04 12:24:38.214282 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '4a0146b3-fcb8-4083-8423-b04a8c638f6c'}) 2025-12-04 12:24:39.409443 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '99182054-a51e-4734-a480-cf8df6a2e376'}) 2025-12-04 12:24:39.409480 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': 'a3efd8a3-91bd-4b47-91ec-ee5a09ff3dae'}) 2025-12-04 12:24:39.409488 | controller | 2025-12-04 12:24:39.409494 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2025-12-04 12:24:39.409500 | controller | Thursday 04 December 2025 12:24:38 +0000 (0:00:00.141) 0:04:47.207 ***** 2025-12-04 12:24:39.409510 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:39.450532 | controller | 2025-12-04 12:24:39.450559 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2025-12-04 12:24:39.450567 | controller | Thursday 04 December 2025 12:24:39 +0000 (0:00:01.195) 0:04:48.402 ***** 2025-12-04 12:24:39.450575 | controller | skipping: [instance] 2025-12-04 12:24:39.611895 | controller | 2025-12-04 12:24:39.611920 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2025-12-04 12:24:39.611927 | controller | Thursday 04 December 2025 12:24:39 +0000 (0:00:00.041) 0:04:48.443 ***** 2025-12-04 12:24:39.611936 | controller | 2025-12-04 12:24:39.682977 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2025-12-04 12:24:39.682999 | controller | Thursday 04 December 2025 12:24:39 +0000 (0:00:00.161) 0:04:48.605 ***** 2025-12-04 12:24:39.683010 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:39.736170 | controller | 2025-12-04 12:24:39.736190 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-12-04 12:24:39.736199 | controller | Thursday 04 December 2025 12:24:39 +0000 (0:00:00.070) 0:04:48.676 ***** 2025-12-04 12:24:39.736207 | controller | skipping: [instance] 2025-12-04 12:24:39.781984 | controller | 2025-12-04 12:24:39.782003 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-12-04 12:24:39.782010 | controller | Thursday 04 December 2025 12:24:39 +0000 (0:00:00.053) 0:04:48.729 ***** 2025-12-04 12:24:39.782018 | controller | skipping: [instance] 2025-12-04 12:24:41.328110 | controller | 2025-12-04 12:24:41.328154 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2025-12-04 12:24:41.328163 | controller | Thursday 04 December 2025 12:24:39 +0000 (0:00:00.044) 0:04:48.774 ***** 2025-12-04 12:24:41.328176 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:46.846507 | controller | 2025-12-04 12:24:46.846565 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2025-12-04 12:24:46.846574 | controller | Thursday 04 December 2025 12:24:41 +0000 (0:00:01.546) 0:04:50.321 ***** 2025-12-04 12:24:46.846587 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=4a0146b3-fcb8-4083-8423-b04a8c638f6c) 2025-12-04 12:24:46.956201 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=99182054-a51e-4734-a480-cf8df6a2e376) 2025-12-04 12:24:46.956229 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=a3efd8a3-91bd-4b47-91ec-ee5a09ff3dae) 2025-12-04 12:24:46.956236 | controller | 2025-12-04 12:24:46.956242 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2025-12-04 12:24:46.956267 | controller | Thursday 04 December 2025 12:24:46 +0000 (0:00:05.517) 0:04:55.838 ***** 2025-12-04 12:24:46.956279 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2025-12-04 12:24:47.218847 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2025-12-04 12:24:47.218890 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2025-12-04 12:24:47.218898 | controller | 2025-12-04 12:24:47.218905 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2025-12-04 12:24:47.218910 | controller | Thursday 04 December 2025 12:24:46 +0000 (0:00:00.110) 0:04:55.949 ***** 2025-12-04 12:24:47.218927 | controller | ok: [instance -> localhost] 2025-12-04 12:24:49.488623 | controller | 2025-12-04 12:24:49.488675 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2025-12-04 12:24:49.488684 | controller | Thursday 04 December 2025 12:24:47 +0000 (0:00:00.262) 0:04:56.211 ***** 2025-12-04 12:24:49.488697 | controller | changed: [instance -> localhost] => (item=controller-0) 2025-12-04 12:24:50.236800 | controller | 2025-12-04 12:24:50.236852 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2025-12-04 12:24:50.236861 | controller | Thursday 04 December 2025 12:24:49 +0000 (0:00:02.269) 0:04:58.481 ***** 2025-12-04 12:24:50.236874 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:51.094866 | controller | 2025-12-04 12:24:51.094909 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2025-12-04 12:24:51.094917 | controller | Thursday 04 December 2025 12:24:50 +0000 (0:00:00.748) 0:04:59.229 ***** 2025-12-04 12:24:51.094929 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:52.372972 | controller | 2025-12-04 12:24:52.373035 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2025-12-04 12:24:52.373043 | controller | Thursday 04 December 2025 12:24:51 +0000 (0:00:00.858) 0:05:00.088 ***** 2025-12-04 12:24:52.373057 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:53.040001 | controller | 2025-12-04 12:24:53.040057 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2025-12-04 12:24:53.040067 | controller | Thursday 04 December 2025 12:24:52 +0000 (0:00:01.277) 0:05:01.365 ***** 2025-12-04 12:24:53.040080 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:54.271977 | controller | 2025-12-04 12:24:54.272038 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2025-12-04 12:24:54.272048 | controller | Thursday 04 December 2025 12:24:53 +0000 (0:00:00.667) 0:05:02.032 ***** 2025-12-04 12:24:54.272060 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:54.886043 | controller | 2025-12-04 12:24:54.886097 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2025-12-04 12:24:54.886106 | controller | Thursday 04 December 2025 12:24:54 +0000 (0:00:01.231) 0:05:03.264 ***** 2025-12-04 12:24:54.886119 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:55.530790 | controller | 2025-12-04 12:24:55.530840 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2025-12-04 12:24:55.530849 | controller | Thursday 04 December 2025 12:24:54 +0000 (0:00:00.614) 0:05:03.879 ***** 2025-12-04 12:24:55.530861 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:56.843292 | controller | 2025-12-04 12:24:56.843337 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2025-12-04 12:24:56.843346 | controller | Thursday 04 December 2025 12:24:55 +0000 (0:00:00.643) 0:05:04.522 ***** 2025-12-04 12:24:56.843362 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-12-04 12:24:56.884699 | controller | 2025-12-04 12:24:56.884719 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-04 12:24:56.884727 | controller | Thursday 04 December 2025 12:24:56 +0000 (0:00:01.312) 0:05:05.835 ***** 2025-12-04 12:24:56.884736 | controller | skipping: [instance] 2025-12-04 12:24:56.923445 | controller | 2025-12-04 12:24:56.923463 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-04 12:24:56.923470 | controller | Thursday 04 December 2025 12:24:56 +0000 (0:00:00.042) 0:05:05.878 ***** 2025-12-04 12:24:56.923478 | controller | skipping: [instance] 2025-12-04 12:24:56.960823 | controller | 2025-12-04 12:24:56.960839 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-04 12:24:56.960846 | controller | Thursday 04 December 2025 12:24:56 +0000 (0:00:00.038) 0:05:05.917 ***** 2025-12-04 12:24:56.960854 | controller | skipping: [instance] 2025-12-04 12:24:57.005459 | controller | 2025-12-04 12:24:57.005489 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-04 12:24:57.005496 | controller | Thursday 04 December 2025 12:24:56 +0000 (0:00:00.037) 0:05:05.954 ***** 2025-12-04 12:24:57.005505 | controller | skipping: [instance] 2025-12-04 12:24:57.044135 | controller | 2025-12-04 12:24:57.044151 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-04 12:24:57.044158 | controller | Thursday 04 December 2025 12:24:57 +0000 (0:00:00.044) 0:05:05.999 ***** 2025-12-04 12:24:57.044166 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:24:57.151355 | controller | 2025-12-04 12:24:57.151397 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-04 12:24:57.151409 | controller | Thursday 04 December 2025 12:24:57 +0000 (0:00:00.038) 0:05:06.038 ***** 2025-12-04 12:24:57.151425 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-12-04 12:24:57.151988 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2025-12-04 12:24:57.202008 | controller | 2025-12-04 12:24:57.202032 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-04 12:24:57.202047 | controller | Thursday 04 December 2025 12:24:57 +0000 (0:00:00.106) 0:05:06.144 ***** 2025-12-04 12:24:57.202056 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2025-12-04 12:25:00.622157 | controller | 2025-12-04 12:25:00.622214 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2025-12-04 12:25:00.622223 | controller | Thursday 04 December 2025 12:24:57 +0000 (0:00:00.050) 0:05:06.195 ***** 2025-12-04 12:25:00.622235 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-12-04 12:25:01.704459 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2025-12-04 12:25:01.704505 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-12-04 12:25:01.704556 | controller | 2025-12-04 12:25:01.704566 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2025-12-04 12:25:01.704572 | controller | Thursday 04 December 2025 12:25:00 +0000 (0:00:03.418) 0:05:09.614 ***** 2025-12-04 12:25:01.704583 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:02.228377 | controller | 2025-12-04 12:25:02.228426 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-04 12:25:02.228434 | controller | Thursday 04 December 2025 12:25:01 +0000 (0:00:01.082) 0:05:10.696 ***** 2025-12-04 12:25:02.228446 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:03.196008 | controller | 2025-12-04 12:25:03.196053 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-04 12:25:03.196062 | controller | Thursday 04 December 2025 12:25:02 +0000 (0:00:00.524) 0:05:11.221 ***** 2025-12-04 12:25:03.196073 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:03.285712 | controller | 2025-12-04 12:25:03.285757 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-04 12:25:03.285765 | controller | Thursday 04 December 2025 12:25:03 +0000 (0:00:00.967) 0:05:12.189 ***** 2025-12-04 12:25:03.285777 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:03.340173 | controller | 2025-12-04 12:25:03.340215 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-04 12:25:03.340224 | controller | Thursday 04 December 2025 12:25:03 +0000 (0:00:00.089) 0:05:12.278 ***** 2025-12-04 12:25:03.340235 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:04.330699 | controller | 2025-12-04 12:25:04.330744 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-04 12:25:04.330752 | controller | Thursday 04 December 2025 12:25:03 +0000 (0:00:00.054) 0:05:12.333 ***** 2025-12-04 12:25:04.330764 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:05.255547 | controller | 2025-12-04 12:25:05.255596 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2025-12-04 12:25:05.255604 | controller | Thursday 04 December 2025 12:25:04 +0000 (0:00:00.990) 0:05:13.323 ***** 2025-12-04 12:25:05.255616 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:11.372440 | controller | 2025-12-04 12:25:11.372484 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2025-12-04 12:25:11.372492 | controller | Thursday 04 December 2025 12:25:05 +0000 (0:00:00.919) 0:05:14.243 ***** 2025-12-04 12:25:11.372504 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2025-12-04 12:25:11.578957 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:11.578996 | controller | 2025-12-04 12:25:11.579009 | controller | TASK [Configure ntp service] *************************************************** 2025-12-04 12:25:11.579015 | controller | Thursday 04 December 2025 12:25:11 +0000 (0:00:06.121) 0:05:20.365 ***** 2025-12-04 12:25:11.579026 | controller | 2025-12-04 12:25:12.562371 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2025-12-04 12:25:12.562417 | controller | Thursday 04 December 2025 12:25:11 +0000 (0:00:00.207) 0:05:20.572 ***** 2025-12-04 12:25:12.562430 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:13.667600 | controller | 2025-12-04 12:25:13.667637 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2025-12-04 12:25:13.667645 | controller | Thursday 04 December 2025 12:25:12 +0000 (0:00:00.983) 0:05:21.555 ***** 2025-12-04 12:25:13.667656 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2025-12-04 12:25:14.737833 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2025-12-04 12:25:14.737880 | controller | 2025-12-04 12:25:14.737888 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2025-12-04 12:25:14.737894 | controller | Thursday 04 December 2025 12:25:13 +0000 (0:00:01.105) 0:05:22.660 ***** 2025-12-04 12:25:14.737905 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:15.462686 | controller | 2025-12-04 12:25:15.462730 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2025-12-04 12:25:15.462738 | controller | Thursday 04 December 2025 12:25:14 +0000 (0:00:01.070) 0:05:23.730 ***** 2025-12-04 12:25:15.462749 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:15.462940 | controller | 2025-12-04 12:25:15.463175 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2025-12-04 12:25:15.611222 | controller | Thursday 04 December 2025 12:25:15 +0000 (0:00:00.725) 0:05:24.456 ***** 2025-12-04 12:25:15.611278 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2025-12-04 12:25:16.152609 | controller | 2025-12-04 12:25:16.152659 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2025-12-04 12:25:16.152668 | controller | Thursday 04 December 2025 12:25:15 +0000 (0:00:00.148) 0:05:24.604 ***** 2025-12-04 12:25:16.152679 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:16.678429 | controller | 2025-12-04 12:25:16.678471 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2025-12-04 12:25:16.678480 | controller | Thursday 04 December 2025 12:25:16 +0000 (0:00:00.541) 0:05:25.145 ***** 2025-12-04 12:25:16.678492 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-12-04 12:25:17.396286 | controller | 2025-12-04 12:25:17.396323 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2025-12-04 12:25:17.396331 | controller | Thursday 04 December 2025 12:25:16 +0000 (0:00:00.525) 0:05:25.671 ***** 2025-12-04 12:25:17.396342 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-04 12:25:17.983522 | controller | 2025-12-04 12:25:17.983573 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2025-12-04 12:25:17.983582 | controller | Thursday 04 December 2025 12:25:17 +0000 (0:00:00.718) 0:05:26.389 ***** 2025-12-04 12:25:17.983594 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-04 12:25:18.038351 | controller | 2025-12-04 12:25:18.038369 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2025-12-04 12:25:18.038376 | controller | Thursday 04 December 2025 12:25:17 +0000 (0:00:00.586) 0:05:26.976 ***** 2025-12-04 12:25:18.038384 | controller | 2025-12-04 12:25:18.624271 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2025-12-04 12:25:18.624309 | controller | Thursday 04 December 2025 12:25:18 +0000 (0:00:00.055) 0:05:27.032 ***** 2025-12-04 12:25:18.624320 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-12-04 12:25:19.485943 | controller | 2025-12-04 12:25:19.485985 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2025-12-04 12:25:19.485993 | controller | Thursday 04 December 2025 12:25:18 +0000 (0:00:00.585) 0:05:27.617 ***** 2025-12-04 12:25:19.486003 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-04 12:25:19.522183 | controller | 2025-12-04 12:25:19.522211 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2025-12-04 12:25:19.522218 | controller | Thursday 04 December 2025 12:25:19 +0000 (0:00:00.861) 0:05:28.479 ***** 2025-12-04 12:25:19.522229 | controller | skipping: [instance] 2025-12-04 12:25:19.562032 | controller | 2025-12-04 12:25:19.562058 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2025-12-04 12:25:19.562066 | controller | Thursday 04 December 2025 12:25:19 +0000 (0:00:00.030) 0:05:28.510 ***** 2025-12-04 12:25:19.562076 | controller | skipping: [instance] 2025-12-04 12:25:19.838788 | controller | 2025-12-04 12:25:19.838814 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2025-12-04 12:25:19.838822 | controller | Thursday 04 December 2025 12:25:19 +0000 (0:00:00.045) 0:05:28.555 ***** 2025-12-04 12:25:19.838832 | controller | changed: [instance] 2025-12-04 12:25:19.921345 | controller | 2025-12-04 12:25:19.921362 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2025-12-04 12:25:19.921369 | controller | Thursday 04 December 2025 12:25:19 +0000 (0:00:00.276) 0:05:28.832 ***** 2025-12-04 12:25:19.921377 | controller | skipping: [instance] => (item=) 2025-12-04 12:25:19.954200 | controller | 2025-12-04 12:25:19.954218 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2025-12-04 12:25:19.954224 | controller | Thursday 04 December 2025 12:25:19 +0000 (0:00:00.082) 0:05:28.915 ***** 2025-12-04 12:25:19.954232 | controller | ok: [instance] 2025-12-04 12:25:20.024777 | controller | 2025-12-04 12:25:20.024795 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-04 12:25:20.024802 | controller | Thursday 04 December 2025 12:25:19 +0000 (0:00:00.033) 0:05:28.948 ***** 2025-12-04 12:25:20.024810 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-12-04 12:25:20.286318 | controller | 2025-12-04 12:25:20.286351 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-04 12:25:20.286358 | controller | Thursday 04 December 2025 12:25:20 +0000 (0:00:00.070) 0:05:29.018 ***** 2025-12-04 12:25:20.286369 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-12-04 12:25:20.343866 | controller | 2025-12-04 12:25:20.343883 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2025-12-04 12:25:20.343891 | controller | Thursday 04 December 2025 12:25:20 +0000 (0:00:00.261) 0:05:29.279 ***** 2025-12-04 12:25:20.343905 | controller | 2025-12-04 12:25:20.542373 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-04 12:25:20.542416 | controller | Thursday 04 December 2025 12:25:20 +0000 (0:00:00.057) 0:05:29.337 ***** 2025-12-04 12:25:20.542429 | controller | ok: [instance] 2025-12-04 12:25:20.604959 | controller | 2025-12-04 12:25:20.604987 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-04 12:25:20.604994 | controller | Thursday 04 December 2025 12:25:20 +0000 (0:00:00.197) 0:05:29.535 ***** 2025-12-04 12:25:20.605005 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-12-04 12:25:20.939894 | controller | 2025-12-04 12:25:20.939934 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-04 12:25:20.939942 | controller | Thursday 04 December 2025 12:25:20 +0000 (0:00:00.062) 0:05:29.598 ***** 2025-12-04 12:25:20.939955 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-12-04 12:25:21.413431 | controller | 2025-12-04 12:25:21.413472 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2025-12-04 12:25:21.413480 | controller | Thursday 04 December 2025 12:25:20 +0000 (0:00:00.334) 0:05:29.932 ***** 2025-12-04 12:25:21.413498 | controller | changed: [instance] 2025-12-04 12:25:22.218629 | controller | 2025-12-04 12:25:22.218678 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-12-04 12:25:22.218686 | controller | Thursday 04 December 2025 12:25:21 +0000 (0:00:00.459) 0:05:30.392 ***** 2025-12-04 12:25:22.218691 | controller | 2025-12-04 12:25:22.218696 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2025-12-04 12:25:22.218701 | controller | Thursday 04 December 2025 12:25:21 +0000 (0:00:00.013) 0:05:30.406 ***** 2025-12-04 12:25:22.218712 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:22.674606 | controller | 2025-12-04 12:25:22.674646 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-04 12:25:22.674654 | controller | Thursday 04 December 2025 12:25:22 +0000 (0:00:00.805) 0:05:31.211 ***** 2025-12-04 12:25:22.674666 | controller | changed: [instance] 2025-12-04 12:25:22.855025 | controller | 2025-12-04 12:25:22.855059 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2025-12-04 12:25:22.855067 | controller | Thursday 04 December 2025 12:25:22 +0000 (0:00:00.455) 0:05:31.667 ***** 2025-12-04 12:25:22.855079 | controller | skipping: [instance] => (item=controller-0) 2025-12-04 12:25:24.398533 | controller | skipping: [instance] => (item=crc-0) 2025-12-04 12:25:24.398814 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2025-12-04 12:25:24.398825 | controller | 2025-12-04 12:25:24.398831 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2025-12-04 12:25:24.398837 | controller | Thursday 04 December 2025 12:25:22 +0000 (0:00:00.180) 0:05:31.848 ***** 2025-12-04 12:25:24.398850 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-12-04 12:25:24.425743 | controller | 2025-12-04 12:25:24.425771 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-12-04 12:25:24.425779 | controller | Thursday 04 December 2025 12:25:24 +0000 (0:00:01.543) 0:05:33.391 ***** 2025-12-04 12:25:24.425789 | controller | skipping: [instance] 2025-12-04 12:25:24.975236 | controller | 2025-12-04 12:25:24.975303 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-04 12:25:24.975312 | controller | Thursday 04 December 2025 12:25:24 +0000 (0:00:00.027) 0:05:33.419 ***** 2025-12-04 12:25:24.975324 | controller | ok: [instance -> compute-0(compute-0.instance)] 2025-12-04 12:25:25.020152 | controller | 2025-12-04 12:25:25.020182 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-04 12:25:25.020190 | controller | Thursday 04 December 2025 12:25:24 +0000 (0:00:00.548) 0:05:33.968 ***** 2025-12-04 12:25:25.020200 | controller | skipping: [instance] 2025-12-04 12:25:25.063163 | controller | 2025-12-04 12:25:25.063199 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-04 12:25:25.063207 | controller | Thursday 04 December 2025 12:25:25 +0000 (0:00:00.045) 0:05:34.013 ***** 2025-12-04 12:25:25.063218 | controller | skipping: [instance] 2025-12-04 12:25:25.108825 | controller | 2025-12-04 12:25:25.108877 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-04 12:25:25.108889 | controller | Thursday 04 December 2025 12:25:25 +0000 (0:00:00.043) 0:05:34.056 ***** 2025-12-04 12:25:25.108906 | controller | skipping: [instance] 2025-12-04 12:25:25.158063 | controller | 2025-12-04 12:25:25.158100 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-04 12:25:25.158111 | controller | Thursday 04 December 2025 12:25:25 +0000 (0:00:00.045) 0:05:34.102 ***** 2025-12-04 12:25:25.158124 | controller | skipping: [instance] 2025-12-04 12:25:25.203888 | controller | 2025-12-04 12:25:25.203911 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2025-12-04 12:25:25.203926 | controller | Thursday 04 December 2025 12:25:25 +0000 (0:00:00.049) 0:05:34.151 ***** 2025-12-04 12:25:25.203936 | controller | skipping: [instance] 2025-12-04 12:25:25.203962 | controller | 2025-12-04 12:25:25.204142 | controller | TASK [reproducer : Create repositories on computes] **************************** 2025-12-04 12:25:25.230492 | controller | Thursday 04 December 2025 12:25:25 +0000 (0:00:00.046) 0:05:34.197 ***** 2025-12-04 12:25:25.230524 | controller | skipping: [instance] 2025-12-04 12:25:25.230708 | controller | 2025-12-04 12:25:25.230781 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2025-12-04 12:25:25.230789 | controller | Thursday 04 December 2025 12:25:25 +0000 (0:00:00.026) 0:05:34.224 ***** 2025-12-04 12:25:25.267452 | controller | skipping: [instance] 2025-12-04 12:25:25.267475 | controller | 2025-12-04 12:25:25.267486 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2025-12-04 12:25:25.267596 | controller | Thursday 04 December 2025 12:25:25 +0000 (0:00:00.036) 0:05:34.261 ***** 2025-12-04 12:25:25.327345 | controller | ok: [instance] 2025-12-04 12:25:25.327447 | controller | 2025-12-04 12:25:25.327458 | controller | TASK [reproducer : Push local code] ******************************************** 2025-12-04 12:25:25.327466 | controller | Thursday 04 December 2025 12:25:25 +0000 (0:00:00.060) 0:05:34.321 ***** 2025-12-04 12:25:25.431205 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2025-12-04 12:25:25.476388 | controller | 2025-12-04 12:25:25.476414 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2025-12-04 12:25:25.476431 | controller | Thursday 04 December 2025 12:25:25 +0000 (0:00:00.103) 0:05:34.424 ***** 2025-12-04 12:25:25.476443 | controller | skipping: [instance] 2025-12-04 12:25:25.476464 | controller | 2025-12-04 12:25:25.476567 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2025-12-04 12:25:25.476667 | controller | Thursday 04 December 2025 12:25:25 +0000 (0:00:00.045) 0:05:34.470 ***** 2025-12-04 12:25:25.524264 | controller | skipping: [instance] 2025-12-04 12:25:25.524403 | controller | 2025-12-04 12:25:25.524601 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2025-12-04 12:25:25.568230 | controller | Thursday 04 December 2025 12:25:25 +0000 (0:00:00.047) 0:05:34.518 ***** 2025-12-04 12:25:25.568274 | controller | skipping: [instance] 2025-12-04 12:25:25.568409 | controller | 2025-12-04 12:25:25.568419 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2025-12-04 12:25:25.568475 | controller | Thursday 04 December 2025 12:25:25 +0000 (0:00:00.044) 0:05:34.562 ***** 2025-12-04 12:25:25.612384 | controller | skipping: [instance] 2025-12-04 12:25:25.612407 | controller | 2025-12-04 12:25:25.612617 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2025-12-04 12:25:25.612641 | controller | Thursday 04 December 2025 12:25:25 +0000 (0:00:00.044) 0:05:34.606 ***** 2025-12-04 12:25:25.652284 | controller | skipping: [instance] 2025-12-04 12:25:25.652400 | controller | 2025-12-04 12:25:25.652531 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2025-12-04 12:25:25.652663 | controller | Thursday 04 December 2025 12:25:25 +0000 (0:00:00.039) 0:05:34.646 ***** 2025-12-04 12:25:26.235578 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2025-12-04 12:25:26.235639 | controller | 2025-12-04 12:25:26.235739 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2025-12-04 12:25:26.235865 | controller | Thursday 04 December 2025 12:25:26 +0000 (0:00:00.582) 0:05:35.228 ***** 2025-12-04 12:25:26.884207 | controller | ok: [instance -> localhost] => (item=ci-framework) 2025-12-04 12:25:26.884426 | controller | 2025-12-04 12:25:26.884492 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2025-12-04 12:25:26.884516 | controller | Thursday 04 December 2025 12:25:26 +0000 (0:00:00.648) 0:05:35.877 ***** 2025-12-04 12:25:26.937137 | controller | skipping: [instance] => (item=ci-framework) 2025-12-04 12:25:26.937167 | controller | skipping: [instance] 2025-12-04 12:25:26.937331 | controller | 2025-12-04 12:25:26.937433 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2025-12-04 12:25:26.937548 | controller | Thursday 04 December 2025 12:25:26 +0000 (0:00:00.052) 0:05:35.930 ***** 2025-12-04 12:25:27.024276 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2025-12-04 12:25:27.024406 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2025-12-04 12:25:27.024513 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2025-12-04 12:25:27.024612 | controller | 2025-12-04 12:25:27.024725 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2025-12-04 12:25:27.024814 | controller | Thursday 04 December 2025 12:25:27 +0000 (0:00:00.087) 0:05:36.018 ***** 2025-12-04 12:25:27.592164 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:27.592217 | controller | 2025-12-04 12:25:27.592388 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2025-12-04 12:25:27.592525 | controller | Thursday 04 December 2025 12:25:27 +0000 (0:00:00.567) 0:05:36.585 ***** 2025-12-04 12:25:27.639286 | controller | skipping: [instance] 2025-12-04 12:25:27.639407 | controller | 2025-12-04 12:25:27.639552 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2025-12-04 12:25:27.639656 | controller | Thursday 04 December 2025 12:25:27 +0000 (0:00:00.047) 0:05:36.633 ***** 2025-12-04 12:25:28.199690 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:28.199750 | controller | 2025-12-04 12:25:28.199904 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2025-12-04 12:25:28.200000 | controller | Thursday 04 December 2025 12:25:28 +0000 (0:00:00.559) 0:05:37.192 ***** 2025-12-04 12:25:28.253608 | controller | skipping: [instance] 2025-12-04 12:25:28.253745 | controller | 2025-12-04 12:25:28.253846 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2025-12-04 12:25:28.254000 | controller | Thursday 04 December 2025 12:25:28 +0000 (0:00:00.054) 0:05:37.247 ***** 2025-12-04 12:25:28.816213 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:28.816302 | controller | 2025-12-04 12:25:28.816459 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2025-12-04 12:25:28.816583 | controller | Thursday 04 December 2025 12:25:28 +0000 (0:00:00.562) 0:05:37.809 ***** 2025-12-04 12:25:31.164557 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:31.164610 | controller | 2025-12-04 12:25:31.164698 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2025-12-04 12:25:31.164781 | controller | Thursday 04 December 2025 12:25:31 +0000 (0:00:02.348) 0:05:40.158 ***** 2025-12-04 12:25:51.090858 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:52.277983 | controller | 2025-12-04 12:25:52.278457 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2025-12-04 12:25:52.278469 | controller | Thursday 04 December 2025 12:25:51 +0000 (0:00:19.923) 0:06:00.081 ***** 2025-12-04 12:25:52.278486 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:52.278762 | controller | 2025-12-04 12:25:52.278775 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2025-12-04 12:25:52.380508 | controller | Thursday 04 December 2025 12:25:52 +0000 (0:00:01.188) 0:06:01.270 ***** 2025-12-04 12:25:52.380531 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2025-12-04 12:25:52.932853 | controller | 2025-12-04 12:25:52.932896 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2025-12-04 12:25:52.932904 | controller | Thursday 04 December 2025 12:25:52 +0000 (0:00:00.103) 0:06:01.374 ***** 2025-12-04 12:25:52.932915 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:52.982887 | controller | 2025-12-04 12:25:52.982926 | controller | TASK [reproducer : Rotate log if present] ************************************** 2025-12-04 12:25:52.982934 | controller | Thursday 04 December 2025 12:25:52 +0000 (0:00:00.551) 0:06:01.925 ***** 2025-12-04 12:25:52.982951 | controller | skipping: [instance] 2025-12-04 12:25:53.038219 | controller | 2025-12-04 12:25:53.038264 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2025-12-04 12:25:53.038274 | controller | Thursday 04 December 2025 12:25:52 +0000 (0:00:00.050) 0:06:01.976 ***** 2025-12-04 12:25:53.038284 | controller | skipping: [instance] 2025-12-04 12:25:53.201131 | controller | 2025-12-04 12:25:53.201167 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2025-12-04 12:25:53.201175 | controller | Thursday 04 December 2025 12:25:53 +0000 (0:00:00.055) 0:06:02.031 ***** 2025-12-04 12:25:53.201185 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:53.800011 | controller | 2025-12-04 12:25:53.800046 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-04 12:25:53.800054 | controller | Thursday 04 December 2025 12:25:53 +0000 (0:00:00.161) 0:06:02.193 ***** 2025-12-04 12:25:53.800064 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:53.843282 | controller | 2025-12-04 12:25:53.843317 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-04 12:25:53.843325 | controller | Thursday 04 December 2025 12:25:53 +0000 (0:00:00.599) 0:06:02.792 ***** 2025-12-04 12:25:53.843335 | controller | skipping: [instance] 2025-12-04 12:25:53.882712 | controller | 2025-12-04 12:25:53.882737 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-04 12:25:53.882744 | controller | Thursday 04 December 2025 12:25:53 +0000 (0:00:00.043) 0:06:02.836 ***** 2025-12-04 12:25:53.882752 | controller | skipping: [instance] 2025-12-04 12:25:53.929957 | controller | 2025-12-04 12:25:53.929986 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-04 12:25:53.929994 | controller | Thursday 04 December 2025 12:25:53 +0000 (0:00:00.039) 0:06:02.876 ***** 2025-12-04 12:25:53.930006 | controller | skipping: [instance] 2025-12-04 12:25:53.981710 | controller | 2025-12-04 12:25:53.981757 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-04 12:25:53.981765 | controller | Thursday 04 December 2025 12:25:53 +0000 (0:00:00.047) 0:06:02.923 ***** 2025-12-04 12:25:53.981808 | controller | skipping: [instance] 2025-12-04 12:25:55.522239 | controller | 2025-12-04 12:25:55.522297 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-12-04 12:25:55.522306 | controller | Thursday 04 December 2025 12:25:53 +0000 (0:00:00.051) 0:06:02.975 ***** 2025-12-04 12:25:55.522317 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:25:56.620089 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:25:56.620150 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:25:56.620157 | controller | changed: [instance -> controller-0] 2025-12-04 12:25:56.620164 | controller | 2025-12-04 12:25:56.620182 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-12-04 12:25:56.620188 | controller | Thursday 04 December 2025 12:25:55 +0000 (0:00:01.538) 0:06:04.514 ***** 2025-12-04 12:25:56.620203 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:56.620225 | controller | 2025-12-04 12:25:56.620231 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-12-04 12:25:56.620238 | controller | Thursday 04 December 2025 12:25:56 +0000 (0:00:01.098) 0:06:05.612 ***** 2025-12-04 12:25:58.025399 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:25:58.025784 | controller | 2025-12-04 12:26:06.078044 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-12-04 12:26:06.078121 | controller | Thursday 04 December 2025 12:25:58 +0000 (0:00:01.405) 0:06:07.018 ***** 2025-12-04 12:26:06.078142 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:06.078270 | controller | 2025-12-04 12:26:06.078285 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-12-04 12:26:06.078295 | controller | Thursday 04 December 2025 12:26:06 +0000 (0:00:08.053) 0:06:15.071 ***** 2025-12-04 12:26:07.172595 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:07.172655 | controller | 2025-12-04 12:26:07.172730 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-12-04 12:26:07.172845 | controller | Thursday 04 December 2025 12:26:07 +0000 (0:00:01.094) 0:06:16.166 ***** 2025-12-04 12:26:07.220520 | controller | skipping: [instance] 2025-12-04 12:26:07.220596 | controller | 2025-12-04 12:26:07.220709 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-12-04 12:26:07.220806 | controller | Thursday 04 December 2025 12:26:07 +0000 (0:00:00.048) 0:06:16.214 ***** 2025-12-04 12:26:08.511440 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:08.511692 | controller | 2025-12-04 12:26:08.582363 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-12-04 12:26:08.582444 | controller | Thursday 04 December 2025 12:26:08 +0000 (0:00:01.290) 0:06:17.504 ***** 2025-12-04 12:26:08.582460 | controller | skipping: [instance] 2025-12-04 12:26:08.582601 | controller | 2025-12-04 12:26:08.582616 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-12-04 12:26:08.655150 | controller | Thursday 04 December 2025 12:26:08 +0000 (0:00:00.070) 0:06:17.575 ***** 2025-12-04 12:26:08.655181 | controller | skipping: [instance] 2025-12-04 12:26:08.655189 | controller | 2025-12-04 12:26:08.655198 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-12-04 12:26:08.655260 | controller | Thursday 04 December 2025 12:26:08 +0000 (0:00:00.073) 0:06:17.648 ***** 2025-12-04 12:26:08.727064 | controller | skipping: [instance] 2025-12-04 12:26:08.727163 | controller | 2025-12-04 12:26:08.727299 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-12-04 12:26:08.727410 | controller | Thursday 04 December 2025 12:26:08 +0000 (0:00:00.071) 0:06:17.720 ***** 2025-12-04 12:26:09.676170 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:09.676350 | controller | 2025-12-04 12:26:09.676670 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-12-04 12:26:10.684655 | controller | Thursday 04 December 2025 12:26:09 +0000 (0:00:00.948) 0:06:18.669 ***** 2025-12-04 12:26:10.684720 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:10.740379 | controller | 2025-12-04 12:26:10.740479 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-12-04 12:26:10.740491 | controller | Thursday 04 December 2025 12:26:10 +0000 (0:00:01.007) 0:06:19.677 ***** 2025-12-04 12:26:10.740509 | controller | skipping: [instance] 2025-12-04 12:26:10.792320 | controller | 2025-12-04 12:26:10.792378 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-12-04 12:26:10.792388 | controller | Thursday 04 December 2025 12:26:10 +0000 (0:00:00.056) 0:06:19.733 ***** 2025-12-04 12:26:10.792401 | controller | skipping: [instance] 2025-12-04 12:26:10.837507 | controller | 2025-12-04 12:26:10.837617 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-12-04 12:26:10.837627 | controller | Thursday 04 December 2025 12:26:10 +0000 (0:00:00.051) 0:06:19.784 ***** 2025-12-04 12:26:10.837645 | controller | skipping: [instance] 2025-12-04 12:26:10.903765 | controller | 2025-12-04 12:26:10.903810 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-12-04 12:26:10.903831 | controller | Thursday 04 December 2025 12:26:10 +0000 (0:00:00.045) 0:06:19.830 ***** 2025-12-04 12:26:10.903845 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:10.950205 | controller | 2025-12-04 12:26:10.950276 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-12-04 12:26:10.950287 | controller | Thursday 04 December 2025 12:26:10 +0000 (0:00:00.066) 0:06:19.897 ***** 2025-12-04 12:26:10.950299 | controller | skipping: [instance] 2025-12-04 12:26:10.950322 | controller | 2025-12-04 12:26:10.950446 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-12-04 12:26:10.950481 | controller | Thursday 04 December 2025 12:26:10 +0000 (0:00:00.046) 0:06:19.943 ***** 2025-12-04 12:26:11.003395 | controller | skipping: [instance] 2025-12-04 12:26:11.003484 | controller | 2025-12-04 12:26:11.003495 | controller | TASK [Download the RPM] ******************************************************** 2025-12-04 12:26:11.003505 | controller | Thursday 04 December 2025 12:26:11 +0000 (0:00:00.052) 0:06:19.996 ***** 2025-12-04 12:26:11.049806 | controller | skipping: [instance] 2025-12-04 12:26:11.049859 | controller | 2025-12-04 12:26:11.050008 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-12-04 12:26:11.050052 | controller | Thursday 04 December 2025 12:26:11 +0000 (0:00:00.046) 0:06:20.043 ***** 2025-12-04 12:26:11.097202 | controller | skipping: [instance] 2025-12-04 12:26:11.097285 | controller | 2025-12-04 12:26:11.097405 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-12-04 12:26:11.097516 | controller | Thursday 04 December 2025 12:26:11 +0000 (0:00:00.047) 0:06:20.091 ***** 2025-12-04 12:26:11.140596 | controller | skipping: [instance] 2025-12-04 12:26:11.140671 | controller | 2025-12-04 12:26:11.140776 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-12-04 12:26:11.140898 | controller | Thursday 04 December 2025 12:26:11 +0000 (0:00:00.043) 0:06:20.134 ***** 2025-12-04 12:26:11.191652 | controller | skipping: [instance] 2025-12-04 12:26:11.191730 | controller | 2025-12-04 12:26:11.191857 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-12-04 12:26:11.191943 | controller | Thursday 04 December 2025 12:26:11 +0000 (0:00:00.050) 0:06:20.185 ***** 2025-12-04 12:26:11.240419 | controller | skipping: [instance] 2025-12-04 12:26:11.240576 | controller | 2025-12-04 12:26:11.240706 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-12-04 12:26:11.240852 | controller | Thursday 04 December 2025 12:26:11 +0000 (0:00:00.048) 0:06:20.234 ***** 2025-12-04 12:26:11.799035 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:11.865587 | controller | 2025-12-04 12:26:11.865642 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-12-04 12:26:11.865652 | controller | Thursday 04 December 2025 12:26:11 +0000 (0:00:00.557) 0:06:20.791 ***** 2025-12-04 12:26:11.865665 | controller | skipping: [instance] 2025-12-04 12:26:11.865687 | controller | 2025-12-04 12:26:11.865737 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-12-04 12:26:11.865833 | controller | Thursday 04 December 2025 12:26:11 +0000 (0:00:00.067) 0:06:20.859 ***** 2025-12-04 12:26:11.935996 | controller | skipping: [instance] 2025-12-04 12:26:11.936053 | controller | 2025-12-04 12:26:11.936156 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-12-04 12:26:11.936288 | controller | Thursday 04 December 2025 12:26:11 +0000 (0:00:00.070) 0:06:20.929 ***** 2025-12-04 12:26:11.986047 | controller | skipping: [instance] 2025-12-04 12:26:11.986144 | controller | 2025-12-04 12:26:11.986289 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-12-04 12:26:11.986400 | controller | Thursday 04 December 2025 12:26:11 +0000 (0:00:00.050) 0:06:20.979 ***** 2025-12-04 12:26:12.047974 | controller | skipping: [instance] 2025-12-04 12:26:12.048086 | controller | 2025-12-04 12:26:12.048232 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-12-04 12:26:12.048412 | controller | Thursday 04 December 2025 12:26:12 +0000 (0:00:00.061) 0:06:21.041 ***** 2025-12-04 12:26:12.107244 | controller | skipping: [instance] 2025-12-04 12:26:12.107352 | controller | 2025-12-04 12:26:12.107459 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-12-04 12:26:12.107571 | controller | Thursday 04 December 2025 12:26:12 +0000 (0:00:00.059) 0:06:21.101 ***** 2025-12-04 12:26:12.173414 | controller | skipping: [instance] 2025-12-04 12:26:12.173566 | controller | 2025-12-04 12:26:12.173750 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-12-04 12:26:12.174012 | controller | Thursday 04 December 2025 12:26:12 +0000 (0:00:00.065) 0:06:21.167 ***** 2025-12-04 12:26:12.237442 | controller | skipping: [instance] 2025-12-04 12:26:12.237543 | controller | 2025-12-04 12:26:12.237653 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-12-04 12:26:12.237837 | controller | Thursday 04 December 2025 12:26:12 +0000 (0:00:00.063) 0:06:21.231 ***** 2025-12-04 12:26:12.299531 | controller | skipping: [instance] 2025-12-04 12:26:12.299623 | controller | 2025-12-04 12:26:12.299753 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-12-04 12:26:12.299899 | controller | Thursday 04 December 2025 12:26:12 +0000 (0:00:00.061) 0:06:21.293 ***** 2025-12-04 12:26:13.001531 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:13.001589 | controller | 2025-12-04 12:26:13.001653 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-12-04 12:26:13.001747 | controller | Thursday 04 December 2025 12:26:12 +0000 (0:00:00.701) 0:06:21.994 ***** 2025-12-04 12:26:14.181679 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:26:14.181738 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:26:14.181798 | controller | changed: [instance -> controller-0] 2025-12-04 12:26:14.181887 | controller | 2025-12-04 12:26:14.181995 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-12-04 12:26:14.182089 | controller | Thursday 04 December 2025 12:26:14 +0000 (0:00:01.180) 0:06:23.175 ***** 2025-12-04 12:26:14.974845 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:14.974932 | controller | 2025-12-04 12:26:14.975030 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-12-04 12:26:14.975135 | controller | Thursday 04 December 2025 12:26:14 +0000 (0:00:00.792) 0:06:23.967 ***** 2025-12-04 12:26:15.588889 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:15.588954 | controller | 2025-12-04 12:26:15.589026 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-12-04 12:26:15.589123 | controller | Thursday 04 December 2025 12:26:15 +0000 (0:00:00.614) 0:06:24.582 ***** 2025-12-04 12:26:15.653275 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:26:15.653418 | controller | ok: [instance -> controller-0] 2025-12-04 12:26:15.653542 | controller | 2025-12-04 12:26:15.653700 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-12-04 12:26:15.653806 | controller | Thursday 04 December 2025 12:26:15 +0000 (0:00:00.064) 0:06:24.647 ***** 2025-12-04 12:26:15.711505 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:15.711581 | controller | 2025-12-04 12:26:15.711674 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-12-04 12:26:15.711771 | controller | Thursday 04 December 2025 12:26:15 +0000 (0:00:00.058) 0:06:24.705 ***** 2025-12-04 12:26:45.784475 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:45.784624 | controller | 2025-12-04 12:26:45.784750 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-12-04 12:26:45.784786 | controller | Thursday 04 December 2025 12:26:45 +0000 (0:00:30.072) 0:06:54.778 ***** 2025-12-04 12:26:46.281049 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:46.281198 | controller | 2025-12-04 12:26:46.281416 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-12-04 12:26:46.281440 | controller | Thursday 04 December 2025 12:26:46 +0000 (0:00:00.496) 0:06:55.274 ***** 2025-12-04 12:26:46.783878 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:46.783917 | controller | 2025-12-04 12:26:46.784014 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-12-04 12:26:46.784118 | controller | Thursday 04 December 2025 12:26:46 +0000 (0:00:00.502) 0:06:55.777 ***** 2025-12-04 12:26:52.990997 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:52.991079 | controller | 2025-12-04 12:26:52.991118 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-12-04 12:26:52.991262 | controller | Thursday 04 December 2025 12:26:52 +0000 (0:00:06.207) 0:07:01.984 ***** 2025-12-04 12:26:53.044261 | controller | skipping: [instance] 2025-12-04 12:26:53.044346 | controller | 2025-12-04 12:26:53.044457 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-12-04 12:26:53.044565 | controller | Thursday 04 December 2025 12:26:53 +0000 (0:00:00.053) 0:07:02.038 ***** 2025-12-04 12:26:53.740585 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:53.740653 | controller | 2025-12-04 12:26:53.740729 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-12-04 12:26:53.740822 | controller | Thursday 04 December 2025 12:26:53 +0000 (0:00:00.695) 0:07:02.734 ***** 2025-12-04 12:26:54.295524 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:54.295636 | controller | 2025-12-04 12:26:54.295668 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-12-04 12:26:54.295678 | controller | Thursday 04 December 2025 12:26:54 +0000 (0:00:00.554) 0:07:03.288 ***** 2025-12-04 12:26:54.343009 | controller | skipping: [instance] 2025-12-04 12:26:54.343147 | controller | 2025-12-04 12:26:54.343195 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-12-04 12:26:54.343210 | controller | Thursday 04 December 2025 12:26:54 +0000 (0:00:00.047) 0:07:03.336 ***** 2025-12-04 12:26:54.388163 | controller | skipping: [instance] 2025-12-04 12:26:54.435099 | controller | 2025-12-04 12:26:54.435148 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-12-04 12:26:54.435157 | controller | Thursday 04 December 2025 12:26:54 +0000 (0:00:00.044) 0:07:03.381 ***** 2025-12-04 12:26:54.435169 | controller | skipping: [instance] 2025-12-04 12:26:54.479062 | controller | 2025-12-04 12:26:54.479123 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-12-04 12:26:54.479140 | controller | Thursday 04 December 2025 12:26:54 +0000 (0:00:00.046) 0:07:03.428 ***** 2025-12-04 12:26:54.479155 | controller | skipping: [instance] 2025-12-04 12:26:54.479206 | controller | 2025-12-04 12:26:54.479214 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-12-04 12:26:54.527717 | controller | Thursday 04 December 2025 12:26:54 +0000 (0:00:00.044) 0:07:03.472 ***** 2025-12-04 12:26:54.527763 | controller | skipping: [instance] 2025-12-04 12:26:54.577825 | controller | 2025-12-04 12:26:54.577851 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-12-04 12:26:54.577858 | controller | Thursday 04 December 2025 12:26:54 +0000 (0:00:00.048) 0:07:03.521 ***** 2025-12-04 12:26:54.577868 | controller | skipping: [instance] 2025-12-04 12:26:57.479184 | controller | 2025-12-04 12:26:57.479231 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-12-04 12:26:57.479240 | controller | Thursday 04 December 2025 12:26:54 +0000 (0:00:00.049) 0:07:03.570 ***** 2025-12-04 12:26:57.479271 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:26:57.479303 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:26:57.479310 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:26:57.479316 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:26:57.479322 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:26:57.479408 | controller | changed: [instance -> controller-0] 2025-12-04 12:26:57.479422 | controller | 2025-12-04 12:26:57.479513 | controller | TASK [Prepare install_yamls make targets] ************************************** 2025-12-04 12:26:57.479597 | controller | Thursday 04 December 2025 12:26:57 +0000 (0:00:02.901) 0:07:06.472 ***** 2025-12-04 12:26:57.702906 | controller | 2025-12-04 12:26:57.702963 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2025-12-04 12:26:57.703056 | controller | Thursday 04 December 2025 12:26:57 +0000 (0:00:00.224) 0:07:06.696 ***** 2025-12-04 12:26:59.346164 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:26:59.346230 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:26:59.346343 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:26:59.346446 | controller | changed: [instance -> controller-0] 2025-12-04 12:26:59.346552 | controller | 2025-12-04 12:26:59.346653 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2025-12-04 12:26:59.346743 | controller | Thursday 04 December 2025 12:26:59 +0000 (0:00:01.643) 0:07:08.339 ***** 2025-12-04 12:26:59.412828 | controller | 2025-12-04 12:26:59.412910 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2025-12-04 12:26:59.413021 | controller | Thursday 04 December 2025 12:26:59 +0000 (0:00:00.066) 0:07:08.406 ***** 2025-12-04 12:26:59.465848 | controller | skipping: [instance] 2025-12-04 12:26:59.466054 | controller | 2025-12-04 12:26:59.466239 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2025-12-04 12:26:59.466288 | controller | Thursday 04 December 2025 12:26:59 +0000 (0:00:00.053) 0:07:08.459 ***** 2025-12-04 12:26:59.515106 | controller | skipping: [instance] 2025-12-04 12:26:59.515184 | controller | 2025-12-04 12:26:59.515301 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2025-12-04 12:26:59.515397 | controller | Thursday 04 December 2025 12:26:59 +0000 (0:00:00.049) 0:07:08.508 ***** 2025-12-04 12:26:59.587374 | controller | 2025-12-04 12:26:59.587481 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-04 12:26:59.587587 | controller | Thursday 04 December 2025 12:26:59 +0000 (0:00:00.072) 0:07:08.581 ***** 2025-12-04 12:26:59.631590 | controller | skipping: [instance] 2025-12-04 12:26:59.631677 | controller | 2025-12-04 12:26:59.631777 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-04 12:26:59.631863 | controller | Thursday 04 December 2025 12:26:59 +0000 (0:00:00.044) 0:07:08.625 ***** 2025-12-04 12:26:59.672425 | controller | skipping: [instance] 2025-12-04 12:26:59.672518 | controller | 2025-12-04 12:26:59.672622 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-04 12:26:59.672715 | controller | Thursday 04 December 2025 12:26:59 +0000 (0:00:00.040) 0:07:08.666 ***** 2025-12-04 12:26:59.712261 | controller | skipping: [instance] 2025-12-04 12:26:59.712345 | controller | 2025-12-04 12:26:59.712447 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-04 12:26:59.712566 | controller | Thursday 04 December 2025 12:26:59 +0000 (0:00:00.039) 0:07:08.706 ***** 2025-12-04 12:26:59.760781 | controller | skipping: [instance] 2025-12-04 12:26:59.760859 | controller | 2025-12-04 12:26:59.760976 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2025-12-04 12:26:59.761064 | controller | Thursday 04 December 2025 12:26:59 +0000 (0:00:00.048) 0:07:08.754 ***** 2025-12-04 12:26:59.865225 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 12:26:59.865380 | controller | ok: [instance -> controller-0] 2025-12-04 12:26:59.865515 | controller | 2025-12-04 12:26:59.865652 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2025-12-04 12:26:59.865777 | controller | Thursday 04 December 2025 12:26:59 +0000 (0:00:00.104) 0:07:08.859 ***** 2025-12-04 12:26:59.940898 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:26:59.940995 | controller | 2025-12-04 12:26:59.941093 | controller | TASK [install_yamls : Get environment structure] ******************************* 2025-12-04 12:26:59.941197 | controller | Thursday 04 December 2025 12:26:59 +0000 (0:00:00.075) 0:07:08.934 ***** 2025-12-04 12:27:01.020670 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:01.020944 | controller | 2025-12-04 12:27:01.064989 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2025-12-04 12:27:01.065007 | controller | Thursday 04 December 2025 12:27:01 +0000 (0:00:01.079) 0:07:10.014 ***** 2025-12-04 12:27:01.065018 | controller | skipping: [instance] 2025-12-04 12:27:01.125485 | controller | 2025-12-04 12:27:01.125545 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2025-12-04 12:27:01.125565 | controller | Thursday 04 December 2025 12:27:01 +0000 (0:00:00.043) 0:07:10.058 ***** 2025-12-04 12:27:01.125588 | controller | skipping: [instance] 2025-12-04 12:27:01.180810 | controller | 2025-12-04 12:27:01.180846 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2025-12-04 12:27:01.180856 | controller | Thursday 04 December 2025 12:27:01 +0000 (0:00:00.060) 0:07:10.119 ***** 2025-12-04 12:27:01.180868 | controller | skipping: [instance] 2025-12-04 12:27:01.251200 | controller | 2025-12-04 12:27:01.251266 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2025-12-04 12:27:01.251279 | controller | Thursday 04 December 2025 12:27:01 +0000 (0:00:00.054) 0:07:10.173 ***** 2025-12-04 12:27:01.251291 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:01.251321 | controller | 2025-12-04 12:27:01.251329 | controller | TASK [install_yamls : Show the env structure] ********************************** 2025-12-04 12:27:01.251499 | controller | Thursday 04 December 2025 12:27:01 +0000 (0:00:00.071) 0:07:10.244 ***** 2025-12-04 12:27:01.304539 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:01.369938 | controller | 2025-12-04 12:27:01.370007 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2025-12-04 12:27:01.370017 | controller | Thursday 04 December 2025 12:27:01 +0000 (0:00:00.052) 0:07:10.297 ***** 2025-12-04 12:27:01.370036 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:01.370060 | controller | 2025-12-04 12:27:01.370070 | controller | TASK [install_yamls : Generate make targets] *********************************** 2025-12-04 12:27:01.370169 | controller | Thursday 04 December 2025 12:27:01 +0000 (0:00:00.065) 0:07:10.363 ***** 2025-12-04 12:27:02.078950 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:02.079062 | controller | 2025-12-04 12:27:02.079138 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2025-12-04 12:27:02.079236 | controller | Thursday 04 December 2025 12:27:02 +0000 (0:00:00.708) 0:07:11.072 ***** 2025-12-04 12:27:02.129639 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:02.129678 | controller | 2025-12-04 12:27:02.129809 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2025-12-04 12:27:02.129921 | controller | Thursday 04 December 2025 12:27:02 +0000 (0:00:00.051) 0:07:11.123 ***** 2025-12-04 12:27:03.144607 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:03.144666 | controller | 2025-12-04 12:27:03.144768 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2025-12-04 12:27:03.144865 | controller | Thursday 04 December 2025 12:27:03 +0000 (0:00:01.014) 0:07:12.137 ***** 2025-12-04 12:27:03.201526 | controller | skipping: [instance] 2025-12-04 12:27:03.201593 | controller | 2025-12-04 12:27:03.201700 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-12-04 12:27:03.201791 | controller | Thursday 04 December 2025 12:27:03 +0000 (0:00:00.057) 0:07:12.195 ***** 2025-12-04 12:27:04.148390 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:04.148502 | controller | 2025-12-04 12:27:04.148514 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-12-04 12:27:04.148658 | controller | Thursday 04 December 2025 12:27:04 +0000 (0:00:00.946) 0:07:13.141 ***** 2025-12-04 12:27:04.210369 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:04.210465 | controller | 2025-12-04 12:27:04.210567 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2025-12-04 12:27:04.210660 | controller | Thursday 04 December 2025 12:27:04 +0000 (0:00:00.062) 0:07:13.204 ***** 2025-12-04 12:27:05.241721 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:05.241782 | controller | 2025-12-04 12:27:05.241843 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2025-12-04 12:27:05.241958 | controller | Thursday 04 December 2025 12:27:05 +0000 (0:00:01.031) 0:07:14.235 ***** 2025-12-04 12:27:05.792349 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:05.792411 | controller | 2025-12-04 12:27:05.792475 | controller | TASK [Configure CRC network if needed] ***************************************** 2025-12-04 12:27:05.792575 | controller | Thursday 04 December 2025 12:27:05 +0000 (0:00:00.550) 0:07:14.785 ***** 2025-12-04 12:27:05.947728 | controller | 2025-12-04 12:27:05.947866 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2025-12-04 12:27:05.948026 | controller | Thursday 04 December 2025 12:27:05 +0000 (0:00:00.155) 0:07:14.941 ***** 2025-12-04 12:27:07.223591 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:07.223647 | controller | 2025-12-04 12:27:07.223743 | controller | TASK [openshift_setup : Patch network operator] ******************************** 2025-12-04 12:27:07.223854 | controller | Thursday 04 December 2025 12:27:07 +0000 (0:00:01.275) 0:07:16.217 ***** 2025-12-04 12:27:08.452953 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:08.492202 | controller | 2025-12-04 12:27:08.492233 | controller | TASK [Ensure OCP cluster is stable] ******************************************** 2025-12-04 12:27:08.492241 | controller | Thursday 04 December 2025 12:27:08 +0000 (0:00:01.228) 0:07:17.446 ***** 2025-12-04 12:27:08.492273 | controller | skipping: [instance] 2025-12-04 12:27:08.535416 | controller | 2025-12-04 12:27:08.535445 | controller | TASK [reproducer : Emulate CI job] ********************************************* 2025-12-04 12:27:08.535466 | controller | Thursday 04 December 2025 12:27:08 +0000 (0:00:00.039) 0:07:17.485 ***** 2025-12-04 12:27:08.535477 | controller | skipping: [instance] 2025-12-04 12:27:08.576567 | controller | 2025-12-04 12:27:08.576591 | controller | TASK [reproducer : Prepare architecture-based deployment] ********************** 2025-12-04 12:27:08.576599 | controller | Thursday 04 December 2025 12:27:08 +0000 (0:00:00.040) 0:07:17.526 ***** 2025-12-04 12:27:08.576608 | controller | skipping: [instance] 2025-12-04 12:27:08.620025 | controller | 2025-12-04 12:27:08.620049 | controller | TASK [reproducer : Prepare architecture-based post deployment] ***************** 2025-12-04 12:27:08.620058 | controller | Thursday 04 December 2025 12:27:08 +0000 (0:00:00.042) 0:07:17.568 ***** 2025-12-04 12:27:08.620067 | controller | skipping: [instance] 2025-12-04 12:27:09.578194 | controller | 2025-12-04 12:27:09.578234 | controller | TASK [reproducer : Prepare ci-like EDPM deploy] ******************************** 2025-12-04 12:27:09.578241 | controller | Thursday 04 December 2025 12:27:08 +0000 (0:00:00.040) 0:07:17.609 ***** 2025-12-04 12:27:09.578272 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:10.031857 | controller | 2025-12-04 12:27:10.031889 | controller | TASK [Ensure we have appropriate credentials for OpenShift accesses] *********** 2025-12-04 12:27:10.031897 | controller | Thursday 04 December 2025 12:27:09 +0000 (0:00:00.961) 0:07:18.571 ***** 2025-12-04 12:27:10.031905 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:10.554325 | controller | 2025-12-04 12:27:10.554357 | controller | TASK [Ensure we have needed inventory files] *********************************** 2025-12-04 12:27:10.554364 | controller | Thursday 04 December 2025 12:27:10 +0000 (0:00:00.454) 0:07:19.025 ***** 2025-12-04 12:27:10.554374 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:11.033937 | controller | 2025-12-04 12:27:11.033979 | controller | TASK [Ensure we have CRC ssh key] ********************************************** 2025-12-04 12:27:11.033987 | controller | Thursday 04 December 2025 12:27:10 +0000 (0:00:00.521) 0:07:19.546 ***** 2025-12-04 12:27:11.033996 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:11.500145 | controller | 2025-12-04 12:27:11.500188 | controller | TASK [Ensure we have the MAC mapping file] ************************************* 2025-12-04 12:27:11.500196 | controller | Thursday 04 December 2025 12:27:11 +0000 (0:00:00.480) 0:07:20.027 ***** 2025-12-04 12:27:11.500205 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:11.500369 | controller | 2025-12-04 12:27:11.500385 | controller | TASK [Load crc inventory] ****************************************************** 2025-12-04 12:27:11.500525 | controller | Thursday 04 December 2025 12:27:11 +0000 (0:00:00.462) 0:07:20.490 ***** 2025-12-04 12:27:11.961465 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:12.464934 | controller | 2025-12-04 12:27:12.464972 | controller | TASK [Load compute inventory] ************************************************** 2025-12-04 12:27:12.464980 | controller | Thursday 04 December 2025 12:27:11 +0000 (0:00:00.464) 0:07:20.954 ***** 2025-12-04 12:27:12.464990 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:13.092878 | controller | 2025-12-04 12:27:13.092914 | controller | TASK [Ensure we can ping compute-0 on osp_trunk net] *************************** 2025-12-04 12:27:13.092927 | controller | Thursday 04 December 2025 12:27:12 +0000 (0:00:00.502) 0:07:21.457 ***** 2025-12-04 12:27:13.092937 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:13.654075 | controller | 2025-12-04 12:27:13.654116 | controller | TASK [Ensure we can ping crc-0 on osp_trunk net] ******************************* 2025-12-04 12:27:13.654124 | controller | Thursday 04 December 2025 12:27:13 +0000 (0:00:00.628) 0:07:22.085 ***** 2025-12-04 12:27:13.654138 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:14.192842 | controller | 2025-12-04 12:27:14.192880 | controller | TASK [Check default location secret file] ************************************** 2025-12-04 12:27:14.192888 | controller | Thursday 04 December 2025 12:27:13 +0000 (0:00:00.558) 0:07:22.644 ***** 2025-12-04 12:27:14.192909 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:14.193122 | controller | 2025-12-04 12:27:14.193136 | controller | TASK [Check non-default location secret] *************************************** 2025-12-04 12:27:14.833226 | controller | Thursday 04 December 2025 12:27:14 +0000 (0:00:00.540) 0:07:23.185 ***** 2025-12-04 12:27:14.833299 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 12:27:14.880982 | controller | 2025-12-04 12:27:14.881002 | controller | TASK [Assert all of the tests] ************************************************* 2025-12-04 12:27:14.881009 | controller | Thursday 04 December 2025 12:27:14 +0000 (0:00:00.639) 0:07:23.824 ***** 2025-12-04 12:27:14.881025 | controller | ok: [instance] 2025-12-04 12:27:15.198298 | controller | 2025-12-04 12:27:15.198359 | controller | TASK [Create dnsmasq dir] ****************************************************** 2025-12-04 12:27:15.198372 | controller | Thursday 04 December 2025 12:27:14 +0000 (0:00:00.049) 0:07:23.874 ***** 2025-12-04 12:27:15.198384 | controller | changed: [instance] 2025-12-04 12:27:15.563534 | controller | 2025-12-04 12:27:15.563612 | controller | TASK [Get journalctl in a file] ************************************************ 2025-12-04 12:27:15.563625 | controller | Thursday 04 December 2025 12:27:15 +0000 (0:00:00.316) 0:07:24.191 ***** 2025-12-04 12:27:15.563636 | controller | changed: [instance] 2025-12-04 12:27:16.119062 | controller | 2025-12-04 12:27:16.119112 | controller | TASK [Dump journalctl output] ************************************************** 2025-12-04 12:27:16.119121 | controller | Thursday 04 December 2025 12:27:15 +0000 (0:00:00.360) 0:07:24.551 ***** 2025-12-04 12:27:16.119130 | controller | changed: [instance] 2025-12-04 12:27:16.867065 | controller | 2025-12-04 12:27:16.867110 | controller | TASK [Copy all dnsmasq config] ************************************************* 2025-12-04 12:27:16.867119 | controller | Thursday 04 December 2025 12:27:16 +0000 (0:00:00.559) 0:07:25.111 ***** 2025-12-04 12:27:16.867129 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-12-04 12:27:17.150217 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2025-12-04 12:27:17.150279 | controller | 2025-12-04 12:27:17.150287 | controller | TASK [Create log directory] **************************************************** 2025-12-04 12:27:17.150299 | controller | Thursday 04 December 2025 12:27:16 +0000 (0:00:00.748) 0:07:25.859 ***** 2025-12-04 12:27:17.150308 | controller | changed: [instance] 2025-12-04 12:27:18.279761 | controller | 2025-12-04 12:27:18.279799 | controller | TASK [Sync logs from controller-0] ********************************************* 2025-12-04 12:27:18.279807 | controller | Thursday 04 December 2025 12:27:17 +0000 (0:00:00.284) 0:07:26.143 ***** 2025-12-04 12:27:18.279821 | controller | changed: [instance] 2025-12-04 12:27:18.439900 | controller | 2025-12-04 12:27:18.439937 | controller | PLAY RECAP ********************************************************************* 2025-12-04 12:27:18.439945 | controller | instance : ok=537 changed=200 unreachable=0 failed=0 skipped=229 rescued=0 ignored=0 2025-12-04 12:27:18.439970 | controller | 2025-12-04 12:27:18.439975 | controller | Thursday 04 December 2025 12:27:18 +0000 (0:00:01.125) 0:07:27.269 ***** 2025-12-04 12:27:18.439981 | controller | =============================================================================== 2025-12-04 12:27:18.439986 | controller | reproducer : Check package install status ------------------------------ 73.12s 2025-12-04 12:27:18.439991 | controller | ci_setup : Install needed packages ------------------------------------- 30.07s 2025-12-04 12:27:18.439996 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 23.06s 2025-12-04 12:27:18.440002 | controller | libvirt_manager : Download base image ---------------------------------- 20.30s 2025-12-04 12:27:18.440007 | controller | reproducer : Install collections on controller-0 ----------------------- 19.92s 2025-12-04 12:27:18.440012 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 11.31s 2025-12-04 12:27:18.440017 | controller | libvirt_manager : Install packages required for using KVM --------------- 8.47s 2025-12-04 12:27:18.440022 | controller | repo_setup : Initialize python venv and install requirements ------------ 8.05s 2025-12-04 12:27:18.440028 | controller | ci_setup : Install openshift client ------------------------------------- 6.21s 2025-12-04 12:27:18.440033 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.12s 2025-12-04 12:27:18.440038 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 5.52s 2025-12-04 12:27:18.440043 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.01s 2025-12-04 12:27:18.440054 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.69s 2025-12-04 12:27:18.440060 | controller | networking_mapper : Gather the facts ------------------------------------ 3.42s 2025-12-04 12:27:18.440065 | controller | sushy_emulator : Install required packages ------------------------------ 3.28s 2025-12-04 12:27:18.440070 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.21s 2025-12-04 12:27:18.440075 | controller | ci_setup : Manage directories ------------------------------------------- 2.90s 2025-12-04 12:27:18.440080 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.35s 2025-12-04 12:27:18.440091 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.27s 2025-12-04 12:27:18.440098 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s 2025-12-04 12:27:18.440108 | controller | INFO Running crc_layout > cleanup 2025-12-04 12:27:18.440648 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-04 12:27:18.448953 | controller | INFO Running job_uri > prepare 2025-12-04 12:27:18.449417 | controller | WARNING Skipping, prepare playbook not configured. 2025-12-04 12:27:18.475678 | controller | INFO Running job_uri > converge 2025-12-04 12:27:19.053769 | controller | 2025-12-04 12:27:19.054025 | controller | PLAY [Prepare] ***************************************************************** 2025-12-04 12:27:19.054204 | controller | 2025-12-04 12:27:19.054407 | controller | TASK [Call task file in loop] ************************************************** 2025-12-04 12:27:19.054599 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.035) 0:00:00.035 ***** 2025-12-04 12:27:19.147130 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////'}) 2025-12-04 12:27:19.147365 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2025-12-04 12:27:19.147550 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2025-12-04 12:27:19.147755 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35'}) 2025-12-04 12:27:19.147940 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2025-12-04 12:27:19.148129 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2025-12-04 12:27:19.148330 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log'}) 2025-12-04 12:27:19.148519 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/'}) 2025-12-04 12:27:19.148700 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4'}) 2025-12-04 12:27:19.148896 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': '/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a'}) 2025-12-04 12:27:19.149049 | controller | 2025-12-04 12:27:19.149209 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////] *** 2025-12-04 12:27:19.149393 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.094) 0:00:00.130 ***** 2025-12-04 12:27:19.200443 | controller | 2025-12-04 12:27:19.200668 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:27:19.200859 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.053) 0:00:00.183 ***** 2025-12-04 12:27:19.243390 | controller | ok: [instance] 2025-12-04 12:27:19.243565 | controller | 2025-12-04 12:27:19.243716 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:27:19.243877 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.042) 0:00:00.226 ***** 2025-12-04 12:27:19.295600 | controller | ok: [instance] 2025-12-04 12:27:19.295761 | controller | 2025-12-04 12:27:19.295920 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 12:27:19.296068 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.052) 0:00:00.278 ***** 2025-12-04 12:27:19.353948 | controller | ok: [instance] 2025-12-04 12:27:19.354112 | controller | 2025-12-04 12:27:19.354284 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 12:27:19.354445 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.058) 0:00:00.336 ***** 2025-12-04 12:27:19.391597 | controller | skipping: [instance] 2025-12-04 12:27:19.391787 | controller | 2025-12-04 12:27:19.391978 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 12:27:19.392136 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.037) 0:00:00.374 ***** 2025-12-04 12:27:19.459187 | controller | ok: [instance] => changed=false 2025-12-04 12:27:19.459408 | controller | msg: All assertions passed 2025-12-04 12:27:19.459569 | controller | 2025-12-04 12:27:19.459734 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2025-12-04 12:27:19.459896 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.067) 0:00:00.442 ***** 2025-12-04 12:27:19.507028 | controller | 2025-12-04 12:27:19.507195 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:27:19.507353 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.047) 0:00:00.490 ***** 2025-12-04 12:27:19.552916 | controller | ok: [instance] 2025-12-04 12:27:19.553113 | controller | 2025-12-04 12:27:19.553307 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:27:19.553503 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.045) 0:00:00.535 ***** 2025-12-04 12:27:19.613830 | controller | ok: [instance] 2025-12-04 12:27:19.614003 | controller | 2025-12-04 12:27:19.614157 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 12:27:19.614325 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.060) 0:00:00.596 ***** 2025-12-04 12:27:19.657927 | controller | ok: [instance] 2025-12-04 12:27:19.658127 | controller | 2025-12-04 12:27:19.658348 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 12:27:19.658552 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.044) 0:00:00.640 ***** 2025-12-04 12:27:19.689662 | controller | skipping: [instance] 2025-12-04 12:27:19.689807 | controller | 2025-12-04 12:27:19.689947 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 12:27:19.690097 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.030) 0:00:00.671 ***** 2025-12-04 12:27:19.730990 | controller | ok: [instance] => changed=false 2025-12-04 12:27:19.775637 | controller | msg: All assertions passed 2025-12-04 12:27:19.775666 | controller | 2025-12-04 12:27:19.775674 | controller | TASK [Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2025-12-04 12:27:19.775681 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.041) 0:00:00.712 ***** 2025-12-04 12:27:19.775702 | controller | 2025-12-04 12:27:19.815436 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:27:19.815468 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.045) 0:00:00.758 ***** 2025-12-04 12:27:19.815480 | controller | ok: [instance] 2025-12-04 12:27:19.859756 | controller | 2025-12-04 12:27:19.859784 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:27:19.859797 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.038) 0:00:00.797 ***** 2025-12-04 12:27:19.859808 | controller | ok: [instance] 2025-12-04 12:27:19.903038 | controller | 2025-12-04 12:27:19.903059 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 12:27:19.903068 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.045) 0:00:00.842 ***** 2025-12-04 12:27:19.903080 | controller | ok: [instance] 2025-12-04 12:27:19.934941 | controller | 2025-12-04 12:27:19.934966 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 12:27:19.934977 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.043) 0:00:00.886 ***** 2025-12-04 12:27:19.934986 | controller | skipping: [instance] 2025-12-04 12:27:20.003505 | controller | 2025-12-04 12:27:20.003556 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 12:27:20.003565 | controller | Thursday 04 December 2025 12:27:19 +0000 (0:00:00.029) 0:00:00.915 ***** 2025-12-04 12:27:20.003575 | controller | ok: [instance] => changed=false 2025-12-04 12:27:20.049713 | controller | msg: All assertions passed 2025-12-04 12:27:20.049750 | controller | 2025-12-04 12:27:20.049759 | controller | TASK [Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35] *** 2025-12-04 12:27:20.049776 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.070) 0:00:00.985 ***** 2025-12-04 12:27:20.049787 | controller | 2025-12-04 12:27:20.089517 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:27:20.089538 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.046) 0:00:01.032 ***** 2025-12-04 12:27:20.089549 | controller | ok: [instance] 2025-12-04 12:27:20.133558 | controller | 2025-12-04 12:27:20.133579 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:27:20.133587 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.039) 0:00:01.072 ***** 2025-12-04 12:27:20.133595 | controller | ok: [instance] 2025-12-04 12:27:20.133742 | controller | 2025-12-04 12:27:20.133895 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 12:27:20.134078 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.043) 0:00:01.116 ***** 2025-12-04 12:27:20.171840 | controller | ok: [instance] 2025-12-04 12:27:20.172012 | controller | 2025-12-04 12:27:20.172162 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 12:27:20.172337 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.038) 0:00:01.154 ***** 2025-12-04 12:27:20.208415 | controller | skipping: [instance] 2025-12-04 12:27:20.208597 | controller | 2025-12-04 12:27:20.208777 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 12:27:20.208978 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.033) 0:00:01.188 ***** 2025-12-04 12:27:20.278185 | controller | ok: [instance] => changed=false 2025-12-04 12:27:20.278369 | controller | msg: All assertions passed 2025-12-04 12:27:20.278517 | controller | 2025-12-04 12:27:20.278666 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2025-12-04 12:27:20.278803 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.073) 0:00:01.261 ***** 2025-12-04 12:27:20.325064 | controller | 2025-12-04 12:27:20.325242 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:27:20.325423 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.046) 0:00:01.307 ***** 2025-12-04 12:27:20.371754 | controller | ok: [instance] 2025-12-04 12:27:20.371951 | controller | 2025-12-04 12:27:20.372147 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:27:20.372358 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.047) 0:00:01.355 ***** 2025-12-04 12:27:20.403417 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:20.403616 | controller | assertion: _matched_url | default('') | length > 0 2025-12-04 12:27:20.403771 | controller | evaluated_to: false 2025-12-04 12:27:20.403938 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-04 12:27:20.431805 | controller | 2025-12-04 12:27:20.431995 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-04 12:27:20.432148 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.043) 0:00:01.398 ***** 2025-12-04 12:27:20.432325 | controller | 2025-12-04 12:27:20.432495 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-04 12:27:20.432642 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.016) 0:00:01.415 ***** 2025-12-04 12:27:20.474374 | controller | skipping: [instance] 2025-12-04 12:27:20.474592 | controller | 2025-12-04 12:27:20.474749 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-04 12:27:20.474894 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.041) 0:00:01.456 ***** 2025-12-04 12:27:20.510489 | controller | skipping: [instance] 2025-12-04 12:27:20.510657 | controller | 2025-12-04 12:27:20.510824 | controller | TASK [Call task file with httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2025-12-04 12:27:20.510986 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.037) 0:00:01.493 ***** 2025-12-04 12:27:20.550057 | controller | 2025-12-04 12:27:20.550267 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:27:20.550470 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.039) 0:00:01.533 ***** 2025-12-04 12:27:20.586709 | controller | ok: [instance] 2025-12-04 12:27:20.586859 | controller | 2025-12-04 12:27:20.586996 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:27:20.587132 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.036) 0:00:01.569 ***** 2025-12-04 12:27:20.614430 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:20.614607 | controller | assertion: _matched_url | default('') | length > 0 2025-12-04 12:27:20.614742 | controller | evaluated_to: false 2025-12-04 12:27:20.614904 | controller | msg: 'The cifmw_job_uri value provided is not valid: httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-04 12:27:20.640993 | controller | 2025-12-04 12:27:20.641160 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-04 12:27:20.641345 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.038) 0:00:01.607 ***** 2025-12-04 12:27:20.641512 | controller | 2025-12-04 12:27:20.641652 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-04 12:27:20.641779 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.016) 0:00:01.624 ***** 2025-12-04 12:27:20.675440 | controller | skipping: [instance] 2025-12-04 12:27:20.675610 | controller | 2025-12-04 12:27:20.675764 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-04 12:27:20.675921 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.033) 0:00:01.657 ***** 2025-12-04 12:27:20.715114 | controller | skipping: [instance] 2025-12-04 12:27:20.753084 | controller | 2025-12-04 12:27:20.753110 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log] *** 2025-12-04 12:27:20.753118 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.040) 0:00:01.698 ***** 2025-12-04 12:27:20.753126 | controller | 2025-12-04 12:27:20.753801 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:27:20.791405 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.038) 0:00:01.736 ***** 2025-12-04 12:27:20.791427 | controller | ok: [instance] 2025-12-04 12:27:20.791662 | controller | 2025-12-04 12:27:20.791675 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:27:20.841312 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.037) 0:00:01.774 ***** 2025-12-04 12:27:20.841335 | controller | ok: [instance] 2025-12-04 12:27:20.891031 | controller | 2025-12-04 12:27:20.891049 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 12:27:20.891057 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.046) 0:00:01.821 ***** 2025-12-04 12:27:20.891071 | controller | ok: [instance] 2025-12-04 12:27:20.920018 | controller | 2025-12-04 12:27:20.920037 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 12:27:20.920045 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.052) 0:00:01.874 ***** 2025-12-04 12:27:20.920054 | controller | skipping: [instance] 2025-12-04 12:27:20.962608 | controller | 2025-12-04 12:27:20.962639 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 12:27:20.962651 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.028) 0:00:01.902 ***** 2025-12-04 12:27:20.962665 | controller | ok: [instance] => changed=false 2025-12-04 12:27:21.032844 | controller | msg: All assertions passed 2025-12-04 12:27:21.032880 | controller | 2025-12-04 12:27:21.032901 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/] *** 2025-12-04 12:27:21.032908 | controller | Thursday 04 December 2025 12:27:20 +0000 (0:00:00.042) 0:00:01.945 ***** 2025-12-04 12:27:21.032918 | controller | 2025-12-04 12:27:21.070656 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:27:21.070680 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.070) 0:00:02.015 ***** 2025-12-04 12:27:21.070691 | controller | ok: [instance] 2025-12-04 12:27:21.111283 | controller | 2025-12-04 12:27:21.111305 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:27:21.111313 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.037) 0:00:02.053 ***** 2025-12-04 12:27:21.111330 | controller | ok: [instance] 2025-12-04 12:27:21.149896 | controller | 2025-12-04 12:27:21.149917 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 12:27:21.149924 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.040) 0:00:02.094 ***** 2025-12-04 12:27:21.149932 | controller | ok: [instance] 2025-12-04 12:27:21.176800 | controller | 2025-12-04 12:27:21.176821 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 12:27:21.176828 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.038) 0:00:02.133 ***** 2025-12-04 12:27:21.176836 | controller | skipping: [instance] 2025-12-04 12:27:21.211784 | controller | 2025-12-04 12:27:21.211803 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 12:27:21.211811 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.026) 0:00:02.159 ***** 2025-12-04 12:27:21.211819 | controller | ok: [instance] => changed=false 2025-12-04 12:27:21.247327 | controller | msg: All assertions passed 2025-12-04 12:27:21.247346 | controller | 2025-12-04 12:27:21.247354 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4] *** 2025-12-04 12:27:21.247360 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.034) 0:00:02.194 ***** 2025-12-04 12:27:21.247368 | controller | 2025-12-04 12:27:21.282413 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:27:21.282432 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.035) 0:00:02.230 ***** 2025-12-04 12:27:21.282442 | controller | ok: [instance] 2025-12-04 12:27:21.313216 | controller | 2025-12-04 12:27:21.313259 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:27:21.313271 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.034) 0:00:02.265 ***** 2025-12-04 12:27:21.313281 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:21.340787 | controller | assertion: _matched_url | default('') | length > 0 2025-12-04 12:27:21.340811 | controller | evaluated_to: false 2025-12-04 12:27:21.340819 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-04 12:27:21.340828 | controller | 2025-12-04 12:27:21.379074 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-04 12:27:21.379113 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.041) 0:00:02.307 ***** 2025-12-04 12:27:21.379122 | controller | 2025-12-04 12:27:21.379128 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-04 12:27:21.379133 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.015) 0:00:02.323 ***** 2025-12-04 12:27:21.379142 | controller | skipping: [instance] 2025-12-04 12:27:21.412075 | controller | 2025-12-04 12:27:21.412098 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-04 12:27:21.412105 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.035) 0:00:02.358 ***** 2025-12-04 12:27:21.412120 | controller | skipping: [instance] 2025-12-04 12:27:21.447777 | controller | 2025-12-04 12:27:21.447799 | controller | TASK [Call task file with /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a] *** 2025-12-04 12:27:21.447807 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.034) 0:00:02.393 ***** 2025-12-04 12:27:21.447815 | controller | 2025-12-04 12:27:21.484341 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 12:27:21.484378 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.036) 0:00:02.430 ***** 2025-12-04 12:27:21.484396 | controller | ok: [instance] 2025-12-04 12:27:21.484596 | controller | 2025-12-04 12:27:21.484766 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 12:27:21.484901 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.036) 0:00:02.467 ***** 2025-12-04 12:27:21.512264 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:21.512490 | controller | assertion: _matched_url | default('') | length > 0 2025-12-04 12:27:21.512709 | controller | evaluated_to: false 2025-12-04 12:27:21.512903 | controller | msg: 'The cifmw_job_uri value provided is not valid: /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-04 12:27:21.538530 | controller | 2025-12-04 12:27:21.538694 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-04 12:27:21.538880 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.038) 0:00:02.505 ***** 2025-12-04 12:27:21.539035 | controller | 2025-12-04 12:27:21.539205 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-04 12:27:21.539394 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.016) 0:00:02.521 ***** 2025-12-04 12:27:21.572875 | controller | skipping: [instance] 2025-12-04 12:27:21.573037 | controller | 2025-12-04 12:27:21.573174 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-04 12:27:21.573337 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.034) 0:00:02.556 ***** 2025-12-04 12:27:21.620624 | controller | skipping: [instance] 2025-12-04 12:27:21.620772 | controller | 2025-12-04 12:27:21.620935 | controller | TASK [Print success message] *************************************************** 2025-12-04 12:27:21.621071 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.047) 0:00:02.603 ***** 2025-12-04 12:27:21.715492 | controller | ok: [instance] => 2025-12-04 12:27:21.715675 | controller | msg: All strings passed! 2025-12-04 12:27:21.715806 | controller | 2025-12-04 12:27:21.715953 | controller | PLAY RECAP ********************************************************************* 2025-12-04 12:27:21.716107 | controller | instance : ok=39 changed=0 unreachable=0 failed=0 skipped=14 rescued=4 ignored=0 2025-12-04 12:27:21.716231 | controller | 2025-12-04 12:27:21.716388 | controller | Thursday 04 December 2025 12:27:21 +0000 (0:00:00.094) 0:00:02.698 ***** 2025-12-04 12:27:21.716536 | controller | =============================================================================== 2025-12-04 12:27:21.716663 | controller | Print success message --------------------------------------------------- 0.09s 2025-12-04 12:27:21.716785 | controller | Call task file in loop -------------------------------------------------- 0.09s 2025-12-04 12:27:21.716912 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.07s 2025-12-04 12:27:21.717040 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/ --- 0.07s 2025-12-04 12:27:21.717164 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.07s 2025-12-04 12:27:21.717309 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.07s 2025-12-04 12:27:21.717439 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.06s 2025-12-04 12:27:21.717575 | controller | reproducer : Extract job id for later reference ------------------------- 0.06s 2025-12-04 12:27:21.717712 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything///// --- 0.05s 2025-12-04 12:27:21.717836 | controller | reproducer : Extract job id for later reference ------------------------- 0.05s 2025-12-04 12:27:21.717955 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.05s 2025-12-04 12:27:21.718082 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7 --- 0.05s 2025-12-04 12:27:21.718204 | controller | Really fail if string failed but should have passed --------------------- 0.05s 2025-12-04 12:27:21.718358 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.05s 2025-12-04 12:27:21.718506 | controller | Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35 --- 0.05s 2025-12-04 12:27:21.718630 | controller | reproducer : Apply regex match filter ----------------------------------- 0.05s 2025-12-04 12:27:21.718760 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 --- 0.05s 2025-12-04 12:27:21.718887 | controller | Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7 --- 0.05s 2025-12-04 12:27:21.719027 | controller | reproducer : Apply regex match filter ----------------------------------- 0.05s 2025-12-04 12:27:21.719163 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.05s 2025-12-04 12:27:21.766680 | controller | INFO Running job_uri > cleanup 2025-12-04 12:27:21.767101 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-04 12:27:21.774100 | controller | INFO Running network_validations > prepare 2025-12-04 12:27:21.774545 | controller | WARNING Skipping, prepare playbook not configured. 2025-12-04 12:27:21.782814 | controller | INFO Running network_validations > converge 2025-12-04 12:27:22.233522 | controller | 2025-12-04 12:27:22.233757 | controller | PLAY [Prepare] ***************************************************************** 2025-12-04 12:27:22.233906 | controller | 2025-12-04 12:27:22.234054 | controller | TASK [Set failed fact] ********************************************************* 2025-12-04 12:27:22.234198 | controller | Thursday 04 December 2025 12:27:22 +0000 (0:00:00.035) 0:00:00.035 ***** 2025-12-04 12:27:22.258500 | controller | ok: [instance] 2025-12-04 12:27:22.258648 | controller | 2025-12-04 12:27:22.258783 | controller | TASK [Load scenarios] ********************************************************** 2025-12-04 12:27:22.258929 | controller | Thursday 04 December 2025 12:27:22 +0000 (0:00:00.025) 0:00:00.061 ***** 2025-12-04 12:27:22.287162 | controller | ok: [instance] 2025-12-04 12:27:22.287367 | controller | 2025-12-04 12:27:22.287557 | controller | TASK [Test network validations] ************************************************ 2025-12-04 12:27:22.287724 | controller | Thursday 04 December 2025 12:27:22 +0000 (0:00:00.028) 0:00:00.089 ***** 2025-12-04 12:27:22.347840 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets only) 2025-12-04 12:27:22.348047 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets and spine/leaf) 2025-12-04 12:27:22.348206 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets with extra defined net) 2025-12-04 12:27:22.348401 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing default net definition) 2025-12-04 12:27:22.348601 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing spine/leaf net definition) 2025-12-04 12:27:22.348785 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=No network for a VM) 2025-12-04 12:27:22.348921 | controller | 2025-12-04 12:27:22.349061 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:22.349202 | controller | Thursday 04 December 2025 12:27:22 +0000 (0:00:00.060) 0:00:00.150 ***** 2025-12-04 12:27:22.371657 | controller | ok: [instance] 2025-12-04 12:27:22.371812 | controller | 2025-12-04 12:27:22.371984 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:22.372156 | controller | Thursday 04 December 2025 12:27:22 +0000 (0:00:00.022) 0:00:00.172 ***** 2025-12-04 12:27:22.398695 | controller | ok: [instance] 2025-12-04 12:27:22.398851 | controller | 2025-12-04 12:27:22.399023 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:22.399166 | controller | Thursday 04 December 2025 12:27:22 +0000 (0:00:00.028) 0:00:00.201 ***** 2025-12-04 12:27:22.426222 | controller | ok: [instance] => 2025-12-04 12:27:22.426422 | controller | msg: 'Running: Default nets only' 2025-12-04 12:27:22.426592 | controller | 2025-12-04 12:27:22.426741 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:22.426882 | controller | Thursday 04 December 2025 12:27:22 +0000 (0:00:00.027) 0:00:00.228 ***** 2025-12-04 12:27:22.474243 | controller | 2025-12-04 12:27:22.474446 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 12:27:22.474639 | controller | Thursday 04 December 2025 12:27:22 +0000 (0:00:00.047) 0:00:00.276 ***** 2025-12-04 12:27:22.501607 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 12:27:22.501824 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 12:27:22.501989 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 12:27:22.502133 | controller | collisions and unexpected behavior. 2025-12-04 12:27:22.558165 | controller | ok: [instance] => (item=controller) 2025-12-04 12:27:22.558371 | controller | 2025-12-04 12:27:22.558545 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 12:27:22.558692 | controller | Thursday 04 December 2025 12:27:22 +0000 (0:00:00.083) 0:00:00.360 ***** 2025-12-04 12:27:22.623831 | controller | ok: [instance] 2025-12-04 12:27:22.624006 | controller | 2025-12-04 12:27:22.624147 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-04 12:27:22.624300 | controller | Thursday 04 December 2025 12:27:22 +0000 (0:00:00.058) 0:00:00.418 ***** 2025-12-04 12:27:22.689642 | controller | ok: [instance] => changed=false 2025-12-04 12:27:22.689817 | controller | msg: All assertions passed 2025-12-04 12:27:22.689970 | controller | 2025-12-04 12:27:22.690115 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:22.690272 | controller | Thursday 04 December 2025 12:27:22 +0000 (0:00:00.069) 0:00:00.487 ***** 2025-12-04 12:27:22.738661 | controller | skipping: [instance] 2025-12-04 12:27:22.738846 | controller | 2025-12-04 12:27:22.739008 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:22.739148 | controller | Thursday 04 December 2025 12:27:22 +0000 (0:00:00.053) 0:00:00.540 ***** 2025-12-04 12:27:22.778791 | controller | skipping: [instance] 2025-12-04 12:27:22.778978 | controller | 2025-12-04 12:27:22.779134 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:22.779324 | controller | Thursday 04 December 2025 12:27:22 +0000 (0:00:00.039) 0:00:00.580 ***** 2025-12-04 12:27:22.837714 | controller | skipping: [instance] 2025-12-04 12:27:22.837886 | controller | 2025-12-04 12:27:22.838035 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:22.838181 | controller | Thursday 04 December 2025 12:27:22 +0000 (0:00:00.059) 0:00:00.640 ***** 2025-12-04 12:27:22.874464 | controller | ok: [instance] 2025-12-04 12:27:22.874645 | controller | 2025-12-04 12:27:22.874797 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:22.874947 | controller | Thursday 04 December 2025 12:27:22 +0000 (0:00:00.036) 0:00:00.676 ***** 2025-12-04 12:27:22.914428 | controller | ok: [instance] 2025-12-04 12:27:22.914587 | controller | 2025-12-04 12:27:22.914733 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:22.914877 | controller | Thursday 04 December 2025 12:27:22 +0000 (0:00:00.040) 0:00:00.716 ***** 2025-12-04 12:27:22.955689 | controller | ok: [instance] => 2025-12-04 12:27:22.955852 | controller | msg: 'Running: Default nets and spine/leaf' 2025-12-04 12:27:22.955997 | controller | 2025-12-04 12:27:22.956127 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:22.956283 | controller | Thursday 04 December 2025 12:27:22 +0000 (0:00:00.041) 0:00:00.758 ***** 2025-12-04 12:27:23.019954 | controller | 2025-12-04 12:27:23.020115 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 12:27:23.020292 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.064) 0:00:00.822 ***** 2025-12-04 12:27:23.051506 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 12:27:23.051664 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 12:27:23.051798 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 12:27:23.051943 | controller | collisions and unexpected behavior. 2025-12-04 12:27:23.074481 | controller | ok: [instance] => (item=controller) 2025-12-04 12:27:23.074624 | controller | 2025-12-04 12:27:23.074757 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 12:27:23.074886 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.052) 0:00:00.874 ***** 2025-12-04 12:27:23.143512 | controller | ok: [instance] 2025-12-04 12:27:23.226684 | controller | 2025-12-04 12:27:23.226711 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-04 12:27:23.226719 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.068) 0:00:00.943 ***** 2025-12-04 12:27:23.226733 | controller | ok: [instance] => changed=false 2025-12-04 12:27:23.278467 | controller | msg: All assertions passed 2025-12-04 12:27:23.278493 | controller | 2025-12-04 12:27:23.278504 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:23.278511 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.084) 0:00:01.028 ***** 2025-12-04 12:27:23.278522 | controller | skipping: [instance] 2025-12-04 12:27:23.329690 | controller | 2025-12-04 12:27:23.329714 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:23.329730 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.052) 0:00:01.080 ***** 2025-12-04 12:27:23.329739 | controller | skipping: [instance] 2025-12-04 12:27:23.373913 | controller | 2025-12-04 12:27:23.373932 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:23.373939 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.051) 0:00:01.131 ***** 2025-12-04 12:27:23.373947 | controller | skipping: [instance] 2025-12-04 12:27:23.403299 | controller | 2025-12-04 12:27:23.403324 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:23.403332 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.042) 0:00:01.174 ***** 2025-12-04 12:27:23.403346 | controller | ok: [instance] 2025-12-04 12:27:23.435351 | controller | 2025-12-04 12:27:23.435375 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:23.435383 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.030) 0:00:01.205 ***** 2025-12-04 12:27:23.435391 | controller | ok: [instance] 2025-12-04 12:27:23.463536 | controller | 2025-12-04 12:27:23.463555 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:23.463562 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.031) 0:00:01.237 ***** 2025-12-04 12:27:23.463571 | controller | ok: [instance] => 2025-12-04 12:27:23.510749 | controller | msg: 'Running: Default nets with extra defined net' 2025-12-04 12:27:23.510776 | controller | 2025-12-04 12:27:23.510787 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:23.510794 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.028) 0:00:01.265 ***** 2025-12-04 12:27:23.510803 | controller | 2025-12-04 12:27:23.621148 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 12:27:23.621176 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.047) 0:00:01.313 ***** 2025-12-04 12:27:23.621188 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 12:27:23.633215 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 12:27:23.633235 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 12:27:23.633243 | controller | collisions and unexpected behavior. 2025-12-04 12:27:23.633267 | controller | ok: [instance] => (item=controller) 2025-12-04 12:27:23.698980 | controller | 2025-12-04 12:27:23.698998 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 12:27:23.699005 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.122) 0:00:01.435 ***** 2025-12-04 12:27:23.699013 | controller | ok: [instance] 2025-12-04 12:27:23.746686 | controller | 2025-12-04 12:27:23.746704 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-04 12:27:23.746711 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.065) 0:00:01.500 ***** 2025-12-04 12:27:23.746719 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:23.757403 | controller | assertion: _defined | difference(_all_nets) | length == 0 2025-12-04 12:27:23.757420 | controller | evaluated_to: false 2025-12-04 12:27:23.757437 | controller | msg: 'Inconsistency detected: ensure you''re attaching all of the defined networks. Those nets don''t seem to be attached: [''extra_net_1'']' 2025-12-04 12:27:23.757445 | controller | 2025-12-04 12:27:23.792395 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-04 12:27:23.792412 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.057) 0:00:01.558 ***** 2025-12-04 12:27:23.792422 | controller | ok: [instance] => 2025-12-04 12:27:23.824788 | controller | cifmw_libvirt_manager_configuration: 2025-12-04 12:27:23.824807 | controller | networks: 2025-12-04 12:27:23.824814 | controller | public: defined 2025-12-04 12:27:23.824820 | controller | vms: 2025-12-04 12:27:23.824826 | controller | controller: 2025-12-04 12:27:23.824831 | controller | nets: 2025-12-04 12:27:23.824836 | controller | - public 2025-12-04 12:27:23.824841 | controller | 2025-12-04 12:27:23.824846 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-04 12:27:23.824851 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.035) 0:00:01.594 ***** 2025-12-04 12:27:23.824859 | controller | skipping: [instance] 2025-12-04 12:27:23.897986 | controller | 2025-12-04 12:27:23.898007 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-04 12:27:23.898013 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.032) 0:00:01.626 ***** 2025-12-04 12:27:23.898022 | controller | skipping: [instance] 2025-12-04 12:27:23.937634 | controller | 2025-12-04 12:27:23.937658 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-04 12:27:23.937666 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.072) 0:00:01.699 ***** 2025-12-04 12:27:23.937675 | controller | ok: [instance] => 2025-12-04 12:27:23.957220 | controller | _cifmw_libvirt_manager_layout: 2025-12-04 12:27:23.957260 | controller | networks: 2025-12-04 12:27:23.957275 | controller | extra_net_1: defined 2025-12-04 12:27:23.957286 | controller | public: defined 2025-12-04 12:27:23.957292 | controller | vms: 2025-12-04 12:27:23.957298 | controller | controller: 2025-12-04 12:27:23.957303 | controller | nets: 2025-12-04 12:27:23.957309 | controller | - public 2025-12-04 12:27:23.957314 | controller | 2025-12-04 12:27:23.957320 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-04 12:27:23.957325 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.039) 0:00:01.739 ***** 2025-12-04 12:27:23.957339 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:23.985300 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-04 12:27:23.985329 | controller | 2025-12-04 12:27:24.009887 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:27:24.009907 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.029) 0:00:01.768 ***** 2025-12-04 12:27:24.009914 | controller | 2025-12-04 12:27:24.009919 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:24.009924 | controller | Thursday 04 December 2025 12:27:23 +0000 (0:00:00.019) 0:00:01.787 ***** 2025-12-04 12:27:24.009933 | controller | ok: [instance] 2025-12-04 12:27:24.052737 | controller | 2025-12-04 12:27:24.052760 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:24.052767 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.024) 0:00:01.812 ***** 2025-12-04 12:27:24.052776 | controller | skipping: [instance] 2025-12-04 12:27:24.085772 | controller | 2025-12-04 12:27:24.085794 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:24.085801 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.042) 0:00:01.855 ***** 2025-12-04 12:27:24.085809 | controller | skipping: [instance] 2025-12-04 12:27:24.125330 | controller | 2025-12-04 12:27:24.125354 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:24.125361 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.033) 0:00:01.888 ***** 2025-12-04 12:27:24.125370 | controller | skipping: [instance] 2025-12-04 12:27:24.147665 | controller | 2025-12-04 12:27:24.147689 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:24.147696 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.038) 0:00:01.926 ***** 2025-12-04 12:27:24.147705 | controller | ok: [instance] 2025-12-04 12:27:24.175946 | controller | 2025-12-04 12:27:24.175971 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:24.175979 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.023) 0:00:01.949 ***** 2025-12-04 12:27:24.175988 | controller | ok: [instance] 2025-12-04 12:27:24.204052 | controller | 2025-12-04 12:27:24.204075 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:24.204082 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.026) 0:00:01.976 ***** 2025-12-04 12:27:24.204091 | controller | ok: [instance] => 2025-12-04 12:27:24.244432 | controller | msg: 'Running: Missing default net definition' 2025-12-04 12:27:24.244455 | controller | 2025-12-04 12:27:24.244471 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:24.244478 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.029) 0:00:02.006 ***** 2025-12-04 12:27:24.244486 | controller | 2025-12-04 12:27:24.244634 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 12:27:24.244769 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.040) 0:00:02.047 ***** 2025-12-04 12:27:24.275969 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 12:27:24.276123 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 12:27:24.276279 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 12:27:24.276427 | controller | collisions and unexpected behavior. 2025-12-04 12:27:24.296234 | controller | ok: [instance] => (item=controller) 2025-12-04 12:27:24.296400 | controller | 2025-12-04 12:27:24.296563 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 12:27:24.296697 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.051) 0:00:02.099 ***** 2025-12-04 12:27:24.341763 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:24.351796 | controller | assertion: _all_nets | difference(_defined) | length == 0 2025-12-04 12:27:24.351813 | controller | evaluated_to: false 2025-12-04 12:27:24.351829 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''foo'']' 2025-12-04 12:27:24.351843 | controller | 2025-12-04 12:27:24.383084 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-04 12:27:24.383101 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.054) 0:00:02.153 ***** 2025-12-04 12:27:24.383111 | controller | ok: [instance] => 2025-12-04 12:27:24.411620 | controller | cifmw_libvirt_manager_configuration: 2025-12-04 12:27:24.411640 | controller | networks: 2025-12-04 12:27:24.411647 | controller | public: defined 2025-12-04 12:27:24.411653 | controller | vms: 2025-12-04 12:27:24.411658 | controller | controller: 2025-12-04 12:27:24.411663 | controller | nets: 2025-12-04 12:27:24.411668 | controller | - public 2025-12-04 12:27:24.411673 | controller | 2025-12-04 12:27:24.411678 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-04 12:27:24.411683 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.030) 0:00:02.184 ***** 2025-12-04 12:27:24.411691 | controller | skipping: [instance] 2025-12-04 12:27:24.563674 | controller | 2025-12-04 12:27:24.563713 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-04 12:27:24.563721 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.029) 0:00:02.214 ***** 2025-12-04 12:27:24.563731 | controller | skipping: [instance] 2025-12-04 12:27:24.607650 | controller | 2025-12-04 12:27:24.607685 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-04 12:27:24.607693 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.151) 0:00:02.365 ***** 2025-12-04 12:27:24.607703 | controller | ok: [instance] => 2025-12-04 12:27:24.620190 | controller | _cifmw_libvirt_manager_layout: 2025-12-04 12:27:24.620218 | controller | networks: 2025-12-04 12:27:24.620225 | controller | public: defined 2025-12-04 12:27:24.620232 | controller | vms: 2025-12-04 12:27:24.620237 | controller | controller: 2025-12-04 12:27:24.620243 | controller | nets: 2025-12-04 12:27:24.620269 | controller | - public 2025-12-04 12:27:24.620274 | controller | - foo 2025-12-04 12:27:24.620280 | controller | 2025-12-04 12:27:24.620286 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-04 12:27:24.620291 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.041) 0:00:02.407 ***** 2025-12-04 12:27:24.620300 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:24.620510 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-04 12:27:24.648082 | controller | 2025-12-04 12:27:24.648278 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:27:24.648434 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.027) 0:00:02.434 ***** 2025-12-04 12:27:24.648581 | controller | 2025-12-04 12:27:24.648745 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:24.648887 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.015) 0:00:02.450 ***** 2025-12-04 12:27:24.673781 | controller | ok: [instance] 2025-12-04 12:27:24.673939 | controller | 2025-12-04 12:27:24.674083 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:24.674216 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.025) 0:00:02.476 ***** 2025-12-04 12:27:24.716802 | controller | skipping: [instance] 2025-12-04 12:27:24.716964 | controller | 2025-12-04 12:27:24.717144 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:24.717314 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.041) 0:00:02.517 ***** 2025-12-04 12:27:24.752753 | controller | skipping: [instance] 2025-12-04 12:27:24.752916 | controller | 2025-12-04 12:27:24.753056 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:24.753192 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.037) 0:00:02.554 ***** 2025-12-04 12:27:24.788691 | controller | skipping: [instance] 2025-12-04 12:27:24.788877 | controller | 2025-12-04 12:27:24.789036 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:24.789173 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.036) 0:00:02.591 ***** 2025-12-04 12:27:24.810676 | controller | ok: [instance] 2025-12-04 12:27:24.810820 | controller | 2025-12-04 12:27:24.810980 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:24.811118 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.022) 0:00:02.613 ***** 2025-12-04 12:27:24.845923 | controller | ok: [instance] 2025-12-04 12:27:24.846071 | controller | 2025-12-04 12:27:24.846204 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:24.846357 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.033) 0:00:02.647 ***** 2025-12-04 12:27:24.873368 | controller | ok: [instance] => 2025-12-04 12:27:24.873547 | controller | msg: 'Running: Missing spine/leaf net definition' 2025-12-04 12:27:24.873679 | controller | 2025-12-04 12:27:24.873809 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:24.873952 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.027) 0:00:02.674 ***** 2025-12-04 12:27:24.912025 | controller | 2025-12-04 12:27:24.912189 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 12:27:24.912349 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.040) 0:00:02.714 ***** 2025-12-04 12:27:24.943585 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 12:27:24.943749 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 12:27:24.943898 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 12:27:24.944037 | controller | collisions and unexpected behavior. 2025-12-04 12:27:24.967980 | controller | ok: [instance] => (item=controller) 2025-12-04 12:27:24.968151 | controller | 2025-12-04 12:27:24.968325 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 12:27:24.968490 | controller | Thursday 04 December 2025 12:27:24 +0000 (0:00:00.054) 0:00:02.768 ***** 2025-12-04 12:27:25.017710 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:25.017910 | controller | assertion: _all_nets | difference(_defined) | length == 0 2025-12-04 12:27:25.018062 | controller | evaluated_to: false 2025-12-04 12:27:25.018214 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''l00-s1'']' 2025-12-04 12:27:25.027711 | controller | 2025-12-04 12:27:25.027933 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-04 12:27:25.028124 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.061) 0:00:02.830 ***** 2025-12-04 12:27:25.064015 | controller | ok: [instance] => 2025-12-04 12:27:25.064184 | controller | cifmw_libvirt_manager_configuration: 2025-12-04 12:27:25.064357 | controller | networks: 2025-12-04 12:27:25.064517 | controller | l00-s0: defined 2025-12-04 12:27:25.064657 | controller | public: defined 2025-12-04 12:27:25.064794 | controller | vms: 2025-12-04 12:27:25.064928 | controller | controller: 2025-12-04 12:27:25.065063 | controller | nets: 2025-12-04 12:27:25.065204 | controller | - public 2025-12-04 12:27:25.065368 | controller | spineleafnets: 2025-12-04 12:27:25.065521 | controller | - l00-s0 2025-12-04 12:27:25.065651 | controller | 2025-12-04 12:27:25.065800 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-04 12:27:25.065940 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.034) 0:00:02.865 ***** 2025-12-04 12:27:25.094200 | controller | skipping: [instance] 2025-12-04 12:27:25.094369 | controller | 2025-12-04 12:27:25.094521 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-04 12:27:25.094655 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.030) 0:00:02.895 ***** 2025-12-04 12:27:25.165149 | controller | skipping: [instance] 2025-12-04 12:27:25.165343 | controller | 2025-12-04 12:27:25.165512 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-04 12:27:25.165656 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.071) 0:00:02.966 ***** 2025-12-04 12:27:25.205001 | controller | ok: [instance] => 2025-12-04 12:27:25.205177 | controller | _cifmw_libvirt_manager_layout: 2025-12-04 12:27:25.205341 | controller | networks: 2025-12-04 12:27:25.205489 | controller | l00-s0: defined 2025-12-04 12:27:25.205732 | controller | public: defined 2025-12-04 12:27:25.205861 | controller | vms: 2025-12-04 12:27:25.205986 | controller | controller: 2025-12-04 12:27:25.206109 | controller | nets: 2025-12-04 12:27:25.206231 | controller | - public 2025-12-04 12:27:25.206377 | controller | spineleafnets: 2025-12-04 12:27:25.206514 | controller | - l00-s0 2025-12-04 12:27:25.206633 | controller | - l00-s1 2025-12-04 12:27:25.206756 | controller | 2025-12-04 12:27:25.206913 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-04 12:27:25.207056 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.040) 0:00:03.007 ***** 2025-12-04 12:27:25.219172 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:25.219350 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-04 12:27:25.247003 | controller | 2025-12-04 12:27:25.247160 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:27:25.247321 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.025) 0:00:03.033 ***** 2025-12-04 12:27:25.247482 | controller | 2025-12-04 12:27:25.247651 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:25.247810 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.016) 0:00:03.049 ***** 2025-12-04 12:27:25.270946 | controller | ok: [instance] 2025-12-04 12:27:25.271092 | controller | 2025-12-04 12:27:25.271242 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:25.271406 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.023) 0:00:03.073 ***** 2025-12-04 12:27:25.313761 | controller | skipping: [instance] 2025-12-04 12:27:25.313925 | controller | 2025-12-04 12:27:25.314084 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:25.314267 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.040) 0:00:03.114 ***** 2025-12-04 12:27:25.374005 | controller | skipping: [instance] 2025-12-04 12:27:25.374227 | controller | 2025-12-04 12:27:25.374389 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:25.374539 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.062) 0:00:03.176 ***** 2025-12-04 12:27:25.412330 | controller | skipping: [instance] 2025-12-04 12:27:25.412489 | controller | 2025-12-04 12:27:25.412626 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:25.412758 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.037) 0:00:03.213 ***** 2025-12-04 12:27:25.437485 | controller | ok: [instance] 2025-12-04 12:27:25.437630 | controller | 2025-12-04 12:27:25.437768 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:25.437918 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.026) 0:00:03.239 ***** 2025-12-04 12:27:25.465437 | controller | ok: [instance] 2025-12-04 12:27:25.465596 | controller | 2025-12-04 12:27:25.465738 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:25.465876 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.027) 0:00:03.267 ***** 2025-12-04 12:27:25.491151 | controller | ok: [instance] => 2025-12-04 12:27:25.491330 | controller | msg: 'Running: No network for a VM' 2025-12-04 12:27:25.491485 | controller | 2025-12-04 12:27:25.491619 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:25.491748 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.025) 0:00:03.293 ***** 2025-12-04 12:27:25.535226 | controller | 2025-12-04 12:27:25.535421 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 12:27:25.535621 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.044) 0:00:03.337 ***** 2025-12-04 12:27:25.576209 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 12:27:25.576449 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 12:27:25.576658 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 12:27:25.576838 | controller | collisions and unexpected behavior. 2025-12-04 12:27:25.596075 | controller | failed: [instance] (item=foo) => changed=false 2025-12-04 12:27:25.596286 | controller | ansible_loop_var: item 2025-12-04 12:27:25.596483 | controller | assertion: item.value.nets is defined 2025-12-04 12:27:25.596657 | controller | evaluated_to: false 2025-12-04 12:27:25.596961 | controller | item: 2025-12-04 12:27:25.597114 | controller | key: foo 2025-12-04 12:27:25.597299 | controller | value: 2025-12-04 12:27:25.597483 | controller | disksize: 10 2025-12-04 12:27:25.597650 | controller | msg: 'Inconsistency detected: VM type "foo" doesn''t seem to have any network.' 2025-12-04 12:27:25.610520 | controller | ok: [instance] => (item=controller) 2025-12-04 12:27:25.610704 | controller | 2025-12-04 12:27:25.610868 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-04 12:27:25.611007 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.074) 0:00:03.412 ***** 2025-12-04 12:27:25.667331 | controller | ok: [instance] => 2025-12-04 12:27:25.667562 | controller | cifmw_libvirt_manager_configuration: 2025-12-04 12:27:25.667735 | controller | networks: 2025-12-04 12:27:25.667893 | controller | public: defined 2025-12-04 12:27:25.668046 | controller | vms: 2025-12-04 12:27:25.668207 | controller | controller: 2025-12-04 12:27:25.668393 | controller | nets: 2025-12-04 12:27:25.668568 | controller | - public 2025-12-04 12:27:25.668719 | controller | 2025-12-04 12:27:25.668877 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-04 12:27:25.669028 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.056) 0:00:03.469 ***** 2025-12-04 12:27:25.716487 | controller | skipping: [instance] 2025-12-04 12:27:25.716709 | controller | 2025-12-04 12:27:25.716888 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-04 12:27:25.717058 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.049) 0:00:03.518 ***** 2025-12-04 12:27:25.810343 | controller | skipping: [instance] 2025-12-04 12:27:25.810570 | controller | 2025-12-04 12:27:25.810772 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-04 12:27:25.810941 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.093) 0:00:03.612 ***** 2025-12-04 12:27:25.866044 | controller | ok: [instance] => 2025-12-04 12:27:25.866237 | controller | _cifmw_libvirt_manager_layout: 2025-12-04 12:27:25.866423 | controller | networks: 2025-12-04 12:27:25.866603 | controller | public: defined 2025-12-04 12:27:25.866778 | controller | vms: 2025-12-04 12:27:25.866929 | controller | controller: 2025-12-04 12:27:25.867066 | controller | nets: 2025-12-04 12:27:25.867228 | controller | - public 2025-12-04 12:27:25.867409 | controller | foo: 2025-12-04 12:27:25.867593 | controller | disksize: 10 2025-12-04 12:27:25.867759 | controller | 2025-12-04 12:27:25.867927 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-04 12:27:25.868095 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.054) 0:00:03.666 ***** 2025-12-04 12:27:25.881667 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:25.881858 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-04 12:27:25.912768 | controller | 2025-12-04 12:27:25.912992 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:27:25.913171 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.030) 0:00:03.696 ***** 2025-12-04 12:27:25.913370 | controller | 2025-12-04 12:27:25.913564 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:25.913731 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.018) 0:00:03.715 ***** 2025-12-04 12:27:25.942975 | controller | ok: [instance] 2025-12-04 12:27:25.943173 | controller | 2025-12-04 12:27:25.943404 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:25.943625 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.030) 0:00:03.745 ***** 2025-12-04 12:27:25.989351 | controller | skipping: [instance] 2025-12-04 12:27:25.989532 | controller | 2025-12-04 12:27:25.989711 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:25.989871 | controller | Thursday 04 December 2025 12:27:25 +0000 (0:00:00.045) 0:00:03.791 ***** 2025-12-04 12:27:26.029198 | controller | skipping: [instance] 2025-12-04 12:27:26.029414 | controller | 2025-12-04 12:27:26.029782 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:26.029956 | controller | Thursday 04 December 2025 12:27:26 +0000 (0:00:00.040) 0:00:03.831 ***** 2025-12-04 12:27:26.068587 | controller | skipping: [instance] 2025-12-04 12:27:26.068771 | controller | 2025-12-04 12:27:26.068964 | controller | TASK [Fail if needed] ********************************************************** 2025-12-04 12:27:26.069126 | controller | Thursday 04 December 2025 12:27:26 +0000 (0:00:00.038) 0:00:03.870 ***** 2025-12-04 12:27:26.129732 | controller | skipping: [instance] 2025-12-04 12:27:26.129883 | controller | 2025-12-04 12:27:26.130035 | controller | PLAY RECAP ********************************************************************* 2025-12-04 12:27:26.130180 | controller | instance : ok=48 changed=0 unreachable=0 failed=0 skipped=27 rescued=8 ignored=0 2025-12-04 12:27:26.130331 | controller | 2025-12-04 12:27:26.130506 | controller | Thursday 04 December 2025 12:27:26 +0000 (0:00:00.061) 0:00:03.931 ***** 2025-12-04 12:27:26.130661 | controller | =============================================================================== 2025-12-04 12:27:26.130829 | controller | reproducer : Dump layout patches ---------------------------------------- 0.15s 2025-12-04 12:27:26.130989 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.12s 2025-12-04 12:27:26.131123 | controller | reproducer : Dump layout patches ---------------------------------------- 0.09s 2025-12-04 12:27:26.131264 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.08s 2025-12-04 12:27:26.131410 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.08s 2025-12-04 12:27:26.131562 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.07s 2025-12-04 12:27:26.131686 | controller | reproducer : Dump layout patches ---------------------------------------- 0.07s 2025-12-04 12:27:26.131815 | controller | reproducer : Dump layout patches ---------------------------------------- 0.07s 2025-12-04 12:27:26.131938 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.07s 2025-12-04 12:27:26.132093 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.07s 2025-12-04 12:27:26.132273 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.07s 2025-12-04 12:27:26.132446 | controller | Validate data ----------------------------------------------------------- 0.06s 2025-12-04 12:27:26.132615 | controller | Display error message --------------------------------------------------- 0.06s 2025-12-04 12:27:26.132771 | controller | Fail if needed ---------------------------------------------------------- 0.06s 2025-12-04 12:27:26.132939 | controller | Test network validations ------------------------------------------------ 0.06s 2025-12-04 12:27:26.133094 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-12-04 12:27:26.133263 | controller | Append failed scenario to list ------------------------------------------ 0.06s 2025-12-04 12:27:26.133445 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-12-04 12:27:26.133626 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2025-12-04 12:27:26.133802 | controller | reproducer : Dump initial layout ---------------------------------------- 0.06s 2025-12-04 12:27:26.215672 | controller | INFO Running network_validations > cleanup 2025-12-04 12:27:26.216110 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-04 12:27:26.223985 | controller | INFO Running ocp_validations > prepare 2025-12-04 12:27:26.224508 | controller | WARNING Skipping, prepare playbook not configured. 2025-12-04 12:27:26.233449 | controller | INFO Running ocp_validations > converge 2025-12-04 12:27:26.717909 | controller | 2025-12-04 12:27:26.745849 | controller | PLAY [Prepare] ***************************************************************** 2025-12-04 12:27:26.745932 | controller | 2025-12-04 12:27:26.745940 | controller | TASK [Set failed fact] ********************************************************* 2025-12-04 12:27:26.745946 | controller | Thursday 04 December 2025 12:27:26 +0000 (0:00:00.035) 0:00:00.035 ***** 2025-12-04 12:27:26.745962 | controller | ok: [instance] 2025-12-04 12:27:26.778769 | controller | 2025-12-04 12:27:26.778790 | controller | TASK [Load scenarios] ********************************************************** 2025-12-04 12:27:26.778798 | controller | Thursday 04 December 2025 12:27:26 +0000 (0:00:00.028) 0:00:00.064 ***** 2025-12-04 12:27:26.778806 | controller | ok: [instance] 2025-12-04 12:27:26.899889 | controller | 2025-12-04 12:27:26.899914 | controller | TASK [Test no volumes] ********************************************************* 2025-12-04 12:27:26.899921 | controller | Thursday 04 December 2025 12:27:26 +0000 (0:00:00.033) 0:00:00.097 ***** 2025-12-04 12:27:26.899941 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, no worker) 2025-12-04 12:27:26.937752 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, with worker) 2025-12-04 12:27:26.937772 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, no worker) 2025-12-04 12:27:26.937785 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, with worker) 2025-12-04 12:27:26.937792 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Too many allocated volumes) 2025-12-04 12:27:26.937797 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Different volume amount) 2025-12-04 12:27:26.937802 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVM without volume) 2025-12-04 12:27:26.937807 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVMS without volume) 2025-12-04 12:27:26.937812 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice) 2025-12-04 12:27:26.937817 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no LVMS) 2025-12-04 12:27:26.937827 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no cinder_lvm) 2025-12-04 12:27:26.937843 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Config overrides via devscripts) 2025-12-04 12:27:26.937849 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 10 dev-scripts extra_worker) 2025-12-04 12:27:26.937854 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 0 dev-scripts extra_worker) 2025-12-04 12:27:26.937859 | controller | 2025-12-04 12:27:26.937864 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:26.937869 | controller | Thursday 04 December 2025 12:27:26 +0000 (0:00:00.120) 0:00:00.217 ***** 2025-12-04 12:27:26.937880 | controller | ok: [instance] 2025-12-04 12:27:26.938054 | controller | 2025-12-04 12:27:26.938239 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:26.938457 | controller | Thursday 04 December 2025 12:27:26 +0000 (0:00:00.039) 0:00:00.256 ***** 2025-12-04 12:27:26.979373 | controller | ok: [instance] 2025-12-04 12:27:26.979576 | controller | 2025-12-04 12:27:26.979755 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:26.979921 | controller | Thursday 04 December 2025 12:27:26 +0000 (0:00:00.037) 0:00:00.294 ***** 2025-12-04 12:27:27.022133 | controller | ok: [instance] => 2025-12-04 12:27:27.022312 | controller | msg: 'Running: No volume, no worker' 2025-12-04 12:27:27.022472 | controller | 2025-12-04 12:27:27.022644 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:27.022815 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.046) 0:00:00.340 ***** 2025-12-04 12:27:27.107199 | controller | 2025-12-04 12:27:27.107430 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:27:27.107644 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.085) 0:00:00.425 ***** 2025-12-04 12:27:27.176200 | controller | ok: [instance] 2025-12-04 12:27:27.223750 | controller | 2025-12-04 12:27:27.223770 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:27:27.223777 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.068) 0:00:00.494 ***** 2025-12-04 12:27:27.223785 | controller | ok: [instance] 2025-12-04 12:27:27.336125 | controller | 2025-12-04 12:27:27.336149 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:27:27.336157 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.047) 0:00:00.542 ***** 2025-12-04 12:27:27.336166 | controller | ok: [instance] 2025-12-04 12:27:27.381760 | controller | 2025-12-04 12:27:27.381783 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:27:27.381790 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.112) 0:00:00.654 ***** 2025-12-04 12:27:27.381799 | controller | skipping: [instance] 2025-12-04 12:27:27.437173 | controller | 2025-12-04 12:27:27.437200 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:27:27.437208 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.045) 0:00:00.700 ***** 2025-12-04 12:27:27.437227 | controller | ok: [instance] 2025-12-04 12:27:27.485710 | controller | 2025-12-04 12:27:27.485736 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:27:27.485744 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.055) 0:00:00.755 ***** 2025-12-04 12:27:27.485753 | controller | skipping: [instance] 2025-12-04 12:27:27.538652 | controller | 2025-12-04 12:27:27.538675 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:27:27.538683 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.048) 0:00:00.804 ***** 2025-12-04 12:27:27.538691 | controller | skipping: [instance] 2025-12-04 12:27:27.605204 | controller | 2025-12-04 12:27:27.605231 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:27:27.605239 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.052) 0:00:00.856 ***** 2025-12-04 12:27:27.605265 | controller | skipping: [instance] 2025-12-04 12:27:27.658473 | controller | 2025-12-04 12:27:27.658735 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 12:27:27.658743 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.065) 0:00:00.922 ***** 2025-12-04 12:27:27.658751 | controller | skipping: [instance] 2025-12-04 12:27:27.658913 | controller | 2025-12-04 12:27:27.659055 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 12:27:27.659196 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.054) 0:00:00.977 ***** 2025-12-04 12:27:27.701488 | controller | skipping: [instance] 2025-12-04 12:27:27.701656 | controller | 2025-12-04 12:27:27.701820 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 12:27:27.701987 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.043) 0:00:01.020 ***** 2025-12-04 12:27:27.792372 | controller | skipping: [instance] 2025-12-04 12:27:27.846332 | controller | 2025-12-04 12:27:27.846352 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:27.846360 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.090) 0:00:01.110 ***** 2025-12-04 12:27:27.846384 | controller | skipping: [instance] 2025-12-04 12:27:27.888065 | controller | 2025-12-04 12:27:27.888083 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:27.888091 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.052) 0:00:01.162 ***** 2025-12-04 12:27:27.888099 | controller | skipping: [instance] 2025-12-04 12:27:27.925043 | controller | 2025-12-04 12:27:27.925066 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:27.925073 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.043) 0:00:01.206 ***** 2025-12-04 12:27:27.925081 | controller | skipping: [instance] 2025-12-04 12:27:27.955793 | controller | 2025-12-04 12:27:27.955813 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:27.955820 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.036) 0:00:01.243 ***** 2025-12-04 12:27:27.955829 | controller | ok: [instance] 2025-12-04 12:27:27.990629 | controller | 2025-12-04 12:27:27.990649 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:27.990656 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.030) 0:00:01.273 ***** 2025-12-04 12:27:27.990664 | controller | ok: [instance] 2025-12-04 12:27:28.018785 | controller | 2025-12-04 12:27:28.018806 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:28.018813 | controller | Thursday 04 December 2025 12:27:27 +0000 (0:00:00.035) 0:00:01.309 ***** 2025-12-04 12:27:28.018822 | controller | ok: [instance] => 2025-12-04 12:27:28.068533 | controller | msg: 'Running: No volume, with worker' 2025-12-04 12:27:28.068556 | controller | 2025-12-04 12:27:28.068565 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:28.068571 | controller | Thursday 04 December 2025 12:27:28 +0000 (0:00:00.028) 0:00:01.337 ***** 2025-12-04 12:27:28.068579 | controller | 2025-12-04 12:27:28.137867 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:27:28.137900 | controller | Thursday 04 December 2025 12:27:28 +0000 (0:00:00.049) 0:00:01.386 ***** 2025-12-04 12:27:28.137912 | controller | ok: [instance] 2025-12-04 12:27:28.229821 | controller | 2025-12-04 12:27:28.229842 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:27:28.229858 | controller | Thursday 04 December 2025 12:27:28 +0000 (0:00:00.067) 0:00:01.454 ***** 2025-12-04 12:27:28.229868 | controller | ok: [instance] 2025-12-04 12:27:28.327874 | controller | 2025-12-04 12:27:28.327920 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:27:28.327941 | controller | Thursday 04 December 2025 12:27:28 +0000 (0:00:00.094) 0:00:01.548 ***** 2025-12-04 12:27:28.327952 | controller | ok: [instance] 2025-12-04 12:27:28.419293 | controller | 2025-12-04 12:27:28.419322 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:27:28.419331 | controller | Thursday 04 December 2025 12:27:28 +0000 (0:00:00.097) 0:00:01.646 ***** 2025-12-04 12:27:28.419344 | controller | ok: [instance] 2025-12-04 12:27:28.480032 | controller | 2025-12-04 12:27:28.480063 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:27:28.480087 | controller | Thursday 04 December 2025 12:27:28 +0000 (0:00:00.091) 0:00:01.737 ***** 2025-12-04 12:27:28.480098 | controller | ok: [instance] 2025-12-04 12:27:28.480306 | controller | 2025-12-04 12:27:28.480503 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:27:28.480680 | controller | Thursday 04 December 2025 12:27:28 +0000 (0:00:00.061) 0:00:01.798 ***** 2025-12-04 12:27:28.550626 | controller | skipping: [instance] 2025-12-04 12:27:28.550839 | controller | 2025-12-04 12:27:28.551044 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:27:28.551237 | controller | Thursday 04 December 2025 12:27:28 +0000 (0:00:00.070) 0:00:01.868 ***** 2025-12-04 12:27:28.609055 | controller | skipping: [instance] 2025-12-04 12:27:28.609238 | controller | 2025-12-04 12:27:28.609451 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:27:28.609679 | controller | Thursday 04 December 2025 12:27:28 +0000 (0:00:00.058) 0:00:01.927 ***** 2025-12-04 12:27:28.669263 | controller | skipping: [instance] 2025-12-04 12:27:28.669440 | controller | 2025-12-04 12:27:28.669614 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 12:27:28.669759 | controller | Thursday 04 December 2025 12:27:28 +0000 (0:00:00.060) 0:00:01.987 ***** 2025-12-04 12:27:28.726889 | controller | skipping: [instance] 2025-12-04 12:27:28.727072 | controller | 2025-12-04 12:27:28.727273 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 12:27:28.727451 | controller | Thursday 04 December 2025 12:27:28 +0000 (0:00:00.057) 0:00:02.045 ***** 2025-12-04 12:27:28.783348 | controller | skipping: [instance] 2025-12-04 12:27:28.854840 | controller | 2025-12-04 12:27:28.854862 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 12:27:28.854870 | controller | Thursday 04 December 2025 12:27:28 +0000 (0:00:00.056) 0:00:02.101 ***** 2025-12-04 12:27:28.854878 | controller | skipping: [instance] 2025-12-04 12:27:28.897903 | controller | 2025-12-04 12:27:28.897927 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:28.897936 | controller | Thursday 04 December 2025 12:27:28 +0000 (0:00:00.071) 0:00:02.172 ***** 2025-12-04 12:27:28.897944 | controller | skipping: [instance] 2025-12-04 12:27:28.938721 | controller | 2025-12-04 12:27:28.938747 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:28.938754 | controller | Thursday 04 December 2025 12:27:28 +0000 (0:00:00.043) 0:00:02.216 ***** 2025-12-04 12:27:28.938763 | controller | skipping: [instance] 2025-12-04 12:27:28.976374 | controller | 2025-12-04 12:27:28.976400 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:28.976409 | controller | Thursday 04 December 2025 12:27:28 +0000 (0:00:00.039) 0:00:02.255 ***** 2025-12-04 12:27:28.976418 | controller | skipping: [instance] 2025-12-04 12:27:29.016899 | controller | 2025-12-04 12:27:29.016924 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:29.016932 | controller | Thursday 04 December 2025 12:27:28 +0000 (0:00:00.038) 0:00:02.294 ***** 2025-12-04 12:27:29.016941 | controller | ok: [instance] 2025-12-04 12:27:29.056622 | controller | 2025-12-04 12:27:29.056646 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:29.056653 | controller | Thursday 04 December 2025 12:27:29 +0000 (0:00:00.040) 0:00:02.334 ***** 2025-12-04 12:27:29.056667 | controller | ok: [instance] 2025-12-04 12:27:29.094049 | controller | 2025-12-04 12:27:29.094077 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:29.094085 | controller | Thursday 04 December 2025 12:27:29 +0000 (0:00:00.040) 0:00:02.374 ***** 2025-12-04 12:27:29.094098 | controller | ok: [instance] => 2025-12-04 12:27:29.153602 | controller | msg: 'Running: Volume, no worker' 2025-12-04 12:27:29.153622 | controller | 2025-12-04 12:27:29.153630 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:29.153636 | controller | Thursday 04 December 2025 12:27:29 +0000 (0:00:00.037) 0:00:02.412 ***** 2025-12-04 12:27:29.153660 | controller | 2025-12-04 12:27:29.236949 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:27:29.236970 | controller | Thursday 04 December 2025 12:27:29 +0000 (0:00:00.059) 0:00:02.472 ***** 2025-12-04 12:27:29.236981 | controller | ok: [instance] 2025-12-04 12:27:29.292065 | controller | 2025-12-04 12:27:29.292088 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:27:29.292095 | controller | Thursday 04 December 2025 12:27:29 +0000 (0:00:00.083) 0:00:02.555 ***** 2025-12-04 12:27:29.292104 | controller | ok: [instance] 2025-12-04 12:27:29.397360 | controller | 2025-12-04 12:27:29.397394 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:27:29.397402 | controller | Thursday 04 December 2025 12:27:29 +0000 (0:00:00.055) 0:00:02.610 ***** 2025-12-04 12:27:29.397424 | controller | ok: [instance] 2025-12-04 12:27:29.632688 | controller | 2025-12-04 12:27:29.632733 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:27:29.632750 | controller | Thursday 04 December 2025 12:27:29 +0000 (0:00:00.103) 0:00:02.714 ***** 2025-12-04 12:27:29.632760 | controller | skipping: [instance] 2025-12-04 12:27:29.682310 | controller | 2025-12-04 12:27:29.682329 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:27:29.682336 | controller | Thursday 04 December 2025 12:27:29 +0000 (0:00:00.224) 0:00:02.939 ***** 2025-12-04 12:27:29.682344 | controller | skipping: [instance] 2025-12-04 12:27:29.736400 | controller | 2025-12-04 12:27:29.736427 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:27:29.736434 | controller | Thursday 04 December 2025 12:27:29 +0000 (0:00:00.061) 0:00:03.000 ***** 2025-12-04 12:27:29.736443 | controller | ok: [instance] 2025-12-04 12:27:29.787834 | controller | 2025-12-04 12:27:29.787856 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:27:29.787870 | controller | Thursday 04 December 2025 12:27:29 +0000 (0:00:00.053) 0:00:03.054 ***** 2025-12-04 12:27:29.787879 | controller | skipping: [instance] 2025-12-04 12:27:29.861267 | controller | 2025-12-04 12:27:29.861291 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:27:29.861298 | controller | Thursday 04 December 2025 12:27:29 +0000 (0:00:00.050) 0:00:03.105 ***** 2025-12-04 12:27:29.861307 | controller | ok: [instance] 2025-12-04 12:27:29.945041 | controller | 2025-12-04 12:27:29.945063 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 12:27:29.945071 | controller | Thursday 04 December 2025 12:27:29 +0000 (0:00:00.074) 0:00:03.179 ***** 2025-12-04 12:27:29.945080 | controller | ok: [instance] 2025-12-04 12:27:30.044762 | controller | 2025-12-04 12:27:30.044794 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 12:27:30.044801 | controller | Thursday 04 December 2025 12:27:29 +0000 (0:00:00.083) 0:00:03.263 ***** 2025-12-04 12:27:30.044811 | controller | ok: [instance] => changed=false 2025-12-04 12:27:30.137556 | controller | msg: All assertions passed 2025-12-04 12:27:30.137582 | controller | 2025-12-04 12:27:30.137590 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 12:27:30.137595 | controller | Thursday 04 December 2025 12:27:30 +0000 (0:00:00.099) 0:00:03.362 ***** 2025-12-04 12:27:30.137604 | controller | ok: [instance] => changed=false 2025-12-04 12:27:30.179972 | controller | msg: All assertions passed 2025-12-04 12:27:30.179998 | controller | 2025-12-04 12:27:30.180006 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:30.180012 | controller | Thursday 04 December 2025 12:27:30 +0000 (0:00:00.089) 0:00:03.452 ***** 2025-12-04 12:27:30.180021 | controller | skipping: [instance] 2025-12-04 12:27:30.216644 | controller | 2025-12-04 12:27:30.216670 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:30.216678 | controller | Thursday 04 December 2025 12:27:30 +0000 (0:00:00.046) 0:00:03.498 ***** 2025-12-04 12:27:30.216687 | controller | skipping: [instance] 2025-12-04 12:27:30.250925 | controller | 2025-12-04 12:27:30.250945 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:30.250952 | controller | Thursday 04 December 2025 12:27:30 +0000 (0:00:00.036) 0:00:03.535 ***** 2025-12-04 12:27:30.250960 | controller | skipping: [instance] 2025-12-04 12:27:30.276208 | controller | 2025-12-04 12:27:30.276226 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:30.276233 | controller | Thursday 04 December 2025 12:27:30 +0000 (0:00:00.034) 0:00:03.569 ***** 2025-12-04 12:27:30.276241 | controller | ok: [instance] 2025-12-04 12:27:30.309028 | controller | 2025-12-04 12:27:30.309052 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:30.309067 | controller | Thursday 04 December 2025 12:27:30 +0000 (0:00:00.023) 0:00:03.593 ***** 2025-12-04 12:27:30.309076 | controller | ok: [instance] 2025-12-04 12:27:30.339439 | controller | 2025-12-04 12:27:30.339459 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:30.339483 | controller | Thursday 04 December 2025 12:27:30 +0000 (0:00:00.034) 0:00:03.627 ***** 2025-12-04 12:27:30.339492 | controller | ok: [instance] => 2025-12-04 12:27:30.392298 | controller | msg: 'Running: Volume, with worker' 2025-12-04 12:27:30.392340 | controller | 2025-12-04 12:27:30.392361 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:30.392368 | controller | Thursday 04 December 2025 12:27:30 +0000 (0:00:00.029) 0:00:03.657 ***** 2025-12-04 12:27:30.392378 | controller | 2025-12-04 12:27:30.483181 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:27:30.483225 | controller | Thursday 04 December 2025 12:27:30 +0000 (0:00:00.053) 0:00:03.710 ***** 2025-12-04 12:27:30.483238 | controller | ok: [instance] 2025-12-04 12:27:30.535199 | controller | 2025-12-04 12:27:30.535223 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:27:30.535230 | controller | Thursday 04 December 2025 12:27:30 +0000 (0:00:00.090) 0:00:03.801 ***** 2025-12-04 12:27:30.535239 | controller | ok: [instance] 2025-12-04 12:27:30.622661 | controller | 2025-12-04 12:27:30.622694 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:27:30.622701 | controller | Thursday 04 December 2025 12:27:30 +0000 (0:00:00.052) 0:00:03.853 ***** 2025-12-04 12:27:30.622710 | controller | ok: [instance] 2025-12-04 12:27:30.717647 | controller | 2025-12-04 12:27:30.717680 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:27:30.717688 | controller | Thursday 04 December 2025 12:27:30 +0000 (0:00:00.082) 0:00:03.936 ***** 2025-12-04 12:27:30.717697 | controller | ok: [instance] 2025-12-04 12:27:30.776064 | controller | 2025-12-04 12:27:30.776088 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:27:30.776096 | controller | Thursday 04 December 2025 12:27:30 +0000 (0:00:00.099) 0:00:04.036 ***** 2025-12-04 12:27:30.776106 | controller | skipping: [instance] 2025-12-04 12:27:30.831430 | controller | 2025-12-04 12:27:30.831482 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:27:30.831491 | controller | Thursday 04 December 2025 12:27:30 +0000 (0:00:00.058) 0:00:04.094 ***** 2025-12-04 12:27:30.831502 | controller | ok: [instance] 2025-12-04 12:27:30.967012 | controller | 2025-12-04 12:27:30.967044 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:27:30.967052 | controller | Thursday 04 December 2025 12:27:30 +0000 (0:00:00.053) 0:00:04.148 ***** 2025-12-04 12:27:30.967061 | controller | ok: [instance] 2025-12-04 12:27:31.069768 | controller | 2025-12-04 12:27:31.069913 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:27:31.069922 | controller | Thursday 04 December 2025 12:27:30 +0000 (0:00:00.136) 0:00:04.285 ***** 2025-12-04 12:27:31.069932 | controller | ok: [instance] 2025-12-04 12:27:31.161142 | controller | 2025-12-04 12:27:31.161184 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 12:27:31.161194 | controller | Thursday 04 December 2025 12:27:31 +0000 (0:00:00.102) 0:00:04.387 ***** 2025-12-04 12:27:31.161203 | controller | ok: [instance] 2025-12-04 12:27:31.161424 | controller | 2025-12-04 12:27:31.161644 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 12:27:31.161829 | controller | Thursday 04 December 2025 12:27:31 +0000 (0:00:00.091) 0:00:04.479 ***** 2025-12-04 12:27:31.256053 | controller | ok: [instance] => changed=false 2025-12-04 12:27:31.256263 | controller | msg: All assertions passed 2025-12-04 12:27:31.256439 | controller | 2025-12-04 12:27:31.256635 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 12:27:31.256804 | controller | Thursday 04 December 2025 12:27:31 +0000 (0:00:00.095) 0:00:04.574 ***** 2025-12-04 12:27:31.363680 | controller | ok: [instance] => changed=false 2025-12-04 12:27:31.363874 | controller | msg: All assertions passed 2025-12-04 12:27:31.364052 | controller | 2025-12-04 12:27:31.364234 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:31.364427 | controller | Thursday 04 December 2025 12:27:31 +0000 (0:00:00.107) 0:00:04.682 ***** 2025-12-04 12:27:31.412506 | controller | skipping: [instance] 2025-12-04 12:27:31.412682 | controller | 2025-12-04 12:27:31.412860 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:31.413044 | controller | Thursday 04 December 2025 12:27:31 +0000 (0:00:00.049) 0:00:04.731 ***** 2025-12-04 12:27:31.455935 | controller | skipping: [instance] 2025-12-04 12:27:31.456115 | controller | 2025-12-04 12:27:31.456318 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:31.456498 | controller | Thursday 04 December 2025 12:27:31 +0000 (0:00:00.043) 0:00:04.774 ***** 2025-12-04 12:27:31.497580 | controller | skipping: [instance] 2025-12-04 12:27:31.497785 | controller | 2025-12-04 12:27:31.497984 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:31.498181 | controller | Thursday 04 December 2025 12:27:31 +0000 (0:00:00.039) 0:00:04.814 ***** 2025-12-04 12:27:31.525447 | controller | ok: [instance] 2025-12-04 12:27:31.525650 | controller | 2025-12-04 12:27:31.525833 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:31.525991 | controller | Thursday 04 December 2025 12:27:31 +0000 (0:00:00.030) 0:00:04.844 ***** 2025-12-04 12:27:31.562173 | controller | ok: [instance] 2025-12-04 12:27:31.562389 | controller | 2025-12-04 12:27:31.562612 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:31.562802 | controller | Thursday 04 December 2025 12:27:31 +0000 (0:00:00.036) 0:00:04.880 ***** 2025-12-04 12:27:31.597971 | controller | ok: [instance] => 2025-12-04 12:27:31.598169 | controller | msg: 'Running: Too many allocated volumes' 2025-12-04 12:27:31.598377 | controller | 2025-12-04 12:27:31.598588 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:31.598785 | controller | Thursday 04 December 2025 12:27:31 +0000 (0:00:00.035) 0:00:04.916 ***** 2025-12-04 12:27:31.660642 | controller | 2025-12-04 12:27:31.660847 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:27:31.661023 | controller | Thursday 04 December 2025 12:27:31 +0000 (0:00:00.062) 0:00:04.979 ***** 2025-12-04 12:27:31.750218 | controller | ok: [instance] 2025-12-04 12:27:31.750383 | controller | 2025-12-04 12:27:31.750554 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:27:31.750706 | controller | Thursday 04 December 2025 12:27:31 +0000 (0:00:00.089) 0:00:05.068 ***** 2025-12-04 12:27:31.807389 | controller | ok: [instance] 2025-12-04 12:27:31.807594 | controller | 2025-12-04 12:27:31.807780 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:27:31.807960 | controller | Thursday 04 December 2025 12:27:31 +0000 (0:00:00.057) 0:00:05.125 ***** 2025-12-04 12:27:31.904267 | controller | ok: [instance] 2025-12-04 12:27:31.904486 | controller | 2025-12-04 12:27:31.904686 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:27:31.904869 | controller | Thursday 04 December 2025 12:27:31 +0000 (0:00:00.097) 0:00:05.222 ***** 2025-12-04 12:27:31.956911 | controller | skipping: [instance] 2025-12-04 12:27:31.957112 | controller | 2025-12-04 12:27:31.957340 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:27:31.957552 | controller | Thursday 04 December 2025 12:27:31 +0000 (0:00:00.052) 0:00:05.275 ***** 2025-12-04 12:27:32.015134 | controller | skipping: [instance] 2025-12-04 12:27:32.015354 | controller | 2025-12-04 12:27:32.015545 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:27:32.015716 | controller | Thursday 04 December 2025 12:27:32 +0000 (0:00:00.058) 0:00:05.333 ***** 2025-12-04 12:27:32.146008 | controller | ok: [instance] 2025-12-04 12:27:32.146166 | controller | 2025-12-04 12:27:32.146346 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:27:32.146513 | controller | Thursday 04 December 2025 12:27:32 +0000 (0:00:00.130) 0:00:05.464 ***** 2025-12-04 12:27:32.211041 | controller | skipping: [instance] 2025-12-04 12:27:32.211263 | controller | 2025-12-04 12:27:32.211455 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:27:32.211619 | controller | Thursday 04 December 2025 12:27:32 +0000 (0:00:00.054) 0:00:05.519 ***** 2025-12-04 12:27:32.307699 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:32.307868 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2025-12-04 12:27:32.308020 | controller | evaluated_to: false 2025-12-04 12:27:32.308177 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 3' 2025-12-04 12:27:32.387074 | controller | 2025-12-04 12:27:32.389686 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:27:32.389883 | controller | Thursday 04 December 2025 12:27:32 +0000 (0:00:00.168) 0:00:05.687 ***** 2025-12-04 12:27:32.390042 | controller | 2025-12-04 12:27:32.390187 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:32.390357 | controller | Thursday 04 December 2025 12:27:32 +0000 (0:00:00.017) 0:00:05.705 ***** 2025-12-04 12:27:32.426861 | controller | ok: [instance] 2025-12-04 12:27:32.427064 | controller | 2025-12-04 12:27:32.427216 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:32.427398 | controller | Thursday 04 December 2025 12:27:32 +0000 (0:00:00.039) 0:00:05.745 ***** 2025-12-04 12:27:32.470646 | controller | skipping: [instance] 2025-12-04 12:27:32.470815 | controller | 2025-12-04 12:27:32.470971 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:32.471113 | controller | Thursday 04 December 2025 12:27:32 +0000 (0:00:00.042) 0:00:05.788 ***** 2025-12-04 12:27:32.510244 | controller | skipping: [instance] 2025-12-04 12:27:32.510451 | controller | 2025-12-04 12:27:32.510651 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:32.510837 | controller | Thursday 04 December 2025 12:27:32 +0000 (0:00:00.041) 0:00:05.829 ***** 2025-12-04 12:27:32.547877 | controller | skipping: [instance] 2025-12-04 12:27:32.548035 | controller | 2025-12-04 12:27:32.548182 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:32.548359 | controller | Thursday 04 December 2025 12:27:32 +0000 (0:00:00.036) 0:00:05.865 ***** 2025-12-04 12:27:32.573337 | controller | ok: [instance] 2025-12-04 12:27:32.604001 | controller | 2025-12-04 12:27:32.604025 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:32.604036 | controller | Thursday 04 December 2025 12:27:32 +0000 (0:00:00.026) 0:00:05.891 ***** 2025-12-04 12:27:32.604046 | controller | ok: [instance] 2025-12-04 12:27:32.642298 | controller | 2025-12-04 12:27:32.642326 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:32.642335 | controller | Thursday 04 December 2025 12:27:32 +0000 (0:00:00.030) 0:00:05.922 ***** 2025-12-04 12:27:32.642343 | controller | ok: [instance] => 2025-12-04 12:27:32.687904 | controller | msg: 'Running: Different volume amount' 2025-12-04 12:27:32.687923 | controller | 2025-12-04 12:27:32.687930 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:32.687935 | controller | Thursday 04 December 2025 12:27:32 +0000 (0:00:00.038) 0:00:05.960 ***** 2025-12-04 12:27:32.687943 | controller | 2025-12-04 12:27:32.753690 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:27:32.753709 | controller | Thursday 04 December 2025 12:27:32 +0000 (0:00:00.046) 0:00:06.006 ***** 2025-12-04 12:27:32.753719 | controller | ok: [instance] 2025-12-04 12:27:32.806242 | controller | 2025-12-04 12:27:32.806279 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:27:32.806287 | controller | Thursday 04 December 2025 12:27:32 +0000 (0:00:00.065) 0:00:06.072 ***** 2025-12-04 12:27:32.806295 | controller | ok: [instance] 2025-12-04 12:27:32.888157 | controller | 2025-12-04 12:27:32.888199 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:27:32.888208 | controller | Thursday 04 December 2025 12:27:32 +0000 (0:00:00.050) 0:00:06.122 ***** 2025-12-04 12:27:32.888218 | controller | ok: [instance] 2025-12-04 12:27:32.967260 | controller | 2025-12-04 12:27:32.967301 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:27:32.967330 | controller | Thursday 04 December 2025 12:27:32 +0000 (0:00:00.083) 0:00:06.206 ***** 2025-12-04 12:27:32.967341 | controller | ok: [instance] 2025-12-04 12:27:33.013450 | controller | 2025-12-04 12:27:33.013500 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:27:33.013509 | controller | Thursday 04 December 2025 12:27:32 +0000 (0:00:00.079) 0:00:06.285 ***** 2025-12-04 12:27:33.013524 | controller | skipping: [instance] 2025-12-04 12:27:33.013711 | controller | 2025-12-04 12:27:33.013908 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:27:33.014094 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.046) 0:00:06.331 ***** 2025-12-04 12:27:33.072818 | controller | ok: [instance] 2025-12-04 12:27:33.073029 | controller | 2025-12-04 12:27:33.073217 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:27:33.073417 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.059) 0:00:06.391 ***** 2025-12-04 12:27:33.129299 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:33.129781 | controller | assertion: (_work.extra_disks_num is defined and _ocp.extra_disks_num == _work.extra_disks_num and _ocp.extra_disks_size is defined and _work.extra_disks_size is defined and _ocp.extra_disks_size == _work.extra_disks_size) or _ocp.extra_disks_num is undefined or _ocp.extra_disks_num == 0 2025-12-04 12:27:33.130082 | controller | evaluated_to: false 2025-12-04 12:27:33.130313 | controller | msg: 'Inconsistency detected: ensure you don''t allocate more disks in cifmw_lvms_disk_list and cifmw_devscripts_cinder_volume_pvs than available.' 2025-12-04 12:27:33.159398 | controller | 2025-12-04 12:27:33.159612 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:27:33.159821 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.068) 0:00:06.459 ***** 2025-12-04 12:27:33.159988 | controller | 2025-12-04 12:27:33.160161 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:33.160357 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.018) 0:00:06.477 ***** 2025-12-04 12:27:33.189499 | controller | ok: [instance] 2025-12-04 12:27:33.189685 | controller | 2025-12-04 12:27:33.189890 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:33.190085 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.029) 0:00:06.507 ***** 2025-12-04 12:27:33.233833 | controller | skipping: [instance] 2025-12-04 12:27:33.234032 | controller | 2025-12-04 12:27:33.234211 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:33.234416 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.045) 0:00:06.552 ***** 2025-12-04 12:27:33.275209 | controller | skipping: [instance] 2025-12-04 12:27:33.275399 | controller | 2025-12-04 12:27:33.275566 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:33.275710 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.040) 0:00:06.592 ***** 2025-12-04 12:27:33.348576 | controller | skipping: [instance] 2025-12-04 12:27:33.348805 | controller | 2025-12-04 12:27:33.348991 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:33.349201 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.074) 0:00:06.667 ***** 2025-12-04 12:27:33.379209 | controller | ok: [instance] 2025-12-04 12:27:33.379431 | controller | 2025-12-04 12:27:33.379636 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:33.379835 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.030) 0:00:06.697 ***** 2025-12-04 12:27:33.416870 | controller | ok: [instance] 2025-12-04 12:27:33.417072 | controller | 2025-12-04 12:27:33.417280 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:33.417490 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.037) 0:00:06.735 ***** 2025-12-04 12:27:33.451301 | controller | ok: [instance] => 2025-12-04 12:27:33.451516 | controller | msg: 'Running: Create LVM without volume' 2025-12-04 12:27:33.451676 | controller | 2025-12-04 12:27:33.451845 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:33.452037 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.034) 0:00:06.769 ***** 2025-12-04 12:27:33.503320 | controller | 2025-12-04 12:27:33.503604 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:27:33.503797 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.051) 0:00:06.821 ***** 2025-12-04 12:27:33.584161 | controller | ok: [instance] 2025-12-04 12:27:33.584423 | controller | 2025-12-04 12:27:33.584646 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:27:33.584839 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.079) 0:00:06.901 ***** 2025-12-04 12:27:33.633479 | controller | ok: [instance] 2025-12-04 12:27:33.633680 | controller | 2025-12-04 12:27:33.633862 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:27:33.634072 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.051) 0:00:06.952 ***** 2025-12-04 12:27:33.743142 | controller | ok: [instance] 2025-12-04 12:27:33.743335 | controller | 2025-12-04 12:27:33.743506 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:27:33.743655 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.109) 0:00:07.061 ***** 2025-12-04 12:27:33.791820 | controller | skipping: [instance] 2025-12-04 12:27:33.792022 | controller | 2025-12-04 12:27:33.792178 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:27:33.792360 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.047) 0:00:07.109 ***** 2025-12-04 12:27:33.831715 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:33.831887 | controller | assertion: not cifmw_devscripts_create_logical_volume | bool 2025-12-04 12:27:33.832063 | controller | evaluated_to: false 2025-12-04 12:27:33.832227 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2025-12-04 12:27:33.859659 | controller | 2025-12-04 12:27:33.859826 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:27:33.859993 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.052) 0:00:07.161 ***** 2025-12-04 12:27:33.860130 | controller | 2025-12-04 12:27:33.860296 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:33.860449 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.016) 0:00:07.178 ***** 2025-12-04 12:27:33.884668 | controller | ok: [instance] 2025-12-04 12:27:33.884861 | controller | 2025-12-04 12:27:33.885068 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:33.885322 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.024) 0:00:07.202 ***** 2025-12-04 12:27:33.938270 | controller | skipping: [instance] 2025-12-04 12:27:33.988515 | controller | 2025-12-04 12:27:33.988539 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:33.988550 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.053) 0:00:07.256 ***** 2025-12-04 12:27:33.988559 | controller | skipping: [instance] 2025-12-04 12:27:34.036183 | controller | 2025-12-04 12:27:34.036205 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:34.036214 | controller | Thursday 04 December 2025 12:27:33 +0000 (0:00:00.050) 0:00:07.306 ***** 2025-12-04 12:27:34.036223 | controller | skipping: [instance] 2025-12-04 12:27:34.065834 | controller | 2025-12-04 12:27:34.065855 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:34.065870 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.047) 0:00:07.354 ***** 2025-12-04 12:27:34.065881 | controller | ok: [instance] 2025-12-04 12:27:34.097902 | controller | 2025-12-04 12:27:34.097928 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:34.097937 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.028) 0:00:07.383 ***** 2025-12-04 12:27:34.097946 | controller | ok: [instance] 2025-12-04 12:27:34.127312 | controller | 2025-12-04 12:27:34.127345 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:34.127354 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.031) 0:00:07.415 ***** 2025-12-04 12:27:34.127368 | controller | ok: [instance] => 2025-12-04 12:27:34.177565 | controller | msg: 'Running: Create LVMS without volume' 2025-12-04 12:27:34.177587 | controller | 2025-12-04 12:27:34.177602 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:34.177609 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.030) 0:00:07.445 ***** 2025-12-04 12:27:34.177618 | controller | 2025-12-04 12:27:34.248799 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:27:34.248822 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.050) 0:00:07.496 ***** 2025-12-04 12:27:34.248834 | controller | ok: [instance] 2025-12-04 12:27:34.333601 | controller | 2025-12-04 12:27:34.333629 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:27:34.333637 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.070) 0:00:07.567 ***** 2025-12-04 12:27:34.333646 | controller | ok: [instance] 2025-12-04 12:27:34.422642 | controller | 2025-12-04 12:27:34.422663 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:27:34.422671 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.084) 0:00:07.651 ***** 2025-12-04 12:27:34.422686 | controller | ok: [instance] 2025-12-04 12:27:34.476169 | controller | 2025-12-04 12:27:34.476209 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:27:34.476220 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.086) 0:00:07.737 ***** 2025-12-04 12:27:34.476231 | controller | skipping: [instance] 2025-12-04 12:27:34.527118 | controller | 2025-12-04 12:27:34.527140 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:27:34.527154 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.056) 0:00:07.794 ***** 2025-12-04 12:27:34.527168 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:34.560201 | controller | assertion: cifmw_lvms_disk_list is undefined or (cifmw_lvms_disk_list | length) == 0 2025-12-04 12:27:34.560230 | controller | evaluated_to: false 2025-12-04 12:27:34.560239 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2025-12-04 12:27:34.560273 | controller | 2025-12-04 12:27:34.596481 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:27:34.596501 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.064) 0:00:07.858 ***** 2025-12-04 12:27:34.596513 | controller | 2025-12-04 12:27:34.596520 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:34.596526 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.019) 0:00:07.878 ***** 2025-12-04 12:27:34.596534 | controller | ok: [instance] 2025-12-04 12:27:34.672882 | controller | 2025-12-04 12:27:34.672920 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:34.672929 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.036) 0:00:07.914 ***** 2025-12-04 12:27:34.672939 | controller | skipping: [instance] 2025-12-04 12:27:34.732732 | controller | 2025-12-04 12:27:34.732758 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:34.732767 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.076) 0:00:07.990 ***** 2025-12-04 12:27:34.732790 | controller | skipping: [instance] 2025-12-04 12:27:34.768931 | controller | 2025-12-04 12:27:34.768970 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:34.768990 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.049) 0:00:08.040 ***** 2025-12-04 12:27:34.768999 | controller | skipping: [instance] 2025-12-04 12:27:34.814854 | controller | 2025-12-04 12:27:34.814874 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:34.814909 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.043) 0:00:08.084 ***** 2025-12-04 12:27:34.814929 | controller | ok: [instance] 2025-12-04 12:27:34.815131 | controller | 2025-12-04 12:27:34.815387 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:34.815661 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.045) 0:00:08.130 ***** 2025-12-04 12:27:34.853406 | controller | ok: [instance] 2025-12-04 12:27:34.853600 | controller | 2025-12-04 12:27:34.853751 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:34.853908 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.042) 0:00:08.172 ***** 2025-12-04 12:27:34.890380 | controller | ok: [instance] => 2025-12-04 12:27:34.890588 | controller | msg: 'Running: Allocate same volume twice' 2025-12-04 12:27:34.890763 | controller | 2025-12-04 12:27:34.890971 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:34.891155 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.036) 0:00:08.209 ***** 2025-12-04 12:27:34.946097 | controller | 2025-12-04 12:27:34.946383 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:27:34.946626 | controller | Thursday 04 December 2025 12:27:34 +0000 (0:00:00.055) 0:00:08.264 ***** 2025-12-04 12:27:35.023842 | controller | ok: [instance] 2025-12-04 12:27:35.024079 | controller | 2025-12-04 12:27:35.024335 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:27:35.024585 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.076) 0:00:08.340 ***** 2025-12-04 12:27:35.078958 | controller | ok: [instance] 2025-12-04 12:27:35.079153 | controller | 2025-12-04 12:27:35.079363 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:27:35.079711 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.056) 0:00:08.397 ***** 2025-12-04 12:27:35.256127 | controller | ok: [instance] 2025-12-04 12:27:35.256369 | controller | 2025-12-04 12:27:35.256540 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:27:35.256695 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.176) 0:00:08.574 ***** 2025-12-04 12:27:35.309728 | controller | skipping: [instance] 2025-12-04 12:27:35.311663 | controller | 2025-12-04 12:27:35.365850 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:27:35.365886 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.052) 0:00:08.626 ***** 2025-12-04 12:27:35.365912 | controller | skipping: [instance] 2025-12-04 12:27:35.366082 | controller | 2025-12-04 12:27:35.366269 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:27:35.366417 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.057) 0:00:08.684 ***** 2025-12-04 12:27:35.422766 | controller | ok: [instance] 2025-12-04 12:27:35.422950 | controller | 2025-12-04 12:27:35.423109 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:27:35.423274 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.056) 0:00:08.741 ***** 2025-12-04 12:27:35.474242 | controller | skipping: [instance] 2025-12-04 12:27:35.474456 | controller | 2025-12-04 12:27:35.474654 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:27:35.474830 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.051) 0:00:08.792 ***** 2025-12-04 12:27:35.538818 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:35.539008 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2025-12-04 12:27:35.539145 | controller | evaluated_to: false 2025-12-04 12:27:35.539315 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 4' 2025-12-04 12:27:35.593281 | controller | 2025-12-04 12:27:35.593497 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:27:35.593656 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.103) 0:00:08.896 ***** 2025-12-04 12:27:35.593794 | controller | 2025-12-04 12:27:35.593933 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:35.594084 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.015) 0:00:08.912 ***** 2025-12-04 12:27:35.620715 | controller | ok: [instance] 2025-12-04 12:27:35.620879 | controller | 2025-12-04 12:27:35.621054 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:35.621200 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.027) 0:00:08.939 ***** 2025-12-04 12:27:35.660239 | controller | skipping: [instance] 2025-12-04 12:27:35.660435 | controller | 2025-12-04 12:27:35.660614 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:35.660761 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.039) 0:00:08.979 ***** 2025-12-04 12:27:35.702206 | controller | skipping: [instance] 2025-12-04 12:27:35.702452 | controller | 2025-12-04 12:27:35.702688 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:35.702918 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.041) 0:00:09.020 ***** 2025-12-04 12:27:35.749353 | controller | skipping: [instance] 2025-12-04 12:27:35.749578 | controller | 2025-12-04 12:27:35.749786 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:35.749985 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.044) 0:00:09.065 ***** 2025-12-04 12:27:35.776926 | controller | ok: [instance] 2025-12-04 12:27:35.777133 | controller | 2025-12-04 12:27:35.777355 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:35.777564 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.029) 0:00:09.095 ***** 2025-12-04 12:27:35.814962 | controller | ok: [instance] 2025-12-04 12:27:35.845532 | controller | 2025-12-04 12:27:35.845562 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:35.845570 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.035) 0:00:09.131 ***** 2025-12-04 12:27:35.845584 | controller | ok: [instance] => 2025-12-04 12:27:35.895713 | controller | msg: 'Running: Allocate same volume twice - no LVMS' 2025-12-04 12:27:35.895733 | controller | 2025-12-04 12:27:35.895741 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:35.895747 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.032) 0:00:09.163 ***** 2025-12-04 12:27:35.895756 | controller | 2025-12-04 12:27:35.969275 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:27:35.969305 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.050) 0:00:09.214 ***** 2025-12-04 12:27:35.969319 | controller | ok: [instance] 2025-12-04 12:27:36.023794 | controller | 2025-12-04 12:27:36.023816 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:27:36.023825 | controller | Thursday 04 December 2025 12:27:35 +0000 (0:00:00.073) 0:00:09.287 ***** 2025-12-04 12:27:36.023834 | controller | ok: [instance] 2025-12-04 12:27:36.113028 | controller | 2025-12-04 12:27:36.113051 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:27:36.113059 | controller | Thursday 04 December 2025 12:27:36 +0000 (0:00:00.051) 0:00:09.339 ***** 2025-12-04 12:27:36.113068 | controller | ok: [instance] 2025-12-04 12:27:36.161687 | controller | 2025-12-04 12:27:36.161710 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:27:36.161719 | controller | Thursday 04 December 2025 12:27:36 +0000 (0:00:00.089) 0:00:09.429 ***** 2025-12-04 12:27:36.161728 | controller | skipping: [instance] 2025-12-04 12:27:36.161934 | controller | 2025-12-04 12:27:36.162119 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:27:36.162323 | controller | Thursday 04 December 2025 12:27:36 +0000 (0:00:00.049) 0:00:09.479 ***** 2025-12-04 12:27:36.217524 | controller | skipping: [instance] 2025-12-04 12:27:36.217692 | controller | 2025-12-04 12:27:36.217842 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:27:36.217984 | controller | Thursday 04 December 2025 12:27:36 +0000 (0:00:00.054) 0:00:09.533 ***** 2025-12-04 12:27:36.277569 | controller | ok: [instance] 2025-12-04 12:27:36.277731 | controller | 2025-12-04 12:27:36.277916 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:27:36.278086 | controller | Thursday 04 December 2025 12:27:36 +0000 (0:00:00.062) 0:00:09.596 ***** 2025-12-04 12:27:36.343081 | controller | skipping: [instance] 2025-12-04 12:27:36.343304 | controller | 2025-12-04 12:27:36.343487 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:27:36.343634 | controller | Thursday 04 December 2025 12:27:36 +0000 (0:00:00.065) 0:00:09.661 ***** 2025-12-04 12:27:36.456125 | controller | ok: [instance] 2025-12-04 12:27:36.456380 | controller | 2025-12-04 12:27:36.456577 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 12:27:36.456742 | controller | Thursday 04 December 2025 12:27:36 +0000 (0:00:00.112) 0:00:09.774 ***** 2025-12-04 12:27:36.516698 | controller | skipping: [instance] 2025-12-04 12:27:36.610452 | controller | 2025-12-04 12:27:36.610522 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 12:27:36.610532 | controller | Thursday 04 December 2025 12:27:36 +0000 (0:00:00.060) 0:00:09.835 ***** 2025-12-04 12:27:36.610544 | controller | ok: [instance] => changed=false 2025-12-04 12:27:36.611173 | controller | msg: All assertions passed 2025-12-04 12:27:36.611192 | controller | 2025-12-04 12:27:36.611199 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 12:27:36.611209 | controller | Thursday 04 December 2025 12:27:36 +0000 (0:00:00.093) 0:00:09.928 ***** 2025-12-04 12:27:36.776042 | controller | ok: [instance] => changed=false 2025-12-04 12:27:36.829763 | controller | msg: All assertions passed 2025-12-04 12:27:36.829792 | controller | 2025-12-04 12:27:36.829800 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:36.829808 | controller | Thursday 04 December 2025 12:27:36 +0000 (0:00:00.165) 0:00:10.094 ***** 2025-12-04 12:27:36.829820 | controller | skipping: [instance] 2025-12-04 12:27:36.892522 | controller | 2025-12-04 12:27:36.892552 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:36.892566 | controller | Thursday 04 December 2025 12:27:36 +0000 (0:00:00.050) 0:00:10.144 ***** 2025-12-04 12:27:36.892578 | controller | skipping: [instance] 2025-12-04 12:27:36.946122 | controller | 2025-12-04 12:27:36.946155 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:36.946170 | controller | Thursday 04 December 2025 12:27:36 +0000 (0:00:00.065) 0:00:10.210 ***** 2025-12-04 12:27:36.946181 | controller | skipping: [instance] 2025-12-04 12:27:36.946345 | controller | 2025-12-04 12:27:36.946558 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:36.946670 | controller | Thursday 04 December 2025 12:27:36 +0000 (0:00:00.054) 0:00:10.264 ***** 2025-12-04 12:27:36.993834 | controller | ok: [instance] 2025-12-04 12:27:36.994000 | controller | 2025-12-04 12:27:36.994136 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:36.994303 | controller | Thursday 04 December 2025 12:27:36 +0000 (0:00:00.045) 0:00:10.310 ***** 2025-12-04 12:27:37.029614 | controller | ok: [instance] 2025-12-04 12:27:37.029752 | controller | 2025-12-04 12:27:37.029911 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:37.030139 | controller | Thursday 04 December 2025 12:27:37 +0000 (0:00:00.037) 0:00:10.348 ***** 2025-12-04 12:27:37.075413 | controller | ok: [instance] => 2025-12-04 12:27:37.123522 | controller | msg: 'Running: Allocate same volume twice - no cinder_lvm' 2025-12-04 12:27:37.123547 | controller | 2025-12-04 12:27:37.123555 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:37.123561 | controller | Thursday 04 December 2025 12:27:37 +0000 (0:00:00.045) 0:00:10.393 ***** 2025-12-04 12:27:37.123572 | controller | 2025-12-04 12:27:37.241703 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:27:37.241740 | controller | Thursday 04 December 2025 12:27:37 +0000 (0:00:00.048) 0:00:10.442 ***** 2025-12-04 12:27:37.241755 | controller | ok: [instance] 2025-12-04 12:27:37.316012 | controller | 2025-12-04 12:27:37.316051 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:27:37.316066 | controller | Thursday 04 December 2025 12:27:37 +0000 (0:00:00.114) 0:00:10.556 ***** 2025-12-04 12:27:37.316077 | controller | ok: [instance] 2025-12-04 12:27:37.406505 | controller | 2025-12-04 12:27:37.406532 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:27:37.406540 | controller | Thursday 04 December 2025 12:27:37 +0000 (0:00:00.078) 0:00:10.634 ***** 2025-12-04 12:27:37.406552 | controller | ok: [instance] 2025-12-04 12:27:37.480519 | controller | 2025-12-04 12:27:37.480560 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:27:37.480570 | controller | Thursday 04 December 2025 12:27:37 +0000 (0:00:00.090) 0:00:10.724 ***** 2025-12-04 12:27:37.480582 | controller | skipping: [instance] 2025-12-04 12:27:37.600238 | controller | 2025-12-04 12:27:37.600288 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:27:37.600298 | controller | Thursday 04 December 2025 12:27:37 +0000 (0:00:00.073) 0:00:10.798 ***** 2025-12-04 12:27:37.600310 | controller | skipping: [instance] 2025-12-04 12:27:37.664095 | controller | 2025-12-04 12:27:37.664123 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:27:37.664132 | controller | Thursday 04 December 2025 12:27:37 +0000 (0:00:00.119) 0:00:10.918 ***** 2025-12-04 12:27:37.664162 | controller | ok: [instance] 2025-12-04 12:27:37.739586 | controller | 2025-12-04 12:27:37.739621 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:27:37.739630 | controller | Thursday 04 December 2025 12:27:37 +0000 (0:00:00.064) 0:00:10.982 ***** 2025-12-04 12:27:37.739642 | controller | skipping: [instance] 2025-12-04 12:27:37.836488 | controller | 2025-12-04 12:27:37.836562 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:27:37.836571 | controller | Thursday 04 December 2025 12:27:37 +0000 (0:00:00.075) 0:00:11.057 ***** 2025-12-04 12:27:37.836586 | controller | ok: [instance] 2025-12-04 12:27:37.902626 | controller | 2025-12-04 12:27:37.902727 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 12:27:37.902739 | controller | Thursday 04 December 2025 12:27:37 +0000 (0:00:00.095) 0:00:11.153 ***** 2025-12-04 12:27:37.902757 | controller | skipping: [instance] 2025-12-04 12:27:37.991911 | controller | 2025-12-04 12:27:37.991968 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 12:27:37.991978 | controller | Thursday 04 December 2025 12:27:37 +0000 (0:00:00.065) 0:00:11.219 ***** 2025-12-04 12:27:37.991991 | controller | ok: [instance] => changed=false 2025-12-04 12:27:37.992419 | controller | msg: All assertions passed 2025-12-04 12:27:37.992471 | controller | 2025-12-04 12:27:37.992480 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 12:27:37.992490 | controller | Thursday 04 December 2025 12:27:37 +0000 (0:00:00.090) 0:00:11.310 ***** 2025-12-04 12:27:38.058538 | controller | skipping: [instance] 2025-12-04 12:27:38.058783 | controller | 2025-12-04 12:27:38.058952 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:38.062294 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.056) 0:00:11.366 ***** 2025-12-04 12:27:38.103501 | controller | skipping: [instance] 2025-12-04 12:27:38.103703 | controller | 2025-12-04 12:27:38.103872 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:38.104089 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.055) 0:00:11.422 ***** 2025-12-04 12:27:38.186184 | controller | skipping: [instance] 2025-12-04 12:27:38.186410 | controller | 2025-12-04 12:27:38.186586 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:38.186758 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.082) 0:00:11.504 ***** 2025-12-04 12:27:38.227335 | controller | skipping: [instance] 2025-12-04 12:27:38.227555 | controller | 2025-12-04 12:27:38.227774 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:38.228552 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.039) 0:00:11.544 ***** 2025-12-04 12:27:38.255850 | controller | ok: [instance] 2025-12-04 12:27:38.256013 | controller | 2025-12-04 12:27:38.256190 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:38.256366 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.030) 0:00:11.574 ***** 2025-12-04 12:27:38.285619 | controller | ok: [instance] 2025-12-04 12:27:38.285834 | controller | 2025-12-04 12:27:38.285990 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:38.288152 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.029) 0:00:11.604 ***** 2025-12-04 12:27:38.313699 | controller | ok: [instance] => 2025-12-04 12:27:38.313730 | controller | msg: 'Running: Config overrides via devscripts' 2025-12-04 12:27:38.313924 | controller | 2025-12-04 12:27:38.314069 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:38.314279 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.028) 0:00:11.632 ***** 2025-12-04 12:27:38.358106 | controller | 2025-12-04 12:27:38.358323 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:27:38.358719 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.044) 0:00:11.676 ***** 2025-12-04 12:27:38.397181 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:38.397353 | controller | assertion: cifmw_devscripts_config.master_memory is undefined 2025-12-04 12:27:38.397530 | controller | evaluated_to: false 2025-12-04 12:27:38.401018 | controller | msg: 'Inconsistency detected: your environment wants to provide devscripts configuration overrides. This isn''t supported, and you must pass those ressource allocation via the usual cifmw_libvirt_manager_configuration, or patch it.' 2025-12-04 12:27:38.420912 | controller | 2025-12-04 12:27:38.421124 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:27:38.421273 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.045) 0:00:11.722 ***** 2025-12-04 12:27:38.421428 | controller | 2025-12-04 12:27:38.421621 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:38.421836 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.017) 0:00:11.739 ***** 2025-12-04 12:27:38.448579 | controller | ok: [instance] 2025-12-04 12:27:38.448752 | controller | 2025-12-04 12:27:38.448934 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:38.449081 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.027) 0:00:11.767 ***** 2025-12-04 12:27:38.489363 | controller | skipping: [instance] 2025-12-04 12:27:38.489557 | controller | 2025-12-04 12:27:38.489734 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:38.489933 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.039) 0:00:11.806 ***** 2025-12-04 12:27:38.523069 | controller | skipping: [instance] 2025-12-04 12:27:38.523204 | controller | 2025-12-04 12:27:38.523409 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:38.523572 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.034) 0:00:11.841 ***** 2025-12-04 12:27:38.558061 | controller | skipping: [instance] 2025-12-04 12:27:38.558195 | controller | 2025-12-04 12:27:38.558370 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:38.558572 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.034) 0:00:11.875 ***** 2025-12-04 12:27:38.580908 | controller | ok: [instance] 2025-12-04 12:27:38.581111 | controller | 2025-12-04 12:27:38.581221 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:38.581396 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.023) 0:00:11.899 ***** 2025-12-04 12:27:38.609695 | controller | ok: [instance] 2025-12-04 12:27:38.609849 | controller | 2025-12-04 12:27:38.610049 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:38.610233 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.028) 0:00:11.928 ***** 2025-12-04 12:27:38.636525 | controller | ok: [instance] => 2025-12-04 12:27:38.636691 | controller | msg: 'Running: Inject 10 dev-scripts extra_worker' 2025-12-04 12:27:38.636844 | controller | 2025-12-04 12:27:38.637008 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:38.637176 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.026) 0:00:11.955 ***** 2025-12-04 12:27:38.677280 | controller | 2025-12-04 12:27:38.677479 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:27:38.677619 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.040) 0:00:11.996 ***** 2025-12-04 12:27:38.759753 | controller | ok: [instance] 2025-12-04 12:27:38.797576 | controller | 2025-12-04 12:27:38.797612 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:27:38.797620 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.081) 0:00:12.077 ***** 2025-12-04 12:27:38.797632 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 12:27:38.824054 | controller | assertion: cifmw_devscripts_config.num_extra_workers is undefined or cifmw_devscripts_config.num_extra_workers == 0 2025-12-04 12:27:38.824082 | controller | evaluated_to: false 2025-12-04 12:27:38.824100 | controller | msg: 'Inconsistency detected: dev-scripts extra_worker resources aren''t supported here. You can create compute, networker or any other kind of VM by defining it as you define OCP cluster nodes.' 2025-12-04 12:27:38.824112 | controller | 2025-12-04 12:27:38.848633 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 12:27:38.848658 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.049) 0:00:12.127 ***** 2025-12-04 12:27:38.848666 | controller | 2025-12-04 12:27:38.848672 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:38.848678 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.015) 0:00:12.142 ***** 2025-12-04 12:27:38.848688 | controller | ok: [instance] 2025-12-04 12:27:38.901372 | controller | 2025-12-04 12:27:38.901433 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:38.901443 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.024) 0:00:12.167 ***** 2025-12-04 12:27:38.901455 | controller | skipping: [instance] 2025-12-04 12:27:38.990404 | controller | 2025-12-04 12:27:38.990445 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:38.990454 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.052) 0:00:12.219 ***** 2025-12-04 12:27:38.990476 | controller | skipping: [instance] 2025-12-04 12:27:39.032401 | controller | 2025-12-04 12:27:39.032439 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:39.032448 | controller | Thursday 04 December 2025 12:27:38 +0000 (0:00:00.089) 0:00:12.308 ***** 2025-12-04 12:27:39.032461 | controller | skipping: [instance] 2025-12-04 12:27:39.062193 | controller | 2025-12-04 12:27:39.062217 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 12:27:39.062225 | controller | Thursday 04 December 2025 12:27:39 +0000 (0:00:00.038) 0:00:12.347 ***** 2025-12-04 12:27:39.062237 | controller | ok: [instance] 2025-12-04 12:27:39.062431 | controller | 2025-12-04 12:27:39.062614 | controller | TASK [Load environment file] *************************************************** 2025-12-04 12:27:39.062773 | controller | Thursday 04 December 2025 12:27:39 +0000 (0:00:00.033) 0:00:12.381 ***** 2025-12-04 12:27:39.100186 | controller | ok: [instance] 2025-12-04 12:27:39.100585 | controller | 2025-12-04 12:27:39.100604 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 12:27:39.100615 | controller | Thursday 04 December 2025 12:27:39 +0000 (0:00:00.037) 0:00:12.418 ***** 2025-12-04 12:27:39.135495 | controller | ok: [instance] => 2025-12-04 12:27:39.135518 | controller | msg: 'Running: Inject 0 dev-scripts extra_worker' 2025-12-04 12:27:39.135526 | controller | 2025-12-04 12:27:39.135532 | controller | TASK [Validate data] *********************************************************** 2025-12-04 12:27:39.135548 | controller | Thursday 04 December 2025 12:27:39 +0000 (0:00:00.034) 0:00:12.453 ***** 2025-12-04 12:27:39.201418 | controller | 2025-12-04 12:27:39.279979 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 12:27:39.280031 | controller | Thursday 04 December 2025 12:27:39 +0000 (0:00:00.066) 0:00:12.519 ***** 2025-12-04 12:27:39.280046 | controller | ok: [instance] 2025-12-04 12:27:39.362580 | controller | 2025-12-04 12:27:39.362736 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 12:27:39.362751 | controller | Thursday 04 December 2025 12:27:39 +0000 (0:00:00.078) 0:00:12.598 ***** 2025-12-04 12:27:39.362768 | controller | ok: [instance] 2025-12-04 12:27:39.476080 | controller | 2025-12-04 12:27:39.476178 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 12:27:39.476189 | controller | Thursday 04 December 2025 12:27:39 +0000 (0:00:00.075) 0:00:12.673 ***** 2025-12-04 12:27:39.476205 | controller | ok: [instance] 2025-12-04 12:27:39.476430 | controller | 2025-12-04 12:27:39.476455 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 12:27:39.549182 | controller | Thursday 04 December 2025 12:27:39 +0000 (0:00:00.120) 0:00:12.793 ***** 2025-12-04 12:27:39.549234 | controller | skipping: [instance] 2025-12-04 12:27:39.620359 | controller | 2025-12-04 12:27:39.620393 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 12:27:39.620404 | controller | Thursday 04 December 2025 12:27:39 +0000 (0:00:00.073) 0:00:12.867 ***** 2025-12-04 12:27:39.620415 | controller | ok: [instance] 2025-12-04 12:27:39.620608 | controller | 2025-12-04 12:27:39.620798 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 12:27:39.621013 | controller | Thursday 04 December 2025 12:27:39 +0000 (0:00:00.071) 0:00:12.938 ***** 2025-12-04 12:27:39.676463 | controller | skipping: [instance] 2025-12-04 12:27:39.726199 | controller | 2025-12-04 12:27:39.726240 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 12:27:39.726265 | controller | Thursday 04 December 2025 12:27:39 +0000 (0:00:00.055) 0:00:12.994 ***** 2025-12-04 12:27:39.726279 | controller | skipping: [instance] 2025-12-04 12:27:39.726362 | controller | 2025-12-04 12:27:39.726375 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 12:27:39.726384 | controller | Thursday 04 December 2025 12:27:39 +0000 (0:00:00.049) 0:00:13.044 ***** 2025-12-04 12:27:39.786436 | controller | skipping: [instance] 2025-12-04 12:27:39.786476 | controller | 2025-12-04 12:27:39.786488 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 12:27:39.786498 | controller | Thursday 04 December 2025 12:27:39 +0000 (0:00:00.060) 0:00:13.104 ***** 2025-12-04 12:27:39.840596 | controller | skipping: [instance] 2025-12-04 12:27:39.902972 | controller | 2025-12-04 12:27:39.903002 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 12:27:39.903010 | controller | Thursday 04 December 2025 12:27:39 +0000 (0:00:00.054) 0:00:13.158 ***** 2025-12-04 12:27:39.903021 | controller | skipping: [instance] 2025-12-04 12:27:39.966577 | controller | 2025-12-04 12:27:39.966614 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 12:27:39.966624 | controller | Thursday 04 December 2025 12:27:39 +0000 (0:00:00.062) 0:00:13.221 ***** 2025-12-04 12:27:39.966645 | controller | skipping: [instance] 2025-12-04 12:27:40.012510 | controller | 2025-12-04 12:27:40.012545 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 12:27:40.012555 | controller | Thursday 04 December 2025 12:27:39 +0000 (0:00:00.063) 0:00:13.284 ***** 2025-12-04 12:27:40.012570 | controller | skipping: [instance] 2025-12-04 12:27:40.012720 | controller | 2025-12-04 12:27:40.012731 | controller | TASK [Display error message] *************************************************** 2025-12-04 12:27:40.012750 | controller | Thursday 04 December 2025 12:27:40 +0000 (0:00:00.045) 0:00:13.329 ***** 2025-12-04 12:27:40.054097 | controller | skipping: [instance] 2025-12-04 12:27:40.054363 | controller | 2025-12-04 12:27:40.054599 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 12:27:40.054870 | controller | Thursday 04 December 2025 12:27:40 +0000 (0:00:00.042) 0:00:13.372 ***** 2025-12-04 12:27:40.096382 | controller | skipping: [instance] 2025-12-04 12:27:40.096600 | controller | 2025-12-04 12:27:40.096802 | controller | TASK [Fail if needed] ********************************************************** 2025-12-04 12:27:40.097047 | controller | Thursday 04 December 2025 12:27:40 +0000 (0:00:00.042) 0:00:13.415 ***** 2025-12-04 12:27:40.208735 | controller | skipping: [instance] 2025-12-04 12:27:40.209118 | controller | 2025-12-04 12:27:40.209288 | controller | PLAY RECAP ********************************************************************* 2025-12-04 12:27:40.209536 | controller | instance : ok=129 changed=0 unreachable=0 failed=0 skipped=85 rescued=7 ignored=0 2025-12-04 12:27:40.209810 | controller | 2025-12-04 12:27:40.209997 | controller | Thursday 04 December 2025 12:27:40 +0000 (0:00:00.111) 0:00:13.526 ***** 2025-12-04 12:27:40.210346 | controller | =============================================================================== 2025-12-04 12:27:40.210599 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.22s 2025-12-04 12:27:40.210618 | controller | reproducer : Ensure we get required data in the layout description ------ 0.18s 2025-12-04 12:27:40.210816 | controller | reproducer : Ensure created amount matches at least allocated amounts --- 0.17s 2025-12-04 12:27:40.211082 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.17s 2025-12-04 12:27:40.211190 | controller | reproducer : Ensure same amount of disks are created -------------------- 0.14s 2025-12-04 12:27:40.211543 | controller | reproducer : Ensure we get disk_size ------------------------------------ 0.13s 2025-12-04 12:27:40.211702 | controller | reproducer : Ensure we get required data in the layout description ------ 0.12s 2025-12-04 12:27:40.211883 | controller | Test no volumes --------------------------------------------------------- 0.12s 2025-12-04 12:27:40.212076 | controller | reproducer : Ensure we don't set some parameters when no extra disks ---- 0.12s 2025-12-04 12:27:40.212809 | controller | reproducer : Ensure we don't try to pass resources via devscripts_overrides --- 0.12s 2025-12-04 12:27:40.213017 | controller | reproducer : Ensure created amount matches at least allocated amounts --- 0.11s 2025-12-04 12:27:40.213032 | controller | reproducer : Ensure we get required data in the layout description ------ 0.11s 2025-12-04 12:27:40.213039 | controller | Fail if needed ---------------------------------------------------------- 0.11s 2025-12-04 12:27:40.213050 | controller | reproducer : Ensure we get required data in the layout description ------ 0.11s 2025-12-04 12:27:40.213060 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.11s 2025-12-04 12:27:40.213354 | controller | reproducer : Ensure we get required data in the layout description ------ 0.10s 2025-12-04 12:27:40.213554 | controller | reproducer : Ensure created amount matches at least allocated amounts --- 0.10s 2025-12-04 12:27:40.213674 | controller | reproducer : Ensure created amount matches at least allocated amounts --- 0.10s 2025-12-04 12:27:40.213923 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.10s 2025-12-04 12:27:40.217295 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.10s 2025-12-04 12:27:40.291137 | controller | INFO Running ocp_validations > cleanup 2025-12-04 12:27:40.292459 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-04 12:27:40.293359 | controller | INFO Writing /tmp/report.html report. 2025-12-04 12:27:40.531631 | [controller] Waiting on logger 2025-12-04 12:27:45.672068 | [controller] Waiting on logger 2025-12-04 12:27:56.104239 | [controller] Waiting on logger 2025-12-04 12:28:06.536235 | [controller] Waiting on logger 2025-12-04 12:28:10.498529 | [Zuul] Log Stream did not terminate 2025-12-04 12:28:10.498733 | controller | changed 2025-12-04 12:28:10.558538 | 2025-12-04 12:28:10.558610 | PLAY RECAP 2025-12-04 12:28:10.558667 | controller | ok: 4 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-12-04 12:28:10.558697 | 2025-12-04 12:28:10.614118 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-12-04 12:28:10.614877 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-12-04 12:28:11.118618 | 2025-12-04 12:28:11.118769 | PLAY [Run ci/playbooks/collect-logs.yml] 2025-12-04 12:28:11.138865 | 2025-12-04 12:28:11.138936 | TASK [Filter out host if needed] 2025-12-04 12:28:11.147104 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2025-12-04 12:28:11.151450 | 2025-12-04 12:28:11.151516 | TASK [Ensure file is present] 2025-12-04 12:28:11.676981 | controller | ok 2025-12-04 12:28:11.682255 | 2025-12-04 12:28:11.682318 | TASK [Manage molecule report file] 2025-12-04 12:28:11.701571 | [controller] Waiting on logger 2025-12-04 12:28:21.064414 | [controller] Waiting on logger 2025-12-04 12:28:31.496252 | [controller] Waiting on logger 2025-12-04 12:28:40.840360 | [controller] Waiting on logger 2025-12-04 12:28:42.143871 | [Zuul] Log Stream did not terminate 2025-12-04 12:28:42.144136 | controller | changed 2025-12-04 12:28:42.149224 | 2025-12-04 12:28:42.149287 | TASK [Check if we get ci-framework-data basedir] 2025-12-04 12:28:42.502227 | controller | ok 2025-12-04 12:28:42.507336 | 2025-12-04 12:28:42.507401 | TASK [Create ci-framework-data log directory for zuul] 2025-12-04 12:28:42.910752 | controller | changed 2025-12-04 12:28:42.916536 | 2025-12-04 12:28:42.916599 | TASK [Copy ci-framework interesting files] 2025-12-04 12:28:42.936338 | [controller] Waiting on logger 2025-12-04 12:29:00.552149 | [controller] Waiting on logger 2025-12-04 12:29:01.576225 | [controller] Waiting on logger 2025-12-04 12:29:13.247643 | [Zuul] Log Stream did not terminate 2025-12-04 12:29:13.247905 | controller | changed 2025-12-04 12:29:13.253201 | 2025-12-04 12:29:13.253270 | TASK [Get SELinux listing] 2025-12-04 12:29:16.104497 | [controller] Waiting on logger 2025-12-04 12:29:18.279982 | controller | changed 2025-12-04 12:29:18.285460 | 2025-12-04 12:29:18.285527 | TASK [Generate log index] 2025-12-04 12:29:19.500886 | controller | changed 2025-12-04 12:29:19.505869 | 2025-12-04 12:29:19.505932 | TASK [Get some env related data] 2025-12-04 12:29:19.527128 | [controller] Waiting on logger 2025-12-04 12:29:34.024403 | [controller] Waiting on logger 2025-12-04 12:29:44.456235 | [controller] Waiting on logger 2025-12-04 12:29:51.307972 | [Zuul] Log Stream did not terminate 2025-12-04 12:29:51.308260 | controller | changed 2025-12-04 12:29:51.313005 | 2025-12-04 12:29:51.313062 | TASK [Generate list of logs to collect in home directory] 2025-12-04 12:29:51.626070 | controller | ok: All paths examined 2025-12-04 12:29:51.630925 | 2025-12-04 12:29:51.630989 | LOOP [Copy logs from home directory] 2025-12-04 12:29:52.140860 | controller | changed: 2025-12-04 12:29:52.141017 | controller | { 2025-12-04 12:29:52.141043 | controller | "atime": 1763989167.9348345, 2025-12-04 12:29:52.141061 | controller | "ctime": 1763990251.6129293, 2025-12-04 12:29:52.141076 | controller | "dev": 64513, 2025-12-04 12:29:52.141091 | controller | "gid": 1000, 2025-12-04 12:29:52.141105 | controller | "gr_name": "zuul", 2025-12-04 12:29:52.141119 | controller | "inode": 5131423, 2025-12-04 12:29:52.141132 | controller | "isblk": false, 2025-12-04 12:29:52.141146 | controller | "ischr": false, 2025-12-04 12:29:52.141159 | controller | "isdir": false, 2025-12-04 12:29:52.141172 | controller | "isfifo": false, 2025-12-04 12:29:52.141186 | controller | "isgid": false, 2025-12-04 12:29:52.141199 | controller | "islnk": false, 2025-12-04 12:29:52.141212 | controller | "isreg": true, 2025-12-04 12:29:52.141225 | controller | "issock": false, 2025-12-04 12:29:52.141238 | controller | "isuid": false, 2025-12-04 12:29:52.141253 | controller | "mode": "0644", 2025-12-04 12:29:52.141266 | controller | "mtime": 1763990251.6129293, 2025-12-04 12:29:52.141280 | controller | "nlink": 1, 2025-12-04 12:29:52.141293 | controller | "path": "/home/zuul/crc-setup.log", 2025-12-04 12:29:52.141306 | controller | "pw_name": "zuul", 2025-12-04 12:29:52.141318 | controller | "rgrp": true, 2025-12-04 12:29:52.141331 | controller | "roth": true, 2025-12-04 12:29:52.141343 | controller | "rusr": true, 2025-12-04 12:29:52.141357 | controller | "size": 4108, 2025-12-04 12:29:52.141370 | controller | "uid": 1000, 2025-12-04 12:29:52.141383 | controller | "wgrp": false, 2025-12-04 12:29:52.141396 | controller | "woth": false, 2025-12-04 12:29:52.141409 | controller | "wusr": true, 2025-12-04 12:29:52.141422 | controller | "xgrp": false, 2025-12-04 12:29:52.141436 | controller | "xoth": false, 2025-12-04 12:29:52.141448 | controller | "xusr": false 2025-12-04 12:29:52.141461 | controller | } 2025-12-04 12:29:52.647077 | controller | changed: 2025-12-04 12:29:52.647125 | controller | { 2025-12-04 12:29:52.647149 | controller | "atime": 1763990253.7119775, 2025-12-04 12:29:52.647168 | controller | "ctime": 1763991032.5164254, 2025-12-04 12:29:52.647185 | controller | "dev": 64513, 2025-12-04 12:29:52.647201 | controller | "gid": 1000, 2025-12-04 12:29:52.647216 | controller | "gr_name": "zuul", 2025-12-04 12:29:52.647233 | controller | "inode": 5131425, 2025-12-04 12:29:52.647249 | controller | "isblk": false, 2025-12-04 12:29:52.647264 | controller | "ischr": false, 2025-12-04 12:29:52.647278 | controller | "isdir": false, 2025-12-04 12:29:52.647292 | controller | "isfifo": false, 2025-12-04 12:29:52.647307 | controller | "isgid": false, 2025-12-04 12:29:52.647321 | controller | "islnk": false, 2025-12-04 12:29:52.647334 | controller | "isreg": true, 2025-12-04 12:29:52.647348 | controller | "issock": false, 2025-12-04 12:29:52.647361 | controller | "isuid": false, 2025-12-04 12:29:52.647375 | controller | "mode": "0644", 2025-12-04 12:29:52.647388 | controller | "mtime": 1763991032.5164254, 2025-12-04 12:29:52.647401 | controller | "nlink": 1, 2025-12-04 12:29:52.647414 | controller | "path": "/home/zuul/crc-start.log", 2025-12-04 12:29:52.647428 | controller | "pw_name": "zuul", 2025-12-04 12:29:52.647441 | controller | "rgrp": true, 2025-12-04 12:29:52.647454 | controller | "roth": true, 2025-12-04 12:29:52.647468 | controller | "rusr": true, 2025-12-04 12:29:52.647482 | controller | "size": 4428, 2025-12-04 12:29:52.647495 | controller | "uid": 1000, 2025-12-04 12:29:52.647508 | controller | "wgrp": false, 2025-12-04 12:29:52.647521 | controller | "woth": false, 2025-12-04 12:29:52.647534 | controller | "wusr": true, 2025-12-04 12:29:52.647547 | controller | "xgrp": false, 2025-12-04 12:29:52.647561 | controller | "xoth": false, 2025-12-04 12:29:52.647574 | controller | "xusr": false 2025-12-04 12:29:52.647592 | controller | } 2025-12-04 12:29:53.177163 | controller | changed: 2025-12-04 12:29:53.177211 | controller | { 2025-12-04 12:29:53.177234 | controller | "atime": 1764850675.978951, 2025-12-04 12:29:53.177252 | controller | "ctime": 1764850692.8220327, 2025-12-04 12:29:53.177267 | controller | "dev": 64513, 2025-12-04 12:29:53.177281 | controller | "gid": 1000, 2025-12-04 12:29:53.177295 | controller | "gr_name": "zuul", 2025-12-04 12:29:53.177308 | controller | "inode": 4751296, 2025-12-04 12:29:53.177321 | controller | "isblk": false, 2025-12-04 12:29:53.177334 | controller | "ischr": false, 2025-12-04 12:29:53.177347 | controller | "isdir": false, 2025-12-04 12:29:53.177360 | controller | "isfifo": false, 2025-12-04 12:29:53.177375 | controller | "isgid": false, 2025-12-04 12:29:53.177389 | controller | "islnk": false, 2025-12-04 12:29:53.177401 | controller | "isreg": true, 2025-12-04 12:29:53.177414 | controller | "issock": false, 2025-12-04 12:29:53.177426 | controller | "isuid": false, 2025-12-04 12:29:53.177438 | controller | "mode": "0644", 2025-12-04 12:29:53.177450 | controller | "mtime": 1764850692.8220327, 2025-12-04 12:29:53.177462 | controller | "nlink": 1, 2025-12-04 12:29:53.177474 | controller | "path": "/home/zuul/ansible.log", 2025-12-04 12:29:53.177486 | controller | "pw_name": "zuul", 2025-12-04 12:29:53.177498 | controller | "rgrp": true, 2025-12-04 12:29:53.177511 | controller | "roth": true, 2025-12-04 12:29:53.177524 | controller | "rusr": true, 2025-12-04 12:29:53.177537 | controller | "size": 6749, 2025-12-04 12:29:53.177551 | controller | "uid": 1000, 2025-12-04 12:29:53.177564 | controller | "wgrp": false, 2025-12-04 12:29:53.177576 | controller | "woth": false, 2025-12-04 12:29:53.177589 | controller | "wusr": true, 2025-12-04 12:29:53.177601 | controller | "xgrp": false, 2025-12-04 12:29:53.177613 | controller | "xoth": false, 2025-12-04 12:29:53.177634 | controller | "xusr": false 2025-12-04 12:29:53.177646 | controller | } 2025-12-04 12:29:53.186177 | 2025-12-04 12:29:53.186239 | TASK [Copy crio stats log file] 2025-12-04 12:29:53.199680 | controller | skipping: Conditional result was False 2025-12-04 12:29:53.204679 | 2025-12-04 12:29:53.204744 | TASK [Get SELinux related data] 2025-12-04 12:29:53.800225 | [controller] Waiting on logger 2025-12-04 12:29:58.230743 | controller | ERROR 2025-12-04 12:29:58.230922 | controller | { 2025-12-04 12:29:58.230953 | controller | "delta": "0:00:00.011369", 2025-12-04 12:29:58.230974 | controller | "end": "2025-12-04 12:29:53.487349", 2025-12-04 12:29:58.230991 | controller | "msg": "non-zero return code", 2025-12-04 12:29:58.231007 | controller | "rc": 1, 2025-12-04 12:29:58.231024 | controller | "start": "2025-12-04 12:29:53.475980" 2025-12-04 12:29:58.231041 | controller | } 2025-12-04 12:29:58.231066 | controller | ERROR: Ignoring Errors 2025-12-04 12:29:58.236259 | 2025-12-04 12:29:58.236323 | TASK [Create system configuration directory] 2025-12-04 12:29:58.477904 | controller | changed 2025-12-04 12:29:58.482219 | 2025-12-04 12:29:58.482289 | TASK [Get some of the system configurations] 2025-12-04 12:29:59.560251 | [controller] Waiting on logger 2025-12-04 12:30:06.968601 | controller | changed 2025-12-04 12:30:06.973733 | 2025-12-04 12:30:06.973812 | TASK [Copy generated documentation if available] 2025-12-04 12:30:06.987100 | controller | skipping: Conditional result was False 2025-12-04 12:30:06.992765 | 2025-12-04 12:30:06.992848 | TASK [Copy generated AsciiDoc documentation if available] 2025-12-04 12:30:07.005987 | controller | skipping: Conditional result was False 2025-12-04 12:30:07.011096 | 2025-12-04 12:30:07.011160 | TASK [Compress logs bigger than 2MB] 2025-12-04 12:30:07.032104 | [controller] Waiting on logger 2025-12-04 12:30:17.416276 | [controller] Waiting on logger 2025-12-04 12:30:26.760553 | [controller] Waiting on logger 2025-12-04 12:30:37.192140 | [controller] Waiting on logger 2025-12-04 12:30:37.302166 | [Zuul] Log Stream did not terminate 2025-12-04 12:30:37.302364 | controller | changed 2025-12-04 12:30:37.307888 | 2025-12-04 12:30:37.307953 | TASK [Copy files from workspace on node] 2025-12-04 12:30:37.326004 | controller | ok 2025-12-04 12:30:37.347341 | 2025-12-04 12:30:37.347412 | TASK [fetch-output : Set log path for multiple nodes] 2025-12-04 12:30:37.360880 | controller | skipping: Conditional result was False 2025-12-04 12:30:37.366580 | 2025-12-04 12:30:37.366643 | TASK [fetch-output : Set log path for single node] 2025-12-04 12:30:37.394235 | controller | ok 2025-12-04 12:30:37.398800 | 2025-12-04 12:30:37.398873 | LOOP [fetch-output : Ensure local output dirs] 2025-12-04 12:30:37.577015 | controller -> localhost | ok: "/var/lib/zuul/builds/3d57aa174e9d4d5883b52d2f5f8368fd/work/logs" 2025-12-04 12:30:37.577241 | controller -> localhost | changed: All items complete 2025-12-04 12:30:37.577271 | 2025-12-04 12:30:37.739248 | controller -> localhost | changed: "/var/lib/zuul/builds/3d57aa174e9d4d5883b52d2f5f8368fd/work/artifacts" 2025-12-04 12:30:37.907350 | controller -> localhost | changed: "/var/lib/zuul/builds/3d57aa174e9d4d5883b52d2f5f8368fd/work/docs" 2025-12-04 12:30:37.926277 | 2025-12-04 12:30:37.926380 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-12-04 12:30:38.571522 | controller | changed: 2025-12-04 12:30:38.571730 | controller | .d..t...... ./ 2025-12-04 12:30:38.571763 | controller | >f+++++++++ README.html 2025-12-04 12:30:38.571786 | controller | >f+++++++++ ansible-execution.log 2025-12-04 12:30:38.571805 | controller | >f+++++++++ ansible.log 2025-12-04 12:30:38.571839 | controller | >f+++++++++ crc-setup.log 2025-12-04 12:30:38.572070 | controller | >f+++++++++ crc-start.log 2025-12-04 12:30:38.572089 | controller | >f+++++++++ dmesg.log 2025-12-04 12:30:38.572106 | controller | >f+++++++++ installed-pkgs.log 2025-12-04 12:30:38.572122 | controller | >f+++++++++ python.log 2025-12-04 12:30:38.572138 | controller | >f+++++++++ registries.conf 2025-12-04 12:30:38.572154 | controller | >f+++++++++ report.html 2025-12-04 12:30:38.572168 | controller | >f+++++++++ selinux-denials.log 2025-12-04 12:30:38.572183 | controller | >f+++++++++ selinux-listing.log 2025-12-04 12:30:38.572198 | controller | cd+++++++++ ci-framework-data/ 2025-12-04 12:30:38.572212 | controller | cd+++++++++ ci-framework-data/artifacts/ 2025-12-04 12:30:38.572227 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2025-12-04 12:30:38.572241 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2025-12-04 12:30:38.572256 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2025-12-04 12:30:38.572270 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2025-12-04 12:30:38.572284 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2025-12-04 12:30:38.572298 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2025-12-04 12:30:38.572312 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2025-12-04 12:30:38.572326 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2025-12-04 12:30:38.572340 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2025-12-04 12:30:38.572354 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2025-12-04 12:30:38.572368 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2025-12-04 12:30:38.572381 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2025-12-04 12:30:38.572395 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2025-12-04 12:30:38.572409 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:1b:52:18 2025-12-04 12:30:38.572423 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:29:89:36 2025-12-04 12:30:38.572438 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:5f:68:69 2025-12-04 12:30:38.572458 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:95:0a:c4 2025-12-04 12:30:38.572474 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:3c:34:64 2025-12-04 12:30:38.572489 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:85:1c:d1 2025-12-04 12:30:38.572503 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2025-12-04 12:30:38.572518 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2025-12-04 12:30:38.572532 | controller | cd+++++++++ ci-framework-data/logs/ 2025-12-04 12:30:38.572546 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2025-12-04 12:30:38.572560 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2025-12-04 12:30:38.572574 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2025-12-04 12:30:38.572588 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2025-12-04 12:30:38.572601 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2025-12-04 12:30:38.572615 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2025-12-04 12:30:38.572628 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2025-12-04 12:30:38.572642 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2025-12-04 12:30:38.572677 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2025-12-04 12:30:38.572697 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2025-12-04 12:30:38.572712 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2025-12-04 12:30:38.572729 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2025-12-04 12:30:38.572745 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2025-12-04 12:30:38.572763 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2025-12-04 12:30:38.572779 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2025-12-04 12:30:38.572794 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2025-12-04 12:30:38.572808 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2025-12-04 12:30:38.572832 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2025-12-04 12:30:38.572850 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2025-12-04 12:30:38.572866 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2025-12-04 12:30:38.572881 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2025-12-04 12:30:38.572896 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2025-12-04 12:30:38.572911 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2025-12-04 12:30:38.572926 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2025-12-04 12:30:38.572940 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2025-12-04 12:30:38.572958 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2025-12-04 12:30:38.572973 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2025-12-04 12:30:38.572987 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2025-12-04 12:30:38.573000 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2025-12-04 12:30:38.573014 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2025-12-04 12:30:38.573027 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2025-12-04 12:30:38.573041 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2025-12-04 12:30:38.573054 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2025-12-04 12:30:38.573067 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2025-12-04 12:30:38.573081 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2025-12-04 12:30:38.573095 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2025-12-04 12:30:38.573109 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2025-12-04 12:30:38.573124 | controller | cd+++++++++ registries.conf.d/ 2025-12-04 12:30:38.573139 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2025-12-04 12:30:38.573154 | controller | cd+++++++++ system-config/ 2025-12-04 12:30:38.573169 | controller | cd+++++++++ system-config/libvirt/ 2025-12-04 12:30:38.573183 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2025-12-04 12:30:38.573198 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2025-12-04 12:30:38.573212 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2025-12-04 12:30:38.573226 | controller | >f+++++++++ system-config/libvirt/network.conf 2025-12-04 12:30:38.573240 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2025-12-04 12:30:38.573254 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2025-12-04 12:30:38.573268 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2025-12-04 12:30:38.573282 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2025-12-04 12:30:38.573296 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2025-12-04 12:30:38.573309 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2025-12-04 12:30:38.573323 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2025-12-04 12:30:38.573338 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2025-12-04 12:30:38.573352 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2025-12-04 12:30:38.573367 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2025-12-04 12:30:38.573381 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2025-12-04 12:30:38.573395 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2025-12-04 12:30:39.026680 | controller | changed: .d..t...... ./ 2025-12-04 12:30:39.467966 | controller | changed: .d..t...... ./ 2025-12-04 12:30:39.483146 | 2025-12-04 12:30:39.483248 | TASK [Return artifact to Zuul] 2025-12-04 12:30:39.511049 | controller | ok 2025-12-04 12:30:39.529282 | 2025-12-04 12:30:39.529338 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2025-12-04 12:30:39.529432 | 2025-12-04 12:30:39.529457 | PLAY RECAP 2025-12-04 12:30:39.529495 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2025-12-04 12:30:39.529516 | 2025-12-04 12:30:39.602280 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-12-04 12:30:39.603080 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-12-04 12:30:40.078881 | 2025-12-04 12:30:40.078999 | PLAY [all] 2025-12-04 12:30:40.097223 | 2025-12-04 12:30:40.097297 | TASK [include_role : fetch-output] 2025-12-04 12:30:40.125699 | controller | ok 2025-12-04 12:30:40.141845 | 2025-12-04 12:30:40.141929 | TASK [fetch-output : Set log path for multiple nodes] 2025-12-04 12:30:40.185735 | controller | skipping: Conditional result was False 2025-12-04 12:30:40.191196 | 2025-12-04 12:30:40.191264 | TASK [fetch-output : Set log path for single node] 2025-12-04 12:30:40.219330 | controller | ok 2025-12-04 12:30:40.224175 | 2025-12-04 12:30:40.224243 | LOOP [fetch-output : Ensure local output dirs] 2025-12-04 12:30:40.515129 | controller -> localhost | ok: "/var/lib/zuul/builds/3d57aa174e9d4d5883b52d2f5f8368fd/work/logs" 2025-12-04 12:30:40.687510 | controller -> localhost | ok: "/var/lib/zuul/builds/3d57aa174e9d4d5883b52d2f5f8368fd/work/artifacts" 2025-12-04 12:30:40.849834 | controller -> localhost | ok: "/var/lib/zuul/builds/3d57aa174e9d4d5883b52d2f5f8368fd/work/docs" 2025-12-04 12:30:40.861332 | 2025-12-04 12:30:40.861426 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-12-04 12:30:41.445186 | controller | ok 2025-12-04 12:30:41.445371 | controller | ok: All items complete 2025-12-04 12:30:41.445401 | 2025-12-04 12:30:41.882178 | controller | ok 2025-12-04 12:30:42.304892 | controller | ok 2025-12-04 12:30:42.315921 | 2025-12-04 12:30:42.316024 | TASK [include_role : fetch-output-openshift] 2025-12-04 12:30:42.329324 | controller | skipping: Conditional result was False 2025-12-04 12:30:42.334397 | 2025-12-04 12:30:42.334457 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2025-12-04 12:30:42.634818 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006145 2025-12-04 12:30:42.809191 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.005312 2025-12-04 12:30:42.836207 | 2025-12-04 12:30:42.836274 | PLAY [all] 2025-12-04 12:30:42.848572 | 2025-12-04 12:30:42.848634 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2025-12-04 12:30:43.293926 | controller | changed 2025-12-04 12:30:43.313621 | 2025-12-04 12:30:43.313684 | PLAY RECAP 2025-12-04 12:30:43.313726 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2025-12-04 12:30:43.313747 | 2025-12-04 12:30:43.376996 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-12-04 12:30:43.377950 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2025-12-04 12:30:43.870990 | 2025-12-04 12:30:43.871093 | PLAY [localhost] 2025-12-04 12:30:43.887058 | 2025-12-04 12:30:43.887127 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2025-12-04 12:30:44.167105 | localhost | changed 2025-12-04 12:30:44.171298 | 2025-12-04 12:30:44.171369 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2025-12-04 12:30:44.188741 | localhost | ok 2025-12-04 12:30:44.195775 | 2025-12-04 12:30:44.195847 | TASK [add-fileserver : Create SSH private key tempfile] 2025-12-04 12:30:44.475766 | localhost | changed 2025-12-04 12:30:44.480941 | 2025-12-04 12:30:44.481011 | TASK [add-fileserver : Create SSH private key from secret] 2025-12-04 12:30:44.983693 | localhost | changed 2025-12-04 12:30:44.988423 | 2025-12-04 12:30:44.988491 | TASK [add-fileserver : Add fileserver ssh key] 2025-12-04 12:30:45.288425 | localhost | Identity added: /var/lib/zuul/builds/3d57aa174e9d4d5883b52d2f5f8368fd/work/tmp/ansible.h1tii2cs (/var/lib/zuul/builds/3d57aa174e9d4d5883b52d2f5f8368fd/work/tmp/ansible.h1tii2cs) 2025-12-04 12:30:45.288588 | localhost | ok: Runtime: 0:00:00.006187 2025-12-04 12:30:45.292645 | 2025-12-04 12:30:45.292740 | TASK [add-fileserver : Remove SSH private key from disk] 2025-12-04 12:30:45.491604 | localhost | ok: Runtime: 0:00:00.003970 2025-12-04 12:30:45.496294 | 2025-12-04 12:30:45.496363 | TASK [add-fileserver : Add fileserver to inventory] 2025-12-04 12:30:45.543356 | localhost | changed 2025-12-04 12:30:45.547989 | 2025-12-04 12:30:45.548059 | TASK [add-fileserver : Add fileserver server to known hosts] 2025-12-04 12:30:45.837438 | localhost | changed 2025-12-04 12:30:45.856326 | 2025-12-04 12:30:45.856385 | PLAY [localhost] 2025-12-04 12:30:45.867236 | 2025-12-04 12:30:45.867298 | TASK [Generate bulk log download script] 2025-12-04 12:30:45.884831 | localhost | ok 2025-12-04 12:30:45.895939 | 2025-12-04 12:30:45.896007 | TASK [local-log-download : Check API endpoint is defined] 2025-12-04 12:30:45.923189 | localhost | ok: All assertions passed 2025-12-04 12:30:45.927471 | 2025-12-04 12:30:45.927538 | TASK [local-log-download : Create download script] 2025-12-04 12:30:46.243728 | localhost -> localhost | changed 2025-12-04 12:30:46.252227 | 2025-12-04 12:30:46.252293 | TASK [Register quick-download link] 2025-12-04 12:30:46.268747 | localhost | ok 2025-12-04 12:30:46.300043 | 2025-12-04 12:30:46.300113 | PLAY [logserver.rdoproject.org] 2025-12-04 12:30:46.309421 | 2025-12-04 12:30:46.309477 | TASK [Set zuul-log-path fact] 2025-12-04 12:30:46.324775 | logserver.rdoproject.org | ok 2025-12-04 12:30:46.333185 | 2025-12-04 12:30:46.333251 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-12-04 12:30:46.358947 | logserver.rdoproject.org | ok 2025-12-04 12:30:46.363755 | 2025-12-04 12:30:46.363814 | TASK [upload-logs : Create log directories] 2025-12-04 12:30:48.114852 | logserver.rdoproject.org | changed 2025-12-04 12:30:48.117866 | 2025-12-04 12:30:48.117928 | TASK [upload-logs : Ensure logs are readable before uploading] 2025-12-04 12:30:48.324473 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.005083 2025-12-04 12:30:48.329042 | 2025-12-04 12:30:48.329107 | TASK [upload-logs : Upload logs to log server] 2025-12-04 12:30:49.775089 | logserver.rdoproject.org | Output suppressed because no_log was given 2025-12-04 12:30:49.777717 | 2025-12-04 12:30:49.777781 | LOOP [upload-logs : Compress console log and json output] 2025-12-04 12:30:49.812444 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-04 12:30:49.819896 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-04 12:30:49.824441 | 2025-12-04 12:30:49.824527 | LOOP [upload-logs : Upload compressed console log and json output] 2025-12-04 12:30:49.856474 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-04 12:30:49.856684 | 2025-12-04 12:30:49.859639 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-04 12:30:49.870995 | 2025-12-04 12:30:49.871077 | LOOP [upload-logs : Upload console log and json output]