2025-11-26 15:45:16.157896 | Job console starting... 2025-11-26 15:45:16.367705 | Updating repositories 2025-11-26 15:45:17.099579 | Preparing job workspace 2025-11-26 15:45:25.040149 | Running Ansible setup... 2025-11-26 15:45:28.504596 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-11-26 15:45:28.975983 | 2025-11-26 15:45:28.976076 | PLAY [localhost] 2025-11-26 15:45:28.983645 | 2025-11-26 15:45:28.983709 | TASK [Gathering Facts] 2025-11-26 15:45:29.787794 | localhost | ok 2025-11-26 15:45:29.800689 | 2025-11-26 15:45:29.800765 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2025-11-26 15:45:30.108371 | localhost -> localhost | changed 2025-11-26 15:45:30.113604 | 2025-11-26 15:45:30.113672 | TASK [log-inventory : Copy ansible inventory to logs dir] 2025-11-26 15:45:30.810506 | localhost -> localhost | changed 2025-11-26 15:45:30.819524 | 2025-11-26 15:45:30.819593 | TASK [Setup log path fact] 2025-11-26 15:45:30.844755 | localhost | ok 2025-11-26 15:45:30.856686 | 2025-11-26 15:45:30.856828 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-11-26 15:45:30.884807 | localhost | ok 2025-11-26 15:45:30.892930 | 2025-11-26 15:45:30.892995 | TASK [emit-job-header : Print job information] 2025-11-26 15:45:30.920205 | # Job Information 2025-11-26 15:45:30.920337 | Ansible Version: 2.15.12 2025-11-26 15:45:30.920366 | Job: cifmw-molecule-reproducer 2025-11-26 15:45:30.920398 | Pipeline: github-check 2025-11-26 15:45:30.920420 | Executor: ibm-bm4-ze.softwarefactory-project.io 2025-11-26 15:45:30.920440 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3476 2025-11-26 15:45:30.920459 | Log URL (when completed): https://logserver.rdoproject.org/d4f/rdoproject.org/d4f91a3c3e7045779492f744b684885d/ 2025-11-26 15:45:30.920476 | Event ID: c3be6270-cade-11f0-8317-80f8240b0107 2025-11-26 15:45:30.923954 | 2025-11-26 15:45:30.924018 | LOOP [emit-job-header : Print node information] 2025-11-26 15:45:31.042518 | localhost | ok: 2025-11-26 15:45:31.042717 | localhost | # Node Information 2025-11-26 15:45:31.042750 | localhost | Inventory Hostname: controller 2025-11-26 15:45:31.042788 | localhost | Hostname: np0005536922 2025-11-26 15:45:31.042811 | localhost | Username: zuul 2025-11-26 15:45:31.042833 | localhost | Distro: CentOS 9 2025-11-26 15:45:31.042853 | localhost | Provider: ibm-bm4-nodepool 2025-11-26 15:45:31.042872 | localhost | Region: regionOne 2025-11-26 15:45:31.042890 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2025-11-26 15:45:31.042931 | localhost | Product Name: OpenStack Compute 2025-11-26 15:45:31.042961 | localhost | Interface IP: 192.168.26.189 2025-11-26 15:45:31.068141 | 2025-11-26 15:45:31.068266 | PLAY [all] 2025-11-26 15:45:31.074663 | 2025-11-26 15:45:31.074730 | TASK [Gather network facts] 2025-11-26 15:45:31.529346 | controller | ok 2025-11-26 15:45:31.543381 | 2025-11-26 15:45:31.543467 | TASK [include_role : start-zuul-console] 2025-11-26 15:45:31.572246 | controller | ok 2025-11-26 15:45:31.582962 | 2025-11-26 15:45:31.583025 | TASK [start-zuul-console : Start zuul_console daemon.] 2025-11-26 15:45:31.957869 | controller | ok 2025-11-26 15:45:31.965989 | 2025-11-26 15:45:31.966048 | TASK [include_role : add-build-sshkey] 2025-11-26 15:45:32.004328 | controller | ok 2025-11-26 15:45:32.028707 | 2025-11-26 15:45:32.028844 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2025-11-26 15:45:32.225377 | controller -> localhost | ok 2025-11-26 15:45:32.231408 | 2025-11-26 15:45:32.231492 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2025-11-26 15:45:32.264306 | controller | ok 2025-11-26 15:45:32.276790 | controller | included: /var/lib/zuul/builds/d4f91a3c3e7045779492f744b684885d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2025-11-26 15:45:32.282186 | 2025-11-26 15:45:32.282249 | TASK [add-build-sshkey : Create Temp SSH key] 2025-11-26 15:45:32.688842 | controller -> localhost | Generating public/private rsa key pair. 2025-11-26 15:45:32.689061 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/d4f91a3c3e7045779492f744b684885d/work/d4f91a3c3e7045779492f744b684885d_id_rsa. 2025-11-26 15:45:32.689096 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/d4f91a3c3e7045779492f744b684885d/work/d4f91a3c3e7045779492f744b684885d_id_rsa.pub. 2025-11-26 15:45:32.689120 | controller -> localhost | The key fingerprint is: 2025-11-26 15:45:32.689140 | controller -> localhost | SHA256:gqXAQ8wlAvfxn4GUWtRavPSt9c2mY3rjWcCvWqWOsyw zuul-build-sshkey 2025-11-26 15:45:32.689161 | controller -> localhost | The key's randomart image is: 2025-11-26 15:45:32.689180 | controller -> localhost | +---[RSA 3072]----+ 2025-11-26 15:45:32.689197 | controller -> localhost | |+o+.o.o+ | 2025-11-26 15:45:32.689224 | controller -> localhost | | =oo +o.= | 2025-11-26 15:45:32.689242 | controller -> localhost | | + .o++.o . | 2025-11-26 15:45:32.689259 | controller -> localhost | | o.+...o. o. | 2025-11-26 15:45:32.689276 | controller -> localhost | | o . S o .oo.| 2025-11-26 15:45:32.689292 | controller -> localhost | | . . .=+| 2025-11-26 15:45:32.689308 | controller -> localhost | | ooo| 2025-11-26 15:45:32.689326 | controller -> localhost | | E..+*+ | 2025-11-26 15:45:32.689343 | controller -> localhost | | .*O=o | 2025-11-26 15:45:32.689359 | controller -> localhost | +----[SHA256]-----+ 2025-11-26 15:45:32.689414 | controller -> localhost | ok: Runtime: 0:00:00.062309 2025-11-26 15:45:32.695026 | 2025-11-26 15:45:32.695093 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2025-11-26 15:45:32.719962 | controller | ok 2025-11-26 15:45:32.729154 | controller | included: /var/lib/zuul/builds/d4f91a3c3e7045779492f744b684885d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2025-11-26 15:45:32.736365 | 2025-11-26 15:45:32.736443 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2025-11-26 15:45:32.760623 | controller | skipping: Conditional result was False 2025-11-26 15:45:32.765846 | 2025-11-26 15:45:32.765927 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2025-11-26 15:45:33.251141 | controller | changed 2025-11-26 15:45:33.255976 | 2025-11-26 15:45:33.256044 | TASK [add-build-sshkey : Make sure user has a .ssh] 2025-11-26 15:45:33.527088 | controller | ok 2025-11-26 15:45:33.531963 | 2025-11-26 15:45:33.532039 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2025-11-26 15:45:34.724871 | controller | changed 2025-11-26 15:45:34.729669 | 2025-11-26 15:45:34.729745 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2025-11-26 15:45:35.932878 | controller | changed 2025-11-26 15:45:35.937880 | 2025-11-26 15:45:35.937970 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2025-11-26 15:45:35.951316 | controller | skipping: Conditional result was False 2025-11-26 15:45:35.963046 | 2025-11-26 15:45:35.963116 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2025-11-26 15:45:36.345245 | controller -> localhost | changed 2025-11-26 15:45:36.354990 | 2025-11-26 15:45:36.355056 | TASK [add-build-sshkey : Add back temp key] 2025-11-26 15:45:36.571863 | controller -> localhost | Identity added: /var/lib/zuul/builds/d4f91a3c3e7045779492f744b684885d/work/d4f91a3c3e7045779492f744b684885d_id_rsa (zuul-build-sshkey) 2025-11-26 15:45:36.572059 | controller -> localhost | ok: Runtime: 0:00:00.006967 2025-11-26 15:45:36.577166 | 2025-11-26 15:45:36.577221 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2025-11-26 15:45:36.933026 | controller | ok 2025-11-26 15:45:36.937281 | 2025-11-26 15:45:36.937336 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2025-11-26 15:45:36.961142 | controller | skipping: Conditional result was False 2025-11-26 15:45:36.970848 | 2025-11-26 15:45:36.970929 | TASK [include_role : validate-host] 2025-11-26 15:45:36.988072 | controller | ok 2025-11-26 15:45:37.004853 | 2025-11-26 15:45:37.004930 | TASK [validate-host : Define zuul_info_dir fact] 2025-11-26 15:45:37.031868 | controller | ok 2025-11-26 15:45:37.036027 | 2025-11-26 15:45:37.036083 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2025-11-26 15:45:37.222627 | controller -> localhost | ok 2025-11-26 15:45:37.227872 | 2025-11-26 15:45:37.227949 | TASK [validate-host : Collect information about the host] 2025-11-26 15:45:37.957304 | controller | ok 2025-11-26 15:45:37.965497 | 2025-11-26 15:45:37.965558 | TASK [validate-host : Sanitize hostname] 2025-11-26 15:45:38.003360 | controller | ok 2025-11-26 15:45:38.007714 | 2025-11-26 15:45:38.007776 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2025-11-26 15:45:38.357317 | controller -> localhost | changed 2025-11-26 15:45:38.363149 | 2025-11-26 15:45:38.363226 | TASK [validate-host : Collect information about zuul worker] 2025-11-26 15:45:38.755448 | controller | ok 2025-11-26 15:45:38.760450 | 2025-11-26 15:45:38.760540 | TASK [validate-host : Write out all zuul information for each host] 2025-11-26 15:45:39.109015 | controller -> localhost | changed 2025-11-26 15:45:39.118205 | 2025-11-26 15:45:39.118291 | TASK [include_role : prepare-workspace-openshift] 2025-11-26 15:45:39.141560 | controller | skipping: Conditional result was False 2025-11-26 15:45:39.146086 | 2025-11-26 15:45:39.146151 | TASK [include_role : remove-zuul-sshkey] 2025-11-26 15:45:39.159442 | controller | skipping: Conditional result was False 2025-11-26 15:45:39.164230 | 2025-11-26 15:45:39.164291 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2025-11-26 15:45:39.429197 | controller | ok: "logs" 2025-11-26 15:45:39.429438 | controller | ok: All items complete 2025-11-26 15:45:39.429469 | 2025-11-26 15:45:39.669308 | controller | ok: "artifacts" 2025-11-26 15:45:39.905672 | controller | ok: "docs" 2025-11-26 15:45:39.912070 | 2025-11-26 15:45:39.912134 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2025-11-26 15:45:40.181383 | controller | changed: "logs" 2025-11-26 15:45:40.423361 | controller | changed: "artifacts" 2025-11-26 15:45:40.667603 | controller | changed: "docs" 2025-11-26 15:45:40.686735 | 2025-11-26 15:45:40.686816 | PLAY RECAP 2025-11-26 15:45:40.686858 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-11-26 15:45:40.686883 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-11-26 15:45:40.686900 | 2025-11-26 15:45:40.752584 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-11-26 15:45:40.753243 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-11-26 15:45:41.249571 | 2025-11-26 15:45:41.249669 | PLAY [all] 2025-11-26 15:45:41.267168 | 2025-11-26 15:45:41.267238 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-11-26 15:45:41.315440 | controller | ok 2025-11-26 15:45:41.319876 | 2025-11-26 15:45:41.319963 | TASK [mirror-info-fork : Create /etc/ci] 2025-11-26 15:45:41.743593 | controller | changed 2025-11-26 15:45:41.749817 | 2025-11-26 15:45:41.749895 | TASK [mirror-info-fork : Install ci_mirror script] 2025-11-26 15:45:43.097167 | controller | changed 2025-11-26 15:45:43.106720 | 2025-11-26 15:45:43.106786 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2025-11-26 15:45:43.564149 | controller | changed: 2025-11-26 15:45:43.564322 | controller | { 2025-11-26 15:45:43.564354 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2025-11-26 15:45:43.564384 | controller | } 2025-11-26 15:45:43.861228 | controller | changed: 2025-11-26 15:45:43.861290 | controller | { 2025-11-26 15:45:43.861318 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2025-11-26 15:45:43.861339 | controller | } 2025-11-26 15:45:44.149734 | controller | changed: 2025-11-26 15:45:44.149785 | controller | { 2025-11-26 15:45:44.149811 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2025-11-26 15:45:44.149830 | controller | } 2025-11-26 15:45:44.449402 | controller | changed: 2025-11-26 15:45:44.449476 | controller | { 2025-11-26 15:45:44.449500 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2025-11-26 15:45:44.449520 | controller | } 2025-11-26 15:45:44.728491 | controller | changed: 2025-11-26 15:45:44.728580 | controller | { 2025-11-26 15:45:44.728609 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2025-11-26 15:45:44.728630 | controller | } 2025-11-26 15:45:45.009126 | controller | changed: 2025-11-26 15:45:45.009205 | controller | { 2025-11-26 15:45:45.009232 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2025-11-26 15:45:45.009253 | controller | } 2025-11-26 15:45:45.294464 | controller | changed: 2025-11-26 15:45:45.294530 | controller | { 2025-11-26 15:45:45.294556 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2025-11-26 15:45:45.294577 | controller | } 2025-11-26 15:45:45.581559 | controller | changed: 2025-11-26 15:45:45.581637 | controller | { 2025-11-26 15:45:45.581665 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2025-11-26 15:45:45.581688 | controller | } 2025-11-26 15:45:45.875555 | controller | changed: 2025-11-26 15:45:45.875613 | controller | { 2025-11-26 15:45:45.875640 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2025-11-26 15:45:45.875660 | controller | } 2025-11-26 15:45:46.185873 | controller | changed: 2025-11-26 15:45:46.185997 | controller | { 2025-11-26 15:45:46.186025 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2025-11-26 15:45:46.186045 | controller | } 2025-11-26 15:45:46.465443 | controller | changed: 2025-11-26 15:45:46.465634 | controller | { 2025-11-26 15:45:46.465660 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2025-11-26 15:45:46.465679 | controller | } 2025-11-26 15:45:46.757881 | controller | changed: 2025-11-26 15:45:46.758059 | controller | { 2025-11-26 15:45:46.758086 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2025-11-26 15:45:46.758107 | controller | } 2025-11-26 15:45:47.061312 | controller | changed: 2025-11-26 15:45:47.061457 | controller | { 2025-11-26 15:45:47.061488 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGpU/BepK3qX0NRf5Np+dOBDqzQEefhNrw2DCZaH3uWW rebtoor@monolith" 2025-11-26 15:45:47.061511 | controller | } 2025-11-26 15:45:47.348113 | controller | changed: 2025-11-26 15:45:47.348316 | controller | { 2025-11-26 15:45:47.348351 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2025-11-26 15:45:47.348373 | controller | } 2025-11-26 15:45:47.627474 | controller | changed: 2025-11-26 15:45:47.627576 | controller | { 2025-11-26 15:45:47.627605 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2025-11-26 15:45:47.627627 | controller | } 2025-11-26 15:45:47.909767 | controller | changed: 2025-11-26 15:45:47.909868 | controller | { 2025-11-26 15:45:47.909893 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2025-11-26 15:45:47.909937 | controller | } 2025-11-26 15:45:48.201110 | controller | changed: 2025-11-26 15:45:48.201254 | controller | { 2025-11-26 15:45:48.201284 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2025-11-26 15:45:48.201307 | controller | } 2025-11-26 15:45:48.481312 | controller | changed: 2025-11-26 15:45:48.481424 | controller | { 2025-11-26 15:45:48.481455 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2025-11-26 15:45:48.481484 | controller | } 2025-11-26 15:45:48.770375 | controller | changed: 2025-11-26 15:45:48.770515 | controller | { 2025-11-26 15:45:48.770546 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2025-11-26 15:45:48.770569 | controller | } 2025-11-26 15:45:49.049657 | controller | changed: 2025-11-26 15:45:49.049719 | controller | { 2025-11-26 15:45:49.049744 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2025-11-26 15:45:49.049764 | controller | } 2025-11-26 15:45:49.330654 | controller | changed: 2025-11-26 15:45:49.330763 | controller | { 2025-11-26 15:45:49.330791 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2025-11-26 15:45:49.330812 | controller | } 2025-11-26 15:45:49.618199 | controller | changed: 2025-11-26 15:45:49.618323 | controller | { 2025-11-26 15:45:49.618352 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2025-11-26 15:45:49.618373 | controller | } 2025-11-26 15:45:49.919876 | controller | changed: 2025-11-26 15:45:49.919996 | controller | { 2025-11-26 15:45:49.920025 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2025-11-26 15:45:49.920048 | controller | } 2025-11-26 15:45:50.220859 | controller | changed: 2025-11-26 15:45:50.221018 | controller | { 2025-11-26 15:45:50.221048 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2025-11-26 15:45:50.221070 | controller | } 2025-11-26 15:45:50.506841 | controller | changed: 2025-11-26 15:45:50.506949 | controller | { 2025-11-26 15:45:50.506977 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2025-11-26 15:45:50.506997 | controller | } 2025-11-26 15:45:50.785706 | controller | changed: 2025-11-26 15:45:50.785789 | controller | { 2025-11-26 15:45:50.785814 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2025-11-26 15:45:50.785834 | controller | } 2025-11-26 15:45:50.803585 | 2025-11-26 15:45:50.803650 | TASK [Set timezone to UTC] 2025-11-26 15:45:51.305262 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2025-11-26 15:45:51.310340 | 2025-11-26 15:45:51.310419 | TASK [Create nodepool directory] 2025-11-26 15:45:51.583497 | controller | changed 2025-11-26 15:45:51.589055 | 2025-11-26 15:45:51.589136 | TASK [Create nodepool sub_nodes file] 2025-11-26 15:45:52.583185 | controller | changed 2025-11-26 15:45:52.588531 | 2025-11-26 15:45:52.588605 | TASK [Create nodepool sub_nodes_private file] 2025-11-26 15:45:53.615159 | controller | changed 2025-11-26 15:45:53.620213 | 2025-11-26 15:45:53.620281 | LOOP [Populate nodepool sub_nodes file] 2025-11-26 15:45:53.649997 | 2025-11-26 15:45:53.650123 | LOOP [Populate nodepool sub_nodes_private file] 2025-11-26 15:45:53.678744 | 2025-11-26 15:45:53.678864 | TASK [Create nodepool primary file] 2025-11-26 15:45:53.702095 | controller | skipping: Conditional result was False 2025-11-26 15:45:53.707077 | 2025-11-26 15:45:53.707145 | TASK [Create nodepool node_private for this node] 2025-11-26 15:45:54.780799 | controller | changed 2025-11-26 15:45:54.786362 | 2025-11-26 15:45:54.786438 | LOOP [Copy ssh keys to nodepool directory] 2025-11-26 15:45:55.174291 | controller | ok: Item: id_rsa Runtime: 0:00:00.004107 2025-11-26 15:45:55.174479 | 2025-11-26 15:45:55.409123 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.005859 2025-11-26 15:45:55.423778 | 2025-11-26 15:45:55.423890 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2025-11-26 15:45:56.453641 | controller | changed 2025-11-26 15:45:56.458497 | 2025-11-26 15:45:56.458572 | TASK [Validate sudoers config after edits] 2025-11-26 15:45:56.729255 | controller | /etc/sudoers: parsed OK 2025-11-26 15:45:56.729404 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2025-11-26 15:45:56.729417 | controller | /etc/sudoers.d/zuul: parsed OK 2025-11-26 15:45:56.729423 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2025-11-26 15:45:56.983725 | controller | ok: Runtime: 0:00:00.004981 2025-11-26 15:45:56.989074 | 2025-11-26 15:45:56.989134 | TASK [Show the environment passed in to job shell scripts] 2025-11-26 15:45:57.249513 | controller | SHELL=/bin/bash 2025-11-26 15:45:57.249558 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2025-11-26 15:45:57.249568 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2025-11-26 15:45:57.249574 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/76/3476/8a0b3785abb80ab4b6c2e6cde2215d1c824d2798 2025-11-26 15:45:57.249580 | controller | PWD=/home/zuul 2025-11-26 15:45:57.249586 | controller | ZUUL_PIPELINE=github-check 2025-11-26 15:45:57.249612 | controller | LOGNAME=zuul 2025-11-26 15:45:57.249678 | controller | XDG_SESSION_TYPE=tty 2025-11-26 15:45:57.249686 | controller | _=/usr/bin/env 2025-11-26 15:45:57.249692 | controller | MOTD_SHOWN=pam 2025-11-26 15:45:57.249697 | controller | HOME=/home/zuul 2025-11-26 15:45:57.249702 | controller | LANG=en_US.UTF-8 2025-11-26 15:45:57.249708 | controller | SSH_CONNECTION=192.168.26.12 42128 192.168.26.189 22 2025-11-26 15:45:57.249713 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2025-11-26 15:45:57.249722 | controller | ZUUL_CHANGE_IDS=3476,8a0b3785abb80ab4b6c2e6cde2215d1c824d2798 2025-11-26 15:45:57.249727 | controller | WORKSPACE=/home/zuul/workspace 2025-11-26 15:45:57.249732 | controller | XDG_SESSION_CLASS=user 2025-11-26 15:45:57.249738 | controller | SELINUX_ROLE_REQUESTED= 2025-11-26 15:45:57.249743 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2025-11-26 15:45:57.249748 | controller | USER=zuul 2025-11-26 15:45:57.249753 | controller | ZUUL_VOTING=True 2025-11-26 15:45:57.249758 | controller | BUILD_TIMEOUT=5400000 2025-11-26 15:45:57.249763 | controller | SELINUX_USE_CURRENT_RANGE= 2025-11-26 15:45:57.249768 | controller | SHLVL=1 2025-11-26 15:45:57.249774 | controller | ZUUL_PATCHSET=8a0b3785abb80ab4b6c2e6cde2215d1c824d2798 2025-11-26 15:45:57.249779 | controller | XDG_SESSION_ID=1 2025-11-26 15:45:57.249784 | controller | ZUUL_BRANCH=main 2025-11-26 15:45:57.249789 | controller | XDG_RUNTIME_DIR=/run/user/1000 2025-11-26 15:45:57.249794 | controller | SSH_CLIENT=192.168.26.12 42128 22 2025-11-26 15:45:57.249800 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2025-11-26 15:45:57.249805 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2025-11-26 15:45:57.249812 | controller | which_declare=declare -f 2025-11-26 15:45:57.249817 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2025-11-26 15:45:57.249823 | controller | SELINUX_LEVEL_REQUESTED= 2025-11-26 15:45:57.249828 | controller | ZUUL_CHANGE=3476 2025-11-26 15:45:57.249833 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2025-11-26 15:45:57.249838 | controller | ZUUL_UUID=d4f91a3c3e7045779492f744b684885d 2025-11-26 15:45:57.249843 | controller | BASH_FUNC_which%%=() { ( alias; 2025-11-26 15:45:57.249849 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2025-11-26 15:45:57.249854 | controller | } 2025-11-26 15:45:57.514132 | controller | ok: Runtime: 0:00:00.006165 2025-11-26 15:45:57.518764 | 2025-11-26 15:45:57.518822 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2025-11-26 15:45:57.532511 | controller | skipping: Conditional result was False 2025-11-26 15:45:57.538277 | 2025-11-26 15:45:57.538341 | TASK [Symlink /home/zuul-worker/workspace] 2025-11-26 15:45:58.089577 | controller | skipping: Conditional result was False 2025-11-26 15:45:58.095261 | 2025-11-26 15:45:58.095332 | TASK [Ensure legacy workspace directory] 2025-11-26 15:45:58.357252 | controller | changed 2025-11-26 15:45:58.374690 | 2025-11-26 15:45:58.374741 | PLAY RECAP 2025-11-26 15:45:58.374787 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-11-26 15:45:58.374810 | 2025-11-26 15:45:58.445276 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-11-26 15:45:58.446000 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-11-26 15:45:58.932960 | 2025-11-26 15:45:58.933062 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2025-11-26 15:45:58.957423 | 2025-11-26 15:45:58.957496 | TASK [Create zuul-output directory] 2025-11-26 15:45:59.331151 | controller | changed 2025-11-26 15:45:59.336297 | 2025-11-26 15:45:59.336371 | TASK [Slurp Zuul inventory test] 2025-11-26 15:45:59.602788 | controller -> localhost | ok 2025-11-26 15:45:59.608529 | 2025-11-26 15:45:59.608597 | TASK [Save zuul inventory] 2025-11-26 15:46:00.729547 | controller | changed 2025-11-26 15:46:00.735122 | 2025-11-26 15:46:00.735204 | TASK [Save zuul vars without the change_message] 2025-11-26 15:46:01.728038 | controller | changed 2025-11-26 15:46:01.746070 | 2025-11-26 15:46:01.746124 | PLAY RECAP 2025-11-26 15:46:01.746168 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-11-26 15:46:01.746191 | 2025-11-26 15:46:01.811096 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-11-26 15:46:01.811804 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-11-26 15:46:02.320297 | 2025-11-26 15:46:02.320404 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2025-11-26 15:46:02.339344 | 2025-11-26 15:46:02.339425 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2025-11-26 15:46:02.358358 | controller | ok 2025-11-26 15:46:02.375939 | 2025-11-26 15:46:02.376032 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-11-26 15:46:02.400039 | controller | skipping: Conditional result was False 2025-11-26 15:46:02.405523 | 2025-11-26 15:46:02.405592 | TASK [mirror-info-fork : Create /etc/ci] 2025-11-26 15:46:02.791734 | controller | ok 2025-11-26 15:46:02.797937 | 2025-11-26 15:46:02.798012 | TASK [mirror-info-fork : Install ci_mirror script] 2025-11-26 15:46:03.758312 | controller | ok 2025-11-26 15:46:03.768015 | 2025-11-26 15:46:03.768081 | TASK [Prepare workspace] 2025-11-26 15:46:03.786376 | controller | ok 2025-11-26 15:46:03.803274 | 2025-11-26 15:46:03.803343 | TASK [prepare-workspace : Start zuul_console daemon.] 2025-11-26 15:46:04.207142 | controller | ok 2025-11-26 15:46:04.213040 | 2025-11-26 15:46:04.213107 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2025-11-26 15:46:06.757587 | controller | Output suppressed because no_log was given 2025-11-26 15:46:06.767144 | 2025-11-26 15:46:06.767242 | LOOP [Create zuul-output directory] 2025-11-26 15:46:07.036274 | controller | changed: "/home/zuul/ci-framework-data/logs" 2025-11-26 15:46:07.269922 | controller | ok: "/home/zuul/zuul-output/logs" 2025-11-26 15:46:07.276180 | 2025-11-26 15:46:07.276276 | TASK [Install required packages] 2025-11-26 15:46:23.422647 | controller | ok: Nothing to do 2025-11-26 15:46:23.427251 | 2025-11-26 15:46:23.427312 | TASK [Install venv] 2025-11-26 15:47:21.113624 | controller | changed 2025-11-26 15:47:21.136654 | 2025-11-26 15:47:21.136744 | PLAY RECAP 2025-11-26 15:47:21.136790 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-11-26 15:47:21.136813 | 2025-11-26 15:47:21.200319 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-11-26 15:47:21.201119 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-11-26 15:47:21.677164 | 2025-11-26 15:47:21.677261 | PLAY [Run ci/playbooks/molecule-test.yml] 2025-11-26 15:47:21.697031 | 2025-11-26 15:47:21.697103 | TASK [Gather required facts] 2025-11-26 15:47:22.253013 | controller | ok 2025-11-26 15:47:22.258140 | 2025-11-26 15:47:22.258211 | TASK [Load environment var if instructed to] 2025-11-26 15:47:22.281871 | controller | skipping: Conditional result was False 2025-11-26 15:47:22.287203 | 2025-11-26 15:47:22.287265 | TASK [Ensure group_vars dir exists] 2025-11-26 15:47:22.661024 | controller | ok 2025-11-26 15:47:22.665950 | 2025-11-26 15:47:22.666036 | TASK [Print related variables] 2025-11-26 15:47:22.693772 | controller | ok: 2025-11-26 15:47:22.693883 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2025-11-26 15:47:22.693927 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2025-11-26 15:47:22.698517 | 2025-11-26 15:47:22.698582 | TASK [Run molecule] 2025-11-26 15:47:23.714724 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2025-11-26 15:47:23.976470 | controller | INFO Performing prerun with role_name_check=0... 2025-11-26 15:47:40.529208 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 15:47:40.529589 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 15:47:40.530028 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 15:47:40.530416 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 15:47:40.530880 | controller | WARNING Another version of 'cifmw.general' 1.0.0+24b8dd11 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+24b8dd11 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 15:47:40.531304 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 15:47:40.531718 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 15:47:40.532131 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 15:47:40.532515 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 15:47:40.532931 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 15:47:40.533340 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 15:47:40.533766 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 15:47:40.534180 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 15:47:40.534580 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 15:47:40.535004 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 15:47:40.543691 | controller | INFO Running crc_layout > prepare 2025-11-26 15:47:41.175994 | controller | 2025-11-26 15:47:41.176022 | controller | PLAY [Prepare] ***************************************************************** 2025-11-26 15:47:41.176252 | controller | 2025-11-26 15:47:41.176293 | controller | TASK [Gathering Facts] ********************************************************* 2025-11-26 15:47:41.176457 | controller | Wednesday 26 November 2025 15:47:41 +0000 (0:00:00.018) 0:00:00.018 **** 2025-11-26 15:47:41.992562 | controller | ok: [instance] 2025-11-26 15:47:41.992654 | controller | 2025-11-26 15:47:41.992794 | controller | TASK [Create custom basedir] *************************************************** 2025-11-26 15:47:41.992902 | controller | Wednesday 26 November 2025 15:47:41 +0000 (0:00:00.817) 0:00:00.835 **** 2025-11-26 15:47:42.304663 | controller | changed: [instance] 2025-11-26 15:47:42.304763 | controller | 2025-11-26 15:47:42.304896 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2025-11-26 15:47:42.305019 | controller | Wednesday 26 November 2025 15:47:42 +0000 (0:00:00.312) 0:00:01.148 **** 2025-11-26 15:47:42.328631 | controller | skipping: [instance] 2025-11-26 15:47:42.328708 | controller | 2025-11-26 15:47:42.328835 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2025-11-26 15:47:42.328948 | controller | Wednesday 26 November 2025 15:47:42 +0000 (0:00:00.023) 0:00:01.171 **** 2025-11-26 15:47:42.377878 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2025-11-26 15:47:42.377951 | controller | 2025-11-26 15:47:42.378067 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2025-11-26 15:47:42.378203 | controller | Wednesday 26 November 2025 15:47:42 +0000 (0:00:00.049) 0:00:01.221 **** 2025-11-26 15:47:42.685702 | controller | ok: [instance] 2025-11-26 15:47:42.685781 | controller | 2025-11-26 15:47:42.685883 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2025-11-26 15:47:42.685978 | controller | Wednesday 26 November 2025 15:47:42 +0000 (0:00:00.307) 0:00:01.528 **** 2025-11-26 15:47:42.899742 | controller | ok: [instance] 2025-11-26 15:47:42.899828 | controller | 2025-11-26 15:47:42.899936 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2025-11-26 15:47:42.900041 | controller | Wednesday 26 November 2025 15:47:42 +0000 (0:00:00.213) 0:00:01.743 **** 2025-11-26 15:47:43.645171 | controller | ok: [instance] => (item=ubi-9-appstream) 2025-11-26 15:47:43.645272 | controller | ok: [instance] => (item=ubi-9-baseos) 2025-11-26 15:47:43.645392 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2025-11-26 15:47:43.645513 | controller | 2025-11-26 15:47:43.645649 | controller | TASK [Deploy repo-setup] ******************************************************* 2025-11-26 15:47:43.645787 | controller | Wednesday 26 November 2025 15:47:43 +0000 (0:00:00.745) 0:00:02.488 **** 2025-11-26 15:47:43.705531 | controller | 2025-11-26 15:47:43.705618 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-11-26 15:47:43.705783 | controller | Wednesday 26 November 2025 15:47:43 +0000 (0:00:00.060) 0:00:02.549 **** 2025-11-26 15:47:44.258918 | controller | changed: [instance] => (item=tmp) 2025-11-26 15:47:44.258963 | controller | changed: [instance] => (item=artifacts/repositories) 2025-11-26 15:47:44.259059 | controller | changed: [instance] => (item=venv/repo_setup) 2025-11-26 15:47:44.259169 | controller | 2025-11-26 15:47:44.259263 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-11-26 15:47:44.259365 | controller | Wednesday 26 November 2025 15:47:44 +0000 (0:00:00.552) 0:00:03.102 **** 2025-11-26 15:47:45.049135 | controller | ok: [instance] 2025-11-26 15:47:45.049691 | controller | 2025-11-26 15:47:46.197628 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-11-26 15:47:46.197666 | controller | Wednesday 26 November 2025 15:47:45 +0000 (0:00:00.790) 0:00:03.892 **** 2025-11-26 15:47:46.197681 | controller | changed: [instance] 2025-11-26 15:47:53.760506 | controller | 2025-11-26 15:47:53.760544 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-11-26 15:47:53.760553 | controller | Wednesday 26 November 2025 15:47:46 +0000 (0:00:01.148) 0:00:05.040 **** 2025-11-26 15:47:53.760563 | controller | changed: [instance] 2025-11-26 15:47:54.449697 | controller | 2025-11-26 15:47:54.449727 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-11-26 15:47:54.449735 | controller | Wednesday 26 November 2025 15:47:53 +0000 (0:00:07.563) 0:00:12.603 **** 2025-11-26 15:47:54.449745 | controller | changed: [instance] 2025-11-26 15:47:54.449953 | controller | 2025-11-26 15:47:54.449989 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-11-26 15:47:54.469190 | controller | Wednesday 26 November 2025 15:47:54 +0000 (0:00:00.689) 0:00:13.292 **** 2025-11-26 15:47:54.469215 | controller | skipping: [instance] 2025-11-26 15:47:55.239671 | controller | 2025-11-26 15:47:55.239694 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-11-26 15:47:55.239702 | controller | Wednesday 26 November 2025 15:47:54 +0000 (0:00:00.019) 0:00:13.312 **** 2025-11-26 15:47:55.239712 | controller | changed: [instance] 2025-11-26 15:47:55.273740 | controller | 2025-11-26 15:47:55.273781 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-11-26 15:47:55.273791 | controller | Wednesday 26 November 2025 15:47:55 +0000 (0:00:00.770) 0:00:14.082 **** 2025-11-26 15:47:55.273804 | controller | skipping: [instance] 2025-11-26 15:47:55.305379 | controller | 2025-11-26 15:47:55.305400 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-11-26 15:47:55.305407 | controller | Wednesday 26 November 2025 15:47:55 +0000 (0:00:00.033) 0:00:14.116 **** 2025-11-26 15:47:55.305416 | controller | skipping: [instance] 2025-11-26 15:47:55.336696 | controller | 2025-11-26 15:47:55.336729 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-11-26 15:47:55.336737 | controller | Wednesday 26 November 2025 15:47:55 +0000 (0:00:00.031) 0:00:14.148 **** 2025-11-26 15:47:55.336748 | controller | skipping: [instance] 2025-11-26 15:47:55.336773 | controller | 2025-11-26 15:47:55.337202 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-11-26 15:47:55.840672 | controller | Wednesday 26 November 2025 15:47:55 +0000 (0:00:00.031) 0:00:14.180 **** 2025-11-26 15:47:55.840712 | controller | changed: [instance] 2025-11-26 15:47:56.248300 | controller | 2025-11-26 15:47:56.248347 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-11-26 15:47:56.248357 | controller | Wednesday 26 November 2025 15:47:55 +0000 (0:00:00.503) 0:00:14.683 **** 2025-11-26 15:47:56.248369 | controller | changed: [instance] 2025-11-26 15:47:56.248392 | controller | 2025-11-26 15:47:56.248465 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-11-26 15:47:56.248591 | controller | Wednesday 26 November 2025 15:47:56 +0000 (0:00:00.408) 0:00:15.091 **** 2025-11-26 15:47:56.278249 | controller | skipping: [instance] 2025-11-26 15:47:56.303767 | controller | 2025-11-26 15:47:56.303809 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-11-26 15:47:56.303817 | controller | Wednesday 26 November 2025 15:47:56 +0000 (0:00:00.029) 0:00:15.121 **** 2025-11-26 15:47:56.303830 | controller | skipping: [instance] 2025-11-26 15:47:56.303874 | controller | 2025-11-26 15:47:56.303895 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-11-26 15:47:56.303907 | controller | Wednesday 26 November 2025 15:47:56 +0000 (0:00:00.025) 0:00:15.147 **** 2025-11-26 15:47:56.329719 | controller | skipping: [instance] 2025-11-26 15:47:56.329766 | controller | 2025-11-26 15:47:56.329776 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-11-26 15:47:56.329893 | controller | Wednesday 26 November 2025 15:47:56 +0000 (0:00:00.025) 0:00:15.173 **** 2025-11-26 15:47:56.363557 | controller | ok: [instance] 2025-11-26 15:47:56.388439 | controller | 2025-11-26 15:47:56.388456 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-11-26 15:47:56.388463 | controller | Wednesday 26 November 2025 15:47:56 +0000 (0:00:00.033) 0:00:15.206 **** 2025-11-26 15:47:56.388479 | controller | skipping: [instance] 2025-11-26 15:47:56.412027 | controller | 2025-11-26 15:47:56.412059 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-11-26 15:47:56.412073 | controller | Wednesday 26 November 2025 15:47:56 +0000 (0:00:00.024) 0:00:15.231 **** 2025-11-26 15:47:56.412088 | controller | skipping: [instance] 2025-11-26 15:47:56.412391 | controller | 2025-11-26 15:47:56.412535 | controller | TASK [Download the RPM] ******************************************************** 2025-11-26 15:47:56.412687 | controller | Wednesday 26 November 2025 15:47:56 +0000 (0:00:00.024) 0:00:15.255 **** 2025-11-26 15:47:56.439155 | controller | skipping: [instance] 2025-11-26 15:47:56.439413 | controller | 2025-11-26 15:47:56.439558 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-11-26 15:47:56.439724 | controller | Wednesday 26 November 2025 15:47:56 +0000 (0:00:00.027) 0:00:15.282 **** 2025-11-26 15:47:56.493219 | controller | skipping: [instance] 2025-11-26 15:47:56.493424 | controller | 2025-11-26 15:47:56.493579 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-11-26 15:47:56.493794 | controller | Wednesday 26 November 2025 15:47:56 +0000 (0:00:00.054) 0:00:15.336 **** 2025-11-26 15:47:56.518007 | controller | skipping: [instance] 2025-11-26 15:47:56.518304 | controller | 2025-11-26 15:47:56.518535 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-11-26 15:47:56.518698 | controller | Wednesday 26 November 2025 15:47:56 +0000 (0:00:00.024) 0:00:15.361 **** 2025-11-26 15:47:56.544430 | controller | skipping: [instance] 2025-11-26 15:47:56.544668 | controller | 2025-11-26 15:47:56.544826 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-11-26 15:47:56.544965 | controller | Wednesday 26 November 2025 15:47:56 +0000 (0:00:00.026) 0:00:15.387 **** 2025-11-26 15:47:56.569264 | controller | skipping: [instance] 2025-11-26 15:47:56.569572 | controller | 2025-11-26 15:47:56.569771 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-11-26 15:47:56.569917 | controller | Wednesday 26 November 2025 15:47:56 +0000 (0:00:00.024) 0:00:15.412 **** 2025-11-26 15:47:56.741535 | controller | ok: [instance] 2025-11-26 15:47:56.940029 | controller | 2025-11-26 15:47:56.940054 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-11-26 15:47:56.940064 | controller | Wednesday 26 November 2025 15:47:56 +0000 (0:00:00.172) 0:00:15.584 **** 2025-11-26 15:47:56.940076 | controller | changed: [instance] 2025-11-26 15:47:57.146154 | controller | 2025-11-26 15:47:57.146173 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-11-26 15:47:57.146181 | controller | Wednesday 26 November 2025 15:47:56 +0000 (0:00:00.198) 0:00:15.782 **** 2025-11-26 15:47:57.146189 | controller | changed: [instance] 2025-11-26 15:47:57.165868 | controller | 2025-11-26 15:47:57.165912 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-11-26 15:47:57.165922 | controller | Wednesday 26 November 2025 15:47:57 +0000 (0:00:00.206) 0:00:15.989 **** 2025-11-26 15:47:57.165935 | controller | skipping: [instance] 2025-11-26 15:47:57.184758 | controller | 2025-11-26 15:47:57.184787 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-11-26 15:47:57.184796 | controller | Wednesday 26 November 2025 15:47:57 +0000 (0:00:00.019) 0:00:16.008 **** 2025-11-26 15:47:57.184807 | controller | skipping: [instance] 2025-11-26 15:47:57.202660 | controller | 2025-11-26 15:47:57.202681 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-11-26 15:47:57.202694 | controller | Wednesday 26 November 2025 15:47:57 +0000 (0:00:00.019) 0:00:16.027 **** 2025-11-26 15:47:57.202704 | controller | skipping: [instance] 2025-11-26 15:47:57.203044 | controller | 2025-11-26 15:47:57.222662 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-11-26 15:47:57.222683 | controller | Wednesday 26 November 2025 15:47:57 +0000 (0:00:00.018) 0:00:16.046 **** 2025-11-26 15:47:57.222694 | controller | skipping: [instance] 2025-11-26 15:47:57.222717 | controller | 2025-11-26 15:47:57.222945 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-11-26 15:47:57.241369 | controller | Wednesday 26 November 2025 15:47:57 +0000 (0:00:00.020) 0:00:16.066 **** 2025-11-26 15:47:57.241407 | controller | skipping: [instance] 2025-11-26 15:47:57.241713 | controller | 2025-11-26 15:47:57.241968 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-11-26 15:47:57.242094 | controller | Wednesday 26 November 2025 15:47:57 +0000 (0:00:00.018) 0:00:16.084 **** 2025-11-26 15:47:57.259736 | controller | skipping: [instance] 2025-11-26 15:47:57.259982 | controller | 2025-11-26 15:47:57.260128 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-11-26 15:47:57.260268 | controller | Wednesday 26 November 2025 15:47:57 +0000 (0:00:00.018) 0:00:16.103 **** 2025-11-26 15:47:57.274540 | controller | skipping: [instance] 2025-11-26 15:47:57.274854 | controller | 2025-11-26 15:47:57.275056 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-11-26 15:47:57.275197 | controller | Wednesday 26 November 2025 15:47:57 +0000 (0:00:00.014) 0:00:16.117 **** 2025-11-26 15:47:57.299924 | controller | skipping: [instance] 2025-11-26 15:47:57.300140 | controller | 2025-11-26 15:47:57.300271 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-11-26 15:47:57.300419 | controller | Wednesday 26 November 2025 15:47:57 +0000 (0:00:00.025) 0:00:16.143 **** 2025-11-26 15:47:57.314122 | controller | skipping: [instance] 2025-11-26 15:47:57.314419 | controller | 2025-11-26 15:47:57.314720 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-11-26 15:47:57.314978 | controller | Wednesday 26 November 2025 15:47:57 +0000 (0:00:00.014) 0:00:16.157 **** 2025-11-26 15:47:57.332242 | controller | skipping: [instance] 2025-11-26 15:47:57.332542 | controller | 2025-11-26 15:47:57.332854 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2025-11-26 15:47:57.333107 | controller | Wednesday 26 November 2025 15:47:57 +0000 (0:00:00.018) 0:00:16.175 **** 2025-11-26 15:47:57.360058 | controller | skipping: [instance] 2025-11-26 15:47:57.360248 | controller | 2025-11-26 15:47:57.360405 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2025-11-26 15:47:57.360542 | controller | Wednesday 26 November 2025 15:47:57 +0000 (0:00:00.027) 0:00:16.203 **** 2025-11-26 15:47:57.386354 | controller | skipping: [instance] 2025-11-26 15:47:57.386668 | controller | 2025-11-26 15:47:57.386961 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2025-11-26 15:47:57.387220 | controller | Wednesday 26 November 2025 15:47:57 +0000 (0:00:00.026) 0:00:16.229 **** 2025-11-26 15:47:57.412873 | controller | skipping: [instance] 2025-11-26 15:47:57.413150 | controller | 2025-11-26 15:47:57.413357 | controller | TASK [test_deps : Install additional packages] ********************************* 2025-11-26 15:47:57.413490 | controller | Wednesday 26 November 2025 15:47:57 +0000 (0:00:00.026) 0:00:16.256 **** 2025-11-26 15:47:57.440459 | controller | skipping: [instance] 2025-11-26 15:47:57.440641 | controller | 2025-11-26 15:47:57.440799 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2025-11-26 15:47:57.440939 | controller | Wednesday 26 November 2025 15:47:57 +0000 (0:00:00.027) 0:00:16.284 **** 2025-11-26 15:48:42.676480 | controller | ok: [instance] 2025-11-26 15:48:43.826929 | controller | 2025-11-26 15:48:43.826958 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2025-11-26 15:48:43.826967 | controller | Wednesday 26 November 2025 15:48:42 +0000 (0:00:45.235) 0:01:01.519 **** 2025-11-26 15:48:43.826977 | controller | ok: [instance] 2025-11-26 15:48:43.859067 | controller | 2025-11-26 15:48:43.859123 | controller | TASK [test_deps : Install extra packages] ************************************** 2025-11-26 15:48:43.859138 | controller | Wednesday 26 November 2025 15:48:43 +0000 (0:00:01.150) 0:01:02.669 **** 2025-11-26 15:48:43.859158 | controller | skipping: [instance] 2025-11-26 15:48:43.901516 | controller | 2025-11-26 15:48:43.901546 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-11-26 15:48:43.901556 | controller | Wednesday 26 November 2025 15:48:43 +0000 (0:00:00.031) 0:01:02.701 **** 2025-11-26 15:48:43.901568 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2025-11-26 15:48:43.901717 | controller | 2025-11-26 15:48:43.901729 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-11-26 15:48:43.901737 | controller | Wednesday 26 November 2025 15:48:43 +0000 (0:00:00.042) 0:01:02.744 **** 2025-11-26 15:48:43.921745 | controller | ok: [instance] => 2025-11-26 15:48:43.922489 | controller | cifmw_ci_setup_packages: 2025-11-26 15:48:43.922512 | controller | - bash-completion 2025-11-26 15:48:43.922521 | controller | - ca-certificates 2025-11-26 15:48:43.922532 | controller | - git-core 2025-11-26 15:48:52.127363 | controller | - make 2025-11-26 15:48:52.127420 | controller | - tar 2025-11-26 15:48:52.127434 | controller | - tmux 2025-11-26 15:48:52.127444 | controller | - python3-pip 2025-11-26 15:48:52.127454 | controller | 2025-11-26 15:48:52.127464 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-11-26 15:48:52.127475 | controller | Wednesday 26 November 2025 15:48:43 +0000 (0:00:00.020) 0:01:02.764 **** 2025-11-26 15:48:52.127494 | controller | changed: [instance] 2025-11-26 15:48:52.696450 | controller | 2025-11-26 15:48:52.696479 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-11-26 15:48:52.696487 | controller | Wednesday 26 November 2025 15:48:52 +0000 (0:00:08.205) 0:01:10.970 **** 2025-11-26 15:48:52.696498 | controller | ok: [instance] 2025-11-26 15:48:52.696671 | controller | 2025-11-26 15:48:52.696825 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-11-26 15:48:52.696838 | controller | Wednesday 26 November 2025 15:48:52 +0000 (0:00:00.569) 0:01:11.539 **** 2025-11-26 15:48:52.902714 | controller | changed: [instance] 2025-11-26 15:48:52.902780 | controller | 2025-11-26 15:48:52.903019 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-11-26 15:48:58.754561 | controller | Wednesday 26 November 2025 15:48:52 +0000 (0:00:00.206) 0:01:11.745 **** 2025-11-26 15:48:58.754596 | controller | changed: [instance] 2025-11-26 15:48:58.789733 | controller | 2025-11-26 15:48:58.789767 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-11-26 15:48:58.789777 | controller | Wednesday 26 November 2025 15:48:58 +0000 (0:00:05.851) 0:01:17.597 **** 2025-11-26 15:48:58.789790 | controller | ok: [instance] 2025-11-26 15:48:58.789797 | controller | 2025-11-26 15:48:58.789805 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-11-26 15:48:58.789814 | controller | Wednesday 26 November 2025 15:48:58 +0000 (0:00:00.035) 0:01:17.633 **** 2025-11-26 15:48:59.035760 | controller | changed: [instance] 2025-11-26 15:48:59.035954 | controller | 2025-11-26 15:48:59.035976 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-11-26 15:48:59.289270 | controller | Wednesday 26 November 2025 15:48:59 +0000 (0:00:00.245) 0:01:17.879 **** 2025-11-26 15:48:59.289289 | controller | changed: [instance] 2025-11-26 15:48:59.305753 | controller | 2025-11-26 15:48:59.305793 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-11-26 15:48:59.305802 | controller | Wednesday 26 November 2025 15:48:59 +0000 (0:00:00.253) 0:01:18.132 **** 2025-11-26 15:48:59.305814 | controller | skipping: [instance] 2025-11-26 15:48:59.305844 | controller | 2025-11-26 15:48:59.306198 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-11-26 15:48:59.321564 | controller | Wednesday 26 November 2025 15:48:59 +0000 (0:00:00.016) 0:01:18.149 **** 2025-11-26 15:48:59.321631 | controller | skipping: [instance] 2025-11-26 15:48:59.336771 | controller | 2025-11-26 15:48:59.336806 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-11-26 15:48:59.336816 | controller | Wednesday 26 November 2025 15:48:59 +0000 (0:00:00.015) 0:01:18.164 **** 2025-11-26 15:48:59.336829 | controller | skipping: [instance] 2025-11-26 15:48:59.337129 | controller | 2025-11-26 15:48:59.352267 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-11-26 15:48:59.352286 | controller | Wednesday 26 November 2025 15:48:59 +0000 (0:00:00.015) 0:01:18.180 **** 2025-11-26 15:48:59.352297 | controller | skipping: [instance] 2025-11-26 15:48:59.368290 | controller | 2025-11-26 15:48:59.368323 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-11-26 15:48:59.368347 | controller | Wednesday 26 November 2025 15:48:59 +0000 (0:00:00.015) 0:01:18.195 **** 2025-11-26 15:48:59.368364 | controller | skipping: [instance] 2025-11-26 15:48:59.368663 | controller | 2025-11-26 15:48:59.368961 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-11-26 15:48:59.369131 | controller | Wednesday 26 November 2025 15:48:59 +0000 (0:00:00.016) 0:01:18.211 **** 2025-11-26 15:48:59.390908 | controller | skipping: [instance] 2025-11-26 15:48:59.391102 | controller | 2025-11-26 15:48:59.391232 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-11-26 15:48:59.391361 | controller | Wednesday 26 November 2025 15:48:59 +0000 (0:00:00.022) 0:01:18.234 **** 2025-11-26 15:49:00.311523 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2025-11-26 15:49:00.630070 | controller | changed: [instance] => (item=/opt/basedir/logs) 2025-11-26 15:49:00.630092 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2025-11-26 15:49:00.630099 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2025-11-26 15:49:00.630105 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2025-11-26 15:49:00.630111 | controller | 2025-11-26 15:49:00.630116 | controller | TASK [Create secret file] ****************************************************** 2025-11-26 15:49:00.630122 | controller | Wednesday 26 November 2025 15:49:00 +0000 (0:00:00.920) 0:01:19.154 **** 2025-11-26 15:49:00.630131 | controller | changed: [instance] 2025-11-26 15:49:00.630158 | controller | 2025-11-26 15:49:00.630279 | controller | PLAY RECAP ********************************************************************* 2025-11-26 15:49:00.630391 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2025-11-26 15:49:00.630772 | controller | 2025-11-26 15:49:00.632682 | controller | Wednesday 26 November 2025 15:49:00 +0000 (0:00:00.319) 0:01:19.473 **** 2025-11-26 15:49:00.632714 | controller | =============================================================================== 2025-11-26 15:49:00.632726 | controller | test_deps : Install selinux python libs -------------------------------- 45.24s 2025-11-26 15:49:00.689363 | controller | ci_setup : Install needed packages -------------------------------------- 8.21s 2025-11-26 15:49:00.689397 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.56s 2025-11-26 15:49:00.689404 | controller | ci_setup : Install openshift client ------------------------------------- 5.85s 2025-11-26 15:49:00.689409 | controller | test_deps : Install python yaml libs ------------------------------------ 1.15s 2025-11-26 15:49:00.689414 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.15s 2025-11-26 15:49:00.689419 | controller | ci_setup : Manage directories ------------------------------------------- 0.92s 2025-11-26 15:49:00.689424 | controller | Gathering Facts --------------------------------------------------------- 0.82s 2025-11-26 15:49:00.689429 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.79s 2025-11-26 15:49:00.689434 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.77s 2025-11-26 15:49:00.689439 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.75s 2025-11-26 15:49:00.689444 | controller | repo_setup : Install repo-setup package --------------------------------- 0.69s 2025-11-26 15:49:00.689448 | controller | ci_setup : Gather version of openshift client --------------------------- 0.57s 2025-11-26 15:49:00.689453 | controller | repo_setup : Ensure directories are present ----------------------------- 0.55s 2025-11-26 15:49:00.689458 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.50s 2025-11-26 15:49:00.689462 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.41s 2025-11-26 15:49:00.689467 | controller | Create secret file ------------------------------------------------------ 0.32s 2025-11-26 15:49:00.689472 | controller | Create custom basedir --------------------------------------------------- 0.31s 2025-11-26 15:49:00.689476 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.31s 2025-11-26 15:49:00.689487 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.25s 2025-11-26 15:49:00.689497 | controller | INFO Running crc_layout > converge 2025-11-26 15:49:01.236343 | controller | 2025-11-26 15:49:01.236641 | controller | PLAY [Converge] **************************************************************** 2025-11-26 15:49:01.236789 | controller | 2025-11-26 15:49:01.236932 | controller | TASK [Gathering Facts] ********************************************************* 2025-11-26 15:49:01.237073 | controller | Wednesday 26 November 2025 15:49:01 +0000 (0:00:00.024) 0:00:00.024 **** 2025-11-26 15:49:02.013642 | controller | ok: [instance] 2025-11-26 15:49:02.035754 | controller | 2025-11-26 15:49:02.035788 | controller | TASK [Load networking definition from scenario file] *************************** 2025-11-26 15:49:02.035798 | controller | Wednesday 26 November 2025 15:49:02 +0000 (0:00:00.777) 0:00:00.802 **** 2025-11-26 15:49:02.035810 | controller | ok: [instance] 2025-11-26 15:49:02.035840 | controller | 2025-11-26 15:49:02.035850 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-11-26 15:49:02.036015 | controller | Wednesday 26 November 2025 15:49:02 +0000 (0:00:00.022) 0:00:00.824 **** 2025-11-26 15:49:03.940708 | controller | changed: [instance] 2025-11-26 15:49:03.940909 | controller | 2025-11-26 15:49:03.940933 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-11-26 15:49:03.965742 | controller | Wednesday 26 November 2025 15:49:03 +0000 (0:00:01.904) 0:00:02.729 **** 2025-11-26 15:49:03.965773 | controller | ok: [instance] 2025-11-26 15:49:03.965938 | controller | 2025-11-26 15:49:03.965957 | controller | TASK [reproducer : Load CI job environment] ************************************ 2025-11-26 15:49:03.985748 | controller | Wednesday 26 November 2025 15:49:03 +0000 (0:00:00.025) 0:00:02.754 **** 2025-11-26 15:49:03.985769 | controller | skipping: [instance] 2025-11-26 15:49:04.046810 | controller | 2025-11-26 15:49:04.046844 | controller | TASK [Build final libvirt layout] ********************************************** 2025-11-26 15:49:04.046857 | controller | Wednesday 26 November 2025 15:49:03 +0000 (0:00:00.020) 0:00:02.774 **** 2025-11-26 15:49:04.046872 | controller | 2025-11-26 15:49:04.123509 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2025-11-26 15:49:04.123529 | controller | Wednesday 26 November 2025 15:49:04 +0000 (0:00:00.060) 0:00:02.835 **** 2025-11-26 15:49:04.123539 | controller | ok: [instance] 2025-11-26 15:49:04.179685 | controller | 2025-11-26 15:49:04.179739 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2025-11-26 15:49:04.179754 | controller | Wednesday 26 November 2025 15:49:04 +0000 (0:00:00.076) 0:00:02.911 **** 2025-11-26 15:49:04.179770 | controller | skipping: [instance] 2025-11-26 15:49:04.180038 | controller | 2025-11-26 15:49:04.180300 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2025-11-26 15:49:04.180548 | controller | Wednesday 26 November 2025 15:49:04 +0000 (0:00:00.056) 0:00:02.968 **** 2025-11-26 15:49:04.204464 | controller | ok: [instance] 2025-11-26 15:49:04.204800 | controller | 2025-11-26 15:49:04.205091 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2025-11-26 15:49:04.205232 | controller | Wednesday 26 November 2025 15:49:04 +0000 (0:00:00.024) 0:00:02.993 **** 2025-11-26 15:49:04.227240 | controller | ok: [instance] => changed=false 2025-11-26 15:49:04.227434 | controller | msg: All assertions passed 2025-11-26 15:49:04.227595 | controller | 2025-11-26 15:49:04.227829 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2025-11-26 15:49:04.228000 | controller | Wednesday 26 November 2025 15:49:04 +0000 (0:00:00.022) 0:00:03.016 **** 2025-11-26 15:49:04.269049 | controller | ok: [instance] 2025-11-26 15:49:04.269300 | controller | 2025-11-26 15:49:04.269433 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2025-11-26 15:49:04.269561 | controller | Wednesday 26 November 2025 15:49:04 +0000 (0:00:00.041) 0:00:03.057 **** 2025-11-26 15:49:04.701354 | controller | ok: [instance] => (item=artifacts) 2025-11-26 15:49:04.771756 | controller | ok: [instance] => (item=logs) 2025-11-26 15:49:04.771801 | controller | 2025-11-26 15:49:04.771814 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2025-11-26 15:49:04.771834 | controller | Wednesday 26 November 2025 15:49:04 +0000 (0:00:00.432) 0:00:03.490 **** 2025-11-26 15:49:04.771850 | controller | 2025-11-26 15:49:04.771894 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2025-11-26 15:49:04.772070 | controller | Wednesday 26 November 2025 15:49:04 +0000 (0:00:00.070) 0:00:03.560 **** 2025-11-26 15:49:04.951452 | controller | ok: [instance] 2025-11-26 15:49:05.194670 | controller | 2025-11-26 15:49:05.194701 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2025-11-26 15:49:05.194708 | controller | Wednesday 26 November 2025 15:49:04 +0000 (0:00:00.179) 0:00:03.740 **** 2025-11-26 15:49:05.194725 | controller | changed: [instance] 2025-11-26 15:49:05.194749 | controller | 2025-11-26 15:49:05.194757 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2025-11-26 15:49:05.194822 | controller | Wednesday 26 November 2025 15:49:05 +0000 (0:00:00.243) 0:00:03.983 **** 2025-11-26 15:49:05.475661 | controller | ok: [instance] 2025-11-26 15:49:05.505713 | controller | 2025-11-26 15:49:05.505764 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2025-11-26 15:49:05.505774 | controller | Wednesday 26 November 2025 15:49:05 +0000 (0:00:00.280) 0:00:04.264 **** 2025-11-26 15:49:05.505787 | controller | skipping: [instance] 2025-11-26 15:49:05.522779 | controller | 2025-11-26 15:49:05.522808 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2025-11-26 15:49:05.522817 | controller | Wednesday 26 November 2025 15:49:05 +0000 (0:00:00.030) 0:00:04.294 **** 2025-11-26 15:49:05.522827 | controller | skipping: [instance] 2025-11-26 15:49:05.542688 | controller | 2025-11-26 15:49:05.542713 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2025-11-26 15:49:05.542735 | controller | Wednesday 26 November 2025 15:49:05 +0000 (0:00:00.016) 0:00:04.310 **** 2025-11-26 15:49:05.542746 | controller | ok: [instance] 2025-11-26 15:49:05.542777 | controller | 2025-11-26 15:49:05.542973 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2025-11-26 15:49:05.568681 | controller | Wednesday 26 November 2025 15:49:05 +0000 (0:00:00.019) 0:00:04.330 **** 2025-11-26 15:49:05.568707 | controller | skipping: [instance] 2025-11-26 15:49:05.568754 | controller | 2025-11-26 15:49:05.568870 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2025-11-26 15:49:05.568988 | controller | Wednesday 26 November 2025 15:49:05 +0000 (0:00:00.026) 0:00:04.357 **** 2025-11-26 15:49:16.387291 | controller | changed: [instance] 2025-11-26 15:49:16.387507 | controller | 2025-11-26 15:49:16.387544 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2025-11-26 15:49:16.593727 | controller | Wednesday 26 November 2025 15:49:16 +0000 (0:00:10.818) 0:00:15.175 **** 2025-11-26 15:49:16.593780 | controller | changed: [instance] 2025-11-26 15:49:16.593808 | controller | 2025-11-26 15:49:16.594028 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2025-11-26 15:49:16.594055 | controller | Wednesday 26 November 2025 15:49:16 +0000 (0:00:00.206) 0:00:15.382 **** 2025-11-26 15:49:17.085116 | controller | changed: [instance] 2025-11-26 15:49:17.654322 | controller | 2025-11-26 15:49:17.654352 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2025-11-26 15:49:17.654360 | controller | Wednesday 26 November 2025 15:49:17 +0000 (0:00:00.491) 0:00:15.873 **** 2025-11-26 15:49:17.654369 | controller | changed: [instance] 2025-11-26 15:49:17.836683 | controller | 2025-11-26 15:49:17.836719 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2025-11-26 15:49:17.836727 | controller | Wednesday 26 November 2025 15:49:17 +0000 (0:00:00.569) 0:00:16.442 **** 2025-11-26 15:49:17.836744 | controller | ok: [instance] 2025-11-26 15:49:17.836774 | controller | 2025-11-26 15:49:17.836877 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2025-11-26 15:49:17.837013 | controller | Wednesday 26 November 2025 15:49:17 +0000 (0:00:00.182) 0:00:16.625 **** 2025-11-26 15:49:18.467167 | controller | ok: [instance] 2025-11-26 15:49:19.325743 | controller | 2025-11-26 15:49:19.325823 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2025-11-26 15:49:19.325851 | controller | Wednesday 26 November 2025 15:49:18 +0000 (0:00:00.629) 0:00:17.255 **** 2025-11-26 15:49:19.325873 | controller | changed: [instance] 2025-11-26 15:49:19.405834 | controller | 2025-11-26 15:49:19.405881 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2025-11-26 15:49:19.405894 | controller | Wednesday 26 November 2025 15:49:19 +0000 (0:00:00.858) 0:00:18.114 **** 2025-11-26 15:49:19.405912 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2025-11-26 15:49:19.405955 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2025-11-26 15:49:19.405966 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2025-11-26 15:49:19.405975 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2025-11-26 15:49:19.405984 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2025-11-26 15:49:19.405993 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2025-11-26 15:49:19.406001 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2025-11-26 15:49:19.406010 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2025-11-26 15:49:19.406019 | controller | 2025-11-26 15:49:19.406031 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2025-11-26 15:49:19.711199 | controller | Wednesday 26 November 2025 15:49:19 +0000 (0:00:00.079) 0:00:18.193 **** 2025-11-26 15:49:19.711237 | controller | ok: [instance] 2025-11-26 15:49:20.014121 | controller | 2025-11-26 15:49:20.014153 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2025-11-26 15:49:20.014161 | controller | Wednesday 26 November 2025 15:49:19 +0000 (0:00:00.305) 0:00:18.499 **** 2025-11-26 15:49:20.014171 | controller | ok: [instance] 2025-11-26 15:49:20.316641 | controller | 2025-11-26 15:49:20.316672 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2025-11-26 15:49:20.316680 | controller | Wednesday 26 November 2025 15:49:20 +0000 (0:00:00.302) 0:00:18.802 **** 2025-11-26 15:49:20.316690 | controller | ok: [instance] 2025-11-26 15:49:20.617682 | controller | 2025-11-26 15:49:20.617715 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2025-11-26 15:49:20.617723 | controller | Wednesday 26 November 2025 15:49:20 +0000 (0:00:00.302) 0:00:19.105 **** 2025-11-26 15:49:20.617734 | controller | ok: [instance] 2025-11-26 15:49:20.617768 | controller | 2025-11-26 15:49:20.617777 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2025-11-26 15:49:20.617882 | controller | Wednesday 26 November 2025 15:49:20 +0000 (0:00:00.301) 0:00:19.406 **** 2025-11-26 15:49:20.920533 | controller | ok: [instance] 2025-11-26 15:49:21.214114 | controller | 2025-11-26 15:49:21.214137 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2025-11-26 15:49:21.214146 | controller | Wednesday 26 November 2025 15:49:20 +0000 (0:00:00.302) 0:00:19.709 **** 2025-11-26 15:49:21.214156 | controller | ok: [instance] 2025-11-26 15:49:21.508647 | controller | 2025-11-26 15:49:21.508683 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2025-11-26 15:49:21.508696 | controller | Wednesday 26 November 2025 15:49:21 +0000 (0:00:00.293) 0:00:20.002 **** 2025-11-26 15:49:21.508735 | controller | ok: [instance] 2025-11-26 15:49:21.813691 | controller | 2025-11-26 15:49:21.813722 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2025-11-26 15:49:21.813732 | controller | Wednesday 26 November 2025 15:49:21 +0000 (0:00:00.294) 0:00:20.297 **** 2025-11-26 15:49:21.813751 | controller | ok: [instance] 2025-11-26 15:49:21.813770 | controller | 2025-11-26 15:49:21.813777 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2025-11-26 15:49:21.813786 | controller | Wednesday 26 November 2025 15:49:21 +0000 (0:00:00.305) 0:00:20.602 **** 2025-11-26 15:49:22.114221 | controller | ok: [instance] 2025-11-26 15:49:22.414279 | controller | 2025-11-26 15:49:22.414302 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2025-11-26 15:49:22.414311 | controller | Wednesday 26 November 2025 15:49:22 +0000 (0:00:00.300) 0:00:20.902 **** 2025-11-26 15:49:22.414321 | controller | ok: [instance] 2025-11-26 15:49:22.722310 | controller | 2025-11-26 15:49:22.722328 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2025-11-26 15:49:22.722336 | controller | Wednesday 26 November 2025 15:49:22 +0000 (0:00:00.300) 0:00:21.202 **** 2025-11-26 15:49:22.722344 | controller | ok: [instance] 2025-11-26 15:49:23.038710 | controller | 2025-11-26 15:49:23.038734 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2025-11-26 15:49:23.038743 | controller | Wednesday 26 November 2025 15:49:22 +0000 (0:00:00.307) 0:00:21.510 **** 2025-11-26 15:49:23.038754 | controller | ok: [instance] 2025-11-26 15:49:23.355309 | controller | 2025-11-26 15:49:23.355338 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2025-11-26 15:49:23.355346 | controller | Wednesday 26 November 2025 15:49:23 +0000 (0:00:00.316) 0:00:21.827 **** 2025-11-26 15:49:23.355356 | controller | ok: [instance] 2025-11-26 15:49:23.664754 | controller | 2025-11-26 15:49:23.664803 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2025-11-26 15:49:23.664813 | controller | Wednesday 26 November 2025 15:49:23 +0000 (0:00:00.316) 0:00:22.143 **** 2025-11-26 15:49:23.664827 | controller | ok: [instance] 2025-11-26 15:49:23.664860 | controller | 2025-11-26 15:49:23.664870 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2025-11-26 15:49:23.664984 | controller | Wednesday 26 November 2025 15:49:23 +0000 (0:00:00.309) 0:00:22.453 **** 2025-11-26 15:49:23.973171 | controller | ok: [instance] 2025-11-26 15:49:24.276454 | controller | 2025-11-26 15:49:24.276484 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2025-11-26 15:49:24.276494 | controller | Wednesday 26 November 2025 15:49:23 +0000 (0:00:00.308) 0:00:22.761 **** 2025-11-26 15:49:24.276505 | controller | ok: [instance] 2025-11-26 15:49:24.585499 | controller | 2025-11-26 15:49:24.585533 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2025-11-26 15:49:24.585542 | controller | Wednesday 26 November 2025 15:49:24 +0000 (0:00:00.303) 0:00:23.065 **** 2025-11-26 15:49:24.585552 | controller | ok: [instance] 2025-11-26 15:49:24.886720 | controller | 2025-11-26 15:49:24.886760 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2025-11-26 15:49:24.886781 | controller | Wednesday 26 November 2025 15:49:24 +0000 (0:00:00.309) 0:00:23.374 **** 2025-11-26 15:49:24.886796 | controller | ok: [instance] 2025-11-26 15:49:25.185027 | controller | 2025-11-26 15:49:25.185051 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2025-11-26 15:49:25.185059 | controller | Wednesday 26 November 2025 15:49:24 +0000 (0:00:00.301) 0:00:23.675 **** 2025-11-26 15:49:25.185068 | controller | ok: [instance] 2025-11-26 15:49:25.499727 | controller | 2025-11-26 15:49:25.499760 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2025-11-26 15:49:25.499781 | controller | Wednesday 26 November 2025 15:49:25 +0000 (0:00:00.298) 0:00:23.973 **** 2025-11-26 15:49:25.499793 | controller | ok: [instance] 2025-11-26 15:49:25.499824 | controller | 2025-11-26 15:49:25.499834 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2025-11-26 15:49:25.499962 | controller | Wednesday 26 November 2025 15:49:25 +0000 (0:00:00.314) 0:00:24.288 **** 2025-11-26 15:49:25.820956 | controller | ok: [instance] 2025-11-26 15:49:26.139700 | controller | 2025-11-26 15:49:26.139733 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2025-11-26 15:49:26.139741 | controller | Wednesday 26 November 2025 15:49:25 +0000 (0:00:00.320) 0:00:24.609 **** 2025-11-26 15:49:26.139760 | controller | ok: [instance] 2025-11-26 15:49:26.448715 | controller | 2025-11-26 15:49:26.448742 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2025-11-26 15:49:26.448759 | controller | Wednesday 26 November 2025 15:49:26 +0000 (0:00:00.318) 0:00:24.928 **** 2025-11-26 15:49:26.448782 | controller | ok: [instance] 2025-11-26 15:49:26.448811 | controller | 2025-11-26 15:49:26.448821 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2025-11-26 15:49:26.448847 | controller | Wednesday 26 November 2025 15:49:26 +0000 (0:00:00.309) 0:00:25.237 **** 2025-11-26 15:49:26.764785 | controller | ok: [instance] 2025-11-26 15:49:26.784719 | controller | 2025-11-26 15:49:26.784744 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2025-11-26 15:49:26.784754 | controller | Wednesday 26 November 2025 15:49:26 +0000 (0:00:00.315) 0:00:25.553 **** 2025-11-26 15:49:26.784766 | controller | skipping: [instance] 2025-11-26 15:49:26.784802 | controller | 2025-11-26 15:49:26.784813 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2025-11-26 15:49:26.784921 | controller | Wednesday 26 November 2025 15:49:26 +0000 (0:00:00.019) 0:00:25.573 **** 2025-11-26 15:49:27.060694 | controller | ok: [instance] 2025-11-26 15:49:27.060740 | controller | 2025-11-26 15:49:27.060751 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2025-11-26 15:49:27.060908 | controller | Wednesday 26 November 2025 15:49:27 +0000 (0:00:00.276) 0:00:25.849 **** 2025-11-26 15:49:27.422898 | controller | ok: [instance] 2025-11-26 15:49:27.724439 | controller | 2025-11-26 15:49:27.724471 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2025-11-26 15:49:27.724481 | controller | Wednesday 26 November 2025 15:49:27 +0000 (0:00:00.361) 0:00:26.211 **** 2025-11-26 15:49:27.724492 | controller | changed: [instance] 2025-11-26 15:49:28.009385 | controller | 2025-11-26 15:49:28.009414 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2025-11-26 15:49:28.009421 | controller | Wednesday 26 November 2025 15:49:27 +0000 (0:00:00.301) 0:00:26.512 **** 2025-11-26 15:49:28.009431 | controller | [WARNING]: Reset is not implemented for this connection 2025-11-26 15:49:28.019723 | controller | changed: [instance] 2025-11-26 15:49:28.020453 | controller | 2025-11-26 15:49:28.102713 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2025-11-26 15:49:28.102734 | controller | Wednesday 26 November 2025 15:49:28 +0000 (0:00:00.279) 0:00:26.791 **** 2025-11-26 15:49:28.102743 | controller | 2025-11-26 15:49:28.102749 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2025-11-26 15:49:28.102755 | controller | Wednesday 26 November 2025 15:49:28 +0000 (0:00:00.016) 0:00:26.808 **** 2025-11-26 15:49:28.102765 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2025-11-26 15:49:28.102811 | controller | 2025-11-26 15:49:28.102819 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2025-11-26 15:49:28.102828 | controller | Wednesday 26 November 2025 15:49:28 +0000 (0:00:00.082) 0:00:26.891 **** 2025-11-26 15:49:28.150735 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2025-11-26 15:49:28.203344 | controller | 2025-11-26 15:49:28.203372 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-26 15:49:28.203382 | controller | Wednesday 26 November 2025 15:49:28 +0000 (0:00:00.047) 0:00:26.939 **** 2025-11-26 15:49:28.203393 | controller | ok: [instance] => (item=compute) 2025-11-26 15:49:28.203457 | controller | ok: [instance] => (item=controller) 2025-11-26 15:49:28.203635 | controller | ok: [instance] => (item=crc) 2025-11-26 15:49:28.203724 | controller | 2025-11-26 15:49:28.203915 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-26 15:49:28.203997 | controller | Wednesday 26 November 2025 15:49:28 +0000 (0:00:00.053) 0:00:26.992 **** 2025-11-26 15:49:28.269048 | controller | ok: [instance] 2025-11-26 15:49:28.269151 | controller | 2025-11-26 15:49:28.269270 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-11-26 15:49:28.269387 | controller | Wednesday 26 November 2025 15:49:28 +0000 (0:00:00.064) 0:00:27.056 **** 2025-11-26 15:49:28.325482 | controller | ok: [instance] => changed=false 2025-11-26 15:49:28.325688 | controller | msg: All assertions passed 2025-11-26 15:49:28.325869 | controller | 2025-11-26 15:49:28.325962 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2025-11-26 15:49:28.326074 | controller | Wednesday 26 November 2025 15:49:28 +0000 (0:00:00.057) 0:00:27.114 **** 2025-11-26 15:49:28.379107 | controller | 2025-11-26 15:49:28.379326 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2025-11-26 15:49:28.379526 | controller | Wednesday 26 November 2025 15:49:28 +0000 (0:00:00.053) 0:00:27.167 **** 2025-11-26 15:49:28.493195 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2025-11-26 15:49:28.493292 | controller | ok: [instance] => (item={}) 2025-11-26 15:49:28.493447 | controller | 2025-11-26 15:49:28.493535 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2025-11-26 15:49:28.493716 | controller | Wednesday 26 November 2025 15:49:28 +0000 (0:00:00.114) 0:00:27.281 **** 2025-11-26 15:49:28.512218 | controller | skipping: [instance] 2025-11-26 15:49:28.512353 | controller | 2025-11-26 15:49:28.512489 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2025-11-26 15:49:28.512637 | controller | Wednesday 26 November 2025 15:49:28 +0000 (0:00:00.019) 0:00:27.301 **** 2025-11-26 15:49:28.727585 | controller | ok: [instance] 2025-11-26 15:49:29.071303 | controller | 2025-11-26 15:49:29.071333 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2025-11-26 15:49:29.071341 | controller | Wednesday 26 November 2025 15:49:28 +0000 (0:00:00.214) 0:00:27.515 **** 2025-11-26 15:49:29.071350 | controller | changed: [instance] 2025-11-26 15:49:29.773472 | controller | 2025-11-26 15:49:29.773503 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2025-11-26 15:49:29.773512 | controller | Wednesday 26 November 2025 15:49:29 +0000 (0:00:00.343) 0:00:27.859 **** 2025-11-26 15:49:29.773523 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2025-11-26 15:49:29.798441 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2025-11-26 15:49:29.798469 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2025-11-26 15:49:29.798477 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2025-11-26 15:49:29.798483 | controller | 2025-11-26 15:49:29.798490 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2025-11-26 15:49:29.798496 | controller | Wednesday 26 November 2025 15:49:29 +0000 (0:00:00.702) 0:00:28.561 **** 2025-11-26 15:49:29.798506 | controller | skipping: [instance] 2025-11-26 15:49:30.142748 | controller | 2025-11-26 15:49:30.142797 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2025-11-26 15:49:30.142807 | controller | Wednesday 26 November 2025 15:49:29 +0000 (0:00:00.025) 0:00:28.587 **** 2025-11-26 15:49:30.142818 | controller | changed: [instance] 2025-11-26 15:49:30.143215 | controller | 2025-11-26 15:49:30.143247 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2025-11-26 15:49:30.143262 | controller | Wednesday 26 November 2025 15:49:30 +0000 (0:00:00.335) 0:00:28.923 **** 2025-11-26 15:49:30.552096 | controller | 2025-11-26 15:49:30.552124 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-11-26 15:49:30.552132 | controller | Wednesday 26 November 2025 15:49:30 +0000 (0:00:00.008) 0:00:28.931 **** 2025-11-26 15:49:30.552149 | controller | changed: [instance] 2025-11-26 15:49:30.627266 | controller | 2025-11-26 15:49:30.627292 | controller | TASK [Ensure no default networks exists] *************************************** 2025-11-26 15:49:30.627299 | controller | Wednesday 26 November 2025 15:49:30 +0000 (0:00:00.409) 0:00:29.340 **** 2025-11-26 15:49:30.627308 | controller | 2025-11-26 15:49:31.736407 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2025-11-26 15:49:31.736438 | controller | Wednesday 26 November 2025 15:49:30 +0000 (0:00:00.075) 0:00:29.415 **** 2025-11-26 15:49:31.736451 | controller | ok: [instance] 2025-11-26 15:49:31.953652 | controller | 2025-11-26 15:49:31.953683 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2025-11-26 15:49:31.953691 | controller | Wednesday 26 November 2025 15:49:31 +0000 (0:00:01.108) 0:00:30.524 **** 2025-11-26 15:49:31.953700 | controller | ok: [instance] 2025-11-26 15:49:32.445088 | controller | 2025-11-26 15:49:32.445123 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2025-11-26 15:49:32.445132 | controller | Wednesday 26 November 2025 15:49:31 +0000 (0:00:00.217) 0:00:30.742 **** 2025-11-26 15:49:32.445143 | controller | ok: [instance] 2025-11-26 15:49:32.659700 | controller | 2025-11-26 15:49:32.659743 | controller | TASK [libvirt_manager : Removing default] ************************************** 2025-11-26 15:49:32.659754 | controller | Wednesday 26 November 2025 15:49:32 +0000 (0:00:00.491) 0:00:31.233 **** 2025-11-26 15:49:32.659777 | controller | ok: [instance] 2025-11-26 15:49:32.659801 | controller | 2025-11-26 15:49:32.660032 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2025-11-26 15:49:33.791692 | controller | Wednesday 26 November 2025 15:49:32 +0000 (0:00:00.215) 0:00:31.448 **** 2025-11-26 15:49:33.791728 | controller | ok: [instance] 2025-11-26 15:49:33.791757 | controller | 2025-11-26 15:49:33.791995 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2025-11-26 15:49:34.096684 | controller | Wednesday 26 November 2025 15:49:33 +0000 (0:00:01.131) 0:00:32.580 **** 2025-11-26 15:49:34.096729 | controller | ok: [instance] 2025-11-26 15:49:34.096927 | controller | 2025-11-26 15:49:34.096940 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2025-11-26 15:49:34.388679 | controller | Wednesday 26 November 2025 15:49:34 +0000 (0:00:00.304) 0:00:32.885 **** 2025-11-26 15:49:34.388712 | controller | changed: [instance] 2025-11-26 15:49:34.388821 | controller | 2025-11-26 15:49:34.388839 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2025-11-26 15:49:34.388848 | controller | Wednesday 26 November 2025 15:49:34 +0000 (0:00:00.291) 0:00:33.177 **** 2025-11-26 15:49:34.683555 | controller | changed: [instance] 2025-11-26 15:49:35.221715 | controller | 2025-11-26 15:49:35.221748 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2025-11-26 15:49:35.221757 | controller | Wednesday 26 November 2025 15:49:34 +0000 (0:00:00.294) 0:00:33.471 **** 2025-11-26 15:49:35.221777 | controller | changed: [instance] => (item=arptables) 2025-11-26 15:49:35.221809 | controller | changed: [instance] => (item=iptables) 2025-11-26 15:49:35.221817 | controller | changed: [instance] => (item=ip6tables) 2025-11-26 15:49:35.221823 | controller | 2025-11-26 15:49:35.221831 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2025-11-26 15:49:35.221880 | controller | Wednesday 26 November 2025 15:49:35 +0000 (0:00:00.538) 0:00:34.010 **** 2025-11-26 15:49:35.553093 | controller | ok: [instance] 2025-11-26 15:49:35.640391 | controller | 2025-11-26 15:49:35.640416 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2025-11-26 15:49:35.640423 | controller | Wednesday 26 November 2025 15:49:35 +0000 (0:00:00.331) 0:00:34.341 **** 2025-11-26 15:49:35.640433 | controller | ok: [instance] 2025-11-26 15:49:35.680999 | controller | 2025-11-26 15:49:35.681018 | controller | TASK [Ensure the required network configurations are applied] ****************** 2025-11-26 15:49:35.681025 | controller | Wednesday 26 November 2025 15:49:35 +0000 (0:00:00.087) 0:00:34.429 **** 2025-11-26 15:49:35.681033 | controller | 2025-11-26 15:49:35.702572 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2025-11-26 15:49:35.702622 | controller | Wednesday 26 November 2025 15:49:35 +0000 (0:00:00.040) 0:00:34.469 **** 2025-11-26 15:49:35.702638 | controller | skipping: [instance] 2025-11-26 15:49:35.733756 | controller | 2025-11-26 15:49:35.733800 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2025-11-26 15:49:35.733809 | controller | Wednesday 26 November 2025 15:49:35 +0000 (0:00:00.021) 0:00:34.491 **** 2025-11-26 15:49:35.733821 | controller | skipping: [instance] 2025-11-26 15:49:35.756639 | controller | 2025-11-26 15:49:35.756663 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-11-26 15:49:35.756671 | controller | Wednesday 26 November 2025 15:49:35 +0000 (0:00:00.031) 0:00:34.522 **** 2025-11-26 15:49:35.756682 | controller | skipping: [instance] 2025-11-26 15:49:35.789716 | controller | 2025-11-26 15:49:35.789747 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2025-11-26 15:49:35.789756 | controller | Wednesday 26 November 2025 15:49:35 +0000 (0:00:00.022) 0:00:34.545 **** 2025-11-26 15:49:35.789776 | controller | skipping: [instance] 2025-11-26 15:49:35.789785 | controller | 2025-11-26 15:49:35.790037 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2025-11-26 15:49:35.790124 | controller | Wednesday 26 November 2025 15:49:35 +0000 (0:00:00.033) 0:00:34.578 **** 2025-11-26 15:49:35.838640 | controller | ok: [instance] 2025-11-26 15:49:35.838803 | controller | 2025-11-26 15:49:35.838963 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2025-11-26 15:49:35.839105 | controller | Wednesday 26 November 2025 15:49:35 +0000 (0:00:00.049) 0:00:34.627 **** 2025-11-26 15:49:35.875190 | controller | skipping: [instance] 2025-11-26 15:49:35.875322 | controller | 2025-11-26 15:49:35.875501 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2025-11-26 15:49:35.875618 | controller | Wednesday 26 November 2025 15:49:35 +0000 (0:00:00.036) 0:00:34.663 **** 2025-11-26 15:49:35.900255 | controller | skipping: [instance] 2025-11-26 15:49:35.900401 | controller | 2025-11-26 15:49:35.900521 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2025-11-26 15:49:35.900666 | controller | Wednesday 26 November 2025 15:49:35 +0000 (0:00:00.025) 0:00:34.689 **** 2025-11-26 15:49:35.958636 | controller | ok: [instance] 2025-11-26 15:49:35.958837 | controller | 2025-11-26 15:49:35.958997 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2025-11-26 15:49:35.959120 | controller | Wednesday 26 November 2025 15:49:35 +0000 (0:00:00.058) 0:00:34.747 **** 2025-11-26 15:49:35.981816 | controller | skipping: [instance] 2025-11-26 15:49:35.981989 | controller | 2025-11-26 15:49:35.982154 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2025-11-26 15:49:35.982282 | controller | Wednesday 26 November 2025 15:49:35 +0000 (0:00:00.023) 0:00:34.770 **** 2025-11-26 15:49:36.030980 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2025-11-26 15:49:36.031113 | controller | 2025-11-26 15:49:36.031291 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-11-26 15:49:36.031397 | controller | Wednesday 26 November 2025 15:49:36 +0000 (0:00:00.049) 0:00:34.819 **** 2025-11-26 15:49:36.349095 | controller | ok: [instance -> localhost] 2025-11-26 15:49:41.424511 | controller | 2025-11-26 15:49:41.424545 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2025-11-26 15:49:41.424553 | controller | Wednesday 26 November 2025 15:49:36 +0000 (0:00:00.317) 0:00:35.137 **** 2025-11-26 15:49:41.424564 | controller | changed: [instance -> localhost] 2025-11-26 15:49:41.633043 | controller | 2025-11-26 15:49:41.633073 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-11-26 15:49:41.633082 | controller | Wednesday 26 November 2025 15:49:41 +0000 (0:00:05.073) 0:00:40.211 **** 2025-11-26 15:49:41.633092 | controller | changed: [instance] 2025-11-26 15:49:41.961393 | controller | 2025-11-26 15:49:41.961433 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2025-11-26 15:49:41.961447 | controller | Wednesday 26 November 2025 15:49:41 +0000 (0:00:00.210) 0:00:40.421 **** 2025-11-26 15:49:41.961475 | controller | changed: [instance] 2025-11-26 15:49:43.542717 | controller | 2025-11-26 15:49:43.542763 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2025-11-26 15:49:43.542773 | controller | Wednesday 26 November 2025 15:49:41 +0000 (0:00:00.327) 0:00:40.749 **** 2025-11-26 15:49:43.542786 | controller | changed: [instance -> localhost] 2025-11-26 15:49:43.542819 | controller | 2025-11-26 15:49:43.543105 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2025-11-26 15:49:43.877522 | controller | Wednesday 26 November 2025 15:49:43 +0000 (0:00:01.581) 0:00:42.331 **** 2025-11-26 15:49:43.877554 | controller | changed: [instance] 2025-11-26 15:49:43.906726 | controller | 2025-11-26 15:49:43.906769 | controller | TASK [reproducer : Select right domain] **************************************** 2025-11-26 15:49:43.906778 | controller | Wednesday 26 November 2025 15:49:43 +0000 (0:00:00.334) 0:00:42.666 **** 2025-11-26 15:49:43.906790 | controller | ok: [instance] 2025-11-26 15:49:43.907041 | controller | 2025-11-26 15:49:43.907066 | controller | TASK [Create the virtual networks] ********************************************* 2025-11-26 15:49:44.020790 | controller | Wednesday 26 November 2025 15:49:43 +0000 (0:00:00.029) 0:00:42.695 **** 2025-11-26 15:49:44.020815 | controller | 2025-11-26 15:49:44.039290 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2025-11-26 15:49:44.039308 | controller | Wednesday 26 November 2025 15:49:44 +0000 (0:00:00.114) 0:00:42.809 **** 2025-11-26 15:49:44.039318 | controller | ok: [instance] 2025-11-26 15:49:44.221972 | controller | 2025-11-26 15:49:44.221995 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2025-11-26 15:49:44.222002 | controller | Wednesday 26 November 2025 15:49:44 +0000 (0:00:00.018) 0:00:42.828 **** 2025-11-26 15:49:44.222010 | controller | ok: [instance] 2025-11-26 15:49:44.248621 | controller | 2025-11-26 15:49:44.248646 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2025-11-26 15:49:44.248654 | controller | Wednesday 26 November 2025 15:49:44 +0000 (0:00:00.182) 0:00:43.010 **** 2025-11-26 15:49:44.248665 | controller | skipping: [instance] 2025-11-26 15:49:44.276200 | controller | 2025-11-26 15:49:44.276218 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2025-11-26 15:49:44.276225 | controller | Wednesday 26 November 2025 15:49:44 +0000 (0:00:00.026) 0:00:43.037 **** 2025-11-26 15:49:44.276234 | controller | skipping: [instance] 2025-11-26 15:49:44.326202 | controller | 2025-11-26 15:49:44.326220 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2025-11-26 15:49:44.326227 | controller | Wednesday 26 November 2025 15:49:44 +0000 (0:00:00.027) 0:00:43.064 **** 2025-11-26 15:49:44.326235 | controller | ok: [instance] 2025-11-26 15:49:44.438250 | controller | 2025-11-26 15:49:44.438276 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2025-11-26 15:49:44.438284 | controller | Wednesday 26 November 2025 15:49:44 +0000 (0:00:00.050) 0:00:43.114 **** 2025-11-26 15:49:44.438293 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2025-11-26 15:49:44.470618 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2025-11-26 15:49:44.470641 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2025-11-26 15:49:44.470649 | controller | 2025-11-26 15:49:44.470654 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2025-11-26 15:49:44.470660 | controller | Wednesday 26 November 2025 15:49:44 +0000 (0:00:00.111) 0:00:43.226 **** 2025-11-26 15:49:44.470675 | controller | skipping: [instance] 2025-11-26 15:49:44.799529 | controller | 2025-11-26 15:49:44.799557 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2025-11-26 15:49:44.799565 | controller | Wednesday 26 November 2025 15:49:44 +0000 (0:00:00.032) 0:00:43.259 **** 2025-11-26 15:49:44.799575 | controller | changed: [instance] 2025-11-26 15:49:44.911805 | controller | 2025-11-26 15:49:44.911839 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2025-11-26 15:49:44.911848 | controller | Wednesday 26 November 2025 15:49:44 +0000 (0:00:00.328) 0:00:43.588 **** 2025-11-26 15:49:44.911869 | controller | changed: [instance] => (item=Adding compute-0 to computes) 2025-11-26 15:49:44.912355 | controller | changed: [instance] => (item=Adding controller-0 to controllers) 2025-11-26 15:49:44.912375 | controller | changed: [instance] => (item=Adding crc-0 to ocps) 2025-11-26 15:49:44.933780 | controller | 2025-11-26 15:49:44.933813 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-11-26 15:49:44.933826 | controller | Wednesday 26 November 2025 15:49:44 +0000 (0:00:00.112) 0:00:43.700 **** 2025-11-26 15:49:44.933840 | controller | skipping: [instance] 2025-11-26 15:49:44.955543 | controller | 2025-11-26 15:49:44.955568 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-11-26 15:49:44.955577 | controller | Wednesday 26 November 2025 15:49:44 +0000 (0:00:00.021) 0:00:43.722 **** 2025-11-26 15:49:44.955587 | controller | skipping: [instance] 2025-11-26 15:49:44.978427 | controller | 2025-11-26 15:49:44.978451 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-11-26 15:49:44.978459 | controller | Wednesday 26 November 2025 15:49:44 +0000 (0:00:00.021) 0:00:43.744 **** 2025-11-26 15:49:44.978468 | controller | skipping: [instance] 2025-11-26 15:49:45.001875 | controller | 2025-11-26 15:49:45.001900 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-11-26 15:49:45.001909 | controller | Wednesday 26 November 2025 15:49:44 +0000 (0:00:00.022) 0:00:43.767 **** 2025-11-26 15:49:45.001920 | controller | skipping: [instance] 2025-11-26 15:49:45.019155 | controller | 2025-11-26 15:49:45.019183 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-11-26 15:49:45.019192 | controller | Wednesday 26 November 2025 15:49:44 +0000 (0:00:00.023) 0:00:43.790 **** 2025-11-26 15:49:45.019204 | controller | ok: [instance] 2025-11-26 15:49:45.019297 | controller | 2025-11-26 15:49:45.019482 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-11-26 15:49:45.019593 | controller | Wednesday 26 November 2025 15:49:45 +0000 (0:00:00.017) 0:00:43.808 **** 2025-11-26 15:49:45.093671 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-11-26 15:49:45.093799 | controller | 2025-11-26 15:49:45.093958 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-11-26 15:49:45.094112 | controller | Wednesday 26 November 2025 15:49:45 +0000 (0:00:00.074) 0:00:43.882 **** 2025-11-26 15:49:45.111332 | controller | skipping: [instance] 2025-11-26 15:49:45.111489 | controller | 2025-11-26 15:49:45.111628 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-11-26 15:49:45.111783 | controller | Wednesday 26 November 2025 15:49:45 +0000 (0:00:00.017) 0:00:43.900 **** 2025-11-26 15:49:45.307714 | controller | changed: [instance] 2025-11-26 15:49:45.307868 | controller | 2025-11-26 15:49:45.307895 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-11-26 15:49:45.307907 | controller | Wednesday 26 November 2025 15:49:45 +0000 (0:00:00.196) 0:00:44.096 **** 2025-11-26 15:49:45.697862 | controller | changed: [instance] 2025-11-26 15:49:45.755346 | controller | 2025-11-26 15:49:45.755371 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-11-26 15:49:45.755379 | controller | Wednesday 26 November 2025 15:49:45 +0000 (0:00:00.389) 0:00:44.486 **** 2025-11-26 15:49:45.755388 | controller | ok: [instance] 2025-11-26 15:49:45.784462 | controller | 2025-11-26 15:49:45.784482 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-11-26 15:49:45.784490 | controller | Wednesday 26 November 2025 15:49:45 +0000 (0:00:00.057) 0:00:44.544 **** 2025-11-26 15:49:45.784500 | controller | ok: [instance] 2025-11-26 15:49:46.148544 | controller | 2025-11-26 15:49:46.148573 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-11-26 15:49:46.148581 | controller | Wednesday 26 November 2025 15:49:45 +0000 (0:00:00.029) 0:00:44.573 **** 2025-11-26 15:49:46.148592 | controller | changed: [instance] 2025-11-26 15:49:46.223860 | controller | 2025-11-26 15:49:46.223897 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2025-11-26 15:49:46.223908 | controller | Wednesday 26 November 2025 15:49:46 +0000 (0:00:00.363) 0:00:44.936 **** 2025-11-26 15:49:46.223922 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2025-11-26 15:49:46.272813 | controller | 2025-11-26 15:49:46.272836 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2025-11-26 15:49:46.272851 | controller | Wednesday 26 November 2025 15:49:46 +0000 (0:00:00.075) 0:00:45.012 **** 2025-11-26 15:49:46.272861 | controller | ok: [instance] => (item=public) 2025-11-26 15:49:46.272928 | controller | ok: [instance] => (item=osp_trunk) 2025-11-26 15:49:46.272946 | controller | 2025-11-26 15:49:46.272953 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2025-11-26 15:49:46.272962 | controller | Wednesday 26 November 2025 15:49:46 +0000 (0:00:00.048) 0:00:45.061 **** 2025-11-26 15:49:46.699245 | controller | changed: [instance] => (item=cifmw-public) 2025-11-26 15:49:47.267712 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-11-26 15:49:47.267759 | controller | 2025-11-26 15:49:47.267770 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2025-11-26 15:49:47.267778 | controller | Wednesday 26 November 2025 15:49:46 +0000 (0:00:00.426) 0:00:45.487 **** 2025-11-26 15:49:47.267791 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 15:49:47.267822 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 15:49:47.267831 | controller | 2025-11-26 15:49:47.267840 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2025-11-26 15:49:47.267869 | controller | Wednesday 26 November 2025 15:49:47 +0000 (0:00:00.568) 0:00:46.056 **** 2025-11-26 15:49:47.676669 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 15:49:48.085534 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 15:49:48.085558 | controller | 2025-11-26 15:49:48.085565 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2025-11-26 15:49:48.085571 | controller | Wednesday 26 November 2025 15:49:47 +0000 (0:00:00.408) 0:00:46.465 **** 2025-11-26 15:49:48.085584 | controller | changed: [instance] => (item=cifmw-public) 2025-11-26 15:49:48.141578 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-11-26 15:49:48.141595 | controller | 2025-11-26 15:49:48.141618 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2025-11-26 15:49:48.141627 | controller | Wednesday 26 November 2025 15:49:48 +0000 (0:00:00.409) 0:00:46.874 **** 2025-11-26 15:49:48.141635 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2025-11-26 15:49:48.318657 | controller | 2025-11-26 15:49:48.318683 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2025-11-26 15:49:48.318691 | controller | Wednesday 26 November 2025 15:49:48 +0000 (0:00:00.055) 0:00:46.930 **** 2025-11-26 15:49:48.318700 | controller | ok: [instance] 2025-11-26 15:49:48.684143 | controller | 2025-11-26 15:49:48.684165 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2025-11-26 15:49:48.684172 | controller | Wednesday 26 November 2025 15:49:48 +0000 (0:00:00.176) 0:00:47.106 **** 2025-11-26 15:49:48.684181 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 15:49:48.752201 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 15:49:48.752234 | controller | 2025-11-26 15:49:48.752248 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2025-11-26 15:49:48.752258 | controller | Wednesday 26 November 2025 15:49:48 +0000 (0:00:00.365) 0:00:47.472 **** 2025-11-26 15:49:48.752273 | controller | 2025-11-26 15:49:48.788716 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-11-26 15:49:48.788761 | controller | Wednesday 26 November 2025 15:49:48 +0000 (0:00:00.067) 0:00:47.540 **** 2025-11-26 15:49:48.788776 | controller | skipping: [instance] 2025-11-26 15:49:49.960536 | controller | 2025-11-26 15:49:49.960568 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2025-11-26 15:49:49.960576 | controller | Wednesday 26 November 2025 15:49:48 +0000 (0:00:00.036) 0:00:47.577 **** 2025-11-26 15:49:49.960586 | controller | ok: [instance] 2025-11-26 15:49:50.155345 | controller | 2025-11-26 15:49:50.155364 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-11-26 15:49:50.155371 | controller | Wednesday 26 November 2025 15:49:49 +0000 (0:00:01.171) 0:00:48.749 **** 2025-11-26 15:49:50.155379 | controller | ok: [instance] 2025-11-26 15:49:50.507415 | controller | 2025-11-26 15:49:50.507435 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2025-11-26 15:49:50.507442 | controller | Wednesday 26 November 2025 15:49:50 +0000 (0:00:00.194) 0:00:48.944 **** 2025-11-26 15:49:50.507451 | controller | changed: [instance] 2025-11-26 15:49:52.161685 | controller | 2025-11-26 15:49:52.161715 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2025-11-26 15:49:52.161724 | controller | Wednesday 26 November 2025 15:49:50 +0000 (0:00:00.352) 0:00:49.296 **** 2025-11-26 15:49:52.161745 | controller | changed: [instance] 2025-11-26 15:49:52.161770 | controller | 2025-11-26 15:49:52.161777 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2025-11-26 15:49:52.161910 | controller | Wednesday 26 November 2025 15:49:52 +0000 (0:00:01.654) 0:00:50.950 **** 2025-11-26 15:49:52.514647 | controller | changed: [instance] 2025-11-26 15:49:52.546641 | controller | 2025-11-26 15:49:52.546660 | controller | TASK [Create extra network configuration] ************************************** 2025-11-26 15:49:52.546668 | controller | Wednesday 26 November 2025 15:49:52 +0000 (0:00:00.352) 0:00:51.302 **** 2025-11-26 15:49:52.546684 | controller | skipping: [instance] 2025-11-26 15:49:52.575651 | controller | 2025-11-26 15:49:52.575676 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2025-11-26 15:49:52.575684 | controller | Wednesday 26 November 2025 15:49:52 +0000 (0:00:00.032) 0:00:51.334 **** 2025-11-26 15:49:52.575692 | controller | skipping: [instance] 2025-11-26 15:49:52.998757 | controller | 2025-11-26 15:49:52.998793 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2025-11-26 15:49:52.998809 | controller | Wednesday 26 November 2025 15:49:52 +0000 (0:00:00.028) 0:00:51.363 **** 2025-11-26 15:49:52.998821 | controller | ok: [instance] 2025-11-26 15:49:52.998851 | controller | 2025-11-26 15:49:52.998861 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2025-11-26 15:49:52.998983 | controller | Wednesday 26 November 2025 15:49:52 +0000 (0:00:00.423) 0:00:51.787 **** 2025-11-26 15:49:53.146820 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 15:49:54.333400 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 15:49:54.333431 | controller | 2025-11-26 15:49:54.333440 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2025-11-26 15:49:54.333447 | controller | Wednesday 26 November 2025 15:49:53 +0000 (0:00:00.147) 0:00:51.934 **** 2025-11-26 15:49:54.333458 | controller | ok: [instance] 2025-11-26 15:49:57.914507 | controller | 2025-11-26 15:49:57.914541 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2025-11-26 15:49:57.914550 | controller | Wednesday 26 November 2025 15:49:54 +0000 (0:00:01.187) 0:00:53.121 **** 2025-11-26 15:49:57.914560 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2025-11-26 15:49:58.118987 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2025-11-26 15:49:58.119009 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2025-11-26 15:49:58.119016 | controller | 2025-11-26 15:49:58.119022 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2025-11-26 15:49:58.119028 | controller | Wednesday 26 November 2025 15:49:57 +0000 (0:00:03.580) 0:00:56.702 **** 2025-11-26 15:49:58.119036 | controller | changed: [instance] 2025-11-26 15:49:58.471748 | controller | 2025-11-26 15:49:58.471792 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2025-11-26 15:49:58.471802 | controller | Wednesday 26 November 2025 15:49:58 +0000 (0:00:00.204) 0:00:56.907 **** 2025-11-26 15:49:58.471816 | controller | changed: [instance] 2025-11-26 15:49:58.471849 | controller | 2025-11-26 15:49:58.472001 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2025-11-26 15:49:58.472032 | controller | Wednesday 26 November 2025 15:49:58 +0000 (0:00:00.352) 0:00:57.260 **** 2025-11-26 15:49:58.849714 | controller | changed: [instance] 2025-11-26 15:49:58.880154 | controller | 2025-11-26 15:49:58.880188 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2025-11-26 15:49:58.880199 | controller | Wednesday 26 November 2025 15:49:58 +0000 (0:00:00.377) 0:00:57.638 **** 2025-11-26 15:49:58.880210 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2025-11-26 15:49:59.250406 | controller | 2025-11-26 15:49:59.250427 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2025-11-26 15:49:59.250434 | controller | Wednesday 26 November 2025 15:49:58 +0000 (0:00:00.030) 0:00:57.668 **** 2025-11-26 15:49:59.250443 | controller | changed: [instance] 2025-11-26 15:49:59.268733 | controller | 2025-11-26 15:49:59.268777 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2025-11-26 15:49:59.268790 | controller | Wednesday 26 November 2025 15:49:59 +0000 (0:00:00.369) 0:00:58.038 **** 2025-11-26 15:49:59.268805 | controller | skipping: [instance] 2025-11-26 15:49:59.269151 | controller | 2025-11-26 15:49:59.269189 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2025-11-26 15:49:59.299547 | controller | Wednesday 26 November 2025 15:49:59 +0000 (0:00:00.018) 0:00:58.057 **** 2025-11-26 15:49:59.299567 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2025-11-26 15:49:59.660042 | controller | 2025-11-26 15:49:59.660061 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2025-11-26 15:49:59.660069 | controller | Wednesday 26 November 2025 15:49:59 +0000 (0:00:00.031) 0:00:58.088 **** 2025-11-26 15:49:59.660078 | controller | changed: [instance] 2025-11-26 15:49:59.680325 | controller | 2025-11-26 15:49:59.680346 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2025-11-26 15:49:59.680353 | controller | Wednesday 26 November 2025 15:49:59 +0000 (0:00:00.360) 0:00:58.448 **** 2025-11-26 15:49:59.680362 | controller | skipping: [instance] 2025-11-26 15:49:59.885710 | controller | 2025-11-26 15:49:59.885764 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2025-11-26 15:49:59.885775 | controller | Wednesday 26 November 2025 15:49:59 +0000 (0:00:00.020) 0:00:58.468 **** 2025-11-26 15:49:59.885788 | controller | ok: [instance] => (item=127.0.0.2) 2025-11-26 15:49:59.885819 | controller | 2025-11-26 15:49:59.885829 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2025-11-26 15:49:59.886003 | controller | Wednesday 26 November 2025 15:49:59 +0000 (0:00:00.205) 0:00:58.674 **** 2025-11-26 15:50:00.545130 | controller | changed: [instance] 2025-11-26 15:50:00.564055 | controller | 2025-11-26 15:50:00.564072 | controller | TASK [dnsmasq : Stop service] ************************************************** 2025-11-26 15:50:00.564080 | controller | Wednesday 26 November 2025 15:50:00 +0000 (0:00:00.659) 0:00:59.333 **** 2025-11-26 15:50:00.564089 | controller | skipping: [instance] 2025-11-26 15:50:00.582765 | controller | 2025-11-26 15:50:00.582803 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2025-11-26 15:50:00.582813 | controller | Wednesday 26 November 2025 15:50:00 +0000 (0:00:00.018) 0:00:59.352 **** 2025-11-26 15:50:00.582825 | controller | skipping: [instance] 2025-11-26 15:50:00.582911 | controller | 2025-11-26 15:50:00.582930 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2025-11-26 15:50:00.582940 | controller | Wednesday 26 November 2025 15:50:00 +0000 (0:00:00.018) 0:00:59.371 **** 2025-11-26 15:50:00.610731 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-11-26 15:50:00.610799 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2025-11-26 15:50:00.610821 | controller | skipping: [instance] 2025-11-26 15:50:00.610829 | controller | 2025-11-26 15:50:00.610836 | controller | TASK [Create dnsmasq networks] ************************************************* 2025-11-26 15:50:00.610847 | controller | Wednesday 26 November 2025 15:50:00 +0000 (0:00:00.028) 0:00:59.399 **** 2025-11-26 15:50:00.722781 | controller | 2025-11-26 15:50:00.752025 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-11-26 15:50:00.752058 | controller | Wednesday 26 November 2025 15:50:00 +0000 (0:00:00.111) 0:00:59.511 **** 2025-11-26 15:50:00.752076 | controller | ok: [instance] => changed=false 2025-11-26 15:50:00.752276 | controller | msg: All assertions passed 2025-11-26 15:50:00.752398 | controller | 2025-11-26 15:50:00.752522 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-11-26 15:50:00.752677 | controller | Wednesday 26 November 2025 15:50:00 +0000 (0:00:00.029) 0:00:59.540 **** 2025-11-26 15:50:00.788056 | controller | ok: [instance] => changed=false 2025-11-26 15:50:00.788316 | controller | msg: All assertions passed 2025-11-26 15:50:00.788438 | controller | 2025-11-26 15:50:00.788570 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-11-26 15:50:00.788739 | controller | Wednesday 26 November 2025 15:50:00 +0000 (0:00:00.036) 0:00:59.576 **** 2025-11-26 15:50:01.211771 | controller | changed: [instance] 2025-11-26 15:50:01.212120 | controller | 2025-11-26 15:50:01.212143 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-11-26 15:50:01.229213 | controller | Wednesday 26 November 2025 15:50:01 +0000 (0:00:00.423) 0:01:00.000 **** 2025-11-26 15:50:01.229233 | controller | skipping: [instance] 2025-11-26 15:50:01.252572 | controller | 2025-11-26 15:50:01.252594 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-11-26 15:50:01.252623 | controller | Wednesday 26 November 2025 15:50:01 +0000 (0:00:00.017) 0:01:00.017 **** 2025-11-26 15:50:01.252638 | controller | skipping: [instance] 2025-11-26 15:50:01.279792 | controller | 2025-11-26 15:50:01.279825 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-11-26 15:50:01.279835 | controller | Wednesday 26 November 2025 15:50:01 +0000 (0:00:00.023) 0:01:00.041 **** 2025-11-26 15:50:01.279852 | controller | ok: [instance] => changed=false 2025-11-26 15:50:01.316533 | controller | msg: All assertions passed 2025-11-26 15:50:01.316554 | controller | 2025-11-26 15:50:01.316562 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-11-26 15:50:01.316568 | controller | Wednesday 26 November 2025 15:50:01 +0000 (0:00:00.027) 0:01:00.068 **** 2025-11-26 15:50:01.316576 | controller | ok: [instance] => changed=false 2025-11-26 15:50:01.736564 | controller | msg: All assertions passed 2025-11-26 15:50:01.736583 | controller | 2025-11-26 15:50:01.736590 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-11-26 15:50:01.736596 | controller | Wednesday 26 November 2025 15:50:01 +0000 (0:00:00.036) 0:01:00.104 **** 2025-11-26 15:50:01.736627 | controller | changed: [instance] 2025-11-26 15:50:01.757760 | controller | 2025-11-26 15:50:01.757799 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-11-26 15:50:01.757810 | controller | Wednesday 26 November 2025 15:50:01 +0000 (0:00:00.420) 0:01:00.525 **** 2025-11-26 15:50:01.757823 | controller | skipping: [instance] 2025-11-26 15:50:01.757885 | controller | 2025-11-26 15:50:01.757905 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-11-26 15:50:01.757918 | controller | Wednesday 26 November 2025 15:50:01 +0000 (0:00:00.021) 0:01:00.546 **** 2025-11-26 15:50:01.781511 | controller | skipping: [instance] 2025-11-26 15:50:01.811367 | controller | 2025-11-26 15:50:01.811383 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2025-11-26 15:50:01.811390 | controller | Wednesday 26 November 2025 15:50:01 +0000 (0:00:00.023) 0:01:00.570 **** 2025-11-26 15:50:01.811402 | controller | skipping: [instance] 2025-11-26 15:50:02.286368 | controller | 2025-11-26 15:50:02.286393 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2025-11-26 15:50:02.286401 | controller | Wednesday 26 November 2025 15:50:01 +0000 (0:00:00.029) 0:01:00.599 **** 2025-11-26 15:50:02.286410 | controller | changed: [instance] => (item=cifmw-public) 2025-11-26 15:50:02.326466 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-11-26 15:50:02.326490 | controller | 2025-11-26 15:50:02.326498 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-11-26 15:50:02.326504 | controller | Wednesday 26 November 2025 15:50:02 +0000 (0:00:00.474) 0:01:01.074 **** 2025-11-26 15:50:02.326513 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2025-11-26 15:50:02.646381 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2025-11-26 15:50:02.646404 | controller | 2025-11-26 15:50:02.646412 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-11-26 15:50:02.646418 | controller | Wednesday 26 November 2025 15:50:02 +0000 (0:00:00.039) 0:01:01.114 **** 2025-11-26 15:50:02.646427 | controller | ok: [instance] 2025-11-26 15:50:02.683126 | controller | 2025-11-26 15:50:02.683147 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-11-26 15:50:02.683155 | controller | Wednesday 26 November 2025 15:50:02 +0000 (0:00:00.320) 0:01:01.435 **** 2025-11-26 15:50:02.683164 | controller | ok: [instance] 2025-11-26 15:50:02.888096 | controller | 2025-11-26 15:50:02.888124 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-11-26 15:50:02.888132 | controller | Wednesday 26 November 2025 15:50:02 +0000 (0:00:00.036) 0:01:01.471 **** 2025-11-26 15:50:02.888142 | controller | ok: [instance] 2025-11-26 15:50:02.921790 | controller | 2025-11-26 15:50:02.921825 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-11-26 15:50:02.921835 | controller | Wednesday 26 November 2025 15:50:02 +0000 (0:00:00.204) 0:01:01.676 **** 2025-11-26 15:50:02.921847 | controller | ok: [instance] 2025-11-26 15:50:03.257972 | controller | 2025-11-26 15:50:03.258001 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2025-11-26 15:50:03.258009 | controller | Wednesday 26 November 2025 15:50:02 +0000 (0:00:00.033) 0:01:01.710 **** 2025-11-26 15:50:03.258024 | controller | changed: [instance] 2025-11-26 15:50:03.587701 | controller | 2025-11-26 15:50:03.587738 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2025-11-26 15:50:03.587746 | controller | Wednesday 26 November 2025 15:50:03 +0000 (0:00:00.336) 0:01:02.046 **** 2025-11-26 15:50:03.587755 | controller | changed: [instance] 2025-11-26 15:50:03.587778 | controller | 2025-11-26 15:50:03.587785 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2025-11-26 15:50:03.587920 | controller | Wednesday 26 November 2025 15:50:03 +0000 (0:00:00.329) 0:01:02.376 **** 2025-11-26 15:50:03.911055 | controller | changed: [instance] 2025-11-26 15:50:04.027812 | controller | 2025-11-26 15:50:04.027843 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2025-11-26 15:50:04.027856 | controller | Wednesday 26 November 2025 15:50:03 +0000 (0:00:00.323) 0:01:02.699 **** 2025-11-26 15:50:04.027871 | controller | ok: [instance] 2025-11-26 15:50:04.357771 | controller | 2025-11-26 15:50:04.357809 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2025-11-26 15:50:04.357820 | controller | Wednesday 26 November 2025 15:50:04 +0000 (0:00:00.116) 0:01:02.816 **** 2025-11-26 15:50:04.357833 | controller | changed: [instance] 2025-11-26 15:50:04.383293 | controller | 2025-11-26 15:50:04.383318 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-11-26 15:50:04.383326 | controller | Wednesday 26 November 2025 15:50:04 +0000 (0:00:00.329) 0:01:03.146 **** 2025-11-26 15:50:04.383337 | controller | skipping: [instance] 2025-11-26 15:50:04.406120 | controller | 2025-11-26 15:50:04.406137 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-11-26 15:50:04.406144 | controller | Wednesday 26 November 2025 15:50:04 +0000 (0:00:00.025) 0:01:03.171 **** 2025-11-26 15:50:04.406152 | controller | skipping: [instance] 2025-11-26 15:50:04.429252 | controller | 2025-11-26 15:50:04.429270 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-11-26 15:50:04.429277 | controller | Wednesday 26 November 2025 15:50:04 +0000 (0:00:00.022) 0:01:03.194 **** 2025-11-26 15:50:04.429285 | controller | skipping: [instance] 2025-11-26 15:50:04.453891 | controller | 2025-11-26 15:50:04.453914 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-11-26 15:50:04.453923 | controller | Wednesday 26 November 2025 15:50:04 +0000 (0:00:00.022) 0:01:03.217 **** 2025-11-26 15:50:04.453934 | controller | skipping: [instance] 2025-11-26 15:50:04.473486 | controller | 2025-11-26 15:50:04.473510 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-11-26 15:50:04.473526 | controller | Wednesday 26 November 2025 15:50:04 +0000 (0:00:00.024) 0:01:03.242 **** 2025-11-26 15:50:04.473537 | controller | ok: [instance] 2025-11-26 15:50:04.583856 | controller | 2025-11-26 15:50:04.583890 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-11-26 15:50:04.583904 | controller | Wednesday 26 November 2025 15:50:04 +0000 (0:00:00.020) 0:01:03.262 **** 2025-11-26 15:50:04.583923 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-11-26 15:50:04.584233 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-11-26 15:50:04.584465 | controller | 2025-11-26 15:50:04.584815 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-11-26 15:50:04.584960 | controller | Wednesday 26 November 2025 15:50:04 +0000 (0:00:00.110) 0:01:03.372 **** 2025-11-26 15:50:04.628851 | controller | skipping: [instance] 2025-11-26 15:50:04.629035 | controller | 2025-11-26 15:50:04.629209 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-11-26 15:50:04.629374 | controller | Wednesday 26 November 2025 15:50:04 +0000 (0:00:00.045) 0:01:03.417 **** 2025-11-26 15:50:04.831326 | controller | ok: [instance] 2025-11-26 15:50:05.231776 | controller | 2025-11-26 15:50:05.231812 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-11-26 15:50:05.231822 | controller | Wednesday 26 November 2025 15:50:04 +0000 (0:00:00.201) 0:01:03.619 **** 2025-11-26 15:50:05.231834 | controller | changed: [instance] 2025-11-26 15:50:05.231866 | controller | 2025-11-26 15:50:05.231876 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-11-26 15:50:05.231963 | controller | Wednesday 26 November 2025 15:50:05 +0000 (0:00:00.400) 0:01:04.020 **** 2025-11-26 15:50:05.294825 | controller | ok: [instance] 2025-11-26 15:50:05.294872 | controller | 2025-11-26 15:50:05.294885 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-11-26 15:50:05.294899 | controller | Wednesday 26 November 2025 15:50:05 +0000 (0:00:00.063) 0:01:04.083 **** 2025-11-26 15:50:05.330124 | controller | ok: [instance] 2025-11-26 15:50:05.740396 | controller | 2025-11-26 15:50:05.740425 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-11-26 15:50:05.740433 | controller | Wednesday 26 November 2025 15:50:05 +0000 (0:00:00.035) 0:01:04.118 **** 2025-11-26 15:50:05.740443 | controller | changed: [instance] 2025-11-26 15:50:05.770689 | controller | 2025-11-26 15:50:05.770723 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2025-11-26 15:50:05.770732 | controller | Wednesday 26 November 2025 15:50:05 +0000 (0:00:00.410) 0:01:04.528 **** 2025-11-26 15:50:05.770743 | controller | ok: [instance] 2025-11-26 15:50:05.770818 | controller | 2025-11-26 15:50:05.770834 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2025-11-26 15:50:05.770845 | controller | Wednesday 26 November 2025 15:50:05 +0000 (0:00:00.030) 0:01:04.559 **** 2025-11-26 15:50:05.790090 | controller | ok: [instance] 2025-11-26 15:50:05.809046 | controller | 2025-11-26 15:50:05.809070 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2025-11-26 15:50:05.809079 | controller | Wednesday 26 November 2025 15:50:05 +0000 (0:00:00.019) 0:01:04.578 **** 2025-11-26 15:50:05.809090 | controller | ok: [instance] 2025-11-26 15:50:05.885746 | controller | 2025-11-26 15:50:05.885788 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2025-11-26 15:50:05.885799 | controller | Wednesday 26 November 2025 15:50:05 +0000 (0:00:00.019) 0:01:04.597 **** 2025-11-26 15:50:05.885813 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2025-11-26 15:50:05.885855 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2025-11-26 15:50:05.885865 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2025-11-26 15:50:05.885875 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2025-11-26 15:50:05.885904 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2025-11-26 15:50:05.886386 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2025-11-26 15:50:06.029062 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2025-11-26 15:50:06.029091 | controller | 2025-11-26 15:50:06.029099 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-26 15:50:06.029105 | controller | Wednesday 26 November 2025 15:50:05 +0000 (0:00:00.076) 0:01:04.674 **** 2025-11-26 15:50:06.029114 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2025-11-26 15:50:06.029274 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2025-11-26 15:50:06.029413 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2025-11-26 15:50:06.029540 | controller | 2025-11-26 15:50:06.029712 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-26 15:50:06.029857 | controller | Wednesday 26 November 2025 15:50:06 +0000 (0:00:00.143) 0:01:04.817 **** 2025-11-26 15:50:06.115245 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2025-11-26 15:50:06.115439 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2025-11-26 15:50:06.115638 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2025-11-26 15:50:06.115842 | controller | skipping: [instance] 2025-11-26 15:50:06.116001 | controller | 2025-11-26 15:50:06.116160 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-26 15:50:06.116297 | controller | Wednesday 26 November 2025 15:50:06 +0000 (0:00:00.086) 0:01:04.904 **** 2025-11-26 15:50:06.198768 | controller | skipping: [instance] => (item=compute-0 - storage) 2025-11-26 15:50:06.198962 | controller | skipping: [instance] => (item=controller-0 - storage) 2025-11-26 15:50:06.199129 | controller | skipping: [instance] => (item=crc-0 - storage) 2025-11-26 15:50:06.199306 | controller | skipping: [instance] 2025-11-26 15:50:06.199451 | controller | 2025-11-26 15:50:06.199583 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-26 15:50:06.199758 | controller | Wednesday 26 November 2025 15:50:06 +0000 (0:00:00.083) 0:01:04.987 **** 2025-11-26 15:50:06.278903 | controller | skipping: [instance] => (item=compute-0 - tenant) 2025-11-26 15:50:06.279170 | controller | skipping: [instance] => (item=controller-0 - tenant) 2025-11-26 15:50:06.279398 | controller | skipping: [instance] => (item=crc-0 - tenant) 2025-11-26 15:50:06.279648 | controller | skipping: [instance] 2025-11-26 15:50:06.279834 | controller | 2025-11-26 15:50:06.279970 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-26 15:50:06.280102 | controller | Wednesday 26 November 2025 15:50:06 +0000 (0:00:00.080) 0:01:05.067 **** 2025-11-26 15:50:06.360164 | controller | skipping: [instance] => (item=compute-0 - external) 2025-11-26 15:50:06.360368 | controller | skipping: [instance] => (item=controller-0 - external) 2025-11-26 15:50:06.360545 | controller | skipping: [instance] => (item=crc-0 - external) 2025-11-26 15:50:06.360751 | controller | skipping: [instance] 2025-11-26 15:50:06.360886 | controller | 2025-11-26 15:50:06.361019 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-26 15:50:06.361150 | controller | Wednesday 26 November 2025 15:50:06 +0000 (0:00:00.081) 0:01:05.149 **** 2025-11-26 15:50:06.441430 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2025-11-26 15:50:06.441650 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2025-11-26 15:50:06.441852 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2025-11-26 15:50:06.441997 | controller | skipping: [instance] 2025-11-26 15:50:06.442124 | controller | 2025-11-26 15:50:06.442262 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-26 15:50:06.442392 | controller | Wednesday 26 November 2025 15:50:06 +0000 (0:00:00.081) 0:01:05.230 **** 2025-11-26 15:50:06.575655 | controller | ok: [instance] => (item=compute-0 - public) 2025-11-26 15:50:06.575952 | controller | ok: [instance] => (item=controller-0 - public) 2025-11-26 15:50:06.576054 | controller | ok: [instance] => (item=crc-0 - public) 2025-11-26 15:50:06.576197 | controller | 2025-11-26 15:50:06.576288 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2025-11-26 15:50:06.576398 | controller | Wednesday 26 November 2025 15:50:06 +0000 (0:00:00.134) 0:01:05.364 **** 2025-11-26 15:50:06.687195 | controller | 2025-11-26 15:50:06.687445 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2025-11-26 15:50:06.687536 | controller | Wednesday 26 November 2025 15:50:06 +0000 (0:00:00.111) 0:01:05.476 **** 2025-11-26 15:50:06.726130 | controller | ok: [instance] 2025-11-26 15:50:06.726374 | controller | 2025-11-26 15:50:06.726501 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2025-11-26 15:50:06.726682 | controller | Wednesday 26 November 2025 15:50:06 +0000 (0:00:00.038) 0:01:05.514 **** 2025-11-26 15:50:06.819715 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:5a:eb:72', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-11-26 15:50:06.819867 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:71:79:59', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-11-26 15:50:06.819960 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:34:a7:66', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-11-26 15:50:06.820107 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:51:30:8f', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-11-26 15:50:06.820184 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:de:6b:1d', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-11-26 15:50:06.820361 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:8f:ee:4f', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-11-26 15:50:06.820431 | controller | 2025-11-26 15:50:06.820534 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2025-11-26 15:50:06.820669 | controller | Wednesday 26 November 2025 15:50:06 +0000 (0:00:00.093) 0:01:05.608 **** 2025-11-26 15:50:06.871977 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2025-11-26 15:50:06.872157 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2025-11-26 15:50:06.872264 | controller | 2025-11-26 15:50:06.872450 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-11-26 15:50:06.872560 | controller | Wednesday 26 November 2025 15:50:06 +0000 (0:00:00.052) 0:01:05.660 **** 2025-11-26 15:50:07.043806 | controller | ok: [instance] 2025-11-26 15:50:07.043867 | controller | 2025-11-26 15:50:07.043877 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-11-26 15:50:07.043892 | controller | Wednesday 26 November 2025 15:50:07 +0000 (0:00:00.171) 0:01:05.832 **** 2025-11-26 15:50:07.067631 | controller | ok: [instance] 2025-11-26 15:50:07.240688 | controller | 2025-11-26 15:50:07.240731 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-11-26 15:50:07.240739 | controller | Wednesday 26 November 2025 15:50:07 +0000 (0:00:00.023) 0:01:05.856 **** 2025-11-26 15:50:07.240749 | controller | ok: [instance] 2025-11-26 15:50:07.240772 | controller | 2025-11-26 15:50:07.240779 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-11-26 15:50:07.240874 | controller | Wednesday 26 November 2025 15:50:07 +0000 (0:00:00.173) 0:01:06.029 **** 2025-11-26 15:50:07.264333 | controller | ok: [instance] 2025-11-26 15:50:07.284262 | controller | 2025-11-26 15:50:07.284285 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2025-11-26 15:50:07.284294 | controller | Wednesday 26 November 2025 15:50:07 +0000 (0:00:00.023) 0:01:06.052 **** 2025-11-26 15:50:07.284305 | controller | ok: [instance] 2025-11-26 15:50:07.452409 | controller | 2025-11-26 15:50:07.452427 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2025-11-26 15:50:07.452434 | controller | Wednesday 26 November 2025 15:50:07 +0000 (0:00:00.019) 0:01:06.072 **** 2025-11-26 15:50:07.452443 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:5a:eb:72', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-11-26 15:50:07.488242 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:71:79:59', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-11-26 15:50:07.488269 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:34:a7:66', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-11-26 15:50:07.488279 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:51:30:8f', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-11-26 15:50:07.488286 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:de:6b:1d', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-11-26 15:50:07.488293 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:8f:ee:4f', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-11-26 15:50:07.488299 | controller | 2025-11-26 15:50:07.488306 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2025-11-26 15:50:07.488313 | controller | Wednesday 26 November 2025 15:50:07 +0000 (0:00:00.167) 0:01:06.240 **** 2025-11-26 15:50:07.488324 | controller | ok: [instance] 2025-11-26 15:50:09.473692 | controller | 2025-11-26 15:50:09.473727 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2025-11-26 15:50:09.473735 | controller | Wednesday 26 November 2025 15:50:07 +0000 (0:00:00.036) 0:01:06.276 **** 2025-11-26 15:50:09.473744 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:5a:eb:72', 'entry': 'set:compute,52:54:00:5a:eb:72,192.168.140.100,compute-0', 'state': 'present'}) 2025-11-26 15:50:09.474281 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:71:79:59', 'entry': 'set:controller,52:54:01:71:79:59,192.168.140.9,controller-0', 'state': 'present'}) 2025-11-26 15:50:09.474298 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:34:a7:66', 'entry': 'set:ocp,52:54:02:34:a7:66,192.168.140.10,crc-0', 'state': 'present'}) 2025-11-26 15:50:09.474309 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:51:30:8f', 'entry': 'set:compute,52:54:00:51:30:8f,192.168.101.100,compute-0', 'state': 'present'}) 2025-11-26 15:50:09.495519 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:de:6b:1d', 'entry': 'set:controller,52:54:01:de:6b:1d,192.168.101.9,controller-0', 'state': 'present'}) 2025-11-26 15:50:09.495542 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:8f:ee:4f', 'entry': 'set:ocp,52:54:02:8f:ee:4f,192.168.101.10,crc-0', 'state': 'present'}) 2025-11-26 15:50:09.495557 | controller | 2025-11-26 15:50:09.495565 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2025-11-26 15:50:09.495578 | controller | Wednesday 26 November 2025 15:50:09 +0000 (0:00:01.985) 0:01:08.262 **** 2025-11-26 15:50:09.495590 | controller | skipping: [instance] 2025-11-26 15:50:09.731344 | controller | 2025-11-26 15:50:09.731364 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2025-11-26 15:50:09.731371 | controller | Wednesday 26 November 2025 15:50:09 +0000 (0:00:00.021) 0:01:08.284 **** 2025-11-26 15:50:09.731379 | controller | ok: [instance] => (item=compute-0) 2025-11-26 15:50:09.844362 | controller | ok: [instance] => (item=controller-0) 2025-11-26 15:50:09.844379 | controller | ok: [instance] => (item=crc-0) 2025-11-26 15:50:09.844386 | controller | 2025-11-26 15:50:09.844391 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2025-11-26 15:50:09.844397 | controller | Wednesday 26 November 2025 15:50:09 +0000 (0:00:00.235) 0:01:08.519 **** 2025-11-26 15:50:09.844404 | controller | 2025-11-26 15:50:09.885728 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-11-26 15:50:09.885749 | controller | Wednesday 26 November 2025 15:50:09 +0000 (0:00:00.113) 0:01:08.632 **** 2025-11-26 15:50:09.885761 | controller | ok: [instance] 2025-11-26 15:50:09.885840 | controller | 2025-11-26 15:50:09.885858 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-11-26 15:50:09.885869 | controller | Wednesday 26 November 2025 15:50:09 +0000 (0:00:00.041) 0:01:08.674 **** 2025-11-26 15:50:10.080043 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-11-26 15:50:10.080231 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-11-26 15:50:10.080392 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-11-26 15:50:10.080549 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-11-26 15:50:10.080754 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-11-26 15:50:10.080899 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-11-26 15:50:10.081027 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-11-26 15:50:10.081162 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-26 15:50:10.081294 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-26 15:50:10.081435 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-11-26 15:50:10.081561 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-11-26 15:50:10.081717 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-11-26 15:50:10.081855 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-11-26 15:50:10.081983 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-11-26 15:50:10.082111 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-11-26 15:50:10.082233 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-11-26 15:50:10.082352 | controller | 2025-11-26 15:50:10.082469 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-11-26 15:50:10.082586 | controller | Wednesday 26 November 2025 15:50:10 +0000 (0:00:00.194) 0:01:08.868 **** 2025-11-26 15:50:13.161970 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-11-26 15:50:13.162043 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-11-26 15:50:13.162057 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-11-26 15:50:13.162068 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-11-26 15:50:13.162077 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-11-26 15:50:13.162086 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-11-26 15:50:13.162095 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-11-26 15:50:13.162104 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-26 15:50:13.162113 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-26 15:50:13.162122 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-11-26 15:50:13.162134 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-11-26 15:50:13.162171 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-11-26 15:50:13.162748 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-11-26 15:50:13.162798 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-11-26 15:50:13.162807 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-11-26 15:50:13.162813 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-11-26 15:50:13.162819 | controller | 2025-11-26 15:50:13.162827 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2025-11-26 15:50:13.162847 | controller | Wednesday 26 November 2025 15:50:13 +0000 (0:00:03.080) 0:01:11.949 **** 2025-11-26 15:50:13.181449 | controller | ok: [instance] 2025-11-26 15:50:13.221745 | controller | 2025-11-26 15:50:13.221779 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2025-11-26 15:50:13.221788 | controller | Wednesday 26 November 2025 15:50:13 +0000 (0:00:00.020) 0:01:11.970 **** 2025-11-26 15:50:13.221799 | controller | skipping: [instance] => (item=compute) 2025-11-26 15:50:13.221828 | controller | skipping: [instance] => (item=controller) 2025-11-26 15:50:13.221835 | controller | skipping: [instance] => (item=crc) 2025-11-26 15:50:13.221843 | controller | skipping: [instance] 2025-11-26 15:50:13.222118 | controller | 2025-11-26 15:50:13.250642 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2025-11-26 15:50:13.250666 | controller | Wednesday 26 November 2025 15:50:13 +0000 (0:00:00.040) 0:01:12.010 **** 2025-11-26 15:50:13.250681 | controller | skipping: [instance] 2025-11-26 15:50:13.614727 | controller | 2025-11-26 15:50:13.614759 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2025-11-26 15:50:13.614767 | controller | Wednesday 26 November 2025 15:50:13 +0000 (0:00:00.028) 0:01:12.039 **** 2025-11-26 15:50:13.614778 | controller | changed: [instance] 2025-11-26 15:50:14.407670 | controller | 2025-11-26 15:50:14.407710 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2025-11-26 15:50:14.407718 | controller | Wednesday 26 November 2025 15:50:13 +0000 (0:00:00.352) 0:01:12.392 **** 2025-11-26 15:50:14.407724 | controller | 2025-11-26 15:50:14.407730 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-11-26 15:50:14.407735 | controller | Wednesday 26 November 2025 15:50:13 +0000 (0:00:00.010) 0:01:12.403 **** 2025-11-26 15:50:14.407744 | controller | changed: [instance] 2025-11-26 15:50:14.407768 | controller | 2025-11-26 15:50:14.408020 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-11-26 15:50:14.750769 | controller | Wednesday 26 November 2025 15:50:14 +0000 (0:00:00.793) 0:01:13.196 **** 2025-11-26 15:50:14.750812 | controller | changed: [instance] 2025-11-26 15:50:14.750848 | controller | 2025-11-26 15:50:14.750859 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2025-11-26 15:50:14.751001 | controller | Wednesday 26 November 2025 15:50:14 +0000 (0:00:00.343) 0:01:13.539 **** 2025-11-26 15:50:15.084709 | controller | changed: [instance] 2025-11-26 15:50:15.084962 | controller | 2025-11-26 15:50:15.084985 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2025-11-26 15:50:15.424512 | controller | Wednesday 26 November 2025 15:50:15 +0000 (0:00:00.333) 0:01:13.873 **** 2025-11-26 15:50:15.424548 | controller | changed: [instance] 2025-11-26 15:50:15.775723 | controller | 2025-11-26 15:50:15.775754 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2025-11-26 15:50:15.775762 | controller | Wednesday 26 November 2025 15:50:15 +0000 (0:00:00.339) 0:01:14.213 **** 2025-11-26 15:50:15.775778 | controller | changed: [instance] 2025-11-26 15:50:15.808216 | controller | 2025-11-26 15:50:15.808239 | controller | TASK [Build utility records dataset] ******************************************* 2025-11-26 15:50:15.808247 | controller | Wednesday 26 November 2025 15:50:15 +0000 (0:00:00.351) 0:01:14.564 **** 2025-11-26 15:50:15.808257 | controller | 2025-11-26 15:50:15.897464 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-11-26 15:50:15.897498 | controller | Wednesday 26 November 2025 15:50:15 +0000 (0:00:00.032) 0:01:14.597 **** 2025-11-26 15:50:15.897510 | controller | ok: [instance] 2025-11-26 15:50:15.993256 | controller | 2025-11-26 15:50:15.993276 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-11-26 15:50:15.993284 | controller | Wednesday 26 November 2025 15:50:15 +0000 (0:00:00.089) 0:01:14.686 **** 2025-11-26 15:50:15.993293 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-11-26 15:50:16.460733 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-26 15:50:16.460778 | controller | 2025-11-26 15:50:16.460788 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-11-26 15:50:16.460795 | controller | Wednesday 26 November 2025 15:50:15 +0000 (0:00:00.095) 0:01:14.781 **** 2025-11-26 15:50:16.460813 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-11-26 15:50:16.460838 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-26 15:50:16.460869 | controller | 2025-11-26 15:50:16.461396 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-11-26 15:50:16.920726 | controller | Wednesday 26 November 2025 15:50:16 +0000 (0:00:00.456) 0:01:15.238 **** 2025-11-26 15:50:16.920760 | controller | 2025-11-26 15:50:16.920770 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-11-26 15:50:16.920777 | controller | Wednesday 26 November 2025 15:50:16 +0000 (0:00:00.011) 0:01:15.249 **** 2025-11-26 15:50:16.920789 | controller | changed: [instance] 2025-11-26 15:50:16.920811 | controller | 2025-11-26 15:50:16.920818 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-11-26 15:50:16.920827 | controller | Wednesday 26 November 2025 15:50:16 +0000 (0:00:00.459) 0:01:15.709 **** 2025-11-26 15:50:17.264702 | controller | changed: [instance] 2025-11-26 15:50:17.295557 | controller | 2025-11-26 15:50:17.295575 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2025-11-26 15:50:17.295583 | controller | Wednesday 26 November 2025 15:50:17 +0000 (0:00:00.343) 0:01:16.053 **** 2025-11-26 15:50:17.295591 | controller | skipping: [instance] 2025-11-26 15:50:17.396708 | controller | 2025-11-26 15:50:17.396727 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2025-11-26 15:50:17.396735 | controller | Wednesday 26 November 2025 15:50:17 +0000 (0:00:00.031) 0:01:16.084 **** 2025-11-26 15:50:17.396744 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2025-11-26 15:50:17.579403 | controller | 2025-11-26 15:50:17.579422 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2025-11-26 15:50:17.579430 | controller | Wednesday 26 November 2025 15:50:17 +0000 (0:00:00.101) 0:01:16.185 **** 2025-11-26 15:50:17.579439 | controller | ok: [instance] 2025-11-26 15:50:17.598766 | controller | 2025-11-26 15:50:17.598805 | controller | TASK [Deploy CRC if needed] **************************************************** 2025-11-26 15:50:17.598815 | controller | Wednesday 26 November 2025 15:50:17 +0000 (0:00:00.182) 0:01:16.368 **** 2025-11-26 15:50:17.598827 | controller | skipping: [instance] 2025-11-26 15:50:17.599012 | controller | 2025-11-26 15:50:17.599034 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2025-11-26 15:50:17.910969 | controller | Wednesday 26 November 2025 15:50:17 +0000 (0:00:00.019) 0:01:16.387 **** 2025-11-26 15:50:17.910991 | controller | ok: [instance] 2025-11-26 15:50:18.140410 | controller | 2025-11-26 15:50:18.140439 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2025-11-26 15:50:18.140447 | controller | Wednesday 26 November 2025 15:50:17 +0000 (0:00:00.312) 0:01:16.699 **** 2025-11-26 15:50:18.140458 | controller | ok: [instance] 2025-11-26 15:50:18.354727 | controller | 2025-11-26 15:50:18.354764 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2025-11-26 15:50:18.354774 | controller | Wednesday 26 November 2025 15:50:18 +0000 (0:00:00.229) 0:01:16.928 **** 2025-11-26 15:50:18.354787 | controller | ok: [instance] 2025-11-26 15:50:18.354818 | controller | 2025-11-26 15:50:18.355116 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2025-11-26 15:50:18.570752 | controller | Wednesday 26 November 2025 15:50:18 +0000 (0:00:00.214) 0:01:17.143 **** 2025-11-26 15:50:18.570789 | controller | ok: [instance] 2025-11-26 15:50:18.797209 | controller | 2025-11-26 15:50:18.797242 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2025-11-26 15:50:18.797259 | controller | Wednesday 26 November 2025 15:50:18 +0000 (0:00:00.215) 0:01:17.359 **** 2025-11-26 15:50:18.797270 | controller | ok: [instance] 2025-11-26 15:50:18.835733 | controller | 2025-11-26 15:50:18.835756 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-11-26 15:50:18.835770 | controller | Wednesday 26 November 2025 15:50:18 +0000 (0:00:00.226) 0:01:17.585 **** 2025-11-26 15:50:18.835781 | controller | 2025-11-26 15:50:18.835812 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-11-26 15:50:18.835936 | controller | Wednesday 26 November 2025 15:50:18 +0000 (0:00:00.038) 0:01:17.624 **** 2025-11-26 15:50:19.026790 | controller | ok: [instance] 2025-11-26 15:50:19.026983 | controller | 2025-11-26 15:50:19.027011 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-11-26 15:50:19.048730 | controller | Wednesday 26 November 2025 15:50:19 +0000 (0:00:00.190) 0:01:17.815 **** 2025-11-26 15:50:19.048760 | controller | ok: [instance] 2025-11-26 15:50:19.048881 | controller | 2025-11-26 15:50:19.048903 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-11-26 15:50:19.048916 | controller | Wednesday 26 November 2025 15:50:19 +0000 (0:00:00.021) 0:01:17.837 **** 2025-11-26 15:50:19.072730 | controller | skipping: [instance] 2025-11-26 15:50:19.073037 | controller | 2025-11-26 15:50:19.353732 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2025-11-26 15:50:19.353766 | controller | Wednesday 26 November 2025 15:50:19 +0000 (0:00:00.023) 0:01:17.861 **** 2025-11-26 15:50:19.353778 | controller | ok: [instance] 2025-11-26 15:50:19.353801 | controller | 2025-11-26 15:50:19.353809 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2025-11-26 15:50:19.353908 | controller | Wednesday 26 November 2025 15:50:19 +0000 (0:00:00.281) 0:01:18.142 **** 2025-11-26 15:50:19.564696 | controller | ok: [instance] 2025-11-26 15:50:19.565020 | controller | 2025-11-26 15:50:19.729731 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2025-11-26 15:50:19.729774 | controller | Wednesday 26 November 2025 15:50:19 +0000 (0:00:00.210) 0:01:18.352 **** 2025-11-26 15:50:19.729789 | controller | ok: [instance] 2025-11-26 15:50:19.783767 | controller | 2025-11-26 15:50:19.783793 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2025-11-26 15:50:19.783804 | controller | Wednesday 26 November 2025 15:50:19 +0000 (0:00:00.165) 0:01:18.518 **** 2025-11-26 15:50:19.783816 | controller | 2025-11-26 15:50:19.783847 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-11-26 15:50:19.783858 | controller | Wednesday 26 November 2025 15:50:19 +0000 (0:00:00.054) 0:01:18.572 **** 2025-11-26 15:50:19.826378 | controller | ok: [instance] => changed=false 2025-11-26 15:50:19.999582 | controller | msg: All assertions passed 2025-11-26 15:50:19.999616 | controller | 2025-11-26 15:50:19.999626 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-11-26 15:50:19.999632 | controller | Wednesday 26 November 2025 15:50:19 +0000 (0:00:00.042) 0:01:18.614 **** 2025-11-26 15:50:19.999640 | controller | ok: [instance] 2025-11-26 15:50:20.181824 | controller | 2025-11-26 15:50:20.181854 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-11-26 15:50:20.181866 | controller | Wednesday 26 November 2025 15:50:19 +0000 (0:00:00.173) 0:01:18.788 **** 2025-11-26 15:50:20.181881 | controller | ok: [instance] 2025-11-26 15:50:20.204812 | controller | 2025-11-26 15:50:20.204853 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-11-26 15:50:20.204865 | controller | Wednesday 26 November 2025 15:50:20 +0000 (0:00:00.181) 0:01:18.970 **** 2025-11-26 15:50:20.204879 | controller | ok: [instance] => changed=false 2025-11-26 15:50:20.204911 | controller | msg: All assertions passed 2025-11-26 15:50:20.204924 | controller | 2025-11-26 15:50:20.205135 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-11-26 15:50:20.387447 | controller | Wednesday 26 November 2025 15:50:20 +0000 (0:00:00.023) 0:01:18.993 **** 2025-11-26 15:50:20.387477 | controller | ok: [instance] 2025-11-26 15:50:20.557295 | controller | 2025-11-26 15:50:20.557320 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-11-26 15:50:20.557330 | controller | Wednesday 26 November 2025 15:50:20 +0000 (0:00:00.182) 0:01:19.176 **** 2025-11-26 15:50:20.557341 | controller | ok: [instance] 2025-11-26 15:50:20.603305 | controller | 2025-11-26 15:50:20.603335 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-11-26 15:50:20.603347 | controller | Wednesday 26 November 2025 15:50:20 +0000 (0:00:00.169) 0:01:19.345 **** 2025-11-26 15:50:20.603367 | controller | ok: [instance] 2025-11-26 15:50:20.986154 | controller | 2025-11-26 15:50:20.986177 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2025-11-26 15:50:20.986185 | controller | Wednesday 26 November 2025 15:50:20 +0000 (0:00:00.045) 0:01:19.391 **** 2025-11-26 15:50:20.986194 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2025-11-26 15:50:21.005117 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2025-11-26 15:50:21.005148 | controller | 2025-11-26 15:50:21.005156 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2025-11-26 15:50:21.005163 | controller | Wednesday 26 November 2025 15:50:20 +0000 (0:00:00.382) 0:01:19.774 **** 2025-11-26 15:50:21.005173 | controller | skipping: [instance] 2025-11-26 15:50:21.030302 | controller | 2025-11-26 15:50:21.030328 | controller | TASK [Load the architecture local kustomize patches] *************************** 2025-11-26 15:50:21.030336 | controller | Wednesday 26 November 2025 15:50:21 +0000 (0:00:00.018) 0:01:19.793 **** 2025-11-26 15:50:21.030346 | controller | skipping: [instance] 2025-11-26 15:50:21.156150 | controller | 2025-11-26 15:50:21.156175 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2025-11-26 15:50:21.156183 | controller | Wednesday 26 November 2025 15:50:21 +0000 (0:00:00.025) 0:01:19.818 **** 2025-11-26 15:50:21.156194 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2025-11-26 15:50:21.182168 | controller | 2025-11-26 15:50:21.182193 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2025-11-26 15:50:21.182202 | controller | Wednesday 26 November 2025 15:50:21 +0000 (0:00:00.125) 0:01:19.944 **** 2025-11-26 15:50:21.182213 | controller | skipping: [instance] 2025-11-26 15:50:21.585305 | controller | 2025-11-26 15:50:21.585331 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2025-11-26 15:50:21.585339 | controller | Wednesday 26 November 2025 15:50:21 +0000 (0:00:00.026) 0:01:19.970 **** 2025-11-26 15:50:21.585348 | controller | changed: [instance] 2025-11-26 15:50:22.091761 | controller | 2025-11-26 15:50:22.091798 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2025-11-26 15:50:22.091808 | controller | Wednesday 26 November 2025 15:50:21 +0000 (0:00:00.403) 0:01:20.373 **** 2025-11-26 15:50:22.091821 | controller | changed: [instance] 2025-11-26 15:50:22.516197 | controller | 2025-11-26 15:50:22.516231 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2025-11-26 15:50:22.516239 | controller | Wednesday 26 November 2025 15:50:22 +0000 (0:00:00.494) 0:01:20.868 **** 2025-11-26 15:50:22.516245 | controller | 2025-11-26 15:50:22.516251 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-11-26 15:50:22.516257 | controller | Wednesday 26 November 2025 15:50:22 +0000 (0:00:00.011) 0:01:20.879 **** 2025-11-26 15:50:22.516268 | controller | changed: [instance] 2025-11-26 15:50:23.335653 | controller | 2025-11-26 15:50:23.335708 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-11-26 15:50:23.335717 | controller | Wednesday 26 November 2025 15:50:22 +0000 (0:00:00.424) 0:01:21.304 **** 2025-11-26 15:50:23.335729 | controller | changed: [instance] 2025-11-26 15:50:23.367042 | controller | 2025-11-26 15:50:23.367074 | controller | TASK [Deploy virtualbmc] ******************************************************* 2025-11-26 15:50:23.367082 | controller | Wednesday 26 November 2025 15:50:23 +0000 (0:00:00.819) 0:01:22.124 **** 2025-11-26 15:50:23.367092 | controller | skipping: [instance] 2025-11-26 15:50:23.398922 | controller | 2025-11-26 15:50:23.398952 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2025-11-26 15:50:23.398961 | controller | Wednesday 26 November 2025 15:50:23 +0000 (0:00:00.031) 0:01:22.155 **** 2025-11-26 15:50:23.398971 | controller | skipping: [instance] 2025-11-26 15:50:23.398994 | controller | 2025-11-26 15:50:23.399006 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2025-11-26 15:50:23.399013 | controller | Wednesday 26 November 2025 15:50:23 +0000 (0:00:00.031) 0:01:22.187 **** 2025-11-26 15:50:23.955526 | controller | changed: [instance] => (item=workload) 2025-11-26 15:50:24.367573 | controller | changed: [instance] => (item=reproducer-inventory) 2025-11-26 15:50:24.367619 | controller | ok: [instance] => (item=volumes) 2025-11-26 15:50:24.367630 | controller | 2025-11-26 15:50:24.367637 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2025-11-26 15:50:24.367642 | controller | Wednesday 26 November 2025 15:50:23 +0000 (0:00:00.555) 0:01:22.743 **** 2025-11-26 15:50:24.367653 | controller | changed: [instance] => (item=workload) 2025-11-26 15:50:24.392023 | controller | changed: [instance] => (item=volumes) 2025-11-26 15:50:24.392044 | controller | 2025-11-26 15:50:24.392053 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2025-11-26 15:50:24.392059 | controller | Wednesday 26 November 2025 15:50:24 +0000 (0:00:00.412) 0:01:23.155 **** 2025-11-26 15:50:24.392068 | controller | skipping: [instance] 2025-11-26 15:50:25.396376 | controller | 2025-11-26 15:50:25.396407 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2025-11-26 15:50:25.396420 | controller | Wednesday 26 November 2025 15:50:24 +0000 (0:00:00.024) 0:01:23.180 **** 2025-11-26 15:50:25.396430 | controller | changed: [instance] => (item=compute) 2025-11-26 15:50:25.755740 | controller | changed: [instance] => (item=controller) 2025-11-26 15:50:25.755770 | controller | changed: [instance] => (item=crc) 2025-11-26 15:50:25.755779 | controller | 2025-11-26 15:50:25.755785 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2025-11-26 15:50:25.755791 | controller | Wednesday 26 November 2025 15:50:25 +0000 (0:00:01.003) 0:01:24.183 **** 2025-11-26 15:50:25.755801 | controller | changed: [instance] 2025-11-26 15:50:25.755890 | controller | 2025-11-26 15:50:25.755923 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2025-11-26 15:50:25.755938 | controller | Wednesday 26 November 2025 15:50:25 +0000 (0:00:00.360) 0:01:24.544 **** 2025-11-26 15:50:25.795494 | controller | skipping: [instance] 2025-11-26 15:50:25.857755 | controller | 2025-11-26 15:50:25.857793 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2025-11-26 15:50:25.857804 | controller | Wednesday 26 November 2025 15:50:25 +0000 (0:00:00.039) 0:01:24.584 **** 2025-11-26 15:50:25.857818 | controller | skipping: [instance] => (item=crc) 2025-11-26 15:50:25.857850 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2025-11-26 15:50:25.858367 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2025-11-26 15:50:26.067068 | controller | 2025-11-26 15:50:26.067092 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-11-26 15:50:26.067100 | controller | Wednesday 26 November 2025 15:50:25 +0000 (0:00:00.062) 0:01:24.646 **** 2025-11-26 15:50:26.067110 | controller | changed: [instance] 2025-11-26 15:50:26.244286 | controller | 2025-11-26 15:50:26.244306 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-11-26 15:50:26.244314 | controller | Wednesday 26 November 2025 15:50:26 +0000 (0:00:00.209) 0:01:24.855 **** 2025-11-26 15:50:26.244322 | controller | ok: [instance] 2025-11-26 15:50:47.268556 | controller | 2025-11-26 15:50:47.268589 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-11-26 15:50:47.268633 | controller | Wednesday 26 November 2025 15:50:26 +0000 (0:00:00.177) 0:01:25.032 **** 2025-11-26 15:50:47.268648 | controller | changed: [instance] 2025-11-26 15:50:47.454419 | controller | 2025-11-26 15:50:47.454436 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-11-26 15:50:47.454443 | controller | Wednesday 26 November 2025 15:50:47 +0000 (0:00:21.023) 0:01:46.056 **** 2025-11-26 15:50:47.454451 | controller | ok: [instance] 2025-11-26 15:50:47.493695 | controller | 2025-11-26 15:50:47.493725 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-11-26 15:50:47.493738 | controller | Wednesday 26 November 2025 15:50:47 +0000 (0:00:00.186) 0:01:46.243 **** 2025-11-26 15:50:47.493748 | controller | ok: [instance] => changed=false 2025-11-26 15:50:47.493770 | controller | msg: All assertions passed 2025-11-26 15:50:47.493777 | controller | 2025-11-26 15:50:47.493914 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-11-26 15:50:47.688347 | controller | Wednesday 26 November 2025 15:50:47 +0000 (0:00:00.039) 0:01:46.282 **** 2025-11-26 15:50:47.688367 | controller | changed: [instance] 2025-11-26 15:50:47.887187 | controller | 2025-11-26 15:50:47.887206 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-11-26 15:50:47.887214 | controller | Wednesday 26 November 2025 15:50:47 +0000 (0:00:00.194) 0:01:46.477 **** 2025-11-26 15:50:47.887222 | controller | ok: [instance] 2025-11-26 15:50:48.077517 | controller | 2025-11-26 15:50:48.077536 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-11-26 15:50:48.077544 | controller | Wednesday 26 November 2025 15:50:47 +0000 (0:00:00.198) 0:01:46.675 **** 2025-11-26 15:50:48.077552 | controller | ok: [instance] 2025-11-26 15:50:48.099285 | controller | 2025-11-26 15:50:48.099301 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-11-26 15:50:48.099308 | controller | Wednesday 26 November 2025 15:50:48 +0000 (0:00:00.190) 0:01:46.866 **** 2025-11-26 15:50:48.099316 | controller | skipping: [instance] 2025-11-26 15:50:48.289751 | controller | 2025-11-26 15:50:48.289784 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-11-26 15:50:48.289792 | controller | Wednesday 26 November 2025 15:50:48 +0000 (0:00:00.021) 0:01:46.888 **** 2025-11-26 15:50:48.289803 | controller | ok: [instance] 2025-11-26 15:50:48.327760 | controller | 2025-11-26 15:50:48.327781 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-11-26 15:50:48.327790 | controller | Wednesday 26 November 2025 15:50:48 +0000 (0:00:00.190) 0:01:47.078 **** 2025-11-26 15:50:48.327800 | controller | ok: [instance] => changed=false 2025-11-26 15:50:48.327837 | controller | msg: All assertions passed 2025-11-26 15:50:48.328257 | controller | 2025-11-26 15:50:48.522101 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-11-26 15:50:48.522120 | controller | Wednesday 26 November 2025 15:50:48 +0000 (0:00:00.037) 0:01:47.116 **** 2025-11-26 15:50:48.522133 | controller | ok: [instance] 2025-11-26 15:50:48.693801 | controller | 2025-11-26 15:50:48.693847 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2025-11-26 15:50:48.693861 | controller | Wednesday 26 November 2025 15:50:48 +0000 (0:00:00.194) 0:01:47.310 **** 2025-11-26 15:50:48.693878 | controller | ok: [instance] 2025-11-26 15:50:49.069561 | controller | 2025-11-26 15:50:49.069588 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2025-11-26 15:50:49.069596 | controller | Wednesday 26 November 2025 15:50:48 +0000 (0:00:00.171) 0:01:47.482 **** 2025-11-26 15:50:49.069654 | controller | changed: [instance] 2025-11-26 15:50:49.236696 | controller | 2025-11-26 15:50:49.236715 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2025-11-26 15:50:49.236723 | controller | Wednesday 26 November 2025 15:50:49 +0000 (0:00:00.375) 0:01:47.858 **** 2025-11-26 15:50:49.236731 | controller | ok: [instance] 2025-11-26 15:50:49.236820 | controller | 2025-11-26 15:50:49.236830 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2025-11-26 15:50:49.236838 | controller | Wednesday 26 November 2025 15:50:49 +0000 (0:00:00.167) 0:01:48.025 **** 2025-11-26 15:50:49.408750 | controller | ok: [instance] 2025-11-26 15:50:49.804740 | controller | 2025-11-26 15:50:49.804779 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2025-11-26 15:50:49.804788 | controller | Wednesday 26 November 2025 15:50:49 +0000 (0:00:00.171) 0:01:48.197 **** 2025-11-26 15:50:49.804800 | controller | changed: [instance] 2025-11-26 15:50:49.804965 | controller | 2025-11-26 15:50:49.805014 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2025-11-26 15:50:49.825457 | controller | Wednesday 26 November 2025 15:50:49 +0000 (0:00:00.395) 0:01:48.593 **** 2025-11-26 15:50:49.825492 | controller | ok: [instance] 2025-11-26 15:50:50.051518 | controller | 2025-11-26 15:50:50.051549 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2025-11-26 15:50:50.051557 | controller | Wednesday 26 November 2025 15:50:49 +0000 (0:00:00.020) 0:01:48.613 **** 2025-11-26 15:50:50.051568 | controller | ok: [instance] 2025-11-26 15:50:50.519107 | controller | 2025-11-26 15:50:50.519138 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2025-11-26 15:50:50.519147 | controller | Wednesday 26 November 2025 15:50:50 +0000 (0:00:00.226) 0:01:48.839 **** 2025-11-26 15:50:50.519157 | controller | ok: [instance] 2025-11-26 15:50:50.642708 | controller | 2025-11-26 15:50:50.642735 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2025-11-26 15:50:50.642746 | controller | Wednesday 26 November 2025 15:50:50 +0000 (0:00:00.467) 0:01:49.307 **** 2025-11-26 15:50:50.642757 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-11-26 15:50:50.917233 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-11-26 15:50:50.917262 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-11-26 15:50:50.917270 | controller | 2025-11-26 15:50:50.917279 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2025-11-26 15:50:50.917285 | controller | Wednesday 26 November 2025 15:50:50 +0000 (0:00:00.123) 0:01:49.431 **** 2025-11-26 15:50:50.917295 | controller | changed: [instance] 2025-11-26 15:50:51.138052 | controller | 2025-11-26 15:50:51.138088 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2025-11-26 15:50:51.138096 | controller | Wednesday 26 November 2025 15:50:50 +0000 (0:00:00.274) 0:01:49.705 **** 2025-11-26 15:50:51.138106 | controller | changed: [instance] 2025-11-26 15:50:51.454550 | controller | 2025-11-26 15:50:51.454581 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2025-11-26 15:50:51.454590 | controller | Wednesday 26 November 2025 15:50:51 +0000 (0:00:00.220) 0:01:49.926 **** 2025-11-26 15:50:51.454622 | controller | changed: [instance] 2025-11-26 15:50:51.485753 | controller | 2025-11-26 15:50:51.485793 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2025-11-26 15:50:51.485804 | controller | Wednesday 26 November 2025 15:50:51 +0000 (0:00:00.316) 0:01:50.243 **** 2025-11-26 15:50:51.485819 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-11-26 15:50:51.530728 | controller | 2025-11-26 15:50:51.530745 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-11-26 15:50:51.530753 | controller | Wednesday 26 November 2025 15:50:51 +0000 (0:00:00.031) 0:01:50.274 **** 2025-11-26 15:50:51.530762 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-11-26 15:50:51.531016 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-11-26 15:50:51.531040 | controller | 2025-11-26 15:50:51.531054 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-26 15:50:51.750633 | controller | Wednesday 26 November 2025 15:50:51 +0000 (0:00:00.045) 0:01:50.319 **** 2025-11-26 15:50:51.750669 | controller | ok: [instance] 2025-11-26 15:50:51.795237 | controller | 2025-11-26 15:50:51.795259 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-26 15:50:51.795271 | controller | Wednesday 26 November 2025 15:50:51 +0000 (0:00:00.219) 0:01:50.539 **** 2025-11-26 15:50:51.795282 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 15:50:52.018047 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 15:50:52.018085 | controller | 2025-11-26 15:50:52.018093 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-26 15:50:52.018100 | controller | Wednesday 26 November 2025 15:50:51 +0000 (0:00:00.044) 0:01:50.583 **** 2025-11-26 15:50:52.018110 | controller | ok: [instance] 2025-11-26 15:50:52.208582 | controller | 2025-11-26 15:50:52.208632 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-26 15:50:52.208643 | controller | Wednesday 26 November 2025 15:50:52 +0000 (0:00:00.222) 0:01:50.806 **** 2025-11-26 15:50:52.208652 | controller | ok: [instance] 2025-11-26 15:50:52.490589 | controller | 2025-11-26 15:50:52.490638 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2025-11-26 15:50:52.490646 | controller | Wednesday 26 November 2025 15:50:52 +0000 (0:00:00.190) 0:01:50.997 **** 2025-11-26 15:50:52.490655 | controller | changed: [instance] 2025-11-26 15:50:52.721081 | controller | 2025-11-26 15:50:52.721111 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-26 15:50:52.721119 | controller | Wednesday 26 November 2025 15:50:52 +0000 (0:00:00.282) 0:01:51.279 **** 2025-11-26 15:50:52.721129 | controller | ok: [instance] 2025-11-26 15:50:52.764975 | controller | 2025-11-26 15:50:52.765000 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-26 15:50:52.765009 | controller | Wednesday 26 November 2025 15:50:52 +0000 (0:00:00.230) 0:01:51.509 **** 2025-11-26 15:50:52.765020 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 15:50:52.765050 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 15:50:52.765060 | controller | 2025-11-26 15:50:52.765280 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-26 15:50:52.988537 | controller | Wednesday 26 November 2025 15:50:52 +0000 (0:00:00.044) 0:01:51.553 **** 2025-11-26 15:50:52.988566 | controller | ok: [instance] 2025-11-26 15:50:53.180042 | controller | 2025-11-26 15:50:53.180072 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-26 15:50:53.180082 | controller | Wednesday 26 November 2025 15:50:52 +0000 (0:00:00.223) 0:01:51.777 **** 2025-11-26 15:50:53.180094 | controller | ok: [instance] 2025-11-26 15:50:54.461251 | controller | 2025-11-26 15:50:54.461279 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2025-11-26 15:50:54.461287 | controller | Wednesday 26 November 2025 15:50:53 +0000 (0:00:00.191) 0:01:51.968 **** 2025-11-26 15:50:54.461297 | controller | changed: [instance] 2025-11-26 15:50:54.483491 | controller | 2025-11-26 15:50:54.483513 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2025-11-26 15:50:54.483522 | controller | Wednesday 26 November 2025 15:50:54 +0000 (0:00:01.281) 0:01:53.249 **** 2025-11-26 15:50:54.483530 | controller | skipping: [instance] 2025-11-26 15:50:54.511707 | controller | 2025-11-26 15:50:54.511726 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2025-11-26 15:50:54.511733 | controller | Wednesday 26 November 2025 15:50:54 +0000 (0:00:00.022) 0:01:53.272 **** 2025-11-26 15:50:54.511742 | controller | skipping: [instance] 2025-11-26 15:50:54.512001 | controller | 2025-11-26 15:50:54.540282 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2025-11-26 15:50:54.540305 | controller | Wednesday 26 November 2025 15:50:54 +0000 (0:00:00.028) 0:01:53.300 **** 2025-11-26 15:50:54.540318 | controller | skipping: [instance] 2025-11-26 15:50:54.567274 | controller | 2025-11-26 15:50:54.567294 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2025-11-26 15:50:54.567302 | controller | Wednesday 26 November 2025 15:50:54 +0000 (0:00:00.028) 0:01:53.328 **** 2025-11-26 15:50:54.567312 | controller | skipping: [instance] 2025-11-26 15:50:54.780781 | controller | 2025-11-26 15:50:54.780824 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-11-26 15:50:54.780834 | controller | Wednesday 26 November 2025 15:50:54 +0000 (0:00:00.027) 0:01:53.356 **** 2025-11-26 15:50:54.780846 | controller | changed: [instance] 2025-11-26 15:50:54.819030 | controller | 2025-11-26 15:50:54.819062 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-11-26 15:50:54.819075 | controller | Wednesday 26 November 2025 15:50:54 +0000 (0:00:00.213) 0:01:53.569 **** 2025-11-26 15:50:54.819085 | controller | ok: [instance] 2025-11-26 15:50:54.875785 | controller | 2025-11-26 15:50:54.875828 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-11-26 15:50:54.875841 | controller | Wednesday 26 November 2025 15:50:54 +0000 (0:00:00.038) 0:01:53.607 **** 2025-11-26 15:50:54.875863 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-11-26 15:50:55.072748 | controller | 2025-11-26 15:50:55.072782 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-11-26 15:50:55.072792 | controller | Wednesday 26 November 2025 15:50:54 +0000 (0:00:00.056) 0:01:53.664 **** 2025-11-26 15:50:55.072804 | controller | ok: [instance] 2025-11-26 15:50:55.138425 | controller | 2025-11-26 15:50:55.138454 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-11-26 15:50:55.138463 | controller | Wednesday 26 November 2025 15:50:55 +0000 (0:00:00.196) 0:01:53.861 **** 2025-11-26 15:50:55.138474 | controller | ok: [instance] 2025-11-26 15:50:55.182408 | controller | 2025-11-26 15:50:55.182428 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-11-26 15:50:55.182437 | controller | Wednesday 26 November 2025 15:50:55 +0000 (0:00:00.065) 0:01:53.927 **** 2025-11-26 15:50:55.182447 | controller | ok: [instance] 2025-11-26 15:50:55.225079 | controller | 2025-11-26 15:50:55.225101 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-11-26 15:50:55.225110 | controller | Wednesday 26 November 2025 15:50:55 +0000 (0:00:00.044) 0:01:53.971 **** 2025-11-26 15:50:55.225121 | controller | skipping: [instance] 2025-11-26 15:50:55.268437 | controller | 2025-11-26 15:50:55.268455 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-11-26 15:50:55.268463 | controller | Wednesday 26 November 2025 15:50:55 +0000 (0:00:00.042) 0:01:54.013 **** 2025-11-26 15:50:55.268471 | controller | skipping: [instance] 2025-11-26 15:50:55.327792 | controller | 2025-11-26 15:50:55.327850 | controller | TASK [Call the config_drive role] ********************************************** 2025-11-26 15:50:55.327876 | controller | Wednesday 26 November 2025 15:50:55 +0000 (0:00:00.043) 0:01:54.057 **** 2025-11-26 15:50:55.327896 | controller | 2025-11-26 15:50:55.726553 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-11-26 15:50:55.726593 | controller | Wednesday 26 November 2025 15:50:55 +0000 (0:00:00.059) 0:01:54.116 **** 2025-11-26 15:50:55.726658 | controller | ok: [instance] => (item=artifacts) 2025-11-26 15:50:56.910741 | controller | ok: [instance] => (item=logs) 2025-11-26 15:50:56.910780 | controller | 2025-11-26 15:50:56.910789 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-11-26 15:50:56.910797 | controller | Wednesday 26 November 2025 15:50:55 +0000 (0:00:00.398) 0:01:54.514 **** 2025-11-26 15:50:56.910809 | controller | ok: [instance] 2025-11-26 15:50:56.910839 | controller | 2025-11-26 15:50:56.911040 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-11-26 15:50:57.114707 | controller | Wednesday 26 November 2025 15:50:56 +0000 (0:00:01.184) 0:01:55.699 **** 2025-11-26 15:50:57.114754 | controller | changed: [instance] 2025-11-26 15:50:57.114825 | controller | 2025-11-26 15:50:57.114844 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-11-26 15:50:57.114855 | controller | Wednesday 26 November 2025 15:50:57 +0000 (0:00:00.204) 0:01:55.903 **** 2025-11-26 15:50:57.465353 | controller | changed: [instance] 2025-11-26 15:50:57.828521 | controller | 2025-11-26 15:50:57.828540 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-11-26 15:50:57.828548 | controller | Wednesday 26 November 2025 15:50:57 +0000 (0:00:00.350) 0:01:56.254 **** 2025-11-26 15:50:57.828556 | controller | changed: [instance] 2025-11-26 15:50:57.871489 | controller | 2025-11-26 15:50:57.871509 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-11-26 15:50:57.871516 | controller | Wednesday 26 November 2025 15:50:57 +0000 (0:00:00.363) 0:01:56.617 **** 2025-11-26 15:50:57.871529 | controller | skipping: [instance] 2025-11-26 15:50:58.065408 | controller | 2025-11-26 15:50:58.065429 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-11-26 15:50:58.065437 | controller | Wednesday 26 November 2025 15:50:57 +0000 (0:00:00.043) 0:01:56.660 **** 2025-11-26 15:50:58.065445 | controller | ok: [instance] 2025-11-26 15:50:58.107745 | controller | 2025-11-26 15:50:58.107782 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-11-26 15:50:58.107792 | controller | Wednesday 26 November 2025 15:50:58 +0000 (0:00:00.193) 0:01:56.854 **** 2025-11-26 15:50:58.107804 | controller | skipping: [instance] 2025-11-26 15:50:58.341734 | controller | 2025-11-26 15:50:58.341782 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-11-26 15:50:58.341790 | controller | Wednesday 26 November 2025 15:50:58 +0000 (0:00:00.041) 0:01:56.896 **** 2025-11-26 15:50:58.341802 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2025-11-26 15:50:58.623055 | controller | changed: [instance] 2025-11-26 15:50:58.623083 | controller | 2025-11-26 15:50:58.623095 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-11-26 15:50:58.623102 | controller | Wednesday 26 November 2025 15:50:58 +0000 (0:00:00.233) 0:01:57.129 **** 2025-11-26 15:50:58.623111 | controller | changed: [instance] 2025-11-26 15:50:58.669296 | controller | 2025-11-26 15:50:58.669325 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-11-26 15:50:58.669333 | controller | Wednesday 26 November 2025 15:50:58 +0000 (0:00:00.281) 0:01:57.411 **** 2025-11-26 15:50:58.669343 | controller | skipping: [instance] 2025-11-26 15:50:58.696471 | controller | 2025-11-26 15:50:58.696498 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2025-11-26 15:50:58.696506 | controller | Wednesday 26 November 2025 15:50:58 +0000 (0:00:00.046) 0:01:57.457 **** 2025-11-26 15:50:58.696516 | controller | skipping: [instance] 2025-11-26 15:50:58.936729 | controller | 2025-11-26 15:50:58.936757 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2025-11-26 15:50:58.936765 | controller | Wednesday 26 November 2025 15:50:58 +0000 (0:00:00.027) 0:01:57.485 **** 2025-11-26 15:50:58.936775 | controller | changed: [instance] 2025-11-26 15:50:58.937001 | controller | 2025-11-26 15:50:58.937023 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2025-11-26 15:50:59.157586 | controller | Wednesday 26 November 2025 15:50:58 +0000 (0:00:00.240) 0:01:57.725 **** 2025-11-26 15:50:59.157634 | controller | changed: [instance] 2025-11-26 15:50:59.469124 | controller | 2025-11-26 15:50:59.469153 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2025-11-26 15:50:59.469161 | controller | Wednesday 26 November 2025 15:50:59 +0000 (0:00:00.220) 0:01:57.946 **** 2025-11-26 15:50:59.469172 | controller | changed: [instance] 2025-11-26 15:50:59.497786 | controller | 2025-11-26 15:50:59.497825 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2025-11-26 15:50:59.497836 | controller | Wednesday 26 November 2025 15:50:59 +0000 (0:00:00.311) 0:01:58.257 **** 2025-11-26 15:50:59.497855 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-11-26 15:50:59.541748 | controller | 2025-11-26 15:50:59.541779 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-11-26 15:50:59.541788 | controller | Wednesday 26 November 2025 15:50:59 +0000 (0:00:00.028) 0:01:58.286 **** 2025-11-26 15:50:59.541800 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-11-26 15:50:59.541827 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-11-26 15:50:59.541839 | controller | 2025-11-26 15:50:59.541847 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-26 15:50:59.541870 | controller | Wednesday 26 November 2025 15:50:59 +0000 (0:00:00.044) 0:01:58.330 **** 2025-11-26 15:50:59.776185 | controller | ok: [instance] 2025-11-26 15:50:59.820812 | controller | 2025-11-26 15:50:59.820859 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-26 15:50:59.820873 | controller | Wednesday 26 November 2025 15:50:59 +0000 (0:00:00.234) 0:01:58.564 **** 2025-11-26 15:50:59.820891 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 15:51:00.067568 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 15:51:00.067628 | controller | 2025-11-26 15:51:00.067637 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-26 15:51:00.067644 | controller | Wednesday 26 November 2025 15:50:59 +0000 (0:00:00.044) 0:01:58.609 **** 2025-11-26 15:51:00.067654 | controller | ok: [instance] 2025-11-26 15:51:00.256764 | controller | 2025-11-26 15:51:00.256792 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-26 15:51:00.256800 | controller | Wednesday 26 November 2025 15:51:00 +0000 (0:00:00.246) 0:01:58.856 **** 2025-11-26 15:51:00.256811 | controller | ok: [instance] 2025-11-26 15:51:00.538069 | controller | 2025-11-26 15:51:00.538096 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2025-11-26 15:51:00.538104 | controller | Wednesday 26 November 2025 15:51:00 +0000 (0:00:00.189) 0:01:59.045 **** 2025-11-26 15:51:00.538113 | controller | changed: [instance] 2025-11-26 15:51:00.763430 | controller | 2025-11-26 15:51:00.763463 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-26 15:51:00.763471 | controller | Wednesday 26 November 2025 15:51:00 +0000 (0:00:00.281) 0:01:59.326 **** 2025-11-26 15:51:00.763481 | controller | ok: [instance] 2025-11-26 15:51:00.808714 | controller | 2025-11-26 15:51:00.808746 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-26 15:51:00.808757 | controller | Wednesday 26 November 2025 15:51:00 +0000 (0:00:00.225) 0:01:59.551 **** 2025-11-26 15:51:00.808770 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 15:51:00.808807 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 15:51:00.808836 | controller | 2025-11-26 15:51:00.809081 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-26 15:51:01.033678 | controller | Wednesday 26 November 2025 15:51:00 +0000 (0:00:00.045) 0:01:59.597 **** 2025-11-26 15:51:01.033725 | controller | ok: [instance] 2025-11-26 15:51:01.033870 | controller | 2025-11-26 15:51:01.033887 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-26 15:51:01.229547 | controller | Wednesday 26 November 2025 15:51:01 +0000 (0:00:00.224) 0:01:59.822 **** 2025-11-26 15:51:01.229596 | controller | ok: [instance] 2025-11-26 15:51:01.514190 | controller | 2025-11-26 15:51:01.514219 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2025-11-26 15:51:01.514227 | controller | Wednesday 26 November 2025 15:51:01 +0000 (0:00:00.195) 0:02:00.018 **** 2025-11-26 15:51:01.514236 | controller | changed: [instance] 2025-11-26 15:51:01.534112 | controller | 2025-11-26 15:51:01.534128 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2025-11-26 15:51:01.534135 | controller | Wednesday 26 November 2025 15:51:01 +0000 (0:00:00.284) 0:02:00.302 **** 2025-11-26 15:51:01.534143 | controller | skipping: [instance] 2025-11-26 15:51:01.560728 | controller | 2025-11-26 15:51:01.560750 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2025-11-26 15:51:01.560758 | controller | Wednesday 26 November 2025 15:51:01 +0000 (0:00:00.020) 0:02:00.322 **** 2025-11-26 15:51:01.560768 | controller | skipping: [instance] 2025-11-26 15:51:01.560977 | controller | 2025-11-26 15:51:01.560995 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2025-11-26 15:51:01.588557 | controller | Wednesday 26 November 2025 15:51:01 +0000 (0:00:00.026) 0:02:00.349 **** 2025-11-26 15:51:01.588591 | controller | skipping: [instance] 2025-11-26 15:51:01.614741 | controller | 2025-11-26 15:51:01.614767 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2025-11-26 15:51:01.614776 | controller | Wednesday 26 November 2025 15:51:01 +0000 (0:00:00.027) 0:02:00.377 **** 2025-11-26 15:51:01.614792 | controller | skipping: [instance] 2025-11-26 15:51:01.828759 | controller | 2025-11-26 15:51:01.828793 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-11-26 15:51:01.828807 | controller | Wednesday 26 November 2025 15:51:01 +0000 (0:00:00.026) 0:02:00.403 **** 2025-11-26 15:51:01.828822 | controller | changed: [instance] 2025-11-26 15:51:01.828874 | controller | 2025-11-26 15:51:01.828888 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-11-26 15:51:01.866469 | controller | Wednesday 26 November 2025 15:51:01 +0000 (0:00:00.213) 0:02:00.617 **** 2025-11-26 15:51:01.866506 | controller | ok: [instance] 2025-11-26 15:51:01.918407 | controller | 2025-11-26 15:51:01.918428 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-11-26 15:51:01.918437 | controller | Wednesday 26 November 2025 15:51:01 +0000 (0:00:00.037) 0:02:00.655 **** 2025-11-26 15:51:01.918447 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-11-26 15:51:02.106371 | controller | 2025-11-26 15:51:02.106404 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-11-26 15:51:02.106412 | controller | Wednesday 26 November 2025 15:51:01 +0000 (0:00:00.051) 0:02:00.707 **** 2025-11-26 15:51:02.106422 | controller | ok: [instance] 2025-11-26 15:51:02.166731 | controller | 2025-11-26 15:51:02.166751 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-11-26 15:51:02.166761 | controller | Wednesday 26 November 2025 15:51:02 +0000 (0:00:00.187) 0:02:00.895 **** 2025-11-26 15:51:02.166771 | controller | ok: [instance] 2025-11-26 15:51:02.166797 | controller | 2025-11-26 15:51:02.166806 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-11-26 15:51:02.166881 | controller | Wednesday 26 November 2025 15:51:02 +0000 (0:00:00.060) 0:02:00.955 **** 2025-11-26 15:51:02.210440 | controller | ok: [instance] 2025-11-26 15:51:02.251357 | controller | 2025-11-26 15:51:02.251377 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-11-26 15:51:02.251386 | controller | Wednesday 26 November 2025 15:51:02 +0000 (0:00:00.043) 0:02:00.999 **** 2025-11-26 15:51:02.251396 | controller | skipping: [instance] 2025-11-26 15:51:02.294485 | controller | 2025-11-26 15:51:02.294503 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-11-26 15:51:02.294511 | controller | Wednesday 26 November 2025 15:51:02 +0000 (0:00:00.040) 0:02:01.040 **** 2025-11-26 15:51:02.294519 | controller | skipping: [instance] 2025-11-26 15:51:02.355082 | controller | 2025-11-26 15:51:02.355120 | controller | TASK [Call the config_drive role] ********************************************** 2025-11-26 15:51:02.355134 | controller | Wednesday 26 November 2025 15:51:02 +0000 (0:00:00.043) 0:02:01.083 **** 2025-11-26 15:51:02.355154 | controller | 2025-11-26 15:51:02.742690 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-11-26 15:51:02.742728 | controller | Wednesday 26 November 2025 15:51:02 +0000 (0:00:00.060) 0:02:01.143 **** 2025-11-26 15:51:02.742741 | controller | ok: [instance] => (item=artifacts) 2025-11-26 15:51:03.896085 | controller | ok: [instance] => (item=logs) 2025-11-26 15:51:03.896128 | controller | 2025-11-26 15:51:03.896137 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-11-26 15:51:03.896144 | controller | Wednesday 26 November 2025 15:51:02 +0000 (0:00:00.387) 0:02:01.531 **** 2025-11-26 15:51:03.896155 | controller | ok: [instance] 2025-11-26 15:51:04.105290 | controller | 2025-11-26 15:51:04.105318 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-11-26 15:51:04.105328 | controller | Wednesday 26 November 2025 15:51:03 +0000 (0:00:01.153) 0:02:02.684 **** 2025-11-26 15:51:04.105339 | controller | changed: [instance] 2025-11-26 15:51:04.462084 | controller | 2025-11-26 15:51:04.462115 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-11-26 15:51:04.462124 | controller | Wednesday 26 November 2025 15:51:04 +0000 (0:00:00.209) 0:02:02.893 **** 2025-11-26 15:51:04.462134 | controller | changed: [instance] 2025-11-26 15:51:04.834690 | controller | 2025-11-26 15:51:04.834728 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-11-26 15:51:04.834741 | controller | Wednesday 26 November 2025 15:51:04 +0000 (0:00:00.356) 0:02:03.250 **** 2025-11-26 15:51:04.834752 | controller | changed: [instance] 2025-11-26 15:51:04.834776 | controller | 2025-11-26 15:51:04.834796 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-11-26 15:51:04.834924 | controller | Wednesday 26 November 2025 15:51:04 +0000 (0:00:00.372) 0:02:03.623 **** 2025-11-26 15:51:04.887749 | controller | skipping: [instance] 2025-11-26 15:51:04.888088 | controller | 2025-11-26 15:51:05.094630 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-11-26 15:51:05.094665 | controller | Wednesday 26 November 2025 15:51:04 +0000 (0:00:00.052) 0:02:03.675 **** 2025-11-26 15:51:05.094684 | controller | ok: [instance] 2025-11-26 15:51:05.140060 | controller | 2025-11-26 15:51:05.140081 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-11-26 15:51:05.140090 | controller | Wednesday 26 November 2025 15:51:05 +0000 (0:00:00.207) 0:02:03.882 **** 2025-11-26 15:51:05.140099 | controller | skipping: [instance] 2025-11-26 15:51:05.379250 | controller | 2025-11-26 15:51:05.379276 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-11-26 15:51:05.379284 | controller | Wednesday 26 November 2025 15:51:05 +0000 (0:00:00.045) 0:02:03.928 **** 2025-11-26 15:51:05.379293 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2025-11-26 15:51:05.654778 | controller | changed: [instance] 2025-11-26 15:51:05.654821 | controller | 2025-11-26 15:51:05.654834 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-11-26 15:51:05.654845 | controller | Wednesday 26 November 2025 15:51:05 +0000 (0:00:00.238) 0:02:04.167 **** 2025-11-26 15:51:05.654862 | controller | changed: [instance] 2025-11-26 15:51:05.654901 | controller | 2025-11-26 15:51:05.654916 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-11-26 15:51:05.703206 | controller | Wednesday 26 November 2025 15:51:05 +0000 (0:00:00.275) 0:02:04.443 **** 2025-11-26 15:51:05.703245 | controller | skipping: [instance] 2025-11-26 15:51:05.733788 | controller | 2025-11-26 15:51:05.733824 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2025-11-26 15:51:05.733838 | controller | Wednesday 26 November 2025 15:51:05 +0000 (0:00:00.048) 0:02:04.491 **** 2025-11-26 15:51:05.733854 | controller | skipping: [instance] 2025-11-26 15:51:05.733896 | controller | 2025-11-26 15:51:05.733911 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2025-11-26 15:51:05.734022 | controller | Wednesday 26 November 2025 15:51:05 +0000 (0:00:00.030) 0:02:04.522 **** 2025-11-26 15:51:05.985350 | controller | changed: [instance] 2025-11-26 15:51:06.211010 | controller | 2025-11-26 15:51:06.211034 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2025-11-26 15:51:06.211041 | controller | Wednesday 26 November 2025 15:51:05 +0000 (0:00:00.251) 0:02:04.773 **** 2025-11-26 15:51:06.211050 | controller | changed: [instance] 2025-11-26 15:51:06.502803 | controller | 2025-11-26 15:51:06.502851 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2025-11-26 15:51:06.502865 | controller | Wednesday 26 November 2025 15:51:06 +0000 (0:00:00.225) 0:02:04.999 **** 2025-11-26 15:51:06.502888 | controller | changed: [instance] 2025-11-26 15:51:06.533283 | controller | 2025-11-26 15:51:06.533313 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2025-11-26 15:51:06.533323 | controller | Wednesday 26 November 2025 15:51:06 +0000 (0:00:00.291) 0:02:05.291 **** 2025-11-26 15:51:06.533334 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-11-26 15:51:06.577237 | controller | 2025-11-26 15:51:06.577257 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-11-26 15:51:06.577266 | controller | Wednesday 26 November 2025 15:51:06 +0000 (0:00:00.030) 0:02:05.321 **** 2025-11-26 15:51:06.577276 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-11-26 15:51:06.804411 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-11-26 15:51:06.804445 | controller | 2025-11-26 15:51:06.804453 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-26 15:51:06.804460 | controller | Wednesday 26 November 2025 15:51:06 +0000 (0:00:00.043) 0:02:05.365 **** 2025-11-26 15:51:06.804470 | controller | ok: [instance] 2025-11-26 15:51:06.850284 | controller | 2025-11-26 15:51:06.850302 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-26 15:51:06.850309 | controller | Wednesday 26 November 2025 15:51:06 +0000 (0:00:00.226) 0:02:05.592 **** 2025-11-26 15:51:06.850318 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 15:51:07.085049 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 15:51:07.085069 | controller | 2025-11-26 15:51:07.085076 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-26 15:51:07.085082 | controller | Wednesday 26 November 2025 15:51:06 +0000 (0:00:00.046) 0:02:05.638 **** 2025-11-26 15:51:07.085089 | controller | ok: [instance] 2025-11-26 15:51:07.291058 | controller | 2025-11-26 15:51:07.291078 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-26 15:51:07.291085 | controller | Wednesday 26 November 2025 15:51:07 +0000 (0:00:00.234) 0:02:05.873 **** 2025-11-26 15:51:07.291094 | controller | ok: [instance] 2025-11-26 15:51:08.576731 | controller | 2025-11-26 15:51:08.576770 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2025-11-26 15:51:08.576780 | controller | Wednesday 26 November 2025 15:51:07 +0000 (0:00:00.206) 0:02:06.079 **** 2025-11-26 15:51:08.576793 | controller | changed: [instance] 2025-11-26 15:51:08.576823 | controller | 2025-11-26 15:51:08.576833 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-26 15:51:08.576958 | controller | Wednesday 26 November 2025 15:51:08 +0000 (0:00:01.285) 0:02:07.365 **** 2025-11-26 15:51:08.797333 | controller | ok: [instance] 2025-11-26 15:51:08.841221 | controller | 2025-11-26 15:51:08.841238 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-26 15:51:08.841245 | controller | Wednesday 26 November 2025 15:51:08 +0000 (0:00:00.220) 0:02:07.585 **** 2025-11-26 15:51:08.841253 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 15:51:09.055632 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 15:51:09.055663 | controller | 2025-11-26 15:51:09.055671 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-26 15:51:09.055678 | controller | Wednesday 26 November 2025 15:51:08 +0000 (0:00:00.043) 0:02:07.629 **** 2025-11-26 15:51:09.055688 | controller | ok: [instance] 2025-11-26 15:51:09.253082 | controller | 2025-11-26 15:51:09.253116 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-26 15:51:09.253124 | controller | Wednesday 26 November 2025 15:51:09 +0000 (0:00:00.214) 0:02:07.844 **** 2025-11-26 15:51:09.253134 | controller | ok: [instance] 2025-11-26 15:51:09.558676 | controller | 2025-11-26 15:51:09.558714 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2025-11-26 15:51:09.558724 | controller | Wednesday 26 November 2025 15:51:09 +0000 (0:00:00.197) 0:02:08.041 **** 2025-11-26 15:51:09.558737 | controller | changed: [instance] 2025-11-26 15:51:09.558771 | controller | 2025-11-26 15:51:09.558781 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2025-11-26 15:51:09.581168 | controller | Wednesday 26 November 2025 15:51:09 +0000 (0:00:00.305) 0:02:08.347 **** 2025-11-26 15:51:09.581203 | controller | skipping: [instance] 2025-11-26 15:51:09.610533 | controller | 2025-11-26 15:51:09.610564 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2025-11-26 15:51:09.610572 | controller | Wednesday 26 November 2025 15:51:09 +0000 (0:00:00.022) 0:02:08.369 **** 2025-11-26 15:51:09.610580 | controller | skipping: [instance] 2025-11-26 15:51:09.638401 | controller | 2025-11-26 15:51:09.638423 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2025-11-26 15:51:09.638434 | controller | Wednesday 26 November 2025 15:51:09 +0000 (0:00:00.029) 0:02:08.399 **** 2025-11-26 15:51:09.638443 | controller | skipping: [instance] 2025-11-26 15:51:09.662343 | controller | 2025-11-26 15:51:09.662371 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2025-11-26 15:51:09.662384 | controller | Wednesday 26 November 2025 15:51:09 +0000 (0:00:00.027) 0:02:08.426 **** 2025-11-26 15:51:09.662395 | controller | skipping: [instance] 2025-11-26 15:51:09.877717 | controller | 2025-11-26 15:51:09.877755 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-11-26 15:51:09.877765 | controller | Wednesday 26 November 2025 15:51:09 +0000 (0:00:00.024) 0:02:08.450 **** 2025-11-26 15:51:09.877778 | controller | changed: [instance] 2025-11-26 15:51:09.877807 | controller | 2025-11-26 15:51:09.877817 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-11-26 15:51:09.877853 | controller | Wednesday 26 November 2025 15:51:09 +0000 (0:00:00.215) 0:02:08.666 **** 2025-11-26 15:51:09.915771 | controller | ok: [instance] 2025-11-26 15:51:09.915833 | controller | 2025-11-26 15:51:09.915846 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-11-26 15:51:09.915943 | controller | Wednesday 26 November 2025 15:51:09 +0000 (0:00:00.038) 0:02:08.704 **** 2025-11-26 15:51:09.939271 | controller | skipping: [instance] 2025-11-26 15:51:09.962770 | controller | 2025-11-26 15:51:09.962803 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-11-26 15:51:09.962817 | controller | Wednesday 26 November 2025 15:51:09 +0000 (0:00:00.023) 0:02:08.727 **** 2025-11-26 15:51:09.962831 | controller | skipping: [instance] 2025-11-26 15:51:09.962871 | controller | 2025-11-26 15:51:09.962884 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-11-26 15:51:09.962919 | controller | Wednesday 26 November 2025 15:51:09 +0000 (0:00:00.023) 0:02:08.751 **** 2025-11-26 15:51:10.005706 | controller | skipping: [instance] 2025-11-26 15:51:10.006002 | controller | 2025-11-26 15:51:10.031777 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2025-11-26 15:51:10.031809 | controller | Wednesday 26 November 2025 15:51:10 +0000 (0:00:00.043) 0:02:08.794 **** 2025-11-26 15:51:10.031827 | controller | skipping: [instance] 2025-11-26 15:51:10.031868 | controller | 2025-11-26 15:51:10.031881 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2025-11-26 15:51:10.031993 | controller | Wednesday 26 November 2025 15:51:10 +0000 (0:00:00.025) 0:02:08.820 **** 2025-11-26 15:51:10.096761 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2025-11-26 15:51:10.096797 | controller | 2025-11-26 15:51:10.096807 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2025-11-26 15:51:10.096819 | controller | Wednesday 26 November 2025 15:51:10 +0000 (0:00:00.064) 0:02:08.885 **** 2025-11-26 15:51:10.331769 | controller | ok: [instance] => (item=crc) 2025-11-26 15:51:10.331806 | controller | 2025-11-26 15:51:10.331819 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2025-11-26 15:51:10.331834 | controller | Wednesday 26 November 2025 15:51:10 +0000 (0:00:00.234) 0:02:09.120 **** 2025-11-26 15:51:12.399773 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-11-26 15:51:12.399825 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-11-26 15:51:12.399837 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-11-26 15:51:12.400193 | controller | 2025-11-26 15:51:13.223705 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-11-26 15:51:13.223736 | controller | Wednesday 26 November 2025 15:51:12 +0000 (0:00:02.068) 0:02:11.188 **** 2025-11-26 15:51:13.223753 | controller | changed: [instance] 2025-11-26 15:51:13.223970 | controller | 2025-11-26 15:51:13.224006 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-11-26 15:51:13.976717 | controller | Wednesday 26 November 2025 15:51:13 +0000 (0:00:00.823) 0:02:12.012 **** 2025-11-26 15:51:13.976751 | controller | changed: [instance] 2025-11-26 15:51:14.771951 | controller | 2025-11-26 15:51:14.771982 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-11-26 15:51:14.771991 | controller | Wednesday 26 November 2025 15:51:13 +0000 (0:00:00.752) 0:02:12.765 **** 2025-11-26 15:51:14.772001 | controller | changed: [instance] 2025-11-26 15:51:15.507663 | controller | 2025-11-26 15:51:15.507692 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2025-11-26 15:51:15.507700 | controller | Wednesday 26 November 2025 15:51:14 +0000 (0:00:00.795) 0:02:13.560 **** 2025-11-26 15:51:15.507710 | controller | changed: [instance] => (item=compute-0.utility) 2025-11-26 15:51:35.220194 | controller | changed: [instance] => (item=controller-0.utility) 2025-11-26 15:51:35.220232 | controller | changed: [instance] => (item=crc-0.utility) 2025-11-26 15:51:35.220240 | controller | 2025-11-26 15:51:35.220246 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2025-11-26 15:51:35.220252 | controller | Wednesday 26 November 2025 15:51:15 +0000 (0:00:00.735) 0:02:14.295 **** 2025-11-26 15:51:35.220263 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-11-26 15:51:35.337333 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2025-11-26 15:51:35.337374 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2025-11-26 15:51:35.337382 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2025-11-26 15:51:35.337388 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2025-11-26 15:51:35.337394 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j295975507485.23978', 'results_file': '/home/zuul/.ansible_async/j295975507485.23978', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2025-11-26 15:51:35.337405 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j719221333128.23996', 'results_file': '/home/zuul/.ansible_async/j719221333128.23996', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2025-11-26 15:51:35.337411 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-11-26 15:51:35.337416 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j248241558475.24012', 'results_file': '/home/zuul/.ansible_async/j248241558475.24012', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2025-11-26 15:51:35.337422 | controller | 2025-11-26 15:51:35.337428 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2025-11-26 15:51:35.337433 | controller | Wednesday 26 November 2025 15:51:35 +0000 (0:00:19.711) 0:02:34.007 **** 2025-11-26 15:51:35.337446 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-11-26 15:51:35.337482 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-11-26 15:51:35.337489 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-11-26 15:51:35.337494 | controller | 2025-11-26 15:51:35.337500 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-11-26 15:51:35.337507 | controller | Wednesday 26 November 2025 15:51:35 +0000 (0:00:00.117) 0:02:34.125 **** 2025-11-26 15:51:35.360170 | controller | skipping: [instance] 2025-11-26 15:51:35.399354 | controller | 2025-11-26 15:51:35.399376 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2025-11-26 15:51:35.399383 | controller | Wednesday 26 November 2025 15:51:35 +0000 (0:00:00.023) 0:02:34.148 **** 2025-11-26 15:51:35.399392 | controller | 2025-11-26 15:51:35.481139 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-11-26 15:51:35.481158 | controller | Wednesday 26 November 2025 15:51:35 +0000 (0:00:00.039) 0:02:34.188 **** 2025-11-26 15:51:35.481173 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-11-26 15:51:35.698087 | controller | 2025-11-26 15:51:35.698116 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-11-26 15:51:35.698124 | controller | Wednesday 26 November 2025 15:51:35 +0000 (0:00:00.081) 0:02:34.269 **** 2025-11-26 15:51:35.698134 | controller | changed: [instance] 2025-11-26 15:51:35.917185 | controller | 2025-11-26 15:51:35.917215 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-11-26 15:51:35.917223 | controller | Wednesday 26 November 2025 15:51:35 +0000 (0:00:00.216) 0:02:34.486 **** 2025-11-26 15:51:35.917233 | controller | changed: [instance] 2025-11-26 15:51:36.333189 | controller | 2025-11-26 15:51:36.333222 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2025-11-26 15:51:36.333230 | controller | Wednesday 26 November 2025 15:51:35 +0000 (0:00:00.219) 0:02:34.705 **** 2025-11-26 15:51:36.333241 | controller | changed: [instance] 2025-11-26 15:51:36.361056 | controller | 2025-11-26 15:51:36.361074 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2025-11-26 15:51:36.361081 | controller | Wednesday 26 November 2025 15:51:36 +0000 (0:00:00.415) 0:02:35.121 **** 2025-11-26 15:51:36.361089 | controller | skipping: [instance] 2025-11-26 15:51:36.390887 | controller | 2025-11-26 15:51:36.390908 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-11-26 15:51:36.390915 | controller | Wednesday 26 November 2025 15:51:36 +0000 (0:00:00.028) 0:02:35.149 **** 2025-11-26 15:51:36.390924 | controller | skipping: [instance] 2025-11-26 15:51:36.440040 | controller | 2025-11-26 15:51:36.440060 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2025-11-26 15:51:36.440067 | controller | Wednesday 26 November 2025 15:51:36 +0000 (0:00:00.029) 0:02:35.179 **** 2025-11-26 15:51:36.440076 | controller | skipping: [instance] 2025-11-26 15:51:36.486353 | controller | 2025-11-26 15:51:36.486377 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2025-11-26 15:51:36.486385 | controller | Wednesday 26 November 2025 15:51:36 +0000 (0:00:00.049) 0:02:35.228 **** 2025-11-26 15:51:36.486394 | controller | skipping: [instance] 2025-11-26 15:51:36.510533 | controller | 2025-11-26 15:51:36.510553 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-11-26 15:51:36.510560 | controller | Wednesday 26 November 2025 15:51:36 +0000 (0:00:00.046) 0:02:35.274 **** 2025-11-26 15:51:36.510569 | controller | skipping: [instance] 2025-11-26 15:51:36.549185 | controller | 2025-11-26 15:51:36.549206 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2025-11-26 15:51:36.549213 | controller | Wednesday 26 November 2025 15:51:36 +0000 (0:00:00.024) 0:02:35.299 **** 2025-11-26 15:51:36.549222 | controller | 2025-11-26 15:51:36.640492 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-11-26 15:51:36.640519 | controller | Wednesday 26 November 2025 15:51:36 +0000 (0:00:00.038) 0:02:35.338 **** 2025-11-26 15:51:36.640531 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-11-26 15:51:36.874267 | controller | 2025-11-26 15:51:36.874298 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-11-26 15:51:36.874306 | controller | Wednesday 26 November 2025 15:51:36 +0000 (0:00:00.090) 0:02:35.428 **** 2025-11-26 15:51:36.874316 | controller | ok: [instance] 2025-11-26 15:51:37.097168 | controller | 2025-11-26 15:51:37.097197 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-11-26 15:51:37.097205 | controller | Wednesday 26 November 2025 15:51:36 +0000 (0:00:00.233) 0:02:35.662 **** 2025-11-26 15:51:37.097214 | controller | ok: [instance] 2025-11-26 15:51:37.494201 | controller | 2025-11-26 15:51:37.494232 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2025-11-26 15:51:37.494245 | controller | Wednesday 26 November 2025 15:51:37 +0000 (0:00:00.223) 0:02:35.885 **** 2025-11-26 15:51:37.494255 | controller | changed: [instance] 2025-11-26 15:51:37.522643 | controller | 2025-11-26 15:51:37.522666 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2025-11-26 15:51:37.522675 | controller | Wednesday 26 November 2025 15:51:37 +0000 (0:00:00.396) 0:02:36.282 **** 2025-11-26 15:51:37.522684 | controller | skipping: [instance] 2025-11-26 15:51:37.549877 | controller | 2025-11-26 15:51:37.549908 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-11-26 15:51:37.549917 | controller | Wednesday 26 November 2025 15:51:37 +0000 (0:00:00.028) 0:02:36.311 **** 2025-11-26 15:51:37.549928 | controller | skipping: [instance] 2025-11-26 15:51:39.123244 | controller | 2025-11-26 15:51:39.123281 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2025-11-26 15:51:39.123292 | controller | Wednesday 26 November 2025 15:51:37 +0000 (0:00:00.027) 0:02:36.338 **** 2025-11-26 15:51:39.123302 | controller | changed: [instance -> controller-0.instance] 2025-11-26 15:51:40.308176 | controller | 2025-11-26 15:51:40.308225 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2025-11-26 15:51:40.308233 | controller | Wednesday 26 November 2025 15:51:39 +0000 (0:00:01.572) 0:02:37.911 **** 2025-11-26 15:51:40.308244 | controller | changed: [instance -> controller-0.instance] 2025-11-26 15:51:40.356274 | controller | 2025-11-26 15:51:40.356298 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-11-26 15:51:40.356306 | controller | Wednesday 26 November 2025 15:51:40 +0000 (0:00:01.184) 0:02:39.096 **** 2025-11-26 15:51:40.356316 | controller | 2025-11-26 15:51:40.604864 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-11-26 15:51:40.604927 | controller | Wednesday 26 November 2025 15:51:40 +0000 (0:00:00.048) 0:02:39.144 **** 2025-11-26 15:51:40.604944 | controller | ok: [instance] 2025-11-26 15:51:40.605037 | controller | 2025-11-26 15:51:40.605092 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-11-26 15:51:40.634745 | controller | Wednesday 26 November 2025 15:51:40 +0000 (0:00:00.248) 0:02:39.393 **** 2025-11-26 15:51:40.634769 | controller | ok: [instance] 2025-11-26 15:51:40.678833 | controller | 2025-11-26 15:51:40.678851 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-11-26 15:51:40.678859 | controller | Wednesday 26 November 2025 15:51:40 +0000 (0:00:00.030) 0:02:39.423 **** 2025-11-26 15:51:40.678868 | controller | skipping: [instance] 2025-11-26 15:51:40.731703 | controller | 2025-11-26 15:51:40.731723 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2025-11-26 15:51:40.731731 | controller | Wednesday 26 November 2025 15:51:40 +0000 (0:00:00.044) 0:02:39.467 **** 2025-11-26 15:51:40.731740 | controller | 2025-11-26 15:51:40.829740 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-11-26 15:51:40.829759 | controller | Wednesday 26 November 2025 15:51:40 +0000 (0:00:00.052) 0:02:39.520 **** 2025-11-26 15:51:40.829771 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2025-11-26 15:51:41.065957 | controller | 2025-11-26 15:51:41.065989 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-11-26 15:51:41.065996 | controller | Wednesday 26 November 2025 15:51:40 +0000 (0:00:00.098) 0:02:39.618 **** 2025-11-26 15:51:41.066006 | controller | ok: [instance] 2025-11-26 15:51:41.287349 | controller | 2025-11-26 15:51:41.287380 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-11-26 15:51:41.287387 | controller | Wednesday 26 November 2025 15:51:41 +0000 (0:00:00.236) 0:02:39.854 **** 2025-11-26 15:51:41.287397 | controller | ok: [instance] 2025-11-26 15:51:41.679270 | controller | 2025-11-26 15:51:41.679307 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2025-11-26 15:51:41.679316 | controller | Wednesday 26 November 2025 15:51:41 +0000 (0:00:00.221) 0:02:40.075 **** 2025-11-26 15:51:41.679335 | controller | changed: [instance] 2025-11-26 15:51:41.679353 | controller | 2025-11-26 15:51:41.679359 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2025-11-26 15:51:41.679366 | controller | Wednesday 26 November 2025 15:51:41 +0000 (0:00:00.391) 0:02:40.467 **** 2025-11-26 15:51:42.598186 | controller | changed: [instance] 2025-11-26 15:51:42.598242 | controller | 2025-11-26 15:51:42.598341 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-11-26 15:51:42.598549 | controller | Wednesday 26 November 2025 15:51:42 +0000 (0:00:00.919) 0:02:41.386 **** 2025-11-26 15:51:42.627003 | controller | skipping: [instance] 2025-11-26 15:51:42.627059 | controller | 2025-11-26 15:51:42.627168 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2025-11-26 15:51:42.627262 | controller | Wednesday 26 November 2025 15:51:42 +0000 (0:00:00.029) 0:02:41.416 **** 2025-11-26 15:51:42.671874 | controller | skipping: [instance] 2025-11-26 15:51:42.671935 | controller | 2025-11-26 15:51:42.672046 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2025-11-26 15:51:42.672150 | controller | Wednesday 26 November 2025 15:51:42 +0000 (0:00:00.044) 0:02:41.460 **** 2025-11-26 15:51:42.717895 | controller | skipping: [instance] 2025-11-26 15:51:42.717975 | controller | 2025-11-26 15:51:42.718077 | controller | TASK [Create VBMC entity] ****************************************************** 2025-11-26 15:51:42.718171 | controller | Wednesday 26 November 2025 15:51:42 +0000 (0:00:00.045) 0:02:41.506 **** 2025-11-26 15:51:42.765172 | controller | skipping: [instance] => (item=compute-0) 2025-11-26 15:51:42.765262 | controller | skipping: [instance] => (item=controller-0) 2025-11-26 15:51:42.765361 | controller | skipping: [instance] => (item=crc-0) 2025-11-26 15:51:42.765464 | controller | skipping: [instance] 2025-11-26 15:51:42.765543 | controller | 2025-11-26 15:51:42.765688 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2025-11-26 15:51:42.765769 | controller | Wednesday 26 November 2025 15:51:42 +0000 (0:00:00.047) 0:02:41.554 **** 2025-11-26 15:51:43.003873 | controller | ok: [instance] 2025-11-26 15:51:43.003951 | controller | 2025-11-26 15:51:43.004057 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2025-11-26 15:51:43.004155 | controller | Wednesday 26 November 2025 15:51:43 +0000 (0:00:00.238) 0:02:41.792 **** 2025-11-26 15:51:43.401920 | controller | changed: [instance] 2025-11-26 15:51:43.401987 | controller | 2025-11-26 15:51:43.402057 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2025-11-26 15:51:43.402176 | controller | Wednesday 26 November 2025 15:51:43 +0000 (0:00:00.393) 0:02:42.186 **** 2025-11-26 15:51:43.437231 | controller | skipping: [instance] 2025-11-26 15:51:43.437316 | controller | 2025-11-26 15:51:43.437437 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2025-11-26 15:51:43.437550 | controller | Wednesday 26 November 2025 15:51:43 +0000 (0:00:00.039) 0:02:42.226 **** 2025-11-26 15:51:43.487527 | controller | skipping: [instance] 2025-11-26 15:51:43.487577 | controller | 2025-11-26 15:51:43.487729 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2025-11-26 15:51:43.487864 | controller | Wednesday 26 November 2025 15:51:43 +0000 (0:00:00.049) 0:02:42.276 **** 2025-11-26 15:51:43.530232 | controller | skipping: [instance] 2025-11-26 15:51:44.195433 | controller | 2025-11-26 15:51:44.195465 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2025-11-26 15:51:44.195473 | controller | Wednesday 26 November 2025 15:51:43 +0000 (0:00:00.042) 0:02:42.318 **** 2025-11-26 15:51:44.195483 | controller | changed: [instance] 2025-11-26 15:51:44.763166 | controller | 2025-11-26 15:51:44.763196 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2025-11-26 15:51:44.763205 | controller | Wednesday 26 November 2025 15:51:44 +0000 (0:00:00.665) 0:02:42.983 **** 2025-11-26 15:51:44.763215 | controller | changed: [instance] 2025-11-26 15:51:44.806047 | controller | 2025-11-26 15:51:44.806065 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2025-11-26 15:51:44.806072 | controller | Wednesday 26 November 2025 15:51:44 +0000 (0:00:00.567) 0:02:43.551 **** 2025-11-26 15:51:44.806081 | controller | skipping: [instance] 2025-11-26 15:51:44.870798 | controller | 2025-11-26 15:51:44.870840 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2025-11-26 15:51:44.870853 | controller | Wednesday 26 November 2025 15:51:44 +0000 (0:00:00.043) 0:02:43.594 **** 2025-11-26 15:51:44.870870 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2025-11-26 15:51:44.912410 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2025-11-26 15:51:44.912449 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2025-11-26 15:51:44.912458 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2025-11-26 15:51:44.912465 | controller | 2025-11-26 15:51:44.912472 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2025-11-26 15:51:44.912480 | controller | Wednesday 26 November 2025 15:51:44 +0000 (0:00:00.064) 0:02:43.659 **** 2025-11-26 15:51:44.912491 | controller | skipping: [instance] 2025-11-26 15:51:44.949755 | controller | 2025-11-26 15:51:44.949790 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2025-11-26 15:51:44.949800 | controller | Wednesday 26 November 2025 15:51:44 +0000 (0:00:00.041) 0:02:43.701 **** 2025-11-26 15:51:44.949812 | controller | skipping: [instance] 2025-11-26 15:51:44.949847 | controller | 2025-11-26 15:51:44.949857 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2025-11-26 15:51:44.949937 | controller | Wednesday 26 November 2025 15:51:44 +0000 (0:00:00.037) 0:02:43.738 **** 2025-11-26 15:51:44.985738 | controller | skipping: [instance] 2025-11-26 15:51:44.986149 | controller | 2025-11-26 15:51:45.023126 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2025-11-26 15:51:45.023162 | controller | Wednesday 26 November 2025 15:51:44 +0000 (0:00:00.036) 0:02:43.774 **** 2025-11-26 15:51:45.023180 | controller | skipping: [instance] 2025-11-26 15:51:45.023344 | controller | 2025-11-26 15:51:45.023502 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2025-11-26 15:51:45.023668 | controller | Wednesday 26 November 2025 15:51:45 +0000 (0:00:00.037) 0:02:43.812 **** 2025-11-26 15:51:45.643059 | controller | changed: [instance] 2025-11-26 15:51:45.680698 | controller | 2025-11-26 15:51:45.680746 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2025-11-26 15:51:45.680758 | controller | Wednesday 26 November 2025 15:51:45 +0000 (0:00:00.619) 0:02:44.431 **** 2025-11-26 15:51:45.680773 | controller | skipping: [instance] 2025-11-26 15:51:45.726196 | controller | 2025-11-26 15:51:45.726224 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2025-11-26 15:51:45.726240 | controller | Wednesday 26 November 2025 15:51:45 +0000 (0:00:00.037) 0:02:44.469 **** 2025-11-26 15:51:45.726252 | controller | skipping: [instance] 2025-11-26 15:51:45.764820 | controller | 2025-11-26 15:51:45.764930 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2025-11-26 15:51:45.764942 | controller | Wednesday 26 November 2025 15:51:45 +0000 (0:00:00.045) 0:02:44.514 **** 2025-11-26 15:51:45.764966 | controller | skipping: [instance] 2025-11-26 15:51:45.765033 | controller | 2025-11-26 15:51:45.765068 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-11-26 15:51:45.765078 | controller | Wednesday 26 November 2025 15:51:45 +0000 (0:00:00.038) 0:02:44.552 **** 2025-11-26 15:51:45.799156 | controller | skipping: [instance] 2025-11-26 15:51:45.833916 | controller | 2025-11-26 15:51:45.833956 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-11-26 15:51:45.833968 | controller | Wednesday 26 November 2025 15:51:45 +0000 (0:00:00.034) 0:02:44.587 **** 2025-11-26 15:51:45.833986 | controller | skipping: [instance] 2025-11-26 15:51:45.834015 | controller | 2025-11-26 15:51:45.834210 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-11-26 15:51:45.870018 | controller | Wednesday 26 November 2025 15:51:45 +0000 (0:00:00.034) 0:02:44.622 **** 2025-11-26 15:51:45.870039 | controller | skipping: [instance] 2025-11-26 15:51:45.905719 | controller | 2025-11-26 15:51:45.905751 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-11-26 15:51:45.905764 | controller | Wednesday 26 November 2025 15:51:45 +0000 (0:00:00.036) 0:02:44.658 **** 2025-11-26 15:51:45.905779 | controller | skipping: [instance] 2025-11-26 15:51:45.906063 | controller | 2025-11-26 15:51:45.906205 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-11-26 15:51:45.906331 | controller | Wednesday 26 November 2025 15:51:45 +0000 (0:00:00.035) 0:02:44.694 **** 2025-11-26 15:51:45.938321 | controller | skipping: [instance] 2025-11-26 15:51:45.938522 | controller | 2025-11-26 15:51:45.938735 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-11-26 15:51:45.938910 | controller | Wednesday 26 November 2025 15:51:45 +0000 (0:00:00.032) 0:02:44.727 **** 2025-11-26 15:51:45.970763 | controller | skipping: [instance] 2025-11-26 15:51:45.971040 | controller | 2025-11-26 15:51:45.971208 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-11-26 15:51:45.971332 | controller | Wednesday 26 November 2025 15:51:45 +0000 (0:00:00.032) 0:02:44.759 **** 2025-11-26 15:51:46.013903 | controller | skipping: [instance] 2025-11-26 15:51:46.014181 | controller | 2025-11-26 15:51:46.014321 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2025-11-26 15:51:46.014463 | controller | Wednesday 26 November 2025 15:51:46 +0000 (0:00:00.043) 0:02:44.802 **** 2025-11-26 15:51:46.044469 | controller | skipping: [instance] 2025-11-26 15:51:46.044808 | controller | 2025-11-26 15:51:46.045077 | controller | TASK [reproducer : Configure Controller node] ********************************** 2025-11-26 15:51:46.045263 | controller | Wednesday 26 November 2025 15:51:46 +0000 (0:00:00.030) 0:02:44.833 **** 2025-11-26 15:51:46.189766 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2025-11-26 15:51:46.189936 | controller | 2025-11-26 15:51:46.190095 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-11-26 15:51:46.190246 | controller | Wednesday 26 November 2025 15:51:46 +0000 (0:00:00.145) 0:02:44.978 **** 2025-11-26 15:51:47.407242 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-11-26 15:51:47.467147 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-11-26 15:51:47.467164 | controller | 2025-11-26 15:51:47.467171 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-11-26 15:51:47.467181 | controller | Wednesday 26 November 2025 15:51:47 +0000 (0:00:01.216) 0:02:46.195 **** 2025-11-26 15:51:47.467189 | controller | skipping: [instance] 2025-11-26 15:51:48.070652 | controller | 2025-11-26 15:51:48.070685 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-11-26 15:51:48.070693 | controller | Wednesday 26 November 2025 15:51:47 +0000 (0:00:00.060) 0:02:46.255 **** 2025-11-26 15:51:48.070703 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:51:48.104576 | controller | 2025-11-26 15:51:48.104613 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-11-26 15:51:48.104624 | controller | Wednesday 26 November 2025 15:51:48 +0000 (0:00:00.603) 0:02:46.858 **** 2025-11-26 15:51:48.104633 | controller | skipping: [instance] 2025-11-26 15:51:48.138510 | controller | 2025-11-26 15:51:48.138528 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-11-26 15:51:48.138536 | controller | Wednesday 26 November 2025 15:51:48 +0000 (0:00:00.034) 0:02:46.893 **** 2025-11-26 15:51:48.138544 | controller | skipping: [instance] 2025-11-26 15:51:48.173434 | controller | 2025-11-26 15:51:48.173478 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-11-26 15:51:48.173486 | controller | Wednesday 26 November 2025 15:51:48 +0000 (0:00:00.033) 0:02:46.927 **** 2025-11-26 15:51:48.173499 | controller | skipping: [instance] 2025-11-26 15:51:48.173528 | controller | 2025-11-26 15:51:48.173565 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-11-26 15:51:48.173720 | controller | Wednesday 26 November 2025 15:51:48 +0000 (0:00:00.035) 0:02:46.962 **** 2025-11-26 15:51:49.749116 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:51:49.785142 | controller | 2025-11-26 15:51:49.785170 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2025-11-26 15:51:49.785178 | controller | Wednesday 26 November 2025 15:51:49 +0000 (0:00:01.575) 0:02:48.537 **** 2025-11-26 15:51:49.785189 | controller | skipping: [instance] 2025-11-26 15:51:49.820482 | controller | 2025-11-26 15:51:49.820508 | controller | TASK [reproducer : Install repos] ********************************************** 2025-11-26 15:51:49.820516 | controller | Wednesday 26 November 2025 15:51:49 +0000 (0:00:00.036) 0:02:48.573 **** 2025-11-26 15:51:49.820526 | controller | skipping: [instance] 2025-11-26 15:51:49.855122 | controller | 2025-11-26 15:51:49.855145 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2025-11-26 15:51:49.855153 | controller | Wednesday 26 November 2025 15:51:49 +0000 (0:00:00.035) 0:02:48.609 **** 2025-11-26 15:51:49.855163 | controller | skipping: [instance] 2025-11-26 15:51:49.888079 | controller | 2025-11-26 15:51:49.888101 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2025-11-26 15:51:49.888109 | controller | Wednesday 26 November 2025 15:51:49 +0000 (0:00:00.034) 0:02:48.643 **** 2025-11-26 15:51:49.888118 | controller | skipping: [instance] 2025-11-26 15:51:50.997024 | controller | 2025-11-26 15:51:50.997063 | controller | TASK [reproducer : Install some tools] ***************************************** 2025-11-26 15:51:50.997072 | controller | Wednesday 26 November 2025 15:51:49 +0000 (0:00:00.033) 0:02:48.676 **** 2025-11-26 15:51:50.997083 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:51:50.997233 | controller | 2025-11-26 15:51:50.997246 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2025-11-26 15:51:50.997255 | controller | Wednesday 26 November 2025 15:51:50 +0000 (0:00:01.108) 0:02:49.785 **** 2025-11-26 15:51:52.102297 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:51:52.102357 | controller | 2025-11-26 15:51:52.102572 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2025-11-26 15:51:52.753216 | controller | Wednesday 26 November 2025 15:51:52 +0000 (0:00:01.105) 0:02:50.891 **** 2025-11-26 15:51:52.753255 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:51:53.707661 | controller | 2025-11-26 15:51:53.707687 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2025-11-26 15:51:53.707695 | controller | Wednesday 26 November 2025 15:51:52 +0000 (0:00:00.650) 0:02:51.541 **** 2025-11-26 15:51:53.707704 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:51:54.728803 | controller | 2025-11-26 15:51:54.728847 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2025-11-26 15:51:54.728856 | controller | Wednesday 26 November 2025 15:51:53 +0000 (0:00:00.954) 0:02:52.496 **** 2025-11-26 15:51:54.728868 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-11-26 15:51:54.729320 | controller | skipping: [instance] => (item=compute-0) 2025-11-26 15:51:55.372781 | controller | skipping: [instance] => (item=controller-0) 2025-11-26 15:51:55.372824 | controller | skipping: [instance] => (item=crc-0) 2025-11-26 15:51:55.372833 | controller | 2025-11-26 15:51:55.372841 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2025-11-26 15:51:55.372848 | controller | Wednesday 26 November 2025 15:51:54 +0000 (0:00:01.021) 0:02:53.517 **** 2025-11-26 15:51:55.372869 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-11-26 15:51:55.372901 | controller | skipping: [instance] => (item=compute-0) 2025-11-26 15:51:55.372909 | controller | skipping: [instance] => (item=controller-0) 2025-11-26 15:51:55.372917 | controller | skipping: [instance] => (item=crc-0) 2025-11-26 15:51:55.372943 | controller | 2025-11-26 15:51:55.373175 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2025-11-26 15:51:57.141529 | controller | Wednesday 26 November 2025 15:51:55 +0000 (0:00:00.643) 0:02:54.161 **** 2025-11-26 15:51:57.141566 | controller | skipping: [instance] => (item=instance) 2025-11-26 15:51:57.725399 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2025-11-26 15:51:57.725430 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-11-26 15:51:57.725437 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2025-11-26 15:51:57.725443 | controller | 2025-11-26 15:51:57.725448 | controller | TASK [reproducer : Create kube directory] ************************************** 2025-11-26 15:51:57.725454 | controller | Wednesday 26 November 2025 15:51:57 +0000 (0:00:01.768) 0:02:55.929 **** 2025-11-26 15:51:57.725464 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:51:58.716828 | controller | 2025-11-26 15:51:58.716860 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2025-11-26 15:51:58.716868 | controller | Wednesday 26 November 2025 15:51:57 +0000 (0:00:00.584) 0:02:56.513 **** 2025-11-26 15:51:58.716878 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:51:59.703716 | controller | 2025-11-26 15:51:59.703745 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2025-11-26 15:51:59.703753 | controller | Wednesday 26 November 2025 15:51:58 +0000 (0:00:00.990) 0:02:57.504 **** 2025-11-26 15:51:59.703762 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:51:59.746721 | controller | 2025-11-26 15:51:59.746738 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2025-11-26 15:51:59.746744 | controller | Wednesday 26 November 2025 15:51:59 +0000 (0:00:00.986) 0:02:58.491 **** 2025-11-26 15:51:59.746752 | controller | skipping: [instance] 2025-11-26 15:52:00.348135 | controller | 2025-11-26 15:52:00.348165 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2025-11-26 15:52:00.348174 | controller | Wednesday 26 November 2025 15:51:59 +0000 (0:00:00.043) 0:02:58.535 **** 2025-11-26 15:52:00.348184 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:52:00.966473 | controller | 2025-11-26 15:52:00.966505 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2025-11-26 15:52:00.966513 | controller | Wednesday 26 November 2025 15:52:00 +0000 (0:00:00.601) 0:02:59.136 **** 2025-11-26 15:52:00.966523 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:52:01.008076 | controller | 2025-11-26 15:52:01.008094 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2025-11-26 15:52:01.008102 | controller | Wednesday 26 November 2025 15:52:00 +0000 (0:00:00.618) 0:02:59.754 **** 2025-11-26 15:52:01.008111 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:52:01.075411 | controller | 2025-11-26 15:52:01.075435 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2025-11-26 15:52:01.075444 | controller | Wednesday 26 November 2025 15:52:01 +0000 (0:00:00.041) 0:02:59.796 **** 2025-11-26 15:52:01.075456 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2025-11-26 15:52:01.133025 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2025-11-26 15:52:01.133049 | controller | 2025-11-26 15:52:01.133057 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-11-26 15:52:01.133063 | controller | Wednesday 26 November 2025 15:52:01 +0000 (0:00:00.067) 0:02:59.863 **** 2025-11-26 15:52:01.133072 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-26 15:52:01.185658 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2025-11-26 15:52:01.185677 | controller | 2025-11-26 15:52:01.185684 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-11-26 15:52:01.185690 | controller | Wednesday 26 November 2025 15:52:01 +0000 (0:00:00.057) 0:02:59.921 **** 2025-11-26 15:52:01.185698 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-26 15:52:01.185958 | controller | _secret_file: '' 2025-11-26 15:52:01.185972 | controller | 2025-11-26 15:52:01.235478 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-11-26 15:52:01.235502 | controller | Wednesday 26 November 2025 15:52:01 +0000 (0:00:00.052) 0:02:59.974 **** 2025-11-26 15:52:01.235513 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-26 15:52:01.285137 | controller | _secret_content: my-default-location-place 2025-11-26 15:52:01.285156 | controller | 2025-11-26 15:52:01.285163 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-11-26 15:52:01.285169 | controller | Wednesday 26 November 2025 15:52:01 +0000 (0:00:00.049) 0:03:00.024 **** 2025-11-26 15:52:01.285177 | controller | skipping: [instance] 2025-11-26 15:52:01.333940 | controller | 2025-11-26 15:52:01.333962 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-11-26 15:52:01.333970 | controller | Wednesday 26 November 2025 15:52:01 +0000 (0:00:00.049) 0:03:00.073 **** 2025-11-26 15:52:01.333979 | controller | skipping: [instance] 2025-11-26 15:52:01.385047 | controller | 2025-11-26 15:52:01.385065 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-11-26 15:52:01.385072 | controller | Wednesday 26 November 2025 15:52:01 +0000 (0:00:00.048) 0:03:00.122 **** 2025-11-26 15:52:01.385086 | controller | skipping: [instance] 2025-11-26 15:52:02.355176 | controller | 2025-11-26 15:52:02.355206 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-11-26 15:52:02.355215 | controller | Wednesday 26 November 2025 15:52:01 +0000 (0:00:00.051) 0:03:00.173 **** 2025-11-26 15:52:02.355224 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:52:02.411658 | controller | 2025-11-26 15:52:02.411689 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-11-26 15:52:02.411701 | controller | Wednesday 26 November 2025 15:52:02 +0000 (0:00:00.969) 0:03:01.143 **** 2025-11-26 15:52:02.411716 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-26 15:52:02.458446 | controller | _secret_dest: /home/zuul/ipmi-things 2025-11-26 15:52:02.458465 | controller | 2025-11-26 15:52:02.458473 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-11-26 15:52:02.458478 | controller | Wednesday 26 November 2025 15:52:02 +0000 (0:00:00.056) 0:03:01.199 **** 2025-11-26 15:52:02.458487 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-26 15:52:02.505855 | controller | _secret_file: /tmp/ipmi-things 2025-11-26 15:52:02.505873 | controller | 2025-11-26 15:52:02.505881 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-11-26 15:52:02.505890 | controller | Wednesday 26 November 2025 15:52:02 +0000 (0:00:00.047) 0:03:01.246 **** 2025-11-26 15:52:02.505899 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-26 15:52:02.565529 | controller | _secret_content: '' 2025-11-26 15:52:02.565547 | controller | 2025-11-26 15:52:02.565561 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-11-26 15:52:02.565568 | controller | Wednesday 26 November 2025 15:52:02 +0000 (0:00:00.047) 0:03:01.294 **** 2025-11-26 15:52:02.565576 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2025-11-26 15:52:03.233460 | controller | msg: All assertions passed 2025-11-26 15:52:03.233492 | controller | 2025-11-26 15:52:03.233500 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-11-26 15:52:03.233507 | controller | Wednesday 26 November 2025 15:52:02 +0000 (0:00:00.059) 0:03:01.353 **** 2025-11-26 15:52:03.233516 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:52:04.274562 | controller | 2025-11-26 15:52:04.274595 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-11-26 15:52:04.274622 | controller | Wednesday 26 November 2025 15:52:03 +0000 (0:00:00.667) 0:03:02.021 **** 2025-11-26 15:52:04.274636 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:52:04.329797 | controller | 2025-11-26 15:52:04.329816 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-11-26 15:52:04.329823 | controller | Wednesday 26 November 2025 15:52:04 +0000 (0:00:01.041) 0:03:03.062 **** 2025-11-26 15:52:04.329832 | controller | skipping: [instance] 2025-11-26 15:52:04.907091 | controller | 2025-11-26 15:52:04.907153 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2025-11-26 15:52:04.907163 | controller | Wednesday 26 November 2025 15:52:04 +0000 (0:00:00.055) 0:03:03.118 **** 2025-11-26 15:52:04.907177 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:52:04.907199 | controller | 2025-11-26 15:52:04.907216 | controller | TASK [reproducer : Check if async file is still available] ********************* 2025-11-26 15:52:04.907236 | controller | Wednesday 26 November 2025 15:52:04 +0000 (0:00:00.577) 0:03:03.695 **** 2025-11-26 15:52:05.539017 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:52:55.965510 | controller | 2025-11-26 15:52:55.965682 | controller | TASK [reproducer : Check package install status] ******************************* 2025-11-26 15:52:55.965694 | controller | Wednesday 26 November 2025 15:52:05 +0000 (0:00:00.631) 0:03:04.327 **** 2025-11-26 15:52:55.965705 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2025-11-26 15:52:55.966379 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2025-11-26 15:52:55.966392 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2025-11-26 15:52:55.966398 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2025-11-26 15:52:55.966404 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2025-11-26 15:52:55.966409 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2025-11-26 15:52:55.966414 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2025-11-26 15:52:55.966422 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2025-11-26 15:52:56.707043 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). 2025-11-26 15:52:56.707080 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:52:56.707088 | controller | 2025-11-26 15:52:56.707094 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2025-11-26 15:52:56.707102 | controller | Wednesday 26 November 2025 15:52:55 +0000 (0:00:50.425) 0:03:54.752 **** 2025-11-26 15:52:56.707111 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:52:59.467358 | controller | 2025-11-26 15:52:59.467389 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2025-11-26 15:52:59.467396 | controller | Wednesday 26 November 2025 15:52:56 +0000 (0:00:00.735) 0:03:55.488 **** 2025-11-26 15:52:59.467407 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:52:59.527588 | controller | 2025-11-26 15:52:59.527625 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2025-11-26 15:52:59.527636 | controller | Wednesday 26 November 2025 15:52:59 +0000 (0:00:02.767) 0:03:58.255 **** 2025-11-26 15:52:59.527645 | controller | skipping: [instance] 2025-11-26 15:52:59.578000 | controller | 2025-11-26 15:52:59.578028 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2025-11-26 15:52:59.578036 | controller | Wednesday 26 November 2025 15:52:59 +0000 (0:00:00.060) 0:03:58.316 **** 2025-11-26 15:52:59.578046 | controller | skipping: [instance] 2025-11-26 15:53:00.320980 | controller | 2025-11-26 15:53:00.321011 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2025-11-26 15:53:00.321019 | controller | Wednesday 26 November 2025 15:52:59 +0000 (0:00:00.050) 0:03:58.366 **** 2025-11-26 15:53:00.321030 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:00.944383 | controller | 2025-11-26 15:53:00.944414 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2025-11-26 15:53:00.944422 | controller | Wednesday 26 November 2025 15:53:00 +0000 (0:00:00.742) 0:03:59.109 **** 2025-11-26 15:53:00.944433 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:01.276478 | controller | 2025-11-26 15:53:01.276510 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2025-11-26 15:53:01.276518 | controller | Wednesday 26 November 2025 15:53:00 +0000 (0:00:00.623) 0:03:59.732 **** 2025-11-26 15:53:01.276528 | controller | changed: [instance] 2025-11-26 15:53:01.909479 | controller | 2025-11-26 15:53:01.909509 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2025-11-26 15:53:01.909517 | controller | Wednesday 26 November 2025 15:53:01 +0000 (0:00:00.332) 0:04:00.064 **** 2025-11-26 15:53:01.909528 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:02.880510 | controller | 2025-11-26 15:53:02.880542 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2025-11-26 15:53:02.880551 | controller | Wednesday 26 November 2025 15:53:01 +0000 (0:00:00.632) 0:04:00.697 **** 2025-11-26 15:53:02.880561 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:02.923640 | controller | 2025-11-26 15:53:02.923659 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-11-26 15:53:02.923666 | controller | Wednesday 26 November 2025 15:53:02 +0000 (0:00:00.971) 0:04:01.669 **** 2025-11-26 15:53:02.923675 | controller | skipping: [instance] 2025-11-26 15:53:02.971812 | controller | 2025-11-26 15:53:02.971833 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-11-26 15:53:02.971841 | controller | Wednesday 26 November 2025 15:53:02 +0000 (0:00:00.043) 0:04:01.712 **** 2025-11-26 15:53:02.971851 | controller | skipping: [instance] 2025-11-26 15:53:03.006695 | controller | 2025-11-26 15:53:03.006716 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-11-26 15:53:03.006724 | controller | Wednesday 26 November 2025 15:53:02 +0000 (0:00:00.048) 0:04:01.760 **** 2025-11-26 15:53:03.006733 | controller | skipping: [instance] 2025-11-26 15:53:03.053439 | controller | 2025-11-26 15:53:03.053473 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2025-11-26 15:53:03.053482 | controller | Wednesday 26 November 2025 15:53:03 +0000 (0:00:00.035) 0:04:01.795 **** 2025-11-26 15:53:03.053492 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:03.089329 | controller | 2025-11-26 15:53:03.089352 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2025-11-26 15:53:03.089359 | controller | Wednesday 26 November 2025 15:53:03 +0000 (0:00:00.046) 0:04:01.842 **** 2025-11-26 15:53:03.089375 | controller | skipping: [instance] 2025-11-26 15:53:03.124141 | controller | 2025-11-26 15:53:03.124174 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2025-11-26 15:53:03.124182 | controller | Wednesday 26 November 2025 15:53:03 +0000 (0:00:00.036) 0:04:01.878 **** 2025-11-26 15:53:03.124190 | controller | skipping: [instance] 2025-11-26 15:53:03.162440 | controller | 2025-11-26 15:53:03.162462 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2025-11-26 15:53:03.162469 | controller | Wednesday 26 November 2025 15:53:03 +0000 (0:00:00.034) 0:04:01.912 **** 2025-11-26 15:53:03.162478 | controller | skipping: [instance] 2025-11-26 15:53:03.162630 | controller | 2025-11-26 15:53:03.162776 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2025-11-26 15:53:03.162923 | controller | Wednesday 26 November 2025 15:53:03 +0000 (0:00:00.038) 0:04:01.951 **** 2025-11-26 15:53:03.710840 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:03.814363 | controller | 2025-11-26 15:53:03.814396 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2025-11-26 15:53:03.814409 | controller | Wednesday 26 November 2025 15:53:03 +0000 (0:00:00.547) 0:04:02.499 **** 2025-11-26 15:53:03.814421 | controller | skipping: [instance] => (item=secret) 2025-11-26 15:53:04.858515 | controller | skipping: [instance] => (item=configmap) 2025-11-26 15:53:04.858550 | controller | skipping: [instance] => (item=pod) 2025-11-26 15:53:04.858558 | controller | skipping: [instance] => (item=service) 2025-11-26 15:53:04.858564 | controller | skipping: [instance] => (item=route) 2025-11-26 15:53:04.858569 | controller | skipping: [instance] 2025-11-26 15:53:04.858576 | controller | 2025-11-26 15:53:04.858581 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2025-11-26 15:53:04.858588 | controller | Wednesday 26 November 2025 15:53:03 +0000 (0:00:00.103) 0:04:02.602 **** 2025-11-26 15:53:04.858614 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:05.825578 | controller | 2025-11-26 15:53:05.825625 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2025-11-26 15:53:05.825637 | controller | Wednesday 26 November 2025 15:53:04 +0000 (0:00:01.044) 0:04:03.646 **** 2025-11-26 15:53:05.825648 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:05.865280 | controller | 2025-11-26 15:53:05.865305 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2025-11-26 15:53:05.865312 | controller | Wednesday 26 November 2025 15:53:05 +0000 (0:00:00.967) 0:04:04.613 **** 2025-11-26 15:53:05.865322 | controller | skipping: [instance] 2025-11-26 15:53:05.903408 | controller | 2025-11-26 15:53:05.903434 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2025-11-26 15:53:05.903443 | controller | Wednesday 26 November 2025 15:53:05 +0000 (0:00:00.039) 0:04:04.653 **** 2025-11-26 15:53:05.903454 | controller | skipping: [instance] 2025-11-26 15:53:05.977893 | controller | 2025-11-26 15:53:05.977918 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2025-11-26 15:53:05.977926 | controller | Wednesday 26 November 2025 15:53:05 +0000 (0:00:00.037) 0:04:04.691 **** 2025-11-26 15:53:05.977936 | controller | skipping: [instance] => (item=secret) 2025-11-26 15:53:06.015882 | controller | skipping: [instance] => (item=configmap) 2025-11-26 15:53:06.015912 | controller | skipping: [instance] => (item=service) 2025-11-26 15:53:06.015921 | controller | skipping: [instance] => (item=route) 2025-11-26 15:53:06.015928 | controller | skipping: [instance] 2025-11-26 15:53:06.015935 | controller | 2025-11-26 15:53:06.015942 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2025-11-26 15:53:06.015950 | controller | Wednesday 26 November 2025 15:53:05 +0000 (0:00:00.074) 0:04:04.765 **** 2025-11-26 15:53:06.015961 | controller | skipping: [instance] 2025-11-26 15:53:07.422481 | controller | 2025-11-26 15:53:07.422513 | controller | TASK [podman : Ensure podman is installed] ************************************* 2025-11-26 15:53:07.422522 | controller | Wednesday 26 November 2025 15:53:06 +0000 (0:00:00.038) 0:04:04.804 **** 2025-11-26 15:53:07.422532 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:08.165316 | controller | 2025-11-26 15:53:08.165348 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2025-11-26 15:53:08.165355 | controller | Wednesday 26 November 2025 15:53:07 +0000 (0:00:01.406) 0:04:06.210 **** 2025-11-26 15:53:08.165365 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:08.204157 | controller | 2025-11-26 15:53:08.204185 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2025-11-26 15:53:08.204193 | controller | Wednesday 26 November 2025 15:53:08 +0000 (0:00:00.742) 0:04:06.953 **** 2025-11-26 15:53:08.204202 | controller | skipping: [instance] 2025-11-26 15:53:08.238770 | controller | 2025-11-26 15:53:08.238797 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2025-11-26 15:53:08.238805 | controller | Wednesday 26 November 2025 15:53:08 +0000 (0:00:00.039) 0:04:06.992 **** 2025-11-26 15:53:08.238815 | controller | skipping: [instance] 2025-11-26 15:53:08.279245 | controller | 2025-11-26 15:53:08.279276 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2025-11-26 15:53:08.279285 | controller | Wednesday 26 November 2025 15:53:08 +0000 (0:00:00.034) 0:04:07.027 **** 2025-11-26 15:53:08.279297 | controller | skipping: [instance] 2025-11-26 15:53:18.833952 | controller | 2025-11-26 15:53:18.833994 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2025-11-26 15:53:18.834007 | controller | Wednesday 26 November 2025 15:53:08 +0000 (0:00:00.040) 0:04:07.067 **** 2025-11-26 15:53:18.834018 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:20.192660 | controller | 2025-11-26 15:53:20.192706 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2025-11-26 15:53:20.192714 | controller | Wednesday 26 November 2025 15:53:18 +0000 (0:00:10.553) 0:04:17.621 **** 2025-11-26 15:53:20.192727 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:20.192753 | controller | 2025-11-26 15:53:20.192783 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-11-26 15:53:20.192898 | controller | Wednesday 26 November 2025 15:53:20 +0000 (0:00:01.359) 0:04:18.981 **** 2025-11-26 15:53:21.322927 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-11-26 15:53:21.323317 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-11-26 15:53:21.361372 | controller | 2025-11-26 15:53:21.361401 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2025-11-26 15:53:21.361409 | controller | Wednesday 26 November 2025 15:53:21 +0000 (0:00:01.128) 0:04:20.109 **** 2025-11-26 15:53:21.361422 | controller | skipping: [instance] 2025-11-26 15:53:21.361677 | controller | 2025-11-26 15:53:21.926871 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2025-11-26 15:53:21.926922 | controller | Wednesday 26 November 2025 15:53:21 +0000 (0:00:00.040) 0:04:20.150 **** 2025-11-26 15:53:21.926940 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:21.963530 | controller | 2025-11-26 15:53:21.963552 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2025-11-26 15:53:21.963559 | controller | Wednesday 26 November 2025 15:53:21 +0000 (0:00:00.565) 0:04:20.715 **** 2025-11-26 15:53:21.963568 | controller | skipping: [instance] 2025-11-26 15:53:22.008173 | controller | 2025-11-26 15:53:22.008201 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2025-11-26 15:53:22.008211 | controller | Wednesday 26 November 2025 15:53:21 +0000 (0:00:00.036) 0:04:20.751 **** 2025-11-26 15:53:22.008223 | controller | skipping: [instance] 2025-11-26 15:53:22.051044 | controller | 2025-11-26 15:53:22.051076 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-11-26 15:53:22.051087 | controller | Wednesday 26 November 2025 15:53:22 +0000 (0:00:00.044) 0:04:20.796 **** 2025-11-26 15:53:22.051100 | controller | skipping: [instance] 2025-11-26 15:53:22.087063 | controller | 2025-11-26 15:53:22.087086 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-11-26 15:53:22.087100 | controller | Wednesday 26 November 2025 15:53:22 +0000 (0:00:00.042) 0:04:20.839 **** 2025-11-26 15:53:22.087110 | controller | skipping: [instance] 2025-11-26 15:53:22.213124 | controller | 2025-11-26 15:53:22.213162 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2025-11-26 15:53:22.213170 | controller | Wednesday 26 November 2025 15:53:22 +0000 (0:00:00.036) 0:04:20.875 **** 2025-11-26 15:53:22.213179 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': 'f9896d09-bf77-43a7-b653-14dcb368d66d'}) 2025-11-26 15:53:23.192791 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '6daac399-406f-4bbc-a14a-8f0ecd25c795'}) 2025-11-26 15:53:23.192825 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '86723b6f-610d-4dc1-bf64-5f190e192c97'}) 2025-11-26 15:53:23.192833 | controller | 2025-11-26 15:53:23.192839 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2025-11-26 15:53:23.192845 | controller | Wednesday 26 November 2025 15:53:22 +0000 (0:00:00.125) 0:04:21.001 **** 2025-11-26 15:53:23.192855 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:23.230006 | controller | 2025-11-26 15:53:23.230038 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2025-11-26 15:53:23.230047 | controller | Wednesday 26 November 2025 15:53:23 +0000 (0:00:00.979) 0:04:21.981 **** 2025-11-26 15:53:23.230057 | controller | skipping: [instance] 2025-11-26 15:53:23.364324 | controller | 2025-11-26 15:53:23.364350 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2025-11-26 15:53:23.364359 | controller | Wednesday 26 November 2025 15:53:23 +0000 (0:00:00.037) 0:04:22.018 **** 2025-11-26 15:53:23.364370 | controller | 2025-11-26 15:53:23.413693 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2025-11-26 15:53:23.413717 | controller | Wednesday 26 November 2025 15:53:23 +0000 (0:00:00.134) 0:04:22.153 **** 2025-11-26 15:53:23.413731 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:23.456939 | controller | 2025-11-26 15:53:23.456957 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-11-26 15:53:23.456965 | controller | Wednesday 26 November 2025 15:53:23 +0000 (0:00:00.049) 0:04:22.202 **** 2025-11-26 15:53:23.456973 | controller | skipping: [instance] 2025-11-26 15:53:23.493527 | controller | 2025-11-26 15:53:23.493545 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-11-26 15:53:23.493552 | controller | Wednesday 26 November 2025 15:53:23 +0000 (0:00:00.043) 0:04:22.245 **** 2025-11-26 15:53:23.493561 | controller | skipping: [instance] 2025-11-26 15:53:24.768336 | controller | 2025-11-26 15:53:24.769203 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2025-11-26 15:53:24.769213 | controller | Wednesday 26 November 2025 15:53:23 +0000 (0:00:00.036) 0:04:22.282 **** 2025-11-26 15:53:24.769225 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:24.769447 | controller | 2025-11-26 15:53:24.769462 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2025-11-26 15:53:29.336765 | controller | Wednesday 26 November 2025 15:53:24 +0000 (0:00:01.274) 0:04:23.556 **** 2025-11-26 15:53:29.336799 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=f9896d09-bf77-43a7-b653-14dcb368d66d) 2025-11-26 15:53:29.336949 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=6daac399-406f-4bbc-a14a-8f0ecd25c795) 2025-11-26 15:53:29.336960 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=86723b6f-610d-4dc1-bf64-5f190e192c97) 2025-11-26 15:53:29.336966 | controller | 2025-11-26 15:53:29.336972 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2025-11-26 15:53:29.336979 | controller | Wednesday 26 November 2025 15:53:29 +0000 (0:00:04.567) 0:04:28.124 **** 2025-11-26 15:53:29.438416 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2025-11-26 15:53:29.652347 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2025-11-26 15:53:29.652367 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2025-11-26 15:53:29.652375 | controller | 2025-11-26 15:53:29.652381 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2025-11-26 15:53:29.652386 | controller | Wednesday 26 November 2025 15:53:29 +0000 (0:00:00.102) 0:04:28.226 **** 2025-11-26 15:53:29.652395 | controller | ok: [instance -> localhost] 2025-11-26 15:53:31.739318 | controller | 2025-11-26 15:53:31.739348 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2025-11-26 15:53:31.739361 | controller | Wednesday 26 November 2025 15:53:29 +0000 (0:00:00.214) 0:04:28.440 **** 2025-11-26 15:53:31.739371 | controller | changed: [instance -> localhost] => (item=controller-0) 2025-11-26 15:53:32.331684 | controller | 2025-11-26 15:53:32.331713 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2025-11-26 15:53:32.331722 | controller | Wednesday 26 November 2025 15:53:31 +0000 (0:00:02.086) 0:04:30.527 **** 2025-11-26 15:53:32.331732 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:32.989209 | controller | 2025-11-26 15:53:32.989238 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2025-11-26 15:53:32.989246 | controller | Wednesday 26 November 2025 15:53:32 +0000 (0:00:00.592) 0:04:31.120 **** 2025-11-26 15:53:32.989257 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:33.999105 | controller | 2025-11-26 15:53:33.999144 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2025-11-26 15:53:33.999153 | controller | Wednesday 26 November 2025 15:53:32 +0000 (0:00:00.657) 0:04:31.777 **** 2025-11-26 15:53:33.999164 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:34.568693 | controller | 2025-11-26 15:53:34.568723 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2025-11-26 15:53:34.568731 | controller | Wednesday 26 November 2025 15:53:33 +0000 (0:00:01.009) 0:04:32.787 **** 2025-11-26 15:53:34.568741 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:34.568765 | controller | 2025-11-26 15:53:34.568773 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2025-11-26 15:53:34.568870 | controller | Wednesday 26 November 2025 15:53:34 +0000 (0:00:00.569) 0:04:33.357 **** 2025-11-26 15:53:35.659321 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:36.329813 | controller | 2025-11-26 15:53:36.329841 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2025-11-26 15:53:36.329850 | controller | Wednesday 26 November 2025 15:53:35 +0000 (0:00:01.090) 0:04:34.447 **** 2025-11-26 15:53:36.329860 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:36.992144 | controller | 2025-11-26 15:53:36.992176 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2025-11-26 15:53:36.992183 | controller | Wednesday 26 November 2025 15:53:36 +0000 (0:00:00.670) 0:04:35.118 **** 2025-11-26 15:53:36.992193 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:38.286081 | controller | 2025-11-26 15:53:38.286111 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2025-11-26 15:53:38.286119 | controller | Wednesday 26 November 2025 15:53:36 +0000 (0:00:00.662) 0:04:35.780 **** 2025-11-26 15:53:38.286128 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-11-26 15:53:38.320771 | controller | 2025-11-26 15:53:38.320793 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-11-26 15:53:38.320801 | controller | Wednesday 26 November 2025 15:53:38 +0000 (0:00:01.293) 0:04:37.074 **** 2025-11-26 15:53:38.320810 | controller | skipping: [instance] 2025-11-26 15:53:38.355324 | controller | 2025-11-26 15:53:38.355345 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-11-26 15:53:38.355357 | controller | Wednesday 26 November 2025 15:53:38 +0000 (0:00:00.034) 0:04:37.109 **** 2025-11-26 15:53:38.355367 | controller | skipping: [instance] 2025-11-26 15:53:38.390531 | controller | 2025-11-26 15:53:38.390553 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-11-26 15:53:38.390560 | controller | Wednesday 26 November 2025 15:53:38 +0000 (0:00:00.034) 0:04:37.144 **** 2025-11-26 15:53:38.390570 | controller | skipping: [instance] 2025-11-26 15:53:38.428775 | controller | 2025-11-26 15:53:38.428796 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-11-26 15:53:38.428804 | controller | Wednesday 26 November 2025 15:53:38 +0000 (0:00:00.035) 0:04:37.179 **** 2025-11-26 15:53:38.428814 | controller | skipping: [instance] 2025-11-26 15:53:38.465002 | controller | 2025-11-26 15:53:38.465020 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-11-26 15:53:38.465028 | controller | Wednesday 26 November 2025 15:53:38 +0000 (0:00:00.038) 0:04:37.217 **** 2025-11-26 15:53:38.465036 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:38.570331 | controller | 2025-11-26 15:53:38.570349 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-11-26 15:53:38.570357 | controller | Wednesday 26 November 2025 15:53:38 +0000 (0:00:00.036) 0:04:37.253 **** 2025-11-26 15:53:38.570368 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-11-26 15:53:38.617385 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2025-11-26 15:53:38.617404 | controller | 2025-11-26 15:53:38.617411 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-11-26 15:53:38.617417 | controller | Wednesday 26 November 2025 15:53:38 +0000 (0:00:00.104) 0:04:37.358 **** 2025-11-26 15:53:38.617431 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2025-11-26 15:53:41.888426 | controller | 2025-11-26 15:53:41.888459 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2025-11-26 15:53:41.888467 | controller | Wednesday 26 November 2025 15:53:38 +0000 (0:00:00.047) 0:04:37.405 **** 2025-11-26 15:53:41.888477 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-11-26 15:53:42.943870 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2025-11-26 15:53:42.943902 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-11-26 15:53:42.943910 | controller | 2025-11-26 15:53:42.943916 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2025-11-26 15:53:42.943922 | controller | Wednesday 26 November 2025 15:53:41 +0000 (0:00:03.270) 0:04:40.676 **** 2025-11-26 15:53:42.943931 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:43.428955 | controller | 2025-11-26 15:53:43.429006 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-11-26 15:53:43.429015 | controller | Wednesday 26 November 2025 15:53:42 +0000 (0:00:01.054) 0:04:41.731 **** 2025-11-26 15:53:43.429024 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:44.507672 | controller | 2025-11-26 15:53:44.507706 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-11-26 15:53:44.507713 | controller | Wednesday 26 November 2025 15:53:43 +0000 (0:00:00.483) 0:04:42.214 **** 2025-11-26 15:53:44.507722 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:44.593534 | controller | 2025-11-26 15:53:44.593561 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-11-26 15:53:44.593568 | controller | Wednesday 26 November 2025 15:53:44 +0000 (0:00:01.081) 0:04:43.295 **** 2025-11-26 15:53:44.593577 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:44.648428 | controller | 2025-11-26 15:53:44.648455 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-11-26 15:53:44.648463 | controller | Wednesday 26 November 2025 15:53:44 +0000 (0:00:00.085) 0:04:43.381 **** 2025-11-26 15:53:44.648472 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:45.633828 | controller | 2025-11-26 15:53:45.633859 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-11-26 15:53:45.633867 | controller | Wednesday 26 November 2025 15:53:44 +0000 (0:00:00.055) 0:04:43.436 **** 2025-11-26 15:53:45.633876 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:46.608109 | controller | 2025-11-26 15:53:46.608151 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2025-11-26 15:53:46.608160 | controller | Wednesday 26 November 2025 15:53:45 +0000 (0:00:00.984) 0:04:44.421 **** 2025-11-26 15:53:46.608170 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:52.673891 | controller | 2025-11-26 15:53:52.673923 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2025-11-26 15:53:52.673934 | controller | Wednesday 26 November 2025 15:53:46 +0000 (0:00:00.974) 0:04:45.396 **** 2025-11-26 15:53:52.673943 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2025-11-26 15:53:52.894247 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:52.894270 | controller | 2025-11-26 15:53:52.894278 | controller | TASK [Configure ntp service] *************************************************** 2025-11-26 15:53:52.894284 | controller | Wednesday 26 November 2025 15:53:52 +0000 (0:00:06.065) 0:04:51.461 **** 2025-11-26 15:53:52.894293 | controller | 2025-11-26 15:53:53.832777 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2025-11-26 15:53:53.832808 | controller | Wednesday 26 November 2025 15:53:52 +0000 (0:00:00.221) 0:04:51.682 **** 2025-11-26 15:53:53.832820 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:54.756386 | controller | 2025-11-26 15:53:54.756423 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2025-11-26 15:53:54.756431 | controller | Wednesday 26 November 2025 15:53:53 +0000 (0:00:00.938) 0:04:52.621 **** 2025-11-26 15:53:54.756441 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2025-11-26 15:53:55.666943 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2025-11-26 15:53:55.666978 | controller | 2025-11-26 15:53:55.666986 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2025-11-26 15:53:55.666992 | controller | Wednesday 26 November 2025 15:53:54 +0000 (0:00:00.923) 0:04:53.544 **** 2025-11-26 15:53:55.667002 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:56.363364 | controller | 2025-11-26 15:53:56.363399 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2025-11-26 15:53:56.363406 | controller | Wednesday 26 November 2025 15:53:55 +0000 (0:00:00.910) 0:04:54.455 **** 2025-11-26 15:53:56.363416 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:56.518863 | controller | 2025-11-26 15:53:56.518902 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2025-11-26 15:53:56.518910 | controller | Wednesday 26 November 2025 15:53:56 +0000 (0:00:00.696) 0:04:55.151 **** 2025-11-26 15:53:56.518921 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2025-11-26 15:53:57.007620 | controller | 2025-11-26 15:53:57.007653 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2025-11-26 15:53:57.007666 | controller | Wednesday 26 November 2025 15:53:56 +0000 (0:00:00.155) 0:04:55.306 **** 2025-11-26 15:53:57.007677 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:53:57.524258 | controller | 2025-11-26 15:53:57.524291 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2025-11-26 15:53:57.524299 | controller | Wednesday 26 November 2025 15:53:57 +0000 (0:00:00.489) 0:04:55.795 **** 2025-11-26 15:53:57.524308 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-11-26 15:53:58.221398 | controller | 2025-11-26 15:53:58.221432 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2025-11-26 15:53:58.221440 | controller | Wednesday 26 November 2025 15:53:57 +0000 (0:00:00.516) 0:04:56.312 **** 2025-11-26 15:53:58.221449 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-11-26 15:53:58.857449 | controller | 2025-11-26 15:53:58.857482 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2025-11-26 15:53:58.857490 | controller | Wednesday 26 November 2025 15:53:58 +0000 (0:00:00.696) 0:04:57.009 **** 2025-11-26 15:53:58.857499 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-11-26 15:53:58.914764 | controller | 2025-11-26 15:53:58.914793 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2025-11-26 15:53:58.914801 | controller | Wednesday 26 November 2025 15:53:58 +0000 (0:00:00.636) 0:04:57.645 **** 2025-11-26 15:53:58.914810 | controller | 2025-11-26 15:53:59.405452 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2025-11-26 15:53:59.405485 | controller | Wednesday 26 November 2025 15:53:58 +0000 (0:00:00.057) 0:04:57.703 **** 2025-11-26 15:53:59.405497 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-11-26 15:54:00.230552 | controller | 2025-11-26 15:54:00.230584 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2025-11-26 15:54:00.230592 | controller | Wednesday 26 November 2025 15:53:59 +0000 (0:00:00.489) 0:04:58.193 **** 2025-11-26 15:54:00.230619 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-11-26 15:54:00.270702 | controller | 2025-11-26 15:54:00.270725 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2025-11-26 15:54:00.270732 | controller | Wednesday 26 November 2025 15:54:00 +0000 (0:00:00.825) 0:04:59.018 **** 2025-11-26 15:54:00.270742 | controller | skipping: [instance] 2025-11-26 15:54:00.312702 | controller | 2025-11-26 15:54:00.312724 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2025-11-26 15:54:00.312731 | controller | Wednesday 26 November 2025 15:54:00 +0000 (0:00:00.040) 0:04:59.059 **** 2025-11-26 15:54:00.312740 | controller | skipping: [instance] 2025-11-26 15:54:00.576948 | controller | 2025-11-26 15:54:00.576981 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2025-11-26 15:54:00.576989 | controller | Wednesday 26 November 2025 15:54:00 +0000 (0:00:00.041) 0:04:59.100 **** 2025-11-26 15:54:00.577000 | controller | changed: [instance] 2025-11-26 15:54:00.656243 | controller | 2025-11-26 15:54:00.656274 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2025-11-26 15:54:00.656282 | controller | Wednesday 26 November 2025 15:54:00 +0000 (0:00:00.264) 0:04:59.364 **** 2025-11-26 15:54:00.656292 | controller | skipping: [instance] => (item=) 2025-11-26 15:54:00.696418 | controller | 2025-11-26 15:54:00.696442 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2025-11-26 15:54:00.696449 | controller | Wednesday 26 November 2025 15:54:00 +0000 (0:00:00.079) 0:04:59.444 **** 2025-11-26 15:54:00.696458 | controller | ok: [instance] 2025-11-26 15:54:00.774404 | controller | 2025-11-26 15:54:00.774432 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-11-26 15:54:00.774440 | controller | Wednesday 26 November 2025 15:54:00 +0000 (0:00:00.040) 0:04:59.484 **** 2025-11-26 15:54:00.774449 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-11-26 15:54:01.070574 | controller | 2025-11-26 15:54:01.070629 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-11-26 15:54:01.070640 | controller | Wednesday 26 November 2025 15:54:00 +0000 (0:00:00.077) 0:04:59.562 **** 2025-11-26 15:54:01.070651 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-11-26 15:54:01.118940 | controller | 2025-11-26 15:54:01.118962 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2025-11-26 15:54:01.118970 | controller | Wednesday 26 November 2025 15:54:01 +0000 (0:00:00.295) 0:04:59.858 **** 2025-11-26 15:54:01.118980 | controller | 2025-11-26 15:54:01.197260 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-11-26 15:54:01.197280 | controller | Wednesday 26 November 2025 15:54:01 +0000 (0:00:00.048) 0:04:59.907 **** 2025-11-26 15:54:01.197297 | controller | ok: [instance] 2025-11-26 15:54:01.259837 | controller | 2025-11-26 15:54:01.259858 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-11-26 15:54:01.259866 | controller | Wednesday 26 November 2025 15:54:01 +0000 (0:00:00.077) 0:04:59.985 **** 2025-11-26 15:54:01.259875 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-11-26 15:54:01.573739 | controller | 2025-11-26 15:54:01.573770 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-11-26 15:54:01.573778 | controller | Wednesday 26 November 2025 15:54:01 +0000 (0:00:00.062) 0:05:00.048 **** 2025-11-26 15:54:01.573789 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-11-26 15:54:02.040769 | controller | 2025-11-26 15:54:02.040800 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2025-11-26 15:54:02.040809 | controller | Wednesday 26 November 2025 15:54:01 +0000 (0:00:00.312) 0:05:00.361 **** 2025-11-26 15:54:02.040820 | controller | changed: [instance] 2025-11-26 15:54:02.723721 | controller | 2025-11-26 15:54:02.723755 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-11-26 15:54:02.723769 | controller | Wednesday 26 November 2025 15:54:02 +0000 (0:00:00.454) 0:05:00.815 **** 2025-11-26 15:54:02.723777 | controller | 2025-11-26 15:54:02.723782 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2025-11-26 15:54:02.723788 | controller | Wednesday 26 November 2025 15:54:02 +0000 (0:00:00.012) 0:05:00.828 **** 2025-11-26 15:54:02.723803 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:03.148918 | controller | 2025-11-26 15:54:03.148959 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-11-26 15:54:03.148968 | controller | Wednesday 26 November 2025 15:54:02 +0000 (0:00:00.683) 0:05:01.511 **** 2025-11-26 15:54:03.148982 | controller | changed: [instance] 2025-11-26 15:54:03.148989 | controller | 2025-11-26 15:54:03.148997 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2025-11-26 15:54:03.149231 | controller | Wednesday 26 November 2025 15:54:03 +0000 (0:00:00.425) 0:05:01.937 **** 2025-11-26 15:54:03.343653 | controller | skipping: [instance] => (item=controller-0) 2025-11-26 15:54:03.343777 | controller | skipping: [instance] => (item=crc-0) 2025-11-26 15:54:03.343971 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2025-11-26 15:54:03.344182 | controller | 2025-11-26 15:54:03.344198 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2025-11-26 15:54:03.344248 | controller | Wednesday 26 November 2025 15:54:03 +0000 (0:00:00.194) 0:05:02.132 **** 2025-11-26 15:54:04.809468 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-11-26 15:54:04.809531 | controller | 2025-11-26 15:54:04.809665 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-11-26 15:54:04.809779 | controller | Wednesday 26 November 2025 15:54:04 +0000 (0:00:01.465) 0:05:03.598 **** 2025-11-26 15:54:04.830721 | controller | skipping: [instance] 2025-11-26 15:54:04.830815 | controller | 2025-11-26 15:54:04.830921 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-11-26 15:54:04.831023 | controller | Wednesday 26 November 2025 15:54:04 +0000 (0:00:00.021) 0:05:03.619 **** 2025-11-26 15:54:05.329071 | controller | ok: [instance -> compute-0(compute-0.instance)] 2025-11-26 15:54:05.329148 | controller | 2025-11-26 15:54:05.329274 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-11-26 15:54:05.329388 | controller | Wednesday 26 November 2025 15:54:05 +0000 (0:00:00.498) 0:05:04.117 **** 2025-11-26 15:54:05.363631 | controller | skipping: [instance] 2025-11-26 15:54:05.363670 | controller | 2025-11-26 15:54:05.363818 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-11-26 15:54:05.363893 | controller | Wednesday 26 November 2025 15:54:05 +0000 (0:00:00.034) 0:05:04.152 **** 2025-11-26 15:54:05.402583 | controller | skipping: [instance] 2025-11-26 15:54:05.402701 | controller | 2025-11-26 15:54:05.402799 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-11-26 15:54:05.402918 | controller | Wednesday 26 November 2025 15:54:05 +0000 (0:00:00.038) 0:05:04.191 **** 2025-11-26 15:54:05.439249 | controller | skipping: [instance] 2025-11-26 15:54:05.439274 | controller | 2025-11-26 15:54:05.439394 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-11-26 15:54:05.439504 | controller | Wednesday 26 November 2025 15:54:05 +0000 (0:00:00.036) 0:05:04.228 **** 2025-11-26 15:54:06.885807 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-11-26 15:54:06.885854 | controller | 2025-11-26 15:54:06.885985 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2025-11-26 15:54:06.886149 | controller | Wednesday 26 November 2025 15:54:06 +0000 (0:00:01.446) 0:05:05.674 **** 2025-11-26 15:54:06.926036 | controller | skipping: [instance] 2025-11-26 15:54:06.926157 | controller | 2025-11-26 15:54:06.926287 | controller | TASK [reproducer : Create repositories on computes] **************************** 2025-11-26 15:54:06.926378 | controller | Wednesday 26 November 2025 15:54:06 +0000 (0:00:00.039) 0:05:05.713 **** 2025-11-26 15:54:06.948027 | controller | skipping: [instance] 2025-11-26 15:54:06.948115 | controller | 2025-11-26 15:54:06.948230 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2025-11-26 15:54:06.948330 | controller | Wednesday 26 November 2025 15:54:06 +0000 (0:00:00.022) 0:05:05.736 **** 2025-11-26 15:54:06.976885 | controller | skipping: [instance] 2025-11-26 15:54:06.976987 | controller | 2025-11-26 15:54:06.977102 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2025-11-26 15:54:06.977232 | controller | Wednesday 26 November 2025 15:54:06 +0000 (0:00:00.029) 0:05:05.765 **** 2025-11-26 15:54:07.094819 | controller | ok: [instance] 2025-11-26 15:54:07.094906 | controller | 2025-11-26 15:54:07.095022 | controller | TASK [reproducer : Push local code] ******************************************** 2025-11-26 15:54:07.095117 | controller | Wednesday 26 November 2025 15:54:07 +0000 (0:00:00.117) 0:05:05.883 **** 2025-11-26 15:54:07.195634 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2025-11-26 15:54:07.195728 | controller | 2025-11-26 15:54:07.195848 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2025-11-26 15:54:07.195954 | controller | Wednesday 26 November 2025 15:54:07 +0000 (0:00:00.100) 0:05:05.984 **** 2025-11-26 15:54:07.300838 | controller | skipping: [instance] 2025-11-26 15:54:07.300905 | controller | 2025-11-26 15:54:07.301033 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2025-11-26 15:54:07.301153 | controller | Wednesday 26 November 2025 15:54:07 +0000 (0:00:00.105) 0:05:06.089 **** 2025-11-26 15:54:07.339872 | controller | skipping: [instance] 2025-11-26 15:54:07.339923 | controller | 2025-11-26 15:54:07.340019 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2025-11-26 15:54:07.340128 | controller | Wednesday 26 November 2025 15:54:07 +0000 (0:00:00.039) 0:05:06.128 **** 2025-11-26 15:54:07.374989 | controller | skipping: [instance] 2025-11-26 15:54:07.375046 | controller | 2025-11-26 15:54:07.375170 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2025-11-26 15:54:07.375275 | controller | Wednesday 26 November 2025 15:54:07 +0000 (0:00:00.035) 0:05:06.163 **** 2025-11-26 15:54:07.411766 | controller | skipping: [instance] 2025-11-26 15:54:07.411847 | controller | 2025-11-26 15:54:07.411951 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2025-11-26 15:54:07.412048 | controller | Wednesday 26 November 2025 15:54:07 +0000 (0:00:00.037) 0:05:06.200 **** 2025-11-26 15:54:07.445962 | controller | skipping: [instance] 2025-11-26 15:54:07.446046 | controller | 2025-11-26 15:54:07.446155 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2025-11-26 15:54:07.446249 | controller | Wednesday 26 November 2025 15:54:07 +0000 (0:00:00.034) 0:05:06.235 **** 2025-11-26 15:54:07.912057 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2025-11-26 15:54:07.912131 | controller | 2025-11-26 15:54:07.912143 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2025-11-26 15:54:07.912153 | controller | Wednesday 26 November 2025 15:54:07 +0000 (0:00:00.465) 0:05:06.700 **** 2025-11-26 15:54:08.476471 | controller | ok: [instance -> localhost] => (item=ci-framework) 2025-11-26 15:54:08.476622 | controller | 2025-11-26 15:54:08.476693 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2025-11-26 15:54:08.476798 | controller | Wednesday 26 November 2025 15:54:08 +0000 (0:00:00.564) 0:05:07.265 **** 2025-11-26 15:54:08.518873 | controller | skipping: [instance] => (item=ci-framework) 2025-11-26 15:54:08.518977 | controller | skipping: [instance] 2025-11-26 15:54:08.519073 | controller | 2025-11-26 15:54:08.519186 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2025-11-26 15:54:08.519276 | controller | Wednesday 26 November 2025 15:54:08 +0000 (0:00:00.042) 0:05:07.307 **** 2025-11-26 15:54:08.596768 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2025-11-26 15:54:08.596892 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2025-11-26 15:54:08.597031 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2025-11-26 15:54:08.597143 | controller | 2025-11-26 15:54:08.597275 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2025-11-26 15:54:08.597385 | controller | Wednesday 26 November 2025 15:54:08 +0000 (0:00:00.077) 0:05:07.385 **** 2025-11-26 15:54:09.035584 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:09.035925 | controller | 2025-11-26 15:54:09.073357 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2025-11-26 15:54:09.073390 | controller | Wednesday 26 November 2025 15:54:09 +0000 (0:00:00.438) 0:05:07.824 **** 2025-11-26 15:54:09.073403 | controller | skipping: [instance] 2025-11-26 15:54:09.539371 | controller | 2025-11-26 15:54:09.539406 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2025-11-26 15:54:09.539417 | controller | Wednesday 26 November 2025 15:54:09 +0000 (0:00:00.037) 0:05:07.861 **** 2025-11-26 15:54:09.539429 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:09.576712 | controller | 2025-11-26 15:54:09.576734 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2025-11-26 15:54:09.576749 | controller | Wednesday 26 November 2025 15:54:09 +0000 (0:00:00.465) 0:05:08.327 **** 2025-11-26 15:54:09.576760 | controller | skipping: [instance] 2025-11-26 15:54:09.576940 | controller | 2025-11-26 15:54:09.577134 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2025-11-26 15:54:09.577317 | controller | Wednesday 26 November 2025 15:54:09 +0000 (0:00:00.038) 0:05:08.365 **** 2025-11-26 15:54:10.020761 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:10.020996 | controller | 2025-11-26 15:54:10.021031 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2025-11-26 15:54:12.172164 | controller | Wednesday 26 November 2025 15:54:10 +0000 (0:00:00.443) 0:05:08.809 **** 2025-11-26 15:54:12.172204 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:31.727594 | controller | 2025-11-26 15:54:31.727649 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2025-11-26 15:54:31.727657 | controller | Wednesday 26 November 2025 15:54:12 +0000 (0:00:02.150) 0:05:10.960 **** 2025-11-26 15:54:31.727667 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:31.727858 | controller | 2025-11-26 15:54:31.727894 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2025-11-26 15:54:32.798704 | controller | Wednesday 26 November 2025 15:54:31 +0000 (0:00:19.555) 0:05:30.515 **** 2025-11-26 15:54:32.798742 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:32.898298 | controller | 2025-11-26 15:54:32.898324 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2025-11-26 15:54:32.898331 | controller | Wednesday 26 November 2025 15:54:32 +0000 (0:00:01.071) 0:05:31.587 **** 2025-11-26 15:54:32.898341 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2025-11-26 15:54:33.383162 | controller | 2025-11-26 15:54:33.383208 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2025-11-26 15:54:33.383218 | controller | Wednesday 26 November 2025 15:54:32 +0000 (0:00:00.099) 0:05:31.686 **** 2025-11-26 15:54:33.383229 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:33.383248 | controller | 2025-11-26 15:54:33.383494 | controller | TASK [reproducer : Rotate log if present] ************************************** 2025-11-26 15:54:33.418656 | controller | Wednesday 26 November 2025 15:54:33 +0000 (0:00:00.484) 0:05:32.171 **** 2025-11-26 15:54:33.418691 | controller | skipping: [instance] 2025-11-26 15:54:33.461003 | controller | 2025-11-26 15:54:33.461036 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2025-11-26 15:54:33.461044 | controller | Wednesday 26 November 2025 15:54:33 +0000 (0:00:00.035) 0:05:32.206 **** 2025-11-26 15:54:33.461054 | controller | skipping: [instance] 2025-11-26 15:54:33.461078 | controller | 2025-11-26 15:54:33.461098 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2025-11-26 15:54:33.461113 | controller | Wednesday 26 November 2025 15:54:33 +0000 (0:00:00.042) 0:05:32.249 **** 2025-11-26 15:54:33.552709 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:33.552768 | controller | 2025-11-26 15:54:33.552978 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-11-26 15:54:34.049826 | controller | Wednesday 26 November 2025 15:54:33 +0000 (0:00:00.091) 0:05:32.341 **** 2025-11-26 15:54:34.049869 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:34.088585 | controller | 2025-11-26 15:54:34.088646 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-11-26 15:54:34.088656 | controller | Wednesday 26 November 2025 15:54:34 +0000 (0:00:00.496) 0:05:32.838 **** 2025-11-26 15:54:34.088666 | controller | skipping: [instance] 2025-11-26 15:54:34.128094 | controller | 2025-11-26 15:54:34.128127 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-11-26 15:54:34.128135 | controller | Wednesday 26 November 2025 15:54:34 +0000 (0:00:00.038) 0:05:32.877 **** 2025-11-26 15:54:34.128145 | controller | skipping: [instance] 2025-11-26 15:54:34.167801 | controller | 2025-11-26 15:54:34.167889 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-11-26 15:54:34.167898 | controller | Wednesday 26 November 2025 15:54:34 +0000 (0:00:00.039) 0:05:32.916 **** 2025-11-26 15:54:34.167916 | controller | skipping: [instance] 2025-11-26 15:54:34.167939 | controller | 2025-11-26 15:54:34.167948 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-11-26 15:54:34.168089 | controller | Wednesday 26 November 2025 15:54:34 +0000 (0:00:00.039) 0:05:32.956 **** 2025-11-26 15:54:35.773750 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:35.773873 | controller | 2025-11-26 15:54:35.774022 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-11-26 15:54:35.774174 | controller | Wednesday 26 November 2025 15:54:35 +0000 (0:00:01.605) 0:05:34.562 **** 2025-11-26 15:54:37.172553 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 15:54:37.172717 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 15:54:37.173013 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 15:54:37.173066 | controller | changed: [instance -> controller-0] 2025-11-26 15:54:37.173074 | controller | 2025-11-26 15:54:37.173092 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-11-26 15:54:37.173246 | controller | Wednesday 26 November 2025 15:54:37 +0000 (0:00:01.398) 0:05:35.961 **** 2025-11-26 15:54:38.068374 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:38.068585 | controller | 2025-11-26 15:54:38.068664 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-11-26 15:54:38.068676 | controller | Wednesday 26 November 2025 15:54:38 +0000 (0:00:00.895) 0:05:36.857 **** 2025-11-26 15:54:39.315346 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:47.136861 | controller | 2025-11-26 15:54:47.136906 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-11-26 15:54:47.136914 | controller | Wednesday 26 November 2025 15:54:39 +0000 (0:00:01.246) 0:05:38.103 **** 2025-11-26 15:54:47.136925 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:48.093762 | controller | 2025-11-26 15:54:48.093796 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-11-26 15:54:48.093804 | controller | Wednesday 26 November 2025 15:54:47 +0000 (0:00:07.821) 0:05:45.924 **** 2025-11-26 15:54:48.093813 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:48.141535 | controller | 2025-11-26 15:54:48.141562 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-11-26 15:54:48.141570 | controller | Wednesday 26 November 2025 15:54:48 +0000 (0:00:00.956) 0:05:46.881 **** 2025-11-26 15:54:48.141580 | controller | skipping: [instance] 2025-11-26 15:54:49.339109 | controller | 2025-11-26 15:54:49.339146 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-11-26 15:54:49.339155 | controller | Wednesday 26 November 2025 15:54:48 +0000 (0:00:00.048) 0:05:46.929 **** 2025-11-26 15:54:49.339165 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:49.395448 | controller | 2025-11-26 15:54:49.395478 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-11-26 15:54:49.395486 | controller | Wednesday 26 November 2025 15:54:49 +0000 (0:00:01.197) 0:05:48.127 **** 2025-11-26 15:54:49.395495 | controller | skipping: [instance] 2025-11-26 15:54:49.463867 | controller | 2025-11-26 15:54:49.463930 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-11-26 15:54:49.463940 | controller | Wednesday 26 November 2025 15:54:49 +0000 (0:00:00.056) 0:05:48.183 **** 2025-11-26 15:54:49.463972 | controller | skipping: [instance] 2025-11-26 15:54:49.532080 | controller | 2025-11-26 15:54:49.532135 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-11-26 15:54:49.532144 | controller | Wednesday 26 November 2025 15:54:49 +0000 (0:00:00.067) 0:05:48.251 **** 2025-11-26 15:54:49.532158 | controller | skipping: [instance] 2025-11-26 15:54:50.394712 | controller | 2025-11-26 15:54:50.394778 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-11-26 15:54:50.394786 | controller | Wednesday 26 November 2025 15:54:49 +0000 (0:00:00.067) 0:05:48.319 **** 2025-11-26 15:54:50.394800 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:51.330839 | controller | 2025-11-26 15:54:51.330903 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-11-26 15:54:51.330913 | controller | Wednesday 26 November 2025 15:54:50 +0000 (0:00:00.863) 0:05:49.182 **** 2025-11-26 15:54:51.330926 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:51.380483 | controller | 2025-11-26 15:54:51.380524 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-11-26 15:54:51.380533 | controller | Wednesday 26 November 2025 15:54:51 +0000 (0:00:00.936) 0:05:50.118 **** 2025-11-26 15:54:51.380546 | controller | skipping: [instance] 2025-11-26 15:54:51.380720 | controller | 2025-11-26 15:54:51.380734 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-11-26 15:54:51.380744 | controller | Wednesday 26 November 2025 15:54:51 +0000 (0:00:00.045) 0:05:50.164 **** 2025-11-26 15:54:51.421476 | controller | skipping: [instance] 2025-11-26 15:54:51.468902 | controller | 2025-11-26 15:54:51.468929 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-11-26 15:54:51.468937 | controller | Wednesday 26 November 2025 15:54:51 +0000 (0:00:00.045) 0:05:50.209 **** 2025-11-26 15:54:51.468950 | controller | skipping: [instance] 2025-11-26 15:54:51.532284 | controller | 2025-11-26 15:54:51.532328 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-11-26 15:54:51.532337 | controller | Wednesday 26 November 2025 15:54:51 +0000 (0:00:00.046) 0:05:50.256 **** 2025-11-26 15:54:51.532349 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:51.576129 | controller | 2025-11-26 15:54:51.576168 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-11-26 15:54:51.576185 | controller | Wednesday 26 November 2025 15:54:51 +0000 (0:00:00.063) 0:05:50.320 **** 2025-11-26 15:54:51.576196 | controller | skipping: [instance] 2025-11-26 15:54:51.621440 | controller | 2025-11-26 15:54:51.621467 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-11-26 15:54:51.621476 | controller | Wednesday 26 November 2025 15:54:51 +0000 (0:00:00.043) 0:05:50.364 **** 2025-11-26 15:54:51.621487 | controller | skipping: [instance] 2025-11-26 15:54:51.678934 | controller | 2025-11-26 15:54:51.678991 | controller | TASK [Download the RPM] ******************************************************** 2025-11-26 15:54:51.679001 | controller | Wednesday 26 November 2025 15:54:51 +0000 (0:00:00.045) 0:05:50.409 **** 2025-11-26 15:54:51.679013 | controller | skipping: [instance] 2025-11-26 15:54:51.728681 | controller | 2025-11-26 15:54:51.728720 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-11-26 15:54:51.728742 | controller | Wednesday 26 November 2025 15:54:51 +0000 (0:00:00.056) 0:05:50.466 **** 2025-11-26 15:54:51.728754 | controller | skipping: [instance] 2025-11-26 15:54:51.780941 | controller | 2025-11-26 15:54:51.781028 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-11-26 15:54:51.781040 | controller | Wednesday 26 November 2025 15:54:51 +0000 (0:00:00.050) 0:05:50.516 **** 2025-11-26 15:54:51.781056 | controller | skipping: [instance] 2025-11-26 15:54:51.831197 | controller | 2025-11-26 15:54:51.831269 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-11-26 15:54:51.831280 | controller | Wednesday 26 November 2025 15:54:51 +0000 (0:00:00.051) 0:05:50.568 **** 2025-11-26 15:54:51.831295 | controller | skipping: [instance] 2025-11-26 15:54:51.880057 | controller | 2025-11-26 15:54:51.880124 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-11-26 15:54:51.880134 | controller | Wednesday 26 November 2025 15:54:51 +0000 (0:00:00.049) 0:05:50.618 **** 2025-11-26 15:54:51.880149 | controller | skipping: [instance] 2025-11-26 15:54:52.397903 | controller | 2025-11-26 15:54:52.397955 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-11-26 15:54:52.397964 | controller | Wednesday 26 November 2025 15:54:51 +0000 (0:00:00.049) 0:05:50.667 **** 2025-11-26 15:54:52.397975 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:52.398088 | controller | 2025-11-26 15:54:52.398106 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-11-26 15:54:52.466823 | controller | Wednesday 26 November 2025 15:54:52 +0000 (0:00:00.517) 0:05:51.185 **** 2025-11-26 15:54:52.466901 | controller | skipping: [instance] 2025-11-26 15:54:52.526020 | controller | 2025-11-26 15:54:52.526078 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-11-26 15:54:52.526089 | controller | Wednesday 26 November 2025 15:54:52 +0000 (0:00:00.068) 0:05:51.254 **** 2025-11-26 15:54:52.526102 | controller | skipping: [instance] 2025-11-26 15:54:52.569550 | controller | 2025-11-26 15:54:52.569591 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-11-26 15:54:52.569620 | controller | Wednesday 26 November 2025 15:54:52 +0000 (0:00:00.059) 0:05:51.314 **** 2025-11-26 15:54:52.569637 | controller | skipping: [instance] 2025-11-26 15:54:52.640338 | controller | 2025-11-26 15:54:52.640383 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-11-26 15:54:52.640391 | controller | Wednesday 26 November 2025 15:54:52 +0000 (0:00:00.043) 0:05:51.357 **** 2025-11-26 15:54:52.640411 | controller | skipping: [instance] 2025-11-26 15:54:52.640418 | controller | 2025-11-26 15:54:52.640424 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-11-26 15:54:52.640432 | controller | Wednesday 26 November 2025 15:54:52 +0000 (0:00:00.070) 0:05:51.428 **** 2025-11-26 15:54:52.700985 | controller | skipping: [instance] 2025-11-26 15:54:52.773337 | controller | 2025-11-26 15:54:52.773382 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-11-26 15:54:52.773391 | controller | Wednesday 26 November 2025 15:54:52 +0000 (0:00:00.059) 0:05:51.488 **** 2025-11-26 15:54:52.773409 | controller | skipping: [instance] 2025-11-26 15:54:52.773432 | controller | 2025-11-26 15:54:52.773439 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-11-26 15:54:52.773446 | controller | Wednesday 26 November 2025 15:54:52 +0000 (0:00:00.073) 0:05:51.561 **** 2025-11-26 15:54:52.835742 | controller | skipping: [instance] 2025-11-26 15:54:52.835961 | controller | 2025-11-26 15:54:52.835998 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-11-26 15:54:52.939941 | controller | Wednesday 26 November 2025 15:54:52 +0000 (0:00:00.063) 0:05:51.624 **** 2025-11-26 15:54:52.939988 | controller | skipping: [instance] 2025-11-26 15:54:53.513088 | controller | 2025-11-26 15:54:53.513133 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-11-26 15:54:53.513141 | controller | Wednesday 26 November 2025 15:54:52 +0000 (0:00:00.104) 0:05:51.728 **** 2025-11-26 15:54:53.513160 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:54.541222 | controller | 2025-11-26 15:54:54.541289 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-11-26 15:54:54.541299 | controller | Wednesday 26 November 2025 15:54:53 +0000 (0:00:00.572) 0:05:52.300 **** 2025-11-26 15:54:54.541324 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 15:54:55.242954 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 15:54:55.243017 | controller | changed: [instance -> controller-0] 2025-11-26 15:54:55.243026 | controller | 2025-11-26 15:54:55.243035 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-11-26 15:54:55.243040 | controller | Wednesday 26 November 2025 15:54:54 +0000 (0:00:01.027) 0:05:53.328 **** 2025-11-26 15:54:55.243053 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:55.789249 | controller | 2025-11-26 15:54:55.789314 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-11-26 15:54:55.789323 | controller | Wednesday 26 November 2025 15:54:55 +0000 (0:00:00.702) 0:05:54.030 **** 2025-11-26 15:54:55.789337 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:54:55.851325 | controller | 2025-11-26 15:54:55.851396 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-11-26 15:54:55.851407 | controller | Wednesday 26 November 2025 15:54:55 +0000 (0:00:00.546) 0:05:54.576 **** 2025-11-26 15:54:55.851425 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 15:54:55.893923 | controller | ok: [instance -> controller-0] 2025-11-26 15:54:55.893988 | controller | 2025-11-26 15:54:55.893998 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-11-26 15:54:55.894005 | controller | Wednesday 26 November 2025 15:54:55 +0000 (0:00:00.061) 0:05:54.638 **** 2025-11-26 15:54:55.894019 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:25.662515 | controller | 2025-11-26 15:55:25.662612 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-11-26 15:55:25.662628 | controller | Wednesday 26 November 2025 15:54:55 +0000 (0:00:00.043) 0:05:54.681 **** 2025-11-26 15:55:25.662653 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:26.198649 | controller | 2025-11-26 15:55:26.198711 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-11-26 15:55:26.198720 | controller | Wednesday 26 November 2025 15:55:25 +0000 (0:00:29.766) 0:06:24.448 **** 2025-11-26 15:55:26.198734 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:26.723765 | controller | 2025-11-26 15:55:26.723810 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-11-26 15:55:26.723818 | controller | Wednesday 26 November 2025 15:55:26 +0000 (0:00:00.537) 0:06:24.986 **** 2025-11-26 15:55:26.723831 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:26.724074 | controller | 2025-11-26 15:55:26.724138 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-11-26 15:55:32.793778 | controller | Wednesday 26 November 2025 15:55:26 +0000 (0:00:00.525) 0:06:25.511 **** 2025-11-26 15:55:32.793849 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:32.848108 | controller | 2025-11-26 15:55:32.848183 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-11-26 15:55:32.848193 | controller | Wednesday 26 November 2025 15:55:32 +0000 (0:00:06.069) 0:06:31.581 **** 2025-11-26 15:55:32.848207 | controller | skipping: [instance] 2025-11-26 15:55:33.499523 | controller | 2025-11-26 15:55:33.499589 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-11-26 15:55:33.499627 | controller | Wednesday 26 November 2025 15:55:32 +0000 (0:00:00.054) 0:06:31.635 **** 2025-11-26 15:55:33.499644 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:34.000320 | controller | 2025-11-26 15:55:34.000389 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-11-26 15:55:34.000412 | controller | Wednesday 26 November 2025 15:55:33 +0000 (0:00:00.651) 0:06:32.286 **** 2025-11-26 15:55:34.000430 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:34.000454 | controller | 2025-11-26 15:55:34.000460 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-11-26 15:55:34.000467 | controller | Wednesday 26 November 2025 15:55:33 +0000 (0:00:00.501) 0:06:32.788 **** 2025-11-26 15:55:34.041713 | controller | skipping: [instance] 2025-11-26 15:55:34.041768 | controller | 2025-11-26 15:55:34.042036 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-11-26 15:55:34.084094 | controller | Wednesday 26 November 2025 15:55:34 +0000 (0:00:00.042) 0:06:32.830 **** 2025-11-26 15:55:34.084122 | controller | skipping: [instance] 2025-11-26 15:55:34.132784 | controller | 2025-11-26 15:55:34.132849 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-11-26 15:55:34.132859 | controller | Wednesday 26 November 2025 15:55:34 +0000 (0:00:00.041) 0:06:32.872 **** 2025-11-26 15:55:34.132873 | controller | skipping: [instance] 2025-11-26 15:55:34.132897 | controller | 2025-11-26 15:55:34.132907 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-11-26 15:55:34.179355 | controller | Wednesday 26 November 2025 15:55:34 +0000 (0:00:00.049) 0:06:32.921 **** 2025-11-26 15:55:34.179393 | controller | skipping: [instance] 2025-11-26 15:55:34.179423 | controller | 2025-11-26 15:55:34.179543 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-11-26 15:55:34.179685 | controller | Wednesday 26 November 2025 15:55:34 +0000 (0:00:00.046) 0:06:32.967 **** 2025-11-26 15:55:34.227293 | controller | skipping: [instance] 2025-11-26 15:55:34.227376 | controller | 2025-11-26 15:55:34.227487 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-11-26 15:55:34.227616 | controller | Wednesday 26 November 2025 15:55:34 +0000 (0:00:00.048) 0:06:33.016 **** 2025-11-26 15:55:34.276740 | controller | skipping: [instance] 2025-11-26 15:55:36.954105 | controller | 2025-11-26 15:55:36.954190 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-11-26 15:55:36.954200 | controller | Wednesday 26 November 2025 15:55:34 +0000 (0:00:00.048) 0:06:33.064 **** 2025-11-26 15:55:36.954219 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 15:55:36.954315 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 15:55:36.954335 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 15:55:36.954342 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 15:55:36.954348 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 15:55:36.954353 | controller | changed: [instance -> controller-0] 2025-11-26 15:55:36.954359 | controller | 2025-11-26 15:55:36.954364 | controller | TASK [Prepare install_yamls make targets] ************************************** 2025-11-26 15:55:36.954374 | controller | Wednesday 26 November 2025 15:55:36 +0000 (0:00:02.677) 0:06:35.742 **** 2025-11-26 15:55:37.102261 | controller | 2025-11-26 15:55:37.102350 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2025-11-26 15:55:37.102474 | controller | Wednesday 26 November 2025 15:55:37 +0000 (0:00:00.148) 0:06:35.891 **** 2025-11-26 15:55:38.589053 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 15:55:38.589137 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 15:55:38.589267 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 15:55:38.589291 | controller | changed: [instance -> controller-0] 2025-11-26 15:55:38.589349 | controller | 2025-11-26 15:55:38.589444 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2025-11-26 15:55:38.589543 | controller | Wednesday 26 November 2025 15:55:38 +0000 (0:00:01.486) 0:06:37.377 **** 2025-11-26 15:55:38.649558 | controller | 2025-11-26 15:55:38.649721 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2025-11-26 15:55:38.649845 | controller | Wednesday 26 November 2025 15:55:38 +0000 (0:00:00.060) 0:06:37.438 **** 2025-11-26 15:55:38.689145 | controller | skipping: [instance] 2025-11-26 15:55:38.689221 | controller | 2025-11-26 15:55:38.689316 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2025-11-26 15:55:38.689405 | controller | Wednesday 26 November 2025 15:55:38 +0000 (0:00:00.039) 0:06:37.478 **** 2025-11-26 15:55:38.735303 | controller | skipping: [instance] 2025-11-26 15:55:38.735363 | controller | 2025-11-26 15:55:38.735504 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2025-11-26 15:55:38.735616 | controller | Wednesday 26 November 2025 15:55:38 +0000 (0:00:00.046) 0:06:37.524 **** 2025-11-26 15:55:38.800559 | controller | 2025-11-26 15:55:38.800673 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2025-11-26 15:55:38.800786 | controller | Wednesday 26 November 2025 15:55:38 +0000 (0:00:00.065) 0:06:37.589 **** 2025-11-26 15:55:38.854151 | controller | skipping: [instance] 2025-11-26 15:55:38.854216 | controller | 2025-11-26 15:55:38.854278 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2025-11-26 15:55:38.854378 | controller | Wednesday 26 November 2025 15:55:38 +0000 (0:00:00.053) 0:06:37.642 **** 2025-11-26 15:55:38.898745 | controller | skipping: [instance] 2025-11-26 15:55:38.898866 | controller | 2025-11-26 15:55:38.898906 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2025-11-26 15:55:38.899009 | controller | Wednesday 26 November 2025 15:55:38 +0000 (0:00:00.044) 0:06:37.687 **** 2025-11-26 15:55:38.946144 | controller | skipping: [instance] 2025-11-26 15:55:38.946227 | controller | 2025-11-26 15:55:38.946329 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2025-11-26 15:55:38.946423 | controller | Wednesday 26 November 2025 15:55:38 +0000 (0:00:00.046) 0:06:37.734 **** 2025-11-26 15:55:38.992517 | controller | skipping: [instance] 2025-11-26 15:55:38.992618 | controller | 2025-11-26 15:55:38.992739 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2025-11-26 15:55:38.992834 | controller | Wednesday 26 November 2025 15:55:38 +0000 (0:00:00.047) 0:06:37.781 **** 2025-11-26 15:55:39.089381 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 15:55:39.089484 | controller | ok: [instance -> controller-0] 2025-11-26 15:55:39.089581 | controller | 2025-11-26 15:55:39.089726 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2025-11-26 15:55:39.089835 | controller | Wednesday 26 November 2025 15:55:39 +0000 (0:00:00.096) 0:06:37.878 **** 2025-11-26 15:55:39.160966 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:39.161109 | controller | 2025-11-26 15:55:39.161241 | controller | TASK [install_yamls : Get environment structure] ******************************* 2025-11-26 15:55:39.161378 | controller | Wednesday 26 November 2025 15:55:39 +0000 (0:00:00.071) 0:06:37.949 **** 2025-11-26 15:55:40.271914 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:40.272166 | controller | 2025-11-26 15:55:40.319488 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2025-11-26 15:55:40.319535 | controller | Wednesday 26 November 2025 15:55:40 +0000 (0:00:01.108) 0:06:39.058 **** 2025-11-26 15:55:40.319549 | controller | skipping: [instance] 2025-11-26 15:55:40.374957 | controller | 2025-11-26 15:55:40.375028 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2025-11-26 15:55:40.375038 | controller | Wednesday 26 November 2025 15:55:40 +0000 (0:00:00.049) 0:06:39.107 **** 2025-11-26 15:55:40.375052 | controller | skipping: [instance] 2025-11-26 15:55:40.375074 | controller | 2025-11-26 15:55:40.375081 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2025-11-26 15:55:40.420744 | controller | Wednesday 26 November 2025 15:55:40 +0000 (0:00:00.055) 0:06:39.163 **** 2025-11-26 15:55:40.420788 | controller | skipping: [instance] 2025-11-26 15:55:40.487507 | controller | 2025-11-26 15:55:40.487544 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2025-11-26 15:55:40.487563 | controller | Wednesday 26 November 2025 15:55:40 +0000 (0:00:00.045) 0:06:39.209 **** 2025-11-26 15:55:40.487577 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:40.487722 | controller | 2025-11-26 15:55:40.487741 | controller | TASK [install_yamls : Show the env structure] ********************************** 2025-11-26 15:55:40.487839 | controller | Wednesday 26 November 2025 15:55:40 +0000 (0:00:00.067) 0:06:39.276 **** 2025-11-26 15:55:40.533915 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:40.533994 | controller | 2025-11-26 15:55:40.534113 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2025-11-26 15:55:40.534208 | controller | Wednesday 26 November 2025 15:55:40 +0000 (0:00:00.046) 0:06:39.322 **** 2025-11-26 15:55:40.591258 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:40.591344 | controller | 2025-11-26 15:55:40.591440 | controller | TASK [install_yamls : Generate make targets] *********************************** 2025-11-26 15:55:40.591524 | controller | Wednesday 26 November 2025 15:55:40 +0000 (0:00:00.057) 0:06:39.379 **** 2025-11-26 15:55:41.234892 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:41.235012 | controller | 2025-11-26 15:55:41.235038 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2025-11-26 15:55:41.235121 | controller | Wednesday 26 November 2025 15:55:41 +0000 (0:00:00.643) 0:06:40.023 **** 2025-11-26 15:55:41.291514 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:41.291638 | controller | 2025-11-26 15:55:41.291656 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2025-11-26 15:55:41.291805 | controller | Wednesday 26 November 2025 15:55:41 +0000 (0:00:00.053) 0:06:40.076 **** 2025-11-26 15:55:42.292821 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:42.292942 | controller | 2025-11-26 15:55:42.293057 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2025-11-26 15:55:42.293081 | controller | Wednesday 26 November 2025 15:55:42 +0000 (0:00:01.004) 0:06:41.081 **** 2025-11-26 15:55:42.341558 | controller | skipping: [instance] 2025-11-26 15:55:42.341690 | controller | 2025-11-26 15:55:42.341824 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-11-26 15:55:42.341937 | controller | Wednesday 26 November 2025 15:55:42 +0000 (0:00:00.049) 0:06:41.130 **** 2025-11-26 15:55:43.060031 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:43.060098 | controller | 2025-11-26 15:55:43.060206 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-11-26 15:55:43.060341 | controller | Wednesday 26 November 2025 15:55:43 +0000 (0:00:00.717) 0:06:41.848 **** 2025-11-26 15:55:43.122114 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:43.122167 | controller | 2025-11-26 15:55:43.122281 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2025-11-26 15:55:43.122378 | controller | Wednesday 26 November 2025 15:55:43 +0000 (0:00:00.062) 0:06:41.910 **** 2025-11-26 15:55:44.050834 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:44.050934 | controller | 2025-11-26 15:55:44.051105 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2025-11-26 15:55:44.051159 | controller | Wednesday 26 November 2025 15:55:44 +0000 (0:00:00.928) 0:06:42.839 **** 2025-11-26 15:55:44.531148 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:44.680960 | controller | 2025-11-26 15:55:44.680996 | controller | TASK [Configure CRC network if needed] ***************************************** 2025-11-26 15:55:44.681004 | controller | Wednesday 26 November 2025 15:55:44 +0000 (0:00:00.479) 0:06:43.319 **** 2025-11-26 15:55:44.681024 | controller | 2025-11-26 15:55:45.849273 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2025-11-26 15:55:45.849306 | controller | Wednesday 26 November 2025 15:55:44 +0000 (0:00:00.150) 0:06:43.469 **** 2025-11-26 15:55:45.849318 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:46.935766 | controller | 2025-11-26 15:55:46.935822 | controller | TASK [openshift_setup : Patch network operator] ******************************** 2025-11-26 15:55:46.935842 | controller | Wednesday 26 November 2025 15:55:45 +0000 (0:00:01.168) 0:06:44.637 **** 2025-11-26 15:55:46.935858 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:46.967090 | controller | 2025-11-26 15:55:46.967141 | controller | TASK [Ensure OCP cluster is stable] ******************************************** 2025-11-26 15:55:46.967149 | controller | Wednesday 26 November 2025 15:55:46 +0000 (0:00:01.086) 0:06:45.723 **** 2025-11-26 15:55:46.967176 | controller | skipping: [instance] 2025-11-26 15:55:47.005965 | controller | 2025-11-26 15:55:47.006003 | controller | TASK [reproducer : Emulate CI job] ********************************************* 2025-11-26 15:55:47.006022 | controller | Wednesday 26 November 2025 15:55:46 +0000 (0:00:00.031) 0:06:45.755 **** 2025-11-26 15:55:47.006035 | controller | skipping: [instance] 2025-11-26 15:55:47.043980 | controller | 2025-11-26 15:55:47.044010 | controller | TASK [reproducer : Prepare architecture-based deployment] ********************** 2025-11-26 15:55:47.044031 | controller | Wednesday 26 November 2025 15:55:47 +0000 (0:00:00.039) 0:06:45.794 **** 2025-11-26 15:55:47.044041 | controller | skipping: [instance] 2025-11-26 15:55:47.044153 | controller | 2025-11-26 15:55:47.044167 | controller | TASK [reproducer : Prepare architecture-based post deployment] ***************** 2025-11-26 15:55:47.081314 | controller | Wednesday 26 November 2025 15:55:47 +0000 (0:00:00.038) 0:06:45.832 **** 2025-11-26 15:55:47.081350 | controller | skipping: [instance] 2025-11-26 15:55:48.030672 | controller | 2025-11-26 15:55:48.030705 | controller | TASK [reproducer : Prepare ci-like EDPM deploy] ******************************** 2025-11-26 15:55:48.030713 | controller | Wednesday 26 November 2025 15:55:47 +0000 (0:00:00.037) 0:06:45.869 **** 2025-11-26 15:55:48.030723 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:48.514257 | controller | 2025-11-26 15:55:48.514292 | controller | TASK [Ensure we have appropriate credentials for OpenShift accesses] *********** 2025-11-26 15:55:48.514301 | controller | Wednesday 26 November 2025 15:55:48 +0000 (0:00:00.949) 0:06:46.819 **** 2025-11-26 15:55:48.514311 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:48.986373 | controller | 2025-11-26 15:55:48.986409 | controller | TASK [Ensure we have needed inventory files] *********************************** 2025-11-26 15:55:48.986418 | controller | Wednesday 26 November 2025 15:55:48 +0000 (0:00:00.483) 0:06:47.302 **** 2025-11-26 15:55:48.986428 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:49.494482 | controller | 2025-11-26 15:55:49.494541 | controller | TASK [Ensure we have CRC ssh key] ********************************************** 2025-11-26 15:55:49.494551 | controller | Wednesday 26 November 2025 15:55:48 +0000 (0:00:00.471) 0:06:47.773 **** 2025-11-26 15:55:49.494567 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:49.494573 | controller | 2025-11-26 15:55:49.494580 | controller | TASK [Ensure we have the MAC mapping file] ************************************* 2025-11-26 15:55:50.003742 | controller | Wednesday 26 November 2025 15:55:49 +0000 (0:00:00.509) 0:06:48.283 **** 2025-11-26 15:55:50.003785 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:50.003795 | controller | 2025-11-26 15:55:50.003959 | controller | TASK [Load crc inventory] ****************************************************** 2025-11-26 15:55:50.004001 | controller | Wednesday 26 November 2025 15:55:50 +0000 (0:00:00.509) 0:06:48.792 **** 2025-11-26 15:55:50.462863 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:50.918756 | controller | 2025-11-26 15:55:50.918808 | controller | TASK [Load compute inventory] ************************************************** 2025-11-26 15:55:50.918816 | controller | Wednesday 26 November 2025 15:55:50 +0000 (0:00:00.458) 0:06:49.251 **** 2025-11-26 15:55:50.918829 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:50.918868 | controller | 2025-11-26 15:55:50.918877 | controller | TASK [Ensure we can ping compute-0 on osp_trunk net] *************************** 2025-11-26 15:55:51.419926 | controller | Wednesday 26 November 2025 15:55:50 +0000 (0:00:00.455) 0:06:49.706 **** 2025-11-26 15:55:51.420018 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:51.916190 | controller | 2025-11-26 15:55:51.916230 | controller | TASK [Ensure we can ping crc-0 on osp_trunk net] ******************************* 2025-11-26 15:55:51.916238 | controller | Wednesday 26 November 2025 15:55:51 +0000 (0:00:00.501) 0:06:50.208 **** 2025-11-26 15:55:51.916248 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:52.440389 | controller | 2025-11-26 15:55:52.440431 | controller | TASK [Check default location secret file] ************************************** 2025-11-26 15:55:52.440440 | controller | Wednesday 26 November 2025 15:55:51 +0000 (0:00:00.496) 0:06:50.704 **** 2025-11-26 15:55:52.440451 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:52.440471 | controller | 2025-11-26 15:55:52.440477 | controller | TASK [Check non-default location secret] *************************************** 2025-11-26 15:55:52.440484 | controller | Wednesday 26 November 2025 15:55:52 +0000 (0:00:00.524) 0:06:51.228 **** 2025-11-26 15:55:52.995716 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 15:55:53.032916 | controller | 2025-11-26 15:55:53.032950 | controller | TASK [Assert all of the tests] ************************************************* 2025-11-26 15:55:53.032958 | controller | Wednesday 26 November 2025 15:55:52 +0000 (0:00:00.555) 0:06:51.784 **** 2025-11-26 15:55:53.032969 | controller | ok: [instance] 2025-11-26 15:55:53.254694 | controller | 2025-11-26 15:55:53.254727 | controller | TASK [Create dnsmasq dir] ****************************************************** 2025-11-26 15:55:53.254736 | controller | Wednesday 26 November 2025 15:55:53 +0000 (0:00:00.036) 0:06:51.820 **** 2025-11-26 15:55:53.254747 | controller | changed: [instance] 2025-11-26 15:55:53.529713 | controller | 2025-11-26 15:55:53.529748 | controller | TASK [Get journalctl in a file] ************************************************ 2025-11-26 15:55:53.529757 | controller | Wednesday 26 November 2025 15:55:53 +0000 (0:00:00.222) 0:06:52.042 **** 2025-11-26 15:55:53.529768 | controller | changed: [instance] 2025-11-26 15:55:53.956507 | controller | 2025-11-26 15:55:53.956540 | controller | TASK [Dump journalctl output] ************************************************** 2025-11-26 15:55:53.956549 | controller | Wednesday 26 November 2025 15:55:53 +0000 (0:00:00.274) 0:06:52.317 **** 2025-11-26 15:55:53.956559 | controller | changed: [instance] 2025-11-26 15:55:54.495802 | controller | 2025-11-26 15:55:54.495840 | controller | TASK [Copy all dnsmasq config] ************************************************* 2025-11-26 15:55:54.495849 | controller | Wednesday 26 November 2025 15:55:53 +0000 (0:00:00.426) 0:06:52.744 **** 2025-11-26 15:55:54.495863 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-11-26 15:55:54.736321 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2025-11-26 15:55:54.736386 | controller | 2025-11-26 15:55:54.736394 | controller | TASK [Create log directory] **************************************************** 2025-11-26 15:55:54.736401 | controller | Wednesday 26 November 2025 15:55:54 +0000 (0:00:00.539) 0:06:53.284 **** 2025-11-26 15:55:54.736415 | controller | changed: [instance] 2025-11-26 15:55:54.736436 | controller | 2025-11-26 15:55:54.736514 | controller | TASK [Sync logs from controller-0] ********************************************* 2025-11-26 15:55:54.736524 | controller | Wednesday 26 November 2025 15:55:54 +0000 (0:00:00.240) 0:06:53.524 **** 2025-11-26 15:55:55.764591 | controller | changed: [instance] 2025-11-26 15:55:55.764687 | controller | 2025-11-26 15:55:55.764696 | controller | PLAY RECAP ********************************************************************* 2025-11-26 15:55:55.764704 | controller | instance : ok=540 changed=203 unreachable=0 failed=0 skipped=226 rescued=0 ignored=0 2025-11-26 15:55:55.764710 | controller | 2025-11-26 15:55:55.764716 | controller | Wednesday 26 November 2025 15:55:55 +0000 (0:00:01.023) 0:06:54.548 **** 2025-11-26 15:55:55.764721 | controller | =============================================================================== 2025-11-26 15:55:55.764727 | controller | reproducer : Check package install status ------------------------------ 50.43s 2025-11-26 15:55:55.764733 | controller | ci_setup : Install needed packages ------------------------------------- 29.77s 2025-11-26 15:55:55.764752 | controller | libvirt_manager : Download base image ---------------------------------- 21.02s 2025-11-26 15:55:55.764757 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.71s 2025-11-26 15:55:55.764763 | controller | reproducer : Install collections on controller-0 ----------------------- 19.56s 2025-11-26 15:55:55.764768 | controller | libvirt_manager : Install packages required for using KVM -------------- 10.82s 2025-11-26 15:55:55.764773 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.55s 2025-11-26 15:55:55.764778 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.82s 2025-11-26 15:55:55.764784 | controller | ci_setup : Install openshift client ------------------------------------- 6.07s 2025-11-26 15:55:55.764789 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.07s 2025-11-26 15:55:55.764794 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.07s 2025-11-26 15:55:55.764799 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 4.57s 2025-11-26 15:55:55.764804 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.58s 2025-11-26 15:55:55.764810 | controller | networking_mapper : Gather the facts ------------------------------------ 3.27s 2025-11-26 15:55:55.764828 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.08s 2025-11-26 15:55:55.764834 | controller | sushy_emulator : Install required packages ------------------------------ 2.77s 2025-11-26 15:55:55.764843 | controller | ci_setup : Manage directories ------------------------------------------- 2.68s 2025-11-26 15:55:55.899057 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.15s 2025-11-26 15:55:55.899367 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.09s 2025-11-26 15:55:55.899378 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s 2025-11-26 15:55:55.899403 | controller | INFO Running crc_layout > cleanup 2025-11-26 15:55:55.899650 | controller | WARNING Skipping, cleanup playbook not configured. 2025-11-26 15:55:55.907331 | controller | INFO Running job_uri > prepare 2025-11-26 15:55:55.907716 | controller | WARNING Skipping, prepare playbook not configured. 2025-11-26 15:55:55.915198 | controller | INFO Running job_uri > converge 2025-11-26 15:55:56.341373 | controller | 2025-11-26 15:55:56.406700 | controller | PLAY [Prepare] ***************************************************************** 2025-11-26 15:55:56.406779 | controller | 2025-11-26 15:55:56.406789 | controller | TASK [Call task file in loop] ************************************************** 2025-11-26 15:55:56.406796 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.032) 0:00:00.032 **** 2025-11-26 15:55:56.406824 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////'}) 2025-11-26 15:55:56.406861 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2025-11-26 15:55:56.406873 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2025-11-26 15:55:56.406880 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35'}) 2025-11-26 15:55:56.406892 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2025-11-26 15:55:56.406901 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2025-11-26 15:55:56.406928 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log'}) 2025-11-26 15:55:56.407557 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/'}) 2025-11-26 15:55:56.445774 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4'}) 2025-11-26 15:55:56.445816 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': '/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a'}) 2025-11-26 15:55:56.445833 | controller | 2025-11-26 15:55:56.445840 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////] *** 2025-11-26 15:55:56.445847 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.066) 0:00:00.099 **** 2025-11-26 15:55:56.445858 | controller | 2025-11-26 15:55:56.480533 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 15:55:56.480583 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.039) 0:00:00.138 **** 2025-11-26 15:55:56.480621 | controller | ok: [instance] 2025-11-26 15:55:56.480689 | controller | 2025-11-26 15:55:56.480710 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 15:55:56.480753 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.035) 0:00:00.173 **** 2025-11-26 15:55:56.517431 | controller | ok: [instance] 2025-11-26 15:55:56.563788 | controller | 2025-11-26 15:55:56.563811 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-26 15:55:56.563818 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.036) 0:00:00.210 **** 2025-11-26 15:55:56.563827 | controller | ok: [instance] 2025-11-26 15:55:56.588219 | controller | 2025-11-26 15:55:56.588240 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-26 15:55:56.588248 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.046) 0:00:00.257 **** 2025-11-26 15:55:56.588258 | controller | skipping: [instance] 2025-11-26 15:55:56.588294 | controller | 2025-11-26 15:55:56.588315 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-26 15:55:56.588326 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.024) 0:00:00.281 **** 2025-11-26 15:55:56.642705 | controller | ok: [instance] => changed=false 2025-11-26 15:55:56.678790 | controller | msg: All assertions passed 2025-11-26 15:55:56.678853 | controller | 2025-11-26 15:55:56.678863 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2025-11-26 15:55:56.678876 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.054) 0:00:00.335 **** 2025-11-26 15:55:56.678893 | controller | 2025-11-26 15:55:56.712552 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 15:55:56.712581 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.036) 0:00:00.372 **** 2025-11-26 15:55:56.712593 | controller | ok: [instance] 2025-11-26 15:55:56.750322 | controller | 2025-11-26 15:55:56.750349 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 15:55:56.750358 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.033) 0:00:00.405 **** 2025-11-26 15:55:56.750369 | controller | ok: [instance] 2025-11-26 15:55:56.783032 | controller | 2025-11-26 15:55:56.783055 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-26 15:55:56.783063 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.037) 0:00:00.443 **** 2025-11-26 15:55:56.783074 | controller | ok: [instance] 2025-11-26 15:55:56.783107 | controller | 2025-11-26 15:55:56.783310 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-26 15:55:56.807863 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.032) 0:00:00.476 **** 2025-11-26 15:55:56.807907 | controller | skipping: [instance] 2025-11-26 15:55:56.842277 | controller | 2025-11-26 15:55:56.842307 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-26 15:55:56.842315 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.024) 0:00:00.501 **** 2025-11-26 15:55:56.842334 | controller | ok: [instance] => changed=false 2025-11-26 15:55:56.842363 | controller | msg: All assertions passed 2025-11-26 15:55:56.842470 | controller | 2025-11-26 15:55:56.842664 | controller | TASK [Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2025-11-26 15:55:56.877299 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.034) 0:00:00.535 **** 2025-11-26 15:55:56.877329 | controller | 2025-11-26 15:55:56.912545 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 15:55:56.912565 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.034) 0:00:00.570 **** 2025-11-26 15:55:56.912576 | controller | ok: [instance] 2025-11-26 15:55:56.963285 | controller | 2025-11-26 15:55:56.963308 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 15:55:56.963315 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.035) 0:00:00.605 **** 2025-11-26 15:55:56.963325 | controller | ok: [instance] 2025-11-26 15:55:57.000444 | controller | 2025-11-26 15:55:57.000489 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-26 15:55:57.000498 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.050) 0:00:00.656 **** 2025-11-26 15:55:57.000509 | controller | ok: [instance] 2025-11-26 15:55:57.000529 | controller | 2025-11-26 15:55:57.000616 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-26 15:55:57.000753 | controller | Wednesday 26 November 2025 15:55:56 +0000 (0:00:00.037) 0:00:00.694 **** 2025-11-26 15:55:57.031670 | controller | skipping: [instance] 2025-11-26 15:55:57.031773 | controller | 2025-11-26 15:55:57.031869 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-26 15:55:57.031964 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.031) 0:00:00.725 **** 2025-11-26 15:55:57.070449 | controller | ok: [instance] => changed=false 2025-11-26 15:55:57.070531 | controller | msg: All assertions passed 2025-11-26 15:55:57.070646 | controller | 2025-11-26 15:55:57.070759 | controller | TASK [Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35] *** 2025-11-26 15:55:57.070871 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.038) 0:00:00.764 **** 2025-11-26 15:55:57.108650 | controller | 2025-11-26 15:55:57.108773 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 15:55:57.108886 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.038) 0:00:00.802 **** 2025-11-26 15:55:57.144857 | controller | ok: [instance] 2025-11-26 15:55:57.144950 | controller | 2025-11-26 15:55:57.145082 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 15:55:57.145199 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.035) 0:00:00.838 **** 2025-11-26 15:55:57.187840 | controller | ok: [instance] 2025-11-26 15:55:57.187945 | controller | 2025-11-26 15:55:57.188076 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-26 15:55:57.188174 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.043) 0:00:00.881 **** 2025-11-26 15:55:57.223831 | controller | ok: [instance] 2025-11-26 15:55:57.223889 | controller | 2025-11-26 15:55:57.224015 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-26 15:55:57.224120 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.035) 0:00:00.916 **** 2025-11-26 15:55:57.254413 | controller | skipping: [instance] 2025-11-26 15:55:57.254497 | controller | 2025-11-26 15:55:57.254631 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-26 15:55:57.254759 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.030) 0:00:00.947 **** 2025-11-26 15:55:57.293583 | controller | ok: [instance] => changed=false 2025-11-26 15:55:57.293730 | controller | msg: All assertions passed 2025-11-26 15:55:57.293975 | controller | 2025-11-26 15:55:57.294010 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2025-11-26 15:55:57.294133 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.039) 0:00:00.987 **** 2025-11-26 15:55:57.362380 | controller | 2025-11-26 15:55:57.362478 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 15:55:57.362581 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.068) 0:00:01.055 **** 2025-11-26 15:55:57.397383 | controller | ok: [instance] 2025-11-26 15:55:57.397476 | controller | 2025-11-26 15:55:57.397580 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 15:55:57.397703 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.035) 0:00:01.090 **** 2025-11-26 15:55:57.438386 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:55:57.438485 | controller | assertion: _matched_url | default('') | length > 0 2025-11-26 15:55:57.438592 | controller | evaluated_to: false 2025-11-26 15:55:57.438732 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-11-26 15:55:57.464094 | controller | 2025-11-26 15:55:57.464206 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-11-26 15:55:57.464307 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.050) 0:00:01.141 **** 2025-11-26 15:55:57.464395 | controller | 2025-11-26 15:55:57.464505 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-11-26 15:55:57.464589 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.015) 0:00:01.157 **** 2025-11-26 15:55:57.506565 | controller | skipping: [instance] 2025-11-26 15:55:57.506664 | controller | 2025-11-26 15:55:57.506769 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-11-26 15:55:57.506868 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.042) 0:00:01.200 **** 2025-11-26 15:55:57.546172 | controller | skipping: [instance] 2025-11-26 15:55:57.546258 | controller | 2025-11-26 15:55:57.546378 | controller | TASK [Call task file with httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2025-11-26 15:55:57.546487 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.039) 0:00:01.239 **** 2025-11-26 15:55:57.586505 | controller | 2025-11-26 15:55:57.586591 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 15:55:57.586728 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.040) 0:00:01.280 **** 2025-11-26 15:55:57.623227 | controller | ok: [instance] 2025-11-26 15:55:57.623296 | controller | 2025-11-26 15:55:57.623368 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 15:55:57.623465 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.036) 0:00:01.316 **** 2025-11-26 15:55:57.651492 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:55:57.651634 | controller | assertion: _matched_url | default('') | length > 0 2025-11-26 15:55:57.651754 | controller | evaluated_to: false 2025-11-26 15:55:57.651875 | controller | msg: 'The cifmw_job_uri value provided is not valid: httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-11-26 15:55:57.681879 | controller | 2025-11-26 15:55:57.681991 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-11-26 15:55:57.682113 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.040) 0:00:01.356 **** 2025-11-26 15:55:57.682199 | controller | 2025-11-26 15:55:57.682303 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-11-26 15:55:57.682423 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.018) 0:00:01.375 **** 2025-11-26 15:55:57.723264 | controller | skipping: [instance] 2025-11-26 15:55:57.723345 | controller | 2025-11-26 15:55:57.723448 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-11-26 15:55:57.723535 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.041) 0:00:01.416 **** 2025-11-26 15:55:57.765847 | controller | skipping: [instance] 2025-11-26 15:55:57.765933 | controller | 2025-11-26 15:55:57.766079 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log] *** 2025-11-26 15:55:57.766171 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.042) 0:00:01.459 **** 2025-11-26 15:55:57.811491 | controller | 2025-11-26 15:55:57.811617 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 15:55:57.811739 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.045) 0:00:01.504 **** 2025-11-26 15:55:57.854582 | controller | ok: [instance] 2025-11-26 15:55:57.854699 | controller | 2025-11-26 15:55:57.854797 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 15:55:57.854897 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.043) 0:00:01.548 **** 2025-11-26 15:55:57.900327 | controller | ok: [instance] 2025-11-26 15:55:57.900401 | controller | 2025-11-26 15:55:57.900495 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-26 15:55:57.900591 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.045) 0:00:01.593 **** 2025-11-26 15:55:57.948788 | controller | ok: [instance] 2025-11-26 15:55:57.948901 | controller | 2025-11-26 15:55:57.949025 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-26 15:55:57.949076 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.048) 0:00:01.641 **** 2025-11-26 15:55:57.981539 | controller | skipping: [instance] 2025-11-26 15:55:57.981682 | controller | 2025-11-26 15:55:57.981763 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-26 15:55:57.981855 | controller | Wednesday 26 November 2025 15:55:57 +0000 (0:00:00.033) 0:00:01.675 **** 2025-11-26 15:55:58.024161 | controller | ok: [instance] => changed=false 2025-11-26 15:55:58.024260 | controller | msg: All assertions passed 2025-11-26 15:55:58.024337 | controller | 2025-11-26 15:55:58.024438 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/] *** 2025-11-26 15:55:58.024533 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.042) 0:00:01.717 **** 2025-11-26 15:55:58.105876 | controller | 2025-11-26 15:55:58.105987 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 15:55:58.106098 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.081) 0:00:01.799 **** 2025-11-26 15:55:58.148897 | controller | ok: [instance] 2025-11-26 15:55:58.149322 | controller | 2025-11-26 15:55:58.149430 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 15:55:58.149515 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.042) 0:00:01.842 **** 2025-11-26 15:55:58.203711 | controller | ok: [instance] 2025-11-26 15:55:58.203812 | controller | 2025-11-26 15:55:58.206118 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-26 15:55:58.206246 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.053) 0:00:01.895 **** 2025-11-26 15:55:58.250058 | controller | ok: [instance] 2025-11-26 15:55:58.250158 | controller | 2025-11-26 15:55:58.250259 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-26 15:55:58.250381 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.047) 0:00:01.943 **** 2025-11-26 15:55:58.279913 | controller | skipping: [instance] 2025-11-26 15:55:58.280022 | controller | 2025-11-26 15:55:58.280144 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-26 15:55:58.280247 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.030) 0:00:01.973 **** 2025-11-26 15:55:58.318256 | controller | ok: [instance] => changed=false 2025-11-26 15:55:58.318360 | controller | msg: All assertions passed 2025-11-26 15:55:58.318456 | controller | 2025-11-26 15:55:58.318573 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4] *** 2025-11-26 15:55:58.318740 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.038) 0:00:02.011 **** 2025-11-26 15:55:58.356866 | controller | 2025-11-26 15:55:58.356961 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 15:55:58.357066 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.038) 0:00:02.050 **** 2025-11-26 15:55:58.394191 | controller | ok: [instance] 2025-11-26 15:55:58.394260 | controller | 2025-11-26 15:55:58.394355 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 15:55:58.394464 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.037) 0:00:02.087 **** 2025-11-26 15:55:58.426323 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:55:58.451848 | controller | assertion: _matched_url | default('') | length > 0 2025-11-26 15:55:58.451871 | controller | evaluated_to: false 2025-11-26 15:55:58.451880 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-11-26 15:55:58.451891 | controller | 2025-11-26 15:55:58.451958 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-11-26 15:55:58.452078 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.040) 0:00:02.128 **** 2025-11-26 15:55:58.452174 | controller | 2025-11-26 15:55:58.452287 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-11-26 15:55:58.452390 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.016) 0:00:02.145 **** 2025-11-26 15:55:58.490016 | controller | skipping: [instance] 2025-11-26 15:55:58.490116 | controller | 2025-11-26 15:55:58.490213 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-11-26 15:55:58.490327 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.038) 0:00:02.183 **** 2025-11-26 15:55:58.523688 | controller | skipping: [instance] 2025-11-26 15:55:58.523787 | controller | 2025-11-26 15:55:58.523895 | controller | TASK [Call task file with /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a] *** 2025-11-26 15:55:58.523982 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.033) 0:00:02.217 **** 2025-11-26 15:55:58.563207 | controller | 2025-11-26 15:55:58.563319 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 15:55:58.563419 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.039) 0:00:02.256 **** 2025-11-26 15:55:58.601128 | controller | ok: [instance] 2025-11-26 15:55:58.601222 | controller | 2025-11-26 15:55:58.601322 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 15:55:58.601423 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.037) 0:00:02.294 **** 2025-11-26 15:55:58.634175 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:55:58.634275 | controller | assertion: _matched_url | default('') | length > 0 2025-11-26 15:55:58.634375 | controller | evaluated_to: false 2025-11-26 15:55:58.634508 | controller | msg: 'The cifmw_job_uri value provided is not valid: /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-11-26 15:55:58.661430 | controller | 2025-11-26 15:55:58.661537 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-11-26 15:55:58.661687 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.044) 0:00:02.339 **** 2025-11-26 15:55:58.661781 | controller | 2025-11-26 15:55:58.661872 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-11-26 15:55:58.661956 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.015) 0:00:02.355 **** 2025-11-26 15:55:58.699709 | controller | skipping: [instance] 2025-11-26 15:55:58.699798 | controller | 2025-11-26 15:55:58.699903 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-11-26 15:55:58.700016 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.038) 0:00:02.393 **** 2025-11-26 15:55:58.738818 | controller | skipping: [instance] 2025-11-26 15:55:58.738912 | controller | 2025-11-26 15:55:58.739027 | controller | TASK [Print success message] *************************************************** 2025-11-26 15:55:58.739151 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.038) 0:00:02.431 **** 2025-11-26 15:55:58.839481 | controller | ok: [instance] => 2025-11-26 15:55:58.839564 | controller | msg: All strings passed! 2025-11-26 15:55:58.839705 | controller | 2025-11-26 15:55:58.839803 | controller | PLAY RECAP ********************************************************************* 2025-11-26 15:55:58.839934 | controller | instance : ok=39 changed=0 unreachable=0 failed=0 skipped=14 rescued=4 ignored=0 2025-11-26 15:55:58.840042 | controller | 2025-11-26 15:55:58.840145 | controller | Wednesday 26 November 2025 15:55:58 +0000 (0:00:00.101) 0:00:02.532 **** 2025-11-26 15:55:58.840250 | controller | =============================================================================== 2025-11-26 15:55:58.840396 | controller | Print success message --------------------------------------------------- 0.10s 2025-11-26 15:55:58.840477 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/ --- 0.08s 2025-11-26 15:55:58.840577 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 --- 0.07s 2025-11-26 15:55:58.840719 | controller | Call task file in loop -------------------------------------------------- 0.07s 2025-11-26 15:55:58.840884 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.05s 2025-11-26 15:55:58.840985 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.05s 2025-11-26 15:55:58.841021 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.05s 2025-11-26 15:55:58.841104 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.05s 2025-11-26 15:55:58.841215 | controller | reproducer : Extract job id for later reference ------------------------- 0.05s 2025-11-26 15:55:58.841306 | controller | reproducer : Extract job id for later reference ------------------------- 0.05s 2025-11-26 15:55:58.841416 | controller | reproducer : Extract job id for later reference ------------------------- 0.05s 2025-11-26 15:55:58.841502 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log --- 0.05s 2025-11-26 15:55:58.841590 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.05s 2025-11-26 15:55:58.841727 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-11-26 15:55:58.841826 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-11-26 15:55:58.841917 | controller | reproducer : Apply regex match filter ----------------------------------- 0.04s 2025-11-26 15:55:58.842020 | controller | reproducer : Apply regex match filter ----------------------------------- 0.04s 2025-11-26 15:55:58.842119 | controller | Really fail if string passed but should have failed --------------------- 0.04s 2025-11-26 15:55:58.842215 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.04s 2025-11-26 15:55:58.842310 | controller | Really fail if string failed but should have passed --------------------- 0.04s 2025-11-26 15:55:58.908341 | controller | INFO Running job_uri > cleanup 2025-11-26 15:55:58.908825 | controller | WARNING Skipping, cleanup playbook not configured. 2025-11-26 15:55:58.916181 | controller | INFO Running network_validations > prepare 2025-11-26 15:55:58.916564 | controller | WARNING Skipping, prepare playbook not configured. 2025-11-26 15:55:58.924621 | controller | INFO Running network_validations > converge 2025-11-26 15:55:59.361809 | controller | 2025-11-26 15:55:59.361898 | controller | PLAY [Prepare] ***************************************************************** 2025-11-26 15:55:59.361991 | controller | 2025-11-26 15:55:59.362110 | controller | TASK [Set failed fact] ********************************************************* 2025-11-26 15:55:59.362205 | controller | Wednesday 26 November 2025 15:55:59 +0000 (0:00:00.031) 0:00:00.031 **** 2025-11-26 15:55:59.392955 | controller | ok: [instance] 2025-11-26 15:55:59.393048 | controller | 2025-11-26 15:55:59.393146 | controller | TASK [Load scenarios] ********************************************************** 2025-11-26 15:55:59.393247 | controller | Wednesday 26 November 2025 15:55:59 +0000 (0:00:00.031) 0:00:00.063 **** 2025-11-26 15:55:59.422654 | controller | ok: [instance] 2025-11-26 15:55:59.422742 | controller | 2025-11-26 15:55:59.422842 | controller | TASK [Test network validations] ************************************************ 2025-11-26 15:55:59.422948 | controller | Wednesday 26 November 2025 15:55:59 +0000 (0:00:00.029) 0:00:00.092 **** 2025-11-26 15:55:59.486961 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets only) 2025-11-26 15:55:59.487103 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets and spine/leaf) 2025-11-26 15:55:59.487176 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets with extra defined net) 2025-11-26 15:55:59.487281 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing default net definition) 2025-11-26 15:55:59.487429 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing spine/leaf net definition) 2025-11-26 15:55:59.487449 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=No network for a VM) 2025-11-26 15:55:59.487548 | controller | 2025-11-26 15:55:59.487675 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:55:59.487765 | controller | Wednesday 26 November 2025 15:55:59 +0000 (0:00:00.064) 0:00:00.156 **** 2025-11-26 15:55:59.517363 | controller | ok: [instance] 2025-11-26 15:55:59.517452 | controller | 2025-11-26 15:55:59.517546 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:55:59.517655 | controller | Wednesday 26 November 2025 15:55:59 +0000 (0:00:00.030) 0:00:00.187 **** 2025-11-26 15:55:59.552457 | controller | ok: [instance] 2025-11-26 15:55:59.552554 | controller | 2025-11-26 15:55:59.552688 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:55:59.552784 | controller | Wednesday 26 November 2025 15:55:59 +0000 (0:00:00.035) 0:00:00.222 **** 2025-11-26 15:55:59.581962 | controller | ok: [instance] => 2025-11-26 15:55:59.582060 | controller | msg: 'Running: Default nets only' 2025-11-26 15:55:59.582165 | controller | 2025-11-26 15:55:59.582359 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:55:59.627149 | controller | Wednesday 26 November 2025 15:55:59 +0000 (0:00:00.029) 0:00:00.252 **** 2025-11-26 15:55:59.627177 | controller | 2025-11-26 15:55:59.627248 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-26 15:55:59.627351 | controller | Wednesday 26 November 2025 15:55:59 +0000 (0:00:00.045) 0:00:00.297 **** 2025-11-26 15:55:59.678070 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-26 15:55:59.678237 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-26 15:55:59.678357 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-26 15:55:59.678476 | controller | collisions and unexpected behavior. 2025-11-26 15:55:59.721077 | controller | ok: [instance] => (item=controller) 2025-11-26 15:55:59.721162 | controller | 2025-11-26 15:55:59.721272 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-26 15:55:59.721376 | controller | Wednesday 26 November 2025 15:55:59 +0000 (0:00:00.094) 0:00:00.391 **** 2025-11-26 15:55:59.781871 | controller | ok: [instance] 2025-11-26 15:55:59.781988 | controller | 2025-11-26 15:55:59.782098 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-11-26 15:55:59.782199 | controller | Wednesday 26 November 2025 15:55:59 +0000 (0:00:00.060) 0:00:00.451 **** 2025-11-26 15:55:59.845989 | controller | ok: [instance] => changed=false 2025-11-26 15:55:59.846113 | controller | msg: All assertions passed 2025-11-26 15:55:59.846211 | controller | 2025-11-26 15:55:59.846316 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:55:59.846417 | controller | Wednesday 26 November 2025 15:55:59 +0000 (0:00:00.064) 0:00:00.515 **** 2025-11-26 15:55:59.887037 | controller | skipping: [instance] 2025-11-26 15:55:59.887141 | controller | 2025-11-26 15:55:59.887238 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:55:59.887340 | controller | Wednesday 26 November 2025 15:55:59 +0000 (0:00:00.041) 0:00:00.557 **** 2025-11-26 15:55:59.923268 | controller | skipping: [instance] 2025-11-26 15:55:59.923359 | controller | 2025-11-26 15:55:59.923470 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:55:59.923574 | controller | Wednesday 26 November 2025 15:55:59 +0000 (0:00:00.036) 0:00:00.593 **** 2025-11-26 15:55:59.957865 | controller | skipping: [instance] 2025-11-26 15:55:59.957927 | controller | 2025-11-26 15:55:59.957942 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:55:59.958192 | controller | Wednesday 26 November 2025 15:55:59 +0000 (0:00:00.034) 0:00:00.627 **** 2025-11-26 15:55:59.979263 | controller | ok: [instance] 2025-11-26 15:55:59.979348 | controller | 2025-11-26 15:55:59.979433 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:55:59.979539 | controller | Wednesday 26 November 2025 15:55:59 +0000 (0:00:00.021) 0:00:00.649 **** 2025-11-26 15:56:00.004018 | controller | ok: [instance] 2025-11-26 15:56:00.004101 | controller | 2025-11-26 15:56:00.004198 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:00.004300 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.024) 0:00:00.674 **** 2025-11-26 15:56:00.030163 | controller | ok: [instance] => 2025-11-26 15:56:00.030263 | controller | msg: 'Running: Default nets and spine/leaf' 2025-11-26 15:56:00.030341 | controller | 2025-11-26 15:56:00.030437 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:00.030532 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.026) 0:00:00.700 **** 2025-11-26 15:56:00.071639 | controller | 2025-11-26 15:56:00.071751 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-26 15:56:00.071851 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.041) 0:00:00.741 **** 2025-11-26 15:56:00.101432 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-26 15:56:00.101543 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-26 15:56:00.101556 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-26 15:56:00.102022 | controller | collisions and unexpected behavior. 2025-11-26 15:56:00.115209 | controller | ok: [instance] => (item=controller) 2025-11-26 15:56:00.115292 | controller | 2025-11-26 15:56:00.115384 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-26 15:56:00.115485 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.043) 0:00:00.785 **** 2025-11-26 15:56:00.171522 | controller | ok: [instance] 2025-11-26 15:56:00.171620 | controller | 2025-11-26 15:56:00.171741 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-11-26 15:56:00.171842 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.056) 0:00:00.841 **** 2025-11-26 15:56:00.234901 | controller | ok: [instance] => changed=false 2025-11-26 15:56:00.235037 | controller | msg: All assertions passed 2025-11-26 15:56:00.235110 | controller | 2025-11-26 15:56:00.235206 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:00.235298 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.063) 0:00:00.904 **** 2025-11-26 15:56:00.271750 | controller | skipping: [instance] 2025-11-26 15:56:00.271845 | controller | 2025-11-26 15:56:00.271951 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:00.272066 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.036) 0:00:00.941 **** 2025-11-26 15:56:00.303796 | controller | skipping: [instance] 2025-11-26 15:56:00.304117 | controller | 2025-11-26 15:56:00.337675 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:00.337733 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.032) 0:00:00.973 **** 2025-11-26 15:56:00.337751 | controller | skipping: [instance] 2025-11-26 15:56:00.337854 | controller | 2025-11-26 15:56:00.337876 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:00.337967 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.031) 0:00:01.005 **** 2025-11-26 15:56:00.359907 | controller | ok: [instance] 2025-11-26 15:56:00.360023 | controller | 2025-11-26 15:56:00.360145 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:00.360258 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.025) 0:00:01.030 **** 2025-11-26 15:56:00.385365 | controller | ok: [instance] 2025-11-26 15:56:00.385448 | controller | 2025-11-26 15:56:00.385571 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:00.385722 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.025) 0:00:01.055 **** 2025-11-26 15:56:00.410434 | controller | ok: [instance] => 2025-11-26 15:56:00.410536 | controller | msg: 'Running: Default nets with extra defined net' 2025-11-26 15:56:00.410650 | controller | 2025-11-26 15:56:00.410763 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:00.410875 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.024) 0:00:01.080 **** 2025-11-26 15:56:00.451431 | controller | 2025-11-26 15:56:00.451543 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-26 15:56:00.451668 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.041) 0:00:01.121 **** 2025-11-26 15:56:00.476475 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-26 15:56:00.476591 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-26 15:56:00.476742 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-26 15:56:00.476860 | controller | collisions and unexpected behavior. 2025-11-26 15:56:00.520242 | controller | ok: [instance] => (item=controller) 2025-11-26 15:56:00.520303 | controller | 2025-11-26 15:56:00.520435 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-26 15:56:00.520541 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.068) 0:00:01.190 **** 2025-11-26 15:56:00.576673 | controller | ok: [instance] 2025-11-26 15:56:00.576834 | controller | 2025-11-26 15:56:00.576932 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-11-26 15:56:00.577496 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.056) 0:00:01.246 **** 2025-11-26 15:56:00.624660 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:56:00.624724 | controller | assertion: _defined | difference(_all_nets) | length == 0 2025-11-26 15:56:00.624735 | controller | evaluated_to: false 2025-11-26 15:56:00.624744 | controller | msg: 'Inconsistency detected: ensure you''re attaching all of the defined networks. Those nets don''t seem to be attached: [''extra_net_1'']' 2025-11-26 15:56:00.635543 | controller | 2025-11-26 15:56:00.635652 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-11-26 15:56:00.635752 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.059) 0:00:01.305 **** 2025-11-26 15:56:00.665465 | controller | ok: [instance] => 2025-11-26 15:56:00.665562 | controller | cifmw_libvirt_manager_configuration: 2025-11-26 15:56:00.665697 | controller | networks: 2025-11-26 15:56:00.665798 | controller | public: defined 2025-11-26 15:56:00.665892 | controller | vms: 2025-11-26 15:56:00.665988 | controller | controller: 2025-11-26 15:56:00.666099 | controller | nets: 2025-11-26 15:56:00.666194 | controller | - public 2025-11-26 15:56:00.666283 | controller | 2025-11-26 15:56:00.666708 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-11-26 15:56:00.666822 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.029) 0:00:01.335 **** 2025-11-26 15:56:00.695140 | controller | skipping: [instance] 2025-11-26 15:56:00.695231 | controller | 2025-11-26 15:56:00.695340 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-11-26 15:56:00.695450 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.029) 0:00:01.365 **** 2025-11-26 15:56:00.767178 | controller | skipping: [instance] 2025-11-26 15:56:00.767237 | controller | 2025-11-26 15:56:00.767337 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-11-26 15:56:00.767437 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.071) 0:00:01.437 **** 2025-11-26 15:56:00.807534 | controller | ok: [instance] => 2025-11-26 15:56:00.807648 | controller | _cifmw_libvirt_manager_layout: 2025-11-26 15:56:00.807776 | controller | networks: 2025-11-26 15:56:00.807875 | controller | extra_net_1: defined 2025-11-26 15:56:00.807967 | controller | public: defined 2025-11-26 15:56:00.808085 | controller | vms: 2025-11-26 15:56:00.808185 | controller | controller: 2025-11-26 15:56:00.808284 | controller | nets: 2025-11-26 15:56:00.808392 | controller | - public 2025-11-26 15:56:00.808485 | controller | 2025-11-26 15:56:00.808576 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-11-26 15:56:00.808702 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.040) 0:00:01.477 **** 2025-11-26 15:56:00.819836 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:56:00.819937 | controller | msg: Error detected, please check assertions and debugging output above. 2025-11-26 15:56:00.847796 | controller | 2025-11-26 15:56:00.847900 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 15:56:00.848014 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.023) 0:00:01.500 **** 2025-11-26 15:56:00.848129 | controller | 2025-11-26 15:56:00.848221 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:00.848321 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.016) 0:00:01.517 **** 2025-11-26 15:56:00.871330 | controller | ok: [instance] 2025-11-26 15:56:00.871409 | controller | 2025-11-26 15:56:00.871527 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:00.871672 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.023) 0:00:01.541 **** 2025-11-26 15:56:00.909949 | controller | skipping: [instance] 2025-11-26 15:56:00.910055 | controller | 2025-11-26 15:56:00.910157 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:00.910264 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.038) 0:00:01.580 **** 2025-11-26 15:56:00.941763 | controller | skipping: [instance] 2025-11-26 15:56:00.941815 | controller | 2025-11-26 15:56:00.941939 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:00.942056 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.031) 0:00:01.611 **** 2025-11-26 15:56:00.975218 | controller | skipping: [instance] 2025-11-26 15:56:00.975281 | controller | 2025-11-26 15:56:00.975387 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:00.975485 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.033) 0:00:01.645 **** 2025-11-26 15:56:00.996828 | controller | ok: [instance] 2025-11-26 15:56:00.996901 | controller | 2025-11-26 15:56:00.996998 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:00.997115 | controller | Wednesday 26 November 2025 15:56:00 +0000 (0:00:00.021) 0:00:01.667 **** 2025-11-26 15:56:01.021921 | controller | ok: [instance] 2025-11-26 15:56:01.022040 | controller | 2025-11-26 15:56:01.022194 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:01.022330 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.024) 0:00:01.692 **** 2025-11-26 15:56:01.048791 | controller | ok: [instance] => 2025-11-26 15:56:01.048869 | controller | msg: 'Running: Missing default net definition' 2025-11-26 15:56:01.048986 | controller | 2025-11-26 15:56:01.049103 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:01.049202 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.026) 0:00:01.719 **** 2025-11-26 15:56:01.088234 | controller | 2025-11-26 15:56:01.088323 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-26 15:56:01.088430 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.039) 0:00:01.758 **** 2025-11-26 15:56:01.112871 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-26 15:56:01.112974 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-26 15:56:01.113144 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-26 15:56:01.113211 | controller | collisions and unexpected behavior. 2025-11-26 15:56:01.131329 | controller | ok: [instance] => (item=controller) 2025-11-26 15:56:01.131428 | controller | 2025-11-26 15:56:01.131531 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-26 15:56:01.131653 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.043) 0:00:01.801 **** 2025-11-26 15:56:01.176352 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:56:01.176438 | controller | assertion: _all_nets | difference(_defined) | length == 0 2025-11-26 15:56:01.176532 | controller | evaluated_to: false 2025-11-26 15:56:01.176701 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''foo'']' 2025-11-26 15:56:01.187512 | controller | 2025-11-26 15:56:01.187623 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-11-26 15:56:01.187757 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.056) 0:00:01.857 **** 2025-11-26 15:56:01.218287 | controller | ok: [instance] => 2025-11-26 15:56:01.218389 | controller | cifmw_libvirt_manager_configuration: 2025-11-26 15:56:01.218497 | controller | networks: 2025-11-26 15:56:01.218633 | controller | public: defined 2025-11-26 15:56:01.218732 | controller | vms: 2025-11-26 15:56:01.218837 | controller | controller: 2025-11-26 15:56:01.218929 | controller | nets: 2025-11-26 15:56:01.219035 | controller | - public 2025-11-26 15:56:01.219130 | controller | 2025-11-26 15:56:01.219234 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-11-26 15:56:01.219339 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.030) 0:00:01.888 **** 2025-11-26 15:56:01.250435 | controller | skipping: [instance] 2025-11-26 15:56:01.250485 | controller | 2025-11-26 15:56:01.250647 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-11-26 15:56:01.250743 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.031) 0:00:01.920 **** 2025-11-26 15:56:01.346663 | controller | skipping: [instance] 2025-11-26 15:56:01.346720 | controller | 2025-11-26 15:56:01.346808 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-11-26 15:56:01.346917 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.096) 0:00:02.016 **** 2025-11-26 15:56:01.412200 | controller | ok: [instance] => 2025-11-26 15:56:01.412308 | controller | _cifmw_libvirt_manager_layout: 2025-11-26 15:56:01.412404 | controller | networks: 2025-11-26 15:56:01.412512 | controller | public: defined 2025-11-26 15:56:01.412633 | controller | vms: 2025-11-26 15:56:01.412763 | controller | controller: 2025-11-26 15:56:01.412857 | controller | nets: 2025-11-26 15:56:01.412943 | controller | - public 2025-11-26 15:56:01.413053 | controller | - foo 2025-11-26 15:56:01.413143 | controller | 2025-11-26 15:56:01.413236 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-11-26 15:56:01.413334 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.065) 0:00:02.082 **** 2025-11-26 15:56:01.424483 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:56:01.424570 | controller | msg: Error detected, please check assertions and debugging output above. 2025-11-26 15:56:01.450934 | controller | 2025-11-26 15:56:01.451039 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 15:56:01.451164 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.022) 0:00:02.104 **** 2025-11-26 15:56:01.451272 | controller | 2025-11-26 15:56:01.451398 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:01.451499 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.016) 0:00:02.121 **** 2025-11-26 15:56:01.472391 | controller | ok: [instance] 2025-11-26 15:56:01.472492 | controller | 2025-11-26 15:56:01.472610 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:01.472738 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.021) 0:00:02.142 **** 2025-11-26 15:56:01.513280 | controller | skipping: [instance] 2025-11-26 15:56:01.513352 | controller | 2025-11-26 15:56:01.513463 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:01.513568 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.040) 0:00:02.183 **** 2025-11-26 15:56:01.546540 | controller | skipping: [instance] 2025-11-26 15:56:01.546640 | controller | 2025-11-26 15:56:01.546779 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:01.546906 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.033) 0:00:02.216 **** 2025-11-26 15:56:01.579770 | controller | skipping: [instance] 2025-11-26 15:56:01.579855 | controller | 2025-11-26 15:56:01.579956 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:01.580066 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.033) 0:00:02.250 **** 2025-11-26 15:56:01.603662 | controller | ok: [instance] 2025-11-26 15:56:01.603763 | controller | 2025-11-26 15:56:01.603863 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:01.603975 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.023) 0:00:02.273 **** 2025-11-26 15:56:01.629864 | controller | ok: [instance] 2025-11-26 15:56:01.629963 | controller | 2025-11-26 15:56:01.630086 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:01.630177 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.026) 0:00:02.299 **** 2025-11-26 15:56:01.655821 | controller | ok: [instance] => 2025-11-26 15:56:01.655912 | controller | msg: 'Running: Missing spine/leaf net definition' 2025-11-26 15:56:01.656000 | controller | 2025-11-26 15:56:01.656106 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:01.656200 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.026) 0:00:02.326 **** 2025-11-26 15:56:01.693852 | controller | 2025-11-26 15:56:01.693957 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-26 15:56:01.694050 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.038) 0:00:02.364 **** 2025-11-26 15:56:01.718098 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-26 15:56:01.718153 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-26 15:56:01.718256 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-26 15:56:01.718383 | controller | collisions and unexpected behavior. 2025-11-26 15:56:01.738205 | controller | ok: [instance] => (item=controller) 2025-11-26 15:56:01.738275 | controller | 2025-11-26 15:56:01.738374 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-26 15:56:01.738479 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.044) 0:00:02.408 **** 2025-11-26 15:56:01.783944 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:56:01.784032 | controller | assertion: _all_nets | difference(_defined) | length == 0 2025-11-26 15:56:01.784131 | controller | evaluated_to: false 2025-11-26 15:56:01.784235 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''l00-s1'']' 2025-11-26 15:56:01.795203 | controller | 2025-11-26 15:56:01.795307 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-11-26 15:56:01.795403 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.056) 0:00:02.465 **** 2025-11-26 15:56:01.824965 | controller | ok: [instance] => 2025-11-26 15:56:01.825060 | controller | cifmw_libvirt_manager_configuration: 2025-11-26 15:56:01.825173 | controller | networks: 2025-11-26 15:56:01.825282 | controller | l00-s0: defined 2025-11-26 15:56:01.825368 | controller | public: defined 2025-11-26 15:56:01.825468 | controller | vms: 2025-11-26 15:56:01.825560 | controller | controller: 2025-11-26 15:56:01.825679 | controller | nets: 2025-11-26 15:56:01.825798 | controller | - public 2025-11-26 15:56:01.825936 | controller | spineleafnets: 2025-11-26 15:56:01.826037 | controller | - l00-s0 2025-11-26 15:56:01.826122 | controller | 2025-11-26 15:56:01.826234 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-11-26 15:56:01.826327 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.029) 0:00:02.495 **** 2025-11-26 15:56:01.852577 | controller | skipping: [instance] 2025-11-26 15:56:01.852724 | controller | 2025-11-26 15:56:01.852826 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-11-26 15:56:01.852942 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.027) 0:00:02.522 **** 2025-11-26 15:56:01.923889 | controller | skipping: [instance] 2025-11-26 15:56:01.923973 | controller | 2025-11-26 15:56:01.924090 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-11-26 15:56:01.924223 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.071) 0:00:02.594 **** 2025-11-26 15:56:01.963427 | controller | ok: [instance] => 2025-11-26 15:56:01.963522 | controller | _cifmw_libvirt_manager_layout: 2025-11-26 15:56:01.963654 | controller | networks: 2025-11-26 15:56:01.963740 | controller | l00-s0: defined 2025-11-26 15:56:01.963846 | controller | public: defined 2025-11-26 15:56:01.963944 | controller | vms: 2025-11-26 15:56:01.964041 | controller | controller: 2025-11-26 15:56:01.964143 | controller | nets: 2025-11-26 15:56:01.964244 | controller | - public 2025-11-26 15:56:01.964330 | controller | spineleafnets: 2025-11-26 15:56:01.964421 | controller | - l00-s0 2025-11-26 15:56:01.964521 | controller | - l00-s1 2025-11-26 15:56:01.964643 | controller | 2025-11-26 15:56:01.964747 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-11-26 15:56:01.964842 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.039) 0:00:02.633 **** 2025-11-26 15:56:01.979914 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:56:01.980035 | controller | msg: Error detected, please check assertions and debugging output above. 2025-11-26 15:56:02.005037 | controller | 2025-11-26 15:56:02.005145 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 15:56:02.005246 | controller | Wednesday 26 November 2025 15:56:01 +0000 (0:00:00.024) 0:00:02.658 **** 2025-11-26 15:56:02.005341 | controller | 2025-11-26 15:56:02.005435 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:02.005537 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.016) 0:00:02.674 **** 2025-11-26 15:56:02.027648 | controller | ok: [instance] 2025-11-26 15:56:02.027730 | controller | 2025-11-26 15:56:02.027843 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:02.027935 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.022) 0:00:02.697 **** 2025-11-26 15:56:02.066083 | controller | skipping: [instance] 2025-11-26 15:56:02.066161 | controller | 2025-11-26 15:56:02.066258 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:02.066355 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.038) 0:00:02.736 **** 2025-11-26 15:56:02.096958 | controller | skipping: [instance] 2025-11-26 15:56:02.097043 | controller | 2025-11-26 15:56:02.097149 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:02.097243 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.030) 0:00:02.767 **** 2025-11-26 15:56:02.156817 | controller | skipping: [instance] 2025-11-26 15:56:02.156883 | controller | 2025-11-26 15:56:02.157015 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:02.157101 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.059) 0:00:02.827 **** 2025-11-26 15:56:02.180470 | controller | ok: [instance] 2025-11-26 15:56:02.180551 | controller | 2025-11-26 15:56:02.180693 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:02.180788 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.023) 0:00:02.850 **** 2025-11-26 15:56:02.208650 | controller | ok: [instance] 2025-11-26 15:56:02.208775 | controller | 2025-11-26 15:56:02.208882 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:02.208974 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.028) 0:00:02.878 **** 2025-11-26 15:56:02.235860 | controller | ok: [instance] => 2025-11-26 15:56:02.235959 | controller | msg: 'Running: No network for a VM' 2025-11-26 15:56:02.236073 | controller | 2025-11-26 15:56:02.236178 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:02.236289 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.027) 0:00:02.906 **** 2025-11-26 15:56:02.276952 | controller | 2025-11-26 15:56:02.277059 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-26 15:56:02.277159 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.041) 0:00:02.947 **** 2025-11-26 15:56:02.302210 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-26 15:56:02.302346 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-26 15:56:02.302390 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-26 15:56:02.302510 | controller | collisions and unexpected behavior. 2025-11-26 15:56:02.315743 | controller | failed: [instance] (item=foo) => changed=false 2025-11-26 15:56:02.315846 | controller | ansible_loop_var: item 2025-11-26 15:56:02.315954 | controller | assertion: item.value.nets is defined 2025-11-26 15:56:02.316070 | controller | evaluated_to: false 2025-11-26 15:56:02.316164 | controller | item: 2025-11-26 15:56:02.316263 | controller | key: foo 2025-11-26 15:56:02.316359 | controller | value: 2025-11-26 15:56:02.316455 | controller | disksize: 10 2025-11-26 15:56:02.316559 | controller | msg: 'Inconsistency detected: VM type "foo" doesn''t seem to have any network.' 2025-11-26 15:56:02.326869 | controller | ok: [instance] => (item=controller) 2025-11-26 15:56:02.326953 | controller | 2025-11-26 15:56:02.327081 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-11-26 15:56:02.327197 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.049) 0:00:02.997 **** 2025-11-26 15:56:02.361095 | controller | ok: [instance] => 2025-11-26 15:56:02.361201 | controller | cifmw_libvirt_manager_configuration: 2025-11-26 15:56:02.361315 | controller | networks: 2025-11-26 15:56:02.361415 | controller | public: defined 2025-11-26 15:56:02.361516 | controller | vms: 2025-11-26 15:56:02.361646 | controller | controller: 2025-11-26 15:56:02.361748 | controller | nets: 2025-11-26 15:56:02.361851 | controller | - public 2025-11-26 15:56:02.361938 | controller | 2025-11-26 15:56:02.362046 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-11-26 15:56:02.362150 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.034) 0:00:03.031 **** 2025-11-26 15:56:02.390502 | controller | skipping: [instance] 2025-11-26 15:56:02.390579 | controller | 2025-11-26 15:56:02.390706 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-11-26 15:56:02.390799 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.029) 0:00:03.060 **** 2025-11-26 15:56:02.466396 | controller | skipping: [instance] 2025-11-26 15:56:02.466455 | controller | 2025-11-26 15:56:02.466525 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-11-26 15:56:02.466644 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.075) 0:00:03.136 **** 2025-11-26 15:56:02.510062 | controller | ok: [instance] => 2025-11-26 15:56:02.510170 | controller | _cifmw_libvirt_manager_layout: 2025-11-26 15:56:02.510271 | controller | networks: 2025-11-26 15:56:02.510369 | controller | public: defined 2025-11-26 15:56:02.510466 | controller | vms: 2025-11-26 15:56:02.510568 | controller | controller: 2025-11-26 15:56:02.510707 | controller | nets: 2025-11-26 15:56:02.510833 | controller | - public 2025-11-26 15:56:02.510930 | controller | foo: 2025-11-26 15:56:02.511028 | controller | disksize: 10 2025-11-26 15:56:02.511122 | controller | 2025-11-26 15:56:02.511222 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-11-26 15:56:02.511324 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.043) 0:00:03.180 **** 2025-11-26 15:56:02.524766 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:56:02.524875 | controller | msg: Error detected, please check assertions and debugging output above. 2025-11-26 15:56:02.552520 | controller | 2025-11-26 15:56:02.552637 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 15:56:02.552762 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.026) 0:00:03.206 **** 2025-11-26 15:56:02.552873 | controller | 2025-11-26 15:56:02.552955 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:02.553093 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.015) 0:00:03.222 **** 2025-11-26 15:56:02.577240 | controller | ok: [instance] 2025-11-26 15:56:02.577328 | controller | 2025-11-26 15:56:02.577432 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:02.577562 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.024) 0:00:03.247 **** 2025-11-26 15:56:02.613429 | controller | skipping: [instance] 2025-11-26 15:56:02.613521 | controller | 2025-11-26 15:56:02.613702 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:02.613789 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.034) 0:00:03.282 **** 2025-11-26 15:56:02.647846 | controller | skipping: [instance] 2025-11-26 15:56:02.647945 | controller | 2025-11-26 15:56:02.648072 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:02.648170 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.036) 0:00:03.318 **** 2025-11-26 15:56:02.680484 | controller | skipping: [instance] 2025-11-26 15:56:02.680568 | controller | 2025-11-26 15:56:02.680687 | controller | TASK [Fail if needed] ********************************************************** 2025-11-26 15:56:02.680794 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.032) 0:00:03.350 **** 2025-11-26 15:56:02.735820 | controller | skipping: [instance] 2025-11-26 15:56:02.735942 | controller | 2025-11-26 15:56:02.736083 | controller | PLAY RECAP ********************************************************************* 2025-11-26 15:56:02.736120 | controller | instance : ok=48 changed=0 unreachable=0 failed=0 skipped=27 rescued=8 ignored=0 2025-11-26 15:56:02.736210 | controller | 2025-11-26 15:56:02.736301 | controller | Wednesday 26 November 2025 15:56:02 +0000 (0:00:00.055) 0:00:03.405 **** 2025-11-26 15:56:02.736392 | controller | =============================================================================== 2025-11-26 15:56:02.736485 | controller | reproducer : Dump layout patches ---------------------------------------- 0.10s 2025-11-26 15:56:02.736567 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.09s 2025-11-26 15:56:02.736718 | controller | reproducer : Dump layout patches ---------------------------------------- 0.08s 2025-11-26 15:56:02.736766 | controller | reproducer : Dump layout patches ---------------------------------------- 0.07s 2025-11-26 15:56:02.736855 | controller | reproducer : Dump layout patches ---------------------------------------- 0.07s 2025-11-26 15:56:02.736946 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.07s 2025-11-26 15:56:02.737046 | controller | reproducer : Dump built layout ------------------------------------------ 0.07s 2025-11-26 15:56:02.737146 | controller | Test network validations ------------------------------------------------ 0.06s 2025-11-26 15:56:02.737237 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2025-11-26 15:56:02.737412 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2025-11-26 15:56:02.737448 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-11-26 15:56:02.737548 | controller | Append failed scenario to list ------------------------------------------ 0.06s 2025-11-26 15:56:02.737761 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2025-11-26 15:56:02.737904 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-11-26 15:56:02.737918 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-11-26 15:56:02.737954 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-11-26 15:56:02.738057 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-11-26 15:56:02.738122 | controller | Fail if needed ---------------------------------------------------------- 0.06s 2025-11-26 15:56:02.738209 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.05s 2025-11-26 15:56:02.738303 | controller | Validate data ----------------------------------------------------------- 0.05s 2025-11-26 15:56:02.806420 | controller | INFO Running network_validations > cleanup 2025-11-26 15:56:02.806877 | controller | WARNING Skipping, cleanup playbook not configured. 2025-11-26 15:56:02.814332 | controller | INFO Running ocp_validations > prepare 2025-11-26 15:56:02.814763 | controller | WARNING Skipping, prepare playbook not configured. 2025-11-26 15:56:02.822674 | controller | INFO Running ocp_validations > converge 2025-11-26 15:56:03.253127 | controller | 2025-11-26 15:56:03.253210 | controller | PLAY [Prepare] ***************************************************************** 2025-11-26 15:56:03.253304 | controller | 2025-11-26 15:56:03.253409 | controller | TASK [Set failed fact] ********************************************************* 2025-11-26 15:56:03.253517 | controller | Wednesday 26 November 2025 15:56:03 +0000 (0:00:00.033) 0:00:00.033 **** 2025-11-26 15:56:03.274764 | controller | ok: [instance] 2025-11-26 15:56:03.274850 | controller | 2025-11-26 15:56:03.274961 | controller | TASK [Load scenarios] ********************************************************** 2025-11-26 15:56:03.275086 | controller | Wednesday 26 November 2025 15:56:03 +0000 (0:00:00.022) 0:00:00.055 **** 2025-11-26 15:56:03.299778 | controller | ok: [instance] 2025-11-26 15:56:03.299867 | controller | 2025-11-26 15:56:03.299982 | controller | TASK [Test no volumes] ********************************************************* 2025-11-26 15:56:03.300095 | controller | Wednesday 26 November 2025 15:56:03 +0000 (0:00:00.025) 0:00:00.080 **** 2025-11-26 15:56:03.397840 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, no worker) 2025-11-26 15:56:03.397947 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, with worker) 2025-11-26 15:56:03.398068 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, no worker) 2025-11-26 15:56:03.398168 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, with worker) 2025-11-26 15:56:03.398271 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Too many allocated volumes) 2025-11-26 15:56:03.398369 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Different volume amount) 2025-11-26 15:56:03.398467 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVM without volume) 2025-11-26 15:56:03.398564 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVMS without volume) 2025-11-26 15:56:03.398693 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice) 2025-11-26 15:56:03.398789 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no LVMS) 2025-11-26 15:56:03.398886 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no cinder_lvm) 2025-11-26 15:56:03.398982 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Config overrides via devscripts) 2025-11-26 15:56:03.399095 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 10 dev-scripts extra_worker) 2025-11-26 15:56:03.399190 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 0 dev-scripts extra_worker) 2025-11-26 15:56:03.399274 | controller | 2025-11-26 15:56:03.399363 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:03.399452 | controller | Wednesday 26 November 2025 15:56:03 +0000 (0:00:00.097) 0:00:00.178 **** 2025-11-26 15:56:03.420416 | controller | ok: [instance] 2025-11-26 15:56:03.420498 | controller | 2025-11-26 15:56:03.420623 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:03.420743 | controller | Wednesday 26 November 2025 15:56:03 +0000 (0:00:00.022) 0:00:00.201 **** 2025-11-26 15:56:03.446574 | controller | ok: [instance] 2025-11-26 15:56:03.446691 | controller | 2025-11-26 15:56:03.446790 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:03.446887 | controller | Wednesday 26 November 2025 15:56:03 +0000 (0:00:00.025) 0:00:00.227 **** 2025-11-26 15:56:03.472180 | controller | ok: [instance] => 2025-11-26 15:56:03.472272 | controller | msg: 'Running: No volume, no worker' 2025-11-26 15:56:03.472368 | controller | 2025-11-26 15:56:03.472466 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:03.472560 | controller | Wednesday 26 November 2025 15:56:03 +0000 (0:00:00.025) 0:00:00.252 **** 2025-11-26 15:56:03.538271 | controller | 2025-11-26 15:56:03.538374 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 15:56:03.538482 | controller | Wednesday 26 November 2025 15:56:03 +0000 (0:00:00.066) 0:00:00.318 **** 2025-11-26 15:56:03.594120 | controller | ok: [instance] 2025-11-26 15:56:03.594201 | controller | 2025-11-26 15:56:03.594300 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 15:56:03.594394 | controller | Wednesday 26 November 2025 15:56:03 +0000 (0:00:00.055) 0:00:00.374 **** 2025-11-26 15:56:03.636926 | controller | ok: [instance] 2025-11-26 15:56:03.637025 | controller | 2025-11-26 15:56:03.637142 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 15:56:03.637250 | controller | Wednesday 26 November 2025 15:56:03 +0000 (0:00:00.042) 0:00:00.417 **** 2025-11-26 15:56:03.703881 | controller | ok: [instance] 2025-11-26 15:56:03.703963 | controller | 2025-11-26 15:56:03.704074 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 15:56:03.704171 | controller | Wednesday 26 November 2025 15:56:03 +0000 (0:00:00.067) 0:00:00.484 **** 2025-11-26 15:56:03.745140 | controller | skipping: [instance] 2025-11-26 15:56:03.745231 | controller | 2025-11-26 15:56:03.745331 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 15:56:03.745439 | controller | Wednesday 26 November 2025 15:56:03 +0000 (0:00:00.041) 0:00:00.525 **** 2025-11-26 15:56:03.796774 | controller | ok: [instance] 2025-11-26 15:56:03.796850 | controller | 2025-11-26 15:56:03.796953 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 15:56:03.797064 | controller | Wednesday 26 November 2025 15:56:03 +0000 (0:00:00.051) 0:00:00.577 **** 2025-11-26 15:56:03.840946 | controller | skipping: [instance] 2025-11-26 15:56:03.840997 | controller | 2025-11-26 15:56:03.841143 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 15:56:03.841232 | controller | Wednesday 26 November 2025 15:56:03 +0000 (0:00:00.044) 0:00:00.621 **** 2025-11-26 15:56:03.885297 | controller | skipping: [instance] 2025-11-26 15:56:03.885387 | controller | 2025-11-26 15:56:03.885492 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 15:56:03.885589 | controller | Wednesday 26 November 2025 15:56:03 +0000 (0:00:00.044) 0:00:00.665 **** 2025-11-26 15:56:03.927662 | controller | skipping: [instance] 2025-11-26 15:56:03.927751 | controller | 2025-11-26 15:56:03.927871 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-26 15:56:03.927978 | controller | Wednesday 26 November 2025 15:56:03 +0000 (0:00:00.042) 0:00:00.708 **** 2025-11-26 15:56:03.980729 | controller | skipping: [instance] 2025-11-26 15:56:03.980824 | controller | 2025-11-26 15:56:03.980944 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-26 15:56:03.981043 | controller | Wednesday 26 November 2025 15:56:03 +0000 (0:00:00.052) 0:00:00.761 **** 2025-11-26 15:56:04.025385 | controller | skipping: [instance] 2025-11-26 15:56:04.025478 | controller | 2025-11-26 15:56:04.025576 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-26 15:56:04.025697 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.044) 0:00:00.805 **** 2025-11-26 15:56:04.075962 | controller | skipping: [instance] 2025-11-26 15:56:04.076053 | controller | 2025-11-26 15:56:04.076152 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:04.076242 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.050) 0:00:00.856 **** 2025-11-26 15:56:04.111350 | controller | skipping: [instance] 2025-11-26 15:56:04.111431 | controller | 2025-11-26 15:56:04.111534 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:04.111686 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.035) 0:00:00.892 **** 2025-11-26 15:56:04.145537 | controller | skipping: [instance] 2025-11-26 15:56:04.145631 | controller | 2025-11-26 15:56:04.145751 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:04.145847 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.034) 0:00:00.926 **** 2025-11-26 15:56:04.185733 | controller | skipping: [instance] 2025-11-26 15:56:04.185829 | controller | 2025-11-26 15:56:04.185937 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:04.186045 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.040) 0:00:00.966 **** 2025-11-26 15:56:04.209620 | controller | ok: [instance] 2025-11-26 15:56:04.209728 | controller | 2025-11-26 15:56:04.209842 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:04.209946 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.023) 0:00:00.990 **** 2025-11-26 15:56:04.236896 | controller | ok: [instance] 2025-11-26 15:56:04.236980 | controller | 2025-11-26 15:56:04.237097 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:04.237217 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.027) 0:00:01.017 **** 2025-11-26 15:56:04.262795 | controller | ok: [instance] => 2025-11-26 15:56:04.262897 | controller | msg: 'Running: No volume, with worker' 2025-11-26 15:56:04.262992 | controller | 2025-11-26 15:56:04.263110 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:04.263214 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.025) 0:00:01.043 **** 2025-11-26 15:56:04.302418 | controller | 2025-11-26 15:56:04.302508 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 15:56:04.302634 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.039) 0:00:01.083 **** 2025-11-26 15:56:04.364373 | controller | ok: [instance] 2025-11-26 15:56:04.364452 | controller | 2025-11-26 15:56:04.365120 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 15:56:04.416172 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.061) 0:00:01.144 **** 2025-11-26 15:56:04.416205 | controller | ok: [instance] 2025-11-26 15:56:04.416268 | controller | 2025-11-26 15:56:04.416385 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 15:56:04.416488 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.051) 0:00:01.196 **** 2025-11-26 15:56:04.551253 | controller | ok: [instance] 2025-11-26 15:56:04.551331 | controller | 2025-11-26 15:56:04.551437 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 15:56:04.551539 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.134) 0:00:01.331 **** 2025-11-26 15:56:04.625791 | controller | ok: [instance] 2025-11-26 15:56:04.625888 | controller | 2025-11-26 15:56:04.625978 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 15:56:04.626092 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.074) 0:00:01.406 **** 2025-11-26 15:56:04.680477 | controller | ok: [instance] 2025-11-26 15:56:04.680578 | controller | 2025-11-26 15:56:04.680745 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 15:56:04.680848 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.054) 0:00:01.460 **** 2025-11-26 15:56:04.724583 | controller | skipping: [instance] 2025-11-26 15:56:04.724701 | controller | 2025-11-26 15:56:04.724799 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 15:56:04.724925 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.043) 0:00:01.504 **** 2025-11-26 15:56:04.770949 | controller | skipping: [instance] 2025-11-26 15:56:04.771052 | controller | 2025-11-26 15:56:04.771168 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 15:56:04.771272 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.046) 0:00:01.551 **** 2025-11-26 15:56:04.822560 | controller | skipping: [instance] 2025-11-26 15:56:04.822760 | controller | 2025-11-26 15:56:04.822791 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-26 15:56:04.823378 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.051) 0:00:01.602 **** 2025-11-26 15:56:04.875958 | controller | skipping: [instance] 2025-11-26 15:56:04.876060 | controller | 2025-11-26 15:56:04.876167 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-26 15:56:04.876270 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.053) 0:00:01.656 **** 2025-11-26 15:56:04.922703 | controller | skipping: [instance] 2025-11-26 15:56:04.922785 | controller | 2025-11-26 15:56:04.922893 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-26 15:56:04.922998 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.046) 0:00:01.703 **** 2025-11-26 15:56:04.977587 | controller | skipping: [instance] 2025-11-26 15:56:04.978002 | controller | 2025-11-26 15:56:04.978129 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:04.978226 | controller | Wednesday 26 November 2025 15:56:04 +0000 (0:00:00.054) 0:00:01.757 **** 2025-11-26 15:56:05.023296 | controller | skipping: [instance] 2025-11-26 15:56:05.023394 | controller | 2025-11-26 15:56:05.023502 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:05.023638 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.046) 0:00:01.803 **** 2025-11-26 15:56:05.063989 | controller | skipping: [instance] 2025-11-26 15:56:05.064086 | controller | 2025-11-26 15:56:05.064183 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:05.064285 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.040) 0:00:01.844 **** 2025-11-26 15:56:05.107643 | controller | skipping: [instance] 2025-11-26 15:56:05.108097 | controller | 2025-11-26 15:56:05.108218 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:05.108304 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.043) 0:00:01.888 **** 2025-11-26 15:56:05.135971 | controller | ok: [instance] 2025-11-26 15:56:05.136084 | controller | 2025-11-26 15:56:05.136184 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:05.136279 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.028) 0:00:01.916 **** 2025-11-26 15:56:05.167939 | controller | ok: [instance] 2025-11-26 15:56:05.168041 | controller | 2025-11-26 15:56:05.168059 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:05.168116 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.031) 0:00:01.947 **** 2025-11-26 15:56:05.201291 | controller | ok: [instance] => 2025-11-26 15:56:05.201377 | controller | msg: 'Running: Volume, no worker' 2025-11-26 15:56:05.201479 | controller | 2025-11-26 15:56:05.201575 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:05.201714 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.033) 0:00:01.981 **** 2025-11-26 15:56:05.250616 | controller | 2025-11-26 15:56:05.250755 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 15:56:05.250862 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.049) 0:00:02.030 **** 2025-11-26 15:56:05.310654 | controller | ok: [instance] 2025-11-26 15:56:05.310737 | controller | 2025-11-26 15:56:05.310848 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 15:56:05.310946 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.060) 0:00:02.091 **** 2025-11-26 15:56:05.358156 | controller | ok: [instance] 2025-11-26 15:56:05.358235 | controller | 2025-11-26 15:56:05.358334 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 15:56:05.358435 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.047) 0:00:02.138 **** 2025-11-26 15:56:05.429339 | controller | ok: [instance] 2025-11-26 15:56:05.429422 | controller | 2025-11-26 15:56:05.429522 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 15:56:05.429638 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.071) 0:00:02.209 **** 2025-11-26 15:56:05.478403 | controller | skipping: [instance] 2025-11-26 15:56:05.478496 | controller | 2025-11-26 15:56:05.478700 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 15:56:05.478779 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.048) 0:00:02.258 **** 2025-11-26 15:56:05.524556 | controller | skipping: [instance] 2025-11-26 15:56:05.524703 | controller | 2025-11-26 15:56:05.524774 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 15:56:05.524873 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.046) 0:00:02.304 **** 2025-11-26 15:56:05.578382 | controller | ok: [instance] 2025-11-26 15:56:05.578472 | controller | 2025-11-26 15:56:05.578684 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 15:56:05.578740 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.053) 0:00:02.358 **** 2025-11-26 15:56:05.674404 | controller | skipping: [instance] 2025-11-26 15:56:05.674481 | controller | 2025-11-26 15:56:05.674624 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 15:56:05.674756 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.096) 0:00:02.454 **** 2025-11-26 15:56:05.740397 | controller | ok: [instance] 2025-11-26 15:56:05.740477 | controller | 2025-11-26 15:56:05.740578 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-26 15:56:05.740732 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.065) 0:00:02.520 **** 2025-11-26 15:56:05.813295 | controller | ok: [instance] 2025-11-26 15:56:05.813398 | controller | 2025-11-26 15:56:05.813505 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-26 15:56:05.813619 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.072) 0:00:02.593 **** 2025-11-26 15:56:05.887400 | controller | ok: [instance] => changed=false 2025-11-26 15:56:05.887487 | controller | msg: All assertions passed 2025-11-26 15:56:05.887593 | controller | 2025-11-26 15:56:05.887748 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-26 15:56:05.887854 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.074) 0:00:02.667 **** 2025-11-26 15:56:05.971768 | controller | ok: [instance] => changed=false 2025-11-26 15:56:05.971891 | controller | msg: All assertions passed 2025-11-26 15:56:05.971993 | controller | 2025-11-26 15:56:05.972121 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:05.972220 | controller | Wednesday 26 November 2025 15:56:05 +0000 (0:00:00.083) 0:00:02.751 **** 2025-11-26 15:56:06.012486 | controller | skipping: [instance] 2025-11-26 15:56:06.012544 | controller | 2025-11-26 15:56:06.012661 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:06.012791 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.041) 0:00:02.792 **** 2025-11-26 15:56:06.046379 | controller | skipping: [instance] 2025-11-26 15:56:06.046469 | controller | 2025-11-26 15:56:06.046574 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:06.046714 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.034) 0:00:02.826 **** 2025-11-26 15:56:06.088731 | controller | skipping: [instance] 2025-11-26 15:56:06.088896 | controller | 2025-11-26 15:56:06.088925 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:06.089059 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.042) 0:00:02.869 **** 2025-11-26 15:56:06.113976 | controller | ok: [instance] 2025-11-26 15:56:06.114084 | controller | 2025-11-26 15:56:06.114362 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:06.114477 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.025) 0:00:02.894 **** 2025-11-26 15:56:06.142932 | controller | ok: [instance] 2025-11-26 15:56:06.143040 | controller | 2025-11-26 15:56:06.143160 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:06.143259 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.029) 0:00:02.923 **** 2025-11-26 15:56:06.169958 | controller | ok: [instance] => 2025-11-26 15:56:06.170077 | controller | msg: 'Running: Volume, with worker' 2025-11-26 15:56:06.170160 | controller | 2025-11-26 15:56:06.170272 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:06.170380 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.026) 0:00:02.950 **** 2025-11-26 15:56:06.213771 | controller | 2025-11-26 15:56:06.213909 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 15:56:06.214067 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.043) 0:00:02.994 **** 2025-11-26 15:56:06.275799 | controller | ok: [instance] 2025-11-26 15:56:06.275897 | controller | 2025-11-26 15:56:06.276020 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 15:56:06.276117 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.061) 0:00:03.056 **** 2025-11-26 15:56:06.322930 | controller | ok: [instance] 2025-11-26 15:56:06.323000 | controller | 2025-11-26 15:56:06.323137 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 15:56:06.323465 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.046) 0:00:03.102 **** 2025-11-26 15:56:06.399263 | controller | ok: [instance] 2025-11-26 15:56:06.399311 | controller | 2025-11-26 15:56:06.399426 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 15:56:06.399531 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.076) 0:00:03.179 **** 2025-11-26 15:56:06.469669 | controller | ok: [instance] 2025-11-26 15:56:06.469758 | controller | 2025-11-26 15:56:06.469866 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 15:56:06.469978 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.070) 0:00:03.249 **** 2025-11-26 15:56:06.515562 | controller | skipping: [instance] 2025-11-26 15:56:06.515691 | controller | 2025-11-26 15:56:06.515801 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 15:56:06.515914 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.045) 0:00:03.295 **** 2025-11-26 15:56:06.560959 | controller | ok: [instance] 2025-11-26 15:56:06.561045 | controller | 2025-11-26 15:56:06.561156 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 15:56:06.561271 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.045) 0:00:03.341 **** 2025-11-26 15:56:06.615714 | controller | ok: [instance] 2025-11-26 15:56:06.615782 | controller | 2025-11-26 15:56:06.615894 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 15:56:06.616001 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.054) 0:00:03.396 **** 2025-11-26 15:56:06.687627 | controller | ok: [instance] 2025-11-26 15:56:06.687675 | controller | 2025-11-26 15:56:06.687809 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-26 15:56:06.687894 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.071) 0:00:03.467 **** 2025-11-26 15:56:06.800223 | controller | ok: [instance] 2025-11-26 15:56:06.800270 | controller | 2025-11-26 15:56:06.800395 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-26 15:56:06.800492 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.112) 0:00:03.580 **** 2025-11-26 15:56:06.876682 | controller | ok: [instance] => changed=false 2025-11-26 15:56:06.876771 | controller | msg: All assertions passed 2025-11-26 15:56:06.876898 | controller | 2025-11-26 15:56:06.877036 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-26 15:56:06.877136 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.076) 0:00:03.656 **** 2025-11-26 15:56:06.957040 | controller | ok: [instance] => changed=false 2025-11-26 15:56:06.957134 | controller | msg: All assertions passed 2025-11-26 15:56:06.957230 | controller | 2025-11-26 15:56:06.957347 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:06.957445 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.080) 0:00:03.737 **** 2025-11-26 15:56:06.994285 | controller | skipping: [instance] 2025-11-26 15:56:06.994361 | controller | 2025-11-26 15:56:06.994474 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:06.994676 | controller | Wednesday 26 November 2025 15:56:06 +0000 (0:00:00.037) 0:00:03.774 **** 2025-11-26 15:56:07.025991 | controller | skipping: [instance] 2025-11-26 15:56:07.026247 | controller | 2025-11-26 15:56:07.026392 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:07.026500 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.031) 0:00:03.806 **** 2025-11-26 15:56:07.065389 | controller | skipping: [instance] 2025-11-26 15:56:07.065535 | controller | 2025-11-26 15:56:07.065666 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:07.065778 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.036) 0:00:03.843 **** 2025-11-26 15:56:07.089053 | controller | ok: [instance] 2025-11-26 15:56:07.089182 | controller | 2025-11-26 15:56:07.089245 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:07.089348 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.026) 0:00:03.869 **** 2025-11-26 15:56:07.117790 | controller | ok: [instance] 2025-11-26 15:56:07.117878 | controller | 2025-11-26 15:56:07.117986 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:07.118107 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.028) 0:00:03.897 **** 2025-11-26 15:56:07.143706 | controller | ok: [instance] => 2025-11-26 15:56:07.143777 | controller | msg: 'Running: Too many allocated volumes' 2025-11-26 15:56:07.143873 | controller | 2025-11-26 15:56:07.143981 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:07.144186 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.026) 0:00:03.924 **** 2025-11-26 15:56:07.185947 | controller | 2025-11-26 15:56:07.186066 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 15:56:07.186179 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.042) 0:00:03.966 **** 2025-11-26 15:56:07.244550 | controller | ok: [instance] 2025-11-26 15:56:07.244699 | controller | 2025-11-26 15:56:07.244803 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 15:56:07.244912 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.058) 0:00:04.025 **** 2025-11-26 15:56:07.287551 | controller | ok: [instance] 2025-11-26 15:56:07.287633 | controller | 2025-11-26 15:56:07.287774 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 15:56:07.287872 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.042) 0:00:04.068 **** 2025-11-26 15:56:07.357236 | controller | ok: [instance] 2025-11-26 15:56:07.357332 | controller | 2025-11-26 15:56:07.357440 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 15:56:07.357543 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.069) 0:00:04.137 **** 2025-11-26 15:56:07.396030 | controller | skipping: [instance] 2025-11-26 15:56:07.396132 | controller | 2025-11-26 15:56:07.396236 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 15:56:07.396351 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.038) 0:00:04.176 **** 2025-11-26 15:56:07.437837 | controller | skipping: [instance] 2025-11-26 15:56:07.437931 | controller | 2025-11-26 15:56:07.438049 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 15:56:07.438164 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.041) 0:00:04.218 **** 2025-11-26 15:56:07.485733 | controller | ok: [instance] 2025-11-26 15:56:07.485857 | controller | 2025-11-26 15:56:07.485943 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 15:56:07.486054 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.047) 0:00:04.266 **** 2025-11-26 15:56:07.527855 | controller | skipping: [instance] 2025-11-26 15:56:07.527955 | controller | 2025-11-26 15:56:07.528082 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 15:56:07.528198 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.042) 0:00:04.308 **** 2025-11-26 15:56:07.585561 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:56:07.585706 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2025-11-26 15:56:07.585796 | controller | evaluated_to: false 2025-11-26 15:56:07.585914 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 3' 2025-11-26 15:56:07.612916 | controller | 2025-11-26 15:56:07.613028 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 15:56:07.613130 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.068) 0:00:04.376 **** 2025-11-26 15:56:07.613213 | controller | 2025-11-26 15:56:07.613306 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:07.613411 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.016) 0:00:04.393 **** 2025-11-26 15:56:07.636373 | controller | ok: [instance] 2025-11-26 15:56:07.636467 | controller | 2025-11-26 15:56:07.636582 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:07.636738 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.023) 0:00:04.416 **** 2025-11-26 15:56:07.676591 | controller | skipping: [instance] 2025-11-26 15:56:07.676772 | controller | 2025-11-26 15:56:07.676984 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:07.677098 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.039) 0:00:04.456 **** 2025-11-26 15:56:07.739957 | controller | skipping: [instance] 2025-11-26 15:56:07.740000 | controller | 2025-11-26 15:56:07.740138 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:07.740256 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.063) 0:00:04.520 **** 2025-11-26 15:56:07.773646 | controller | skipping: [instance] 2025-11-26 15:56:07.773730 | controller | 2025-11-26 15:56:07.773830 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:07.773939 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.033) 0:00:04.554 **** 2025-11-26 15:56:07.797433 | controller | ok: [instance] 2025-11-26 15:56:07.797513 | controller | 2025-11-26 15:56:07.797642 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:07.797774 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.023) 0:00:04.578 **** 2025-11-26 15:56:07.823951 | controller | ok: [instance] 2025-11-26 15:56:07.824047 | controller | 2025-11-26 15:56:07.824170 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:07.824281 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.026) 0:00:04.604 **** 2025-11-26 15:56:07.850928 | controller | ok: [instance] => 2025-11-26 15:56:07.851031 | controller | msg: 'Running: Different volume amount' 2025-11-26 15:56:07.851134 | controller | 2025-11-26 15:56:07.851232 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:07.851338 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.027) 0:00:04.631 **** 2025-11-26 15:56:07.892109 | controller | 2025-11-26 15:56:07.892278 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 15:56:07.892299 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.041) 0:00:04.672 **** 2025-11-26 15:56:07.949147 | controller | ok: [instance] 2025-11-26 15:56:07.949229 | controller | 2025-11-26 15:56:07.949327 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 15:56:07.949441 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.057) 0:00:04.729 **** 2025-11-26 15:56:07.992765 | controller | ok: [instance] 2025-11-26 15:56:07.992851 | controller | 2025-11-26 15:56:07.992971 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 15:56:07.993085 | controller | Wednesday 26 November 2025 15:56:07 +0000 (0:00:00.043) 0:00:04.773 **** 2025-11-26 15:56:08.063946 | controller | ok: [instance] 2025-11-26 15:56:08.064036 | controller | 2025-11-26 15:56:08.064148 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 15:56:08.064247 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.071) 0:00:04.844 **** 2025-11-26 15:56:08.140519 | controller | ok: [instance] 2025-11-26 15:56:08.140630 | controller | 2025-11-26 15:56:08.140738 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 15:56:08.140978 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.076) 0:00:04.920 **** 2025-11-26 15:56:08.184268 | controller | skipping: [instance] 2025-11-26 15:56:08.184359 | controller | 2025-11-26 15:56:08.184466 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 15:56:08.184587 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.043) 0:00:04.964 **** 2025-11-26 15:56:08.233706 | controller | ok: [instance] 2025-11-26 15:56:08.233801 | controller | 2025-11-26 15:56:08.233820 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 15:56:08.233831 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.049) 0:00:05.013 **** 2025-11-26 15:56:08.280626 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:56:08.280728 | controller | assertion: (_work.extra_disks_num is defined and _ocp.extra_disks_num == _work.extra_disks_num and _ocp.extra_disks_size is defined and _work.extra_disks_size is defined and _ocp.extra_disks_size == _work.extra_disks_size) or _ocp.extra_disks_num is undefined or _ocp.extra_disks_num == 0 2025-11-26 15:56:08.280837 | controller | evaluated_to: false 2025-11-26 15:56:08.280950 | controller | msg: 'Inconsistency detected: ensure you don''t allocate more disks in cifmw_lvms_disk_list and cifmw_devscripts_cinder_volume_pvs than available.' 2025-11-26 15:56:08.308381 | controller | 2025-11-26 15:56:08.308479 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 15:56:08.308613 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.057) 0:00:05.071 **** 2025-11-26 15:56:08.308734 | controller | 2025-11-26 15:56:08.308828 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:08.308925 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.016) 0:00:05.088 **** 2025-11-26 15:56:08.332336 | controller | ok: [instance] 2025-11-26 15:56:08.332421 | controller | 2025-11-26 15:56:08.332528 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:08.332654 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.024) 0:00:05.112 **** 2025-11-26 15:56:08.375406 | controller | skipping: [instance] 2025-11-26 15:56:08.375485 | controller | 2025-11-26 15:56:08.375597 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:08.375731 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.042) 0:00:05.155 **** 2025-11-26 15:56:08.408350 | controller | skipping: [instance] 2025-11-26 15:56:08.408434 | controller | 2025-11-26 15:56:08.408539 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:08.408672 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.032) 0:00:05.188 **** 2025-11-26 15:56:08.441557 | controller | skipping: [instance] 2025-11-26 15:56:08.441730 | controller | 2025-11-26 15:56:08.441770 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:08.441883 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.033) 0:00:05.222 **** 2025-11-26 15:56:08.465084 | controller | ok: [instance] 2025-11-26 15:56:08.465166 | controller | 2025-11-26 15:56:08.465270 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:08.465375 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.023) 0:00:05.245 **** 2025-11-26 15:56:08.495442 | controller | ok: [instance] 2025-11-26 15:56:08.495522 | controller | 2025-11-26 15:56:08.495640 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:08.495770 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.029) 0:00:05.274 **** 2025-11-26 15:56:08.522505 | controller | ok: [instance] => 2025-11-26 15:56:08.522632 | controller | msg: 'Running: Create LVM without volume' 2025-11-26 15:56:08.522752 | controller | 2025-11-26 15:56:08.522835 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:08.522937 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.028) 0:00:05.302 **** 2025-11-26 15:56:08.588648 | controller | 2025-11-26 15:56:08.588769 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 15:56:08.588868 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.065) 0:00:05.368 **** 2025-11-26 15:56:08.647179 | controller | ok: [instance] 2025-11-26 15:56:08.647268 | controller | 2025-11-26 15:56:08.647379 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 15:56:08.647485 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.058) 0:00:05.427 **** 2025-11-26 15:56:08.688386 | controller | ok: [instance] 2025-11-26 15:56:08.688473 | controller | 2025-11-26 15:56:08.688580 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 15:56:08.688719 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.041) 0:00:05.468 **** 2025-11-26 15:56:08.759332 | controller | ok: [instance] 2025-11-26 15:56:08.759414 | controller | 2025-11-26 15:56:08.759522 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 15:56:08.759670 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.070) 0:00:05.539 **** 2025-11-26 15:56:08.800241 | controller | skipping: [instance] 2025-11-26 15:56:08.800331 | controller | 2025-11-26 15:56:08.800436 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 15:56:08.800570 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.041) 0:00:05.580 **** 2025-11-26 15:56:08.838582 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:56:08.838700 | controller | assertion: not cifmw_devscripts_create_logical_volume | bool 2025-11-26 15:56:08.838798 | controller | evaluated_to: false 2025-11-26 15:56:08.838915 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2025-11-26 15:56:08.865262 | controller | 2025-11-26 15:56:08.865364 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 15:56:08.865469 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.048) 0:00:05.629 **** 2025-11-26 15:56:08.865576 | controller | 2025-11-26 15:56:08.865690 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:08.865794 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.016) 0:00:05.645 **** 2025-11-26 15:56:08.887063 | controller | ok: [instance] 2025-11-26 15:56:08.887140 | controller | 2025-11-26 15:56:08.887233 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:08.887334 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.022) 0:00:05.667 **** 2025-11-26 15:56:08.923557 | controller | skipping: [instance] 2025-11-26 15:56:08.923663 | controller | 2025-11-26 15:56:08.923784 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:08.923887 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.036) 0:00:05.704 **** 2025-11-26 15:56:08.955469 | controller | skipping: [instance] 2025-11-26 15:56:08.955568 | controller | 2025-11-26 15:56:08.955691 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:08.955806 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.031) 0:00:05.735 **** 2025-11-26 15:56:08.991057 | controller | skipping: [instance] 2025-11-26 15:56:08.991143 | controller | 2025-11-26 15:56:08.991347 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:09.013670 | controller | Wednesday 26 November 2025 15:56:08 +0000 (0:00:00.035) 0:00:05.771 **** 2025-11-26 15:56:09.013697 | controller | ok: [instance] 2025-11-26 15:56:09.013731 | controller | 2025-11-26 15:56:09.013847 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:09.013943 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.022) 0:00:05.794 **** 2025-11-26 15:56:09.043556 | controller | ok: [instance] 2025-11-26 15:56:09.043655 | controller | 2025-11-26 15:56:09.043754 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:09.043845 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.030) 0:00:05.824 **** 2025-11-26 15:56:09.069818 | controller | ok: [instance] => 2025-11-26 15:56:09.069909 | controller | msg: 'Running: Create LVMS without volume' 2025-11-26 15:56:09.069998 | controller | 2025-11-26 15:56:09.070111 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:09.070194 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.026) 0:00:05.850 **** 2025-11-26 15:56:09.113961 | controller | 2025-11-26 15:56:09.114079 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 15:56:09.114187 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.043) 0:00:05.894 **** 2025-11-26 15:56:09.174652 | controller | ok: [instance] 2025-11-26 15:56:09.174754 | controller | 2025-11-26 15:56:09.174866 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 15:56:09.174969 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.060) 0:00:05.955 **** 2025-11-26 15:56:09.216647 | controller | ok: [instance] 2025-11-26 15:56:09.216760 | controller | 2025-11-26 15:56:09.216879 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 15:56:09.216983 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.041) 0:00:05.997 **** 2025-11-26 15:56:09.286111 | controller | ok: [instance] 2025-11-26 15:56:09.286207 | controller | 2025-11-26 15:56:09.286313 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 15:56:09.286420 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.069) 0:00:06.066 **** 2025-11-26 15:56:09.327791 | controller | skipping: [instance] 2025-11-26 15:56:09.327891 | controller | 2025-11-26 15:56:09.328016 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 15:56:09.328134 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.041) 0:00:06.108 **** 2025-11-26 15:56:09.368066 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:56:09.368177 | controller | assertion: cifmw_lvms_disk_list is undefined or (cifmw_lvms_disk_list | length) == 0 2025-11-26 15:56:09.368731 | controller | evaluated_to: false 2025-11-26 15:56:09.395436 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2025-11-26 15:56:09.395464 | controller | 2025-11-26 15:56:09.395536 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 15:56:09.395689 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.051) 0:00:06.160 **** 2025-11-26 15:56:09.395781 | controller | 2025-11-26 15:56:09.395886 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:09.395984 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.015) 0:00:06.176 **** 2025-11-26 15:56:09.443405 | controller | ok: [instance] 2025-11-26 15:56:09.443491 | controller | 2025-11-26 15:56:09.443630 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:09.443753 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.047) 0:00:06.223 **** 2025-11-26 15:56:09.481468 | controller | skipping: [instance] 2025-11-26 15:56:09.482172 | controller | 2025-11-26 15:56:09.482476 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:09.482630 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.037) 0:00:06.261 **** 2025-11-26 15:56:09.517460 | controller | skipping: [instance] 2025-11-26 15:56:09.517564 | controller | 2025-11-26 15:56:09.517695 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:09.517795 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.036) 0:00:06.298 **** 2025-11-26 15:56:09.553157 | controller | skipping: [instance] 2025-11-26 15:56:09.553246 | controller | 2025-11-26 15:56:09.553351 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:09.553456 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.035) 0:00:06.333 **** 2025-11-26 15:56:09.578211 | controller | ok: [instance] 2025-11-26 15:56:09.578304 | controller | 2025-11-26 15:56:09.578408 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:09.578514 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.024) 0:00:06.357 **** 2025-11-26 15:56:09.605449 | controller | ok: [instance] 2025-11-26 15:56:09.605536 | controller | 2025-11-26 15:56:09.605667 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:09.605791 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.028) 0:00:06.386 **** 2025-11-26 15:56:09.632147 | controller | ok: [instance] => 2025-11-26 15:56:09.632296 | controller | msg: 'Running: Allocate same volume twice' 2025-11-26 15:56:09.632348 | controller | 2025-11-26 15:56:09.632444 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:09.632546 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.026) 0:00:06.412 **** 2025-11-26 15:56:09.675728 | controller | 2025-11-26 15:56:09.675781 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 15:56:09.675871 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.043) 0:00:06.456 **** 2025-11-26 15:56:09.733374 | controller | ok: [instance] 2025-11-26 15:56:09.733454 | controller | 2025-11-26 15:56:09.733553 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 15:56:09.733675 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.057) 0:00:06.513 **** 2025-11-26 15:56:09.774081 | controller | ok: [instance] 2025-11-26 15:56:09.774165 | controller | 2025-11-26 15:56:09.774270 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 15:56:09.774374 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.040) 0:00:06.554 **** 2025-11-26 15:56:09.844235 | controller | ok: [instance] 2025-11-26 15:56:09.844325 | controller | 2025-11-26 15:56:09.844413 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 15:56:09.844513 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.070) 0:00:06.624 **** 2025-11-26 15:56:09.885040 | controller | skipping: [instance] 2025-11-26 15:56:09.885131 | controller | 2025-11-26 15:56:09.885232 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 15:56:09.885339 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.040) 0:00:06.665 **** 2025-11-26 15:56:09.932329 | controller | skipping: [instance] 2025-11-26 15:56:09.932404 | controller | 2025-11-26 15:56:09.932507 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 15:56:09.932637 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.047) 0:00:06.712 **** 2025-11-26 15:56:09.976523 | controller | ok: [instance] 2025-11-26 15:56:09.976625 | controller | 2025-11-26 15:56:09.976742 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 15:56:09.976829 | controller | Wednesday 26 November 2025 15:56:09 +0000 (0:00:00.044) 0:00:06.757 **** 2025-11-26 15:56:10.018461 | controller | skipping: [instance] 2025-11-26 15:56:10.018589 | controller | 2025-11-26 15:56:10.018715 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 15:56:10.018812 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.041) 0:00:06.798 **** 2025-11-26 15:56:10.073351 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:56:10.073719 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2025-11-26 15:56:10.099896 | controller | evaluated_to: false 2025-11-26 15:56:10.099918 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 4' 2025-11-26 15:56:10.099930 | controller | 2025-11-26 15:56:10.100005 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 15:56:10.100117 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.065) 0:00:06.864 **** 2025-11-26 15:56:10.100217 | controller | 2025-11-26 15:56:10.100328 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:10.100419 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.015) 0:00:06.880 **** 2025-11-26 15:56:10.123928 | controller | ok: [instance] 2025-11-26 15:56:10.124031 | controller | 2025-11-26 15:56:10.124148 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:10.124238 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.023) 0:00:06.904 **** 2025-11-26 15:56:10.161789 | controller | skipping: [instance] 2025-11-26 15:56:10.161886 | controller | 2025-11-26 15:56:10.162001 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:10.162113 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.037) 0:00:06.942 **** 2025-11-26 15:56:10.193628 | controller | skipping: [instance] 2025-11-26 15:56:10.193740 | controller | 2025-11-26 15:56:10.193843 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:10.193946 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.032) 0:00:06.974 **** 2025-11-26 15:56:10.229624 | controller | skipping: [instance] 2025-11-26 15:56:10.229737 | controller | 2025-11-26 15:56:10.229845 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:10.229942 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.035) 0:00:07.010 **** 2025-11-26 15:56:10.254649 | controller | ok: [instance] 2025-11-26 15:56:10.254750 | controller | 2025-11-26 15:56:10.254862 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:10.254981 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.025) 0:00:07.035 **** 2025-11-26 15:56:10.307170 | controller | ok: [instance] 2025-11-26 15:56:10.307273 | controller | 2025-11-26 15:56:10.307424 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:10.307493 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.052) 0:00:07.087 **** 2025-11-26 15:56:10.336777 | controller | ok: [instance] => 2025-11-26 15:56:10.336876 | controller | msg: 'Running: Allocate same volume twice - no LVMS' 2025-11-26 15:56:10.336973 | controller | 2025-11-26 15:56:10.337090 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:10.337176 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.029) 0:00:07.117 **** 2025-11-26 15:56:10.381416 | controller | 2025-11-26 15:56:10.381536 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 15:56:10.381679 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.044) 0:00:07.161 **** 2025-11-26 15:56:10.439643 | controller | ok: [instance] 2025-11-26 15:56:10.439748 | controller | 2025-11-26 15:56:10.439851 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 15:56:10.439962 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.058) 0:00:07.220 **** 2025-11-26 15:56:10.480804 | controller | ok: [instance] 2025-11-26 15:56:10.480900 | controller | 2025-11-26 15:56:10.481020 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 15:56:10.481128 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.041) 0:00:07.261 **** 2025-11-26 15:56:10.550034 | controller | ok: [instance] 2025-11-26 15:56:10.588751 | controller | 2025-11-26 15:56:10.588779 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 15:56:10.588788 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.068) 0:00:07.330 **** 2025-11-26 15:56:10.588797 | controller | skipping: [instance] 2025-11-26 15:56:10.588816 | controller | 2025-11-26 15:56:10.588924 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 15:56:10.589045 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.039) 0:00:07.369 **** 2025-11-26 15:56:10.629088 | controller | skipping: [instance] 2025-11-26 15:56:10.629161 | controller | 2025-11-26 15:56:10.629257 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 15:56:10.629354 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.040) 0:00:07.409 **** 2025-11-26 15:56:10.672732 | controller | ok: [instance] 2025-11-26 15:56:10.672830 | controller | 2025-11-26 15:56:10.672926 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 15:56:10.673040 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.043) 0:00:07.453 **** 2025-11-26 15:56:10.712473 | controller | skipping: [instance] 2025-11-26 15:56:10.712580 | controller | 2025-11-26 15:56:10.712731 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 15:56:10.712905 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.039) 0:00:07.493 **** 2025-11-26 15:56:10.780395 | controller | ok: [instance] 2025-11-26 15:56:10.780484 | controller | 2025-11-26 15:56:10.780616 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-26 15:56:10.780747 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.067) 0:00:07.560 **** 2025-11-26 15:56:10.831037 | controller | skipping: [instance] 2025-11-26 15:56:10.831144 | controller | 2025-11-26 15:56:10.831251 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-26 15:56:10.831386 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.050) 0:00:07.611 **** 2025-11-26 15:56:10.902257 | controller | ok: [instance] => changed=false 2025-11-26 15:56:10.902352 | controller | msg: All assertions passed 2025-11-26 15:56:10.902448 | controller | 2025-11-26 15:56:10.902573 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-26 15:56:10.902712 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.071) 0:00:07.682 **** 2025-11-26 15:56:10.983241 | controller | ok: [instance] => changed=false 2025-11-26 15:56:10.983332 | controller | msg: All assertions passed 2025-11-26 15:56:10.983429 | controller | 2025-11-26 15:56:10.983555 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:10.983683 | controller | Wednesday 26 November 2025 15:56:10 +0000 (0:00:00.080) 0:00:07.763 **** 2025-11-26 15:56:11.019825 | controller | skipping: [instance] 2025-11-26 15:56:11.019919 | controller | 2025-11-26 15:56:11.020032 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:11.020158 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.036) 0:00:07.800 **** 2025-11-26 15:56:11.055272 | controller | skipping: [instance] 2025-11-26 15:56:11.055356 | controller | 2025-11-26 15:56:11.055487 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:11.055569 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.035) 0:00:07.835 **** 2025-11-26 15:56:11.089150 | controller | skipping: [instance] 2025-11-26 15:56:11.089239 | controller | 2025-11-26 15:56:11.089251 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:11.089333 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.033) 0:00:07.869 **** 2025-11-26 15:56:11.115487 | controller | ok: [instance] 2025-11-26 15:56:11.115578 | controller | 2025-11-26 15:56:11.115718 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:11.115825 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.026) 0:00:07.896 **** 2025-11-26 15:56:11.145053 | controller | ok: [instance] 2025-11-26 15:56:11.145157 | controller | 2025-11-26 15:56:11.145264 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:11.145373 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.029) 0:00:07.925 **** 2025-11-26 15:56:11.174268 | controller | ok: [instance] => 2025-11-26 15:56:11.174367 | controller | msg: 'Running: Allocate same volume twice - no cinder_lvm' 2025-11-26 15:56:11.174460 | controller | 2025-11-26 15:56:11.174566 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:11.174691 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.029) 0:00:07.954 **** 2025-11-26 15:56:11.215032 | controller | 2025-11-26 15:56:11.215145 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 15:56:11.215244 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.040) 0:00:07.995 **** 2025-11-26 15:56:11.303790 | controller | ok: [instance] 2025-11-26 15:56:11.303852 | controller | 2025-11-26 15:56:11.303969 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 15:56:11.304101 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.088) 0:00:08.084 **** 2025-11-26 15:56:11.344647 | controller | ok: [instance] 2025-11-26 15:56:11.344748 | controller | 2025-11-26 15:56:11.344866 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 15:56:11.344958 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.041) 0:00:08.125 **** 2025-11-26 15:56:11.414701 | controller | ok: [instance] 2025-11-26 15:56:11.414808 | controller | 2025-11-26 15:56:11.414921 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 15:56:11.415034 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.070) 0:00:08.195 **** 2025-11-26 15:56:11.453742 | controller | skipping: [instance] 2025-11-26 15:56:11.453811 | controller | 2025-11-26 15:56:11.453913 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 15:56:11.454039 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.039) 0:00:08.234 **** 2025-11-26 15:56:11.498414 | controller | skipping: [instance] 2025-11-26 15:56:11.498515 | controller | 2025-11-26 15:56:11.498659 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 15:56:11.498765 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.044) 0:00:08.278 **** 2025-11-26 15:56:11.544308 | controller | ok: [instance] 2025-11-26 15:56:11.544444 | controller | 2025-11-26 15:56:11.544559 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 15:56:11.544714 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.045) 0:00:08.324 **** 2025-11-26 15:56:11.587415 | controller | skipping: [instance] 2025-11-26 15:56:11.587507 | controller | 2025-11-26 15:56:11.587638 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 15:56:11.587754 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.042) 0:00:08.367 **** 2025-11-26 15:56:11.655865 | controller | ok: [instance] 2025-11-26 15:56:11.655966 | controller | 2025-11-26 15:56:11.656073 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-26 15:56:11.656185 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.068) 0:00:08.436 **** 2025-11-26 15:56:11.706772 | controller | skipping: [instance] 2025-11-26 15:56:11.706890 | controller | 2025-11-26 15:56:11.707001 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-26 15:56:11.707128 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.050) 0:00:08.487 **** 2025-11-26 15:56:11.773191 | controller | ok: [instance] => changed=false 2025-11-26 15:56:11.773304 | controller | msg: All assertions passed 2025-11-26 15:56:11.773415 | controller | 2025-11-26 15:56:11.773515 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-26 15:56:11.773642 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.066) 0:00:08.553 **** 2025-11-26 15:56:11.831370 | controller | skipping: [instance] 2025-11-26 15:56:11.831490 | controller | 2025-11-26 15:56:11.831594 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:11.831746 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.058) 0:00:08.611 **** 2025-11-26 15:56:11.872895 | controller | skipping: [instance] 2025-11-26 15:56:11.873002 | controller | 2025-11-26 15:56:11.873114 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:11.873218 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.041) 0:00:08.653 **** 2025-11-26 15:56:11.906056 | controller | skipping: [instance] 2025-11-26 15:56:11.906148 | controller | 2025-11-26 15:56:11.906256 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:11.906358 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.033) 0:00:08.686 **** 2025-11-26 15:56:11.940917 | controller | skipping: [instance] 2025-11-26 15:56:11.941006 | controller | 2025-11-26 15:56:11.941124 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:11.941214 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.034) 0:00:08.721 **** 2025-11-26 15:56:11.961468 | controller | ok: [instance] 2025-11-26 15:56:11.961561 | controller | 2025-11-26 15:56:11.961667 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:11.961776 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.020) 0:00:08.742 **** 2025-11-26 15:56:11.988298 | controller | ok: [instance] 2025-11-26 15:56:11.988353 | controller | 2025-11-26 15:56:11.988459 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:11.988557 | controller | Wednesday 26 November 2025 15:56:11 +0000 (0:00:00.026) 0:00:08.768 **** 2025-11-26 15:56:12.012382 | controller | ok: [instance] => 2025-11-26 15:56:12.012636 | controller | msg: 'Running: Config overrides via devscripts' 2025-11-26 15:56:12.012751 | controller | 2025-11-26 15:56:12.012854 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:12.012987 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.023) 0:00:08.792 **** 2025-11-26 15:56:12.052447 | controller | 2025-11-26 15:56:12.052549 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 15:56:12.052668 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.040) 0:00:08.833 **** 2025-11-26 15:56:12.084262 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:56:12.084359 | controller | assertion: cifmw_devscripts_config.master_memory is undefined 2025-11-26 15:56:12.084458 | controller | evaluated_to: false 2025-11-26 15:56:12.084589 | controller | msg: 'Inconsistency detected: your environment wants to provide devscripts configuration overrides. This isn''t supported, and you must pass those ressource allocation via the usual cifmw_libvirt_manager_configuration, or patch it.' 2025-11-26 15:56:12.110594 | controller | 2025-11-26 15:56:12.110719 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 15:56:12.110824 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.041) 0:00:08.874 **** 2025-11-26 15:56:12.110916 | controller | 2025-11-26 15:56:12.111019 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:12.111136 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.015) 0:00:08.890 **** 2025-11-26 15:56:12.156713 | controller | ok: [instance] 2025-11-26 15:56:12.156807 | controller | 2025-11-26 15:56:12.156930 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:12.157024 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.046) 0:00:08.937 **** 2025-11-26 15:56:12.193889 | controller | skipping: [instance] 2025-11-26 15:56:12.194123 | controller | 2025-11-26 15:56:12.194234 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:12.194261 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.037) 0:00:08.974 **** 2025-11-26 15:56:12.224531 | controller | skipping: [instance] 2025-11-26 15:56:12.224654 | controller | 2025-11-26 15:56:12.224752 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:12.224837 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.030) 0:00:09.005 **** 2025-11-26 15:56:12.258572 | controller | skipping: [instance] 2025-11-26 15:56:12.258704 | controller | 2025-11-26 15:56:12.258795 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:12.258896 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.034) 0:00:09.039 **** 2025-11-26 15:56:12.279193 | controller | ok: [instance] 2025-11-26 15:56:12.279277 | controller | 2025-11-26 15:56:12.279378 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:12.279478 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.020) 0:00:09.059 **** 2025-11-26 15:56:12.307073 | controller | ok: [instance] 2025-11-26 15:56:12.307171 | controller | 2025-11-26 15:56:12.307275 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:12.307378 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.027) 0:00:09.087 **** 2025-11-26 15:56:12.335505 | controller | ok: [instance] => 2025-11-26 15:56:12.335639 | controller | msg: 'Running: Inject 10 dev-scripts extra_worker' 2025-11-26 15:56:12.335745 | controller | 2025-11-26 15:56:12.335840 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:12.335952 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.028) 0:00:09.116 **** 2025-11-26 15:56:12.381018 | controller | 2025-11-26 15:56:12.381139 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 15:56:12.381244 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.045) 0:00:09.161 **** 2025-11-26 15:56:12.439192 | controller | ok: [instance] 2025-11-26 15:56:12.439283 | controller | 2025-11-26 15:56:12.439388 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 15:56:12.439471 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.058) 0:00:09.219 **** 2025-11-26 15:56:12.470318 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 15:56:12.470421 | controller | assertion: cifmw_devscripts_config.num_extra_workers is undefined or cifmw_devscripts_config.num_extra_workers == 0 2025-11-26 15:56:12.470514 | controller | evaluated_to: false 2025-11-26 15:56:12.470755 | controller | msg: 'Inconsistency detected: dev-scripts extra_worker resources aren''t supported here. You can create compute, networker or any other kind of VM by defining it as you define OCP cluster nodes.' 2025-11-26 15:56:12.496885 | controller | 2025-11-26 15:56:12.496979 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 15:56:12.497085 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.041) 0:00:09.261 **** 2025-11-26 15:56:12.497169 | controller | 2025-11-26 15:56:12.497261 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:12.497347 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.015) 0:00:09.277 **** 2025-11-26 15:56:12.517699 | controller | ok: [instance] 2025-11-26 15:56:12.517882 | controller | 2025-11-26 15:56:12.518002 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:12.518130 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.021) 0:00:09.298 **** 2025-11-26 15:56:12.556638 | controller | skipping: [instance] 2025-11-26 15:56:12.556708 | controller | 2025-11-26 15:56:12.556807 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:12.556916 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.038) 0:00:09.337 **** 2025-11-26 15:56:12.589150 | controller | skipping: [instance] 2025-11-26 15:56:12.589410 | controller | 2025-11-26 15:56:12.589423 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:12.589432 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.032) 0:00:09.369 **** 2025-11-26 15:56:12.622154 | controller | skipping: [instance] 2025-11-26 15:56:12.622243 | controller | 2025-11-26 15:56:12.622352 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 15:56:12.622461 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.032) 0:00:09.402 **** 2025-11-26 15:56:12.645135 | controller | ok: [instance] 2025-11-26 15:56:12.645209 | controller | 2025-11-26 15:56:12.645304 | controller | TASK [Load environment file] *************************************************** 2025-11-26 15:56:12.645410 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.022) 0:00:09.425 **** 2025-11-26 15:56:12.669097 | controller | ok: [instance] 2025-11-26 15:56:12.669228 | controller | 2025-11-26 15:56:12.669280 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 15:56:12.669378 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.024) 0:00:09.449 **** 2025-11-26 15:56:12.696117 | controller | ok: [instance] => 2025-11-26 15:56:12.696282 | controller | msg: 'Running: Inject 0 dev-scripts extra_worker' 2025-11-26 15:56:12.696416 | controller | 2025-11-26 15:56:12.696552 | controller | TASK [Validate data] *********************************************************** 2025-11-26 15:56:12.696706 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.026) 0:00:09.476 **** 2025-11-26 15:56:12.735805 | controller | 2025-11-26 15:56:12.735964 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 15:56:12.736134 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.039) 0:00:09.516 **** 2025-11-26 15:56:12.795275 | controller | ok: [instance] 2025-11-26 15:56:12.839701 | controller | 2025-11-26 15:56:12.839755 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 15:56:12.839764 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.059) 0:00:09.575 **** 2025-11-26 15:56:12.839778 | controller | ok: [instance] 2025-11-26 15:56:12.839832 | controller | 2025-11-26 15:56:12.839841 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 15:56:12.839850 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.044) 0:00:09.620 **** 2025-11-26 15:56:12.908024 | controller | ok: [instance] 2025-11-26 15:56:12.908166 | controller | 2025-11-26 15:56:12.908308 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 15:56:12.908449 | controller | Wednesday 26 November 2025 15:56:12 +0000 (0:00:00.068) 0:00:09.688 **** 2025-11-26 15:56:13.011244 | controller | skipping: [instance] 2025-11-26 15:56:13.011358 | controller | 2025-11-26 15:56:13.011540 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 15:56:13.011670 | controller | Wednesday 26 November 2025 15:56:13 +0000 (0:00:00.103) 0:00:09.791 **** 2025-11-26 15:56:13.061915 | controller | ok: [instance] 2025-11-26 15:56:13.062002 | controller | 2025-11-26 15:56:13.062124 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 15:56:13.062255 | controller | Wednesday 26 November 2025 15:56:13 +0000 (0:00:00.050) 0:00:09.842 **** 2025-11-26 15:56:13.100469 | controller | skipping: [instance] 2025-11-26 15:56:13.100565 | controller | 2025-11-26 15:56:13.100680 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 15:56:13.100774 | controller | Wednesday 26 November 2025 15:56:13 +0000 (0:00:00.038) 0:00:09.881 **** 2025-11-26 15:56:13.137971 | controller | skipping: [instance] 2025-11-26 15:56:13.138080 | controller | 2025-11-26 15:56:13.138216 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 15:56:13.138337 | controller | Wednesday 26 November 2025 15:56:13 +0000 (0:00:00.037) 0:00:09.918 **** 2025-11-26 15:56:13.179399 | controller | skipping: [instance] 2025-11-26 15:56:13.179470 | controller | 2025-11-26 15:56:13.179587 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-26 15:56:13.179743 | controller | Wednesday 26 November 2025 15:56:13 +0000 (0:00:00.041) 0:00:09.959 **** 2025-11-26 15:56:13.220874 | controller | skipping: [instance] 2025-11-26 15:56:13.220955 | controller | 2025-11-26 15:56:13.221071 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-26 15:56:13.221168 | controller | Wednesday 26 November 2025 15:56:13 +0000 (0:00:00.041) 0:00:10.001 **** 2025-11-26 15:56:13.272647 | controller | skipping: [instance] 2025-11-26 15:56:13.272693 | controller | 2025-11-26 15:56:13.272824 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-26 15:56:13.272925 | controller | Wednesday 26 November 2025 15:56:13 +0000 (0:00:00.051) 0:00:10.052 **** 2025-11-26 15:56:13.322731 | controller | skipping: [instance] 2025-11-26 15:56:13.322813 | controller | 2025-11-26 15:56:13.322917 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 15:56:13.323030 | controller | Wednesday 26 November 2025 15:56:13 +0000 (0:00:00.049) 0:00:10.102 **** 2025-11-26 15:56:13.359064 | controller | skipping: [instance] 2025-11-26 15:56:13.359156 | controller | 2025-11-26 15:56:13.359281 | controller | TASK [Display error message] *************************************************** 2025-11-26 15:56:13.359400 | controller | Wednesday 26 November 2025 15:56:13 +0000 (0:00:00.036) 0:00:10.139 **** 2025-11-26 15:56:13.391265 | controller | skipping: [instance] 2025-11-26 15:56:13.391345 | controller | 2025-11-26 15:56:13.391455 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 15:56:13.391563 | controller | Wednesday 26 November 2025 15:56:13 +0000 (0:00:00.032) 0:00:10.171 **** 2025-11-26 15:56:13.425340 | controller | skipping: [instance] 2025-11-26 15:56:13.425431 | controller | 2025-11-26 15:56:13.425560 | controller | TASK [Fail if needed] ********************************************************** 2025-11-26 15:56:13.425762 | controller | Wednesday 26 November 2025 15:56:13 +0000 (0:00:00.033) 0:00:10.205 **** 2025-11-26 15:56:13.486170 | controller | skipping: [instance] 2025-11-26 15:56:13.486265 | controller | 2025-11-26 15:56:13.486402 | controller | PLAY RECAP ********************************************************************* 2025-11-26 15:56:13.486500 | controller | instance : ok=129 changed=0 unreachable=0 failed=0 skipped=85 rescued=7 ignored=0 2025-11-26 15:56:13.486706 | controller | 2025-11-26 15:56:13.486829 | controller | Wednesday 26 November 2025 15:56:13 +0000 (0:00:00.060) 0:00:10.266 **** 2025-11-26 15:56:13.486846 | controller | =============================================================================== 2025-11-26 15:56:13.486920 | controller | reproducer : Ensure we get required data in the layout description ------ 0.13s 2025-11-26 15:56:13.487022 | controller | reproducer : Ensure no allocation overlap ------------------------------- 0.11s 2025-11-26 15:56:13.487123 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.10s 2025-11-26 15:56:13.487205 | controller | Test no volumes --------------------------------------------------------- 0.10s 2025-11-26 15:56:13.487316 | controller | reproducer : Ensure same amount of disks are created -------------------- 0.10s 2025-11-26 15:56:13.487404 | controller | reproducer : Ensure we don't try to pass resources via devscripts_overrides --- 0.09s 2025-11-26 15:56:13.487502 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s 2025-11-26 15:56:13.487615 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s 2025-11-26 15:56:13.487719 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.08s 2025-11-26 15:56:13.487815 | controller | reproducer : Ensure we get required data in the layout description ------ 0.08s 2025-11-26 15:56:13.487915 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.08s 2025-11-26 15:56:13.488020 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.08s 2025-11-26 15:56:13.488136 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.07s 2025-11-26 15:56:13.488218 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.07s 2025-11-26 15:56:13.488316 | controller | reproducer : Ensure no allocation overlap ------------------------------- 0.07s 2025-11-26 15:56:13.488415 | controller | reproducer : Ensure created amount matches at least allocated amounts --- 0.07s 2025-11-26 15:56:13.488507 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.07s 2025-11-26 15:56:13.488637 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-11-26 15:56:13.488729 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-11-26 15:56:13.488835 | controller | reproducer : Ensure we get required data in the layout description ------ 0.07s 2025-11-26 15:56:13.556470 | controller | INFO Running ocp_validations > cleanup 2025-11-26 15:56:13.556912 | controller | WARNING Skipping, cleanup playbook not configured. 2025-11-26 15:56:13.557492 | controller | INFO Writing /tmp/report.html report. 2025-11-26 15:56:13.809985 | [controller] Waiting on logger 2025-11-26 15:56:18.994579 | [controller] Waiting on logger 2025-11-26 15:56:29.426851 | [controller] Waiting on logger 2025-11-26 15:56:39.858582 | [controller] Waiting on logger 2025-11-26 15:56:43.699578 | [Zuul] Log Stream did not terminate 2025-11-26 15:56:43.699817 | controller | changed 2025-11-26 15:56:43.750282 | 2025-11-26 15:56:43.750351 | PLAY RECAP 2025-11-26 15:56:43.750392 | controller | ok: 4 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-11-26 15:56:43.750415 | 2025-11-26 15:56:43.828118 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-11-26 15:56:43.829003 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-11-26 15:56:44.393361 | 2025-11-26 15:56:44.393589 | PLAY [Run ci/playbooks/collect-logs.yml] 2025-11-26 15:56:44.414786 | 2025-11-26 15:56:44.414868 | TASK [Filter out host if needed] 2025-11-26 15:56:44.423583 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2025-11-26 15:56:44.428115 | 2025-11-26 15:56:44.428182 | TASK [Ensure file is present] 2025-11-26 15:56:44.824927 | controller | ok 2025-11-26 15:56:44.832658 | 2025-11-26 15:56:44.832738 | TASK [Manage molecule report file] 2025-11-26 15:56:44.853595 | [controller] Waiting on logger 2025-11-26 15:56:54.194508 | [controller] Waiting on logger 2025-11-26 15:57:04.626438 | [controller] Waiting on logger 2025-11-26 15:57:13.970493 | [controller] Waiting on logger 2025-11-26 15:57:15.240945 | [Zuul] Log Stream did not terminate 2025-11-26 15:57:15.241170 | controller | changed 2025-11-26 15:57:15.248241 | 2025-11-26 15:57:15.248300 | TASK [Check if we get ci-framework-data basedir] 2025-11-26 15:57:15.532225 | controller | ok 2025-11-26 15:57:15.537224 | 2025-11-26 15:57:15.537286 | TASK [Create ci-framework-data log directory for zuul] 2025-11-26 15:57:15.921468 | controller | changed 2025-11-26 15:57:15.927603 | 2025-11-26 15:57:15.927671 | TASK [Copy ci-framework interesting files] 2025-11-26 15:57:15.948724 | [controller] Waiting on logger 2025-11-26 15:57:26.386448 | [controller] Waiting on logger 2025-11-26 15:57:36.818538 | [controller] Waiting on logger 2025-11-26 15:57:46.162686 | [controller] Waiting on logger 2025-11-26 15:57:46.220344 | [Zuul] Log Stream did not terminate 2025-11-26 15:57:46.220519 | controller | changed 2025-11-26 15:57:46.226161 | 2025-11-26 15:57:46.226232 | TASK [Get SELinux listing] 2025-11-26 15:57:47.250633 | [controller] Waiting on logger 2025-11-26 15:57:59.730644 | [controller] Waiting on logger 2025-11-26 15:58:09.074655 | [controller] Waiting on logger 2025-11-26 15:58:16.559349 | [Zuul] Log Stream did not terminate 2025-11-26 15:58:16.559706 | controller | changed 2025-11-26 15:58:16.565821 | 2025-11-26 15:58:16.565885 | TASK [Generate log index] 2025-11-26 15:58:17.791713 | controller | changed 2025-11-26 15:58:17.796655 | 2025-11-26 15:58:17.796719 | TASK [Get some env related data] 2025-11-26 15:58:17.820649 | [controller] Waiting on logger 2025-11-26 15:58:28.210645 | [controller] Waiting on logger 2025-11-26 15:58:38.642822 | [controller] Waiting on logger 2025-11-26 15:58:47.986518 | [controller] Waiting on logger 2025-11-26 15:58:49.006330 | [Zuul] Log Stream did not terminate 2025-11-26 15:58:49.007212 | controller | changed 2025-11-26 15:58:49.012712 | 2025-11-26 15:58:49.012772 | TASK [Generate list of logs to collect in home directory] 2025-11-26 15:58:49.380203 | controller | ok: All paths examined 2025-11-26 15:58:49.385445 | 2025-11-26 15:58:49.385505 | LOOP [Copy logs from home directory] 2025-11-26 15:58:50.037958 | controller | changed: 2025-11-26 15:58:50.038191 | controller | { 2025-11-26 15:58:50.038221 | controller | "atime": 1743544925.4788878, 2025-11-26 15:58:50.038241 | controller | "ctime": 1743545329.1409318, 2025-11-26 15:58:50.038265 | controller | "dev": 64513, 2025-11-26 15:58:50.038291 | controller | "gid": 1000, 2025-11-26 15:58:50.038316 | controller | "gr_name": "zuul", 2025-11-26 15:58:50.038338 | controller | "inode": 4518807, 2025-11-26 15:58:50.038492 | controller | "isblk": false, 2025-11-26 15:58:50.038528 | controller | "ischr": false, 2025-11-26 15:58:50.038559 | controller | "isdir": false, 2025-11-26 15:58:50.038578 | controller | "isfifo": false, 2025-11-26 15:58:50.038596 | controller | "isgid": false, 2025-11-26 15:58:50.038611 | controller | "islnk": false, 2025-11-26 15:58:50.038626 | controller | "isreg": true, 2025-11-26 15:58:50.038639 | controller | "issock": false, 2025-11-26 15:58:50.038653 | controller | "isuid": false, 2025-11-26 15:58:50.038668 | controller | "mode": "0644", 2025-11-26 15:58:50.038681 | controller | "mtime": 1743545329.1409318, 2025-11-26 15:58:50.038695 | controller | "nlink": 1, 2025-11-26 15:58:50.038710 | controller | "path": "/home/zuul/crc-setup.log", 2025-11-26 15:58:50.038723 | controller | "pw_name": "zuul", 2025-11-26 15:58:50.038737 | controller | "rgrp": true, 2025-11-26 15:58:50.038750 | controller | "roth": true, 2025-11-26 15:58:50.038763 | controller | "rusr": true, 2025-11-26 15:58:50.038776 | controller | "size": 4108, 2025-11-26 15:58:50.038789 | controller | "uid": 1000, 2025-11-26 15:58:50.038801 | controller | "wgrp": false, 2025-11-26 15:58:50.038814 | controller | "woth": false, 2025-11-26 15:58:50.038826 | controller | "wusr": true, 2025-11-26 15:58:50.038839 | controller | "xgrp": false, 2025-11-26 15:58:50.038851 | controller | "xoth": false, 2025-11-26 15:58:50.038864 | controller | "xusr": false 2025-11-26 15:58:50.038876 | controller | } 2025-11-26 15:58:50.729107 | controller | changed: 2025-11-26 15:58:50.729302 | controller | { 2025-11-26 15:58:50.729340 | controller | "atime": 1743545331.0429637, 2025-11-26 15:58:50.729362 | controller | "ctime": 1743545842.0111232, 2025-11-26 15:58:50.729380 | controller | "dev": 64513, 2025-11-26 15:58:50.729397 | controller | "gid": 1000, 2025-11-26 15:58:50.729413 | controller | "gr_name": "zuul", 2025-11-26 15:58:50.729428 | controller | "inode": 4194437, 2025-11-26 15:58:50.729442 | controller | "isblk": false, 2025-11-26 15:58:50.729455 | controller | "ischr": false, 2025-11-26 15:58:50.729470 | controller | "isdir": false, 2025-11-26 15:58:50.729484 | controller | "isfifo": false, 2025-11-26 15:58:50.729498 | controller | "isgid": false, 2025-11-26 15:58:50.729512 | controller | "islnk": false, 2025-11-26 15:58:50.729525 | controller | "isreg": true, 2025-11-26 15:58:50.729538 | controller | "issock": false, 2025-11-26 15:58:50.729566 | controller | "isuid": false, 2025-11-26 15:58:50.729582 | controller | "mode": "0644", 2025-11-26 15:58:50.729595 | controller | "mtime": 1743545842.0111232, 2025-11-26 15:58:50.729609 | controller | "nlink": 1, 2025-11-26 15:58:50.729622 | controller | "path": "/home/zuul/crc-start.log", 2025-11-26 15:58:50.729636 | controller | "pw_name": "zuul", 2025-11-26 15:58:50.729649 | controller | "rgrp": true, 2025-11-26 15:58:50.729662 | controller | "roth": true, 2025-11-26 15:58:50.729675 | controller | "rusr": true, 2025-11-26 15:58:50.729688 | controller | "size": 4023, 2025-11-26 15:58:50.729701 | controller | "uid": 1000, 2025-11-26 15:58:50.729714 | controller | "wgrp": false, 2025-11-26 15:58:50.729726 | controller | "woth": false, 2025-11-26 15:58:50.729738 | controller | "wusr": true, 2025-11-26 15:58:50.729751 | controller | "xgrp": false, 2025-11-26 15:58:50.729763 | controller | "xoth": false, 2025-11-26 15:58:50.729776 | controller | "xusr": false 2025-11-26 15:58:50.729788 | controller | } 2025-11-26 15:58:51.320875 | controller | changed: 2025-11-26 15:58:51.320963 | controller | { 2025-11-26 15:58:51.320990 | controller | "atime": 1764172025.1910565, 2025-11-26 15:58:51.321009 | controller | "ctime": 1764172040.6994143, 2025-11-26 15:58:51.321026 | controller | "dev": 64513, 2025-11-26 15:58:51.321041 | controller | "gid": 1000, 2025-11-26 15:58:51.321056 | controller | "gr_name": "zuul", 2025-11-26 15:58:51.321073 | controller | "inode": 4233417, 2025-11-26 15:58:51.321087 | controller | "isblk": false, 2025-11-26 15:58:51.321106 | controller | "ischr": false, 2025-11-26 15:58:51.321121 | controller | "isdir": false, 2025-11-26 15:58:51.321134 | controller | "isfifo": false, 2025-11-26 15:58:51.321147 | controller | "isgid": false, 2025-11-26 15:58:51.321160 | controller | "islnk": false, 2025-11-26 15:58:51.321173 | controller | "isreg": true, 2025-11-26 15:58:51.321186 | controller | "issock": false, 2025-11-26 15:58:51.321199 | controller | "isuid": false, 2025-11-26 15:58:51.321211 | controller | "mode": "0644", 2025-11-26 15:58:51.321223 | controller | "mtime": 1764172040.6994143, 2025-11-26 15:58:51.321236 | controller | "nlink": 1, 2025-11-26 15:58:51.321250 | controller | "path": "/home/zuul/ansible.log", 2025-11-26 15:58:51.321264 | controller | "pw_name": "zuul", 2025-11-26 15:58:51.321277 | controller | "rgrp": true, 2025-11-26 15:58:51.321291 | controller | "roth": true, 2025-11-26 15:58:51.321305 | controller | "rusr": true, 2025-11-26 15:58:51.321319 | controller | "size": 6749, 2025-11-26 15:58:51.321333 | controller | "uid": 1000, 2025-11-26 15:58:51.321346 | controller | "wgrp": false, 2025-11-26 15:58:51.321359 | controller | "woth": false, 2025-11-26 15:58:51.321372 | controller | "wusr": true, 2025-11-26 15:58:51.321385 | controller | "xgrp": false, 2025-11-26 15:58:51.321397 | controller | "xoth": false, 2025-11-26 15:58:51.321410 | controller | "xusr": false 2025-11-26 15:58:51.321422 | controller | } 2025-11-26 15:58:51.332736 | 2025-11-26 15:58:51.332872 | TASK [Copy crio stats log file] 2025-11-26 15:58:51.346838 | controller | skipping: Conditional result was False 2025-11-26 15:58:51.352599 | 2025-11-26 15:58:51.352674 | TASK [Get SELinux related data] 2025-11-26 15:58:51.374387 | [controller] Waiting on logger 2025-11-26 15:59:02.053053 | controller | ERROR 2025-11-26 15:59:02.053336 | controller | { 2025-11-26 15:59:02.053376 | controller | "delta": "0:00:00.014448", 2025-11-26 15:59:02.053403 | controller | "end": "2025-11-26 15:58:51.651751", 2025-11-26 15:59:02.053426 | controller | "msg": "non-zero return code", 2025-11-26 15:59:02.053447 | controller | "rc": 1, 2025-11-26 15:59:02.053470 | controller | "start": "2025-11-26 15:58:51.637303" 2025-11-26 15:59:02.053492 | controller | } 2025-11-26 15:59:02.053518 | controller | ERROR: Ignoring Errors 2025-11-26 15:59:02.059628 | 2025-11-26 15:59:02.059692 | TASK [Create system configuration directory] 2025-11-26 15:59:02.322254 | controller | changed 2025-11-26 15:59:02.327084 | 2025-11-26 15:59:02.327144 | TASK [Get some of the system configurations] 2025-11-26 15:59:02.347609 | [controller] Waiting on logger 2025-11-26 15:59:05.650681 | [controller] Waiting on logger 2025-11-26 15:59:20.946416 | [controller] Waiting on logger 2025-11-26 15:59:27.410606 | [controller] Waiting on logger 2025-11-26 15:59:32.673352 | [Zuul] Log Stream did not terminate 2025-11-26 15:59:32.673609 | controller | changed 2025-11-26 15:59:32.679118 | 2025-11-26 15:59:32.679182 | TASK [Copy generated documentation if available] 2025-11-26 15:59:32.694230 | controller | skipping: Conditional result was False 2025-11-26 15:59:32.700229 | 2025-11-26 15:59:32.700299 | TASK [Copy generated AsciiDoc documentation if available] 2025-11-26 15:59:32.714088 | controller | skipping: Conditional result was False 2025-11-26 15:59:32.719516 | 2025-11-26 15:59:32.719583 | TASK [Compress logs bigger than 2MB] 2025-11-26 15:59:35.474713 | [controller] Waiting on logger 2025-11-26 15:59:37.746545 | controller | changed 2025-11-26 15:59:37.751786 | 2025-11-26 15:59:37.751846 | TASK [Copy files from workspace on node] 2025-11-26 15:59:37.770541 | controller | ok 2025-11-26 15:59:37.792620 | 2025-11-26 15:59:37.792699 | TASK [fetch-output : Set log path for multiple nodes] 2025-11-26 15:59:37.815860 | controller | skipping: Conditional result was False 2025-11-26 15:59:37.821501 | 2025-11-26 15:59:37.821572 | TASK [fetch-output : Set log path for single node] 2025-11-26 15:59:37.850873 | controller | ok 2025-11-26 15:59:37.855607 | 2025-11-26 15:59:37.855670 | LOOP [fetch-output : Ensure local output dirs] 2025-11-26 15:59:38.051066 | controller -> localhost | ok: "/var/lib/zuul/builds/d4f91a3c3e7045779492f744b684885d/work/logs" 2025-11-26 15:59:38.051356 | controller -> localhost | changed: All items complete 2025-11-26 15:59:38.051384 | 2025-11-26 15:59:38.228021 | controller -> localhost | changed: "/var/lib/zuul/builds/d4f91a3c3e7045779492f744b684885d/work/artifacts" 2025-11-26 15:59:38.405014 | controller -> localhost | changed: "/var/lib/zuul/builds/d4f91a3c3e7045779492f744b684885d/work/docs" 2025-11-26 15:59:38.414669 | 2025-11-26 15:59:38.414751 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-11-26 15:59:39.097092 | controller | changed: 2025-11-26 15:59:39.097303 | controller | .d..t...... ./ 2025-11-26 15:59:39.097333 | controller | >f+++++++++ README.html 2025-11-26 15:59:39.097354 | controller | >f+++++++++ ansible-execution.log 2025-11-26 15:59:39.097373 | controller | >f+++++++++ ansible.log 2025-11-26 15:59:39.097392 | controller | >f+++++++++ crc-setup.log 2025-11-26 15:59:39.097409 | controller | >f+++++++++ crc-start.log 2025-11-26 15:59:39.097425 | controller | >f+++++++++ dmesg.log 2025-11-26 15:59:39.097441 | controller | >f+++++++++ installed-pkgs.log 2025-11-26 15:59:39.097456 | controller | >f+++++++++ python.log 2025-11-26 15:59:39.097472 | controller | >f+++++++++ registries.conf 2025-11-26 15:59:39.097487 | controller | >f+++++++++ report.html 2025-11-26 15:59:39.097501 | controller | >f+++++++++ selinux-denials.log 2025-11-26 15:59:39.097515 | controller | >f+++++++++ selinux-listing.log 2025-11-26 15:59:39.097529 | controller | cd+++++++++ ci-framework-data/ 2025-11-26 15:59:39.097542 | controller | cd+++++++++ ci-framework-data/artifacts/ 2025-11-26 15:59:39.097556 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2025-11-26 15:59:39.097588 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2025-11-26 15:59:39.097604 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2025-11-26 15:59:39.097619 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2025-11-26 15:59:39.097634 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2025-11-26 15:59:39.097648 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2025-11-26 15:59:39.097661 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2025-11-26 15:59:39.097676 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2025-11-26 15:59:39.097690 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2025-11-26 15:59:39.097704 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2025-11-26 15:59:39.097718 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2025-11-26 15:59:39.097731 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2025-11-26 15:59:39.097745 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2025-11-26 15:59:39.097759 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:5a:eb:72 2025-11-26 15:59:39.097774 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:71:79:59 2025-11-26 15:59:39.097788 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:34:a7:66 2025-11-26 15:59:39.097802 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:51:30:8f 2025-11-26 15:59:39.097816 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:de:6b:1d 2025-11-26 15:59:39.097829 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:8f:ee:4f 2025-11-26 15:59:39.097843 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2025-11-26 15:59:39.097863 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2025-11-26 15:59:39.097878 | controller | cd+++++++++ ci-framework-data/logs/ 2025-11-26 15:59:39.097892 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2025-11-26 15:59:39.097906 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2025-11-26 15:59:39.097954 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2025-11-26 15:59:39.097971 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2025-11-26 15:59:39.097986 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2025-11-26 15:59:39.098000 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2025-11-26 15:59:39.098015 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2025-11-26 15:59:39.098029 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2025-11-26 15:59:39.098046 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2025-11-26 15:59:39.098061 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2025-11-26 15:59:39.098076 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2025-11-26 15:59:39.098092 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2025-11-26 15:59:39.098106 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2025-11-26 15:59:39.098129 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2025-11-26 15:59:39.098144 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2025-11-26 15:59:39.098163 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2025-11-26 15:59:39.098179 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2025-11-26 15:59:39.098194 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2025-11-26 15:59:39.098208 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2025-11-26 15:59:39.098222 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2025-11-26 15:59:39.098236 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2025-11-26 15:59:39.098251 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2025-11-26 15:59:39.098267 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2025-11-26 15:59:39.098282 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2025-11-26 15:59:39.098297 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2025-11-26 15:59:39.098311 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2025-11-26 15:59:39.098325 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2025-11-26 15:59:39.098347 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2025-11-26 15:59:39.098361 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2025-11-26 15:59:39.098378 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2025-11-26 15:59:39.098393 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2025-11-26 15:59:39.098408 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2025-11-26 15:59:39.098423 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2025-11-26 15:59:39.098438 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2025-11-26 15:59:39.098452 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2025-11-26 15:59:39.098466 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2025-11-26 15:59:39.098480 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2025-11-26 15:59:39.098494 | controller | cd+++++++++ registries.conf.d/ 2025-11-26 15:59:39.098507 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2025-11-26 15:59:39.098520 | controller | cd+++++++++ system-config/ 2025-11-26 15:59:39.098534 | controller | cd+++++++++ system-config/libvirt/ 2025-11-26 15:59:39.098547 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2025-11-26 15:59:39.098578 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2025-11-26 15:59:39.098595 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2025-11-26 15:59:39.098609 | controller | >f+++++++++ system-config/libvirt/network.conf 2025-11-26 15:59:39.098623 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2025-11-26 15:59:39.098636 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2025-11-26 15:59:39.098650 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2025-11-26 15:59:39.098663 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2025-11-26 15:59:39.098676 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2025-11-26 15:59:39.098689 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2025-11-26 15:59:39.098702 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2025-11-26 15:59:39.098716 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2025-11-26 15:59:39.098729 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2025-11-26 15:59:39.098742 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2025-11-26 15:59:39.098755 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2025-11-26 15:59:39.098768 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2025-11-26 15:59:39.554968 | controller | changed: .d..t...... ./ 2025-11-26 15:59:40.016461 | controller | changed: .d..t...... ./ 2025-11-26 15:59:40.037398 | 2025-11-26 15:59:40.037584 | TASK [Return artifact to Zuul] 2025-11-26 15:59:40.067004 | controller | ok 2025-11-26 15:59:40.085168 | 2025-11-26 15:59:40.085230 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2025-11-26 15:59:40.085336 | 2025-11-26 15:59:40.085363 | PLAY RECAP 2025-11-26 15:59:40.085399 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2025-11-26 15:59:40.085419 | 2025-11-26 15:59:40.172016 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-11-26 15:59:40.172854 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-11-26 15:59:40.729252 | 2025-11-26 15:59:40.729379 | PLAY [all] 2025-11-26 15:59:40.748141 | 2025-11-26 15:59:40.748216 | TASK [include_role : fetch-output] 2025-11-26 15:59:40.779122 | controller | ok 2025-11-26 15:59:40.796008 | 2025-11-26 15:59:40.796090 | TASK [fetch-output : Set log path for multiple nodes] 2025-11-26 15:59:40.842007 | controller | skipping: Conditional result was False 2025-11-26 15:59:40.848208 | 2025-11-26 15:59:40.848277 | TASK [fetch-output : Set log path for single node] 2025-11-26 15:59:40.888882 | controller | ok 2025-11-26 15:59:40.893790 | 2025-11-26 15:59:40.893855 | LOOP [fetch-output : Ensure local output dirs] 2025-11-26 15:59:41.239205 | controller -> localhost | ok: "/var/lib/zuul/builds/d4f91a3c3e7045779492f744b684885d/work/logs" 2025-11-26 15:59:41.425977 | controller -> localhost | ok: "/var/lib/zuul/builds/d4f91a3c3e7045779492f744b684885d/work/artifacts" 2025-11-26 15:59:41.608356 | controller -> localhost | ok: "/var/lib/zuul/builds/d4f91a3c3e7045779492f744b684885d/work/docs" 2025-11-26 15:59:41.618435 | 2025-11-26 15:59:41.618587 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-11-26 15:59:42.256750 | controller | ok 2025-11-26 15:59:42.257036 | controller | ok: All items complete 2025-11-26 15:59:42.257068 | 2025-11-26 15:59:42.731348 | controller | ok 2025-11-26 15:59:43.179187 | controller | ok 2025-11-26 15:59:43.199448 | 2025-11-26 15:59:43.199525 | TASK [include_role : fetch-output-openshift] 2025-11-26 15:59:43.224936 | controller | skipping: Conditional result was False 2025-11-26 15:59:43.230953 | 2025-11-26 15:59:43.231025 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2025-11-26 15:59:43.607661 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.007779 2025-11-26 15:59:43.803157 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.009173 2025-11-26 15:59:43.827903 | 2025-11-26 15:59:43.827984 | PLAY [all] 2025-11-26 15:59:43.841363 | 2025-11-26 15:59:43.841430 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2025-11-26 15:59:44.329247 | controller | changed 2025-11-26 15:59:44.349312 | 2025-11-26 15:59:44.349368 | PLAY RECAP 2025-11-26 15:59:44.349413 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2025-11-26 15:59:44.349435 | 2025-11-26 15:59:44.435479 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-11-26 15:59:44.436261 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2025-11-26 15:59:44.973620 | 2025-11-26 15:59:44.973757 | PLAY [localhost] 2025-11-26 15:59:44.991711 | 2025-11-26 15:59:44.991785 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2025-11-26 15:59:45.354624 | localhost | changed 2025-11-26 15:59:45.359364 | 2025-11-26 15:59:45.359446 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2025-11-26 15:59:45.388725 | localhost | ok 2025-11-26 15:59:45.396392 | 2025-11-26 15:59:45.396463 | TASK [add-fileserver : Create SSH private key tempfile] 2025-11-26 15:59:45.709422 | localhost | changed 2025-11-26 15:59:45.716444 | 2025-11-26 15:59:45.716529 | TASK [add-fileserver : Create SSH private key from secret] 2025-11-26 15:59:46.294148 | localhost | changed 2025-11-26 15:59:46.299521 | 2025-11-26 15:59:46.299609 | TASK [add-fileserver : Add fileserver ssh key] 2025-11-26 15:59:46.653938 | localhost | Identity added: /var/lib/zuul/builds/d4f91a3c3e7045779492f744b684885d/work/tmp/ansible.iw6kggpj (/var/lib/zuul/builds/d4f91a3c3e7045779492f744b684885d/work/tmp/ansible.iw6kggpj) 2025-11-26 15:59:46.654185 | localhost | ok: Runtime: 0:00:00.008394 2025-11-26 15:59:46.658666 | 2025-11-26 15:59:46.658738 | TASK [add-fileserver : Remove SSH private key from disk] 2025-11-26 15:59:46.901273 | localhost | ok: Runtime: 0:00:00.006541 2025-11-26 15:59:46.906400 | 2025-11-26 15:59:46.906477 | TASK [add-fileserver : Add fileserver to inventory] 2025-11-26 15:59:46.958606 | localhost | changed 2025-11-26 15:59:46.962893 | 2025-11-26 15:59:46.963003 | TASK [add-fileserver : Add fileserver server to known hosts] 2025-11-26 15:59:47.307829 | localhost | changed 2025-11-26 15:59:47.327864 | 2025-11-26 15:59:47.327946 | PLAY [localhost] 2025-11-26 15:59:47.339373 | 2025-11-26 15:59:47.339440 | TASK [Generate bulk log download script] 2025-11-26 15:59:47.360161 | localhost | ok 2025-11-26 15:59:47.372591 | 2025-11-26 15:59:47.372668 | TASK [local-log-download : Check API endpoint is defined] 2025-11-26 15:59:47.402530 | localhost | ok: All assertions passed 2025-11-26 15:59:47.407420 | 2025-11-26 15:59:47.407494 | TASK [local-log-download : Create download script] 2025-11-26 15:59:47.758657 | localhost -> localhost | changed 2025-11-26 15:59:47.768227 | 2025-11-26 15:59:47.768314 | TASK [Register quick-download link] 2025-11-26 15:59:47.789240 | localhost | ok 2025-11-26 15:59:47.841622 | 2025-11-26 15:59:47.841777 | PLAY [logserver.rdoproject.org] 2025-11-26 15:59:47.853343 | 2025-11-26 15:59:47.853547 | TASK [Set zuul-log-path fact] 2025-11-26 15:59:47.872297 | logserver.rdoproject.org | ok 2025-11-26 15:59:47.881888 | 2025-11-26 15:59:47.881974 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-11-26 15:59:47.910438 | logserver.rdoproject.org | ok 2025-11-26 15:59:47.916055 | 2025-11-26 15:59:47.916127 | TASK [upload-logs : Create log directories] 2025-11-26 15:59:49.545989 | logserver.rdoproject.org | changed 2025-11-26 15:59:49.549334 | 2025-11-26 15:59:49.549404 | TASK [upload-logs : Ensure logs are readable before uploading] 2025-11-26 15:59:49.776954 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.007269 2025-11-26 15:59:49.782966 | 2025-11-26 15:59:49.783050 | TASK [upload-logs : Upload logs to log server] 2025-11-26 15:59:51.323657 | logserver.rdoproject.org | Output suppressed because no_log was given 2025-11-26 15:59:51.326822 | 2025-11-26 15:59:51.326894 | LOOP [upload-logs : Compress console log and json output] 2025-11-26 15:59:51.371258 | logserver.rdoproject.org | skipping: Conditional result was False 2025-11-26 15:59:51.379196 | logserver.rdoproject.org | skipping: Conditional result was False 2025-11-26 15:59:51.386815 | 2025-11-26 15:59:51.386963 | LOOP [upload-logs : Upload compressed console log and json output] 2025-11-26 15:59:51.427933 | logserver.rdoproject.org | skipping: Conditional result was False 2025-11-26 15:59:51.428197 | 2025-11-26 15:59:51.431574 | logserver.rdoproject.org | skipping: Conditional result was False 2025-11-26 15:59:51.436406 | 2025-11-26 15:59:51.436530 | LOOP [upload-logs : Upload console log and json output]