2025-10-09 21:00:03.137368 | Job console starting... 2025-10-09 21:00:03.377646 | Updating repositories 2025-10-09 21:00:04.132435 | Preparing job workspace 2025-10-09 21:00:10.839951 | Running Ansible setup... 2025-10-09 21:00:14.300633 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-10-09 21:00:14.776711 | 2025-10-09 21:00:14.776847 | PLAY [localhost] 2025-10-09 21:00:14.784594 | 2025-10-09 21:00:14.784661 | TASK [Gathering Facts] 2025-10-09 21:00:15.540271 | localhost | ok 2025-10-09 21:00:15.551888 | 2025-10-09 21:00:15.551991 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2025-10-09 21:00:15.848713 | localhost -> localhost | changed 2025-10-09 21:00:15.853708 | 2025-10-09 21:00:15.853786 | TASK [log-inventory : Copy ansible inventory to logs dir] 2025-10-09 21:00:16.475091 | localhost -> localhost | changed 2025-10-09 21:00:16.482959 | 2025-10-09 21:00:16.483026 | TASK [Setup log path fact] 2025-10-09 21:00:16.499746 | localhost | ok 2025-10-09 21:00:16.509696 | 2025-10-09 21:00:16.509756 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-10-09 21:00:16.525978 | localhost | ok 2025-10-09 21:00:16.532646 | 2025-10-09 21:00:16.532711 | TASK [emit-job-header : Print job information] 2025-10-09 21:00:16.559009 | # Job Information 2025-10-09 21:00:16.559118 | Ansible Version: 2.15.12 2025-10-09 21:00:16.559148 | Job: cifmw-molecule-reproducer 2025-10-09 21:00:16.559169 | Pipeline: github-check 2025-10-09 21:00:16.559187 | Executor: ibm-bm4-ze.softwarefactory-project.io 2025-10-09 21:00:16.559205 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3350 2025-10-09 21:00:16.559223 | Log URL (when completed): https://logserver.rdoproject.org/ade/rdoproject.org/ade6fa2c29a64550b8f2813b6c02d566/ 2025-10-09 21:00:16.559240 | Event ID: 9f8f5f00-a552-11f0-9748-fcb1beb182ad 2025-10-09 21:00:16.562564 | 2025-10-09 21:00:16.562626 | LOOP [emit-job-header : Print node information] 2025-10-09 21:00:16.641270 | localhost | ok: 2025-10-09 21:00:16.641378 | localhost | # Node Information 2025-10-09 21:00:16.641405 | localhost | Inventory Hostname: controller 2025-10-09 21:00:16.641426 | localhost | Hostname: np0005479050 2025-10-09 21:00:16.641445 | localhost | Username: zuul 2025-10-09 21:00:16.641464 | localhost | Distro: CentOS 9 2025-10-09 21:00:16.641480 | localhost | Provider: ibm-bm4-nodepool 2025-10-09 21:00:16.641496 | localhost | Region: regionOne 2025-10-09 21:00:16.641511 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2025-10-09 21:00:16.641527 | localhost | Product Name: OpenStack Compute 2025-10-09 21:00:16.641543 | localhost | Interface IP: 192.168.26.111 2025-10-09 21:00:16.662343 | 2025-10-09 21:00:16.662392 | PLAY [all] 2025-10-09 21:00:16.668273 | 2025-10-09 21:00:16.668333 | TASK [Gather network facts] 2025-10-09 21:00:17.123579 | controller | ok 2025-10-09 21:00:17.136636 | 2025-10-09 21:00:17.136695 | TASK [include_role : start-zuul-console] 2025-10-09 21:00:17.154402 | controller | ok 2025-10-09 21:00:17.164417 | 2025-10-09 21:00:17.164475 | TASK [start-zuul-console : Start zuul_console daemon.] 2025-10-09 21:00:17.546372 | controller | ok 2025-10-09 21:00:17.554165 | 2025-10-09 21:00:17.554221 | TASK [include_role : add-build-sshkey] 2025-10-09 21:00:17.571358 | controller | ok 2025-10-09 21:00:17.583428 | 2025-10-09 21:00:17.583492 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2025-10-09 21:00:17.778839 | controller -> localhost | ok 2025-10-09 21:00:17.783860 | 2025-10-09 21:00:17.783931 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2025-10-09 21:00:17.802455 | controller | ok 2025-10-09 21:00:17.813976 | controller | included: /var/lib/zuul/builds/ade6fa2c29a64550b8f2813b6c02d566/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2025-10-09 21:00:17.819149 | 2025-10-09 21:00:17.819206 | TASK [add-build-sshkey : Create Temp SSH key] 2025-10-09 21:00:18.217186 | controller -> localhost | Generating public/private rsa key pair. 2025-10-09 21:00:18.217388 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/ade6fa2c29a64550b8f2813b6c02d566/work/ade6fa2c29a64550b8f2813b6c02d566_id_rsa. 2025-10-09 21:00:18.217423 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/ade6fa2c29a64550b8f2813b6c02d566/work/ade6fa2c29a64550b8f2813b6c02d566_id_rsa.pub. 2025-10-09 21:00:18.217447 | controller -> localhost | The key fingerprint is: 2025-10-09 21:00:18.217467 | controller -> localhost | SHA256:0JEchG4ePNcnwU3F5QlgoXk47UelBP8Hr6EzdtdOH0o zuul-build-sshkey 2025-10-09 21:00:18.217487 | controller -> localhost | The key's randomart image is: 2025-10-09 21:00:18.217506 | controller -> localhost | +---[RSA 3072]----+ 2025-10-09 21:00:18.217523 | controller -> localhost | | +++ B==.o.| 2025-10-09 21:00:18.217541 | controller -> localhost | | ..o.O + =..| 2025-10-09 21:00:18.217558 | controller -> localhost | | o. .* + +...| 2025-10-09 21:00:18.217575 | controller -> localhost | | *.. * o .o | 2025-10-09 21:00:18.217591 | controller -> localhost | | o +S + ...o| 2025-10-09 21:00:18.217607 | controller -> localhost | | . .. oo| 2025-10-09 21:00:18.217622 | controller -> localhost | | =Eo.+| 2025-10-09 21:00:18.217639 | controller -> localhost | | ..+.+o| 2025-10-09 21:00:18.217655 | controller -> localhost | | . o| 2025-10-09 21:00:18.217670 | controller -> localhost | +----[SHA256]-----+ 2025-10-09 21:00:18.217710 | controller -> localhost | ok: Runtime: 0:00:00.082402 2025-10-09 21:00:18.223100 | 2025-10-09 21:00:18.223170 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2025-10-09 21:00:18.242223 | controller | ok 2025-10-09 21:00:18.251100 | controller | included: /var/lib/zuul/builds/ade6fa2c29a64550b8f2813b6c02d566/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2025-10-09 21:00:18.258061 | 2025-10-09 21:00:18.258130 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2025-10-09 21:00:18.272627 | controller | skipping: Conditional result was False 2025-10-09 21:00:18.278118 | 2025-10-09 21:00:18.278180 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2025-10-09 21:00:18.755357 | controller | changed 2025-10-09 21:00:18.760100 | 2025-10-09 21:00:18.760174 | TASK [add-build-sshkey : Make sure user has a .ssh] 2025-10-09 21:00:19.024613 | controller | ok 2025-10-09 21:00:19.029675 | 2025-10-09 21:00:19.029741 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2025-10-09 21:00:20.223038 | controller | changed 2025-10-09 21:00:20.227951 | 2025-10-09 21:00:20.228016 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2025-10-09 21:00:21.412088 | controller | changed 2025-10-09 21:00:21.416573 | 2025-10-09 21:00:21.416639 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2025-10-09 21:00:21.429776 | controller | skipping: Conditional result was False 2025-10-09 21:00:21.434954 | 2025-10-09 21:00:21.435019 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2025-10-09 21:00:21.721088 | controller -> localhost | changed 2025-10-09 21:00:21.730937 | 2025-10-09 21:00:21.731002 | TASK [add-build-sshkey : Add back temp key] 2025-10-09 21:00:21.935882 | controller -> localhost | Identity added: /var/lib/zuul/builds/ade6fa2c29a64550b8f2813b6c02d566/work/ade6fa2c29a64550b8f2813b6c02d566_id_rsa (zuul-build-sshkey) 2025-10-09 21:00:21.936121 | controller -> localhost | ok: Runtime: 0:00:00.006106 2025-10-09 21:00:21.941808 | 2025-10-09 21:00:21.941878 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2025-10-09 21:00:22.303103 | controller | ok 2025-10-09 21:00:22.307767 | 2025-10-09 21:00:22.307856 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2025-10-09 21:00:22.330985 | controller | skipping: Conditional result was False 2025-10-09 21:00:22.340242 | 2025-10-09 21:00:22.340317 | TASK [include_role : validate-host] 2025-10-09 21:00:22.357117 | controller | ok 2025-10-09 21:00:22.374573 | 2025-10-09 21:00:22.374642 | TASK [validate-host : Define zuul_info_dir fact] 2025-10-09 21:00:22.391935 | controller | ok 2025-10-09 21:00:22.396006 | 2025-10-09 21:00:22.396072 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2025-10-09 21:00:22.580766 | controller -> localhost | ok 2025-10-09 21:00:22.586731 | 2025-10-09 21:00:22.586791 | TASK [validate-host : Collect information about the host] 2025-10-09 21:00:23.300219 | controller | ok 2025-10-09 21:00:23.307679 | 2025-10-09 21:00:23.307741 | TASK [validate-host : Sanitize hostname] 2025-10-09 21:00:23.345214 | controller | ok 2025-10-09 21:00:23.349481 | 2025-10-09 21:00:23.349542 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2025-10-09 21:00:23.687369 | controller -> localhost | changed 2025-10-09 21:00:23.692451 | 2025-10-09 21:00:23.692511 | TASK [validate-host : Collect information about zuul worker] 2025-10-09 21:00:24.074929 | controller | ok 2025-10-09 21:00:24.079561 | 2025-10-09 21:00:24.079628 | TASK [validate-host : Write out all zuul information for each host] 2025-10-09 21:00:24.396544 | controller -> localhost | changed 2025-10-09 21:00:24.405021 | 2025-10-09 21:00:24.405082 | TASK [include_role : prepare-workspace-openshift] 2025-10-09 21:00:24.418291 | controller | skipping: Conditional result was False 2025-10-09 21:00:24.422875 | 2025-10-09 21:00:24.422957 | TASK [include_role : remove-zuul-sshkey] 2025-10-09 21:00:24.436373 | controller | skipping: Conditional result was False 2025-10-09 21:00:24.440742 | 2025-10-09 21:00:24.440803 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2025-10-09 21:00:24.698702 | controller | ok: "logs" 2025-10-09 21:00:24.698902 | controller | ok: All items complete 2025-10-09 21:00:24.698959 | 2025-10-09 21:00:24.931466 | controller | ok: "artifacts" 2025-10-09 21:00:25.160136 | controller | ok: "docs" 2025-10-09 21:00:25.171748 | 2025-10-09 21:00:25.171842 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2025-10-09 21:00:25.441749 | controller | changed: "logs" 2025-10-09 21:00:25.681553 | controller | changed: "artifacts" 2025-10-09 21:00:25.927526 | controller | changed: "docs" 2025-10-09 21:00:25.947176 | 2025-10-09 21:00:25.947248 | PLAY RECAP 2025-10-09 21:00:25.947288 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-10-09 21:00:25.947313 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-10-09 21:00:25.947330 | 2025-10-09 21:00:26.019094 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-10-09 21:00:26.019979 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-10-09 21:00:26.516078 | 2025-10-09 21:00:26.516179 | PLAY [all] 2025-10-09 21:00:26.533840 | 2025-10-09 21:00:26.533937 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-10-09 21:00:26.572185 | controller | ok 2025-10-09 21:00:26.576590 | 2025-10-09 21:00:26.576662 | TASK [mirror-info-fork : Create /etc/ci] 2025-10-09 21:00:26.979012 | controller | changed 2025-10-09 21:00:26.984242 | 2025-10-09 21:00:26.984329 | TASK [mirror-info-fork : Install ci_mirror script] 2025-10-09 21:00:28.301579 | controller | changed 2025-10-09 21:00:28.311570 | 2025-10-09 21:00:28.311645 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2025-10-09 21:00:28.741310 | controller | changed: 2025-10-09 21:00:28.741581 | controller | { 2025-10-09 21:00:28.741625 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2025-10-09 21:00:28.741660 | controller | } 2025-10-09 21:00:29.025631 | controller | changed: 2025-10-09 21:00:29.025685 | controller | { 2025-10-09 21:00:29.025714 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2025-10-09 21:00:29.025735 | controller | } 2025-10-09 21:00:29.313860 | controller | changed: 2025-10-09 21:00:29.313933 | controller | { 2025-10-09 21:00:29.313969 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2025-10-09 21:00:29.313992 | controller | } 2025-10-09 21:00:29.597588 | controller | changed: 2025-10-09 21:00:29.597639 | controller | { 2025-10-09 21:00:29.597666 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2025-10-09 21:00:29.597688 | controller | } 2025-10-09 21:00:29.878484 | controller | changed: 2025-10-09 21:00:29.878588 | controller | { 2025-10-09 21:00:29.878616 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2025-10-09 21:00:29.878636 | controller | } 2025-10-09 21:00:30.175744 | controller | changed: 2025-10-09 21:00:30.175896 | controller | { 2025-10-09 21:00:30.175958 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2025-10-09 21:00:30.175984 | controller | } 2025-10-09 21:00:30.490089 | controller | changed: 2025-10-09 21:00:30.490198 | controller | { 2025-10-09 21:00:30.490224 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2025-10-09 21:00:30.490245 | controller | } 2025-10-09 21:00:30.775850 | controller | changed: 2025-10-09 21:00:30.775971 | controller | { 2025-10-09 21:00:30.776001 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2025-10-09 21:00:30.776022 | controller | } 2025-10-09 21:00:31.058709 | controller | changed: 2025-10-09 21:00:31.058858 | controller | { 2025-10-09 21:00:31.058895 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2025-10-09 21:00:31.058937 | controller | } 2025-10-09 21:00:31.384153 | controller | changed: 2025-10-09 21:00:31.384234 | controller | { 2025-10-09 21:00:31.384262 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2025-10-09 21:00:31.384286 | controller | } 2025-10-09 21:00:31.659426 | controller | changed: 2025-10-09 21:00:31.659473 | controller | { 2025-10-09 21:00:31.659496 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2025-10-09 21:00:31.659514 | controller | } 2025-10-09 21:00:31.948850 | controller | changed: 2025-10-09 21:00:31.948900 | controller | { 2025-10-09 21:00:31.948947 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2025-10-09 21:00:31.948970 | controller | } 2025-10-09 21:00:32.248234 | controller | changed: 2025-10-09 21:00:32.248291 | controller | { 2025-10-09 21:00:32.248322 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGpU/BepK3qX0NRf5Np+dOBDqzQEefhNrw2DCZaH3uWW rebtoor@monolith" 2025-10-09 21:00:32.248347 | controller | } 2025-10-09 21:00:32.544178 | controller | changed: 2025-10-09 21:00:32.544238 | controller | { 2025-10-09 21:00:32.544273 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2025-10-09 21:00:32.544395 | controller | } 2025-10-09 21:00:32.835772 | controller | changed: 2025-10-09 21:00:32.835852 | controller | { 2025-10-09 21:00:32.835878 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2025-10-09 21:00:32.835898 | controller | } 2025-10-09 21:00:33.143844 | controller | changed: 2025-10-09 21:00:33.143893 | controller | { 2025-10-09 21:00:33.143937 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2025-10-09 21:00:33.143960 | controller | } 2025-10-09 21:00:33.439919 | controller | changed: 2025-10-09 21:00:33.439974 | controller | { 2025-10-09 21:00:33.440004 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2025-10-09 21:00:33.440029 | controller | } 2025-10-09 21:00:33.729429 | controller | changed: 2025-10-09 21:00:33.729479 | controller | { 2025-10-09 21:00:33.729505 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2025-10-09 21:00:33.729534 | controller | } 2025-10-09 21:00:34.024162 | controller | changed: 2025-10-09 21:00:34.024223 | controller | { 2025-10-09 21:00:34.024249 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2025-10-09 21:00:34.024268 | controller | } 2025-10-09 21:00:34.320855 | controller | changed: 2025-10-09 21:00:34.320920 | controller | { 2025-10-09 21:00:34.320949 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2025-10-09 21:00:34.320970 | controller | } 2025-10-09 21:00:34.616881 | controller | changed: 2025-10-09 21:00:34.616948 | controller | { 2025-10-09 21:00:34.616976 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2025-10-09 21:00:34.616995 | controller | } 2025-10-09 21:00:34.917259 | controller | changed: 2025-10-09 21:00:34.917307 | controller | { 2025-10-09 21:00:34.917331 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2025-10-09 21:00:34.917349 | controller | } 2025-10-09 21:00:35.215273 | controller | changed: 2025-10-09 21:00:35.215325 | controller | { 2025-10-09 21:00:35.215351 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2025-10-09 21:00:35.215372 | controller | } 2025-10-09 21:00:35.509142 | controller | changed: 2025-10-09 21:00:35.509202 | controller | { 2025-10-09 21:00:35.509231 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2025-10-09 21:00:35.509252 | controller | } 2025-10-09 21:00:35.803479 | controller | changed: 2025-10-09 21:00:35.803528 | controller | { 2025-10-09 21:00:35.803553 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2025-10-09 21:00:35.803573 | controller | } 2025-10-09 21:00:36.097149 | controller | changed: 2025-10-09 21:00:36.097201 | controller | { 2025-10-09 21:00:36.097226 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2025-10-09 21:00:36.097245 | controller | } 2025-10-09 21:00:36.116295 | 2025-10-09 21:00:36.116419 | TASK [Set timezone to UTC] 2025-10-09 21:00:36.622274 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2025-10-09 21:00:36.626960 | 2025-10-09 21:00:36.627026 | TASK [Create nodepool directory] 2025-10-09 21:00:36.900465 | controller | changed 2025-10-09 21:00:36.905587 | 2025-10-09 21:00:36.905650 | TASK [Create nodepool sub_nodes file] 2025-10-09 21:00:37.950472 | controller | changed 2025-10-09 21:00:37.955375 | 2025-10-09 21:00:37.955446 | TASK [Create nodepool sub_nodes_private file] 2025-10-09 21:00:38.999291 | controller | changed 2025-10-09 21:00:39.004066 | 2025-10-09 21:00:39.004137 | LOOP [Populate nodepool sub_nodes file] 2025-10-09 21:00:39.032326 | 2025-10-09 21:00:39.032450 | LOOP [Populate nodepool sub_nodes_private file] 2025-10-09 21:00:39.059947 | 2025-10-09 21:00:39.060054 | TASK [Create nodepool primary file] 2025-10-09 21:00:39.082627 | controller | skipping: Conditional result was False 2025-10-09 21:00:39.087190 | 2025-10-09 21:00:39.087259 | TASK [Create nodepool node_private for this node] 2025-10-09 21:00:40.180549 | controller | changed 2025-10-09 21:00:40.185961 | 2025-10-09 21:00:40.186026 | LOOP [Copy ssh keys to nodepool directory] 2025-10-09 21:00:40.574388 | controller | ok: Item: id_rsa Runtime: 0:00:00.005192 2025-10-09 21:00:40.574569 | 2025-10-09 21:00:40.821581 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.005366 2025-10-09 21:00:40.834057 | 2025-10-09 21:00:40.834135 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2025-10-09 21:00:41.897565 | controller | changed 2025-10-09 21:00:41.902234 | 2025-10-09 21:00:41.902297 | TASK [Validate sudoers config after edits] 2025-10-09 21:00:42.214890 | controller | /etc/sudoers: parsed OK 2025-10-09 21:00:42.214943 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2025-10-09 21:00:42.214953 | controller | /etc/sudoers.d/zuul: parsed OK 2025-10-09 21:00:42.214960 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2025-10-09 21:00:42.427948 | controller | ok: Runtime: 0:00:00.005535 2025-10-09 21:00:42.433036 | 2025-10-09 21:00:42.433094 | TASK [Show the environment passed in to job shell scripts] 2025-10-09 21:00:42.720636 | controller | SHELL=/bin/bash 2025-10-09 21:00:42.720688 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2025-10-09 21:00:42.720698 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2025-10-09 21:00:42.720704 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/50/3350/55ebc64c162b091ebba3cc57bbae949ea106dbd4 2025-10-09 21:00:42.720710 | controller | PWD=/home/zuul 2025-10-09 21:00:42.720716 | controller | ZUUL_PIPELINE=github-check 2025-10-09 21:00:42.720721 | controller | LOGNAME=zuul 2025-10-09 21:00:42.720727 | controller | XDG_SESSION_TYPE=tty 2025-10-09 21:00:42.720777 | controller | _=/usr/bin/env 2025-10-09 21:00:42.720785 | controller | MOTD_SHOWN=pam 2025-10-09 21:00:42.720790 | controller | HOME=/home/zuul 2025-10-09 21:00:42.720796 | controller | LANG=en_US.UTF-8 2025-10-09 21:00:42.720801 | controller | SSH_CONNECTION=192.168.26.12 42296 192.168.26.111 22 2025-10-09 21:00:42.720807 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2025-10-09 21:00:42.720817 | controller | ZUUL_CHANGE_IDS=3350,55ebc64c162b091ebba3cc57bbae949ea106dbd4 2025-10-09 21:00:42.720822 | controller | WORKSPACE=/home/zuul/workspace 2025-10-09 21:00:42.720827 | controller | XDG_SESSION_CLASS=user 2025-10-09 21:00:42.720833 | controller | SELINUX_ROLE_REQUESTED= 2025-10-09 21:00:42.720838 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2025-10-09 21:00:42.720843 | controller | USER=zuul 2025-10-09 21:00:42.720849 | controller | ZUUL_VOTING=True 2025-10-09 21:00:42.720854 | controller | BUILD_TIMEOUT=5400000 2025-10-09 21:00:42.720859 | controller | SELINUX_USE_CURRENT_RANGE= 2025-10-09 21:00:42.720864 | controller | SHLVL=1 2025-10-09 21:00:42.720870 | controller | ZUUL_PATCHSET=55ebc64c162b091ebba3cc57bbae949ea106dbd4 2025-10-09 21:00:42.720875 | controller | XDG_SESSION_ID=1 2025-10-09 21:00:42.720880 | controller | ZUUL_BRANCH=main 2025-10-09 21:00:42.720886 | controller | XDG_RUNTIME_DIR=/run/user/1000 2025-10-09 21:00:42.720891 | controller | SSH_CLIENT=192.168.26.12 42296 22 2025-10-09 21:00:42.720897 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2025-10-09 21:00:42.720902 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2025-10-09 21:00:42.720907 | controller | which_declare=declare -f 2025-10-09 21:00:42.720913 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2025-10-09 21:00:42.720919 | controller | SELINUX_LEVEL_REQUESTED= 2025-10-09 21:00:42.720924 | controller | ZUUL_CHANGE=3350 2025-10-09 21:00:42.720929 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2025-10-09 21:00:42.720934 | controller | ZUUL_UUID=ade6fa2c29a64550b8f2813b6c02d566 2025-10-09 21:00:42.720940 | controller | BASH_FUNC_which%%=() { ( alias; 2025-10-09 21:00:42.720945 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2025-10-09 21:00:42.720950 | controller | } 2025-10-09 21:00:42.957684 | controller | ok: Runtime: 0:00:00.007149 2025-10-09 21:00:42.962468 | 2025-10-09 21:00:42.962525 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2025-10-09 21:00:42.976099 | controller | skipping: Conditional result was False 2025-10-09 21:00:42.981036 | 2025-10-09 21:00:42.981095 | TASK [Symlink /home/zuul-worker/workspace] 2025-10-09 21:00:43.525826 | controller | skipping: Conditional result was False 2025-10-09 21:00:43.531781 | 2025-10-09 21:00:43.531854 | TASK [Ensure legacy workspace directory] 2025-10-09 21:00:43.793950 | controller | changed 2025-10-09 21:00:43.812099 | 2025-10-09 21:00:43.812193 | PLAY RECAP 2025-10-09 21:00:43.812240 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-10-09 21:00:43.812264 | 2025-10-09 21:00:43.880490 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-10-09 21:00:43.881310 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-10-09 21:00:44.365933 | 2025-10-09 21:00:44.366032 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2025-10-09 21:00:44.385360 | 2025-10-09 21:00:44.385434 | TASK [Create zuul-output directory] 2025-10-09 21:00:44.769538 | controller | changed 2025-10-09 21:00:44.774293 | 2025-10-09 21:00:44.774365 | TASK [Slurp Zuul inventory test] 2025-10-09 21:00:45.030829 | controller -> localhost | ok 2025-10-09 21:00:45.036957 | 2025-10-09 21:00:45.037026 | TASK [Save zuul inventory] 2025-10-09 21:00:46.262030 | controller | changed 2025-10-09 21:00:46.267239 | 2025-10-09 21:00:46.267302 | TASK [Save zuul vars without the change_message] 2025-10-09 21:00:47.389800 | controller | changed 2025-10-09 21:00:47.408373 | 2025-10-09 21:00:47.408429 | PLAY RECAP 2025-10-09 21:00:47.408469 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-10-09 21:00:47.408491 | 2025-10-09 21:00:47.469823 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-10-09 21:00:47.470534 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-10-09 21:00:47.994122 | 2025-10-09 21:00:47.994262 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2025-10-09 21:00:48.013845 | 2025-10-09 21:00:48.013934 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2025-10-09 21:00:48.032066 | controller | ok 2025-10-09 21:00:48.048200 | 2025-10-09 21:00:48.048285 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-10-09 21:00:48.071228 | controller | skipping: Conditional result was False 2025-10-09 21:00:48.076687 | 2025-10-09 21:00:48.076756 | TASK [mirror-info-fork : Create /etc/ci] 2025-10-09 21:00:48.469336 | controller | ok 2025-10-09 21:00:48.474631 | 2025-10-09 21:00:48.474698 | TASK [mirror-info-fork : Install ci_mirror script] 2025-10-09 21:00:49.468176 | controller | ok 2025-10-09 21:00:49.477264 | 2025-10-09 21:00:49.477328 | TASK [Prepare workspace] 2025-10-09 21:00:49.494702 | controller | ok 2025-10-09 21:00:49.510819 | 2025-10-09 21:00:49.510884 | TASK [prepare-workspace : Start zuul_console daemon.] 2025-10-09 21:00:49.885199 | controller | ok 2025-10-09 21:00:49.890748 | 2025-10-09 21:00:49.890813 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2025-10-09 21:00:51.835232 | controller | Output suppressed because no_log was given 2025-10-09 21:00:51.843983 | 2025-10-09 21:00:51.844046 | LOOP [Create zuul-output directory] 2025-10-09 21:00:52.110813 | controller | changed: "/home/zuul/ci-framework-data/logs" 2025-10-09 21:00:52.341854 | controller | ok: "/home/zuul/zuul-output/logs" 2025-10-09 21:00:52.352039 | 2025-10-09 21:00:52.352132 | TASK [Install required packages] 2025-10-09 21:01:11.110162 | controller | ok: Nothing to do 2025-10-09 21:01:11.114961 | 2025-10-09 21:01:11.115024 | TASK [Install venv] 2025-10-09 21:02:09.077942 | controller | changed 2025-10-09 21:02:09.101788 | 2025-10-09 21:02:09.101842 | PLAY RECAP 2025-10-09 21:02:09.101884 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-10-09 21:02:09.101904 | 2025-10-09 21:02:09.168160 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-10-09 21:02:09.168969 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-10-09 21:02:09.649532 | 2025-10-09 21:02:09.649625 | PLAY [Run ci/playbooks/molecule-test.yml] 2025-10-09 21:02:09.669238 | 2025-10-09 21:02:09.669310 | TASK [Gather required facts] 2025-10-09 21:02:10.216504 | controller | ok 2025-10-09 21:02:10.221750 | 2025-10-09 21:02:10.221826 | TASK [Load environment var if instructed to] 2025-10-09 21:02:10.235474 | controller | skipping: Conditional result was False 2025-10-09 21:02:10.240759 | 2025-10-09 21:02:10.240823 | TASK [Ensure group_vars dir exists] 2025-10-09 21:02:10.614480 | controller | ok 2025-10-09 21:02:10.619361 | 2025-10-09 21:02:10.619420 | TASK [Run molecule] 2025-10-09 21:02:11.601396 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2025-10-09 21:02:11.861888 | controller | INFO Performing prerun with role_name_check=0... 2025-10-09 21:02:29.078992 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2025-10-09 21:02:29.079430 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-10-09 21:02:29.079874 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-10-09 21:02:29.080282 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-10-09 21:02:29.080760 | controller | WARNING Another version of 'cifmw.general' 1.0.0+55ebc64c was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+55ebc64c (/home/zuul/.ansible/collections/ansible_collections). 2025-10-09 21:02:29.081178 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-10-09 21:02:29.081946 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-10-09 21:02:29.082016 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-10-09 21:02:29.082437 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-10-09 21:02:29.082922 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-10-09 21:02:29.083333 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-10-09 21:02:29.083777 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-10-09 21:02:29.084175 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-10-09 21:02:29.084613 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-10-09 21:02:29.085014 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-10-09 21:02:29.095568 | controller | INFO Running crc_layout > prepare 2025-10-09 21:02:29.770908 | controller | 2025-10-09 21:02:29.771019 | controller | PLAY [Prepare] ***************************************************************** 2025-10-09 21:02:29.771281 | controller | 2025-10-09 21:02:29.771378 | controller | TASK [Gathering Facts] ********************************************************* 2025-10-09 21:02:29.771673 | controller | Thursday 09 October 2025 21:02:29 +0000 (0:00:00.018) 0:00:00.018 ****** 2025-10-09 21:02:30.605530 | controller | ok: [instance] 2025-10-09 21:02:30.605718 | controller | 2025-10-09 21:02:30.605817 | controller | TASK [Create custom basedir] *************************************************** 2025-10-09 21:02:30.605912 | controller | Thursday 09 October 2025 21:02:30 +0000 (0:00:00.834) 0:00:00.853 ****** 2025-10-09 21:02:30.939862 | controller | changed: [instance] 2025-10-09 21:02:30.939931 | controller | 2025-10-09 21:02:30.940012 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2025-10-09 21:02:30.940104 | controller | Thursday 09 October 2025 21:02:30 +0000 (0:00:00.334) 0:00:01.188 ****** 2025-10-09 21:02:30.965019 | controller | skipping: [instance] 2025-10-09 21:02:30.965210 | controller | 2025-10-09 21:02:30.965337 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2025-10-09 21:02:30.965437 | controller | Thursday 09 October 2025 21:02:30 +0000 (0:00:00.025) 0:00:01.213 ****** 2025-10-09 21:02:31.011330 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2025-10-09 21:02:31.011517 | controller | 2025-10-09 21:02:31.011764 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2025-10-09 21:02:31.011960 | controller | Thursday 09 October 2025 21:02:31 +0000 (0:00:00.046) 0:00:01.260 ****** 2025-10-09 21:02:31.288109 | controller | ok: [instance] 2025-10-09 21:02:31.288252 | controller | 2025-10-09 21:02:31.288440 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2025-10-09 21:02:31.288688 | controller | Thursday 09 October 2025 21:02:31 +0000 (0:00:00.276) 0:00:01.536 ****** 2025-10-09 21:02:31.496925 | controller | ok: [instance] 2025-10-09 21:02:31.497076 | controller | 2025-10-09 21:02:31.497265 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2025-10-09 21:02:31.497362 | controller | Thursday 09 October 2025 21:02:31 +0000 (0:00:00.208) 0:00:01.745 ****** 2025-10-09 21:02:32.171829 | controller | ok: [instance] => (item=ubi-9-appstream) 2025-10-09 21:02:32.171885 | controller | ok: [instance] => (item=ubi-9-baseos) 2025-10-09 21:02:32.171986 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2025-10-09 21:02:32.172077 | controller | 2025-10-09 21:02:32.172163 | controller | TASK [Deploy repo-setup] ******************************************************* 2025-10-09 21:02:32.172249 | controller | Thursday 09 October 2025 21:02:32 +0000 (0:00:00.675) 0:00:02.420 ****** 2025-10-09 21:02:32.233301 | controller | 2025-10-09 21:02:32.233388 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-10-09 21:02:32.233567 | controller | Thursday 09 October 2025 21:02:32 +0000 (0:00:00.061) 0:00:02.482 ****** 2025-10-09 21:02:32.754595 | controller | changed: [instance] => (item=tmp) 2025-10-09 21:02:32.754718 | controller | changed: [instance] => (item=artifacts/repositories) 2025-10-09 21:02:32.754848 | controller | changed: [instance] => (item=venv/repo_setup) 2025-10-09 21:02:32.754958 | controller | 2025-10-09 21:02:32.755074 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-10-09 21:02:32.755186 | controller | Thursday 09 October 2025 21:02:32 +0000 (0:00:00.521) 0:00:03.003 ****** 2025-10-09 21:02:33.529887 | controller | ok: [instance] 2025-10-09 21:02:33.530136 | controller | 2025-10-09 21:02:33.530217 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-10-09 21:02:34.702734 | controller | Thursday 09 October 2025 21:02:33 +0000 (0:00:00.775) 0:00:03.778 ****** 2025-10-09 21:02:34.702782 | controller | changed: [instance] 2025-10-09 21:02:34.702817 | controller | 2025-10-09 21:02:34.702855 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-10-09 21:02:34.703035 | controller | Thursday 09 October 2025 21:02:34 +0000 (0:00:01.172) 0:00:04.951 ****** 2025-10-09 21:02:42.309347 | controller | changed: [instance] 2025-10-09 21:02:43.008336 | controller | 2025-10-09 21:02:43.008375 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-10-09 21:02:43.008383 | controller | Thursday 09 October 2025 21:02:42 +0000 (0:00:07.606) 0:00:12.557 ****** 2025-10-09 21:02:43.008394 | controller | changed: [instance] 2025-10-09 21:02:43.031729 | controller | 2025-10-09 21:02:43.031770 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-10-09 21:02:43.031780 | controller | Thursday 09 October 2025 21:02:43 +0000 (0:00:00.699) 0:00:13.256 ****** 2025-10-09 21:02:43.031792 | controller | skipping: [instance] 2025-10-09 21:02:43.031816 | controller | 2025-10-09 21:02:43.031825 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-10-09 21:02:43.031833 | controller | Thursday 09 October 2025 21:02:43 +0000 (0:00:00.023) 0:00:13.280 ****** 2025-10-09 21:02:43.876018 | controller | changed: [instance] 2025-10-09 21:02:43.910651 | controller | 2025-10-09 21:02:43.910683 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-10-09 21:02:43.910691 | controller | Thursday 09 October 2025 21:02:43 +0000 (0:00:00.843) 0:00:14.124 ****** 2025-10-09 21:02:43.910701 | controller | skipping: [instance] 2025-10-09 21:02:43.911564 | controller | 2025-10-09 21:02:43.944940 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-10-09 21:02:43.944956 | controller | Thursday 09 October 2025 21:02:43 +0000 (0:00:00.034) 0:00:14.159 ****** 2025-10-09 21:02:43.944965 | controller | skipping: [instance] 2025-10-09 21:02:43.981140 | controller | 2025-10-09 21:02:43.981156 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-10-09 21:02:43.981163 | controller | Thursday 09 October 2025 21:02:43 +0000 (0:00:00.034) 0:00:14.193 ****** 2025-10-09 21:02:43.981172 | controller | skipping: [instance] 2025-10-09 21:02:44.512014 | controller | 2025-10-09 21:02:44.512035 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-10-09 21:02:44.512042 | controller | Thursday 09 October 2025 21:02:43 +0000 (0:00:00.036) 0:00:14.229 ****** 2025-10-09 21:02:44.512051 | controller | changed: [instance] 2025-10-09 21:02:44.933651 | controller | 2025-10-09 21:02:44.933691 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-10-09 21:02:44.933699 | controller | Thursday 09 October 2025 21:02:44 +0000 (0:00:00.530) 0:00:14.760 ****** 2025-10-09 21:02:44.933711 | controller | changed: [instance] 2025-10-09 21:02:44.933878 | controller | 2025-10-09 21:02:44.934104 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-10-09 21:02:44.934317 | controller | Thursday 09 October 2025 21:02:44 +0000 (0:00:00.422) 0:00:15.182 ****** 2025-10-09 21:02:44.962996 | controller | skipping: [instance] 2025-10-09 21:02:44.963229 | controller | 2025-10-09 21:02:44.963451 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-10-09 21:02:44.963626 | controller | Thursday 09 October 2025 21:02:44 +0000 (0:00:00.029) 0:00:15.211 ****** 2025-10-09 21:02:44.991406 | controller | skipping: [instance] 2025-10-09 21:02:44.991536 | controller | 2025-10-09 21:02:44.991561 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-10-09 21:02:44.991677 | controller | Thursday 09 October 2025 21:02:44 +0000 (0:00:00.028) 0:00:15.240 ****** 2025-10-09 21:02:45.019542 | controller | skipping: [instance] 2025-10-09 21:02:45.019685 | controller | 2025-10-09 21:02:45.019812 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-10-09 21:02:45.019929 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.028) 0:00:15.268 ****** 2025-10-09 21:02:45.055425 | controller | ok: [instance] 2025-10-09 21:02:45.055653 | controller | 2025-10-09 21:02:45.055672 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-10-09 21:02:45.055683 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.035) 0:00:15.304 ****** 2025-10-09 21:02:45.081302 | controller | skipping: [instance] 2025-10-09 21:02:45.081407 | controller | 2025-10-09 21:02:45.081555 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-10-09 21:02:45.081727 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.026) 0:00:15.330 ****** 2025-10-09 21:02:45.108390 | controller | skipping: [instance] 2025-10-09 21:02:45.108426 | controller | 2025-10-09 21:02:45.108443 | controller | TASK [Download the RPM] ******************************************************** 2025-10-09 21:02:45.108689 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.026) 0:00:15.357 ****** 2025-10-09 21:02:45.135705 | controller | skipping: [instance] 2025-10-09 21:02:45.135907 | controller | 2025-10-09 21:02:45.136034 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-10-09 21:02:45.136189 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.027) 0:00:15.384 ****** 2025-10-09 21:02:45.162731 | controller | skipping: [instance] 2025-10-09 21:02:45.162890 | controller | 2025-10-09 21:02:45.162998 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-10-09 21:02:45.163103 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.026) 0:00:15.411 ****** 2025-10-09 21:02:45.190120 | controller | skipping: [instance] 2025-10-09 21:02:45.190222 | controller | 2025-10-09 21:02:45.190374 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-10-09 21:02:45.190463 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.027) 0:00:15.439 ****** 2025-10-09 21:02:45.219780 | controller | skipping: [instance] 2025-10-09 21:02:45.220018 | controller | 2025-10-09 21:02:45.220144 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-10-09 21:02:45.220264 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.029) 0:00:15.468 ****** 2025-10-09 21:02:45.245954 | controller | skipping: [instance] 2025-10-09 21:02:45.246059 | controller | 2025-10-09 21:02:45.246185 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-10-09 21:02:45.246335 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.026) 0:00:15.495 ****** 2025-10-09 21:02:45.434180 | controller | ok: [instance] 2025-10-09 21:02:45.434412 | controller | 2025-10-09 21:02:45.434688 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-10-09 21:02:45.434927 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.188) 0:00:15.683 ****** 2025-10-09 21:02:45.641994 | controller | changed: [instance] 2025-10-09 21:02:45.861486 | controller | 2025-10-09 21:02:45.861534 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-10-09 21:02:45.861543 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.207) 0:00:15.890 ****** 2025-10-09 21:02:45.861556 | controller | changed: [instance] 2025-10-09 21:02:45.883354 | controller | 2025-10-09 21:02:45.883380 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-10-09 21:02:45.883387 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.219) 0:00:16.110 ****** 2025-10-09 21:02:45.883397 | controller | skipping: [instance] 2025-10-09 21:02:45.904355 | controller | 2025-10-09 21:02:45.904376 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-10-09 21:02:45.904382 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.021) 0:00:16.131 ****** 2025-10-09 21:02:45.904396 | controller | skipping: [instance] 2025-10-09 21:02:45.925310 | controller | 2025-10-09 21:02:45.925332 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-10-09 21:02:45.925340 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.021) 0:00:16.153 ****** 2025-10-09 21:02:45.925349 | controller | skipping: [instance] 2025-10-09 21:02:45.945127 | controller | 2025-10-09 21:02:45.945144 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-10-09 21:02:45.945151 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.020) 0:00:16.173 ****** 2025-10-09 21:02:45.945160 | controller | skipping: [instance] 2025-10-09 21:02:45.967686 | controller | 2025-10-09 21:02:45.967702 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-10-09 21:02:45.967717 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.020) 0:00:16.193 ****** 2025-10-09 21:02:45.967728 | controller | skipping: [instance] 2025-10-09 21:02:45.988775 | controller | 2025-10-09 21:02:45.988788 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-10-09 21:02:45.988795 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.022) 0:00:16.215 ****** 2025-10-09 21:02:45.988809 | controller | skipping: [instance] 2025-10-09 21:02:45.988937 | controller | 2025-10-09 21:02:45.989091 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-10-09 21:02:45.989235 | controller | Thursday 09 October 2025 21:02:45 +0000 (0:00:00.021) 0:00:16.237 ****** 2025-10-09 21:02:46.005028 | controller | skipping: [instance] 2025-10-09 21:02:46.005264 | controller | 2025-10-09 21:02:46.005489 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-10-09 21:02:46.005659 | controller | Thursday 09 October 2025 21:02:46 +0000 (0:00:00.016) 0:00:16.254 ****** 2025-10-09 21:02:46.034067 | controller | skipping: [instance] 2025-10-09 21:02:46.034302 | controller | 2025-10-09 21:02:46.034548 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-10-09 21:02:46.034703 | controller | Thursday 09 October 2025 21:02:46 +0000 (0:00:00.028) 0:00:16.283 ****** 2025-10-09 21:02:46.050742 | controller | skipping: [instance] 2025-10-09 21:02:46.050977 | controller | 2025-10-09 21:02:46.051195 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-10-09 21:02:46.051407 | controller | Thursday 09 October 2025 21:02:46 +0000 (0:00:00.016) 0:00:16.299 ****** 2025-10-09 21:02:46.071203 | controller | skipping: [instance] 2025-10-09 21:02:46.071426 | controller | 2025-10-09 21:02:46.071664 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2025-10-09 21:02:46.071839 | controller | Thursday 09 October 2025 21:02:46 +0000 (0:00:00.020) 0:00:16.320 ****** 2025-10-09 21:02:46.098979 | controller | skipping: [instance] 2025-10-09 21:02:46.099217 | controller | 2025-10-09 21:02:46.099442 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2025-10-09 21:02:46.099720 | controller | Thursday 09 October 2025 21:02:46 +0000 (0:00:00.027) 0:00:16.347 ****** 2025-10-09 21:02:46.126888 | controller | skipping: [instance] 2025-10-09 21:02:46.127124 | controller | 2025-10-09 21:02:46.127348 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2025-10-09 21:02:46.127563 | controller | Thursday 09 October 2025 21:02:46 +0000 (0:00:00.027) 0:00:16.375 ****** 2025-10-09 21:02:46.153039 | controller | skipping: [instance] 2025-10-09 21:02:46.153188 | controller | 2025-10-09 21:02:46.153306 | controller | TASK [test_deps : Install additional packages] ********************************* 2025-10-09 21:02:46.153792 | controller | Thursday 09 October 2025 21:02:46 +0000 (0:00:00.026) 0:00:16.402 ****** 2025-10-09 21:02:46.179867 | controller | skipping: [instance] 2025-10-09 21:02:46.180015 | controller | 2025-10-09 21:02:46.180131 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2025-10-09 21:02:46.180361 | controller | Thursday 09 October 2025 21:02:46 +0000 (0:00:00.026) 0:00:16.429 ****** 2025-10-09 21:03:31.165240 | controller | ok: [instance] 2025-10-09 21:03:32.355093 | controller | 2025-10-09 21:03:32.355137 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2025-10-09 21:03:32.355147 | controller | Thursday 09 October 2025 21:03:31 +0000 (0:00:44.984) 0:01:01.413 ****** 2025-10-09 21:03:32.355159 | controller | ok: [instance] 2025-10-09 21:03:32.395408 | controller | 2025-10-09 21:03:32.395425 | controller | TASK [test_deps : Install extra packages] ************************************** 2025-10-09 21:03:32.395433 | controller | Thursday 09 October 2025 21:03:32 +0000 (0:00:01.189) 0:01:02.603 ****** 2025-10-09 21:03:32.395442 | controller | skipping: [instance] 2025-10-09 21:03:32.443812 | controller | 2025-10-09 21:03:32.443879 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-10-09 21:03:32.443891 | controller | Thursday 09 October 2025 21:03:32 +0000 (0:00:00.041) 0:01:02.644 ****** 2025-10-09 21:03:32.443908 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2025-10-09 21:03:32.443972 | controller | 2025-10-09 21:03:32.443985 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-10-09 21:03:32.465706 | controller | Thursday 09 October 2025 21:03:32 +0000 (0:00:00.048) 0:01:02.692 ****** 2025-10-09 21:03:32.465726 | controller | ok: [instance] => 2025-10-09 21:03:32.465759 | controller | cifmw_ci_setup_packages: 2025-10-09 21:03:32.465769 | controller | - bash-completion 2025-10-09 21:03:32.466778 | controller | - ca-certificates 2025-10-09 21:03:38.101925 | controller | - git-core 2025-10-09 21:03:38.101968 | controller | - make 2025-10-09 21:03:38.101976 | controller | - tar 2025-10-09 21:03:38.101981 | controller | - tmux 2025-10-09 21:03:38.101987 | controller | - python3-pip 2025-10-09 21:03:38.101992 | controller | 2025-10-09 21:03:38.101998 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-10-09 21:03:38.102004 | controller | Thursday 09 October 2025 21:03:32 +0000 (0:00:00.021) 0:01:02.714 ****** 2025-10-09 21:03:38.102014 | controller | changed: [instance] 2025-10-09 21:03:38.718675 | controller | 2025-10-09 21:03:38.718714 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-10-09 21:03:38.718722 | controller | Thursday 09 October 2025 21:03:38 +0000 (0:00:05.635) 0:01:08.350 ****** 2025-10-09 21:03:38.718733 | controller | ok: [instance] 2025-10-09 21:03:38.718764 | controller | 2025-10-09 21:03:38.718771 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-10-09 21:03:38.718778 | controller | Thursday 09 October 2025 21:03:38 +0000 (0:00:00.616) 0:01:08.966 ****** 2025-10-09 21:03:38.946634 | controller | changed: [instance] 2025-10-09 21:03:38.946700 | controller | 2025-10-09 21:03:38.946992 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-10-09 21:03:44.977612 | controller | Thursday 09 October 2025 21:03:38 +0000 (0:00:00.228) 0:01:09.195 ****** 2025-10-09 21:03:44.977680 | controller | changed: [instance] 2025-10-09 21:03:45.017018 | controller | 2025-10-09 21:03:45.017041 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-10-09 21:03:45.017050 | controller | Thursday 09 October 2025 21:03:44 +0000 (0:00:06.030) 0:01:15.225 ****** 2025-10-09 21:03:45.017061 | controller | ok: [instance] 2025-10-09 21:03:45.286313 | controller | 2025-10-09 21:03:45.286333 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-10-09 21:03:45.286340 | controller | Thursday 09 October 2025 21:03:45 +0000 (0:00:00.039) 0:01:15.265 ****** 2025-10-09 21:03:45.286348 | controller | changed: [instance] 2025-10-09 21:03:45.565285 | controller | 2025-10-09 21:03:45.565322 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-10-09 21:03:45.565336 | controller | Thursday 09 October 2025 21:03:45 +0000 (0:00:00.269) 0:01:15.534 ****** 2025-10-09 21:03:45.565352 | controller | changed: [instance] 2025-10-09 21:03:45.584742 | controller | 2025-10-09 21:03:45.584803 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-10-09 21:03:45.584814 | controller | Thursday 09 October 2025 21:03:45 +0000 (0:00:00.278) 0:01:15.813 ****** 2025-10-09 21:03:45.584829 | controller | skipping: [instance] 2025-10-09 21:03:45.584857 | controller | 2025-10-09 21:03:45.584975 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-10-09 21:03:45.585006 | controller | Thursday 09 October 2025 21:03:45 +0000 (0:00:00.020) 0:01:15.833 ****** 2025-10-09 21:03:45.603029 | controller | skipping: [instance] 2025-10-09 21:03:45.621723 | controller | 2025-10-09 21:03:45.621782 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-10-09 21:03:45.621794 | controller | Thursday 09 October 2025 21:03:45 +0000 (0:00:00.018) 0:01:15.851 ****** 2025-10-09 21:03:45.621811 | controller | skipping: [instance] 2025-10-09 21:03:45.638662 | controller | 2025-10-09 21:03:45.638682 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-10-09 21:03:45.638690 | controller | Thursday 09 October 2025 21:03:45 +0000 (0:00:00.018) 0:01:15.870 ****** 2025-10-09 21:03:45.638699 | controller | skipping: [instance] 2025-10-09 21:03:45.638727 | controller | 2025-10-09 21:03:45.638736 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-10-09 21:03:45.638838 | controller | Thursday 09 October 2025 21:03:45 +0000 (0:00:00.017) 0:01:15.887 ****** 2025-10-09 21:03:45.675755 | controller | skipping: [instance] 2025-10-09 21:03:45.676008 | controller | 2025-10-09 21:03:45.676036 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-10-09 21:03:45.676259 | controller | Thursday 09 October 2025 21:03:45 +0000 (0:00:00.036) 0:01:15.924 ****** 2025-10-09 21:03:45.698720 | controller | skipping: [instance] 2025-10-09 21:03:45.698868 | controller | 2025-10-09 21:03:45.699006 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-10-09 21:03:45.699141 | controller | Thursday 09 October 2025 21:03:45 +0000 (0:00:00.023) 0:01:15.947 ****** 2025-10-09 21:03:46.705745 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2025-10-09 21:03:46.705822 | controller | changed: [instance] => (item=/opt/basedir/logs) 2025-10-09 21:03:46.705830 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2025-10-09 21:03:46.705836 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2025-10-09 21:03:46.705842 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2025-10-09 21:03:46.705848 | controller | 2025-10-09 21:03:46.705856 | controller | TASK [Create secret file] ****************************************************** 2025-10-09 21:03:47.041675 | controller | Thursday 09 October 2025 21:03:46 +0000 (0:00:01.006) 0:01:16.954 ****** 2025-10-09 21:03:47.041723 | controller | changed: [instance] 2025-10-09 21:03:47.041754 | controller | 2025-10-09 21:03:47.041761 | controller | PLAY RECAP ********************************************************************* 2025-10-09 21:03:47.041768 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2025-10-09 21:03:47.043830 | controller | 2025-10-09 21:03:47.111130 | controller | Thursday 09 October 2025 21:03:47 +0000 (0:00:00.336) 0:01:17.290 ****** 2025-10-09 21:03:47.111181 | controller | =============================================================================== 2025-10-09 21:03:47.111189 | controller | test_deps : Install selinux python libs -------------------------------- 44.98s 2025-10-09 21:03:47.111195 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.61s 2025-10-09 21:03:47.111201 | controller | ci_setup : Install openshift client ------------------------------------- 6.03s 2025-10-09 21:03:47.111206 | controller | ci_setup : Install needed packages -------------------------------------- 5.64s 2025-10-09 21:03:47.111211 | controller | test_deps : Install python yaml libs ------------------------------------ 1.19s 2025-10-09 21:03:47.111217 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.17s 2025-10-09 21:03:47.111222 | controller | ci_setup : Manage directories ------------------------------------------- 1.01s 2025-10-09 21:03:47.111227 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.84s 2025-10-09 21:03:47.111232 | controller | Gathering Facts --------------------------------------------------------- 0.83s 2025-10-09 21:03:47.111237 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.78s 2025-10-09 21:03:47.111242 | controller | repo_setup : Install repo-setup package --------------------------------- 0.70s 2025-10-09 21:03:47.111247 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.68s 2025-10-09 21:03:47.111252 | controller | ci_setup : Gather version of openshift client --------------------------- 0.62s 2025-10-09 21:03:47.111257 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.53s 2025-10-09 21:03:47.111263 | controller | repo_setup : Ensure directories are present ----------------------------- 0.52s 2025-10-09 21:03:47.111268 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.42s 2025-10-09 21:03:47.111273 | controller | Create secret file ------------------------------------------------------ 0.34s 2025-10-09 21:03:47.111278 | controller | Create custom basedir --------------------------------------------------- 0.33s 2025-10-09 21:03:47.111283 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.28s 2025-10-09 21:03:47.111296 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.28s 2025-10-09 21:03:47.111307 | controller | INFO Running crc_layout > converge 2025-10-09 21:03:47.684947 | controller | 2025-10-09 21:03:47.685181 | controller | PLAY [Converge] **************************************************************** 2025-10-09 21:03:47.685322 | controller | 2025-10-09 21:03:47.685463 | controller | TASK [Gathering Facts] ********************************************************* 2025-10-09 21:03:47.685647 | controller | Thursday 09 October 2025 21:03:47 +0000 (0:00:00.025) 0:00:00.025 ****** 2025-10-09 21:03:48.503289 | controller | ok: [instance] 2025-10-09 21:03:48.526740 | controller | 2025-10-09 21:03:48.526782 | controller | TASK [Load networking definition from scenario file] *************************** 2025-10-09 21:03:48.526792 | controller | Thursday 09 October 2025 21:03:48 +0000 (0:00:00.818) 0:00:00.844 ****** 2025-10-09 21:03:48.526805 | controller | ok: [instance] 2025-10-09 21:03:50.409707 | controller | 2025-10-09 21:03:50.409755 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-10-09 21:03:50.409763 | controller | Thursday 09 October 2025 21:03:48 +0000 (0:00:00.023) 0:00:00.868 ****** 2025-10-09 21:03:50.409774 | controller | changed: [instance] 2025-10-09 21:03:50.409799 | controller | 2025-10-09 21:03:50.409807 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-10-09 21:03:50.409952 | controller | Thursday 09 October 2025 21:03:50 +0000 (0:00:01.882) 0:00:02.750 ****** 2025-10-09 21:03:50.436028 | controller | ok: [instance] 2025-10-09 21:03:50.456269 | controller | 2025-10-09 21:03:50.456287 | controller | TASK [reproducer : Load CI job environment] ************************************ 2025-10-09 21:03:50.456294 | controller | Thursday 09 October 2025 21:03:50 +0000 (0:00:00.026) 0:00:02.777 ****** 2025-10-09 21:03:50.456303 | controller | skipping: [instance] 2025-10-09 21:03:50.533335 | controller | 2025-10-09 21:03:50.533353 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2025-10-09 21:03:50.533360 | controller | Thursday 09 October 2025 21:03:50 +0000 (0:00:00.020) 0:00:02.797 ****** 2025-10-09 21:03:50.533369 | controller | ok: [instance] 2025-10-09 21:03:50.583374 | controller | 2025-10-09 21:03:50.583392 | controller | TASK [Build final libvirt layout] ********************************************** 2025-10-09 21:03:50.583399 | controller | Thursday 09 October 2025 21:03:50 +0000 (0:00:00.077) 0:00:02.874 ****** 2025-10-09 21:03:50.583408 | controller | 2025-10-09 21:03:50.664539 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2025-10-09 21:03:50.664561 | controller | Thursday 09 October 2025 21:03:50 +0000 (0:00:00.049) 0:00:02.924 ****** 2025-10-09 21:03:50.664593 | controller | ok: [instance] 2025-10-09 21:03:50.725171 | controller | 2025-10-09 21:03:50.725187 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2025-10-09 21:03:50.725194 | controller | Thursday 09 October 2025 21:03:50 +0000 (0:00:00.081) 0:00:03.005 ****** 2025-10-09 21:03:50.725203 | controller | skipping: [instance] 2025-10-09 21:03:50.725332 | controller | 2025-10-09 21:03:50.725465 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2025-10-09 21:03:50.725625 | controller | Thursday 09 October 2025 21:03:50 +0000 (0:00:00.061) 0:00:03.066 ****** 2025-10-09 21:03:50.751949 | controller | ok: [instance] 2025-10-09 21:03:50.752104 | controller | 2025-10-09 21:03:50.752266 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2025-10-09 21:03:50.752406 | controller | Thursday 09 October 2025 21:03:50 +0000 (0:00:00.026) 0:00:03.093 ****** 2025-10-09 21:03:50.776640 | controller | ok: [instance] => changed=false 2025-10-09 21:03:50.776798 | controller | msg: All assertions passed 2025-10-09 21:03:50.776930 | controller | 2025-10-09 21:03:50.777065 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2025-10-09 21:03:50.777198 | controller | Thursday 09 October 2025 21:03:50 +0000 (0:00:00.024) 0:00:03.118 ****** 2025-10-09 21:03:50.821082 | controller | ok: [instance] 2025-10-09 21:03:50.821229 | controller | 2025-10-09 21:03:50.821366 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2025-10-09 21:03:50.821501 | controller | Thursday 09 October 2025 21:03:50 +0000 (0:00:00.044) 0:00:03.162 ****** 2025-10-09 21:03:51.280686 | controller | ok: [instance] => (item=artifacts) 2025-10-09 21:03:51.281173 | controller | ok: [instance] => (item=logs) 2025-10-09 21:03:51.281198 | controller | 2025-10-09 21:03:51.356338 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2025-10-09 21:03:51.356359 | controller | Thursday 09 October 2025 21:03:51 +0000 (0:00:00.458) 0:00:03.621 ****** 2025-10-09 21:03:51.356370 | controller | 2025-10-09 21:03:51.547656 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2025-10-09 21:03:51.547691 | controller | Thursday 09 October 2025 21:03:51 +0000 (0:00:00.076) 0:00:03.697 ****** 2025-10-09 21:03:51.547703 | controller | ok: [instance] 2025-10-09 21:03:51.547756 | controller | 2025-10-09 21:03:51.547775 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2025-10-09 21:03:51.547785 | controller | Thursday 09 October 2025 21:03:51 +0000 (0:00:00.191) 0:00:03.889 ****** 2025-10-09 21:03:51.804319 | controller | changed: [instance] 2025-10-09 21:03:52.089693 | controller | 2025-10-09 21:03:52.089730 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2025-10-09 21:03:52.089739 | controller | Thursday 09 October 2025 21:03:51 +0000 (0:00:00.256) 0:00:04.145 ****** 2025-10-09 21:03:52.089750 | controller | ok: [instance] 2025-10-09 21:03:52.089776 | controller | 2025-10-09 21:03:52.090055 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2025-10-09 21:03:52.121137 | controller | Thursday 09 October 2025 21:03:52 +0000 (0:00:00.285) 0:00:04.431 ****** 2025-10-09 21:03:52.121162 | controller | skipping: [instance] 2025-10-09 21:03:52.139467 | controller | 2025-10-09 21:03:52.139489 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2025-10-09 21:03:52.139498 | controller | Thursday 09 October 2025 21:03:52 +0000 (0:00:00.031) 0:00:04.462 ****** 2025-10-09 21:03:52.139509 | controller | skipping: [instance] 2025-10-09 21:03:52.160685 | controller | 2025-10-09 21:03:52.160719 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2025-10-09 21:03:52.160733 | controller | Thursday 09 October 2025 21:03:52 +0000 (0:00:00.018) 0:00:04.480 ****** 2025-10-09 21:03:52.160743 | controller | ok: [instance] 2025-10-09 21:03:52.160822 | controller | 2025-10-09 21:03:52.160842 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2025-10-09 21:03:52.160853 | controller | Thursday 09 October 2025 21:03:52 +0000 (0:00:00.021) 0:00:04.501 ****** 2025-10-09 21:03:52.189663 | controller | skipping: [instance] 2025-10-09 21:03:52.189710 | controller | 2025-10-09 21:03:52.189722 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2025-10-09 21:03:52.189857 | controller | Thursday 09 October 2025 21:03:52 +0000 (0:00:00.029) 0:00:04.531 ****** 2025-10-09 21:04:03.834246 | controller | changed: [instance] 2025-10-09 21:04:03.834323 | controller | 2025-10-09 21:04:03.834330 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2025-10-09 21:04:03.834342 | controller | Thursday 09 October 2025 21:04:03 +0000 (0:00:11.644) 0:00:16.175 ****** 2025-10-09 21:04:04.059240 | controller | changed: [instance] 2025-10-09 21:04:04.585453 | controller | 2025-10-09 21:04:04.585501 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2025-10-09 21:04:04.585509 | controller | Thursday 09 October 2025 21:04:04 +0000 (0:00:00.224) 0:00:16.399 ****** 2025-10-09 21:04:04.585520 | controller | changed: [instance] 2025-10-09 21:04:05.190693 | controller | 2025-10-09 21:04:05.190737 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2025-10-09 21:04:05.190748 | controller | Thursday 09 October 2025 21:04:04 +0000 (0:00:00.526) 0:00:16.926 ****** 2025-10-09 21:04:05.190760 | controller | changed: [instance] 2025-10-09 21:04:05.190768 | controller | 2025-10-09 21:04:05.190775 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2025-10-09 21:04:05.190783 | controller | Thursday 09 October 2025 21:04:05 +0000 (0:00:00.605) 0:00:17.531 ****** 2025-10-09 21:04:05.399135 | controller | ok: [instance] 2025-10-09 21:04:06.096418 | controller | 2025-10-09 21:04:06.096447 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2025-10-09 21:04:06.096462 | controller | Thursday 09 October 2025 21:04:05 +0000 (0:00:00.208) 0:00:17.740 ****** 2025-10-09 21:04:06.096473 | controller | ok: [instance] 2025-10-09 21:04:07.076255 | controller | 2025-10-09 21:04:07.076291 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2025-10-09 21:04:07.076299 | controller | Thursday 09 October 2025 21:04:06 +0000 (0:00:00.697) 0:00:18.437 ****** 2025-10-09 21:04:07.076308 | controller | changed: [instance] 2025-10-09 21:04:07.161538 | controller | 2025-10-09 21:04:07.161564 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2025-10-09 21:04:07.161591 | controller | Thursday 09 October 2025 21:04:07 +0000 (0:00:00.979) 0:00:19.417 ****** 2025-10-09 21:04:07.161608 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2025-10-09 21:04:07.161653 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2025-10-09 21:04:07.161662 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2025-10-09 21:04:07.161669 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2025-10-09 21:04:07.161675 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2025-10-09 21:04:07.161685 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2025-10-09 21:04:07.162184 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2025-10-09 21:04:07.523091 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2025-10-09 21:04:07.523124 | controller | 2025-10-09 21:04:07.523132 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2025-10-09 21:04:07.523138 | controller | Thursday 09 October 2025 21:04:07 +0000 (0:00:00.085) 0:00:19.502 ****** 2025-10-09 21:04:07.523148 | controller | ok: [instance] 2025-10-09 21:04:07.880348 | controller | 2025-10-09 21:04:07.880386 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2025-10-09 21:04:07.880396 | controller | Thursday 09 October 2025 21:04:07 +0000 (0:00:00.361) 0:00:19.864 ****** 2025-10-09 21:04:07.880414 | controller | ok: [instance] 2025-10-09 21:04:08.233727 | controller | 2025-10-09 21:04:08.233770 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2025-10-09 21:04:08.233779 | controller | Thursday 09 October 2025 21:04:07 +0000 (0:00:00.357) 0:00:20.221 ****** 2025-10-09 21:04:08.233792 | controller | ok: [instance] 2025-10-09 21:04:08.233823 | controller | 2025-10-09 21:04:08.233833 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2025-10-09 21:04:08.233939 | controller | Thursday 09 October 2025 21:04:08 +0000 (0:00:00.353) 0:00:20.574 ****** 2025-10-09 21:04:08.573763 | controller | ok: [instance] 2025-10-09 21:04:08.907715 | controller | 2025-10-09 21:04:08.907759 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2025-10-09 21:04:08.907769 | controller | Thursday 09 October 2025 21:04:08 +0000 (0:00:00.339) 0:00:20.914 ****** 2025-10-09 21:04:08.907782 | controller | ok: [instance] 2025-10-09 21:04:09.252995 | controller | 2025-10-09 21:04:09.253034 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2025-10-09 21:04:09.253043 | controller | Thursday 09 October 2025 21:04:08 +0000 (0:00:00.334) 0:00:21.248 ****** 2025-10-09 21:04:09.253063 | controller | ok: [instance] 2025-10-09 21:04:09.601653 | controller | 2025-10-09 21:04:09.601686 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2025-10-09 21:04:09.601694 | controller | Thursday 09 October 2025 21:04:09 +0000 (0:00:00.345) 0:00:21.594 ****** 2025-10-09 21:04:09.601710 | controller | ok: [instance] 2025-10-09 21:04:09.601735 | controller | 2025-10-09 21:04:09.601899 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2025-10-09 21:04:09.940644 | controller | Thursday 09 October 2025 21:04:09 +0000 (0:00:00.349) 0:00:21.943 ****** 2025-10-09 21:04:09.940669 | controller | ok: [instance] 2025-10-09 21:04:09.940848 | controller | 2025-10-09 21:04:09.940861 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2025-10-09 21:04:10.271349 | controller | Thursday 09 October 2025 21:04:09 +0000 (0:00:00.338) 0:00:22.281 ****** 2025-10-09 21:04:10.271385 | controller | ok: [instance] 2025-10-09 21:04:11.609710 | controller | 2025-10-09 21:04:11.609746 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2025-10-09 21:04:11.609754 | controller | Thursday 09 October 2025 21:04:10 +0000 (0:00:00.330) 0:00:22.612 ****** 2025-10-09 21:04:11.609771 | controller | ok: [instance] 2025-10-09 21:04:12.009114 | controller | 2025-10-09 21:04:12.009142 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2025-10-09 21:04:12.009150 | controller | Thursday 09 October 2025 21:04:11 +0000 (0:00:01.338) 0:00:23.950 ****** 2025-10-09 21:04:12.009160 | controller | ok: [instance] 2025-10-09 21:04:12.358165 | controller | 2025-10-09 21:04:12.358188 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2025-10-09 21:04:12.358196 | controller | Thursday 09 October 2025 21:04:12 +0000 (0:00:00.399) 0:00:24.350 ****** 2025-10-09 21:04:12.358206 | controller | ok: [instance] 2025-10-09 21:04:12.700316 | controller | 2025-10-09 21:04:12.700339 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2025-10-09 21:04:12.700346 | controller | Thursday 09 October 2025 21:04:12 +0000 (0:00:00.349) 0:00:24.699 ****** 2025-10-09 21:04:12.700356 | controller | ok: [instance] 2025-10-09 21:04:13.044951 | controller | 2025-10-09 21:04:13.044972 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2025-10-09 21:04:13.044980 | controller | Thursday 09 October 2025 21:04:12 +0000 (0:00:00.342) 0:00:25.041 ****** 2025-10-09 21:04:13.044989 | controller | ok: [instance] 2025-10-09 21:04:13.415333 | controller | 2025-10-09 21:04:13.415353 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2025-10-09 21:04:13.415360 | controller | Thursday 09 October 2025 21:04:13 +0000 (0:00:00.344) 0:00:25.386 ****** 2025-10-09 21:04:13.415369 | controller | ok: [instance] 2025-10-09 21:04:13.752744 | controller | 2025-10-09 21:04:13.752786 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2025-10-09 21:04:13.752796 | controller | Thursday 09 October 2025 21:04:13 +0000 (0:00:00.366) 0:00:25.752 ****** 2025-10-09 21:04:13.752807 | controller | ok: [instance] 2025-10-09 21:04:13.752835 | controller | 2025-10-09 21:04:13.752845 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2025-10-09 21:04:13.752918 | controller | Thursday 09 October 2025 21:04:13 +0000 (0:00:00.340) 0:00:26.093 ****** 2025-10-09 21:04:15.097513 | controller | ok: [instance] 2025-10-09 21:04:15.434857 | controller | 2025-10-09 21:04:15.434897 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2025-10-09 21:04:15.434907 | controller | Thursday 09 October 2025 21:04:15 +0000 (0:00:01.344) 0:00:27.438 ****** 2025-10-09 21:04:15.434919 | controller | ok: [instance] 2025-10-09 21:04:15.434947 | controller | 2025-10-09 21:04:15.434957 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2025-10-09 21:04:15.435034 | controller | Thursday 09 October 2025 21:04:15 +0000 (0:00:00.337) 0:00:27.776 ****** 2025-10-09 21:04:15.769428 | controller | ok: [instance] 2025-10-09 21:04:16.105466 | controller | 2025-10-09 21:04:16.105487 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2025-10-09 21:04:16.105495 | controller | Thursday 09 October 2025 21:04:15 +0000 (0:00:00.334) 0:00:28.110 ****** 2025-10-09 21:04:16.105504 | controller | ok: [instance] 2025-10-09 21:04:16.438131 | controller | 2025-10-09 21:04:16.438165 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2025-10-09 21:04:16.438173 | controller | Thursday 09 October 2025 21:04:16 +0000 (0:00:00.336) 0:00:28.446 ****** 2025-10-09 21:04:16.438189 | controller | ok: [instance] 2025-10-09 21:04:16.771604 | controller | 2025-10-09 21:04:16.771649 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2025-10-09 21:04:16.771665 | controller | Thursday 09 October 2025 21:04:16 +0000 (0:00:00.332) 0:00:28.778 ****** 2025-10-09 21:04:16.771675 | controller | ok: [instance] 2025-10-09 21:04:17.108724 | controller | 2025-10-09 21:04:17.108763 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2025-10-09 21:04:17.108773 | controller | Thursday 09 October 2025 21:04:16 +0000 (0:00:00.333) 0:00:29.112 ****** 2025-10-09 21:04:17.108785 | controller | ok: [instance] 2025-10-09 21:04:17.446687 | controller | 2025-10-09 21:04:17.446722 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2025-10-09 21:04:17.446731 | controller | Thursday 09 October 2025 21:04:17 +0000 (0:00:00.337) 0:00:29.449 ****** 2025-10-09 21:04:17.446742 | controller | ok: [instance] 2025-10-09 21:04:17.474742 | controller | 2025-10-09 21:04:17.474782 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2025-10-09 21:04:17.474793 | controller | Thursday 09 October 2025 21:04:17 +0000 (0:00:00.337) 0:00:29.787 ****** 2025-10-09 21:04:17.474806 | controller | skipping: [instance] 2025-10-09 21:04:17.474995 | controller | 2025-10-09 21:04:17.475030 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2025-10-09 21:04:17.781097 | controller | Thursday 09 October 2025 21:04:17 +0000 (0:00:00.028) 0:00:29.815 ****** 2025-10-09 21:04:17.781140 | controller | ok: [instance] 2025-10-09 21:04:18.167629 | controller | 2025-10-09 21:04:18.167674 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2025-10-09 21:04:18.167683 | controller | Thursday 09 October 2025 21:04:17 +0000 (0:00:00.306) 0:00:30.122 ****** 2025-10-09 21:04:18.167693 | controller | ok: [instance] 2025-10-09 21:04:18.483341 | controller | 2025-10-09 21:04:18.483379 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2025-10-09 21:04:18.483389 | controller | Thursday 09 October 2025 21:04:18 +0000 (0:00:00.386) 0:00:30.508 ****** 2025-10-09 21:04:18.483401 | controller | changed: [instance] 2025-10-09 21:04:18.780282 | controller | 2025-10-09 21:04:18.780311 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2025-10-09 21:04:18.780320 | controller | Thursday 09 October 2025 21:04:18 +0000 (0:00:00.315) 0:00:30.824 ****** 2025-10-09 21:04:18.780331 | controller | [WARNING]: Reset is not implemented for this connection 2025-10-09 21:04:18.790785 | controller | changed: [instance] 2025-10-09 21:04:18.790852 | controller | 2025-10-09 21:04:18.790863 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2025-10-09 21:04:18.790873 | controller | Thursday 09 October 2025 21:04:18 +0000 (0:00:00.291) 0:00:31.115 ****** 2025-10-09 21:04:18.790881 | controller | 2025-10-09 21:04:18.790888 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2025-10-09 21:04:18.790900 | controller | Thursday 09 October 2025 21:04:18 +0000 (0:00:00.016) 0:00:31.131 ****** 2025-10-09 21:04:18.865743 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2025-10-09 21:04:18.865999 | controller | 2025-10-09 21:04:18.866041 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2025-10-09 21:04:18.908621 | controller | Thursday 09 October 2025 21:04:18 +0000 (0:00:00.075) 0:00:31.207 ****** 2025-10-09 21:04:18.908668 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2025-10-09 21:04:18.957192 | controller | 2025-10-09 21:04:18.957214 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-10-09 21:04:18.957224 | controller | Thursday 09 October 2025 21:04:18 +0000 (0:00:00.042) 0:00:31.249 ****** 2025-10-09 21:04:18.957235 | controller | ok: [instance] => (item=compute) 2025-10-09 21:04:18.997482 | controller | ok: [instance] => (item=controller) 2025-10-09 21:04:18.997509 | controller | ok: [instance] => (item=crc) 2025-10-09 21:04:18.997518 | controller | 2025-10-09 21:04:18.997525 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-10-09 21:04:18.997538 | controller | Thursday 09 October 2025 21:04:18 +0000 (0:00:00.048) 0:00:31.297 ****** 2025-10-09 21:04:18.997548 | controller | ok: [instance] 2025-10-09 21:04:18.997671 | controller | 2025-10-09 21:04:18.997802 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-10-09 21:04:18.997931 | controller | Thursday 09 October 2025 21:04:18 +0000 (0:00:00.041) 0:00:31.339 ****** 2025-10-09 21:04:19.045165 | controller | ok: [instance] => changed=false 2025-10-09 21:04:19.045311 | controller | msg: All assertions passed 2025-10-09 21:04:19.045436 | controller | 2025-10-09 21:04:19.045588 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2025-10-09 21:04:19.045749 | controller | Thursday 09 October 2025 21:04:19 +0000 (0:00:00.047) 0:00:31.386 ****** 2025-10-09 21:04:19.087706 | controller | 2025-10-09 21:04:19.087976 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2025-10-09 21:04:19.088069 | controller | Thursday 09 October 2025 21:04:19 +0000 (0:00:00.042) 0:00:31.429 ****** 2025-10-09 21:04:19.162388 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2025-10-09 21:04:19.162565 | controller | ok: [instance] => (item={}) 2025-10-09 21:04:19.162715 | controller | 2025-10-09 21:04:19.162907 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2025-10-09 21:04:19.163001 | controller | Thursday 09 October 2025 21:04:19 +0000 (0:00:00.074) 0:00:31.503 ****** 2025-10-09 21:04:19.180900 | controller | skipping: [instance] 2025-10-09 21:04:19.181068 | controller | 2025-10-09 21:04:19.181166 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2025-10-09 21:04:19.181323 | controller | Thursday 09 October 2025 21:04:19 +0000 (0:00:00.018) 0:00:31.522 ****** 2025-10-09 21:04:19.417764 | controller | ok: [instance] 2025-10-09 21:04:19.417820 | controller | 2025-10-09 21:04:19.417986 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2025-10-09 21:04:19.418078 | controller | Thursday 09 October 2025 21:04:19 +0000 (0:00:00.236) 0:00:31.758 ****** 2025-10-09 21:04:19.794624 | controller | changed: [instance] 2025-10-09 21:04:20.597557 | controller | 2025-10-09 21:04:20.597614 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2025-10-09 21:04:20.597622 | controller | Thursday 09 October 2025 21:04:19 +0000 (0:00:00.376) 0:00:32.135 ****** 2025-10-09 21:04:20.597633 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2025-10-09 21:04:20.631752 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2025-10-09 21:04:20.631788 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2025-10-09 21:04:20.631801 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2025-10-09 21:04:20.631813 | controller | 2025-10-09 21:04:20.631824 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2025-10-09 21:04:20.631833 | controller | Thursday 09 October 2025 21:04:20 +0000 (0:00:00.802) 0:00:32.938 ****** 2025-10-09 21:04:20.631846 | controller | skipping: [instance] 2025-10-09 21:04:21.024512 | controller | 2025-10-09 21:04:21.024549 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2025-10-09 21:04:21.024562 | controller | Thursday 09 October 2025 21:04:20 +0000 (0:00:00.034) 0:00:32.972 ****** 2025-10-09 21:04:21.024572 | controller | changed: [instance] 2025-10-09 21:04:21.024609 | controller | 2025-10-09 21:04:21.025126 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2025-10-09 21:04:21.465939 | controller | Thursday 09 October 2025 21:04:21 +0000 (0:00:00.384) 0:00:33.357 ****** 2025-10-09 21:04:21.465983 | controller | 2025-10-09 21:04:21.465991 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-10-09 21:04:21.465997 | controller | Thursday 09 October 2025 21:04:21 +0000 (0:00:00.008) 0:00:33.365 ****** 2025-10-09 21:04:21.466007 | controller | changed: [instance] 2025-10-09 21:04:21.543943 | controller | 2025-10-09 21:04:21.543995 | controller | TASK [Ensure no default networks exists] *************************************** 2025-10-09 21:04:21.544007 | controller | Thursday 09 October 2025 21:04:21 +0000 (0:00:00.441) 0:00:33.806 ****** 2025-10-09 21:04:21.544023 | controller | 2025-10-09 21:04:22.792095 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2025-10-09 21:04:22.792144 | controller | Thursday 09 October 2025 21:04:21 +0000 (0:00:00.078) 0:00:33.885 ****** 2025-10-09 21:04:22.792160 | controller | ok: [instance] 2025-10-09 21:04:23.057982 | controller | 2025-10-09 21:04:23.058038 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2025-10-09 21:04:23.058049 | controller | Thursday 09 October 2025 21:04:22 +0000 (0:00:01.247) 0:00:35.132 ****** 2025-10-09 21:04:23.058063 | controller | ok: [instance] 2025-10-09 21:04:23.592499 | controller | 2025-10-09 21:04:23.592536 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2025-10-09 21:04:23.592545 | controller | Thursday 09 October 2025 21:04:23 +0000 (0:00:00.266) 0:00:35.398 ****** 2025-10-09 21:04:23.592555 | controller | ok: [instance] 2025-10-09 21:04:23.848692 | controller | 2025-10-09 21:04:23.848733 | controller | TASK [libvirt_manager : Removing default] ************************************** 2025-10-09 21:04:23.848743 | controller | Thursday 09 October 2025 21:04:23 +0000 (0:00:00.534) 0:00:35.933 ****** 2025-10-09 21:04:23.848756 | controller | ok: [instance] 2025-10-09 21:04:25.070322 | controller | 2025-10-09 21:04:25.070357 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2025-10-09 21:04:25.070364 | controller | Thursday 09 October 2025 21:04:23 +0000 (0:00:00.256) 0:00:36.189 ****** 2025-10-09 21:04:25.070374 | controller | ok: [instance] 2025-10-09 21:04:25.405474 | controller | 2025-10-09 21:04:25.405509 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2025-10-09 21:04:25.405525 | controller | Thursday 09 October 2025 21:04:25 +0000 (0:00:01.221) 0:00:37.411 ****** 2025-10-09 21:04:25.405535 | controller | ok: [instance] 2025-10-09 21:04:25.752672 | controller | 2025-10-09 21:04:25.752717 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2025-10-09 21:04:25.752726 | controller | Thursday 09 October 2025 21:04:25 +0000 (0:00:00.335) 0:00:37.746 ****** 2025-10-09 21:04:25.752737 | controller | changed: [instance] 2025-10-09 21:04:26.098378 | controller | 2025-10-09 21:04:26.098414 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2025-10-09 21:04:26.098422 | controller | Thursday 09 October 2025 21:04:25 +0000 (0:00:00.347) 0:00:38.093 ****** 2025-10-09 21:04:26.098432 | controller | changed: [instance] 2025-10-09 21:04:28.727511 | controller | 2025-10-09 21:04:28.727549 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2025-10-09 21:04:28.727557 | controller | Thursday 09 October 2025 21:04:26 +0000 (0:00:00.345) 0:00:38.439 ****** 2025-10-09 21:04:28.727568 | controller | changed: [instance] => (item=arptables) 2025-10-09 21:04:29.063192 | controller | changed: [instance] => (item=iptables) 2025-10-09 21:04:29.063219 | controller | changed: [instance] => (item=ip6tables) 2025-10-09 21:04:29.063226 | controller | 2025-10-09 21:04:29.063232 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2025-10-09 21:04:29.063238 | controller | Thursday 09 October 2025 21:04:28 +0000 (0:00:02.628) 0:00:41.068 ****** 2025-10-09 21:04:29.063248 | controller | ok: [instance] 2025-10-09 21:04:29.157849 | controller | 2025-10-09 21:04:29.157918 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2025-10-09 21:04:29.157933 | controller | Thursday 09 October 2025 21:04:29 +0000 (0:00:00.336) 0:00:41.404 ****** 2025-10-09 21:04:29.157953 | controller | ok: [instance] 2025-10-09 21:04:29.204820 | controller | 2025-10-09 21:04:29.204886 | controller | TASK [Ensure the required network configurations are applied] ****************** 2025-10-09 21:04:29.204908 | controller | Thursday 09 October 2025 21:04:29 +0000 (0:00:00.094) 0:00:41.498 ****** 2025-10-09 21:04:29.204924 | controller | 2025-10-09 21:04:29.230182 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2025-10-09 21:04:29.230212 | controller | Thursday 09 October 2025 21:04:29 +0000 (0:00:00.047) 0:00:41.545 ****** 2025-10-09 21:04:29.230224 | controller | skipping: [instance] 2025-10-09 21:04:29.254747 | controller | 2025-10-09 21:04:29.254782 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2025-10-09 21:04:29.254792 | controller | Thursday 09 October 2025 21:04:29 +0000 (0:00:00.025) 0:00:41.571 ****** 2025-10-09 21:04:29.254805 | controller | skipping: [instance] 2025-10-09 21:04:29.254998 | controller | 2025-10-09 21:04:29.255030 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-10-09 21:04:29.278694 | controller | Thursday 09 October 2025 21:04:29 +0000 (0:00:00.024) 0:00:41.596 ****** 2025-10-09 21:04:29.278748 | controller | skipping: [instance] 2025-10-09 21:04:29.308836 | controller | 2025-10-09 21:04:29.308858 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2025-10-09 21:04:29.308865 | controller | Thursday 09 October 2025 21:04:29 +0000 (0:00:00.023) 0:00:41.620 ****** 2025-10-09 21:04:29.308875 | controller | skipping: [instance] 2025-10-09 21:04:29.309070 | controller | 2025-10-09 21:04:29.309291 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2025-10-09 21:04:29.309413 | controller | Thursday 09 October 2025 21:04:29 +0000 (0:00:00.030) 0:00:41.650 ****** 2025-10-09 21:04:29.348352 | controller | ok: [instance] 2025-10-09 21:04:29.348484 | controller | 2025-10-09 21:04:29.348635 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2025-10-09 21:04:29.348777 | controller | Thursday 09 October 2025 21:04:29 +0000 (0:00:00.039) 0:00:41.689 ****** 2025-10-09 21:04:29.384185 | controller | skipping: [instance] 2025-10-09 21:04:29.384414 | controller | 2025-10-09 21:04:29.384542 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2025-10-09 21:04:29.384695 | controller | Thursday 09 October 2025 21:04:29 +0000 (0:00:00.035) 0:00:41.725 ****** 2025-10-09 21:04:29.410270 | controller | skipping: [instance] 2025-10-09 21:04:29.410472 | controller | 2025-10-09 21:04:29.410598 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2025-10-09 21:04:29.410767 | controller | Thursday 09 October 2025 21:04:29 +0000 (0:00:00.026) 0:00:41.751 ****** 2025-10-09 21:04:29.475270 | controller | ok: [instance] 2025-10-09 21:04:29.475408 | controller | 2025-10-09 21:04:29.475563 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2025-10-09 21:04:29.475732 | controller | Thursday 09 October 2025 21:04:29 +0000 (0:00:00.065) 0:00:41.816 ****** 2025-10-09 21:04:29.504202 | controller | skipping: [instance] 2025-10-09 21:04:29.504312 | controller | 2025-10-09 21:04:29.504424 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2025-10-09 21:04:29.504532 | controller | Thursday 09 October 2025 21:04:29 +0000 (0:00:00.028) 0:00:41.845 ****** 2025-10-09 21:04:29.557095 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2025-10-09 21:04:29.557331 | controller | 2025-10-09 21:04:29.557520 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-10-09 21:04:29.557819 | controller | Thursday 09 October 2025 21:04:29 +0000 (0:00:00.052) 0:00:41.898 ****** 2025-10-09 21:04:29.905712 | controller | ok: [instance -> localhost] 2025-10-09 21:04:35.052205 | controller | 2025-10-09 21:04:35.052243 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2025-10-09 21:04:35.052252 | controller | Thursday 09 October 2025 21:04:29 +0000 (0:00:00.348) 0:00:42.246 ****** 2025-10-09 21:04:35.052262 | controller | changed: [instance -> localhost] 2025-10-09 21:04:35.286381 | controller | 2025-10-09 21:04:35.286410 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-10-09 21:04:35.286419 | controller | Thursday 09 October 2025 21:04:35 +0000 (0:00:05.146) 0:00:47.393 ****** 2025-10-09 21:04:35.286436 | controller | changed: [instance] 2025-10-09 21:04:35.645533 | controller | 2025-10-09 21:04:35.645572 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2025-10-09 21:04:35.645601 | controller | Thursday 09 October 2025 21:04:35 +0000 (0:00:00.234) 0:00:47.627 ****** 2025-10-09 21:04:35.645613 | controller | changed: [instance] 2025-10-09 21:04:37.272513 | controller | 2025-10-09 21:04:37.272540 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2025-10-09 21:04:37.272548 | controller | Thursday 09 October 2025 21:04:35 +0000 (0:00:00.358) 0:00:47.986 ****** 2025-10-09 21:04:37.272558 | controller | changed: [instance -> localhost] 2025-10-09 21:04:37.686088 | controller | 2025-10-09 21:04:37.686127 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2025-10-09 21:04:37.686136 | controller | Thursday 09 October 2025 21:04:37 +0000 (0:00:01.627) 0:00:49.613 ****** 2025-10-09 21:04:37.686147 | controller | changed: [instance] 2025-10-09 21:04:37.722606 | controller | 2025-10-09 21:04:37.722635 | controller | TASK [reproducer : Select right domain] **************************************** 2025-10-09 21:04:37.722643 | controller | Thursday 09 October 2025 21:04:37 +0000 (0:00:00.412) 0:00:50.026 ****** 2025-10-09 21:04:37.722653 | controller | ok: [instance] 2025-10-09 21:04:37.841595 | controller | 2025-10-09 21:04:37.841613 | controller | TASK [Create the virtual networks] ********************************************* 2025-10-09 21:04:37.841620 | controller | Thursday 09 October 2025 21:04:37 +0000 (0:00:00.037) 0:00:50.063 ****** 2025-10-09 21:04:37.841628 | controller | 2025-10-09 21:04:37.862227 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2025-10-09 21:04:37.862249 | controller | Thursday 09 October 2025 21:04:37 +0000 (0:00:00.118) 0:00:50.182 ****** 2025-10-09 21:04:37.862261 | controller | ok: [instance] 2025-10-09 21:04:38.060199 | controller | 2025-10-09 21:04:38.060221 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2025-10-09 21:04:38.060230 | controller | Thursday 09 October 2025 21:04:37 +0000 (0:00:00.020) 0:00:50.203 ****** 2025-10-09 21:04:38.060241 | controller | ok: [instance] 2025-10-09 21:04:38.092861 | controller | 2025-10-09 21:04:38.092940 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2025-10-09 21:04:38.092956 | controller | Thursday 09 October 2025 21:04:38 +0000 (0:00:00.197) 0:00:50.401 ****** 2025-10-09 21:04:38.092979 | controller | skipping: [instance] 2025-10-09 21:04:38.125487 | controller | 2025-10-09 21:04:38.125522 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2025-10-09 21:04:38.125533 | controller | Thursday 09 October 2025 21:04:38 +0000 (0:00:00.032) 0:00:50.433 ****** 2025-10-09 21:04:38.125546 | controller | skipping: [instance] 2025-10-09 21:04:38.187475 | controller | 2025-10-09 21:04:38.187495 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2025-10-09 21:04:38.187502 | controller | Thursday 09 October 2025 21:04:38 +0000 (0:00:00.032) 0:00:50.466 ****** 2025-10-09 21:04:38.187511 | controller | ok: [instance] 2025-10-09 21:04:38.313793 | controller | 2025-10-09 21:04:38.313842 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2025-10-09 21:04:38.313851 | controller | Thursday 09 October 2025 21:04:38 +0000 (0:00:00.061) 0:00:50.528 ****** 2025-10-09 21:04:38.313877 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2025-10-09 21:04:38.351249 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2025-10-09 21:04:38.351293 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2025-10-09 21:04:38.351301 | controller | 2025-10-09 21:04:38.351308 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2025-10-09 21:04:38.351313 | controller | Thursday 09 October 2025 21:04:38 +0000 (0:00:00.126) 0:00:50.654 ****** 2025-10-09 21:04:38.351325 | controller | skipping: [instance] 2025-10-09 21:04:38.715978 | controller | 2025-10-09 21:04:38.716018 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2025-10-09 21:04:38.716026 | controller | Thursday 09 October 2025 21:04:38 +0000 (0:00:00.036) 0:00:50.691 ****** 2025-10-09 21:04:38.716045 | controller | changed: [instance] 2025-10-09 21:04:38.835737 | controller | 2025-10-09 21:04:38.835781 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2025-10-09 21:04:38.835789 | controller | Thursday 09 October 2025 21:04:38 +0000 (0:00:00.365) 0:00:51.056 ****** 2025-10-09 21:04:38.835801 | controller | changed: [instance] => (item=Adding compute-0 to computes) 2025-10-09 21:04:38.859336 | controller | changed: [instance] => (item=Adding controller-0 to controllers) 2025-10-09 21:04:38.859369 | controller | changed: [instance] => (item=Adding crc-0 to ocps) 2025-10-09 21:04:38.859377 | controller | 2025-10-09 21:04:38.859382 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-10-09 21:04:38.859388 | controller | Thursday 09 October 2025 21:04:38 +0000 (0:00:00.119) 0:00:51.176 ****** 2025-10-09 21:04:38.859399 | controller | skipping: [instance] 2025-10-09 21:04:38.884106 | controller | 2025-10-09 21:04:38.884133 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-10-09 21:04:38.884141 | controller | Thursday 09 October 2025 21:04:38 +0000 (0:00:00.023) 0:00:51.200 ****** 2025-10-09 21:04:38.884150 | controller | skipping: [instance] 2025-10-09 21:04:38.909239 | controller | 2025-10-09 21:04:38.909261 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-10-09 21:04:38.909269 | controller | Thursday 09 October 2025 21:04:38 +0000 (0:00:00.024) 0:00:51.225 ****** 2025-10-09 21:04:38.909278 | controller | skipping: [instance] 2025-10-09 21:04:38.934986 | controller | 2025-10-09 21:04:38.935005 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-10-09 21:04:38.935013 | controller | Thursday 09 October 2025 21:04:38 +0000 (0:00:00.025) 0:00:51.250 ****** 2025-10-09 21:04:38.935021 | controller | skipping: [instance] 2025-10-09 21:04:38.954742 | controller | 2025-10-09 21:04:38.954784 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-10-09 21:04:38.954794 | controller | Thursday 09 October 2025 21:04:38 +0000 (0:00:00.025) 0:00:51.276 ****** 2025-10-09 21:04:38.954807 | controller | ok: [instance] 2025-10-09 21:04:38.954838 | controller | 2025-10-09 21:04:38.954848 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-10-09 21:04:38.954950 | controller | Thursday 09 October 2025 21:04:38 +0000 (0:00:00.019) 0:00:51.296 ****** 2025-10-09 21:04:39.041882 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-10-09 21:04:39.042393 | controller | 2025-10-09 21:04:39.042595 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-10-09 21:04:39.042763 | controller | Thursday 09 October 2025 21:04:39 +0000 (0:00:00.077) 0:00:51.374 ****** 2025-10-09 21:04:39.061813 | controller | skipping: [instance] 2025-10-09 21:04:39.061960 | controller | 2025-10-09 21:04:39.062107 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-10-09 21:04:39.062247 | controller | Thursday 09 October 2025 21:04:39 +0000 (0:00:00.028) 0:00:51.403 ****** 2025-10-09 21:04:39.271623 | controller | changed: [instance] 2025-10-09 21:04:39.271749 | controller | 2025-10-09 21:04:39.271919 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-10-09 21:04:39.272010 | controller | Thursday 09 October 2025 21:04:39 +0000 (0:00:00.209) 0:00:51.613 ****** 2025-10-09 21:04:39.691737 | controller | changed: [instance] 2025-10-09 21:04:39.691886 | controller | 2025-10-09 21:04:39.691922 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-10-09 21:04:39.691937 | controller | Thursday 09 October 2025 21:04:39 +0000 (0:00:00.419) 0:00:52.032 ****** 2025-10-09 21:04:39.757256 | controller | ok: [instance] 2025-10-09 21:04:39.793538 | controller | 2025-10-09 21:04:39.793556 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-10-09 21:04:39.793564 | controller | Thursday 09 October 2025 21:04:39 +0000 (0:00:00.066) 0:00:52.098 ****** 2025-10-09 21:04:39.793593 | controller | ok: [instance] 2025-10-09 21:04:40.188422 | controller | 2025-10-09 21:04:40.188462 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-10-09 21:04:40.188471 | controller | Thursday 09 October 2025 21:04:39 +0000 (0:00:00.036) 0:00:52.134 ****** 2025-10-09 21:04:40.188483 | controller | changed: [instance] 2025-10-09 21:04:40.271322 | controller | 2025-10-09 21:04:40.271350 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2025-10-09 21:04:40.271365 | controller | Thursday 09 October 2025 21:04:40 +0000 (0:00:00.394) 0:00:52.529 ****** 2025-10-09 21:04:40.271377 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2025-10-09 21:04:40.349145 | controller | 2025-10-09 21:04:40.349170 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2025-10-09 21:04:40.349177 | controller | Thursday 09 October 2025 21:04:40 +0000 (0:00:00.083) 0:00:52.612 ****** 2025-10-09 21:04:40.349186 | controller | ok: [instance] => (item=public) 2025-10-09 21:04:40.825163 | controller | ok: [instance] => (item=osp_trunk) 2025-10-09 21:04:40.825195 | controller | 2025-10-09 21:04:40.825203 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2025-10-09 21:04:40.825209 | controller | Thursday 09 October 2025 21:04:40 +0000 (0:00:00.077) 0:00:52.690 ****** 2025-10-09 21:04:40.825219 | controller | changed: [instance] => (item=cifmw-public) 2025-10-09 21:04:41.478353 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-10-09 21:04:41.478384 | controller | 2025-10-09 21:04:41.478391 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2025-10-09 21:04:41.478396 | controller | Thursday 09 October 2025 21:04:40 +0000 (0:00:00.475) 0:00:53.165 ****** 2025-10-09 21:04:41.478405 | controller | ok: [instance] => (item=cifmw-public) 2025-10-09 21:04:41.943735 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-10-09 21:04:41.943771 | controller | 2025-10-09 21:04:41.943780 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2025-10-09 21:04:41.943788 | controller | Thursday 09 October 2025 21:04:41 +0000 (0:00:00.653) 0:00:53.819 ****** 2025-10-09 21:04:41.943807 | controller | ok: [instance] => (item=cifmw-public) 2025-10-09 21:04:41.943836 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-10-09 21:04:41.943844 | controller | 2025-10-09 21:04:41.943853 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2025-10-09 21:04:41.943941 | controller | Thursday 09 October 2025 21:04:41 +0000 (0:00:00.465) 0:00:54.284 ****** 2025-10-09 21:04:42.411547 | controller | changed: [instance] => (item=cifmw-public) 2025-10-09 21:04:42.481497 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-10-09 21:04:42.481515 | controller | 2025-10-09 21:04:42.481523 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2025-10-09 21:04:42.481528 | controller | Thursday 09 October 2025 21:04:42 +0000 (0:00:00.467) 0:00:54.751 ****** 2025-10-09 21:04:42.481537 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2025-10-09 21:04:42.691176 | controller | 2025-10-09 21:04:42.691192 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2025-10-09 21:04:42.691199 | controller | Thursday 09 October 2025 21:04:42 +0000 (0:00:00.070) 0:00:54.822 ****** 2025-10-09 21:04:42.691207 | controller | ok: [instance] 2025-10-09 21:04:43.097248 | controller | 2025-10-09 21:04:43.097280 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2025-10-09 21:04:43.097288 | controller | Thursday 09 October 2025 21:04:42 +0000 (0:00:00.210) 0:00:55.032 ****** 2025-10-09 21:04:43.097297 | controller | ok: [instance] => (item=cifmw-public) 2025-10-09 21:04:43.168732 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-10-09 21:04:43.168761 | controller | 2025-10-09 21:04:43.168769 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2025-10-09 21:04:43.168776 | controller | Thursday 09 October 2025 21:04:43 +0000 (0:00:00.405) 0:00:55.438 ****** 2025-10-09 21:04:43.168787 | controller | 2025-10-09 21:04:43.209766 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-10-09 21:04:43.209804 | controller | Thursday 09 October 2025 21:04:43 +0000 (0:00:00.071) 0:00:55.510 ****** 2025-10-09 21:04:43.209818 | controller | skipping: [instance] 2025-10-09 21:04:43.209849 | controller | 2025-10-09 21:04:43.209858 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2025-10-09 21:04:43.210001 | controller | Thursday 09 October 2025 21:04:43 +0000 (0:00:00.041) 0:00:55.551 ****** 2025-10-09 21:04:44.489605 | controller | ok: [instance] 2025-10-09 21:04:44.701172 | controller | 2025-10-09 21:04:44.701193 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-10-09 21:04:44.701201 | controller | Thursday 09 October 2025 21:04:44 +0000 (0:00:01.279) 0:00:56.830 ****** 2025-10-09 21:04:44.701210 | controller | ok: [instance] 2025-10-09 21:04:45.077723 | controller | 2025-10-09 21:04:45.077764 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2025-10-09 21:04:45.077774 | controller | Thursday 09 October 2025 21:04:44 +0000 (0:00:00.211) 0:00:57.042 ****** 2025-10-09 21:04:45.077787 | controller | changed: [instance] 2025-10-09 21:04:45.077818 | controller | 2025-10-09 21:04:45.077826 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2025-10-09 21:04:45.077836 | controller | Thursday 09 October 2025 21:04:45 +0000 (0:00:00.376) 0:00:57.418 ****** 2025-10-09 21:04:46.816141 | controller | changed: [instance] 2025-10-09 21:04:47.173766 | controller | 2025-10-09 21:04:47.173818 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2025-10-09 21:04:47.173831 | controller | Thursday 09 October 2025 21:04:46 +0000 (0:00:01.737) 0:00:59.156 ****** 2025-10-09 21:04:47.173860 | controller | changed: [instance] 2025-10-09 21:04:47.173901 | controller | 2025-10-09 21:04:47.173925 | controller | TASK [Create extra network configuration] ************************************** 2025-10-09 21:04:47.173952 | controller | Thursday 09 October 2025 21:04:47 +0000 (0:00:00.357) 0:00:59.514 ****** 2025-10-09 21:04:47.213789 | controller | skipping: [instance] 2025-10-09 21:04:47.247812 | controller | 2025-10-09 21:04:47.247860 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2025-10-09 21:04:47.247884 | controller | Thursday 09 October 2025 21:04:47 +0000 (0:00:00.040) 0:00:59.554 ****** 2025-10-09 21:04:47.247901 | controller | skipping: [instance] 2025-10-09 21:04:47.247964 | controller | 2025-10-09 21:04:47.247989 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2025-10-09 21:04:47.248004 | controller | Thursday 09 October 2025 21:04:47 +0000 (0:00:00.034) 0:00:59.589 ****** 2025-10-09 21:04:47.707186 | controller | ok: [instance] 2025-10-09 21:04:47.856373 | controller | 2025-10-09 21:04:47.856396 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2025-10-09 21:04:47.856403 | controller | Thursday 09 October 2025 21:04:47 +0000 (0:00:00.459) 0:01:00.048 ****** 2025-10-09 21:04:47.856412 | controller | ok: [instance] => (item=cifmw-public) 2025-10-09 21:04:49.057849 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-10-09 21:04:49.057876 | controller | 2025-10-09 21:04:49.057884 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2025-10-09 21:04:49.057890 | controller | Thursday 09 October 2025 21:04:47 +0000 (0:00:00.149) 0:01:00.197 ****** 2025-10-09 21:04:49.057899 | controller | ok: [instance] 2025-10-09 21:04:52.896736 | controller | 2025-10-09 21:04:52.896774 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2025-10-09 21:04:52.896784 | controller | Thursday 09 October 2025 21:04:49 +0000 (0:00:01.201) 0:01:01.398 ****** 2025-10-09 21:04:52.896796 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2025-10-09 21:04:52.896830 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2025-10-09 21:04:52.896863 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2025-10-09 21:04:52.897193 | controller | 2025-10-09 21:04:53.126656 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2025-10-09 21:04:53.126698 | controller | Thursday 09 October 2025 21:04:52 +0000 (0:00:03.838) 0:01:05.237 ****** 2025-10-09 21:04:53.126710 | controller | changed: [instance] 2025-10-09 21:04:53.126735 | controller | 2025-10-09 21:04:53.126744 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2025-10-09 21:04:53.126817 | controller | Thursday 09 October 2025 21:04:53 +0000 (0:00:00.230) 0:01:05.468 ****** 2025-10-09 21:04:53.498218 | controller | changed: [instance] 2025-10-09 21:04:53.915705 | controller | 2025-10-09 21:04:53.915742 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2025-10-09 21:04:53.915751 | controller | Thursday 09 October 2025 21:04:53 +0000 (0:00:00.371) 0:01:05.839 ****** 2025-10-09 21:04:53.915761 | controller | changed: [instance] 2025-10-09 21:04:53.950792 | controller | 2025-10-09 21:04:53.950865 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2025-10-09 21:04:53.950877 | controller | Thursday 09 October 2025 21:04:53 +0000 (0:00:00.417) 0:01:06.256 ****** 2025-10-09 21:04:53.950896 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2025-10-09 21:04:53.950939 | controller | 2025-10-09 21:04:53.950973 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2025-10-09 21:04:53.951130 | controller | Thursday 09 October 2025 21:04:53 +0000 (0:00:00.035) 0:01:06.292 ****** 2025-10-09 21:04:54.384788 | controller | changed: [instance] 2025-10-09 21:04:54.406723 | controller | 2025-10-09 21:04:54.406767 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2025-10-09 21:04:54.406778 | controller | Thursday 09 October 2025 21:04:54 +0000 (0:00:00.433) 0:01:06.725 ****** 2025-10-09 21:04:54.406791 | controller | skipping: [instance] 2025-10-09 21:04:54.406824 | controller | 2025-10-09 21:04:54.406835 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2025-10-09 21:04:54.406938 | controller | Thursday 09 October 2025 21:04:54 +0000 (0:00:00.022) 0:01:06.748 ****** 2025-10-09 21:04:54.444550 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2025-10-09 21:04:54.867780 | controller | 2025-10-09 21:04:54.867826 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2025-10-09 21:04:54.867846 | controller | Thursday 09 October 2025 21:04:54 +0000 (0:00:00.037) 0:01:06.785 ****** 2025-10-09 21:04:54.867859 | controller | changed: [instance] 2025-10-09 21:04:54.867921 | controller | 2025-10-09 21:04:54.867951 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2025-10-09 21:04:54.891712 | controller | Thursday 09 October 2025 21:04:54 +0000 (0:00:00.423) 0:01:07.208 ****** 2025-10-09 21:04:54.891751 | controller | skipping: [instance] 2025-10-09 21:04:55.141701 | controller | 2025-10-09 21:04:55.141726 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2025-10-09 21:04:55.141736 | controller | Thursday 09 October 2025 21:04:54 +0000 (0:00:00.023) 0:01:07.232 ****** 2025-10-09 21:04:55.141747 | controller | ok: [instance] => (item=127.0.0.2) 2025-10-09 21:04:55.141755 | controller | 2025-10-09 21:04:55.141762 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2025-10-09 21:04:55.141771 | controller | Thursday 09 October 2025 21:04:55 +0000 (0:00:00.250) 0:01:07.483 ****** 2025-10-09 21:04:55.868664 | controller | changed: [instance] 2025-10-09 21:04:55.868885 | controller | 2025-10-09 21:04:55.868905 | controller | TASK [dnsmasq : Stop service] ************************************************** 2025-10-09 21:04:55.892024 | controller | Thursday 09 October 2025 21:04:55 +0000 (0:00:00.726) 0:01:08.209 ****** 2025-10-09 21:04:55.892045 | controller | skipping: [instance] 2025-10-09 21:04:55.913694 | controller | 2025-10-09 21:04:55.913897 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2025-10-09 21:04:55.913909 | controller | Thursday 09 October 2025 21:04:55 +0000 (0:00:00.023) 0:01:08.233 ****** 2025-10-09 21:04:55.913921 | controller | skipping: [instance] 2025-10-09 21:04:55.946299 | controller | 2025-10-09 21:04:55.946333 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2025-10-09 21:04:55.946343 | controller | Thursday 09 October 2025 21:04:55 +0000 (0:00:00.021) 0:01:08.254 ****** 2025-10-09 21:04:55.946355 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-10-09 21:04:56.065637 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2025-10-09 21:04:56.065664 | controller | skipping: [instance] 2025-10-09 21:04:56.065671 | controller | 2025-10-09 21:04:56.065677 | controller | TASK [Create dnsmasq networks] ************************************************* 2025-10-09 21:04:56.065693 | controller | Thursday 09 October 2025 21:04:55 +0000 (0:00:00.032) 0:01:08.287 ****** 2025-10-09 21:04:56.065703 | controller | 2025-10-09 21:04:56.104836 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-10-09 21:04:56.104860 | controller | Thursday 09 October 2025 21:04:56 +0000 (0:00:00.119) 0:01:08.407 ****** 2025-10-09 21:04:56.104873 | controller | ok: [instance] => changed=false 2025-10-09 21:04:56.147645 | controller | msg: All assertions passed 2025-10-09 21:04:56.147704 | controller | 2025-10-09 21:04:56.147722 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-10-09 21:04:56.147729 | controller | Thursday 09 October 2025 21:04:56 +0000 (0:00:00.038) 0:01:08.445 ****** 2025-10-09 21:04:56.147740 | controller | ok: [instance] => changed=false 2025-10-09 21:04:56.147829 | controller | msg: All assertions passed 2025-10-09 21:04:56.147975 | controller | 2025-10-09 21:04:56.148158 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-10-09 21:04:56.148291 | controller | Thursday 09 October 2025 21:04:56 +0000 (0:00:00.043) 0:01:08.489 ****** 2025-10-09 21:04:56.638042 | controller | changed: [instance] 2025-10-09 21:04:56.663535 | controller | 2025-10-09 21:04:56.663603 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-10-09 21:04:56.663625 | controller | Thursday 09 October 2025 21:04:56 +0000 (0:00:00.489) 0:01:08.978 ****** 2025-10-09 21:04:56.663644 | controller | skipping: [instance] 2025-10-09 21:04:56.693761 | controller | 2025-10-09 21:04:56.693805 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-10-09 21:04:56.693819 | controller | Thursday 09 October 2025 21:04:56 +0000 (0:00:00.025) 0:01:09.004 ****** 2025-10-09 21:04:56.693837 | controller | skipping: [instance] 2025-10-09 21:04:56.732467 | controller | 2025-10-09 21:04:56.732510 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-10-09 21:04:56.732524 | controller | Thursday 09 October 2025 21:04:56 +0000 (0:00:00.030) 0:01:09.035 ****** 2025-10-09 21:04:56.732542 | controller | ok: [instance] => changed=false 2025-10-09 21:04:56.732640 | controller | msg: All assertions passed 2025-10-09 21:04:56.732666 | controller | 2025-10-09 21:04:56.732752 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-10-09 21:04:56.732851 | controller | Thursday 09 October 2025 21:04:56 +0000 (0:00:00.038) 0:01:09.073 ****** 2025-10-09 21:04:56.778339 | controller | ok: [instance] => changed=false 2025-10-09 21:04:56.778845 | controller | msg: All assertions passed 2025-10-09 21:04:57.231935 | controller | 2025-10-09 21:04:57.231966 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-10-09 21:04:57.231976 | controller | Thursday 09 October 2025 21:04:56 +0000 (0:00:00.046) 0:01:09.119 ****** 2025-10-09 21:04:57.231988 | controller | changed: [instance] 2025-10-09 21:04:57.232145 | controller | 2025-10-09 21:04:57.232194 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-10-09 21:04:57.232215 | controller | Thursday 09 October 2025 21:04:57 +0000 (0:00:00.453) 0:01:09.573 ****** 2025-10-09 21:04:57.258195 | controller | skipping: [instance] 2025-10-09 21:04:57.290093 | controller | 2025-10-09 21:04:57.290135 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-10-09 21:04:57.290149 | controller | Thursday 09 October 2025 21:04:57 +0000 (0:00:00.026) 0:01:09.599 ****** 2025-10-09 21:04:57.290177 | controller | skipping: [instance] 2025-10-09 21:04:57.290248 | controller | 2025-10-09 21:04:57.290268 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2025-10-09 21:04:57.290340 | controller | Thursday 09 October 2025 21:04:57 +0000 (0:00:00.032) 0:01:09.631 ****** 2025-10-09 21:04:57.835046 | controller | changed: [instance] => (item=cifmw-public) 2025-10-09 21:04:57.835105 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-10-09 21:04:57.835230 | controller | 2025-10-09 21:04:57.835336 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-10-09 21:04:57.835440 | controller | Thursday 09 October 2025 21:04:57 +0000 (0:00:00.544) 0:01:10.176 ****** 2025-10-09 21:04:57.874926 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2025-10-09 21:04:57.875032 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2025-10-09 21:04:57.875125 | controller | 2025-10-09 21:04:57.875233 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-10-09 21:04:57.875343 | controller | Thursday 09 October 2025 21:04:57 +0000 (0:00:00.040) 0:01:10.216 ****** 2025-10-09 21:04:58.230251 | controller | ok: [instance] 2025-10-09 21:04:58.230303 | controller | 2025-10-09 21:04:58.230383 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-10-09 21:04:58.230485 | controller | Thursday 09 October 2025 21:04:58 +0000 (0:00:00.355) 0:01:10.571 ****** 2025-10-09 21:04:58.270739 | controller | ok: [instance] 2025-10-09 21:04:58.270776 | controller | 2025-10-09 21:04:58.270786 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-10-09 21:04:58.270796 | controller | Thursday 09 October 2025 21:04:58 +0000 (0:00:00.040) 0:01:10.611 ****** 2025-10-09 21:04:58.485518 | controller | ok: [instance] 2025-10-09 21:04:58.523731 | controller | 2025-10-09 21:04:58.523753 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-10-09 21:04:58.523761 | controller | Thursday 09 October 2025 21:04:58 +0000 (0:00:00.214) 0:01:10.826 ****** 2025-10-09 21:04:58.523771 | controller | ok: [instance] 2025-10-09 21:04:58.891359 | controller | 2025-10-09 21:04:58.891398 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2025-10-09 21:04:58.891406 | controller | Thursday 09 October 2025 21:04:58 +0000 (0:00:00.038) 0:01:10.865 ****** 2025-10-09 21:04:58.891421 | controller | changed: [instance] 2025-10-09 21:04:59.261116 | controller | 2025-10-09 21:04:59.261155 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2025-10-09 21:04:59.261164 | controller | Thursday 09 October 2025 21:04:58 +0000 (0:00:00.367) 0:01:11.232 ****** 2025-10-09 21:04:59.261174 | controller | changed: [instance] 2025-10-09 21:04:59.629726 | controller | 2025-10-09 21:04:59.629786 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2025-10-09 21:04:59.629795 | controller | Thursday 09 October 2025 21:04:59 +0000 (0:00:00.369) 0:01:11.601 ****** 2025-10-09 21:04:59.629808 | controller | changed: [instance] 2025-10-09 21:04:59.629841 | controller | 2025-10-09 21:04:59.629849 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2025-10-09 21:04:59.629978 | controller | Thursday 09 October 2025 21:04:59 +0000 (0:00:00.368) 0:01:11.970 ****** 2025-10-09 21:04:59.758329 | controller | ok: [instance] 2025-10-09 21:05:00.120755 | controller | 2025-10-09 21:05:00.120813 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2025-10-09 21:05:00.120826 | controller | Thursday 09 October 2025 21:04:59 +0000 (0:00:00.128) 0:01:12.099 ****** 2025-10-09 21:05:00.120841 | controller | changed: [instance] 2025-10-09 21:05:00.120874 | controller | 2025-10-09 21:05:00.120885 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-10-09 21:05:00.120915 | controller | Thursday 09 October 2025 21:05:00 +0000 (0:00:00.362) 0:01:12.461 ****** 2025-10-09 21:05:00.148718 | controller | skipping: [instance] 2025-10-09 21:05:00.148762 | controller | 2025-10-09 21:05:00.148772 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-10-09 21:05:00.148783 | controller | Thursday 09 October 2025 21:05:00 +0000 (0:00:00.028) 0:01:12.490 ****** 2025-10-09 21:05:00.175779 | controller | skipping: [instance] 2025-10-09 21:05:00.175830 | controller | 2025-10-09 21:05:00.175840 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-10-09 21:05:00.175852 | controller | Thursday 09 October 2025 21:05:00 +0000 (0:00:00.026) 0:01:12.517 ****** 2025-10-09 21:05:00.202813 | controller | skipping: [instance] 2025-10-09 21:05:00.202855 | controller | 2025-10-09 21:05:00.202865 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-10-09 21:05:00.202876 | controller | Thursday 09 October 2025 21:05:00 +0000 (0:00:00.026) 0:01:12.543 ****** 2025-10-09 21:05:00.227762 | controller | skipping: [instance] 2025-10-09 21:05:00.227835 | controller | 2025-10-09 21:05:00.228011 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-10-09 21:05:00.248448 | controller | Thursday 09 October 2025 21:05:00 +0000 (0:00:00.025) 0:01:12.569 ****** 2025-10-09 21:05:00.248475 | controller | ok: [instance] 2025-10-09 21:05:00.370409 | controller | 2025-10-09 21:05:00.370434 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-10-09 21:05:00.370445 | controller | Thursday 09 October 2025 21:05:00 +0000 (0:00:00.020) 0:01:12.589 ****** 2025-10-09 21:05:00.370460 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-10-09 21:05:00.370720 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-10-09 21:05:00.370904 | controller | 2025-10-09 21:05:00.371075 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-10-09 21:05:00.371210 | controller | Thursday 09 October 2025 21:05:00 +0000 (0:00:00.122) 0:01:12.711 ****** 2025-10-09 21:05:00.392235 | controller | skipping: [instance] 2025-10-09 21:05:00.392406 | controller | 2025-10-09 21:05:00.392600 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-10-09 21:05:00.392806 | controller | Thursday 09 October 2025 21:05:00 +0000 (0:00:00.022) 0:01:12.733 ****** 2025-10-09 21:05:00.612212 | controller | ok: [instance] 2025-10-09 21:05:01.061777 | controller | 2025-10-09 21:05:01.061825 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-10-09 21:05:01.061836 | controller | Thursday 09 October 2025 21:05:00 +0000 (0:00:00.219) 0:01:12.953 ****** 2025-10-09 21:05:01.061851 | controller | changed: [instance] 2025-10-09 21:05:01.129845 | controller | 2025-10-09 21:05:01.129927 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-10-09 21:05:01.129942 | controller | Thursday 09 October 2025 21:05:01 +0000 (0:00:00.449) 0:01:13.402 ****** 2025-10-09 21:05:01.129964 | controller | ok: [instance] 2025-10-09 21:05:01.130000 | controller | 2025-10-09 21:05:01.130015 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-10-09 21:05:01.169781 | controller | Thursday 09 October 2025 21:05:01 +0000 (0:00:00.068) 0:01:13.471 ****** 2025-10-09 21:05:01.169836 | controller | ok: [instance] 2025-10-09 21:05:01.620290 | controller | 2025-10-09 21:05:01.620339 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-10-09 21:05:01.620348 | controller | Thursday 09 October 2025 21:05:01 +0000 (0:00:00.039) 0:01:13.510 ****** 2025-10-09 21:05:01.620362 | controller | changed: [instance] 2025-10-09 21:05:01.657076 | controller | 2025-10-09 21:05:01.657098 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2025-10-09 21:05:01.657106 | controller | Thursday 09 October 2025 21:05:01 +0000 (0:00:00.450) 0:01:13.961 ****** 2025-10-09 21:05:01.657117 | controller | ok: [instance] 2025-10-09 21:05:01.687221 | controller | 2025-10-09 21:05:01.687236 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2025-10-09 21:05:01.687244 | controller | Thursday 09 October 2025 21:05:01 +0000 (0:00:00.037) 0:01:13.998 ****** 2025-10-09 21:05:01.687254 | controller | ok: [instance] 2025-10-09 21:05:01.713550 | controller | 2025-10-09 21:05:01.713567 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2025-10-09 21:05:01.713589 | controller | Thursday 09 October 2025 21:05:01 +0000 (0:00:00.030) 0:01:14.028 ****** 2025-10-09 21:05:01.713601 | controller | ok: [instance] 2025-10-09 21:05:01.797772 | controller | 2025-10-09 21:05:01.797823 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2025-10-09 21:05:01.797834 | controller | Thursday 09 October 2025 21:05:01 +0000 (0:00:00.026) 0:01:14.054 ****** 2025-10-09 21:05:01.797849 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2025-10-09 21:05:01.797897 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2025-10-09 21:05:01.797906 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2025-10-09 21:05:01.797914 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2025-10-09 21:05:01.797924 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2025-10-09 21:05:01.797931 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2025-10-09 21:05:01.797939 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2025-10-09 21:05:01.797946 | controller | 2025-10-09 21:05:01.797960 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-10-09 21:05:01.930767 | controller | Thursday 09 October 2025 21:05:01 +0000 (0:00:00.083) 0:01:14.138 ****** 2025-10-09 21:05:01.930813 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2025-10-09 21:05:01.930869 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2025-10-09 21:05:01.930882 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2025-10-09 21:05:01.930892 | controller | 2025-10-09 21:05:01.930906 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-10-09 21:05:01.930919 | controller | Thursday 09 October 2025 21:05:01 +0000 (0:00:00.133) 0:01:14.271 ****** 2025-10-09 21:05:02.020057 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2025-10-09 21:05:02.020130 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2025-10-09 21:05:02.020279 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2025-10-09 21:05:02.020389 | controller | skipping: [instance] 2025-10-09 21:05:02.020498 | controller | 2025-10-09 21:05:02.020638 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-10-09 21:05:02.020800 | controller | Thursday 09 October 2025 21:05:02 +0000 (0:00:00.089) 0:01:14.361 ****** 2025-10-09 21:05:02.106642 | controller | skipping: [instance] => (item=compute-0 - storage) 2025-10-09 21:05:02.106787 | controller | skipping: [instance] => (item=controller-0 - storage) 2025-10-09 21:05:02.106976 | controller | skipping: [instance] => (item=crc-0 - storage) 2025-10-09 21:05:02.107096 | controller | skipping: [instance] 2025-10-09 21:05:02.107228 | controller | 2025-10-09 21:05:02.107373 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-10-09 21:05:02.107477 | controller | Thursday 09 October 2025 21:05:02 +0000 (0:00:00.086) 0:01:14.448 ****** 2025-10-09 21:05:02.195956 | controller | skipping: [instance] => (item=compute-0 - tenant) 2025-10-09 21:05:02.196035 | controller | skipping: [instance] => (item=controller-0 - tenant) 2025-10-09 21:05:02.196239 | controller | skipping: [instance] => (item=crc-0 - tenant) 2025-10-09 21:05:02.196308 | controller | skipping: [instance] 2025-10-09 21:05:02.196461 | controller | 2025-10-09 21:05:02.196600 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-10-09 21:05:02.196705 | controller | Thursday 09 October 2025 21:05:02 +0000 (0:00:00.089) 0:01:14.537 ****** 2025-10-09 21:05:02.282361 | controller | skipping: [instance] => (item=compute-0 - external) 2025-10-09 21:05:02.282447 | controller | skipping: [instance] => (item=controller-0 - external) 2025-10-09 21:05:02.282609 | controller | skipping: [instance] => (item=crc-0 - external) 2025-10-09 21:05:02.282764 | controller | skipping: [instance] 2025-10-09 21:05:02.282879 | controller | 2025-10-09 21:05:02.282985 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-10-09 21:05:02.283092 | controller | Thursday 09 October 2025 21:05:02 +0000 (0:00:00.086) 0:01:14.623 ****** 2025-10-09 21:05:02.369192 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2025-10-09 21:05:02.369307 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2025-10-09 21:05:02.369443 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2025-10-09 21:05:02.369599 | controller | skipping: [instance] 2025-10-09 21:05:02.369733 | controller | 2025-10-09 21:05:02.369895 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-10-09 21:05:02.369993 | controller | Thursday 09 October 2025 21:05:02 +0000 (0:00:00.086) 0:01:14.710 ****** 2025-10-09 21:05:02.505052 | controller | ok: [instance] => (item=compute-0 - public) 2025-10-09 21:05:02.505138 | controller | ok: [instance] => (item=controller-0 - public) 2025-10-09 21:05:02.505347 | controller | ok: [instance] => (item=crc-0 - public) 2025-10-09 21:05:02.505417 | controller | 2025-10-09 21:05:02.505626 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2025-10-09 21:05:02.505758 | controller | Thursday 09 October 2025 21:05:02 +0000 (0:00:00.135) 0:01:14.846 ****** 2025-10-09 21:05:02.622180 | controller | 2025-10-09 21:05:02.622227 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2025-10-09 21:05:02.622378 | controller | Thursday 09 October 2025 21:05:02 +0000 (0:00:00.117) 0:01:14.963 ****** 2025-10-09 21:05:02.669244 | controller | ok: [instance] 2025-10-09 21:05:02.669444 | controller | 2025-10-09 21:05:02.669652 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2025-10-09 21:05:02.669727 | controller | Thursday 09 October 2025 21:05:02 +0000 (0:00:00.046) 0:01:15.010 ****** 2025-10-09 21:05:02.775965 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:8c:a6:a2', 'ips': ['192.168.140.100', '']}) 2025-10-09 21:05:02.776087 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:b1:f6:b3', 'ips': ['192.168.140.9', '']}) 2025-10-09 21:05:02.776233 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:c3:23:81', 'ips': ['192.168.140.10', '']}) 2025-10-09 21:05:02.776386 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:65:9a:33', 'ips': ['192.168.101.100', '']}) 2025-10-09 21:05:02.776525 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:3c:58:1b', 'ips': ['192.168.101.9', '']}) 2025-10-09 21:05:02.776718 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:cf:9b:f3', 'ips': ['192.168.101.10', '']}) 2025-10-09 21:05:02.776853 | controller | 2025-10-09 21:05:02.776951 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2025-10-09 21:05:02.777062 | controller | Thursday 09 October 2025 21:05:02 +0000 (0:00:00.106) 0:01:15.117 ****** 2025-10-09 21:05:02.834215 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2025-10-09 21:05:02.834335 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2025-10-09 21:05:02.834443 | controller | 2025-10-09 21:05:02.834555 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-10-09 21:05:02.834687 | controller | Thursday 09 October 2025 21:05:02 +0000 (0:00:00.058) 0:01:15.175 ****** 2025-10-09 21:05:03.029151 | controller | ok: [instance] 2025-10-09 21:05:03.058420 | controller | 2025-10-09 21:05:03.058443 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-10-09 21:05:03.058453 | controller | Thursday 09 October 2025 21:05:03 +0000 (0:00:00.194) 0:01:15.370 ****** 2025-10-09 21:05:03.058472 | controller | ok: [instance] 2025-10-09 21:05:03.249861 | controller | 2025-10-09 21:05:03.249919 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-10-09 21:05:03.249934 | controller | Thursday 09 October 2025 21:05:03 +0000 (0:00:00.029) 0:01:15.399 ****** 2025-10-09 21:05:03.249952 | controller | ok: [instance] 2025-10-09 21:05:03.250006 | controller | 2025-10-09 21:05:03.250021 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-10-09 21:05:03.281611 | controller | Thursday 09 October 2025 21:05:03 +0000 (0:00:00.191) 0:01:15.591 ****** 2025-10-09 21:05:03.281645 | controller | ok: [instance] 2025-10-09 21:05:03.306427 | controller | 2025-10-09 21:05:03.306449 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2025-10-09 21:05:03.306458 | controller | Thursday 09 October 2025 21:05:03 +0000 (0:00:00.031) 0:01:15.622 ****** 2025-10-09 21:05:03.306469 | controller | ok: [instance] 2025-10-09 21:05:03.482689 | controller | 2025-10-09 21:05:03.482741 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2025-10-09 21:05:03.482755 | controller | Thursday 09 October 2025 21:05:03 +0000 (0:00:00.024) 0:01:15.647 ****** 2025-10-09 21:05:03.482771 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:8c:a6:a2', 'ips': ['192.168.140.100', '']}) 2025-10-09 21:05:03.483520 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:b1:f6:b3', 'ips': ['192.168.140.9', '']}) 2025-10-09 21:05:03.526482 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:c3:23:81', 'ips': ['192.168.140.10', '']}) 2025-10-09 21:05:03.526511 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:65:9a:33', 'ips': ['192.168.101.100', '']}) 2025-10-09 21:05:03.526520 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:3c:58:1b', 'ips': ['192.168.101.9', '']}) 2025-10-09 21:05:03.526527 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:cf:9b:f3', 'ips': ['192.168.101.10', '']}) 2025-10-09 21:05:03.526534 | controller | 2025-10-09 21:05:03.526540 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2025-10-09 21:05:03.526546 | controller | Thursday 09 October 2025 21:05:03 +0000 (0:00:00.176) 0:01:15.823 ****** 2025-10-09 21:05:03.526556 | controller | ok: [instance] 2025-10-09 21:05:05.721713 | controller | 2025-10-09 21:05:05.721750 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2025-10-09 21:05:05.721759 | controller | Thursday 09 October 2025 21:05:03 +0000 (0:00:00.043) 0:01:15.867 ****** 2025-10-09 21:05:05.721771 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:8c:a6:a2', 'entry': '52:54:00:8c:a6:a2,192.168.140.100,compute-0', 'state': 'present'}) 2025-10-09 21:05:05.721779 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:b1:f6:b3', 'entry': '52:54:01:b1:f6:b3,192.168.140.9,controller-0', 'state': 'present'}) 2025-10-09 21:05:05.721785 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:c3:23:81', 'entry': '52:54:02:c3:23:81,192.168.140.10,crc-0', 'state': 'present'}) 2025-10-09 21:05:05.721792 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:65:9a:33', 'entry': '52:54:00:65:9a:33,192.168.101.100,compute-0', 'state': 'present'}) 2025-10-09 21:05:05.721798 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:3c:58:1b', 'entry': '52:54:01:3c:58:1b,192.168.101.9,controller-0', 'state': 'present'}) 2025-10-09 21:05:05.721804 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:cf:9b:f3', 'entry': '52:54:02:cf:9b:f3,192.168.101.10,crc-0', 'state': 'present'}) 2025-10-09 21:05:05.721810 | controller | 2025-10-09 21:05:05.721816 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2025-10-09 21:05:05.721842 | controller | Thursday 09 October 2025 21:05:05 +0000 (0:00:02.194) 0:01:18.062 ****** 2025-10-09 21:05:05.750794 | controller | skipping: [instance] 2025-10-09 21:05:05.750876 | controller | 2025-10-09 21:05:05.750898 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2025-10-09 21:05:05.750909 | controller | Thursday 09 October 2025 21:05:05 +0000 (0:00:00.029) 0:01:18.092 ****** 2025-10-09 21:05:05.981800 | controller | ok: [instance] => (item=compute-0) 2025-10-09 21:05:05.981858 | controller | ok: [instance] => (item=controller-0) 2025-10-09 21:05:05.981876 | controller | ok: [instance] => (item=crc-0) 2025-10-09 21:05:05.981920 | controller | 2025-10-09 21:05:05.982132 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2025-10-09 21:05:06.101497 | controller | Thursday 09 October 2025 21:05:05 +0000 (0:00:00.230) 0:01:18.322 ****** 2025-10-09 21:05:06.101526 | controller | 2025-10-09 21:05:06.230736 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-10-09 21:05:06.230776 | controller | Thursday 09 October 2025 21:05:06 +0000 (0:00:00.119) 0:01:18.442 ****** 2025-10-09 21:05:06.230790 | controller | ok: [instance] 2025-10-09 21:05:06.230818 | controller | 2025-10-09 21:05:06.230827 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-10-09 21:05:06.230885 | controller | Thursday 09 October 2025 21:05:06 +0000 (0:00:00.128) 0:01:18.571 ****** 2025-10-09 21:05:06.435694 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-10-09 21:05:06.435796 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-10-09 21:05:06.435816 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-10-09 21:05:06.435824 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-10-09 21:05:06.435834 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-10-09 21:05:06.435917 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-10-09 21:05:06.436066 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-10-09 21:05:06.436139 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-10-09 21:05:06.436254 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-10-09 21:05:06.436353 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-10-09 21:05:06.436458 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-10-09 21:05:06.436561 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-10-09 21:05:06.436689 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-10-09 21:05:06.436813 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-10-09 21:05:06.436919 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-10-09 21:05:06.437029 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-10-09 21:05:06.437124 | controller | 2025-10-09 21:05:06.437225 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-10-09 21:05:06.437331 | controller | Thursday 09 October 2025 21:05:06 +0000 (0:00:00.204) 0:01:18.776 ****** 2025-10-09 21:05:09.720737 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-10-09 21:05:10.105714 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-10-09 21:05:10.105754 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-10-09 21:05:10.105764 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-10-09 21:05:10.105771 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-10-09 21:05:10.105778 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-10-09 21:05:10.105785 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-10-09 21:05:10.105791 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-10-09 21:05:10.105798 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-10-09 21:05:10.105805 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-10-09 21:05:10.105811 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-10-09 21:05:10.105818 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-10-09 21:05:10.105825 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-10-09 21:05:10.105840 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-10-09 21:05:10.105846 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-10-09 21:05:10.105853 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-10-09 21:05:10.105860 | controller | 2025-10-09 21:05:10.105866 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2025-10-09 21:05:10.105874 | controller | Thursday 09 October 2025 21:05:09 +0000 (0:00:03.283) 0:01:22.060 ****** 2025-10-09 21:05:10.105885 | controller | changed: [instance] 2025-10-09 21:05:10.105918 | controller | 2025-10-09 21:05:10.105926 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2025-10-09 21:05:10.105935 | controller | Thursday 09 October 2025 21:05:10 +0000 (0:00:00.375) 0:01:22.435 ****** 2025-10-09 21:05:10.105960 | controller | 2025-10-09 21:05:10.105969 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-10-09 21:05:10.106096 | controller | Thursday 09 October 2025 21:05:10 +0000 (0:00:00.011) 0:01:22.446 ****** 2025-10-09 21:05:10.921443 | controller | changed: [instance] 2025-10-09 21:05:11.280670 | controller | 2025-10-09 21:05:11.280713 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-10-09 21:05:11.280722 | controller | Thursday 09 October 2025 21:05:10 +0000 (0:00:00.815) 0:01:23.262 ****** 2025-10-09 21:05:11.280732 | controller | changed: [instance] 2025-10-09 21:05:11.280758 | controller | 2025-10-09 21:05:11.280766 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2025-10-09 21:05:11.280854 | controller | Thursday 09 October 2025 21:05:11 +0000 (0:00:00.359) 0:01:23.621 ****** 2025-10-09 21:05:11.626663 | controller | changed: [instance] 2025-10-09 21:05:11.626723 | controller | 2025-10-09 21:05:11.626733 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2025-10-09 21:05:11.626742 | controller | Thursday 09 October 2025 21:05:11 +0000 (0:00:00.345) 0:01:23.967 ****** 2025-10-09 21:05:11.989812 | controller | changed: [instance] 2025-10-09 21:05:12.358594 | controller | 2025-10-09 21:05:12.358627 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2025-10-09 21:05:12.358635 | controller | Thursday 09 October 2025 21:05:11 +0000 (0:00:00.362) 0:01:24.330 ****** 2025-10-09 21:05:12.358645 | controller | changed: [instance] 2025-10-09 21:05:12.389756 | controller | 2025-10-09 21:05:12.389792 | controller | TASK [Build utility records dataset] ******************************************* 2025-10-09 21:05:12.389801 | controller | Thursday 09 October 2025 21:05:12 +0000 (0:00:00.369) 0:01:24.699 ****** 2025-10-09 21:05:12.389813 | controller | 2025-10-09 21:05:12.483766 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-10-09 21:05:12.483800 | controller | Thursday 09 October 2025 21:05:12 +0000 (0:00:00.031) 0:01:24.731 ****** 2025-10-09 21:05:12.483816 | controller | ok: [instance] 2025-10-09 21:05:12.587178 | controller | 2025-10-09 21:05:12.587202 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-10-09 21:05:12.587212 | controller | Thursday 09 October 2025 21:05:12 +0000 (0:00:00.093) 0:01:24.824 ****** 2025-10-09 21:05:12.587229 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-10-09 21:05:13.068761 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-10-09 21:05:13.068794 | controller | 2025-10-09 21:05:13.068803 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-10-09 21:05:13.068810 | controller | Thursday 09 October 2025 21:05:12 +0000 (0:00:00.103) 0:01:24.927 ****** 2025-10-09 21:05:13.068821 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-10-09 21:05:13.068850 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-10-09 21:05:13.068858 | controller | 2025-10-09 21:05:13.068866 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-10-09 21:05:13.069262 | controller | Thursday 09 October 2025 21:05:13 +0000 (0:00:00.471) 0:01:25.399 ****** 2025-10-09 21:05:13.549159 | controller | 2025-10-09 21:05:13.549193 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-10-09 21:05:13.549201 | controller | Thursday 09 October 2025 21:05:13 +0000 (0:00:00.010) 0:01:25.409 ****** 2025-10-09 21:05:13.549211 | controller | changed: [instance] 2025-10-09 21:05:14.937694 | controller | 2025-10-09 21:05:14.937756 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-10-09 21:05:14.937767 | controller | Thursday 09 October 2025 21:05:13 +0000 (0:00:00.480) 0:01:25.889 ****** 2025-10-09 21:05:14.937780 | controller | changed: [instance] 2025-10-09 21:05:14.973503 | controller | 2025-10-09 21:05:14.973549 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2025-10-09 21:05:14.973562 | controller | Thursday 09 October 2025 21:05:14 +0000 (0:00:01.388) 0:01:27.278 ****** 2025-10-09 21:05:14.973614 | controller | skipping: [instance] 2025-10-09 21:05:15.085200 | controller | 2025-10-09 21:05:15.085217 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2025-10-09 21:05:15.085224 | controller | Thursday 09 October 2025 21:05:14 +0000 (0:00:00.036) 0:01:27.314 ****** 2025-10-09 21:05:15.085232 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2025-10-09 21:05:15.279072 | controller | 2025-10-09 21:05:15.279090 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2025-10-09 21:05:15.279097 | controller | Thursday 09 October 2025 21:05:15 +0000 (0:00:00.111) 0:01:27.426 ****** 2025-10-09 21:05:15.279106 | controller | ok: [instance] 2025-10-09 21:05:15.301673 | controller | 2025-10-09 21:05:15.301695 | controller | TASK [Deploy CRC if needed] **************************************************** 2025-10-09 21:05:15.301704 | controller | Thursday 09 October 2025 21:05:15 +0000 (0:00:00.194) 0:01:27.620 ****** 2025-10-09 21:05:15.301725 | controller | skipping: [instance] 2025-10-09 21:05:15.301756 | controller | 2025-10-09 21:05:15.302018 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2025-10-09 21:05:15.670263 | controller | Thursday 09 October 2025 21:05:15 +0000 (0:00:00.022) 0:01:27.643 ****** 2025-10-09 21:05:15.670298 | controller | ok: [instance] 2025-10-09 21:05:15.916099 | controller | 2025-10-09 21:05:15.916124 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2025-10-09 21:05:15.916133 | controller | Thursday 09 October 2025 21:05:15 +0000 (0:00:00.367) 0:01:28.011 ****** 2025-10-09 21:05:15.916143 | controller | ok: [instance] 2025-10-09 21:05:16.141411 | controller | 2025-10-09 21:05:16.141446 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2025-10-09 21:05:16.141454 | controller | Thursday 09 October 2025 21:05:15 +0000 (0:00:00.245) 0:01:28.257 ****** 2025-10-09 21:05:16.141464 | controller | ok: [instance] 2025-10-09 21:05:16.366788 | controller | 2025-10-09 21:05:16.366814 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2025-10-09 21:05:16.366822 | controller | Thursday 09 October 2025 21:05:16 +0000 (0:00:00.225) 0:01:28.482 ****** 2025-10-09 21:05:16.366832 | controller | ok: [instance] 2025-10-09 21:05:16.601335 | controller | 2025-10-09 21:05:16.601366 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2025-10-09 21:05:16.601374 | controller | Thursday 09 October 2025 21:05:16 +0000 (0:00:00.225) 0:01:28.708 ****** 2025-10-09 21:05:16.601384 | controller | ok: [instance] 2025-10-09 21:05:16.644202 | controller | 2025-10-09 21:05:16.644234 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-10-09 21:05:16.644244 | controller | Thursday 09 October 2025 21:05:16 +0000 (0:00:00.234) 0:01:28.942 ****** 2025-10-09 21:05:16.644257 | controller | 2025-10-09 21:05:16.844258 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-10-09 21:05:16.844281 | controller | Thursday 09 October 2025 21:05:16 +0000 (0:00:00.042) 0:01:28.985 ****** 2025-10-09 21:05:16.844294 | controller | ok: [instance] 2025-10-09 21:05:16.868421 | controller | 2025-10-09 21:05:16.868438 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-10-09 21:05:16.868451 | controller | Thursday 09 October 2025 21:05:16 +0000 (0:00:00.199) 0:01:29.185 ****** 2025-10-09 21:05:16.868459 | controller | ok: [instance] 2025-10-09 21:05:16.893415 | controller | 2025-10-09 21:05:16.893444 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-10-09 21:05:16.893457 | controller | Thursday 09 October 2025 21:05:16 +0000 (0:00:00.023) 0:01:29.209 ****** 2025-10-09 21:05:16.893471 | controller | skipping: [instance] 2025-10-09 21:05:17.153339 | controller | 2025-10-09 21:05:17.153371 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2025-10-09 21:05:17.153379 | controller | Thursday 09 October 2025 21:05:16 +0000 (0:00:00.025) 0:01:29.234 ****** 2025-10-09 21:05:17.153390 | controller | ok: [instance] 2025-10-09 21:05:17.378316 | controller | 2025-10-09 21:05:17.378343 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2025-10-09 21:05:17.378356 | controller | Thursday 09 October 2025 21:05:17 +0000 (0:00:00.260) 0:01:29.494 ****** 2025-10-09 21:05:17.378366 | controller | ok: [instance] 2025-10-09 21:05:17.561500 | controller | 2025-10-09 21:05:17.561532 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2025-10-09 21:05:17.561540 | controller | Thursday 09 October 2025 21:05:17 +0000 (0:00:00.225) 0:01:29.719 ****** 2025-10-09 21:05:17.561550 | controller | ok: [instance] 2025-10-09 21:05:17.621703 | controller | 2025-10-09 21:05:17.621741 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2025-10-09 21:05:17.621751 | controller | Thursday 09 October 2025 21:05:17 +0000 (0:00:00.183) 0:01:29.902 ****** 2025-10-09 21:05:17.621764 | controller | 2025-10-09 21:05:17.666665 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-10-09 21:05:17.666684 | controller | Thursday 09 October 2025 21:05:17 +0000 (0:00:00.060) 0:01:29.963 ****** 2025-10-09 21:05:17.666697 | controller | ok: [instance] => changed=false 2025-10-09 21:05:17.845673 | controller | msg: All assertions passed 2025-10-09 21:05:17.845722 | controller | 2025-10-09 21:05:17.845733 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-10-09 21:05:17.845740 | controller | Thursday 09 October 2025 21:05:17 +0000 (0:00:00.044) 0:01:30.007 ****** 2025-10-09 21:05:17.845752 | controller | ok: [instance] 2025-10-09 21:05:18.041214 | controller | 2025-10-09 21:05:18.041246 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-10-09 21:05:18.041256 | controller | Thursday 09 October 2025 21:05:17 +0000 (0:00:00.179) 0:01:30.186 ****** 2025-10-09 21:05:18.041267 | controller | ok: [instance] 2025-10-09 21:05:18.066738 | controller | 2025-10-09 21:05:18.066788 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-10-09 21:05:18.066802 | controller | Thursday 09 October 2025 21:05:18 +0000 (0:00:00.195) 0:01:30.382 ****** 2025-10-09 21:05:18.066820 | controller | ok: [instance] => changed=false 2025-10-09 21:05:18.259733 | controller | msg: All assertions passed 2025-10-09 21:05:18.259776 | controller | 2025-10-09 21:05:18.259786 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-10-09 21:05:18.259794 | controller | Thursday 09 October 2025 21:05:18 +0000 (0:00:00.025) 0:01:30.407 ****** 2025-10-09 21:05:18.259806 | controller | ok: [instance] 2025-10-09 21:05:18.259837 | controller | 2025-10-09 21:05:18.259847 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-10-09 21:05:18.439654 | controller | Thursday 09 October 2025 21:05:18 +0000 (0:00:00.192) 0:01:30.600 ****** 2025-10-09 21:05:18.439692 | controller | ok: [instance] 2025-10-09 21:05:18.490403 | controller | 2025-10-09 21:05:18.490430 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-10-09 21:05:18.490437 | controller | Thursday 09 October 2025 21:05:18 +0000 (0:00:00.179) 0:01:30.780 ****** 2025-10-09 21:05:18.490448 | controller | ok: [instance] 2025-10-09 21:05:18.895615 | controller | 2025-10-09 21:05:18.895649 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2025-10-09 21:05:18.895657 | controller | Thursday 09 October 2025 21:05:18 +0000 (0:00:00.050) 0:01:30.831 ****** 2025-10-09 21:05:18.895667 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2025-10-09 21:05:18.921229 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2025-10-09 21:05:18.921252 | controller | 2025-10-09 21:05:18.921260 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2025-10-09 21:05:18.921265 | controller | Thursday 09 October 2025 21:05:18 +0000 (0:00:00.404) 0:01:31.236 ****** 2025-10-09 21:05:18.921274 | controller | skipping: [instance] 2025-10-09 21:05:18.957045 | controller | 2025-10-09 21:05:18.957067 | controller | TASK [Load the architecture local kustomize patches] *************************** 2025-10-09 21:05:18.957076 | controller | Thursday 09 October 2025 21:05:18 +0000 (0:00:00.025) 0:01:31.262 ****** 2025-10-09 21:05:18.957092 | controller | skipping: [instance] 2025-10-09 21:05:19.092199 | controller | 2025-10-09 21:05:19.092219 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2025-10-09 21:05:19.092237 | controller | Thursday 09 October 2025 21:05:18 +0000 (0:00:00.035) 0:01:31.298 ****** 2025-10-09 21:05:19.092251 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2025-10-09 21:05:19.128137 | controller | 2025-10-09 21:05:19.128160 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2025-10-09 21:05:19.128169 | controller | Thursday 09 October 2025 21:05:19 +0000 (0:00:00.135) 0:01:31.433 ****** 2025-10-09 21:05:19.128179 | controller | skipping: [instance] 2025-10-09 21:05:19.563379 | controller | 2025-10-09 21:05:19.563412 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2025-10-09 21:05:19.563420 | controller | Thursday 09 October 2025 21:05:19 +0000 (0:00:00.035) 0:01:31.469 ****** 2025-10-09 21:05:19.563429 | controller | changed: [instance] 2025-10-09 21:05:20.158411 | controller | 2025-10-09 21:05:20.158443 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2025-10-09 21:05:20.158451 | controller | Thursday 09 October 2025 21:05:19 +0000 (0:00:00.434) 0:01:31.904 ****** 2025-10-09 21:05:20.158461 | controller | changed: [instance] 2025-10-09 21:05:20.594804 | controller | 2025-10-09 21:05:20.594837 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2025-10-09 21:05:20.594852 | controller | Thursday 09 October 2025 21:05:20 +0000 (0:00:00.583) 0:01:32.487 ****** 2025-10-09 21:05:20.594858 | controller | 2025-10-09 21:05:20.594863 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-10-09 21:05:20.594869 | controller | Thursday 09 October 2025 21:05:20 +0000 (0:00:00.011) 0:01:32.499 ****** 2025-10-09 21:05:20.594878 | controller | changed: [instance] 2025-10-09 21:05:20.594896 | controller | 2025-10-09 21:05:20.594903 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-10-09 21:05:20.595019 | controller | Thursday 09 October 2025 21:05:20 +0000 (0:00:00.436) 0:01:32.935 ****** 2025-10-09 21:05:21.458655 | controller | changed: [instance] 2025-10-09 21:05:21.458708 | controller | 2025-10-09 21:05:21.458931 | controller | TASK [Deploy virtualbmc] ******************************************************* 2025-10-09 21:05:21.494549 | controller | Thursday 09 October 2025 21:05:21 +0000 (0:00:00.864) 0:01:33.799 ****** 2025-10-09 21:05:21.494601 | controller | skipping: [instance] 2025-10-09 21:05:21.529659 | controller | 2025-10-09 21:05:21.529682 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2025-10-09 21:05:21.529690 | controller | Thursday 09 October 2025 21:05:21 +0000 (0:00:00.035) 0:01:33.835 ****** 2025-10-09 21:05:21.529699 | controller | skipping: [instance] 2025-10-09 21:05:21.529734 | controller | 2025-10-09 21:05:21.529743 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2025-10-09 21:05:21.529839 | controller | Thursday 09 October 2025 21:05:21 +0000 (0:00:00.035) 0:01:33.871 ****** 2025-10-09 21:05:22.116341 | controller | changed: [instance] => (item=workload) 2025-10-09 21:05:22.583676 | controller | changed: [instance] => (item=reproducer-inventory) 2025-10-09 21:05:22.583711 | controller | ok: [instance] => (item=volumes) 2025-10-09 21:05:22.583729 | controller | 2025-10-09 21:05:22.583736 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2025-10-09 21:05:22.583742 | controller | Thursday 09 October 2025 21:05:22 +0000 (0:00:00.585) 0:01:34.456 ****** 2025-10-09 21:05:22.583752 | controller | changed: [instance] => (item=workload) 2025-10-09 21:05:22.583768 | controller | changed: [instance] => (item=volumes) 2025-10-09 21:05:22.583774 | controller | 2025-10-09 21:05:22.583780 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2025-10-09 21:05:22.583787 | controller | Thursday 09 October 2025 21:05:22 +0000 (0:00:00.467) 0:01:34.924 ****** 2025-10-09 21:05:22.611812 | controller | skipping: [instance] 2025-10-09 21:05:23.655713 | controller | 2025-10-09 21:05:23.655767 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2025-10-09 21:05:23.655777 | controller | Thursday 09 October 2025 21:05:22 +0000 (0:00:00.028) 0:01:34.953 ****** 2025-10-09 21:05:23.655789 | controller | changed: [instance] => (item=compute) 2025-10-09 21:05:23.655819 | controller | changed: [instance] => (item=controller) 2025-10-09 21:05:23.655832 | controller | changed: [instance] => (item=crc) 2025-10-09 21:05:23.655841 | controller | 2025-10-09 21:05:23.655944 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2025-10-09 21:05:23.655979 | controller | Thursday 09 October 2025 21:05:23 +0000 (0:00:01.043) 0:01:35.996 ****** 2025-10-09 21:05:24.028162 | controller | changed: [instance] 2025-10-09 21:05:24.067481 | controller | 2025-10-09 21:05:24.067506 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2025-10-09 21:05:24.067516 | controller | Thursday 09 October 2025 21:05:24 +0000 (0:00:00.372) 0:01:36.369 ****** 2025-10-09 21:05:24.067528 | controller | skipping: [instance] 2025-10-09 21:05:24.130740 | controller | 2025-10-09 21:05:24.130773 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2025-10-09 21:05:24.130786 | controller | Thursday 09 October 2025 21:05:24 +0000 (0:00:00.039) 0:01:36.408 ****** 2025-10-09 21:05:24.130797 | controller | skipping: [instance] => (item=crc) 2025-10-09 21:05:24.338227 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2025-10-09 21:05:24.338250 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2025-10-09 21:05:24.338258 | controller | 2025-10-09 21:05:24.338265 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-10-09 21:05:24.338270 | controller | Thursday 09 October 2025 21:05:24 +0000 (0:00:00.063) 0:01:36.471 ****** 2025-10-09 21:05:24.338279 | controller | changed: [instance] 2025-10-09 21:05:24.520485 | controller | 2025-10-09 21:05:24.520505 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-10-09 21:05:24.520512 | controller | Thursday 09 October 2025 21:05:24 +0000 (0:00:00.207) 0:01:36.679 ****** 2025-10-09 21:05:24.520521 | controller | ok: [instance] 2025-10-09 21:05:45.665845 | controller | 2025-10-09 21:05:45.665912 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-10-09 21:05:45.665923 | controller | Thursday 09 October 2025 21:05:24 +0000 (0:00:00.182) 0:01:36.861 ****** 2025-10-09 21:05:45.665938 | controller | changed: [instance] 2025-10-09 21:05:45.665974 | controller | 2025-10-09 21:05:45.665984 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-10-09 21:05:45.666009 | controller | Thursday 09 October 2025 21:05:45 +0000 (0:00:21.144) 0:01:58.006 ****** 2025-10-09 21:05:45.883329 | controller | ok: [instance] 2025-10-09 21:05:45.923688 | controller | 2025-10-09 21:05:45.923708 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-10-09 21:05:45.923716 | controller | Thursday 09 October 2025 21:05:45 +0000 (0:00:00.217) 0:01:58.224 ****** 2025-10-09 21:05:45.923725 | controller | ok: [instance] => changed=false 2025-10-09 21:05:46.156193 | controller | msg: All assertions passed 2025-10-09 21:05:46.156241 | controller | 2025-10-09 21:05:46.156248 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-10-09 21:05:46.156255 | controller | Thursday 09 October 2025 21:05:45 +0000 (0:00:00.040) 0:01:58.265 ****** 2025-10-09 21:05:46.156267 | controller | changed: [instance] 2025-10-09 21:05:46.371230 | controller | 2025-10-09 21:05:46.371257 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-10-09 21:05:46.371266 | controller | Thursday 09 October 2025 21:05:46 +0000 (0:00:00.232) 0:01:58.497 ****** 2025-10-09 21:05:46.371277 | controller | ok: [instance] 2025-10-09 21:05:46.577084 | controller | 2025-10-09 21:05:46.577109 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-10-09 21:05:46.577118 | controller | Thursday 09 October 2025 21:05:46 +0000 (0:00:00.215) 0:01:58.712 ****** 2025-10-09 21:05:46.577129 | controller | ok: [instance] 2025-10-09 21:05:46.600665 | controller | 2025-10-09 21:05:46.600699 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-10-09 21:05:46.600712 | controller | Thursday 09 October 2025 21:05:46 +0000 (0:00:00.205) 0:01:58.918 ****** 2025-10-09 21:05:46.600728 | controller | skipping: [instance] 2025-10-09 21:05:46.824207 | controller | 2025-10-09 21:05:46.824225 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-10-09 21:05:46.824232 | controller | Thursday 09 October 2025 21:05:46 +0000 (0:00:00.023) 0:01:58.941 ****** 2025-10-09 21:05:46.824240 | controller | ok: [instance] 2025-10-09 21:05:46.876238 | controller | 2025-10-09 21:05:46.876261 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-10-09 21:05:46.876270 | controller | Thursday 09 October 2025 21:05:46 +0000 (0:00:00.223) 0:01:59.165 ****** 2025-10-09 21:05:46.876280 | controller | ok: [instance] => changed=false 2025-10-09 21:05:47.113148 | controller | msg: All assertions passed 2025-10-09 21:05:47.113178 | controller | 2025-10-09 21:05:47.113187 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-10-09 21:05:47.113195 | controller | Thursday 09 October 2025 21:05:46 +0000 (0:00:00.051) 0:01:59.216 ****** 2025-10-09 21:05:47.113206 | controller | ok: [instance] 2025-10-09 21:05:47.311313 | controller | 2025-10-09 21:05:47.311336 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2025-10-09 21:05:47.311343 | controller | Thursday 09 October 2025 21:05:47 +0000 (0:00:00.237) 0:01:59.454 ****** 2025-10-09 21:05:47.311352 | controller | ok: [instance] 2025-10-09 21:05:47.762201 | controller | 2025-10-09 21:05:47.762256 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2025-10-09 21:05:47.762265 | controller | Thursday 09 October 2025 21:05:47 +0000 (0:00:00.198) 0:01:59.652 ****** 2025-10-09 21:05:47.762278 | controller | changed: [instance] 2025-10-09 21:05:47.966492 | controller | 2025-10-09 21:05:47.966526 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2025-10-09 21:05:47.966534 | controller | Thursday 09 October 2025 21:05:47 +0000 (0:00:00.450) 0:02:00.102 ****** 2025-10-09 21:05:47.966552 | controller | ok: [instance] 2025-10-09 21:05:48.162176 | controller | 2025-10-09 21:05:48.162201 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2025-10-09 21:05:48.162210 | controller | Thursday 09 October 2025 21:05:47 +0000 (0:00:00.204) 0:02:00.307 ****** 2025-10-09 21:05:48.162221 | controller | ok: [instance] 2025-10-09 21:05:48.617270 | controller | 2025-10-09 21:05:48.617323 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2025-10-09 21:05:48.617331 | controller | Thursday 09 October 2025 21:05:48 +0000 (0:00:00.195) 0:02:00.503 ****** 2025-10-09 21:05:48.617345 | controller | changed: [instance] 2025-10-09 21:05:48.646304 | controller | 2025-10-09 21:05:48.646328 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2025-10-09 21:05:48.646337 | controller | Thursday 09 October 2025 21:05:48 +0000 (0:00:00.454) 0:02:00.958 ****** 2025-10-09 21:05:48.646348 | controller | ok: [instance] 2025-10-09 21:05:48.885997 | controller | 2025-10-09 21:05:48.886020 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2025-10-09 21:05:48.886029 | controller | Thursday 09 October 2025 21:05:48 +0000 (0:00:00.029) 0:02:00.987 ****** 2025-10-09 21:05:48.886040 | controller | ok: [instance] 2025-10-09 21:05:49.403570 | controller | 2025-10-09 21:05:49.403636 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2025-10-09 21:05:49.403645 | controller | Thursday 09 October 2025 21:05:48 +0000 (0:00:00.239) 0:02:01.227 ****** 2025-10-09 21:05:49.403658 | controller | ok: [instance] 2025-10-09 21:05:49.528825 | controller | 2025-10-09 21:05:49.528888 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2025-10-09 21:05:49.528904 | controller | Thursday 09 October 2025 21:05:49 +0000 (0:00:00.517) 0:02:01.744 ****** 2025-10-09 21:05:49.528925 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-10-09 21:05:49.804381 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-10-09 21:05:49.804426 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-10-09 21:05:49.804442 | controller | 2025-10-09 21:05:49.804451 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2025-10-09 21:05:49.804458 | controller | Thursday 09 October 2025 21:05:49 +0000 (0:00:00.124) 0:02:01.869 ****** 2025-10-09 21:05:49.804472 | controller | changed: [instance] 2025-10-09 21:05:50.054507 | controller | 2025-10-09 21:05:50.054546 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2025-10-09 21:05:50.054555 | controller | Thursday 09 October 2025 21:05:49 +0000 (0:00:00.276) 0:02:02.145 ****** 2025-10-09 21:05:50.054566 | controller | changed: [instance] 2025-10-09 21:05:50.406461 | controller | 2025-10-09 21:05:50.406519 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2025-10-09 21:05:50.406528 | controller | Thursday 09 October 2025 21:05:50 +0000 (0:00:00.250) 0:02:02.395 ****** 2025-10-09 21:05:50.406540 | controller | changed: [instance] 2025-10-09 21:05:50.438299 | controller | 2025-10-09 21:05:50.438321 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2025-10-09 21:05:50.438327 | controller | Thursday 09 October 2025 21:05:50 +0000 (0:00:00.351) 0:02:02.747 ****** 2025-10-09 21:05:50.438337 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-10-09 21:05:50.535651 | controller | 2025-10-09 21:05:50.535675 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-10-09 21:05:50.535685 | controller | Thursday 09 October 2025 21:05:50 +0000 (0:00:00.032) 0:02:02.779 ****** 2025-10-09 21:05:50.535697 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-10-09 21:05:50.536110 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-10-09 21:05:50.536130 | controller | 2025-10-09 21:05:50.791983 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-10-09 21:05:50.792007 | controller | Thursday 09 October 2025 21:05:50 +0000 (0:00:00.097) 0:02:02.876 ****** 2025-10-09 21:05:50.792017 | controller | ok: [instance] 2025-10-09 21:05:50.844327 | controller | 2025-10-09 21:05:50.844347 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-10-09 21:05:50.844354 | controller | Thursday 09 October 2025 21:05:50 +0000 (0:00:00.256) 0:02:03.133 ****** 2025-10-09 21:05:50.844363 | controller | ok: [instance] => (item=cifmw-public) 2025-10-09 21:05:51.097728 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-10-09 21:05:51.097791 | controller | 2025-10-09 21:05:51.097805 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-10-09 21:05:51.097815 | controller | Thursday 09 October 2025 21:05:50 +0000 (0:00:00.052) 0:02:03.185 ****** 2025-10-09 21:05:51.097831 | controller | ok: [instance] 2025-10-09 21:05:51.098202 | controller | 2025-10-09 21:05:51.317110 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-10-09 21:05:51.317128 | controller | Thursday 09 October 2025 21:05:51 +0000 (0:00:00.253) 0:02:03.438 ****** 2025-10-09 21:05:51.317138 | controller | ok: [instance] 2025-10-09 21:05:51.637247 | controller | 2025-10-09 21:05:51.637288 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2025-10-09 21:05:51.637298 | controller | Thursday 09 October 2025 21:05:51 +0000 (0:00:00.219) 0:02:03.658 ****** 2025-10-09 21:05:51.637318 | controller | changed: [instance] 2025-10-09 21:05:51.891007 | controller | 2025-10-09 21:05:51.891050 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-10-09 21:05:51.891059 | controller | Thursday 09 October 2025 21:05:51 +0000 (0:00:00.319) 0:02:03.978 ****** 2025-10-09 21:05:51.891071 | controller | ok: [instance] 2025-10-09 21:05:51.941411 | controller | 2025-10-09 21:05:51.941431 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-10-09 21:05:51.941438 | controller | Thursday 09 October 2025 21:05:51 +0000 (0:00:00.253) 0:02:04.231 ****** 2025-10-09 21:05:51.941452 | controller | ok: [instance] => (item=cifmw-public) 2025-10-09 21:05:52.200711 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-10-09 21:05:52.200777 | controller | 2025-10-09 21:05:52.200786 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-10-09 21:05:52.200793 | controller | Thursday 09 October 2025 21:05:51 +0000 (0:00:00.050) 0:02:04.282 ****** 2025-10-09 21:05:52.200808 | controller | ok: [instance] 2025-10-09 21:05:52.415703 | controller | 2025-10-09 21:05:52.415753 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-10-09 21:05:52.415763 | controller | Thursday 09 October 2025 21:05:52 +0000 (0:00:00.259) 0:02:04.541 ****** 2025-10-09 21:05:52.415775 | controller | ok: [instance] 2025-10-09 21:05:52.415807 | controller | 2025-10-09 21:05:52.415814 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2025-10-09 21:05:52.415822 | controller | Thursday 09 October 2025 21:05:52 +0000 (0:00:00.215) 0:02:04.756 ****** 2025-10-09 21:05:52.724765 | controller | changed: [instance] 2025-10-09 21:05:52.724930 | controller | 2025-10-09 21:05:52.724984 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2025-10-09 21:05:52.724999 | controller | Thursday 09 October 2025 21:05:52 +0000 (0:00:00.308) 0:02:05.065 ****** 2025-10-09 21:05:52.747357 | controller | skipping: [instance] 2025-10-09 21:05:52.778391 | controller | 2025-10-09 21:05:52.778418 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2025-10-09 21:05:52.778428 | controller | Thursday 09 October 2025 21:05:52 +0000 (0:00:00.022) 0:02:05.088 ****** 2025-10-09 21:05:52.778440 | controller | skipping: [instance] 2025-10-09 21:05:52.809770 | controller | 2025-10-09 21:05:52.809828 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2025-10-09 21:05:52.809842 | controller | Thursday 09 October 2025 21:05:52 +0000 (0:00:00.031) 0:02:05.119 ****** 2025-10-09 21:05:52.809857 | controller | skipping: [instance] 2025-10-09 21:05:52.809903 | controller | 2025-10-09 21:05:52.809914 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2025-10-09 21:05:52.809926 | controller | Thursday 09 October 2025 21:05:52 +0000 (0:00:00.031) 0:02:05.151 ****** 2025-10-09 21:05:52.838737 | controller | skipping: [instance] 2025-10-09 21:05:52.838828 | controller | 2025-10-09 21:05:52.838857 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-10-09 21:05:52.838869 | controller | Thursday 09 October 2025 21:05:52 +0000 (0:00:00.028) 0:02:05.179 ****** 2025-10-09 21:05:53.073522 | controller | changed: [instance] 2025-10-09 21:05:53.115208 | controller | 2025-10-09 21:05:53.115230 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-10-09 21:05:53.115241 | controller | Thursday 09 October 2025 21:05:53 +0000 (0:00:00.234) 0:02:05.414 ****** 2025-10-09 21:05:53.115252 | controller | ok: [instance] 2025-10-09 21:05:53.174546 | controller | 2025-10-09 21:05:53.174612 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-10-09 21:05:53.174634 | controller | Thursday 09 October 2025 21:05:53 +0000 (0:00:00.041) 0:02:05.455 ****** 2025-10-09 21:05:53.174649 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-10-09 21:05:53.386678 | controller | 2025-10-09 21:05:53.386696 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-10-09 21:05:53.386704 | controller | Thursday 09 October 2025 21:05:53 +0000 (0:00:00.059) 0:02:05.515 ****** 2025-10-09 21:05:53.386712 | controller | ok: [instance] 2025-10-09 21:05:53.454713 | controller | 2025-10-09 21:05:53.454761 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-10-09 21:05:53.454771 | controller | Thursday 09 October 2025 21:05:53 +0000 (0:00:00.212) 0:02:05.727 ****** 2025-10-09 21:05:53.454781 | controller | ok: [instance] 2025-10-09 21:05:53.507808 | controller | 2025-10-09 21:05:53.507868 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-10-09 21:05:53.507879 | controller | Thursday 09 October 2025 21:05:53 +0000 (0:00:00.067) 0:02:05.795 ****** 2025-10-09 21:05:53.507902 | controller | ok: [instance] 2025-10-09 21:05:53.508087 | controller | 2025-10-09 21:05:53.508122 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-10-09 21:05:53.563049 | controller | Thursday 09 October 2025 21:05:53 +0000 (0:00:00.053) 0:02:05.848 ****** 2025-10-09 21:05:53.563076 | controller | skipping: [instance] 2025-10-09 21:05:53.614515 | controller | 2025-10-09 21:05:53.614532 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-10-09 21:05:53.614540 | controller | Thursday 09 October 2025 21:05:53 +0000 (0:00:00.055) 0:02:05.904 ****** 2025-10-09 21:05:53.614548 | controller | skipping: [instance] 2025-10-09 21:05:53.685103 | controller | 2025-10-09 21:05:53.685124 | controller | TASK [Call the config_drive role] ********************************************** 2025-10-09 21:05:53.685133 | controller | Thursday 09 October 2025 21:05:53 +0000 (0:00:00.051) 0:02:05.955 ****** 2025-10-09 21:05:53.685144 | controller | 2025-10-09 21:05:54.133501 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-10-09 21:05:54.133562 | controller | Thursday 09 October 2025 21:05:53 +0000 (0:00:00.070) 0:02:06.026 ****** 2025-10-09 21:05:54.133594 | controller | ok: [instance] => (item=artifacts) 2025-10-09 21:05:55.349111 | controller | ok: [instance] => (item=logs) 2025-10-09 21:05:55.349164 | controller | 2025-10-09 21:05:55.349172 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-10-09 21:05:55.349178 | controller | Thursday 09 October 2025 21:05:54 +0000 (0:00:00.447) 0:02:06.474 ****** 2025-10-09 21:05:55.349191 | controller | ok: [instance] 2025-10-09 21:05:55.600271 | controller | 2025-10-09 21:05:55.600314 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-10-09 21:05:55.600322 | controller | Thursday 09 October 2025 21:05:55 +0000 (0:00:01.215) 0:02:07.689 ****** 2025-10-09 21:05:55.600335 | controller | changed: [instance] 2025-10-09 21:05:56.016450 | controller | 2025-10-09 21:05:56.016502 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-10-09 21:05:56.016511 | controller | Thursday 09 October 2025 21:05:55 +0000 (0:00:00.251) 0:02:07.941 ****** 2025-10-09 21:05:56.016523 | controller | changed: [instance] 2025-10-09 21:05:56.412367 | controller | 2025-10-09 21:05:56.412410 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-10-09 21:05:56.412419 | controller | Thursday 09 October 2025 21:05:56 +0000 (0:00:00.415) 0:02:08.357 ****** 2025-10-09 21:05:56.412432 | controller | changed: [instance] 2025-10-09 21:05:56.458784 | controller | 2025-10-09 21:05:56.458817 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-10-09 21:05:56.458830 | controller | Thursday 09 October 2025 21:05:56 +0000 (0:00:00.395) 0:02:08.753 ****** 2025-10-09 21:05:56.458845 | controller | skipping: [instance] 2025-10-09 21:05:56.459139 | controller | 2025-10-09 21:05:56.459170 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-10-09 21:05:56.673437 | controller | Thursday 09 October 2025 21:05:56 +0000 (0:00:00.046) 0:02:08.800 ****** 2025-10-09 21:05:56.673469 | controller | ok: [instance] 2025-10-09 21:05:56.721839 | controller | 2025-10-09 21:05:56.721909 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-10-09 21:05:56.721925 | controller | Thursday 09 October 2025 21:05:56 +0000 (0:00:00.214) 0:02:09.014 ****** 2025-10-09 21:05:56.721945 | controller | skipping: [instance] 2025-10-09 21:05:56.721957 | controller | 2025-10-09 21:05:56.721971 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-10-09 21:05:56.965439 | controller | Thursday 09 October 2025 21:05:56 +0000 (0:00:00.048) 0:02:09.063 ****** 2025-10-09 21:05:56.965482 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2025-10-09 21:05:57.273145 | controller | changed: [instance] 2025-10-09 21:05:57.273186 | controller | 2025-10-09 21:05:57.273194 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-10-09 21:05:57.273201 | controller | Thursday 09 October 2025 21:05:56 +0000 (0:00:00.242) 0:02:09.306 ****** 2025-10-09 21:05:57.273213 | controller | changed: [instance] 2025-10-09 21:05:57.326701 | controller | 2025-10-09 21:05:57.326730 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-10-09 21:05:57.326739 | controller | Thursday 09 October 2025 21:05:57 +0000 (0:00:00.307) 0:02:09.613 ****** 2025-10-09 21:05:57.326764 | controller | skipping: [instance] 2025-10-09 21:05:57.326795 | controller | 2025-10-09 21:05:57.326805 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2025-10-09 21:05:57.326915 | controller | Thursday 09 October 2025 21:05:57 +0000 (0:00:00.054) 0:02:09.668 ****** 2025-10-09 21:05:57.602702 | controller | changed: [instance] 2025-10-09 21:05:57.868329 | controller | 2025-10-09 21:05:57.868384 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2025-10-09 21:05:57.868394 | controller | Thursday 09 October 2025 21:05:57 +0000 (0:00:00.274) 0:02:09.942 ****** 2025-10-09 21:05:57.868406 | controller | changed: [instance] 2025-10-09 21:05:58.297311 | controller | 2025-10-09 21:05:58.297366 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2025-10-09 21:05:58.297375 | controller | Thursday 09 October 2025 21:05:57 +0000 (0:00:00.265) 0:02:10.208 ****** 2025-10-09 21:05:58.297388 | controller | changed: [instance] 2025-10-09 21:05:58.330766 | controller | 2025-10-09 21:05:58.330823 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2025-10-09 21:05:58.330833 | controller | Thursday 09 October 2025 21:05:58 +0000 (0:00:00.428) 0:02:10.637 ****** 2025-10-09 21:05:58.330847 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-10-09 21:05:58.330883 | controller | 2025-10-09 21:05:58.330892 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-10-09 21:05:58.331020 | controller | Thursday 09 October 2025 21:05:58 +0000 (0:00:00.034) 0:02:10.672 ****** 2025-10-09 21:05:58.377782 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-10-09 21:05:58.377866 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-10-09 21:05:58.378221 | controller | 2025-10-09 21:05:58.630720 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-10-09 21:05:58.630769 | controller | Thursday 09 October 2025 21:05:58 +0000 (0:00:00.047) 0:02:10.719 ****** 2025-10-09 21:05:58.630786 | controller | ok: [instance] 2025-10-09 21:05:58.630825 | controller | 2025-10-09 21:05:58.630836 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-10-09 21:05:58.630944 | controller | Thursday 09 October 2025 21:05:58 +0000 (0:00:00.252) 0:02:10.971 ****** 2025-10-09 21:05:58.682362 | controller | ok: [instance] => (item=cifmw-public) 2025-10-09 21:05:58.936771 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-10-09 21:05:58.936820 | controller | 2025-10-09 21:05:58.936830 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-10-09 21:05:58.936839 | controller | Thursday 09 October 2025 21:05:58 +0000 (0:00:00.051) 0:02:11.023 ****** 2025-10-09 21:05:58.936852 | controller | ok: [instance] 2025-10-09 21:05:59.152666 | controller | 2025-10-09 21:05:59.152720 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-10-09 21:05:59.152730 | controller | Thursday 09 October 2025 21:05:58 +0000 (0:00:00.254) 0:02:11.277 ****** 2025-10-09 21:05:59.152742 | controller | ok: [instance] 2025-10-09 21:05:59.468327 | controller | 2025-10-09 21:05:59.468365 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2025-10-09 21:05:59.468373 | controller | Thursday 09 October 2025 21:05:59 +0000 (0:00:00.215) 0:02:11.493 ****** 2025-10-09 21:05:59.468385 | controller | changed: [instance] 2025-10-09 21:05:59.728221 | controller | 2025-10-09 21:05:59.728273 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-10-09 21:05:59.728283 | controller | Thursday 09 October 2025 21:05:59 +0000 (0:00:00.316) 0:02:11.809 ****** 2025-10-09 21:05:59.728296 | controller | ok: [instance] 2025-10-09 21:05:59.779494 | controller | 2025-10-09 21:05:59.779550 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-10-09 21:05:59.779569 | controller | Thursday 09 October 2025 21:05:59 +0000 (0:00:00.259) 0:02:12.068 ****** 2025-10-09 21:05:59.779597 | controller | ok: [instance] => (item=cifmw-public) 2025-10-09 21:06:00.032407 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-10-09 21:06:00.032450 | controller | 2025-10-09 21:06:00.032458 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-10-09 21:06:00.032465 | controller | Thursday 09 October 2025 21:05:59 +0000 (0:00:00.051) 0:02:12.119 ****** 2025-10-09 21:06:00.032477 | controller | ok: [instance] 2025-10-09 21:06:00.262727 | controller | 2025-10-09 21:06:00.262787 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-10-09 21:06:00.262796 | controller | Thursday 09 October 2025 21:06:00 +0000 (0:00:00.253) 0:02:12.373 ****** 2025-10-09 21:06:00.262808 | controller | ok: [instance] 2025-10-09 21:06:00.262815 | controller | 2025-10-09 21:06:00.262820 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2025-10-09 21:06:00.262827 | controller | Thursday 09 October 2025 21:06:00 +0000 (0:00:00.230) 0:02:12.603 ****** 2025-10-09 21:06:00.570512 | controller | changed: [instance] 2025-10-09 21:06:00.600681 | controller | 2025-10-09 21:06:00.600721 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2025-10-09 21:06:00.600731 | controller | Thursday 09 October 2025 21:06:00 +0000 (0:00:00.307) 0:02:12.911 ****** 2025-10-09 21:06:00.600744 | controller | skipping: [instance] 2025-10-09 21:06:00.601173 | controller | 2025-10-09 21:06:00.634690 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2025-10-09 21:06:00.634718 | controller | Thursday 09 October 2025 21:06:00 +0000 (0:00:00.030) 0:02:12.942 ****** 2025-10-09 21:06:00.634740 | controller | skipping: [instance] 2025-10-09 21:06:00.672421 | controller | 2025-10-09 21:06:00.672438 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2025-10-09 21:06:00.672445 | controller | Thursday 09 October 2025 21:06:00 +0000 (0:00:00.033) 0:02:12.975 ****** 2025-10-09 21:06:00.672453 | controller | skipping: [instance] 2025-10-09 21:06:00.703400 | controller | 2025-10-09 21:06:00.703416 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2025-10-09 21:06:00.703423 | controller | Thursday 09 October 2025 21:06:00 +0000 (0:00:00.037) 0:02:13.013 ****** 2025-10-09 21:06:00.703431 | controller | skipping: [instance] 2025-10-09 21:06:00.945042 | controller | 2025-10-09 21:06:00.945075 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-10-09 21:06:00.945084 | controller | Thursday 09 October 2025 21:06:00 +0000 (0:00:00.031) 0:02:13.044 ****** 2025-10-09 21:06:00.945095 | controller | changed: [instance] 2025-10-09 21:06:00.992260 | controller | 2025-10-09 21:06:00.992285 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-10-09 21:06:00.992293 | controller | Thursday 09 October 2025 21:06:00 +0000 (0:00:00.241) 0:02:13.285 ****** 2025-10-09 21:06:00.992305 | controller | ok: [instance] 2025-10-09 21:06:01.051435 | controller | 2025-10-09 21:06:01.051458 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-10-09 21:06:01.051467 | controller | Thursday 09 October 2025 21:06:00 +0000 (0:00:00.047) 0:02:13.333 ****** 2025-10-09 21:06:01.051478 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-10-09 21:06:01.272673 | controller | 2025-10-09 21:06:01.272697 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-10-09 21:06:01.272706 | controller | Thursday 09 October 2025 21:06:01 +0000 (0:00:00.059) 0:02:13.392 ****** 2025-10-09 21:06:01.272716 | controller | ok: [instance] 2025-10-09 21:06:01.272788 | controller | 2025-10-09 21:06:01.272806 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-10-09 21:06:01.272817 | controller | Thursday 09 October 2025 21:06:01 +0000 (0:00:00.221) 0:02:13.614 ****** 2025-10-09 21:06:01.344295 | controller | ok: [instance] 2025-10-09 21:06:01.398660 | controller | 2025-10-09 21:06:01.398687 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-10-09 21:06:01.398703 | controller | Thursday 09 October 2025 21:06:01 +0000 (0:00:00.071) 0:02:13.685 ****** 2025-10-09 21:06:01.398714 | controller | ok: [instance] 2025-10-09 21:06:01.398900 | controller | 2025-10-09 21:06:01.398920 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-10-09 21:06:01.447524 | controller | Thursday 09 October 2025 21:06:01 +0000 (0:00:00.054) 0:02:13.740 ****** 2025-10-09 21:06:01.447548 | controller | skipping: [instance] 2025-10-09 21:06:01.493496 | controller | 2025-10-09 21:06:01.493522 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-10-09 21:06:01.493531 | controller | Thursday 09 October 2025 21:06:01 +0000 (0:00:00.048) 0:02:13.788 ****** 2025-10-09 21:06:01.493542 | controller | skipping: [instance] 2025-10-09 21:06:01.493735 | controller | 2025-10-09 21:06:01.493936 | controller | TASK [Call the config_drive role] ********************************************** 2025-10-09 21:06:01.494077 | controller | Thursday 09 October 2025 21:06:01 +0000 (0:00:00.046) 0:02:13.835 ****** 2025-10-09 21:06:01.555029 | controller | 2025-10-09 21:06:01.555215 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-10-09 21:06:01.555375 | controller | Thursday 09 October 2025 21:06:01 +0000 (0:00:00.061) 0:02:13.896 ****** 2025-10-09 21:06:01.975530 | controller | ok: [instance] => (item=artifacts) 2025-10-09 21:06:03.191508 | controller | ok: [instance] => (item=logs) 2025-10-09 21:06:03.191540 | controller | 2025-10-09 21:06:03.191547 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-10-09 21:06:03.191553 | controller | Thursday 09 October 2025 21:06:01 +0000 (0:00:00.419) 0:02:14.316 ****** 2025-10-09 21:06:03.191563 | controller | ok: [instance] 2025-10-09 21:06:03.418765 | controller | 2025-10-09 21:06:03.418809 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-10-09 21:06:03.418817 | controller | Thursday 09 October 2025 21:06:03 +0000 (0:00:01.216) 0:02:15.532 ****** 2025-10-09 21:06:03.418829 | controller | changed: [instance] 2025-10-09 21:06:03.418860 | controller | 2025-10-09 21:06:03.418868 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-10-09 21:06:03.418988 | controller | Thursday 09 October 2025 21:06:03 +0000 (0:00:00.227) 0:02:15.760 ****** 2025-10-09 21:06:03.829253 | controller | changed: [instance] 2025-10-09 21:06:04.243790 | controller | 2025-10-09 21:06:04.243842 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-10-09 21:06:04.243856 | controller | Thursday 09 October 2025 21:06:03 +0000 (0:00:00.409) 0:02:16.170 ****** 2025-10-09 21:06:04.243874 | controller | changed: [instance] 2025-10-09 21:06:04.294716 | controller | 2025-10-09 21:06:04.294773 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-10-09 21:06:04.294785 | controller | Thursday 09 October 2025 21:06:04 +0000 (0:00:00.414) 0:02:16.584 ****** 2025-10-09 21:06:04.294798 | controller | skipping: [instance] 2025-10-09 21:06:04.294835 | controller | 2025-10-09 21:06:04.294845 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-10-09 21:06:04.509509 | controller | Thursday 09 October 2025 21:06:04 +0000 (0:00:00.051) 0:02:16.636 ****** 2025-10-09 21:06:04.509550 | controller | ok: [instance] 2025-10-09 21:06:04.556690 | controller | 2025-10-09 21:06:04.556728 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-10-09 21:06:04.556738 | controller | Thursday 09 October 2025 21:06:04 +0000 (0:00:00.214) 0:02:16.850 ****** 2025-10-09 21:06:04.556761 | controller | skipping: [instance] 2025-10-09 21:06:04.556801 | controller | 2025-10-09 21:06:04.556812 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-10-09 21:06:04.805837 | controller | Thursday 09 October 2025 21:06:04 +0000 (0:00:00.047) 0:02:16.898 ****** 2025-10-09 21:06:04.805883 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2025-10-09 21:06:05.097529 | controller | changed: [instance] 2025-10-09 21:06:05.097569 | controller | 2025-10-09 21:06:05.097598 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-10-09 21:06:05.097612 | controller | Thursday 09 October 2025 21:06:04 +0000 (0:00:00.248) 0:02:17.146 ****** 2025-10-09 21:06:05.097631 | controller | changed: [instance] 2025-10-09 21:06:05.149292 | controller | 2025-10-09 21:06:05.149315 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-10-09 21:06:05.149325 | controller | Thursday 09 October 2025 21:06:05 +0000 (0:00:00.291) 0:02:17.438 ****** 2025-10-09 21:06:05.149336 | controller | skipping: [instance] 2025-10-09 21:06:05.417888 | controller | 2025-10-09 21:06:05.417954 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2025-10-09 21:06:05.417966 | controller | Thursday 09 October 2025 21:06:05 +0000 (0:00:00.052) 0:02:17.490 ****** 2025-10-09 21:06:05.417983 | controller | changed: [instance] 2025-10-09 21:06:05.655361 | controller | 2025-10-09 21:06:05.655412 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2025-10-09 21:06:05.655422 | controller | Thursday 09 October 2025 21:06:05 +0000 (0:00:00.268) 0:02:17.758 ****** 2025-10-09 21:06:05.655436 | controller | changed: [instance] 2025-10-09 21:06:06.011693 | controller | 2025-10-09 21:06:06.011734 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2025-10-09 21:06:06.011742 | controller | Thursday 09 October 2025 21:06:05 +0000 (0:00:00.237) 0:02:17.996 ****** 2025-10-09 21:06:06.011763 | controller | changed: [instance] 2025-10-09 21:06:06.011790 | controller | 2025-10-09 21:06:06.011799 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2025-10-09 21:06:06.011945 | controller | Thursday 09 October 2025 21:06:06 +0000 (0:00:00.356) 0:02:18.352 ****** 2025-10-09 21:06:06.042119 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-10-09 21:06:06.086696 | controller | 2025-10-09 21:06:06.086719 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-10-09 21:06:06.086728 | controller | Thursday 09 October 2025 21:06:06 +0000 (0:00:00.030) 0:02:18.383 ****** 2025-10-09 21:06:06.086739 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-10-09 21:06:06.086916 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-10-09 21:06:06.086931 | controller | 2025-10-09 21:06:06.086941 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-10-09 21:06:06.330971 | controller | Thursday 09 October 2025 21:06:06 +0000 (0:00:00.044) 0:02:18.427 ****** 2025-10-09 21:06:06.331001 | controller | ok: [instance] 2025-10-09 21:06:06.375702 | controller | 2025-10-09 21:06:06.375739 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-10-09 21:06:06.375749 | controller | Thursday 09 October 2025 21:06:06 +0000 (0:00:00.244) 0:02:18.672 ****** 2025-10-09 21:06:06.375772 | controller | ok: [instance] => (item=cifmw-public) 2025-10-09 21:06:06.625001 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-10-09 21:06:06.625039 | controller | 2025-10-09 21:06:06.625047 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-10-09 21:06:06.625053 | controller | Thursday 09 October 2025 21:06:06 +0000 (0:00:00.044) 0:02:18.717 ****** 2025-10-09 21:06:06.625069 | controller | ok: [instance] 2025-10-09 21:06:06.840981 | controller | 2025-10-09 21:06:06.841016 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-10-09 21:06:06.841026 | controller | Thursday 09 October 2025 21:06:06 +0000 (0:00:00.249) 0:02:18.966 ****** 2025-10-09 21:06:06.841040 | controller | ok: [instance] 2025-10-09 21:06:07.192533 | controller | 2025-10-09 21:06:07.192569 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2025-10-09 21:06:07.192594 | controller | Thursday 09 October 2025 21:06:06 +0000 (0:00:00.216) 0:02:19.182 ****** 2025-10-09 21:06:07.192609 | controller | changed: [instance] 2025-10-09 21:06:07.460179 | controller | 2025-10-09 21:06:07.460213 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-10-09 21:06:07.460221 | controller | Thursday 09 October 2025 21:06:07 +0000 (0:00:00.351) 0:02:19.533 ****** 2025-10-09 21:06:07.460236 | controller | ok: [instance] 2025-10-09 21:06:07.510460 | controller | 2025-10-09 21:06:07.510479 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-10-09 21:06:07.510486 | controller | Thursday 09 October 2025 21:06:07 +0000 (0:00:00.267) 0:02:19.801 ****** 2025-10-09 21:06:07.510495 | controller | ok: [instance] => (item=cifmw-public) 2025-10-09 21:06:07.755708 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-10-09 21:06:07.755742 | controller | 2025-10-09 21:06:07.755752 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-10-09 21:06:07.755769 | controller | Thursday 09 October 2025 21:06:07 +0000 (0:00:00.050) 0:02:19.851 ****** 2025-10-09 21:06:07.755781 | controller | ok: [instance] 2025-10-09 21:06:07.972212 | controller | 2025-10-09 21:06:07.972247 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-10-09 21:06:07.972256 | controller | Thursday 09 October 2025 21:06:07 +0000 (0:00:00.245) 0:02:20.096 ****** 2025-10-09 21:06:07.972267 | controller | ok: [instance] 2025-10-09 21:06:08.283699 | controller | 2025-10-09 21:06:08.283736 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2025-10-09 21:06:08.283746 | controller | Thursday 09 October 2025 21:06:07 +0000 (0:00:00.216) 0:02:20.313 ****** 2025-10-09 21:06:08.283769 | controller | changed: [instance] 2025-10-09 21:06:08.283800 | controller | 2025-10-09 21:06:08.283810 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2025-10-09 21:06:08.283835 | controller | Thursday 09 October 2025 21:06:08 +0000 (0:00:00.311) 0:02:20.624 ****** 2025-10-09 21:06:08.313262 | controller | skipping: [instance] 2025-10-09 21:06:08.347653 | controller | 2025-10-09 21:06:08.347680 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2025-10-09 21:06:08.347690 | controller | Thursday 09 October 2025 21:06:08 +0000 (0:00:00.029) 0:02:20.654 ****** 2025-10-09 21:06:08.347701 | controller | skipping: [instance] 2025-10-09 21:06:08.379220 | controller | 2025-10-09 21:06:08.379241 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2025-10-09 21:06:08.379249 | controller | Thursday 09 October 2025 21:06:08 +0000 (0:00:00.034) 0:02:20.688 ****** 2025-10-09 21:06:08.379258 | controller | skipping: [instance] 2025-10-09 21:06:08.406860 | controller | 2025-10-09 21:06:08.406930 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2025-10-09 21:06:08.406944 | controller | Thursday 09 October 2025 21:06:08 +0000 (0:00:00.031) 0:02:20.720 ****** 2025-10-09 21:06:08.406964 | controller | skipping: [instance] 2025-10-09 21:06:08.631561 | controller | 2025-10-09 21:06:08.631620 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-10-09 21:06:08.631629 | controller | Thursday 09 October 2025 21:06:08 +0000 (0:00:00.027) 0:02:20.748 ****** 2025-10-09 21:06:08.631640 | controller | changed: [instance] 2025-10-09 21:06:08.672688 | controller | 2025-10-09 21:06:08.672717 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-10-09 21:06:08.672727 | controller | Thursday 09 October 2025 21:06:08 +0000 (0:00:00.224) 0:02:20.972 ****** 2025-10-09 21:06:08.672739 | controller | ok: [instance] 2025-10-09 21:06:08.672967 | controller | 2025-10-09 21:06:08.672990 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-10-09 21:06:08.708538 | controller | Thursday 09 October 2025 21:06:08 +0000 (0:00:00.041) 0:02:21.014 ****** 2025-10-09 21:06:08.708560 | controller | skipping: [instance] 2025-10-09 21:06:08.741235 | controller | 2025-10-09 21:06:08.741257 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-10-09 21:06:08.741266 | controller | Thursday 09 October 2025 21:06:08 +0000 (0:00:00.035) 0:02:21.049 ****** 2025-10-09 21:06:08.741277 | controller | skipping: [instance] 2025-10-09 21:06:08.796719 | controller | 2025-10-09 21:06:08.796742 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-10-09 21:06:08.796767 | controller | Thursday 09 October 2025 21:06:08 +0000 (0:00:00.032) 0:02:21.082 ****** 2025-10-09 21:06:08.796779 | controller | skipping: [instance] 2025-10-09 21:06:08.796810 | controller | 2025-10-09 21:06:08.796820 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2025-10-09 21:06:08.796911 | controller | Thursday 09 October 2025 21:06:08 +0000 (0:00:00.055) 0:02:21.137 ****** 2025-10-09 21:06:08.862162 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2025-10-09 21:06:09.116715 | controller | 2025-10-09 21:06:09.116752 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2025-10-09 21:06:09.116771 | controller | Thursday 09 October 2025 21:06:08 +0000 (0:00:00.065) 0:02:21.203 ****** 2025-10-09 21:06:09.116784 | controller | ok: [instance] => (item=crc) 2025-10-09 21:06:09.116814 | controller | 2025-10-09 21:06:09.116824 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2025-10-09 21:06:09.116888 | controller | Thursday 09 October 2025 21:06:09 +0000 (0:00:00.254) 0:02:21.458 ****** 2025-10-09 21:06:11.193497 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-10-09 21:06:12.144379 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-10-09 21:06:12.144415 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-10-09 21:06:12.144423 | controller | 2025-10-09 21:06:12.144429 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-10-09 21:06:12.144435 | controller | Thursday 09 October 2025 21:06:11 +0000 (0:00:02.075) 0:02:23.533 ****** 2025-10-09 21:06:12.144446 | controller | changed: [instance] 2025-10-09 21:06:13.055267 | controller | 2025-10-09 21:06:13.055306 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-10-09 21:06:13.055314 | controller | Thursday 09 October 2025 21:06:12 +0000 (0:00:00.951) 0:02:24.485 ****** 2025-10-09 21:06:13.055325 | controller | changed: [instance] 2025-10-09 21:06:13.983347 | controller | 2025-10-09 21:06:13.983416 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-10-09 21:06:13.983425 | controller | Thursday 09 October 2025 21:06:13 +0000 (0:00:00.910) 0:02:25.396 ****** 2025-10-09 21:06:13.983439 | controller | changed: [instance] 2025-10-09 21:06:14.774915 | controller | 2025-10-09 21:06:14.774973 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2025-10-09 21:06:14.774982 | controller | Thursday 09 October 2025 21:06:13 +0000 (0:00:00.925) 0:02:26.322 ****** 2025-10-09 21:06:14.774995 | controller | changed: [instance] => (item=compute-0.utility) 2025-10-09 21:06:34.764007 | controller | changed: [instance] => (item=controller-0.utility) 2025-10-09 21:06:34.764066 | controller | changed: [instance] => (item=crc-0.utility) 2025-10-09 21:06:34.764075 | controller | 2025-10-09 21:06:34.764082 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2025-10-09 21:06:34.764089 | controller | Thursday 09 October 2025 21:06:14 +0000 (0:00:00.793) 0:02:27.115 ****** 2025-10-09 21:06:34.764102 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-10-09 21:06:34.764280 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2025-10-09 21:06:34.764427 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2025-10-09 21:06:34.764588 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2025-10-09 21:06:34.764763 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2025-10-09 21:06:34.764931 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2025-10-09 21:06:34.765106 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j429523261126.23994', 'results_file': '/home/zuul/.ansible_async/j429523261126.23994', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2025-10-09 21:06:34.765276 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j139429523359.24011', 'results_file': '/home/zuul/.ansible_async/j139429523359.24011', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2025-10-09 21:06:34.765441 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j181972631963.24027', 'results_file': '/home/zuul/.ansible_async/j181972631963.24027', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2025-10-09 21:06:34.765607 | controller | 2025-10-09 21:06:34.765778 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2025-10-09 21:06:34.765934 | controller | Thursday 09 October 2025 21:06:34 +0000 (0:00:19.985) 0:02:47.101 ****** 2025-10-09 21:06:34.896198 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-10-09 21:06:34.896377 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-10-09 21:06:34.896527 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-10-09 21:06:34.896716 | controller | 2025-10-09 21:06:34.896877 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-10-09 21:06:34.897013 | controller | Thursday 09 October 2025 21:06:34 +0000 (0:00:00.136) 0:02:47.237 ****** 2025-10-09 21:06:34.924766 | controller | skipping: [instance] 2025-10-09 21:06:34.924918 | controller | 2025-10-09 21:06:34.925061 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2025-10-09 21:06:34.925200 | controller | Thursday 09 October 2025 21:06:34 +0000 (0:00:00.029) 0:02:47.266 ****** 2025-10-09 21:06:34.970291 | controller | 2025-10-09 21:06:35.064905 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-10-09 21:06:35.064955 | controller | Thursday 09 October 2025 21:06:34 +0000 (0:00:00.045) 0:02:47.311 ****** 2025-10-09 21:06:35.064977 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-10-09 21:06:35.307657 | controller | 2025-10-09 21:06:35.307704 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-10-09 21:06:35.307713 | controller | Thursday 09 October 2025 21:06:35 +0000 (0:00:00.093) 0:02:47.405 ****** 2025-10-09 21:06:35.307724 | controller | changed: [instance] 2025-10-09 21:06:35.553783 | controller | 2025-10-09 21:06:35.553834 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-10-09 21:06:35.553844 | controller | Thursday 09 October 2025 21:06:35 +0000 (0:00:00.243) 0:02:47.648 ****** 2025-10-09 21:06:35.553861 | controller | changed: [instance] 2025-10-09 21:06:35.962271 | controller | 2025-10-09 21:06:35.962360 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2025-10-09 21:06:35.962372 | controller | Thursday 09 October 2025 21:06:35 +0000 (0:00:00.245) 0:02:47.894 ****** 2025-10-09 21:06:35.962423 | controller | changed: [instance] 2025-10-09 21:06:35.962519 | controller | 2025-10-09 21:06:35.962563 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2025-10-09 21:06:35.962594 | controller | Thursday 09 October 2025 21:06:35 +0000 (0:00:00.408) 0:02:48.303 ****** 2025-10-09 21:06:35.999702 | controller | skipping: [instance] 2025-10-09 21:06:35.999763 | controller | 2025-10-09 21:06:35.999774 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-10-09 21:06:35.999960 | controller | Thursday 09 October 2025 21:06:35 +0000 (0:00:00.037) 0:02:48.340 ****** 2025-10-09 21:06:36.037387 | controller | skipping: [instance] 2025-10-09 21:06:36.037606 | controller | 2025-10-09 21:06:36.037721 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2025-10-09 21:06:36.037749 | controller | Thursday 09 October 2025 21:06:36 +0000 (0:00:00.037) 0:02:48.378 ****** 2025-10-09 21:06:36.094424 | controller | skipping: [instance] 2025-10-09 21:06:36.145726 | controller | 2025-10-09 21:06:36.145756 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2025-10-09 21:06:36.145764 | controller | Thursday 09 October 2025 21:06:36 +0000 (0:00:00.056) 0:02:48.435 ****** 2025-10-09 21:06:36.145775 | controller | skipping: [instance] 2025-10-09 21:06:36.175001 | controller | 2025-10-09 21:06:36.175020 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-10-09 21:06:36.175028 | controller | Thursday 09 October 2025 21:06:36 +0000 (0:00:00.051) 0:02:48.486 ****** 2025-10-09 21:06:36.175037 | controller | skipping: [instance] 2025-10-09 21:06:36.213510 | controller | 2025-10-09 21:06:36.213564 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2025-10-09 21:06:36.213594 | controller | Thursday 09 October 2025 21:06:36 +0000 (0:00:00.029) 0:02:48.516 ****** 2025-10-09 21:06:36.213610 | controller | 2025-10-09 21:06:36.213630 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-10-09 21:06:36.213637 | controller | Thursday 09 October 2025 21:06:36 +0000 (0:00:00.038) 0:02:48.555 ****** 2025-10-09 21:06:36.293898 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-10-09 21:06:36.293963 | controller | 2025-10-09 21:06:36.294059 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-10-09 21:06:36.294164 | controller | Thursday 09 October 2025 21:06:36 +0000 (0:00:00.080) 0:02:48.635 ****** 2025-10-09 21:06:36.608423 | controller | ok: [instance] 2025-10-09 21:06:36.608520 | controller | 2025-10-09 21:06:36.608670 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-10-09 21:06:36.608766 | controller | Thursday 09 October 2025 21:06:36 +0000 (0:00:00.314) 0:02:48.949 ****** 2025-10-09 21:06:36.824656 | controller | ok: [instance] 2025-10-09 21:06:37.235422 | controller | 2025-10-09 21:06:37.235476 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2025-10-09 21:06:37.235485 | controller | Thursday 09 October 2025 21:06:36 +0000 (0:00:00.212) 0:02:49.162 ****** 2025-10-09 21:06:37.235496 | controller | changed: [instance] 2025-10-09 21:06:37.235516 | controller | 2025-10-09 21:06:37.235569 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2025-10-09 21:06:37.235689 | controller | Thursday 09 October 2025 21:06:37 +0000 (0:00:00.414) 0:02:49.576 ****** 2025-10-09 21:06:37.269199 | controller | skipping: [instance] 2025-10-09 21:06:37.269280 | controller | 2025-10-09 21:06:37.269378 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-10-09 21:06:37.269483 | controller | Thursday 09 October 2025 21:06:37 +0000 (0:00:00.034) 0:02:49.610 ****** 2025-10-09 21:06:37.303199 | controller | skipping: [instance] 2025-10-09 21:06:37.303283 | controller | 2025-10-09 21:06:37.303378 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2025-10-09 21:06:37.303483 | controller | Thursday 09 October 2025 21:06:37 +0000 (0:00:00.034) 0:02:49.644 ****** 2025-10-09 21:06:38.889538 | controller | changed: [instance -> controller-0.instance] 2025-10-09 21:06:38.889655 | controller | 2025-10-09 21:06:38.889727 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2025-10-09 21:06:38.889940 | controller | Thursday 09 October 2025 21:06:38 +0000 (0:00:01.585) 0:02:51.230 ****** 2025-10-09 21:06:40.074798 | controller | changed: [instance -> controller-0.instance] 2025-10-09 21:06:40.075111 | controller | 2025-10-09 21:06:40.117023 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-10-09 21:06:40.117074 | controller | Thursday 09 October 2025 21:06:40 +0000 (0:00:01.185) 0:02:52.415 ****** 2025-10-09 21:06:40.117088 | controller | 2025-10-09 21:06:40.348297 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-10-09 21:06:40.348344 | controller | Thursday 09 October 2025 21:06:40 +0000 (0:00:00.042) 0:02:52.458 ****** 2025-10-09 21:06:40.348358 | controller | ok: [instance] 2025-10-09 21:06:40.348392 | controller | 2025-10-09 21:06:40.348402 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-10-09 21:06:40.376751 | controller | Thursday 09 October 2025 21:06:40 +0000 (0:00:00.230) 0:02:52.689 ****** 2025-10-09 21:06:40.376775 | controller | ok: [instance] 2025-10-09 21:06:40.376846 | controller | 2025-10-09 21:06:40.376948 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-10-09 21:06:40.377137 | controller | Thursday 09 October 2025 21:06:40 +0000 (0:00:00.028) 0:02:52.718 ****** 2025-10-09 21:06:40.418400 | controller | skipping: [instance] 2025-10-09 21:06:40.472524 | controller | 2025-10-09 21:06:40.472543 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2025-10-09 21:06:40.472551 | controller | Thursday 09 October 2025 21:06:40 +0000 (0:00:00.041) 0:02:52.759 ****** 2025-10-09 21:06:40.472560 | controller | 2025-10-09 21:06:40.567505 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-10-09 21:06:40.567524 | controller | Thursday 09 October 2025 21:06:40 +0000 (0:00:00.053) 0:02:52.813 ****** 2025-10-09 21:06:40.567535 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2025-10-09 21:06:40.806223 | controller | 2025-10-09 21:06:40.806254 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-10-09 21:06:40.806262 | controller | Thursday 09 October 2025 21:06:40 +0000 (0:00:00.094) 0:02:52.908 ****** 2025-10-09 21:06:40.806272 | controller | ok: [instance] 2025-10-09 21:06:41.046169 | controller | 2025-10-09 21:06:41.046225 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-10-09 21:06:41.046233 | controller | Thursday 09 October 2025 21:06:40 +0000 (0:00:00.238) 0:02:53.146 ****** 2025-10-09 21:06:41.046250 | controller | ok: [instance] 2025-10-09 21:06:41.444781 | controller | 2025-10-09 21:06:41.444857 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2025-10-09 21:06:41.444867 | controller | Thursday 09 October 2025 21:06:41 +0000 (0:00:00.240) 0:02:53.387 ****** 2025-10-09 21:06:41.444887 | controller | changed: [instance] 2025-10-09 21:06:42.240463 | controller | 2025-10-09 21:06:42.240520 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2025-10-09 21:06:42.240529 | controller | Thursday 09 October 2025 21:06:41 +0000 (0:00:00.398) 0:02:53.785 ****** 2025-10-09 21:06:42.240541 | controller | changed: [instance] 2025-10-09 21:06:42.279312 | controller | 2025-10-09 21:06:42.279334 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-10-09 21:06:42.279341 | controller | Thursday 09 October 2025 21:06:42 +0000 (0:00:00.795) 0:02:54.580 ****** 2025-10-09 21:06:42.279351 | controller | skipping: [instance] 2025-10-09 21:06:42.335278 | controller | 2025-10-09 21:06:42.335308 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2025-10-09 21:06:42.335315 | controller | Thursday 09 October 2025 21:06:42 +0000 (0:00:00.039) 0:02:54.620 ****** 2025-10-09 21:06:42.335325 | controller | skipping: [instance] 2025-10-09 21:06:42.386331 | controller | 2025-10-09 21:06:42.386377 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2025-10-09 21:06:42.386386 | controller | Thursday 09 October 2025 21:06:42 +0000 (0:00:00.056) 0:02:54.676 ****** 2025-10-09 21:06:42.386405 | controller | skipping: [instance] 2025-10-09 21:06:42.439294 | controller | 2025-10-09 21:06:42.439338 | controller | TASK [Create VBMC entity] ****************************************************** 2025-10-09 21:06:42.439346 | controller | Thursday 09 October 2025 21:06:42 +0000 (0:00:00.050) 0:02:54.726 ****** 2025-10-09 21:06:42.439358 | controller | skipping: [instance] => (item=compute-0) 2025-10-09 21:06:42.439515 | controller | skipping: [instance] => (item=controller-0) 2025-10-09 21:06:42.439715 | controller | skipping: [instance] => (item=crc-0) 2025-10-09 21:06:42.439859 | controller | skipping: [instance] 2025-10-09 21:06:42.439988 | controller | 2025-10-09 21:06:42.440126 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2025-10-09 21:06:42.440259 | controller | Thursday 09 October 2025 21:06:42 +0000 (0:00:00.053) 0:02:54.780 ****** 2025-10-09 21:06:42.699080 | controller | ok: [instance] 2025-10-09 21:06:43.128529 | controller | 2025-10-09 21:06:43.128569 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2025-10-09 21:06:43.128594 | controller | Thursday 09 October 2025 21:06:42 +0000 (0:00:00.259) 0:02:55.040 ****** 2025-10-09 21:06:43.128616 | controller | changed: [instance] 2025-10-09 21:06:43.168857 | controller | 2025-10-09 21:06:43.168937 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2025-10-09 21:06:43.168946 | controller | Thursday 09 October 2025 21:06:43 +0000 (0:00:00.429) 0:02:55.469 ****** 2025-10-09 21:06:43.168967 | controller | skipping: [instance] 2025-10-09 21:06:43.212767 | controller | 2025-10-09 21:06:43.212805 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2025-10-09 21:06:43.212818 | controller | Thursday 09 October 2025 21:06:43 +0000 (0:00:00.040) 0:02:55.509 ****** 2025-10-09 21:06:43.212835 | controller | skipping: [instance] 2025-10-09 21:06:43.253290 | controller | 2025-10-09 21:06:43.253335 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2025-10-09 21:06:43.253345 | controller | Thursday 09 October 2025 21:06:43 +0000 (0:00:00.044) 0:02:55.553 ****** 2025-10-09 21:06:43.253358 | controller | skipping: [instance] 2025-10-09 21:06:43.953448 | controller | 2025-10-09 21:06:43.953491 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2025-10-09 21:06:43.953500 | controller | Thursday 09 October 2025 21:06:43 +0000 (0:00:00.040) 0:02:55.594 ****** 2025-10-09 21:06:43.953511 | controller | changed: [instance] 2025-10-09 21:06:44.657724 | controller | 2025-10-09 21:06:44.657766 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2025-10-09 21:06:44.657775 | controller | Thursday 09 October 2025 21:06:43 +0000 (0:00:00.699) 0:02:56.294 ****** 2025-10-09 21:06:44.657788 | controller | changed: [instance] 2025-10-09 21:06:44.710012 | controller | 2025-10-09 21:06:44.710060 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2025-10-09 21:06:44.710069 | controller | Thursday 09 October 2025 21:06:44 +0000 (0:00:00.704) 0:02:56.998 ****** 2025-10-09 21:06:44.710082 | controller | skipping: [instance] 2025-10-09 21:06:44.710262 | controller | 2025-10-09 21:06:44.710298 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2025-10-09 21:06:44.783509 | controller | Thursday 09 October 2025 21:06:44 +0000 (0:00:00.052) 0:02:57.051 ****** 2025-10-09 21:06:44.783560 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2025-10-09 21:06:44.837606 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2025-10-09 21:06:44.837641 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2025-10-09 21:06:44.837650 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2025-10-09 21:06:44.837658 | controller | 2025-10-09 21:06:44.837666 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2025-10-09 21:06:44.837680 | controller | Thursday 09 October 2025 21:06:44 +0000 (0:00:00.073) 0:02:57.124 ****** 2025-10-09 21:06:44.837694 | controller | skipping: [instance] 2025-10-09 21:06:44.837737 | controller | 2025-10-09 21:06:44.837759 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2025-10-09 21:06:44.837865 | controller | Thursday 09 October 2025 21:06:44 +0000 (0:00:00.054) 0:02:57.178 ****** 2025-10-09 21:06:44.885452 | controller | skipping: [instance] 2025-10-09 21:06:44.930347 | controller | 2025-10-09 21:06:44.930377 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2025-10-09 21:06:44.930385 | controller | Thursday 09 October 2025 21:06:44 +0000 (0:00:00.047) 0:02:57.226 ****** 2025-10-09 21:06:44.930396 | controller | skipping: [instance] 2025-10-09 21:06:44.930428 | controller | 2025-10-09 21:06:44.930671 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2025-10-09 21:06:44.976426 | controller | Thursday 09 October 2025 21:06:44 +0000 (0:00:00.044) 0:02:57.271 ****** 2025-10-09 21:06:44.976448 | controller | skipping: [instance] 2025-10-09 21:06:44.976565 | controller | 2025-10-09 21:06:44.976645 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2025-10-09 21:06:45.673390 | controller | Thursday 09 October 2025 21:06:44 +0000 (0:00:00.046) 0:02:57.317 ****** 2025-10-09 21:06:45.673470 | controller | changed: [instance] 2025-10-09 21:06:45.716515 | controller | 2025-10-09 21:06:45.716542 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2025-10-09 21:06:45.716550 | controller | Thursday 09 October 2025 21:06:45 +0000 (0:00:00.696) 0:02:58.014 ****** 2025-10-09 21:06:45.716561 | controller | skipping: [instance] 2025-10-09 21:06:45.755613 | controller | 2025-10-09 21:06:45.755659 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2025-10-09 21:06:45.755668 | controller | Thursday 09 October 2025 21:06:45 +0000 (0:00:00.043) 0:02:58.057 ****** 2025-10-09 21:06:45.755680 | controller | skipping: [instance] 2025-10-09 21:06:45.755710 | controller | 2025-10-09 21:06:45.755852 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2025-10-09 21:06:45.755879 | controller | Thursday 09 October 2025 21:06:45 +0000 (0:00:00.039) 0:02:58.097 ****** 2025-10-09 21:06:45.799442 | controller | skipping: [instance] 2025-10-09 21:06:45.842432 | controller | 2025-10-09 21:06:45.842489 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-10-09 21:06:45.842498 | controller | Thursday 09 October 2025 21:06:45 +0000 (0:00:00.043) 0:02:58.140 ****** 2025-10-09 21:06:45.842511 | controller | skipping: [instance] 2025-10-09 21:06:45.842533 | controller | 2025-10-09 21:06:45.842690 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-10-09 21:06:45.842711 | controller | Thursday 09 October 2025 21:06:45 +0000 (0:00:00.043) 0:02:58.183 ****** 2025-10-09 21:06:45.881444 | controller | skipping: [instance] 2025-10-09 21:06:45.881516 | controller | 2025-10-09 21:06:45.881563 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-10-09 21:06:45.881768 | controller | Thursday 09 October 2025 21:06:45 +0000 (0:00:00.039) 0:02:58.222 ****** 2025-10-09 21:06:45.918427 | controller | skipping: [instance] 2025-10-09 21:06:45.953755 | controller | 2025-10-09 21:06:45.953789 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-10-09 21:06:45.953800 | controller | Thursday 09 October 2025 21:06:45 +0000 (0:00:00.036) 0:02:58.259 ****** 2025-10-09 21:06:45.953813 | controller | skipping: [instance] 2025-10-09 21:06:45.954006 | controller | 2025-10-09 21:06:45.954180 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-10-09 21:06:45.954347 | controller | Thursday 09 October 2025 21:06:45 +0000 (0:00:00.035) 0:02:58.295 ****** 2025-10-09 21:06:45.987983 | controller | skipping: [instance] 2025-10-09 21:06:45.988139 | controller | 2025-10-09 21:06:45.988315 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-10-09 21:06:45.988471 | controller | Thursday 09 October 2025 21:06:45 +0000 (0:00:00.034) 0:02:58.329 ****** 2025-10-09 21:06:46.026658 | controller | skipping: [instance] 2025-10-09 21:06:46.026814 | controller | 2025-10-09 21:06:46.027867 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-10-09 21:06:46.028033 | controller | Thursday 09 October 2025 21:06:46 +0000 (0:00:00.038) 0:02:58.368 ****** 2025-10-09 21:06:46.080384 | controller | skipping: [instance] 2025-10-09 21:06:46.080534 | controller | 2025-10-09 21:06:46.080604 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2025-10-09 21:06:46.119912 | controller | Thursday 09 October 2025 21:06:46 +0000 (0:00:00.052) 0:02:58.420 ****** 2025-10-09 21:06:46.119990 | controller | skipping: [instance] 2025-10-09 21:06:46.348731 | controller | 2025-10-09 21:06:46.348843 | controller | TASK [reproducer : Configure Controller node] ********************************** 2025-10-09 21:06:46.348855 | controller | Thursday 09 October 2025 21:06:46 +0000 (0:00:00.040) 0:02:58.461 ****** 2025-10-09 21:06:46.348881 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2025-10-09 21:06:46.393860 | controller | 2025-10-09 21:06:46.393922 | controller | TASK [reproducer : Set facts related to the reproducer] ************************ 2025-10-09 21:06:46.393931 | controller | Thursday 09 October 2025 21:06:46 +0000 (0:00:00.228) 0:02:58.689 ****** 2025-10-09 21:06:46.393943 | controller | ok: [instance] 2025-10-09 21:06:47.975492 | controller | 2025-10-09 21:06:47.975549 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-10-09 21:06:47.975559 | controller | Thursday 09 October 2025 21:06:46 +0000 (0:00:00.044) 0:02:58.734 ****** 2025-10-09 21:06:47.975596 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-10-09 21:06:47.975622 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-10-09 21:06:47.975631 | controller | 2025-10-09 21:06:47.975687 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-10-09 21:06:47.975708 | controller | Thursday 09 October 2025 21:06:47 +0000 (0:00:01.581) 0:03:00.315 ****** 2025-10-09 21:06:48.004073 | controller | skipping: [instance] 2025-10-09 21:06:48.796330 | controller | 2025-10-09 21:06:48.796411 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-10-09 21:06:48.796420 | controller | Thursday 09 October 2025 21:06:48 +0000 (0:00:00.029) 0:03:00.345 ****** 2025-10-09 21:06:48.796436 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:06:48.796457 | controller | 2025-10-09 21:06:48.796465 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-10-09 21:06:48.837780 | controller | Thursday 09 October 2025 21:06:48 +0000 (0:00:00.790) 0:03:01.135 ****** 2025-10-09 21:06:48.837859 | controller | skipping: [instance] 2025-10-09 21:06:48.837908 | controller | 2025-10-09 21:06:48.837922 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-10-09 21:06:48.838110 | controller | Thursday 09 October 2025 21:06:48 +0000 (0:00:00.043) 0:03:01.179 ****** 2025-10-09 21:06:48.883740 | controller | skipping: [instance] 2025-10-09 21:06:48.883779 | controller | 2025-10-09 21:06:48.883790 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-10-09 21:06:48.883803 | controller | Thursday 09 October 2025 21:06:48 +0000 (0:00:00.046) 0:03:01.225 ****** 2025-10-09 21:06:48.925836 | controller | skipping: [instance] 2025-10-09 21:06:50.580841 | controller | 2025-10-09 21:06:50.580912 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-10-09 21:06:50.580929 | controller | Thursday 09 October 2025 21:06:48 +0000 (0:00:00.041) 0:03:01.266 ****** 2025-10-09 21:06:50.580944 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:06:50.627793 | controller | 2025-10-09 21:06:50.627867 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2025-10-09 21:06:50.627879 | controller | Thursday 09 October 2025 21:06:50 +0000 (0:00:01.652) 0:03:02.919 ****** 2025-10-09 21:06:50.627895 | controller | skipping: [instance] 2025-10-09 21:06:50.668420 | controller | 2025-10-09 21:06:50.668454 | controller | TASK [reproducer : Install repos] ********************************************** 2025-10-09 21:06:50.668462 | controller | Thursday 09 October 2025 21:06:50 +0000 (0:00:00.049) 0:03:02.968 ****** 2025-10-09 21:06:50.668478 | controller | skipping: [instance] 2025-10-09 21:06:50.715099 | controller | 2025-10-09 21:06:50.715117 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2025-10-09 21:06:50.715124 | controller | Thursday 09 October 2025 21:06:50 +0000 (0:00:00.040) 0:03:03.009 ****** 2025-10-09 21:06:50.715132 | controller | skipping: [instance] 2025-10-09 21:06:50.762288 | controller | 2025-10-09 21:06:50.762305 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2025-10-09 21:06:50.762311 | controller | Thursday 09 October 2025 21:06:50 +0000 (0:00:00.045) 0:03:03.054 ****** 2025-10-09 21:06:50.762319 | controller | skipping: [instance] 2025-10-09 21:06:52.036053 | controller | 2025-10-09 21:06:52.036110 | controller | TASK [reproducer : Install some tools] ***************************************** 2025-10-09 21:06:52.036119 | controller | Thursday 09 October 2025 21:06:50 +0000 (0:00:00.047) 0:03:03.102 ****** 2025-10-09 21:06:52.036133 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:06:53.227629 | controller | 2025-10-09 21:06:53.227689 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2025-10-09 21:06:53.227699 | controller | Thursday 09 October 2025 21:06:52 +0000 (0:00:01.273) 0:03:04.376 ****** 2025-10-09 21:06:53.227720 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:06:53.227740 | controller | 2025-10-09 21:06:53.227748 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2025-10-09 21:06:53.227837 | controller | Thursday 09 October 2025 21:06:53 +0000 (0:00:01.191) 0:03:05.568 ****** 2025-10-09 21:06:53.964740 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:06:53.964817 | controller | 2025-10-09 21:06:53.964827 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2025-10-09 21:06:53.964878 | controller | Thursday 09 October 2025 21:06:53 +0000 (0:00:00.737) 0:03:06.305 ****** 2025-10-09 21:06:55.042929 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:06:55.043014 | controller | 2025-10-09 21:06:55.043142 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2025-10-09 21:06:55.043259 | controller | Thursday 09 October 2025 21:06:55 +0000 (0:00:01.078) 0:03:07.383 ****** 2025-10-09 21:06:56.264764 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-10-09 21:06:56.264817 | controller | skipping: [instance] => (item=compute-0) 2025-10-09 21:06:56.264827 | controller | skipping: [instance] => (item=controller-0) 2025-10-09 21:06:56.264834 | controller | skipping: [instance] => (item=crc-0) 2025-10-09 21:06:56.264842 | controller | 2025-10-09 21:06:56.264849 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2025-10-09 21:06:56.264858 | controller | Thursday 09 October 2025 21:06:56 +0000 (0:00:01.221) 0:03:08.604 ****** 2025-10-09 21:06:57.054734 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-10-09 21:06:58.977301 | controller | skipping: [instance] => (item=compute-0) 2025-10-09 21:06:58.977362 | controller | skipping: [instance] => (item=controller-0) 2025-10-09 21:06:58.977370 | controller | skipping: [instance] => (item=crc-0) 2025-10-09 21:06:58.977377 | controller | 2025-10-09 21:06:58.977383 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2025-10-09 21:06:58.977389 | controller | Thursday 09 October 2025 21:06:57 +0000 (0:00:00.789) 0:03:09.394 ****** 2025-10-09 21:06:58.977401 | controller | skipping: [instance] => (item=instance) 2025-10-09 21:06:59.588008 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2025-10-09 21:06:59.588068 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-10-09 21:06:59.588075 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2025-10-09 21:06:59.588081 | controller | 2025-10-09 21:06:59.588087 | controller | TASK [reproducer : Create kube directory] ************************************** 2025-10-09 21:06:59.588092 | controller | Thursday 09 October 2025 21:06:58 +0000 (0:00:01.922) 0:03:11.317 ****** 2025-10-09 21:06:59.588104 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:07:00.599890 | controller | 2025-10-09 21:07:00.599940 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2025-10-09 21:07:00.599949 | controller | Thursday 09 October 2025 21:06:59 +0000 (0:00:00.610) 0:03:11.928 ****** 2025-10-09 21:07:00.599962 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:07:01.705783 | controller | 2025-10-09 21:07:01.705853 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2025-10-09 21:07:01.705862 | controller | Thursday 09 October 2025 21:07:00 +0000 (0:00:01.012) 0:03:12.940 ****** 2025-10-09 21:07:01.705876 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:07:01.706077 | controller | 2025-10-09 21:07:01.706233 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2025-10-09 21:07:01.706385 | controller | Thursday 09 October 2025 21:07:01 +0000 (0:00:01.105) 0:03:14.045 ****** 2025-10-09 21:07:01.747295 | controller | skipping: [instance] 2025-10-09 21:07:01.747524 | controller | 2025-10-09 21:07:01.747794 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2025-10-09 21:07:01.747952 | controller | Thursday 09 October 2025 21:07:01 +0000 (0:00:00.043) 0:03:14.088 ****** 2025-10-09 21:07:02.420592 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:07:02.420771 | controller | 2025-10-09 21:07:02.420914 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2025-10-09 21:07:02.421048 | controller | Thursday 09 October 2025 21:07:02 +0000 (0:00:00.672) 0:03:14.761 ****** 2025-10-09 21:07:03.104991 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:07:03.105216 | controller | 2025-10-09 21:07:03.105369 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2025-10-09 21:07:03.105523 | controller | Thursday 09 October 2025 21:07:03 +0000 (0:00:00.683) 0:03:15.445 ****** 2025-10-09 21:07:03.149880 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:07:03.150091 | controller | 2025-10-09 21:07:03.150301 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2025-10-09 21:07:03.150549 | controller | Thursday 09 October 2025 21:07:03 +0000 (0:00:00.046) 0:03:15.491 ****** 2025-10-09 21:07:03.226373 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2025-10-09 21:07:03.226637 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2025-10-09 21:07:03.226767 | controller | 2025-10-09 21:07:03.226895 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-10-09 21:07:03.227019 | controller | Thursday 09 October 2025 21:07:03 +0000 (0:00:00.076) 0:03:15.567 ****** 2025-10-09 21:07:03.287977 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-10-09 21:07:03.288270 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2025-10-09 21:07:03.288534 | controller | 2025-10-09 21:07:03.288782 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-10-09 21:07:03.288913 | controller | Thursday 09 October 2025 21:07:03 +0000 (0:00:00.061) 0:03:15.629 ****** 2025-10-09 21:07:03.350406 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-10-09 21:07:03.350778 | controller | _secret_file: '' 2025-10-09 21:07:03.350944 | controller | 2025-10-09 21:07:03.351071 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-10-09 21:07:03.351198 | controller | Thursday 09 October 2025 21:07:03 +0000 (0:00:00.062) 0:03:15.691 ****** 2025-10-09 21:07:03.408249 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-10-09 21:07:03.408434 | controller | _secret_content: my-default-location-place 2025-10-09 21:07:03.408633 | controller | 2025-10-09 21:07:03.408800 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-10-09 21:07:03.408963 | controller | Thursday 09 October 2025 21:07:03 +0000 (0:00:00.058) 0:03:15.749 ****** 2025-10-09 21:07:03.461604 | controller | skipping: [instance] 2025-10-09 21:07:03.461825 | controller | 2025-10-09 21:07:03.462041 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-10-09 21:07:03.462176 | controller | Thursday 09 October 2025 21:07:03 +0000 (0:00:00.053) 0:03:15.803 ****** 2025-10-09 21:07:03.514692 | controller | skipping: [instance] 2025-10-09 21:07:03.514881 | controller | 2025-10-09 21:07:03.515053 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-10-09 21:07:03.515198 | controller | Thursday 09 October 2025 21:07:03 +0000 (0:00:00.053) 0:03:15.856 ****** 2025-10-09 21:07:03.569870 | controller | skipping: [instance] 2025-10-09 21:07:03.570149 | controller | 2025-10-09 21:07:03.570335 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-10-09 21:07:03.570470 | controller | Thursday 09 October 2025 21:07:03 +0000 (0:00:00.054) 0:03:15.911 ****** 2025-10-09 21:07:04.682102 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:07:04.682338 | controller | 2025-10-09 21:07:04.682513 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-10-09 21:07:04.682689 | controller | Thursday 09 October 2025 21:07:04 +0000 (0:00:01.111) 0:03:17.022 ****** 2025-10-09 21:07:04.743386 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-10-09 21:07:04.743606 | controller | _secret_dest: /home/zuul/ipmi-things 2025-10-09 21:07:04.743757 | controller | 2025-10-09 21:07:04.743907 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-10-09 21:07:04.744069 | controller | Thursday 09 October 2025 21:07:04 +0000 (0:00:00.061) 0:03:17.084 ****** 2025-10-09 21:07:04.799348 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-10-09 21:07:04.799594 | controller | _secret_file: /tmp/ipmi-things 2025-10-09 21:07:04.799753 | controller | 2025-10-09 21:07:04.799896 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-10-09 21:07:04.800049 | controller | Thursday 09 October 2025 21:07:04 +0000 (0:00:00.055) 0:03:17.140 ****** 2025-10-09 21:07:04.854592 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-10-09 21:07:04.854762 | controller | _secret_content: '' 2025-10-09 21:07:04.854890 | controller | 2025-10-09 21:07:04.855031 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-10-09 21:07:04.855157 | controller | Thursday 09 October 2025 21:07:04 +0000 (0:00:00.055) 0:03:17.195 ****** 2025-10-09 21:07:04.922623 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2025-10-09 21:07:04.922816 | controller | msg: All assertions passed 2025-10-09 21:07:04.922943 | controller | 2025-10-09 21:07:04.923070 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-10-09 21:07:04.923193 | controller | Thursday 09 October 2025 21:07:04 +0000 (0:00:00.068) 0:03:17.264 ****** 2025-10-09 21:07:05.570016 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:07:05.570206 | controller | 2025-10-09 21:07:05.570353 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-10-09 21:07:05.570507 | controller | Thursday 09 October 2025 21:07:05 +0000 (0:00:00.646) 0:03:17.910 ****** 2025-10-09 21:07:06.653253 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:07:06.653503 | controller | 2025-10-09 21:07:06.653698 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-10-09 21:07:06.653860 | controller | Thursday 09 October 2025 21:07:06 +0000 (0:00:01.083) 0:03:18.994 ****** 2025-10-09 21:07:06.718435 | controller | skipping: [instance] 2025-10-09 21:07:06.718659 | controller | 2025-10-09 21:07:06.718828 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2025-10-09 21:07:06.718985 | controller | Thursday 09 October 2025 21:07:06 +0000 (0:00:00.065) 0:03:19.059 ****** 2025-10-09 21:07:07.376182 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:07:07.376419 | controller | 2025-10-09 21:07:07.376621 | controller | TASK [reproducer : Check if async file is still available] ********************* 2025-10-09 21:07:07.376801 | controller | Thursday 09 October 2025 21:07:07 +0000 (0:00:00.657) 0:03:19.716 ****** 2025-10-09 21:07:08.087622 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:07:08.087879 | controller | 2025-10-09 21:07:08.088051 | controller | TASK [reproducer : Check package install status] ******************************* 2025-10-09 21:07:08.088210 | controller | Thursday 09 October 2025 21:07:08 +0000 (0:00:00.711) 0:03:20.428 ****** 2025-10-09 21:08:21.176246 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2025-10-09 21:08:21.787391 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2025-10-09 21:08:21.787426 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2025-10-09 21:08:21.787434 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2025-10-09 21:08:21.787439 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2025-10-09 21:08:21.787445 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2025-10-09 21:08:21.787450 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2025-10-09 21:08:21.787456 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2025-10-09 21:08:21.787461 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). 2025-10-09 21:08:21.787466 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left). 2025-10-09 21:08:21.787471 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (90 retries left). 2025-10-09 21:08:21.787476 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (89 retries left). 2025-10-09 21:08:21.787481 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (88 retries left). 2025-10-09 21:08:21.787493 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:21.787499 | controller | 2025-10-09 21:08:21.787504 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2025-10-09 21:08:21.787510 | controller | Thursday 09 October 2025 21:08:21 +0000 (0:01:13.082) 0:04:33.511 ****** 2025-10-09 21:08:21.787520 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:21.787699 | controller | 2025-10-09 21:08:21.787850 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2025-10-09 21:08:21.787990 | controller | Thursday 09 October 2025 21:08:21 +0000 (0:00:00.617) 0:04:34.128 ****** 2025-10-09 21:08:24.449901 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:24.503684 | controller | 2025-10-09 21:08:24.503714 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2025-10-09 21:08:24.503723 | controller | Thursday 09 October 2025 21:08:24 +0000 (0:00:02.661) 0:04:36.790 ****** 2025-10-09 21:08:24.503733 | controller | skipping: [instance] 2025-10-09 21:08:24.564774 | controller | 2025-10-09 21:08:24.564801 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2025-10-09 21:08:24.564820 | controller | Thursday 09 October 2025 21:08:24 +0000 (0:00:00.054) 0:04:36.844 ****** 2025-10-09 21:08:24.564831 | controller | skipping: [instance] 2025-10-09 21:08:25.269161 | controller | 2025-10-09 21:08:25.269198 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2025-10-09 21:08:25.269206 | controller | Thursday 09 October 2025 21:08:24 +0000 (0:00:00.061) 0:04:36.905 ****** 2025-10-09 21:08:25.269216 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:26.000083 | controller | 2025-10-09 21:08:26.000136 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2025-10-09 21:08:26.000145 | controller | Thursday 09 October 2025 21:08:25 +0000 (0:00:00.704) 0:04:37.610 ****** 2025-10-09 21:08:26.000158 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:26.346086 | controller | 2025-10-09 21:08:26.346178 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2025-10-09 21:08:26.346191 | controller | Thursday 09 October 2025 21:08:25 +0000 (0:00:00.730) 0:04:38.340 ****** 2025-10-09 21:08:26.346211 | controller | changed: [instance] 2025-10-09 21:08:26.346259 | controller | 2025-10-09 21:08:26.346472 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2025-10-09 21:08:26.346638 | controller | Thursday 09 October 2025 21:08:26 +0000 (0:00:00.341) 0:04:38.682 ****** 2025-10-09 21:08:27.212962 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:27.213143 | controller | 2025-10-09 21:08:27.213329 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2025-10-09 21:08:27.213461 | controller | Thursday 09 October 2025 21:08:27 +0000 (0:00:00.871) 0:04:39.553 ****** 2025-10-09 21:08:28.381946 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:28.382175 | controller | 2025-10-09 21:08:28.382353 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-10-09 21:08:28.382493 | controller | Thursday 09 October 2025 21:08:28 +0000 (0:00:01.168) 0:04:40.722 ****** 2025-10-09 21:08:28.438836 | controller | skipping: [instance] 2025-10-09 21:08:28.438985 | controller | 2025-10-09 21:08:28.439127 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-10-09 21:08:28.439255 | controller | Thursday 09 October 2025 21:08:28 +0000 (0:00:00.057) 0:04:40.780 ****** 2025-10-09 21:08:28.493175 | controller | skipping: [instance] 2025-10-09 21:08:28.493394 | controller | 2025-10-09 21:08:28.493623 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-10-09 21:08:28.493830 | controller | Thursday 09 October 2025 21:08:28 +0000 (0:00:00.054) 0:04:40.834 ****** 2025-10-09 21:08:28.545382 | controller | skipping: [instance] 2025-10-09 21:08:28.545522 | controller | 2025-10-09 21:08:28.545690 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2025-10-09 21:08:28.545835 | controller | Thursday 09 October 2025 21:08:28 +0000 (0:00:00.052) 0:04:40.886 ****** 2025-10-09 21:08:28.627464 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:28.627661 | controller | 2025-10-09 21:08:28.627825 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2025-10-09 21:08:28.627968 | controller | Thursday 09 October 2025 21:08:28 +0000 (0:00:00.082) 0:04:40.968 ****** 2025-10-09 21:08:28.682714 | controller | skipping: [instance] 2025-10-09 21:08:28.682863 | controller | 2025-10-09 21:08:28.683001 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2025-10-09 21:08:28.683150 | controller | Thursday 09 October 2025 21:08:28 +0000 (0:00:00.054) 0:04:41.024 ****** 2025-10-09 21:08:28.739625 | controller | skipping: [instance] 2025-10-09 21:08:28.739783 | controller | 2025-10-09 21:08:28.739931 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2025-10-09 21:08:28.740068 | controller | Thursday 09 October 2025 21:08:28 +0000 (0:00:00.057) 0:04:41.081 ****** 2025-10-09 21:08:28.801449 | controller | skipping: [instance] 2025-10-09 21:08:29.528678 | controller | 2025-10-09 21:08:29.528718 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2025-10-09 21:08:29.528727 | controller | Thursday 09 October 2025 21:08:28 +0000 (0:00:00.061) 0:04:41.142 ****** 2025-10-09 21:08:29.528738 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:29.642531 | controller | 2025-10-09 21:08:29.642555 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2025-10-09 21:08:29.642562 | controller | Thursday 09 October 2025 21:08:29 +0000 (0:00:00.726) 0:04:41.869 ****** 2025-10-09 21:08:29.642572 | controller | skipping: [instance] => (item=secret) 2025-10-09 21:08:30.863139 | controller | skipping: [instance] => (item=configmap) 2025-10-09 21:08:30.863212 | controller | skipping: [instance] => (item=pod) 2025-10-09 21:08:30.863220 | controller | skipping: [instance] => (item=service) 2025-10-09 21:08:30.863232 | controller | skipping: [instance] => (item=route) 2025-10-09 21:08:30.863238 | controller | skipping: [instance] 2025-10-09 21:08:30.863245 | controller | 2025-10-09 21:08:30.863251 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2025-10-09 21:08:30.863257 | controller | Thursday 09 October 2025 21:08:29 +0000 (0:00:00.114) 0:04:41.983 ****** 2025-10-09 21:08:30.863270 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:30.863300 | controller | 2025-10-09 21:08:30.863308 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2025-10-09 21:08:32.019404 | controller | Thursday 09 October 2025 21:08:30 +0000 (0:00:01.220) 0:04:43.203 ****** 2025-10-09 21:08:32.019471 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:32.019500 | controller | 2025-10-09 21:08:32.019656 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2025-10-09 21:08:32.019681 | controller | Thursday 09 October 2025 21:08:32 +0000 (0:00:01.156) 0:04:44.360 ****** 2025-10-09 21:08:32.077476 | controller | skipping: [instance] 2025-10-09 21:08:32.131415 | controller | 2025-10-09 21:08:32.131459 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2025-10-09 21:08:32.131467 | controller | Thursday 09 October 2025 21:08:32 +0000 (0:00:00.058) 0:04:44.418 ****** 2025-10-09 21:08:32.131480 | controller | skipping: [instance] 2025-10-09 21:08:32.221145 | controller | 2025-10-09 21:08:32.221203 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2025-10-09 21:08:32.221213 | controller | Thursday 09 October 2025 21:08:32 +0000 (0:00:00.054) 0:04:44.472 ****** 2025-10-09 21:08:32.221225 | controller | skipping: [instance] => (item=secret) 2025-10-09 21:08:32.271393 | controller | skipping: [instance] => (item=configmap) 2025-10-09 21:08:32.271445 | controller | skipping: [instance] => (item=service) 2025-10-09 21:08:32.271458 | controller | skipping: [instance] => (item=route) 2025-10-09 21:08:32.271467 | controller | skipping: [instance] 2025-10-09 21:08:32.271478 | controller | 2025-10-09 21:08:32.271488 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2025-10-09 21:08:32.271498 | controller | Thursday 09 October 2025 21:08:32 +0000 (0:00:00.089) 0:04:44.561 ****** 2025-10-09 21:08:32.271514 | controller | skipping: [instance] 2025-10-09 21:08:32.271792 | controller | 2025-10-09 21:08:32.272036 | controller | TASK [podman : Ensure podman is installed] ************************************* 2025-10-09 21:08:32.272174 | controller | Thursday 09 October 2025 21:08:32 +0000 (0:00:00.050) 0:04:44.612 ****** 2025-10-09 21:08:33.974212 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:34.807081 | controller | 2025-10-09 21:08:34.807122 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2025-10-09 21:08:34.807131 | controller | Thursday 09 October 2025 21:08:33 +0000 (0:00:01.701) 0:04:46.314 ****** 2025-10-09 21:08:34.807142 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:34.856520 | controller | 2025-10-09 21:08:34.856553 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2025-10-09 21:08:34.856564 | controller | Thursday 09 October 2025 21:08:34 +0000 (0:00:00.833) 0:04:47.147 ****** 2025-10-09 21:08:34.856604 | controller | skipping: [instance] 2025-10-09 21:08:34.897258 | controller | 2025-10-09 21:08:34.897277 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2025-10-09 21:08:34.897293 | controller | Thursday 09 October 2025 21:08:34 +0000 (0:00:00.049) 0:04:47.197 ****** 2025-10-09 21:08:34.897302 | controller | skipping: [instance] 2025-10-09 21:08:34.954603 | controller | 2025-10-09 21:08:34.954622 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2025-10-09 21:08:34.954629 | controller | Thursday 09 October 2025 21:08:34 +0000 (0:00:00.040) 0:04:47.238 ****** 2025-10-09 21:08:34.954638 | controller | skipping: [instance] 2025-10-09 21:08:45.484014 | controller | 2025-10-09 21:08:45.484067 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2025-10-09 21:08:45.484075 | controller | Thursday 09 October 2025 21:08:34 +0000 (0:00:00.057) 0:04:47.295 ****** 2025-10-09 21:08:45.484092 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:46.997670 | controller | 2025-10-09 21:08:46.997713 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2025-10-09 21:08:46.997721 | controller | Thursday 09 October 2025 21:08:45 +0000 (0:00:10.528) 0:04:57.824 ****** 2025-10-09 21:08:46.997732 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:48.255415 | controller | 2025-10-09 21:08:48.255457 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-10-09 21:08:48.255466 | controller | Thursday 09 October 2025 21:08:46 +0000 (0:00:01.514) 0:04:59.338 ****** 2025-10-09 21:08:48.255476 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-10-09 21:08:48.303538 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-10-09 21:08:48.303596 | controller | 2025-10-09 21:08:48.303608 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2025-10-09 21:08:48.303614 | controller | Thursday 09 October 2025 21:08:48 +0000 (0:00:01.257) 0:05:00.595 ****** 2025-10-09 21:08:48.303626 | controller | skipping: [instance] 2025-10-09 21:08:48.975921 | controller | 2025-10-09 21:08:48.975968 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2025-10-09 21:08:48.975977 | controller | Thursday 09 October 2025 21:08:48 +0000 (0:00:00.048) 0:05:00.644 ****** 2025-10-09 21:08:48.975989 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:49.025411 | controller | 2025-10-09 21:08:49.025446 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2025-10-09 21:08:49.025455 | controller | Thursday 09 October 2025 21:08:48 +0000 (0:00:00.671) 0:05:01.316 ****** 2025-10-09 21:08:49.025465 | controller | skipping: [instance] 2025-10-09 21:08:49.092528 | controller | 2025-10-09 21:08:49.092562 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2025-10-09 21:08:49.092571 | controller | Thursday 09 October 2025 21:08:49 +0000 (0:00:00.048) 0:05:01.365 ****** 2025-10-09 21:08:49.092606 | controller | skipping: [instance] 2025-10-09 21:08:49.146898 | controller | 2025-10-09 21:08:49.146927 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-10-09 21:08:49.146935 | controller | Thursday 09 October 2025 21:08:49 +0000 (0:00:00.068) 0:05:01.433 ****** 2025-10-09 21:08:49.146946 | controller | skipping: [instance] 2025-10-09 21:08:49.190227 | controller | 2025-10-09 21:08:49.190257 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-10-09 21:08:49.190266 | controller | Thursday 09 October 2025 21:08:49 +0000 (0:00:00.054) 0:05:01.487 ****** 2025-10-09 21:08:49.190280 | controller | skipping: [instance] 2025-10-09 21:08:49.341276 | controller | 2025-10-09 21:08:49.341317 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2025-10-09 21:08:49.341326 | controller | Thursday 09 October 2025 21:08:49 +0000 (0:00:00.043) 0:05:01.531 ****** 2025-10-09 21:08:49.341337 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '2035c3c3-0793-45a0-9cc9-c0c39cf35f88'}) 2025-10-09 21:08:50.417239 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': 'e74368ae-a7f8-4805-a0a1-e563aff68bd3'}) 2025-10-09 21:08:50.417284 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': 'c06d5455-8e2a-454b-8092-d1494c796c38'}) 2025-10-09 21:08:50.417292 | controller | 2025-10-09 21:08:50.417298 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2025-10-09 21:08:50.417305 | controller | Thursday 09 October 2025 21:08:49 +0000 (0:00:00.150) 0:05:01.682 ****** 2025-10-09 21:08:50.417326 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:50.460648 | controller | 2025-10-09 21:08:50.460681 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2025-10-09 21:08:50.460690 | controller | Thursday 09 October 2025 21:08:50 +0000 (0:00:01.075) 0:05:02.757 ****** 2025-10-09 21:08:50.460709 | controller | skipping: [instance] 2025-10-09 21:08:50.618365 | controller | 2025-10-09 21:08:50.618406 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2025-10-09 21:08:50.618417 | controller | Thursday 09 October 2025 21:08:50 +0000 (0:00:00.044) 0:05:02.801 ****** 2025-10-09 21:08:50.618429 | controller | 2025-10-09 21:08:50.670327 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2025-10-09 21:08:50.670357 | controller | Thursday 09 October 2025 21:08:50 +0000 (0:00:00.157) 0:05:02.959 ****** 2025-10-09 21:08:50.670370 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:50.716751 | controller | 2025-10-09 21:08:50.716780 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-10-09 21:08:50.716789 | controller | Thursday 09 October 2025 21:08:50 +0000 (0:00:00.052) 0:05:03.011 ****** 2025-10-09 21:08:50.716800 | controller | skipping: [instance] 2025-10-09 21:08:50.759444 | controller | 2025-10-09 21:08:50.759467 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-10-09 21:08:50.759475 | controller | Thursday 09 October 2025 21:08:50 +0000 (0:00:00.046) 0:05:03.057 ****** 2025-10-09 21:08:50.759485 | controller | skipping: [instance] 2025-10-09 21:08:52.345950 | controller | 2025-10-09 21:08:52.345992 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2025-10-09 21:08:52.346000 | controller | Thursday 09 October 2025 21:08:50 +0000 (0:00:00.042) 0:05:03.100 ****** 2025-10-09 21:08:52.346012 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:08:57.490715 | controller | 2025-10-09 21:08:57.490764 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2025-10-09 21:08:57.490774 | controller | Thursday 09 October 2025 21:08:52 +0000 (0:00:01.585) 0:05:04.686 ****** 2025-10-09 21:08:57.490785 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=2035c3c3-0793-45a0-9cc9-c0c39cf35f88) 2025-10-09 21:08:57.491272 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=e74368ae-a7f8-4805-a0a1-e563aff68bd3) 2025-10-09 21:08:57.491444 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=c06d5455-8e2a-454b-8092-d1494c796c38) 2025-10-09 21:08:57.491614 | controller | 2025-10-09 21:08:57.491812 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2025-10-09 21:08:57.491960 | controller | Thursday 09 October 2025 21:08:57 +0000 (0:00:05.138) 0:05:09.825 ****** 2025-10-09 21:08:57.593938 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2025-10-09 21:08:57.830403 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2025-10-09 21:08:57.830444 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2025-10-09 21:08:57.830452 | controller | 2025-10-09 21:08:57.830458 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2025-10-09 21:08:57.830464 | controller | Thursday 09 October 2025 21:08:57 +0000 (0:00:00.109) 0:05:09.934 ****** 2025-10-09 21:08:57.830474 | controller | ok: [instance -> localhost] 2025-10-09 21:08:59.707109 | controller | 2025-10-09 21:08:59.707151 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2025-10-09 21:08:59.707160 | controller | Thursday 09 October 2025 21:08:57 +0000 (0:00:00.236) 0:05:10.171 ****** 2025-10-09 21:08:59.707171 | controller | changed: [instance -> localhost] => (item=controller-0) 2025-10-09 21:09:00.436121 | controller | 2025-10-09 21:09:00.436159 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2025-10-09 21:09:00.436168 | controller | Thursday 09 October 2025 21:08:59 +0000 (0:00:01.865) 0:05:12.036 ****** 2025-10-09 21:09:00.436179 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:01.180834 | controller | 2025-10-09 21:09:01.180873 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2025-10-09 21:09:01.180881 | controller | Thursday 09 October 2025 21:09:00 +0000 (0:00:00.739) 0:05:12.776 ****** 2025-10-09 21:09:01.180898 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:02.372908 | controller | 2025-10-09 21:09:02.372948 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2025-10-09 21:09:02.372964 | controller | Thursday 09 October 2025 21:09:01 +0000 (0:00:00.744) 0:05:13.521 ****** 2025-10-09 21:09:02.372976 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:03.119567 | controller | 2025-10-09 21:09:03.119631 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2025-10-09 21:09:03.119641 | controller | Thursday 09 October 2025 21:09:02 +0000 (0:00:01.191) 0:05:14.713 ****** 2025-10-09 21:09:03.119653 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:04.268543 | controller | 2025-10-09 21:09:04.268606 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2025-10-09 21:09:04.268619 | controller | Thursday 09 October 2025 21:09:03 +0000 (0:00:00.746) 0:05:15.460 ****** 2025-10-09 21:09:04.268630 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:04.937372 | controller | 2025-10-09 21:09:04.937413 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2025-10-09 21:09:04.937422 | controller | Thursday 09 October 2025 21:09:04 +0000 (0:00:01.149) 0:05:16.609 ****** 2025-10-09 21:09:04.937433 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:05.615181 | controller | 2025-10-09 21:09:05.615221 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2025-10-09 21:09:05.615229 | controller | Thursday 09 October 2025 21:09:04 +0000 (0:00:00.668) 0:05:17.278 ****** 2025-10-09 21:09:05.615240 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:07.062780 | controller | 2025-10-09 21:09:07.062819 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2025-10-09 21:09:07.062828 | controller | Thursday 09 October 2025 21:09:05 +0000 (0:00:00.674) 0:05:17.952 ****** 2025-10-09 21:09:07.062838 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-10-09 21:09:07.106541 | controller | 2025-10-09 21:09:07.106588 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-10-09 21:09:07.106600 | controller | Thursday 09 October 2025 21:09:07 +0000 (0:00:01.450) 0:05:19.403 ****** 2025-10-09 21:09:07.106610 | controller | skipping: [instance] 2025-10-09 21:09:07.151935 | controller | 2025-10-09 21:09:07.151955 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-10-09 21:09:07.151963 | controller | Thursday 09 October 2025 21:09:07 +0000 (0:00:00.044) 0:05:19.447 ****** 2025-10-09 21:09:07.151972 | controller | skipping: [instance] 2025-10-09 21:09:07.196566 | controller | 2025-10-09 21:09:07.196603 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-10-09 21:09:07.196612 | controller | Thursday 09 October 2025 21:09:07 +0000 (0:00:00.045) 0:05:19.493 ****** 2025-10-09 21:09:07.196621 | controller | skipping: [instance] 2025-10-09 21:09:07.240772 | controller | 2025-10-09 21:09:07.240791 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-10-09 21:09:07.240799 | controller | Thursday 09 October 2025 21:09:07 +0000 (0:00:00.044) 0:05:19.537 ****** 2025-10-09 21:09:07.240808 | controller | skipping: [instance] 2025-10-09 21:09:07.286636 | controller | 2025-10-09 21:09:07.286655 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-10-09 21:09:07.286663 | controller | Thursday 09 October 2025 21:09:07 +0000 (0:00:00.044) 0:05:19.582 ****** 2025-10-09 21:09:07.286673 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:07.401351 | controller | 2025-10-09 21:09:07.401373 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-10-09 21:09:07.401382 | controller | Thursday 09 October 2025 21:09:07 +0000 (0:00:00.045) 0:05:19.627 ****** 2025-10-09 21:09:07.401394 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-10-09 21:09:07.460634 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2025-10-09 21:09:07.460653 | controller | 2025-10-09 21:09:07.460661 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-10-09 21:09:07.460667 | controller | Thursday 09 October 2025 21:09:07 +0000 (0:00:00.114) 0:05:19.742 ****** 2025-10-09 21:09:07.460677 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2025-10-09 21:09:11.161588 | controller | 2025-10-09 21:09:11.161642 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2025-10-09 21:09:11.161651 | controller | Thursday 09 October 2025 21:09:07 +0000 (0:00:00.059) 0:05:19.801 ****** 2025-10-09 21:09:11.161663 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-10-09 21:09:12.271264 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2025-10-09 21:09:12.271313 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-10-09 21:09:12.271321 | controller | 2025-10-09 21:09:12.271328 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2025-10-09 21:09:12.271335 | controller | Thursday 09 October 2025 21:09:11 +0000 (0:00:03.700) 0:05:23.501 ****** 2025-10-09 21:09:12.271355 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:12.771934 | controller | 2025-10-09 21:09:12.771975 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-10-09 21:09:12.771983 | controller | Thursday 09 October 2025 21:09:12 +0000 (0:00:01.109) 0:05:24.611 ****** 2025-10-09 21:09:12.772001 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:12.772183 | controller | 2025-10-09 21:09:12.772196 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-10-09 21:09:12.772205 | controller | Thursday 09 October 2025 21:09:12 +0000 (0:00:00.500) 0:05:25.112 ****** 2025-10-09 21:09:13.753396 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:13.845027 | controller | 2025-10-09 21:09:13.845063 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-10-09 21:09:13.845072 | controller | Thursday 09 October 2025 21:09:13 +0000 (0:00:00.981) 0:05:26.093 ****** 2025-10-09 21:09:13.845084 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:13.905943 | controller | 2025-10-09 21:09:13.905971 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-10-09 21:09:13.905979 | controller | Thursday 09 October 2025 21:09:13 +0000 (0:00:00.092) 0:05:26.186 ****** 2025-10-09 21:09:13.905989 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:14.972639 | controller | 2025-10-09 21:09:14.972690 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-10-09 21:09:14.972698 | controller | Thursday 09 October 2025 21:09:13 +0000 (0:00:00.061) 0:05:26.247 ****** 2025-10-09 21:09:14.972711 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:15.927293 | controller | 2025-10-09 21:09:15.927342 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2025-10-09 21:09:15.927359 | controller | Thursday 09 October 2025 21:09:14 +0000 (0:00:01.066) 0:05:27.313 ****** 2025-10-09 21:09:15.927372 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:22.041284 | controller | 2025-10-09 21:09:22.041339 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2025-10-09 21:09:22.041347 | controller | Thursday 09 October 2025 21:09:15 +0000 (0:00:00.954) 0:05:28.268 ****** 2025-10-09 21:09:22.041369 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2025-10-09 21:09:22.273920 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:22.273942 | controller | 2025-10-09 21:09:22.273949 | controller | TASK [Configure ntp service] *************************************************** 2025-10-09 21:09:22.273955 | controller | Thursday 09 October 2025 21:09:22 +0000 (0:00:06.113) 0:05:34.381 ****** 2025-10-09 21:09:22.273963 | controller | 2025-10-09 21:09:23.300443 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2025-10-09 21:09:23.300493 | controller | Thursday 09 October 2025 21:09:22 +0000 (0:00:00.233) 0:05:34.615 ****** 2025-10-09 21:09:23.300507 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:24.368935 | controller | 2025-10-09 21:09:24.368987 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2025-10-09 21:09:24.368996 | controller | Thursday 09 October 2025 21:09:23 +0000 (0:00:01.026) 0:05:35.641 ****** 2025-10-09 21:09:24.369009 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2025-10-09 21:09:25.393345 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2025-10-09 21:09:25.393406 | controller | 2025-10-09 21:09:25.393414 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2025-10-09 21:09:25.393421 | controller | Thursday 09 October 2025 21:09:24 +0000 (0:00:01.068) 0:05:36.709 ****** 2025-10-09 21:09:25.393434 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:26.125993 | controller | 2025-10-09 21:09:26.126099 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2025-10-09 21:09:26.126112 | controller | Thursday 09 October 2025 21:09:25 +0000 (0:00:01.024) 0:05:37.733 ****** 2025-10-09 21:09:26.126125 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:26.268202 | controller | 2025-10-09 21:09:26.268227 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2025-10-09 21:09:26.268235 | controller | Thursday 09 October 2025 21:09:26 +0000 (0:00:00.732) 0:05:38.466 ****** 2025-10-09 21:09:26.268246 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2025-10-09 21:09:26.808350 | controller | 2025-10-09 21:09:26.808422 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2025-10-09 21:09:26.808431 | controller | Thursday 09 October 2025 21:09:26 +0000 (0:00:00.143) 0:05:38.609 ****** 2025-10-09 21:09:26.808444 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:27.332483 | controller | 2025-10-09 21:09:27.332544 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2025-10-09 21:09:27.332554 | controller | Thursday 09 October 2025 21:09:26 +0000 (0:00:00.539) 0:05:39.148 ****** 2025-10-09 21:09:27.332566 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-10-09 21:09:27.332868 | controller | 2025-10-09 21:09:27.332943 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2025-10-09 21:09:27.333095 | controller | Thursday 09 October 2025 21:09:27 +0000 (0:00:00.523) 0:05:39.672 ****** 2025-10-09 21:09:28.024353 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-10-09 21:09:28.553632 | controller | 2025-10-09 21:09:28.553674 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2025-10-09 21:09:28.553688 | controller | Thursday 09 October 2025 21:09:28 +0000 (0:00:00.692) 0:05:40.365 ****** 2025-10-09 21:09:28.553700 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-10-09 21:09:28.606343 | controller | 2025-10-09 21:09:28.606385 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2025-10-09 21:09:28.606394 | controller | Thursday 09 October 2025 21:09:28 +0000 (0:00:00.529) 0:05:40.894 ****** 2025-10-09 21:09:28.606406 | controller | 2025-10-09 21:09:29.109330 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2025-10-09 21:09:29.109383 | controller | Thursday 09 October 2025 21:09:28 +0000 (0:00:00.053) 0:05:40.947 ****** 2025-10-09 21:09:29.109397 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-10-09 21:09:29.898447 | controller | 2025-10-09 21:09:29.898491 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2025-10-09 21:09:29.898499 | controller | Thursday 09 October 2025 21:09:29 +0000 (0:00:00.502) 0:05:41.450 ****** 2025-10-09 21:09:29.898510 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-10-09 21:09:29.941619 | controller | 2025-10-09 21:09:29.941655 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2025-10-09 21:09:29.941663 | controller | Thursday 09 October 2025 21:09:29 +0000 (0:00:00.788) 0:05:42.238 ****** 2025-10-09 21:09:29.941674 | controller | skipping: [instance] 2025-10-09 21:09:29.983547 | controller | 2025-10-09 21:09:29.983783 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2025-10-09 21:09:29.983795 | controller | Thursday 09 October 2025 21:09:29 +0000 (0:00:00.043) 0:05:42.282 ****** 2025-10-09 21:09:29.983804 | controller | skipping: [instance] 2025-10-09 21:09:30.250006 | controller | 2025-10-09 21:09:30.250043 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2025-10-09 21:09:30.250052 | controller | Thursday 09 October 2025 21:09:29 +0000 (0:00:00.042) 0:05:42.324 ****** 2025-10-09 21:09:30.250062 | controller | changed: [instance] 2025-10-09 21:09:30.328290 | controller | 2025-10-09 21:09:30.328310 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2025-10-09 21:09:30.328318 | controller | Thursday 09 October 2025 21:09:30 +0000 (0:00:00.266) 0:05:42.590 ****** 2025-10-09 21:09:30.328400 | controller | skipping: [instance] => (item=) 2025-10-09 21:09:30.328522 | controller | 2025-10-09 21:09:30.328532 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2025-10-09 21:09:30.328541 | controller | Thursday 09 October 2025 21:09:30 +0000 (0:00:00.078) 0:05:42.669 ****** 2025-10-09 21:09:30.366845 | controller | ok: [instance] 2025-10-09 21:09:30.444926 | controller | 2025-10-09 21:09:30.444946 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-10-09 21:09:30.444954 | controller | Thursday 09 October 2025 21:09:30 +0000 (0:00:00.038) 0:05:42.707 ****** 2025-10-09 21:09:30.444963 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-10-09 21:09:30.736759 | controller | 2025-10-09 21:09:30.736802 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-10-09 21:09:30.736811 | controller | Thursday 09 October 2025 21:09:30 +0000 (0:00:00.078) 0:05:42.786 ****** 2025-10-09 21:09:30.736823 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-10-09 21:09:30.787804 | controller | 2025-10-09 21:09:30.787823 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2025-10-09 21:09:30.787830 | controller | Thursday 09 October 2025 21:09:30 +0000 (0:00:00.291) 0:05:43.077 ****** 2025-10-09 21:09:30.787839 | controller | 2025-10-09 21:09:30.855991 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-10-09 21:09:30.856039 | controller | Thursday 09 October 2025 21:09:30 +0000 (0:00:00.051) 0:05:43.129 ****** 2025-10-09 21:09:30.856052 | controller | ok: [instance] 2025-10-09 21:09:30.918242 | controller | 2025-10-09 21:09:30.918272 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-10-09 21:09:30.918280 | controller | Thursday 09 October 2025 21:09:30 +0000 (0:00:00.067) 0:05:43.196 ****** 2025-10-09 21:09:30.918291 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-10-09 21:09:31.199427 | controller | 2025-10-09 21:09:31.199472 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-10-09 21:09:31.199481 | controller | Thursday 09 October 2025 21:09:30 +0000 (0:00:00.062) 0:05:43.259 ****** 2025-10-09 21:09:31.199493 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-10-09 21:09:31.649472 | controller | 2025-10-09 21:09:31.649511 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2025-10-09 21:09:31.649520 | controller | Thursday 09 October 2025 21:09:31 +0000 (0:00:00.280) 0:05:43.540 ****** 2025-10-09 21:09:31.649540 | controller | changed: [instance] 2025-10-09 21:09:32.471525 | controller | 2025-10-09 21:09:32.471611 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-10-09 21:09:32.471624 | controller | Thursday 09 October 2025 21:09:31 +0000 (0:00:00.436) 0:05:43.976 ****** 2025-10-09 21:09:32.471630 | controller | 2025-10-09 21:09:32.471635 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2025-10-09 21:09:32.471640 | controller | Thursday 09 October 2025 21:09:31 +0000 (0:00:00.012) 0:05:43.989 ****** 2025-10-09 21:09:32.471654 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:32.879882 | controller | 2025-10-09 21:09:32.879955 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-10-09 21:09:32.879968 | controller | Thursday 09 October 2025 21:09:32 +0000 (0:00:00.822) 0:05:44.811 ****** 2025-10-09 21:09:32.879986 | controller | changed: [instance] 2025-10-09 21:09:32.880042 | controller | 2025-10-09 21:09:32.880065 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2025-10-09 21:09:32.880116 | controller | Thursday 09 October 2025 21:09:32 +0000 (0:00:00.408) 0:05:45.220 ****** 2025-10-09 21:09:33.059766 | controller | skipping: [instance] => (item=controller-0) 2025-10-09 21:09:34.603454 | controller | skipping: [instance] => (item=crc-0) 2025-10-09 21:09:34.603513 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2025-10-09 21:09:34.603521 | controller | 2025-10-09 21:09:34.603528 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2025-10-09 21:09:34.603534 | controller | Thursday 09 October 2025 21:09:33 +0000 (0:00:00.180) 0:05:45.400 ****** 2025-10-09 21:09:34.603546 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-10-09 21:09:34.628733 | controller | 2025-10-09 21:09:34.628794 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-10-09 21:09:34.628804 | controller | Thursday 09 October 2025 21:09:34 +0000 (0:00:01.543) 0:05:46.944 ****** 2025-10-09 21:09:34.628824 | controller | skipping: [instance] 2025-10-09 21:09:35.184806 | controller | 2025-10-09 21:09:35.184882 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-10-09 21:09:35.184891 | controller | Thursday 09 October 2025 21:09:34 +0000 (0:00:00.023) 0:05:46.967 ****** 2025-10-09 21:09:35.184910 | controller | ok: [instance -> compute-0(compute-0.instance)] 2025-10-09 21:09:35.185046 | controller | 2025-10-09 21:09:35.185117 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-10-09 21:09:35.185135 | controller | Thursday 09 October 2025 21:09:35 +0000 (0:00:00.554) 0:05:47.522 ****** 2025-10-09 21:09:35.224950 | controller | skipping: [instance] 2025-10-09 21:09:35.225100 | controller | 2025-10-09 21:09:35.225420 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-10-09 21:09:35.225567 | controller | Thursday 09 October 2025 21:09:35 +0000 (0:00:00.043) 0:05:47.566 ****** 2025-10-09 21:09:35.267676 | controller | skipping: [instance] 2025-10-09 21:09:35.267849 | controller | 2025-10-09 21:09:35.268009 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-10-09 21:09:35.268163 | controller | Thursday 09 October 2025 21:09:35 +0000 (0:00:00.043) 0:05:47.609 ****** 2025-10-09 21:09:35.310350 | controller | skipping: [instance] 2025-10-09 21:09:35.310549 | controller | 2025-10-09 21:09:35.310762 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-10-09 21:09:35.310941 | controller | Thursday 09 October 2025 21:09:35 +0000 (0:00:00.042) 0:05:47.651 ****** 2025-10-09 21:09:36.767333 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-10-09 21:09:36.767426 | controller | 2025-10-09 21:09:36.767631 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2025-10-09 21:09:36.767722 | controller | Thursday 09 October 2025 21:09:36 +0000 (0:00:01.453) 0:05:49.105 ****** 2025-10-09 21:09:36.805045 | controller | skipping: [instance] 2025-10-09 21:09:36.805129 | controller | 2025-10-09 21:09:36.805141 | controller | TASK [reproducer : Create repositories on computes] **************************** 2025-10-09 21:09:36.805282 | controller | Thursday 09 October 2025 21:09:36 +0000 (0:00:00.041) 0:05:49.146 ****** 2025-10-09 21:09:36.827348 | controller | skipping: [instance] 2025-10-09 21:09:36.827497 | controller | 2025-10-09 21:09:36.827516 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2025-10-09 21:09:36.827745 | controller | Thursday 09 October 2025 21:09:36 +0000 (0:00:00.022) 0:05:49.168 ****** 2025-10-09 21:09:36.861124 | controller | skipping: [instance] 2025-10-09 21:09:36.861246 | controller | 2025-10-09 21:09:36.861411 | controller | TASK [reproducer : Push local code] ******************************************** 2025-10-09 21:09:36.861542 | controller | Thursday 09 October 2025 21:09:36 +0000 (0:00:00.034) 0:05:49.202 ****** 2025-10-09 21:09:36.963643 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2025-10-09 21:09:36.963933 | controller | 2025-10-09 21:09:36.964338 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2025-10-09 21:09:36.964634 | controller | Thursday 09 October 2025 21:09:36 +0000 (0:00:00.102) 0:05:49.305 ****** 2025-10-09 21:09:37.009039 | controller | skipping: [instance] 2025-10-09 21:09:37.009313 | controller | 2025-10-09 21:09:37.009668 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2025-10-09 21:09:37.009997 | controller | Thursday 09 October 2025 21:09:37 +0000 (0:00:00.045) 0:05:49.350 ****** 2025-10-09 21:09:37.056252 | controller | skipping: [instance] 2025-10-09 21:09:37.109433 | controller | 2025-10-09 21:09:37.109460 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2025-10-09 21:09:37.109467 | controller | Thursday 09 October 2025 21:09:37 +0000 (0:00:00.046) 0:05:49.397 ****** 2025-10-09 21:09:37.109477 | controller | skipping: [instance] 2025-10-09 21:09:37.158995 | controller | 2025-10-09 21:09:37.159012 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2025-10-09 21:09:37.159019 | controller | Thursday 09 October 2025 21:09:37 +0000 (0:00:00.053) 0:05:49.450 ****** 2025-10-09 21:09:37.159043 | controller | skipping: [instance] 2025-10-09 21:09:37.205711 | controller | 2025-10-09 21:09:37.205741 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2025-10-09 21:09:37.205751 | controller | Thursday 09 October 2025 21:09:37 +0000 (0:00:00.049) 0:05:49.500 ****** 2025-10-09 21:09:37.205762 | controller | skipping: [instance] 2025-10-09 21:09:37.736256 | controller | 2025-10-09 21:09:37.736308 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2025-10-09 21:09:37.736317 | controller | Thursday 09 October 2025 21:09:37 +0000 (0:00:00.046) 0:05:49.547 ****** 2025-10-09 21:09:37.736329 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2025-10-09 21:09:38.368595 | controller | 2025-10-09 21:09:38.368647 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2025-10-09 21:09:38.368659 | controller | Thursday 09 October 2025 21:09:37 +0000 (0:00:00.529) 0:05:50.076 ****** 2025-10-09 21:09:38.368678 | controller | ok: [instance -> localhost] => (item=ci-framework) 2025-10-09 21:09:38.415622 | controller | 2025-10-09 21:09:38.415660 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2025-10-09 21:09:38.415669 | controller | Thursday 09 October 2025 21:09:38 +0000 (0:00:00.631) 0:05:50.708 ****** 2025-10-09 21:09:38.415681 | controller | skipping: [instance] => (item=ci-framework) 2025-10-09 21:09:38.415968 | controller | skipping: [instance] 2025-10-09 21:09:38.416350 | controller | 2025-10-09 21:09:38.416426 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2025-10-09 21:09:38.501350 | controller | Thursday 09 October 2025 21:09:38 +0000 (0:00:00.048) 0:05:50.756 ****** 2025-10-09 21:09:38.501415 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2025-10-09 21:09:38.501538 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2025-10-09 21:09:38.501550 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2025-10-09 21:09:38.501557 | controller | 2025-10-09 21:09:38.501567 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2025-10-09 21:09:38.501689 | controller | Thursday 09 October 2025 21:09:38 +0000 (0:00:00.085) 0:05:50.842 ****** 2025-10-09 21:09:39.048088 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:39.048159 | controller | 2025-10-09 21:09:39.048297 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2025-10-09 21:09:39.048442 | controller | Thursday 09 October 2025 21:09:39 +0000 (0:00:00.546) 0:05:51.389 ****** 2025-10-09 21:09:39.091698 | controller | skipping: [instance] 2025-10-09 21:09:39.091781 | controller | 2025-10-09 21:09:39.091875 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2025-10-09 21:09:39.091974 | controller | Thursday 09 October 2025 21:09:39 +0000 (0:00:00.044) 0:05:51.433 ****** 2025-10-09 21:09:39.653486 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:39.653606 | controller | 2025-10-09 21:09:39.653639 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2025-10-09 21:09:39.653771 | controller | Thursday 09 October 2025 21:09:39 +0000 (0:00:00.561) 0:05:51.994 ****** 2025-10-09 21:09:39.709072 | controller | skipping: [instance] 2025-10-09 21:09:39.709167 | controller | 2025-10-09 21:09:39.709298 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2025-10-09 21:09:39.709426 | controller | Thursday 09 October 2025 21:09:39 +0000 (0:00:00.056) 0:05:52.050 ****** 2025-10-09 21:09:40.252937 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:40.253013 | controller | 2025-10-09 21:09:40.253133 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2025-10-09 21:09:40.253147 | controller | Thursday 09 October 2025 21:09:40 +0000 (0:00:00.543) 0:05:52.593 ****** 2025-10-09 21:09:42.705035 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:09:42.705430 | controller | 2025-10-09 21:10:03.048961 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2025-10-09 21:10:03.049007 | controller | Thursday 09 October 2025 21:09:42 +0000 (0:00:02.451) 0:05:55.045 ****** 2025-10-09 21:10:03.049022 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:10:04.227848 | controller | 2025-10-09 21:10:04.227908 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2025-10-09 21:10:04.227929 | controller | Thursday 09 October 2025 21:10:03 +0000 (0:00:20.344) 0:06:15.389 ****** 2025-10-09 21:10:04.227943 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:10:04.334350 | controller | 2025-10-09 21:10:04.334384 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2025-10-09 21:10:04.334402 | controller | Thursday 09 October 2025 21:10:04 +0000 (0:00:01.178) 0:06:16.567 ****** 2025-10-09 21:10:04.334412 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2025-10-09 21:10:04.334442 | controller | 2025-10-09 21:10:04.334602 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2025-10-09 21:10:04.334660 | controller | Thursday 09 October 2025 21:10:04 +0000 (0:00:00.107) 0:06:16.675 ****** 2025-10-09 21:10:04.843022 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:10:04.843152 | controller | 2025-10-09 21:10:04.843165 | controller | TASK [reproducer : Rotate log if present] ************************************** 2025-10-09 21:10:04.889666 | controller | Thursday 09 October 2025 21:10:04 +0000 (0:00:00.508) 0:06:17.183 ****** 2025-10-09 21:10:04.889716 | controller | skipping: [instance] 2025-10-09 21:10:04.941563 | controller | 2025-10-09 21:10:04.941595 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2025-10-09 21:10:04.941606 | controller | Thursday 09 October 2025 21:10:04 +0000 (0:00:00.046) 0:06:17.230 ****** 2025-10-09 21:10:04.941622 | controller | skipping: [instance] 2025-10-09 21:10:04.941643 | controller | 2025-10-09 21:10:04.941649 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2025-10-09 21:10:04.941656 | controller | Thursday 09 October 2025 21:10:04 +0000 (0:00:00.052) 0:06:17.282 ****** 2025-10-09 21:10:05.038085 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:10:05.038160 | controller | 2025-10-09 21:10:05.038277 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-10-09 21:10:05.038362 | controller | Thursday 09 October 2025 21:10:05 +0000 (0:00:00.096) 0:06:17.379 ****** 2025-10-09 21:10:05.572870 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:10:05.572943 | controller | 2025-10-09 21:10:05.573054 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-10-09 21:10:05.573156 | controller | Thursday 09 October 2025 21:10:05 +0000 (0:00:00.534) 0:06:17.913 ****** 2025-10-09 21:10:05.619441 | controller | skipping: [instance] 2025-10-09 21:10:05.619507 | controller | 2025-10-09 21:10:05.619647 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-10-09 21:10:05.619759 | controller | Thursday 09 October 2025 21:10:05 +0000 (0:00:00.047) 0:06:17.960 ****** 2025-10-09 21:10:05.671402 | controller | skipping: [instance] 2025-10-09 21:10:05.671477 | controller | 2025-10-09 21:10:05.671571 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-10-09 21:10:05.671750 | controller | Thursday 09 October 2025 21:10:05 +0000 (0:00:00.051) 0:06:18.012 ****** 2025-10-09 21:10:05.724562 | controller | skipping: [instance] 2025-10-09 21:10:05.724653 | controller | 2025-10-09 21:10:05.724788 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-10-09 21:10:05.724889 | controller | Thursday 09 October 2025 21:10:05 +0000 (0:00:00.052) 0:06:18.065 ****** 2025-10-09 21:10:07.296326 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-10-09 21:10:07.296406 | controller | 2025-10-09 21:10:07.296479 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-10-09 21:10:07.296933 | controller | Thursday 09 October 2025 21:10:07 +0000 (0:00:01.571) 0:06:19.637 ****** 2025-10-09 21:10:07.840095 | controller | failed: [instance -> controller-0(controller-0.instance)] (item=None) => changed=false 2025-10-09 21:10:08.372740 | controller | censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result' 2025-10-09 21:10:08.372860 | controller | failed: [instance -> controller-0(controller-0.instance)] (item=None) => changed=false 2025-10-09 21:10:08.894326 | controller | censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result' 2025-10-09 21:10:08.894405 | controller | failed: [instance -> controller-0(controller-0.instance)] (item=None) => changed=false 2025-10-09 21:10:08.895389 | controller | censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result' 2025-10-09 21:10:08.895431 | controller | fatal: [instance -> controller-0]: FAILED! => changed=false 2025-10-09 21:10:08.904726 | controller | censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result' 2025-10-09 21:10:08.904837 | controller | 2025-10-09 21:10:09.125519 | controller | TASK [Create dnsmasq dir] ****************************************************** 2025-10-09 21:10:09.125755 | controller | Thursday 09 October 2025 21:10:08 +0000 (0:00:01.608) 0:06:21.245 ****** 2025-10-09 21:10:09.125785 | controller | changed: [instance] 2025-10-09 21:10:09.125866 | controller | 2025-10-09 21:10:09.125877 | controller | TASK [Get journalctl in a file] ************************************************ 2025-10-09 21:10:09.125887 | controller | Thursday 09 October 2025 21:10:09 +0000 (0:00:00.220) 0:06:21.466 ****** 2025-10-09 21:10:09.395301 | controller | changed: [instance] 2025-10-09 21:10:09.395603 | controller | 2025-10-09 21:10:09.839234 | controller | TASK [Dump journalctl output] ************************************************** 2025-10-09 21:10:09.839283 | controller | Thursday 09 October 2025 21:10:09 +0000 (0:00:00.268) 0:06:21.735 ****** 2025-10-09 21:10:09.839296 | controller | changed: [instance] 2025-10-09 21:10:09.839321 | controller | 2025-10-09 21:10:09.839329 | controller | TASK [Copy all dnsmasq config] ************************************************* 2025-10-09 21:10:09.839444 | controller | Thursday 09 October 2025 21:10:09 +0000 (0:00:00.445) 0:06:22.180 ****** 2025-10-09 21:10:10.389787 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-10-09 21:10:10.389978 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2025-10-09 21:10:10.390037 | controller | 2025-10-09 21:10:10.613817 | controller | TASK [Create log directory] **************************************************** 2025-10-09 21:10:10.613884 | controller | Thursday 09 October 2025 21:10:10 +0000 (0:00:00.550) 0:06:22.730 ****** 2025-10-09 21:10:10.613899 | controller | changed: [instance] 2025-10-09 21:10:10.614092 | controller | 2025-10-09 21:10:11.568008 | controller | TASK [Sync logs from controller-0] ********************************************* 2025-10-09 21:10:11.568058 | controller | Thursday 09 October 2025 21:10:10 +0000 (0:00:00.223) 0:06:22.954 ****** 2025-10-09 21:10:11.568072 | controller | changed: [instance] 2025-10-09 21:10:11.568104 | controller | 2025-10-09 21:10:11.568113 | controller | PLAY RECAP ********************************************************************* 2025-10-09 21:10:11.568711 | controller | instance : ok=489 changed=180 unreachable=0 failed=1 skipped=177 rescued=0 ignored=0 2025-10-09 21:10:11.569142 | controller | 2025-10-09 21:10:11.569198 | controller | Thursday 09 October 2025 21:10:11 +0000 (0:00:00.952) 0:06:23.906 ****** 2025-10-09 21:10:11.569208 | controller | =============================================================================== 2025-10-09 21:10:11.569214 | controller | reproducer : Check package install status ------------------------------ 73.08s 2025-10-09 21:10:11.569227 | controller | libvirt_manager : Download base image ---------------------------------- 21.14s 2025-10-09 21:10:11.569378 | controller | reproducer : Install collections on controller-0 ----------------------- 20.34s 2025-10-09 21:10:11.569398 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.99s 2025-10-09 21:10:11.569405 | controller | libvirt_manager : Install packages required for using KVM -------------- 11.64s 2025-10-09 21:10:11.569435 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.53s 2025-10-09 21:10:11.569548 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.11s 2025-10-09 21:10:11.569593 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.15s 2025-10-09 21:10:11.569610 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 5.14s 2025-10-09 21:10:11.569681 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.84s 2025-10-09 21:10:11.569707 | controller | networking_mapper : Gather the facts ------------------------------------ 3.70s 2025-10-09 21:10:11.569771 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.28s 2025-10-09 21:10:11.569898 | controller | sushy_emulator : Install required packages ------------------------------ 2.66s 2025-10-09 21:10:11.570131 | controller | reproducer : Ensure the required parameters are loaded ------------------ 2.63s 2025-10-09 21:10:11.570143 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.45s 2025-10-09 21:10:11.570268 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.19s 2025-10-09 21:10:11.570279 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.08s 2025-10-09 21:10:11.570354 | controller | reproducer : Inject SSH configuration ----------------------------------- 1.92s 2025-10-09 21:10:11.570364 | controller | discover_latest_image : Get latest image -------------------------------- 1.88s 2025-10-09 21:10:11.570449 | controller | reproducer : Sync local repositories to other hosts if present ---------- 1.87s 2025-10-09 21:10:11.723331 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml'] 2025-10-09 21:10:11.723833 | controller | WARNING An error occurred during the test sequence action: 'converge'. Cleaning up. 2025-10-09 21:10:11.735674 | controller | INFO Running crc_layout > cleanup 2025-10-09 21:10:11.736108 | controller | WARNING Skipping, cleanup playbook not configured. 2025-10-09 21:10:11.743447 | controller | INFO Running crc_layout > destroy 2025-10-09 21:10:11.743748 | controller | WARNING Skipping, instances are delegated. 2025-10-09 21:10:11.744051 | controller | INFO Pruning extra files from scenario ephemeral directory 2025-10-09 21:10:11.745524 | controller | INFO Writing /tmp/report.html report. 2025-10-09 21:10:12.232608 | [controller] Waiting on logger 2025-10-09 21:10:17.394428 | [controller] Waiting on logger 2025-10-09 21:10:27.826426 | [controller] Waiting on logger 2025-10-09 21:10:38.259167 | [controller] Waiting on logger 2025-10-09 21:10:41.864789 | [Zuul] Log Stream did not terminate 2025-10-09 21:10:41.865064 | controller | ERROR 2025-10-09 21:10:41.865179 | controller | { 2025-10-09 21:10:41.865216 | controller | "delta": "0:08:00.842002", 2025-10-09 21:10:41.865242 | controller | "end": "2025-10-09 21:10:11.819807", 2025-10-09 21:10:41.865264 | controller | "msg": "non-zero return code", 2025-10-09 21:10:41.865287 | controller | "rc": 1, 2025-10-09 21:10:41.865307 | controller | "start": "2025-10-09 21:02:10.977805" 2025-10-09 21:10:41.865326 | controller | } failure 2025-10-09 21:10:41.922645 | 2025-10-09 21:10:41.922725 | PLAY RECAP 2025-10-09 21:10:41.922769 | controller | ok: 2 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0 2025-10-09 21:10:41.922791 | 2025-10-09 21:10:41.985022 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-10-09 21:10:41.985791 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-10-09 21:10:42.484503 | 2025-10-09 21:10:42.484594 | PLAY [Run ci/playbooks/collect-logs.yml] 2025-10-09 21:10:42.502634 | 2025-10-09 21:10:42.502702 | TASK [Filter out host if needed] 2025-10-09 21:10:42.510599 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2025-10-09 21:10:42.514797 | 2025-10-09 21:10:42.514864 | TASK [Ensure file is present] 2025-10-09 21:10:42.938469 | controller | ok 2025-10-09 21:10:42.944806 | 2025-10-09 21:10:42.944872 | TASK [Manage molecule report file] 2025-10-09 21:10:42.964946 | [controller] Waiting on logger 2025-10-09 21:10:52.311081 | [controller] Waiting on logger 2025-10-09 21:11:02.706447 | [controller] Waiting on logger 2025-10-09 21:11:13.138854 | [controller] Waiting on logger 2025-10-09 21:11:13.367852 | [Zuul] Log Stream did not terminate 2025-10-09 21:11:13.368091 | controller | changed 2025-10-09 21:11:13.373411 | 2025-10-09 21:11:13.373474 | TASK [Check if we get ci-framework-data basedir] 2025-10-09 21:11:13.674981 | controller | ok 2025-10-09 21:11:13.680000 | 2025-10-09 21:11:13.680084 | TASK [Create ci-framework-data log directory for zuul] 2025-10-09 21:11:14.095006 | controller | changed 2025-10-09 21:11:14.100523 | 2025-10-09 21:11:14.100586 | TASK [Copy ci-framework interesting files] 2025-10-09 21:11:19.126302 | controller | changed 2025-10-09 21:11:19.131534 | 2025-10-09 21:11:19.131596 | TASK [Get SELinux listing] 2025-10-09 21:11:22.482691 | [controller] Waiting on logger 2025-10-09 21:11:24.154774 | controller | changed 2025-10-09 21:11:24.160557 | 2025-10-09 21:11:24.160627 | TASK [Generate log index] 2025-10-09 21:11:25.438521 | controller | changed 2025-10-09 21:11:25.443272 | 2025-10-09 21:11:25.443337 | TASK [Get some env related data] 2025-10-09 21:11:25.464153 | [controller] Waiting on logger 2025-10-09 21:11:35.858818 | [controller] Waiting on logger 2025-10-09 21:11:45.239163 | [controller] Waiting on logger 2025-10-09 21:11:55.634511 | [controller] Waiting on logger 2025-10-09 21:11:56.713471 | [Zuul] Log Stream did not terminate 2025-10-09 21:11:56.713656 | controller | changed 2025-10-09 21:11:56.718851 | 2025-10-09 21:11:56.718927 | TASK [Generate list of logs to collect in home directory] 2025-10-09 21:11:57.078267 | controller | ok: All paths examined 2025-10-09 21:11:57.083297 | 2025-10-09 21:11:57.083356 | LOOP [Copy logs from home directory] 2025-10-09 21:11:57.661020 | controller | changed: 2025-10-09 21:11:57.661217 | controller | { 2025-10-09 21:11:57.661246 | controller | "atime": 1743544925.4788878, 2025-10-09 21:11:57.661267 | controller | "ctime": 1743545329.1409318, 2025-10-09 21:11:57.661284 | controller | "dev": 64513, 2025-10-09 21:11:57.661299 | controller | "gid": 1000, 2025-10-09 21:11:57.661313 | controller | "gr_name": "zuul", 2025-10-09 21:11:57.661327 | controller | "inode": 4518807, 2025-10-09 21:11:57.661341 | controller | "isblk": false, 2025-10-09 21:11:57.661354 | controller | "ischr": false, 2025-10-09 21:11:57.661367 | controller | "isdir": false, 2025-10-09 21:11:57.661380 | controller | "isfifo": false, 2025-10-09 21:11:57.661402 | controller | "isgid": false, 2025-10-09 21:11:57.661417 | controller | "islnk": false, 2025-10-09 21:11:57.661431 | controller | "isreg": true, 2025-10-09 21:11:57.661445 | controller | "issock": false, 2025-10-09 21:11:57.661458 | controller | "isuid": false, 2025-10-09 21:11:57.661471 | controller | "mode": "0644", 2025-10-09 21:11:57.661485 | controller | "mtime": 1743545329.1409318, 2025-10-09 21:11:57.661499 | controller | "nlink": 1, 2025-10-09 21:11:57.661515 | controller | "path": "/home/zuul/crc-setup.log", 2025-10-09 21:11:57.661529 | controller | "pw_name": "zuul", 2025-10-09 21:11:57.661542 | controller | "rgrp": true, 2025-10-09 21:11:57.661554 | controller | "roth": true, 2025-10-09 21:11:57.661566 | controller | "rusr": true, 2025-10-09 21:11:57.661578 | controller | "size": 4108, 2025-10-09 21:11:57.661590 | controller | "uid": 1000, 2025-10-09 21:11:57.661602 | controller | "wgrp": false, 2025-10-09 21:11:57.661614 | controller | "woth": false, 2025-10-09 21:11:57.661626 | controller | "wusr": true, 2025-10-09 21:11:57.661638 | controller | "xgrp": false, 2025-10-09 21:11:57.661649 | controller | "xoth": false, 2025-10-09 21:11:57.661661 | controller | "xusr": false 2025-10-09 21:11:57.661673 | controller | } 2025-10-09 21:11:58.227888 | controller | changed: 2025-10-09 21:11:58.227982 | controller | { 2025-10-09 21:11:58.228008 | controller | "atime": 1743545331.0429637, 2025-10-09 21:11:58.228027 | controller | "ctime": 1743545842.0111232, 2025-10-09 21:11:58.228044 | controller | "dev": 64513, 2025-10-09 21:11:58.228059 | controller | "gid": 1000, 2025-10-09 21:11:58.228074 | controller | "gr_name": "zuul", 2025-10-09 21:11:58.228089 | controller | "inode": 4194437, 2025-10-09 21:11:58.228104 | controller | "isblk": false, 2025-10-09 21:11:58.228117 | controller | "ischr": false, 2025-10-09 21:11:58.228130 | controller | "isdir": false, 2025-10-09 21:11:58.228143 | controller | "isfifo": false, 2025-10-09 21:11:58.228170 | controller | "isgid": false, 2025-10-09 21:11:58.228185 | controller | "islnk": false, 2025-10-09 21:11:58.228199 | controller | "isreg": true, 2025-10-09 21:11:58.228212 | controller | "issock": false, 2025-10-09 21:11:58.228226 | controller | "isuid": false, 2025-10-09 21:11:58.228238 | controller | "mode": "0644", 2025-10-09 21:11:58.228251 | controller | "mtime": 1743545842.0111232, 2025-10-09 21:11:58.228264 | controller | "nlink": 1, 2025-10-09 21:11:58.228277 | controller | "path": "/home/zuul/crc-start.log", 2025-10-09 21:11:58.228291 | controller | "pw_name": "zuul", 2025-10-09 21:11:58.228304 | controller | "rgrp": true, 2025-10-09 21:11:58.228317 | controller | "roth": true, 2025-10-09 21:11:58.228330 | controller | "rusr": true, 2025-10-09 21:11:58.228342 | controller | "size": 4023, 2025-10-09 21:11:58.228355 | controller | "uid": 1000, 2025-10-09 21:11:58.228367 | controller | "wgrp": false, 2025-10-09 21:11:58.228381 | controller | "woth": false, 2025-10-09 21:11:58.228394 | controller | "wusr": true, 2025-10-09 21:11:58.228407 | controller | "xgrp": false, 2025-10-09 21:11:58.228420 | controller | "xoth": false, 2025-10-09 21:11:58.228432 | controller | "xusr": false 2025-10-09 21:11:58.228445 | controller | } 2025-10-09 21:11:58.811903 | controller | changed: 2025-10-09 21:11:58.812095 | controller | { 2025-10-09 21:11:58.812127 | controller | "atime": 1760043712.4442527, 2025-10-09 21:11:58.812158 | controller | "ctime": 1760043728.6013536, 2025-10-09 21:11:58.812178 | controller | "dev": 64513, 2025-10-09 21:11:58.812195 | controller | "gid": 1000, 2025-10-09 21:11:58.812210 | controller | "gr_name": "zuul", 2025-10-09 21:11:58.812225 | controller | "inode": 4638648, 2025-10-09 21:11:58.812240 | controller | "isblk": false, 2025-10-09 21:11:58.812254 | controller | "ischr": false, 2025-10-09 21:11:58.812267 | controller | "isdir": false, 2025-10-09 21:11:58.812281 | controller | "isfifo": false, 2025-10-09 21:11:58.812295 | controller | "isgid": false, 2025-10-09 21:11:58.812309 | controller | "islnk": false, 2025-10-09 21:11:58.812324 | controller | "isreg": true, 2025-10-09 21:11:58.812340 | controller | "issock": false, 2025-10-09 21:11:58.812356 | controller | "isuid": false, 2025-10-09 21:11:58.812370 | controller | "mode": "0644", 2025-10-09 21:11:58.812384 | controller | "mtime": 1760043728.6013536, 2025-10-09 21:11:58.812398 | controller | "nlink": 1, 2025-10-09 21:11:58.812412 | controller | "path": "/home/zuul/ansible.log", 2025-10-09 21:11:58.812425 | controller | "pw_name": "zuul", 2025-10-09 21:11:58.812439 | controller | "rgrp": true, 2025-10-09 21:11:58.812453 | controller | "roth": true, 2025-10-09 21:11:58.812466 | controller | "rusr": true, 2025-10-09 21:11:58.812479 | controller | "size": 6749, 2025-10-09 21:11:58.812492 | controller | "uid": 1000, 2025-10-09 21:11:58.812507 | controller | "wgrp": false, 2025-10-09 21:11:58.812522 | controller | "woth": false, 2025-10-09 21:11:58.812536 | controller | "wusr": true, 2025-10-09 21:11:58.812549 | controller | "xgrp": false, 2025-10-09 21:11:58.812563 | controller | "xoth": false, 2025-10-09 21:11:58.812576 | controller | "xusr": false 2025-10-09 21:11:58.812589 | controller | } 2025-10-09 21:11:58.827971 | 2025-10-09 21:11:58.828036 | TASK [Copy crio stats log file] 2025-10-09 21:11:58.840780 | controller | skipping: Conditional result was False 2025-10-09 21:11:58.845926 | 2025-10-09 21:11:58.845995 | TASK [Get SELinux related data] 2025-10-09 21:11:58.868046 | [controller] Waiting on logger 2025-10-09 21:12:09.266475 | [controller] Waiting on logger 2025-10-09 21:12:18.610503 | [controller] Waiting on logger 2025-10-09 21:12:29.042466 | [controller] Waiting on logger 2025-10-09 21:12:29.145999 | [Zuul] Log Stream did not terminate 2025-10-09 21:12:29.146161 | controller | ERROR 2025-10-09 21:12:29.146260 | controller | { 2025-10-09 21:12:29.146291 | controller | "delta": "0:00:00.010333", 2025-10-09 21:12:29.146311 | controller | "end": "2025-10-09 21:11:59.126770", 2025-10-09 21:12:29.146330 | controller | "msg": "non-zero return code", 2025-10-09 21:12:29.146347 | controller | "rc": 1, 2025-10-09 21:12:29.146366 | controller | "start": "2025-10-09 21:11:59.116437" 2025-10-09 21:12:29.146386 | controller | } 2025-10-09 21:12:29.146410 | controller | ERROR: Ignoring Errors 2025-10-09 21:12:29.151101 | 2025-10-09 21:12:29.151166 | TASK [Create system configuration directory] 2025-10-09 21:12:29.402483 | controller | changed 2025-10-09 21:12:29.406949 | 2025-10-09 21:12:29.407027 | TASK [Get some of the system configurations] 2025-10-09 21:12:29.427142 | [controller] Waiting on logger 2025-10-09 21:12:36.839126 | controller | changed 2025-10-09 21:12:36.843779 | 2025-10-09 21:12:36.843836 | TASK [Copy generated documentation if available] 2025-10-09 21:12:36.856805 | controller | skipping: Conditional result was False 2025-10-09 21:12:36.861741 | 2025-10-09 21:12:36.861803 | TASK [Copy generated AsciiDoc documentation if available] 2025-10-09 21:12:36.874764 | controller | skipping: Conditional result was False 2025-10-09 21:12:36.879430 | 2025-10-09 21:12:36.879486 | TASK [Compress logs bigger than 2MB] 2025-10-09 21:12:37.938659 | [controller] Waiting on logger 2025-10-09 21:12:46.706552 | [controller] Waiting on logger 2025-10-09 21:12:47.653169 | controller | changed 2025-10-09 21:12:47.658318 | 2025-10-09 21:12:47.658381 | TASK [Copy files from workspace on node] 2025-10-09 21:12:47.676381 | controller | ok 2025-10-09 21:12:47.698038 | 2025-10-09 21:12:47.698109 | TASK [fetch-output : Set log path for multiple nodes] 2025-10-09 21:12:47.711479 | controller | skipping: Conditional result was False 2025-10-09 21:12:47.716857 | 2025-10-09 21:12:47.716938 | TASK [fetch-output : Set log path for single node] 2025-10-09 21:12:47.745175 | controller | ok 2025-10-09 21:12:47.749959 | 2025-10-09 21:12:47.750025 | LOOP [fetch-output : Ensure local output dirs] 2025-10-09 21:12:47.934509 | controller -> localhost | ok: "/var/lib/zuul/builds/ade6fa2c29a64550b8f2813b6c02d566/work/logs" 2025-10-09 21:12:47.934729 | controller -> localhost | changed: All items complete 2025-10-09 21:12:47.934759 | 2025-10-09 21:12:48.108300 | controller -> localhost | changed: "/var/lib/zuul/builds/ade6fa2c29a64550b8f2813b6c02d566/work/artifacts" 2025-10-09 21:12:48.280666 | controller -> localhost | changed: "/var/lib/zuul/builds/ade6fa2c29a64550b8f2813b6c02d566/work/docs" 2025-10-09 21:12:48.296511 | 2025-10-09 21:12:48.296604 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-10-09 21:12:48.946466 | controller | changed: 2025-10-09 21:12:48.946641 | controller | .d..t...... ./ 2025-10-09 21:12:48.946670 | controller | >f+++++++++ README.html 2025-10-09 21:12:48.946691 | controller | >f+++++++++ ansible-execution.log 2025-10-09 21:12:48.946710 | controller | >f+++++++++ ansible.log 2025-10-09 21:12:48.946728 | controller | >f+++++++++ crc-setup.log 2025-10-09 21:12:48.946744 | controller | >f+++++++++ crc-start.log 2025-10-09 21:12:48.946760 | controller | >f+++++++++ dmesg.log 2025-10-09 21:12:48.946776 | controller | >f+++++++++ installed-pkgs.log 2025-10-09 21:12:48.946791 | controller | >f+++++++++ python.log 2025-10-09 21:12:48.946808 | controller | >f+++++++++ registries.conf 2025-10-09 21:12:48.946824 | controller | >f+++++++++ report.html 2025-10-09 21:12:48.946839 | controller | >f+++++++++ selinux-denials.log 2025-10-09 21:12:48.946855 | controller | >f+++++++++ selinux-listing.log 2025-10-09 21:12:48.946870 | controller | cd+++++++++ ci-framework-data/ 2025-10-09 21:12:48.946885 | controller | cd+++++++++ ci-framework-data/artifacts/ 2025-10-09 21:12:48.946900 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2025-10-09 21:12:48.946939 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2025-10-09 21:12:48.946958 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2025-10-09 21:12:48.946974 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2025-10-09 21:12:48.946989 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2025-10-09 21:12:48.947003 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2025-10-09 21:12:48.947018 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2025-10-09 21:12:48.947032 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2025-10-09 21:12:48.947045 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2025-10-09 21:12:48.947060 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2025-10-09 21:12:48.947074 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2025-10-09 21:12:48.947088 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2025-10-09 21:12:48.947103 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2025-10-09 21:12:48.947116 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:8c:a6:a2 2025-10-09 21:12:48.947131 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:b1:f6:b3 2025-10-09 21:12:48.947146 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:c3:23:81 2025-10-09 21:12:48.947177 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:65:9a:33 2025-10-09 21:12:48.947194 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:3c:58:1b 2025-10-09 21:12:48.947209 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:cf:9b:f3 2025-10-09 21:12:48.947225 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2025-10-09 21:12:48.947241 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2025-10-09 21:12:48.947256 | controller | cd+++++++++ ci-framework-data/logs/ 2025-10-09 21:12:48.947270 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2025-10-09 21:12:48.947285 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2025-10-09 21:12:48.947299 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2025-10-09 21:12:48.947313 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2025-10-09 21:12:48.947327 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2025-10-09 21:12:48.947342 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2025-10-09 21:12:48.947356 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2025-10-09 21:12:48.947370 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2025-10-09 21:12:48.947384 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2025-10-09 21:12:48.947398 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2025-10-09 21:12:48.947412 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2025-10-09 21:12:48.947426 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2025-10-09 21:12:48.947439 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2025-10-09 21:12:48.947454 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2025-10-09 21:12:48.947469 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2025-10-09 21:12:48.947486 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2025-10-09 21:12:48.947502 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2025-10-09 21:12:48.947518 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2025-10-09 21:12:48.947533 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2025-10-09 21:12:48.947547 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2025-10-09 21:12:48.947562 | controller | cd+++++++++ registries.conf.d/ 2025-10-09 21:12:48.947576 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2025-10-09 21:12:48.947590 | controller | cd+++++++++ system-config/ 2025-10-09 21:12:48.947605 | controller | cd+++++++++ system-config/libvirt/ 2025-10-09 21:12:48.947620 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2025-10-09 21:12:48.947634 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2025-10-09 21:12:48.947648 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2025-10-09 21:12:48.947662 | controller | >f+++++++++ system-config/libvirt/network.conf 2025-10-09 21:12:48.947676 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2025-10-09 21:12:48.947690 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2025-10-09 21:12:48.947708 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2025-10-09 21:12:48.947723 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2025-10-09 21:12:48.947736 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2025-10-09 21:12:48.947750 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2025-10-09 21:12:48.947764 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2025-10-09 21:12:48.947778 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2025-10-09 21:12:48.947792 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2025-10-09 21:12:48.947806 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2025-10-09 21:12:48.947820 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2025-10-09 21:12:48.947835 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2025-10-09 21:12:49.431690 | controller | changed: .d..t...... ./ 2025-10-09 21:12:49.901679 | controller | changed: .d..t...... ./ 2025-10-09 21:12:49.922221 | 2025-10-09 21:12:49.922295 | TASK [Return artifact to Zuul] 2025-10-09 21:12:49.950421 | controller | ok 2025-10-09 21:12:49.968050 | 2025-10-09 21:12:49.968102 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2025-10-09 21:12:49.968476 | 2025-10-09 21:12:49.968508 | PLAY RECAP 2025-10-09 21:12:49.968544 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2025-10-09 21:12:49.968563 | 2025-10-09 21:12:50.043057 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-10-09 21:12:50.043773 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-10-09 21:12:50.533990 | 2025-10-09 21:12:50.534074 | PLAY [all] 2025-10-09 21:12:50.550872 | 2025-10-09 21:12:50.550955 | TASK [include_role : fetch-output] 2025-10-09 21:12:50.579251 | controller | ok 2025-10-09 21:12:50.595446 | 2025-10-09 21:12:50.595527 | TASK [fetch-output : Set log path for multiple nodes] 2025-10-09 21:12:50.629862 | controller | skipping: Conditional result was False 2025-10-09 21:12:50.635420 | 2025-10-09 21:12:50.635497 | TASK [fetch-output : Set log path for single node] 2025-10-09 21:12:50.662844 | controller | ok 2025-10-09 21:12:50.667591 | 2025-10-09 21:12:50.667661 | LOOP [fetch-output : Ensure local output dirs] 2025-10-09 21:12:50.971876 | controller -> localhost | ok: "/var/lib/zuul/builds/ade6fa2c29a64550b8f2813b6c02d566/work/logs" 2025-10-09 21:12:51.151540 | controller -> localhost | ok: "/var/lib/zuul/builds/ade6fa2c29a64550b8f2813b6c02d566/work/artifacts" 2025-10-09 21:12:51.326742 | controller -> localhost | ok: "/var/lib/zuul/builds/ade6fa2c29a64550b8f2813b6c02d566/work/docs" 2025-10-09 21:12:51.338529 | 2025-10-09 21:12:51.338624 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-10-09 21:12:51.932329 | controller | ok 2025-10-09 21:12:51.932553 | controller | ok: All items complete 2025-10-09 21:12:51.932584 | 2025-10-09 21:12:52.399968 | controller | ok 2025-10-09 21:12:52.872293 | controller | ok 2025-10-09 21:12:52.884553 | 2025-10-09 21:12:52.884658 | TASK [include_role : fetch-output-openshift] 2025-10-09 21:12:52.898534 | controller | skipping: Conditional result was False 2025-10-09 21:12:52.904014 | 2025-10-09 21:12:52.904081 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2025-10-09 21:12:53.229727 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006387 2025-10-09 21:12:53.417100 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006823 2025-10-09 21:12:53.449249 | 2025-10-09 21:12:53.449337 | PLAY [all] 2025-10-09 21:12:53.462787 | 2025-10-09 21:12:53.462853 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2025-10-09 21:12:53.938232 | controller | changed 2025-10-09 21:12:53.959457 | 2025-10-09 21:12:53.959510 | PLAY RECAP 2025-10-09 21:12:53.959554 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2025-10-09 21:12:53.959584 | 2025-10-09 21:12:54.025890 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-10-09 21:12:54.026645 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2025-10-09 21:12:54.549685 | 2025-10-09 21:12:54.549811 | PLAY [localhost] 2025-10-09 21:12:54.566235 | 2025-10-09 21:12:54.566308 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2025-10-09 21:12:54.867269 | localhost | changed 2025-10-09 21:12:54.871533 | 2025-10-09 21:12:54.871611 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2025-10-09 21:12:54.889555 | localhost | ok 2025-10-09 21:12:54.897052 | 2025-10-09 21:12:54.897160 | TASK [add-fileserver : Create SSH private key tempfile] 2025-10-09 21:12:55.177753 | localhost | changed 2025-10-09 21:12:55.183474 | 2025-10-09 21:12:55.183555 | TASK [add-fileserver : Create SSH private key from secret] 2025-10-09 21:12:55.686818 | localhost | changed 2025-10-09 21:12:55.691711 | 2025-10-09 21:12:55.691787 | TASK [add-fileserver : Add fileserver ssh key] 2025-10-09 21:12:56.012895 | localhost | Identity added: /var/lib/zuul/builds/ade6fa2c29a64550b8f2813b6c02d566/work/tmp/ansible.yu0a2alm (/var/lib/zuul/builds/ade6fa2c29a64550b8f2813b6c02d566/work/tmp/ansible.yu0a2alm) 2025-10-09 21:12:56.013066 | localhost | ok: Runtime: 0:00:00.006304 2025-10-09 21:12:56.017246 | 2025-10-09 21:12:56.017315 | TASK [add-fileserver : Remove SSH private key from disk] 2025-10-09 21:12:56.227647 | localhost | ok: Runtime: 0:00:00.004072 2025-10-09 21:12:56.232254 | 2025-10-09 21:12:56.232329 | TASK [add-fileserver : Add fileserver to inventory] 2025-10-09 21:12:56.280528 | localhost | changed 2025-10-09 21:12:56.285444 | 2025-10-09 21:12:56.285512 | TASK [add-fileserver : Add fileserver server to known hosts] 2025-10-09 21:12:56.586495 | localhost | changed 2025-10-09 21:12:56.607060 | 2025-10-09 21:12:56.607213 | PLAY [localhost] 2025-10-09 21:12:56.618410 | 2025-10-09 21:12:56.618470 | TASK [Generate bulk log download script] 2025-10-09 21:12:56.636302 | localhost | ok 2025-10-09 21:12:56.646485 | 2025-10-09 21:12:56.646549 | TASK [local-log-download : Check API endpoint is defined] 2025-10-09 21:12:56.673607 | localhost | ok: All assertions passed 2025-10-09 21:12:56.677797 | 2025-10-09 21:12:56.677860 | TASK [local-log-download : Create download script] 2025-10-09 21:12:57.004579 | localhost -> localhost | changed 2025-10-09 21:12:57.014037 | 2025-10-09 21:12:57.014100 | TASK [Register quick-download link] 2025-10-09 21:12:57.030660 | localhost | ok 2025-10-09 21:12:57.062460 | 2025-10-09 21:12:57.062523 | PLAY [logserver.rdoproject.org] 2025-10-09 21:12:57.071210 | 2025-10-09 21:12:57.071267 | TASK [Set zuul-log-path fact] 2025-10-09 21:12:57.086668 | logserver.rdoproject.org | ok 2025-10-09 21:12:57.095261 | 2025-10-09 21:12:57.095324 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-10-09 21:12:57.112610 | logserver.rdoproject.org | ok 2025-10-09 21:12:57.117715 | 2025-10-09 21:12:57.117773 | TASK [upload-logs : Create log directories] 2025-10-09 21:12:59.365443 | logserver.rdoproject.org | changed 2025-10-09 21:12:59.368226 | 2025-10-09 21:12:59.368284 | TASK [upload-logs : Ensure logs are readable before uploading] 2025-10-09 21:12:59.573776 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.004852 2025-10-09 21:12:59.577976 | 2025-10-09 21:12:59.578039 | TASK [upload-logs : Upload logs to log server] 2025-10-09 21:13:01.204893 | logserver.rdoproject.org | Output suppressed because no_log was given 2025-10-09 21:13:01.207814 | 2025-10-09 21:13:01.207880 | LOOP [upload-logs : Compress console log and json output] 2025-10-09 21:13:01.244811 | logserver.rdoproject.org | skipping: Conditional result was False 2025-10-09 21:13:01.252822 | logserver.rdoproject.org | skipping: Conditional result was False 2025-10-09 21:13:01.264853 | 2025-10-09 21:13:01.264949 | LOOP [upload-logs : Upload compressed console log and json output] 2025-10-09 21:13:01.298734 | logserver.rdoproject.org | skipping: Conditional result was False 2025-10-09 21:13:01.298999 | 2025-10-09 21:13:01.302113 | logserver.rdoproject.org | skipping: Conditional result was False 2025-10-09 21:13:01.312734 | 2025-10-09 21:13:01.312815 | LOOP [upload-logs : Upload console log and json output]