2026-02-26 16:50:59.448704 | Job console starting... 2026-02-26 16:50:59.663697 | Updating repositories 2026-02-26 16:51:00.407661 | Preparing job workspace 2026-02-26 16:51:09.336544 | Running Ansible setup... 2026-02-26 16:51:12.849158 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-26 16:51:13.351407 | 2026-02-26 16:51:13.351540 | PLAY [localhost] 2026-02-26 16:51:13.360073 | 2026-02-26 16:51:13.360144 | TASK [Gathering Facts] 2026-02-26 16:51:14.134353 | localhost | ok 2026-02-26 16:51:14.147788 | 2026-02-26 16:51:14.147918 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-02-26 16:51:14.444919 | localhost -> localhost | changed 2026-02-26 16:51:14.450091 | 2026-02-26 16:51:14.450176 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-02-26 16:51:15.070245 | localhost -> localhost | changed 2026-02-26 16:51:15.077631 | 2026-02-26 16:51:15.077698 | TASK [Setup log path fact] 2026-02-26 16:51:15.094143 | localhost | ok 2026-02-26 16:51:15.104110 | 2026-02-26 16:51:15.104171 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-26 16:51:15.120248 | localhost | ok 2026-02-26 16:51:15.127377 | 2026-02-26 16:51:15.127443 | TASK [emit-job-header : Print job information] 2026-02-26 16:51:15.153197 | # Job Information 2026-02-26 16:51:15.153312 | Ansible Version: 2.15.12 2026-02-26 16:51:15.153345 | Job: cifmw-molecule-reproducer 2026-02-26 16:51:15.153377 | Pipeline: github-check 2026-02-26 16:51:15.153398 | Executor: ibm-bm4-ze.softwarefactory-project.io 2026-02-26 16:51:15.153417 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3678 2026-02-26 16:51:15.153436 | Log URL (when completed): https://logserver.rdoproject.org/685/rdoproject.org/685d343c8f124555be0d56023affbe1d/ 2026-02-26 16:51:15.153454 | Event ID: 32ef9d20-1333-11f1-8fcc-5064e0056f8e 2026-02-26 16:51:15.157262 | 2026-02-26 16:51:15.157340 | LOOP [emit-job-header : Print node information] 2026-02-26 16:51:15.235760 | localhost | ok: 2026-02-26 16:51:15.235987 | localhost | # Node Information 2026-02-26 16:51:15.236016 | localhost | Inventory Hostname: controller 2026-02-26 16:51:15.236039 | localhost | Hostname: np0005631794 2026-02-26 16:51:15.236058 | localhost | Username: zuul 2026-02-26 16:51:15.236077 | localhost | Distro: CentOS 9 2026-02-26 16:51:15.236094 | localhost | Provider: ibm-bm4-nodepool 2026-02-26 16:51:15.236109 | localhost | Region: regionOne 2026-02-26 16:51:15.236124 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2026-02-26 16:51:15.236139 | localhost | Product Name: OpenStack Compute 2026-02-26 16:51:15.236154 | localhost | Interface IP: 192.168.26.42 2026-02-26 16:51:15.257472 | 2026-02-26 16:51:15.257543 | PLAY [all] 2026-02-26 16:51:15.263867 | 2026-02-26 16:51:15.263931 | TASK [Gather network facts] 2026-02-26 16:51:15.748143 | controller | ok 2026-02-26 16:51:15.761525 | 2026-02-26 16:51:15.761586 | TASK [include_role : start-zuul-console] 2026-02-26 16:51:15.778561 | controller | ok 2026-02-26 16:51:15.788485 | 2026-02-26 16:51:15.788545 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-02-26 16:51:16.161096 | controller | ok 2026-02-26 16:51:16.169283 | 2026-02-26 16:51:16.169370 | TASK [include_role : add-build-sshkey] 2026-02-26 16:51:16.186380 | controller | ok 2026-02-26 16:51:16.198203 | 2026-02-26 16:51:16.198263 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-02-26 16:51:16.373395 | controller -> localhost | ok 2026-02-26 16:51:16.378174 | 2026-02-26 16:51:16.378239 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-02-26 16:51:16.395673 | controller | ok 2026-02-26 16:51:16.406639 | controller | included: /var/lib/zuul/builds/685d343c8f124555be0d56023affbe1d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-02-26 16:51:16.411743 | 2026-02-26 16:51:16.411805 | TASK [add-build-sshkey : Create Temp SSH key] 2026-02-26 16:51:16.727874 | controller -> localhost | Generating public/private rsa key pair. 2026-02-26 16:51:16.728053 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/685d343c8f124555be0d56023affbe1d/work/685d343c8f124555be0d56023affbe1d_id_rsa. 2026-02-26 16:51:16.728085 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/685d343c8f124555be0d56023affbe1d/work/685d343c8f124555be0d56023affbe1d_id_rsa.pub. 2026-02-26 16:51:16.728107 | controller -> localhost | The key fingerprint is: 2026-02-26 16:51:16.728125 | controller -> localhost | SHA256:SdVpa3Hy7KpSmO2cADLRO9wd71WzIxqO9nLmz1ZWP4g zuul-build-sshkey 2026-02-26 16:51:16.728143 | controller -> localhost | The key's randomart image is: 2026-02-26 16:51:16.728160 | controller -> localhost | +---[RSA 3072]----+ 2026-02-26 16:51:16.728175 | controller -> localhost | | . .. . | 2026-02-26 16:51:16.728191 | controller -> localhost | | . . .. * ...| 2026-02-26 16:51:16.728205 | controller -> localhost | | o o.. + B .o| 2026-02-26 16:51:16.728220 | controller -> localhost | | o =.....+.+o.| 2026-02-26 16:51:16.728236 | controller -> localhost | | o oS+oo+oo +| 2026-02-26 16:51:16.728250 | controller -> localhost | | +ooE...+.| 2026-02-26 16:51:16.728265 | controller -> localhost | | .=.. .o .| 2026-02-26 16:51:16.728279 | controller -> localhost | | ..++o. | 2026-02-26 16:51:16.728317 | controller -> localhost | | .*ooo | 2026-02-26 16:51:16.728344 | controller -> localhost | +----[SHA256]-----+ 2026-02-26 16:51:16.728397 | controller -> localhost | ok: Runtime: 0:00:00.024754 2026-02-26 16:51:16.733496 | 2026-02-26 16:51:16.733556 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-02-26 16:51:16.750008 | controller | ok 2026-02-26 16:51:16.758633 | controller | included: /var/lib/zuul/builds/685d343c8f124555be0d56023affbe1d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-02-26 16:51:16.765524 | 2026-02-26 16:51:16.765583 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-02-26 16:51:16.778121 | controller | skipping: Conditional result was False 2026-02-26 16:51:16.783000 | 2026-02-26 16:51:16.783067 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-02-26 16:51:17.247246 | controller | changed 2026-02-26 16:51:17.251544 | 2026-02-26 16:51:17.251608 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-02-26 16:51:17.522236 | controller | ok 2026-02-26 16:51:17.526588 | 2026-02-26 16:51:17.526647 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-02-26 16:51:18.722503 | controller | changed 2026-02-26 16:51:18.727183 | 2026-02-26 16:51:18.727247 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-02-26 16:51:19.905983 | controller | changed 2026-02-26 16:51:19.910753 | 2026-02-26 16:51:19.910819 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-02-26 16:51:19.924072 | controller | skipping: Conditional result was False 2026-02-26 16:51:19.929332 | 2026-02-26 16:51:19.929409 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-02-26 16:51:20.209883 | controller -> localhost | changed 2026-02-26 16:51:20.218922 | 2026-02-26 16:51:20.219000 | TASK [add-build-sshkey : Add back temp key] 2026-02-26 16:51:20.434949 | controller -> localhost | Identity added: /var/lib/zuul/builds/685d343c8f124555be0d56023affbe1d/work/685d343c8f124555be0d56023affbe1d_id_rsa (zuul-build-sshkey) 2026-02-26 16:51:20.435097 | controller -> localhost | ok: Runtime: 0:00:00.006020 2026-02-26 16:51:20.440201 | 2026-02-26 16:51:20.440261 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-02-26 16:51:20.792677 | controller | ok 2026-02-26 16:51:20.797998 | 2026-02-26 16:51:20.798060 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-02-26 16:51:20.821568 | controller | skipping: Conditional result was False 2026-02-26 16:51:20.830048 | 2026-02-26 16:51:20.830107 | TASK [include_role : validate-host] 2026-02-26 16:51:20.846972 | controller | ok 2026-02-26 16:51:20.864086 | 2026-02-26 16:51:20.864146 | TASK [validate-host : Define zuul_info_dir fact] 2026-02-26 16:51:20.892265 | controller | ok 2026-02-26 16:51:20.896412 | 2026-02-26 16:51:20.896472 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-02-26 16:51:21.071934 | controller -> localhost | ok 2026-02-26 16:51:21.077128 | 2026-02-26 16:51:21.077189 | TASK [validate-host : Collect information about the host] 2026-02-26 16:51:21.813820 | controller | ok 2026-02-26 16:51:21.821364 | 2026-02-26 16:51:21.821422 | TASK [validate-host : Sanitize hostname] 2026-02-26 16:51:21.859174 | controller | ok 2026-02-26 16:51:21.863698 | 2026-02-26 16:51:21.863758 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-02-26 16:51:22.211808 | controller -> localhost | changed 2026-02-26 16:51:22.217480 | 2026-02-26 16:51:22.217552 | TASK [validate-host : Collect information about zuul worker] 2026-02-26 16:51:22.621600 | controller | ok 2026-02-26 16:51:22.626241 | 2026-02-26 16:51:22.626326 | TASK [validate-host : Write out all zuul information for each host] 2026-02-26 16:51:22.964577 | controller -> localhost | changed 2026-02-26 16:51:22.973027 | 2026-02-26 16:51:22.973088 | TASK [include_role : prepare-workspace-openshift] 2026-02-26 16:51:22.986409 | controller | skipping: Conditional result was False 2026-02-26 16:51:22.990949 | 2026-02-26 16:51:22.991008 | TASK [include_role : remove-zuul-sshkey] 2026-02-26 16:51:23.003933 | controller | skipping: Conditional result was False 2026-02-26 16:51:23.008452 | 2026-02-26 16:51:23.008514 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-02-26 16:51:23.270779 | controller | ok: "logs" 2026-02-26 16:51:23.271009 | controller | ok: All items complete 2026-02-26 16:51:23.271046 | 2026-02-26 16:51:23.512306 | controller | ok: "artifacts" 2026-02-26 16:51:23.750735 | controller | ok: "docs" 2026-02-26 16:51:23.758619 | 2026-02-26 16:51:23.758722 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-02-26 16:51:24.040954 | controller | changed: "logs" 2026-02-26 16:51:24.286550 | controller | changed: "artifacts" 2026-02-26 16:51:24.530702 | controller | changed: "docs" 2026-02-26 16:51:24.554156 | 2026-02-26 16:51:24.554256 | PLAY RECAP 2026-02-26 16:51:24.554314 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-26 16:51:24.554348 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-26 16:51:24.554380 | 2026-02-26 16:51:24.625372 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-26 16:51:24.626019 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-26 16:51:25.135038 | 2026-02-26 16:51:25.135136 | PLAY [all] 2026-02-26 16:51:25.152670 | 2026-02-26 16:51:25.152742 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-26 16:51:25.200965 | controller | ok 2026-02-26 16:51:25.205460 | 2026-02-26 16:51:25.205535 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-26 16:51:25.619215 | controller | changed 2026-02-26 16:51:25.624185 | 2026-02-26 16:51:25.624255 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-26 16:51:26.993043 | controller | changed 2026-02-26 16:51:27.002879 | 2026-02-26 16:51:27.002954 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2026-02-26 16:51:27.450185 | controller | changed: 2026-02-26 16:51:27.450396 | controller | { 2026-02-26 16:51:27.450429 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2026-02-26 16:51:27.450460 | controller | } 2026-02-26 16:51:27.743671 | controller | changed: 2026-02-26 16:51:27.743728 | controller | { 2026-02-26 16:51:27.743757 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2026-02-26 16:51:27.743778 | controller | } 2026-02-26 16:51:28.057727 | controller | changed: 2026-02-26 16:51:28.057830 | controller | { 2026-02-26 16:51:28.057859 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2026-02-26 16:51:28.057879 | controller | } 2026-02-26 16:51:28.368599 | controller | changed: 2026-02-26 16:51:28.368695 | controller | { 2026-02-26 16:51:28.368721 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2026-02-26 16:51:28.368741 | controller | } 2026-02-26 16:51:28.675766 | controller | changed: 2026-02-26 16:51:28.675959 | controller | { 2026-02-26 16:51:28.675998 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2026-02-26 16:51:28.676021 | controller | } 2026-02-26 16:51:28.980500 | controller | changed: 2026-02-26 16:51:28.980609 | controller | { 2026-02-26 16:51:28.980637 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2026-02-26 16:51:28.980856 | controller | } 2026-02-26 16:51:29.279289 | controller | changed: 2026-02-26 16:51:29.279378 | controller | { 2026-02-26 16:51:29.279404 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2026-02-26 16:51:29.279423 | controller | } 2026-02-26 16:51:29.591348 | controller | changed: 2026-02-26 16:51:29.592665 | controller | { 2026-02-26 16:51:29.592694 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2026-02-26 16:51:29.592716 | controller | } 2026-02-26 16:51:29.896067 | controller | changed: 2026-02-26 16:51:29.896153 | controller | { 2026-02-26 16:51:29.896180 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2026-02-26 16:51:29.896200 | controller | } 2026-02-26 16:51:30.196888 | controller | changed: 2026-02-26 16:51:30.196968 | controller | { 2026-02-26 16:51:30.196994 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2026-02-26 16:51:30.197014 | controller | } 2026-02-26 16:51:30.496524 | controller | changed: 2026-02-26 16:51:30.496621 | controller | { 2026-02-26 16:51:30.496648 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2026-02-26 16:51:30.496668 | controller | } 2026-02-26 16:51:30.812544 | controller | changed: 2026-02-26 16:51:30.812597 | controller | { 2026-02-26 16:51:30.812621 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2026-02-26 16:51:30.812640 | controller | } 2026-02-26 16:51:31.134985 | controller | changed: 2026-02-26 16:51:31.135039 | controller | { 2026-02-26 16:51:31.135065 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com" 2026-02-26 16:51:31.135085 | controller | } 2026-02-26 16:51:31.441413 | controller | changed: 2026-02-26 16:51:31.441483 | controller | { 2026-02-26 16:51:31.441509 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2026-02-26 16:51:31.441528 | controller | } 2026-02-26 16:51:31.750533 | controller | changed: 2026-02-26 16:51:31.750590 | controller | { 2026-02-26 16:51:31.750615 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2026-02-26 16:51:31.750635 | controller | } 2026-02-26 16:51:32.056582 | controller | changed: 2026-02-26 16:51:32.056713 | controller | { 2026-02-26 16:51:32.056745 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2026-02-26 16:51:32.056792 | controller | } 2026-02-26 16:51:32.367748 | controller | changed: 2026-02-26 16:51:32.367803 | controller | { 2026-02-26 16:51:32.367829 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2026-02-26 16:51:32.367850 | controller | } 2026-02-26 16:51:32.677224 | controller | changed: 2026-02-26 16:51:32.677276 | controller | { 2026-02-26 16:51:32.677324 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2026-02-26 16:51:32.677366 | controller | } 2026-02-26 16:51:32.991858 | controller | changed: 2026-02-26 16:51:32.991917 | controller | { 2026-02-26 16:51:32.991943 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2026-02-26 16:51:32.991963 | controller | } 2026-02-26 16:51:33.301038 | controller | changed: 2026-02-26 16:51:33.301108 | controller | { 2026-02-26 16:51:33.301134 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2026-02-26 16:51:33.301154 | controller | } 2026-02-26 16:51:33.610806 | controller | changed: 2026-02-26 16:51:33.610867 | controller | { 2026-02-26 16:51:33.610892 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2026-02-26 16:51:33.610912 | controller | } 2026-02-26 16:51:33.924171 | controller | changed: 2026-02-26 16:51:33.924259 | controller | { 2026-02-26 16:51:33.924285 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2026-02-26 16:51:33.924326 | controller | } 2026-02-26 16:51:34.260385 | controller | changed: 2026-02-26 16:51:34.260475 | controller | { 2026-02-26 16:51:34.260501 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2026-02-26 16:51:34.260522 | controller | } 2026-02-26 16:51:34.586890 | controller | changed: 2026-02-26 16:51:34.586965 | controller | { 2026-02-26 16:51:34.586989 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2026-02-26 16:51:34.587008 | controller | } 2026-02-26 16:51:34.907342 | controller | changed: 2026-02-26 16:51:34.907960 | controller | { 2026-02-26 16:51:34.908288 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2026-02-26 16:51:34.908337 | controller | } 2026-02-26 16:51:35.203099 | controller | changed: 2026-02-26 16:51:35.203188 | controller | { 2026-02-26 16:51:35.203214 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2026-02-26 16:51:35.203233 | controller | } 2026-02-26 16:51:35.223256 | 2026-02-26 16:51:35.223338 | TASK [Set timezone to UTC] 2026-02-26 16:51:35.738532 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2026-02-26 16:51:35.743122 | 2026-02-26 16:51:35.743192 | TASK [Create nodepool directory] 2026-02-26 16:51:36.035689 | controller | changed 2026-02-26 16:51:36.041073 | 2026-02-26 16:51:36.041138 | TASK [Create nodepool sub_nodes file] 2026-02-26 16:51:37.152731 | controller | changed 2026-02-26 16:51:37.157700 | 2026-02-26 16:51:37.157764 | TASK [Create nodepool sub_nodes_private file] 2026-02-26 16:51:38.248559 | controller | changed 2026-02-26 16:51:38.253683 | 2026-02-26 16:51:38.253766 | LOOP [Populate nodepool sub_nodes file] 2026-02-26 16:51:38.282900 | 2026-02-26 16:51:38.283024 | LOOP [Populate nodepool sub_nodes_private file] 2026-02-26 16:51:38.311125 | 2026-02-26 16:51:38.311248 | TASK [Create nodepool primary file] 2026-02-26 16:51:38.334507 | controller | skipping: Conditional result was False 2026-02-26 16:51:38.339747 | 2026-02-26 16:51:38.339822 | TASK [Create nodepool node_private for this node] 2026-02-26 16:51:39.465455 | controller | changed 2026-02-26 16:51:39.470690 | 2026-02-26 16:51:39.470751 | LOOP [Copy ssh keys to nodepool directory] 2026-02-26 16:51:39.873162 | controller | ok: Item: id_rsa Runtime: 0:00:00.005931 2026-02-26 16:51:39.873579 | 2026-02-26 16:51:40.118905 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.006112 2026-02-26 16:51:40.133134 | 2026-02-26 16:51:40.133226 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2026-02-26 16:51:41.249323 | controller | changed 2026-02-26 16:51:41.254015 | 2026-02-26 16:51:41.254075 | TASK [Validate sudoers config after edits] 2026-02-26 16:51:41.542906 | controller | /etc/sudoers: parsed OK 2026-02-26 16:51:41.542965 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2026-02-26 16:51:41.542976 | controller | /etc/sudoers.d/zuul: parsed OK 2026-02-26 16:51:41.542983 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2026-02-26 16:51:41.780370 | controller | ok: Runtime: 0:00:00.006200 2026-02-26 16:51:41.785530 | 2026-02-26 16:51:41.785588 | TASK [Show the environment passed in to job shell scripts] 2026-02-26 16:51:42.071009 | controller | SHELL=/bin/bash 2026-02-26 16:51:42.071074 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2026-02-26 16:51:42.071084 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2026-02-26 16:51:42.071092 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/78/3678/e0573c53557b6e057f6f6711b832528f0b93cdec 2026-02-26 16:51:42.071168 | controller | PWD=/home/zuul 2026-02-26 16:51:42.071178 | controller | ZUUL_PIPELINE=github-check 2026-02-26 16:51:42.071184 | controller | LOGNAME=zuul 2026-02-26 16:51:42.071190 | controller | XDG_SESSION_TYPE=tty 2026-02-26 16:51:42.071195 | controller | _=/usr/bin/env 2026-02-26 16:51:42.071200 | controller | MOTD_SHOWN=pam 2026-02-26 16:51:42.071206 | controller | HOME=/home/zuul 2026-02-26 16:51:42.071211 | controller | LANG=en_US.UTF-8 2026-02-26 16:51:42.071216 | controller | SSH_CONNECTION=192.168.26.12 38214 192.168.26.42 22 2026-02-26 16:51:42.071223 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2026-02-26 16:51:42.071234 | controller | ZUUL_CHANGE_IDS=3678,e0573c53557b6e057f6f6711b832528f0b93cdec 2026-02-26 16:51:42.071239 | controller | WORKSPACE=/home/zuul/workspace 2026-02-26 16:51:42.071245 | controller | XDG_SESSION_CLASS=user 2026-02-26 16:51:42.071251 | controller | SELINUX_ROLE_REQUESTED= 2026-02-26 16:51:42.071257 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2026-02-26 16:51:42.071263 | controller | USER=zuul 2026-02-26 16:51:42.071268 | controller | ZUUL_VOTING=True 2026-02-26 16:51:42.071274 | controller | BUILD_TIMEOUT=5400000 2026-02-26 16:51:42.071279 | controller | SELINUX_USE_CURRENT_RANGE= 2026-02-26 16:51:42.071284 | controller | SHLVL=1 2026-02-26 16:51:42.071290 | controller | ZUUL_PATCHSET=e0573c53557b6e057f6f6711b832528f0b93cdec 2026-02-26 16:51:42.071296 | controller | XDG_SESSION_ID=1 2026-02-26 16:51:42.071302 | controller | ZUUL_BRANCH=main 2026-02-26 16:51:42.071307 | controller | XDG_RUNTIME_DIR=/run/user/1000 2026-02-26 16:51:42.071313 | controller | SSH_CLIENT=192.168.26.12 38214 22 2026-02-26 16:51:42.071320 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2026-02-26 16:51:42.071326 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2026-02-26 16:51:42.071331 | controller | which_declare=declare -f 2026-02-26 16:51:42.071338 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2026-02-26 16:51:42.071344 | controller | SELINUX_LEVEL_REQUESTED= 2026-02-26 16:51:42.071349 | controller | ZUUL_CHANGE=3678 2026-02-26 16:51:42.071354 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2026-02-26 16:51:42.071360 | controller | ZUUL_UUID=685d343c8f124555be0d56023affbe1d 2026-02-26 16:51:42.071365 | controller | BASH_FUNC_which%%=() { ( alias; 2026-02-26 16:51:42.071370 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2026-02-26 16:51:42.071376 | controller | } 2026-02-26 16:51:42.310627 | controller | ok: Runtime: 0:00:00.007623 2026-02-26 16:51:42.315783 | 2026-02-26 16:51:42.315843 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2026-02-26 16:51:42.329412 | controller | skipping: Conditional result was False 2026-02-26 16:51:42.334619 | 2026-02-26 16:51:42.334686 | TASK [Symlink /home/zuul-worker/workspace] 2026-02-26 16:51:42.879343 | controller | skipping: Conditional result was False 2026-02-26 16:51:42.885067 | 2026-02-26 16:51:42.885138 | TASK [Ensure legacy workspace directory] 2026-02-26 16:51:43.147189 | controller | changed 2026-02-26 16:51:43.164807 | 2026-02-26 16:51:43.164861 | PLAY RECAP 2026-02-26 16:51:43.164906 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-26 16:51:43.164930 | 2026-02-26 16:51:43.233984 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-26 16:51:43.234761 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-26 16:51:43.729180 | 2026-02-26 16:51:43.729271 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2026-02-26 16:51:43.749430 | 2026-02-26 16:51:43.749505 | TASK [Create zuul-output directory] 2026-02-26 16:51:44.143713 | controller | changed 2026-02-26 16:51:44.149056 | 2026-02-26 16:51:44.149129 | TASK [Slurp Zuul inventory test] 2026-02-26 16:51:44.405934 | controller -> localhost | ok 2026-02-26 16:51:44.411743 | 2026-02-26 16:51:44.411811 | TASK [Save zuul inventory] 2026-02-26 16:51:45.750428 | controller | changed 2026-02-26 16:51:45.755875 | 2026-02-26 16:51:45.755938 | TASK [Save zuul vars without the change_message] 2026-02-26 16:51:46.932348 | controller | changed 2026-02-26 16:51:46.950850 | 2026-02-26 16:51:46.950905 | PLAY RECAP 2026-02-26 16:51:46.950949 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-26 16:51:46.950972 | 2026-02-26 16:51:47.011535 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-26 16:51:47.012323 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-26 16:51:47.527439 | 2026-02-26 16:51:47.527531 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2026-02-26 16:51:47.546491 | 2026-02-26 16:51:47.546562 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2026-02-26 16:51:47.564760 | controller | ok 2026-02-26 16:51:47.581187 | 2026-02-26 16:51:47.581268 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-26 16:51:47.604208 | controller | skipping: Conditional result was False 2026-02-26 16:51:47.609680 | 2026-02-26 16:51:47.609752 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-26 16:51:48.011744 | controller | ok 2026-02-26 16:51:48.017451 | 2026-02-26 16:51:48.017541 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-26 16:51:49.054877 | controller | ok 2026-02-26 16:51:49.064210 | 2026-02-26 16:51:49.064279 | TASK [Prepare workspace] 2026-02-26 16:51:49.082663 | controller | ok 2026-02-26 16:51:49.099072 | 2026-02-26 16:51:49.099144 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-02-26 16:51:49.474943 | controller | ok 2026-02-26 16:51:49.480599 | 2026-02-26 16:51:49.480664 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-02-26 16:51:51.898503 | controller | Output suppressed because no_log was given 2026-02-26 16:51:51.907654 | 2026-02-26 16:51:51.907723 | LOOP [Create zuul-output directory] 2026-02-26 16:51:52.192155 | controller | changed: "/home/zuul/ci-framework-data/logs" 2026-02-26 16:51:52.446918 | controller | ok: "/home/zuul/zuul-output/logs" 2026-02-26 16:51:52.457271 | 2026-02-26 16:51:52.457391 | TASK [Install required packages] 2026-02-26 16:52:16.505320 | controller | ok: Nothing to do 2026-02-26 16:52:16.510232 | 2026-02-26 16:52:16.510308 | TASK [Install venv] 2026-02-26 16:53:14.025734 | controller | changed 2026-02-26 16:53:14.049882 | 2026-02-26 16:53:14.049954 | PLAY RECAP 2026-02-26 16:53:14.050067 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-02-26 16:53:14.050097 | 2026-02-26 16:53:14.121730 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-26 16:53:14.122515 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-26 16:53:14.614632 | 2026-02-26 16:53:14.614726 | PLAY [Run ci/playbooks/molecule-test.yml] 2026-02-26 16:53:14.633565 | 2026-02-26 16:53:14.633635 | TASK [Gather required facts] 2026-02-26 16:53:15.160681 | controller | ok 2026-02-26 16:53:15.166035 | 2026-02-26 16:53:15.166113 | TASK [Load environment var if instructed to] 2026-02-26 16:53:15.190281 | controller | skipping: Conditional result was False 2026-02-26 16:53:15.195494 | 2026-02-26 16:53:15.195562 | TASK [Ensure group_vars dir exists] 2026-02-26 16:53:15.579032 | controller | ok 2026-02-26 16:53:15.584151 | 2026-02-26 16:53:15.584218 | TASK [Print related variables] 2026-02-26 16:53:15.612723 | controller | ok: 2026-02-26 16:53:15.612832 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2026-02-26 16:53:15.612860 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2026-02-26 16:53:15.617780 | 2026-02-26 16:53:15.617860 | TASK [Run molecule] 2026-02-26 16:53:16.599288 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2026-02-26 16:53:16.862058 | controller | INFO Performing prerun with role_name_check=0... 2026-02-26 16:53:34.049340 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 16:53:34.049724 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 16:53:34.050206 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 16:53:34.050651 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 16:53:34.051141 | controller | WARNING Another version of 'cifmw.general' 1.0.0+e0573c53 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+e0573c53 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 16:53:34.051635 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 16:53:34.052016 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 16:53:34.052457 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 16:53:34.052884 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 16:53:34.053302 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 16:53:34.053732 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 16:53:34.054190 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 16:53:34.054639 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 16:53:34.055091 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 16:53:34.055553 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-26 16:53:34.064893 | controller | INFO Running crc_layout > prepare 2026-02-26 16:53:34.752680 | controller | 2026-02-26 16:53:34.752741 | controller | PLAY [Prepare] ***************************************************************** 2026-02-26 16:53:34.752813 | controller | 2026-02-26 16:53:34.752941 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-26 16:53:34.753041 | controller | Thursday 26 February 2026 16:53:34 +0000 (0:00:00.019) 0:00:00.019 ***** 2026-02-26 16:53:35.601868 | controller | ok: [instance] 2026-02-26 16:53:35.601906 | controller | 2026-02-26 16:53:35.602070 | controller | TASK [Create custom basedir] *************************************************** 2026-02-26 16:53:35.602138 | controller | Thursday 26 February 2026 16:53:35 +0000 (0:00:00.849) 0:00:00.869 ***** 2026-02-26 16:53:35.919868 | controller | changed: [instance] 2026-02-26 16:53:35.919970 | controller | 2026-02-26 16:53:35.920069 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2026-02-26 16:53:35.920167 | controller | Thursday 26 February 2026 16:53:35 +0000 (0:00:00.318) 0:00:01.187 ***** 2026-02-26 16:53:35.940007 | controller | skipping: [instance] 2026-02-26 16:53:35.940112 | controller | 2026-02-26 16:53:35.940227 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2026-02-26 16:53:35.940352 | controller | Thursday 26 February 2026 16:53:35 +0000 (0:00:00.020) 0:00:01.207 ***** 2026-02-26 16:53:35.983297 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2026-02-26 16:53:35.983404 | controller | 2026-02-26 16:53:35.983542 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2026-02-26 16:53:35.983657 | controller | Thursday 26 February 2026 16:53:35 +0000 (0:00:00.043) 0:00:01.251 ***** 2026-02-26 16:53:36.265427 | controller | ok: [instance] 2026-02-26 16:53:36.265520 | controller | 2026-02-26 16:53:36.265617 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2026-02-26 16:53:36.265712 | controller | Thursday 26 February 2026 16:53:36 +0000 (0:00:00.282) 0:00:01.533 ***** 2026-02-26 16:53:36.482312 | controller | ok: [instance] 2026-02-26 16:53:36.482379 | controller | 2026-02-26 16:53:36.482493 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2026-02-26 16:53:36.482589 | controller | Thursday 26 February 2026 16:53:36 +0000 (0:00:00.216) 0:00:01.750 ***** 2026-02-26 16:53:37.188582 | controller | ok: [instance] => (item=ubi-9-appstream) 2026-02-26 16:53:37.188619 | controller | ok: [instance] => (item=ubi-9-baseos) 2026-02-26 16:53:37.188762 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2026-02-26 16:53:37.188835 | controller | 2026-02-26 16:53:37.188951 | controller | TASK [Deploy repo-setup] ******************************************************* 2026-02-26 16:53:37.189032 | controller | Thursday 26 February 2026 16:53:37 +0000 (0:00:00.706) 0:00:02.456 ***** 2026-02-26 16:53:37.249749 | controller | 2026-02-26 16:53:37.249878 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-26 16:53:37.250149 | controller | Thursday 26 February 2026 16:53:37 +0000 (0:00:00.061) 0:00:02.517 ***** 2026-02-26 16:53:37.784851 | controller | changed: [instance] => (item=tmp) 2026-02-26 16:53:37.784981 | controller | changed: [instance] => (item=artifacts/repositories) 2026-02-26 16:53:37.785089 | controller | changed: [instance] => (item=venv/repo_setup) 2026-02-26 16:53:37.785181 | controller | 2026-02-26 16:53:37.785276 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-26 16:53:37.785357 | controller | Thursday 26 February 2026 16:53:37 +0000 (0:00:00.534) 0:00:03.052 ***** 2026-02-26 16:53:38.610531 | controller | ok: [instance] 2026-02-26 16:53:38.610592 | controller | 2026-02-26 16:53:38.610859 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-26 16:53:39.748416 | controller | Thursday 26 February 2026 16:53:38 +0000 (0:00:00.825) 0:00:03.878 ***** 2026-02-26 16:53:39.748463 | controller | changed: [instance] 2026-02-26 16:53:47.167883 | controller | 2026-02-26 16:53:47.167932 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-26 16:53:47.167941 | controller | Thursday 26 February 2026 16:53:39 +0000 (0:00:01.137) 0:00:05.015 ***** 2026-02-26 16:53:47.167952 | controller | changed: [instance] 2026-02-26 16:53:47.867881 | controller | 2026-02-26 16:53:47.867914 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-26 16:53:47.867922 | controller | Thursday 26 February 2026 16:53:47 +0000 (0:00:07.419) 0:00:12.435 ***** 2026-02-26 16:53:47.867933 | controller | changed: [instance] 2026-02-26 16:53:47.891325 | controller | 2026-02-26 16:53:47.891342 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-26 16:53:47.891349 | controller | Thursday 26 February 2026 16:53:47 +0000 (0:00:00.700) 0:00:13.135 ***** 2026-02-26 16:53:47.891357 | controller | skipping: [instance] 2026-02-26 16:53:49.027365 | controller | 2026-02-26 16:53:49.027389 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-26 16:53:49.027396 | controller | Thursday 26 February 2026 16:53:47 +0000 (0:00:00.023) 0:00:13.159 ***** 2026-02-26 16:53:49.027405 | controller | changed: [instance] 2026-02-26 16:53:49.066171 | controller | 2026-02-26 16:53:49.066188 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-26 16:53:49.066196 | controller | Thursday 26 February 2026 16:53:49 +0000 (0:00:01.135) 0:00:14.294 ***** 2026-02-26 16:53:49.066204 | controller | skipping: [instance] 2026-02-26 16:53:49.102815 | controller | 2026-02-26 16:53:49.102849 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-26 16:53:49.102856 | controller | Thursday 26 February 2026 16:53:49 +0000 (0:00:00.039) 0:00:14.333 ***** 2026-02-26 16:53:49.102865 | controller | skipping: [instance] 2026-02-26 16:53:49.138119 | controller | 2026-02-26 16:53:49.138163 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-26 16:53:49.138172 | controller | Thursday 26 February 2026 16:53:49 +0000 (0:00:00.036) 0:00:14.370 ***** 2026-02-26 16:53:49.138183 | controller | skipping: [instance] 2026-02-26 16:53:49.138208 | controller | 2026-02-26 16:53:49.138589 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-26 16:53:53.021927 | controller | Thursday 26 February 2026 16:53:49 +0000 (0:00:00.035) 0:00:14.405 ***** 2026-02-26 16:53:53.021967 | controller | changed: [instance] 2026-02-26 16:53:53.022052 | controller | 2026-02-26 16:53:53.022062 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-26 16:53:53.022070 | controller | Thursday 26 February 2026 16:53:53 +0000 (0:00:03.883) 0:00:18.289 ***** 2026-02-26 16:53:53.471348 | controller | changed: [instance] 2026-02-26 16:53:53.503572 | controller | 2026-02-26 16:53:53.503594 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-26 16:53:53.503603 | controller | Thursday 26 February 2026 16:53:53 +0000 (0:00:00.449) 0:00:18.739 ***** 2026-02-26 16:53:53.503614 | controller | skipping: [instance] 2026-02-26 16:53:53.533945 | controller | 2026-02-26 16:53:53.533988 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-26 16:53:53.533998 | controller | Thursday 26 February 2026 16:53:53 +0000 (0:00:00.032) 0:00:18.771 ***** 2026-02-26 16:53:53.534016 | controller | skipping: [instance] 2026-02-26 16:53:53.534048 | controller | 2026-02-26 16:53:53.534058 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-26 16:53:53.564322 | controller | Thursday 26 February 2026 16:53:53 +0000 (0:00:00.030) 0:00:18.801 ***** 2026-02-26 16:53:53.564352 | controller | skipping: [instance] 2026-02-26 16:53:53.603324 | controller | 2026-02-26 16:53:53.603348 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-26 16:53:53.603356 | controller | Thursday 26 February 2026 16:53:53 +0000 (0:00:00.030) 0:00:18.832 ***** 2026-02-26 16:53:53.603365 | controller | ok: [instance] 2026-02-26 16:53:53.632379 | controller | 2026-02-26 16:53:53.632401 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-26 16:53:53.632411 | controller | Thursday 26 February 2026 16:53:53 +0000 (0:00:00.039) 0:00:18.871 ***** 2026-02-26 16:53:53.632430 | controller | skipping: [instance] 2026-02-26 16:53:53.660296 | controller | 2026-02-26 16:53:53.660315 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-26 16:53:53.660322 | controller | Thursday 26 February 2026 16:53:53 +0000 (0:00:00.028) 0:00:18.900 ***** 2026-02-26 16:53:53.660330 | controller | skipping: [instance] 2026-02-26 16:53:53.688022 | controller | 2026-02-26 16:53:53.688044 | controller | TASK [Download the RPM] ******************************************************** 2026-02-26 16:53:53.688053 | controller | Thursday 26 February 2026 16:53:53 +0000 (0:00:00.028) 0:00:18.928 ***** 2026-02-26 16:53:53.688062 | controller | skipping: [instance] 2026-02-26 16:53:53.688234 | controller | 2026-02-26 16:53:53.688388 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-26 16:53:53.688542 | controller | Thursday 26 February 2026 16:53:53 +0000 (0:00:00.028) 0:00:18.956 ***** 2026-02-26 16:53:53.715959 | controller | skipping: [instance] 2026-02-26 16:53:53.716124 | controller | 2026-02-26 16:53:53.716272 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-26 16:53:53.716394 | controller | Thursday 26 February 2026 16:53:53 +0000 (0:00:00.027) 0:00:18.984 ***** 2026-02-26 16:53:53.743399 | controller | skipping: [instance] 2026-02-26 16:53:53.743579 | controller | 2026-02-26 16:53:53.743745 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-26 16:53:53.743945 | controller | Thursday 26 February 2026 16:53:53 +0000 (0:00:00.027) 0:00:19.011 ***** 2026-02-26 16:53:53.778272 | controller | skipping: [instance] 2026-02-26 16:53:53.778429 | controller | 2026-02-26 16:53:53.778555 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-26 16:53:53.778675 | controller | Thursday 26 February 2026 16:53:53 +0000 (0:00:00.034) 0:00:19.046 ***** 2026-02-26 16:53:53.805652 | controller | skipping: [instance] 2026-02-26 16:53:53.805816 | controller | 2026-02-26 16:53:53.806019 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-26 16:53:53.806183 | controller | Thursday 26 February 2026 16:53:53 +0000 (0:00:00.027) 0:00:19.073 ***** 2026-02-26 16:53:53.995472 | controller | ok: [instance] 2026-02-26 16:53:54.216668 | controller | 2026-02-26 16:53:54.216697 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-26 16:53:54.216704 | controller | Thursday 26 February 2026 16:53:53 +0000 (0:00:00.188) 0:00:19.262 ***** 2026-02-26 16:53:54.216715 | controller | changed: [instance] 2026-02-26 16:53:54.449794 | controller | 2026-02-26 16:53:54.449840 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-26 16:53:54.449851 | controller | Thursday 26 February 2026 16:53:54 +0000 (0:00:00.221) 0:00:19.484 ***** 2026-02-26 16:53:54.449862 | controller | changed: [instance] 2026-02-26 16:53:54.472952 | controller | 2026-02-26 16:53:54.472983 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-26 16:53:54.472996 | controller | Thursday 26 February 2026 16:53:54 +0000 (0:00:00.233) 0:00:19.717 ***** 2026-02-26 16:53:54.473011 | controller | skipping: [instance] 2026-02-26 16:53:54.473047 | controller | 2026-02-26 16:53:54.473313 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-26 16:53:54.497275 | controller | Thursday 26 February 2026 16:53:54 +0000 (0:00:00.023) 0:00:19.741 ***** 2026-02-26 16:53:54.497358 | controller | skipping: [instance] 2026-02-26 16:53:54.521688 | controller | 2026-02-26 16:53:54.521712 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-26 16:53:54.521720 | controller | Thursday 26 February 2026 16:53:54 +0000 (0:00:00.023) 0:00:19.764 ***** 2026-02-26 16:53:54.521730 | controller | skipping: [instance] 2026-02-26 16:53:54.544796 | controller | 2026-02-26 16:53:54.544815 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-26 16:53:54.544843 | controller | Thursday 26 February 2026 16:53:54 +0000 (0:00:00.023) 0:00:19.788 ***** 2026-02-26 16:53:54.544852 | controller | skipping: [instance] 2026-02-26 16:53:54.568243 | controller | 2026-02-26 16:53:54.568262 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-26 16:53:54.568277 | controller | Thursday 26 February 2026 16:53:54 +0000 (0:00:00.023) 0:00:19.812 ***** 2026-02-26 16:53:54.568286 | controller | skipping: [instance] 2026-02-26 16:53:54.590960 | controller | 2026-02-26 16:53:54.590982 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-26 16:53:54.590991 | controller | Thursday 26 February 2026 16:53:54 +0000 (0:00:00.023) 0:00:19.836 ***** 2026-02-26 16:53:54.591004 | controller | skipping: [instance] 2026-02-26 16:53:54.591194 | controller | 2026-02-26 16:53:54.591369 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-26 16:53:54.591528 | controller | Thursday 26 February 2026 16:53:54 +0000 (0:00:00.022) 0:00:19.858 ***** 2026-02-26 16:53:54.608904 | controller | skipping: [instance] 2026-02-26 16:53:54.609054 | controller | 2026-02-26 16:53:54.609207 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-26 16:53:54.609339 | controller | Thursday 26 February 2026 16:53:54 +0000 (0:00:00.018) 0:00:19.876 ***** 2026-02-26 16:53:54.638360 | controller | skipping: [instance] 2026-02-26 16:53:54.638626 | controller | 2026-02-26 16:53:54.638919 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-26 16:53:54.639087 | controller | Thursday 26 February 2026 16:53:54 +0000 (0:00:00.029) 0:00:19.906 ***** 2026-02-26 16:53:54.656949 | controller | skipping: [instance] 2026-02-26 16:53:54.657241 | controller | 2026-02-26 16:53:54.657504 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-26 16:53:54.657761 | controller | Thursday 26 February 2026 16:53:54 +0000 (0:00:00.018) 0:00:19.924 ***** 2026-02-26 16:53:54.679659 | controller | skipping: [instance] 2026-02-26 16:53:54.679970 | controller | 2026-02-26 16:53:54.680270 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2026-02-26 16:53:54.680522 | controller | Thursday 26 February 2026 16:53:54 +0000 (0:00:00.022) 0:00:19.947 ***** 2026-02-26 16:53:54.712035 | controller | skipping: [instance] 2026-02-26 16:53:54.712211 | controller | 2026-02-26 16:53:54.712340 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2026-02-26 16:53:54.712460 | controller | Thursday 26 February 2026 16:53:54 +0000 (0:00:00.032) 0:00:19.980 ***** 2026-02-26 16:53:54.743001 | controller | skipping: [instance] 2026-02-26 16:53:54.743219 | controller | 2026-02-26 16:53:54.743348 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2026-02-26 16:53:54.743472 | controller | Thursday 26 February 2026 16:53:54 +0000 (0:00:00.030) 0:00:20.010 ***** 2026-02-26 16:53:54.776027 | controller | skipping: [instance] 2026-02-26 16:53:54.776205 | controller | 2026-02-26 16:53:54.776341 | controller | TASK [test_deps : Install additional packages] ********************************* 2026-02-26 16:53:54.776471 | controller | Thursday 26 February 2026 16:53:54 +0000 (0:00:00.033) 0:00:20.044 ***** 2026-02-26 16:53:54.807632 | controller | skipping: [instance] 2026-02-26 16:53:54.807796 | controller | 2026-02-26 16:53:54.807976 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2026-02-26 16:53:54.808148 | controller | Thursday 26 February 2026 16:53:54 +0000 (0:00:00.031) 0:00:20.075 ***** 2026-02-26 16:54:49.761271 | controller | ok: [instance] 2026-02-26 16:54:50.972964 | controller | 2026-02-26 16:54:50.973013 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2026-02-26 16:54:50.973024 | controller | Thursday 26 February 2026 16:54:49 +0000 (0:00:54.952) 0:01:15.028 ***** 2026-02-26 16:54:50.973039 | controller | ok: [instance] 2026-02-26 16:54:51.007018 | controller | 2026-02-26 16:54:51.007070 | controller | TASK [test_deps : Install extra packages] ************************************** 2026-02-26 16:54:51.007081 | controller | Thursday 26 February 2026 16:54:50 +0000 (0:00:01.211) 0:01:16.240 ***** 2026-02-26 16:54:51.007096 | controller | skipping: [instance] 2026-02-26 16:54:51.049990 | controller | 2026-02-26 16:54:51.050037 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-26 16:54:51.050048 | controller | Thursday 26 February 2026 16:54:51 +0000 (0:00:00.034) 0:01:16.274 ***** 2026-02-26 16:54:51.050062 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2026-02-26 16:54:51.072404 | controller | 2026-02-26 16:54:51.072462 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-26 16:54:51.072481 | controller | Thursday 26 February 2026 16:54:51 +0000 (0:00:00.042) 0:01:16.317 ***** 2026-02-26 16:54:51.072497 | controller | ok: [instance] => 2026-02-26 16:54:59.319774 | controller | cifmw_ci_setup_packages: 2026-02-26 16:54:59.319837 | controller | - bash-completion 2026-02-26 16:54:59.319849 | controller | - ca-certificates 2026-02-26 16:54:59.319855 | controller | - git-core 2026-02-26 16:54:59.319861 | controller | - make 2026-02-26 16:54:59.319867 | controller | - tar 2026-02-26 16:54:59.319872 | controller | - tmux 2026-02-26 16:54:59.319878 | controller | - python3-pip 2026-02-26 16:54:59.319883 | controller | 2026-02-26 16:54:59.319889 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-26 16:54:59.319895 | controller | Thursday 26 February 2026 16:54:51 +0000 (0:00:00.021) 0:01:16.339 ***** 2026-02-26 16:54:59.319906 | controller | changed: [instance] 2026-02-26 16:54:59.319936 | controller | 2026-02-26 16:54:59.319953 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-26 16:54:59.320120 | controller | Thursday 26 February 2026 16:54:59 +0000 (0:00:08.248) 0:01:24.587 ***** 2026-02-26 16:54:59.905696 | controller | ok: [instance] 2026-02-26 16:55:00.114652 | controller | 2026-02-26 16:55:00.114684 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-26 16:55:00.114693 | controller | Thursday 26 February 2026 16:54:59 +0000 (0:00:00.585) 0:01:25.173 ***** 2026-02-26 16:55:00.114705 | controller | changed: [instance] 2026-02-26 16:55:06.155466 | controller | 2026-02-26 16:55:06.155508 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-26 16:55:06.155516 | controller | Thursday 26 February 2026 16:55:00 +0000 (0:00:00.208) 0:01:25.382 ***** 2026-02-26 16:55:06.155528 | controller | changed: [instance] 2026-02-26 16:55:06.192665 | controller | 2026-02-26 16:55:06.192685 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-26 16:55:06.192693 | controller | Thursday 26 February 2026 16:55:06 +0000 (0:00:06.039) 0:01:31.421 ***** 2026-02-26 16:55:06.192702 | controller | ok: [instance] 2026-02-26 16:55:06.468781 | controller | 2026-02-26 16:55:06.468834 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-26 16:55:06.468847 | controller | Thursday 26 February 2026 16:55:06 +0000 (0:00:00.038) 0:01:31.460 ***** 2026-02-26 16:55:06.468859 | controller | changed: [instance] 2026-02-26 16:55:06.740794 | controller | 2026-02-26 16:55:06.740848 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-26 16:55:06.740860 | controller | Thursday 26 February 2026 16:55:06 +0000 (0:00:00.275) 0:01:31.736 ***** 2026-02-26 16:55:06.740872 | controller | changed: [instance] 2026-02-26 16:55:06.757633 | controller | 2026-02-26 16:55:06.757663 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-26 16:55:06.757671 | controller | Thursday 26 February 2026 16:55:06 +0000 (0:00:00.272) 0:01:32.008 ***** 2026-02-26 16:55:06.757683 | controller | skipping: [instance] 2026-02-26 16:55:06.778949 | controller | 2026-02-26 16:55:06.778973 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-26 16:55:06.778981 | controller | Thursday 26 February 2026 16:55:06 +0000 (0:00:00.017) 0:01:32.025 ***** 2026-02-26 16:55:06.778991 | controller | skipping: [instance] 2026-02-26 16:55:06.780016 | controller | 2026-02-26 16:55:06.780055 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-26 16:55:06.780164 | controller | Thursday 26 February 2026 16:55:06 +0000 (0:00:00.018) 0:01:32.044 ***** 2026-02-26 16:55:06.839691 | controller | skipping: [instance] 2026-02-26 16:55:06.855170 | controller | 2026-02-26 16:55:06.855188 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-26 16:55:06.855196 | controller | Thursday 26 February 2026 16:55:06 +0000 (0:00:00.063) 0:01:32.107 ***** 2026-02-26 16:55:06.855204 | controller | skipping: [instance] 2026-02-26 16:55:06.872286 | controller | 2026-02-26 16:55:06.872304 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-26 16:55:06.872316 | controller | Thursday 26 February 2026 16:55:06 +0000 (0:00:00.015) 0:01:32.123 ***** 2026-02-26 16:55:06.872325 | controller | skipping: [instance] 2026-02-26 16:55:06.872455 | controller | 2026-02-26 16:55:06.872585 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-26 16:55:06.872711 | controller | Thursday 26 February 2026 16:55:06 +0000 (0:00:00.017) 0:01:32.140 ***** 2026-02-26 16:55:06.895506 | controller | skipping: [instance] 2026-02-26 16:55:06.895664 | controller | 2026-02-26 16:55:06.895834 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-26 16:55:06.895978 | controller | Thursday 26 February 2026 16:55:06 +0000 (0:00:00.023) 0:01:32.163 ***** 2026-02-26 16:55:07.852943 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2026-02-26 16:55:07.852992 | controller | changed: [instance] => (item=/opt/basedir/logs) 2026-02-26 16:55:07.853000 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2026-02-26 16:55:07.853006 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2026-02-26 16:55:07.853014 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2026-02-26 16:55:07.853283 | controller | 2026-02-26 16:55:08.185953 | controller | TASK [Create secret file] ****************************************************** 2026-02-26 16:55:08.185994 | controller | Thursday 26 February 2026 16:55:07 +0000 (0:00:00.955) 0:01:33.118 ***** 2026-02-26 16:55:08.186018 | controller | changed: [instance] 2026-02-26 16:55:08.186054 | controller | 2026-02-26 16:55:08.186063 | controller | PLAY RECAP ********************************************************************* 2026-02-26 16:55:08.186071 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2026-02-26 16:55:08.186078 | controller | 2026-02-26 16:55:08.186087 | controller | Thursday 26 February 2026 16:55:08 +0000 (0:00:00.334) 0:01:33.453 ***** 2026-02-26 16:55:08.187849 | controller | =============================================================================== 2026-02-26 16:55:08.187876 | controller | test_deps : Install selinux python libs -------------------------------- 54.95s 2026-02-26 16:55:08.243809 | controller | ci_setup : Install needed packages -------------------------------------- 8.25s 2026-02-26 16:55:08.243864 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.42s 2026-02-26 16:55:08.243871 | controller | ci_setup : Install openshift client ------------------------------------- 6.04s 2026-02-26 16:55:08.243876 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 3.88s 2026-02-26 16:55:08.243881 | controller | test_deps : Install python yaml libs ------------------------------------ 1.21s 2026-02-26 16:55:08.243886 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.14s 2026-02-26 16:55:08.243891 | controller | repo_setup : Run repo-setup --------------------------------------------- 1.14s 2026-02-26 16:55:08.243896 | controller | ci_setup : Manage directories ------------------------------------------- 0.96s 2026-02-26 16:55:08.243901 | controller | Gathering Facts --------------------------------------------------------- 0.85s 2026-02-26 16:55:08.243906 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.83s 2026-02-26 16:55:08.243911 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.71s 2026-02-26 16:55:08.243915 | controller | repo_setup : Install repo-setup package --------------------------------- 0.70s 2026-02-26 16:55:08.243920 | controller | ci_setup : Gather version of openshift client --------------------------- 0.59s 2026-02-26 16:55:08.243924 | controller | repo_setup : Ensure directories are present ----------------------------- 0.53s 2026-02-26 16:55:08.243929 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.45s 2026-02-26 16:55:08.243934 | controller | Create secret file ------------------------------------------------------ 0.33s 2026-02-26 16:55:08.243938 | controller | Create custom basedir --------------------------------------------------- 0.32s 2026-02-26 16:55:08.243945 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.28s 2026-02-26 16:55:08.243955 | controller | ci_setup : Create completion file --------------------------------------- 0.28s 2026-02-26 16:55:08.243967 | controller | INFO Running crc_layout > converge 2026-02-26 16:55:08.812033 | controller | 2026-02-26 16:55:08.812283 | controller | PLAY [Converge] **************************************************************** 2026-02-26 16:55:08.812429 | controller | 2026-02-26 16:55:08.812564 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-26 16:55:08.812689 | controller | Thursday 26 February 2026 16:55:08 +0000 (0:00:00.025) 0:00:00.025 ***** 2026-02-26 16:55:09.629959 | controller | ok: [instance] 2026-02-26 16:55:09.630025 | controller | 2026-02-26 16:55:09.630035 | controller | TASK [Load networking definition from scenario file] *************************** 2026-02-26 16:55:09.630044 | controller | Thursday 26 February 2026 16:55:09 +0000 (0:00:00.817) 0:00:00.842 ***** 2026-02-26 16:55:09.649883 | controller | ok: [instance] 2026-02-26 16:55:11.238348 | controller | 2026-02-26 16:55:11.238378 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-26 16:55:11.238386 | controller | Thursday 26 February 2026 16:55:09 +0000 (0:00:00.020) 0:00:00.863 ***** 2026-02-26 16:55:11.238396 | controller | changed: [instance] 2026-02-26 16:55:11.263950 | controller | 2026-02-26 16:55:11.263979 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-26 16:55:11.263995 | controller | Thursday 26 February 2026 16:55:11 +0000 (0:00:01.588) 0:00:02.451 ***** 2026-02-26 16:55:11.264007 | controller | ok: [instance] 2026-02-26 16:55:11.264038 | controller | 2026-02-26 16:55:11.264237 | controller | TASK [reproducer : Load CI job environment] ************************************ 2026-02-26 16:55:11.285507 | controller | Thursday 26 February 2026 16:55:11 +0000 (0:00:00.025) 0:00:02.477 ***** 2026-02-26 16:55:11.285533 | controller | skipping: [instance] 2026-02-26 16:55:11.334396 | controller | 2026-02-26 16:55:11.334415 | controller | TASK [Build final libvirt layout] ********************************************** 2026-02-26 16:55:11.334422 | controller | Thursday 26 February 2026 16:55:11 +0000 (0:00:00.021) 0:00:02.498 ***** 2026-02-26 16:55:11.334430 | controller | 2026-02-26 16:55:11.413241 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2026-02-26 16:55:11.413268 | controller | Thursday 26 February 2026 16:55:11 +0000 (0:00:00.049) 0:00:02.547 ***** 2026-02-26 16:55:11.413281 | controller | ok: [instance] 2026-02-26 16:55:11.482339 | controller | 2026-02-26 16:55:11.482368 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2026-02-26 16:55:11.482377 | controller | Thursday 26 February 2026 16:55:11 +0000 (0:00:00.078) 0:00:02.626 ***** 2026-02-26 16:55:11.482389 | controller | skipping: [instance] 2026-02-26 16:55:11.482874 | controller | 2026-02-26 16:55:11.483019 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2026-02-26 16:55:11.483163 | controller | Thursday 26 February 2026 16:55:11 +0000 (0:00:00.068) 0:00:02.694 ***** 2026-02-26 16:55:11.507701 | controller | ok: [instance] 2026-02-26 16:55:11.507893 | controller | 2026-02-26 16:55:11.508053 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2026-02-26 16:55:11.508222 | controller | Thursday 26 February 2026 16:55:11 +0000 (0:00:00.026) 0:00:02.721 ***** 2026-02-26 16:55:11.530251 | controller | ok: [instance] => changed=false 2026-02-26 16:55:11.530426 | controller | msg: All assertions passed 2026-02-26 16:55:11.530579 | controller | 2026-02-26 16:55:11.530751 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2026-02-26 16:55:11.530924 | controller | Thursday 26 February 2026 16:55:11 +0000 (0:00:00.022) 0:00:02.743 ***** 2026-02-26 16:55:11.571664 | controller | ok: [instance] 2026-02-26 16:55:11.571873 | controller | 2026-02-26 16:55:11.572052 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2026-02-26 16:55:11.572226 | controller | Thursday 26 February 2026 16:55:11 +0000 (0:00:00.041) 0:00:02.784 ***** 2026-02-26 16:55:12.005363 | controller | ok: [instance] => (item=artifacts) 2026-02-26 16:55:12.076589 | controller | ok: [instance] => (item=logs) 2026-02-26 16:55:12.076624 | controller | 2026-02-26 16:55:12.076634 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2026-02-26 16:55:12.076649 | controller | Thursday 26 February 2026 16:55:12 +0000 (0:00:00.433) 0:00:03.218 ***** 2026-02-26 16:55:12.076657 | controller | 2026-02-26 16:55:12.255791 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2026-02-26 16:55:12.255837 | controller | Thursday 26 February 2026 16:55:12 +0000 (0:00:00.071) 0:00:03.289 ***** 2026-02-26 16:55:12.255854 | controller | ok: [instance] 2026-02-26 16:55:12.529807 | controller | 2026-02-26 16:55:12.529888 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2026-02-26 16:55:12.529897 | controller | Thursday 26 February 2026 16:55:12 +0000 (0:00:00.179) 0:00:03.468 ***** 2026-02-26 16:55:12.529907 | controller | changed: [instance] 2026-02-26 16:55:12.807624 | controller | 2026-02-26 16:55:12.807655 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2026-02-26 16:55:12.807663 | controller | Thursday 26 February 2026 16:55:12 +0000 (0:00:00.273) 0:00:03.742 ***** 2026-02-26 16:55:12.807674 | controller | ok: [instance] 2026-02-26 16:55:12.837502 | controller | 2026-02-26 16:55:12.837527 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2026-02-26 16:55:12.837535 | controller | Thursday 26 February 2026 16:55:12 +0000 (0:00:00.277) 0:00:04.020 ***** 2026-02-26 16:55:12.837545 | controller | skipping: [instance] 2026-02-26 16:55:12.855736 | controller | 2026-02-26 16:55:12.855756 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2026-02-26 16:55:12.855765 | controller | Thursday 26 February 2026 16:55:12 +0000 (0:00:00.030) 0:00:04.050 ***** 2026-02-26 16:55:12.855775 | controller | skipping: [instance] 2026-02-26 16:55:12.877001 | controller | 2026-02-26 16:55:12.877048 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2026-02-26 16:55:12.877060 | controller | Thursday 26 February 2026 16:55:12 +0000 (0:00:00.018) 0:00:04.068 ***** 2026-02-26 16:55:12.877075 | controller | ok: [instance] 2026-02-26 16:55:12.904943 | controller | 2026-02-26 16:55:12.904966 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2026-02-26 16:55:12.904982 | controller | Thursday 26 February 2026 16:55:12 +0000 (0:00:00.021) 0:00:04.090 ***** 2026-02-26 16:55:12.904994 | controller | skipping: [instance] 2026-02-26 16:55:21.485750 | controller | 2026-02-26 16:55:21.485780 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2026-02-26 16:55:21.485789 | controller | Thursday 26 February 2026 16:55:12 +0000 (0:00:00.028) 0:00:04.118 ***** 2026-02-26 16:55:21.485799 | controller | changed: [instance] 2026-02-26 16:55:21.693901 | controller | 2026-02-26 16:55:21.693942 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2026-02-26 16:55:21.693951 | controller | Thursday 26 February 2026 16:55:21 +0000 (0:00:08.580) 0:00:12.698 ***** 2026-02-26 16:55:21.693961 | controller | changed: [instance] 2026-02-26 16:55:21.693968 | controller | 2026-02-26 16:55:21.693985 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2026-02-26 16:55:21.694140 | controller | Thursday 26 February 2026 16:55:21 +0000 (0:00:00.208) 0:00:12.906 ***** 2026-02-26 16:55:22.190714 | controller | changed: [instance] 2026-02-26 16:55:22.813450 | controller | 2026-02-26 16:55:22.813485 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2026-02-26 16:55:22.813493 | controller | Thursday 26 February 2026 16:55:22 +0000 (0:00:00.496) 0:00:13.403 ***** 2026-02-26 16:55:22.813504 | controller | changed: [instance] 2026-02-26 16:55:23.018465 | controller | 2026-02-26 16:55:23.018493 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2026-02-26 16:55:23.018501 | controller | Thursday 26 February 2026 16:55:22 +0000 (0:00:00.622) 0:00:14.026 ***** 2026-02-26 16:55:23.018511 | controller | ok: [instance] 2026-02-26 16:55:23.670706 | controller | 2026-02-26 16:55:23.670739 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2026-02-26 16:55:23.670748 | controller | Thursday 26 February 2026 16:55:23 +0000 (0:00:00.205) 0:00:14.231 ***** 2026-02-26 16:55:23.670759 | controller | ok: [instance] 2026-02-26 16:55:24.433926 | controller | 2026-02-26 16:55:24.433970 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2026-02-26 16:55:24.433986 | controller | Thursday 26 February 2026 16:55:23 +0000 (0:00:00.652) 0:00:14.883 ***** 2026-02-26 16:55:24.433998 | controller | changed: [instance] 2026-02-26 16:55:24.434024 | controller | 2026-02-26 16:55:24.434214 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2026-02-26 16:55:24.536908 | controller | Thursday 26 February 2026 16:55:24 +0000 (0:00:00.763) 0:00:15.647 ***** 2026-02-26 16:55:24.536965 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2026-02-26 16:55:24.855659 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2026-02-26 16:55:24.855688 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2026-02-26 16:55:24.855696 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2026-02-26 16:55:24.855702 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2026-02-26 16:55:24.855708 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2026-02-26 16:55:24.855713 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2026-02-26 16:55:24.855718 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2026-02-26 16:55:24.855724 | controller | 2026-02-26 16:55:24.855730 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2026-02-26 16:55:24.855736 | controller | Thursday 26 February 2026 16:55:24 +0000 (0:00:00.102) 0:00:15.749 ***** 2026-02-26 16:55:24.855746 | controller | ok: [instance] 2026-02-26 16:55:25.170613 | controller | 2026-02-26 16:55:25.170641 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2026-02-26 16:55:25.170649 | controller | Thursday 26 February 2026 16:55:24 +0000 (0:00:00.319) 0:00:16.068 ***** 2026-02-26 16:55:25.170659 | controller | ok: [instance] 2026-02-26 16:55:25.488430 | controller | 2026-02-26 16:55:25.488459 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2026-02-26 16:55:25.488467 | controller | Thursday 26 February 2026 16:55:25 +0000 (0:00:00.314) 0:00:16.383 ***** 2026-02-26 16:55:25.488477 | controller | ok: [instance] 2026-02-26 16:55:25.802906 | controller | 2026-02-26 16:55:25.802947 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2026-02-26 16:55:25.802955 | controller | Thursday 26 February 2026 16:55:25 +0000 (0:00:00.317) 0:00:16.701 ***** 2026-02-26 16:55:25.802967 | controller | ok: [instance] 2026-02-26 16:55:25.802991 | controller | 2026-02-26 16:55:25.803213 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2026-02-26 16:55:26.123793 | controller | Thursday 26 February 2026 16:55:25 +0000 (0:00:00.314) 0:00:17.016 ***** 2026-02-26 16:55:26.123845 | controller | ok: [instance] 2026-02-26 16:55:26.439715 | controller | 2026-02-26 16:55:26.439747 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2026-02-26 16:55:26.439755 | controller | Thursday 26 February 2026 16:55:26 +0000 (0:00:00.320) 0:00:17.336 ***** 2026-02-26 16:55:26.439766 | controller | ok: [instance] 2026-02-26 16:55:26.748709 | controller | 2026-02-26 16:55:26.748737 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2026-02-26 16:55:26.748744 | controller | Thursday 26 February 2026 16:55:26 +0000 (0:00:00.315) 0:00:17.652 ***** 2026-02-26 16:55:26.748760 | controller | ok: [instance] 2026-02-26 16:55:27.059612 | controller | 2026-02-26 16:55:27.059639 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2026-02-26 16:55:27.059646 | controller | Thursday 26 February 2026 16:55:26 +0000 (0:00:00.309) 0:00:17.961 ***** 2026-02-26 16:55:27.059661 | controller | ok: [instance] 2026-02-26 16:55:27.378161 | controller | 2026-02-26 16:55:27.378192 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2026-02-26 16:55:27.378201 | controller | Thursday 26 February 2026 16:55:27 +0000 (0:00:00.310) 0:00:18.272 ***** 2026-02-26 16:55:27.378211 | controller | ok: [instance] 2026-02-26 16:55:28.705029 | controller | 2026-02-26 16:55:28.705077 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2026-02-26 16:55:28.705091 | controller | Thursday 26 February 2026 16:55:27 +0000 (0:00:00.318) 0:00:18.591 ***** 2026-02-26 16:55:28.705109 | controller | ok: [instance] 2026-02-26 16:55:29.021446 | controller | 2026-02-26 16:55:29.021475 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2026-02-26 16:55:29.021483 | controller | Thursday 26 February 2026 16:55:28 +0000 (0:00:01.326) 0:00:19.918 ***** 2026-02-26 16:55:29.021493 | controller | ok: [instance] 2026-02-26 16:55:29.342708 | controller | 2026-02-26 16:55:29.342737 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2026-02-26 16:55:29.342746 | controller | Thursday 26 February 2026 16:55:29 +0000 (0:00:00.316) 0:00:20.234 ***** 2026-02-26 16:55:29.342756 | controller | ok: [instance] 2026-02-26 16:55:29.654492 | controller | 2026-02-26 16:55:29.654522 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2026-02-26 16:55:29.654530 | controller | Thursday 26 February 2026 16:55:29 +0000 (0:00:00.321) 0:00:20.555 ***** 2026-02-26 16:55:29.654540 | controller | ok: [instance] 2026-02-26 16:55:29.983581 | controller | 2026-02-26 16:55:29.983610 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2026-02-26 16:55:29.983618 | controller | Thursday 26 February 2026 16:55:29 +0000 (0:00:00.311) 0:00:20.867 ***** 2026-02-26 16:55:29.983628 | controller | ok: [instance] 2026-02-26 16:55:30.300911 | controller | 2026-02-26 16:55:30.300951 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2026-02-26 16:55:30.300961 | controller | Thursday 26 February 2026 16:55:29 +0000 (0:00:00.328) 0:00:21.196 ***** 2026-02-26 16:55:30.300975 | controller | ok: [instance] 2026-02-26 16:55:30.621943 | controller | 2026-02-26 16:55:30.621976 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2026-02-26 16:55:30.621984 | controller | Thursday 26 February 2026 16:55:30 +0000 (0:00:00.317) 0:00:21.513 ***** 2026-02-26 16:55:30.621995 | controller | ok: [instance] 2026-02-26 16:55:30.622026 | controller | 2026-02-26 16:55:30.622040 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2026-02-26 16:55:30.622048 | controller | Thursday 26 February 2026 16:55:30 +0000 (0:00:00.321) 0:00:21.834 ***** 2026-02-26 16:55:30.940611 | controller | ok: [instance] 2026-02-26 16:55:31.248303 | controller | 2026-02-26 16:55:31.248328 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2026-02-26 16:55:31.248336 | controller | Thursday 26 February 2026 16:55:30 +0000 (0:00:00.318) 0:00:22.153 ***** 2026-02-26 16:55:31.248346 | controller | ok: [instance] 2026-02-26 16:55:31.554309 | controller | 2026-02-26 16:55:31.554335 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2026-02-26 16:55:31.554343 | controller | Thursday 26 February 2026 16:55:31 +0000 (0:00:00.307) 0:00:22.461 ***** 2026-02-26 16:55:31.554353 | controller | ok: [instance] 2026-02-26 16:55:31.870843 | controller | 2026-02-26 16:55:31.870876 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2026-02-26 16:55:31.870884 | controller | Thursday 26 February 2026 16:55:31 +0000 (0:00:00.305) 0:00:22.767 ***** 2026-02-26 16:55:31.870895 | controller | ok: [instance] 2026-02-26 16:55:32.183995 | controller | 2026-02-26 16:55:32.184041 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2026-02-26 16:55:32.184055 | controller | Thursday 26 February 2026 16:55:31 +0000 (0:00:00.316) 0:00:23.083 ***** 2026-02-26 16:55:32.184072 | controller | ok: [instance] 2026-02-26 16:55:32.499969 | controller | 2026-02-26 16:55:32.500017 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2026-02-26 16:55:32.500031 | controller | Thursday 26 February 2026 16:55:32 +0000 (0:00:00.313) 0:00:23.397 ***** 2026-02-26 16:55:32.500058 | controller | ok: [instance] 2026-02-26 16:55:32.820482 | controller | 2026-02-26 16:55:32.820518 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2026-02-26 16:55:32.820532 | controller | Thursday 26 February 2026 16:55:32 +0000 (0:00:00.315) 0:00:23.713 ***** 2026-02-26 16:55:32.820544 | controller | ok: [instance] 2026-02-26 16:55:33.134543 | controller | 2026-02-26 16:55:33.134576 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2026-02-26 16:55:33.134584 | controller | Thursday 26 February 2026 16:55:32 +0000 (0:00:00.320) 0:00:24.033 ***** 2026-02-26 16:55:33.134595 | controller | ok: [instance] 2026-02-26 16:55:33.155843 | controller | 2026-02-26 16:55:33.155875 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2026-02-26 16:55:33.155884 | controller | Thursday 26 February 2026 16:55:33 +0000 (0:00:00.314) 0:00:24.347 ***** 2026-02-26 16:55:33.155896 | controller | skipping: [instance] 2026-02-26 16:55:33.432420 | controller | 2026-02-26 16:55:33.432454 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2026-02-26 16:55:33.432462 | controller | Thursday 26 February 2026 16:55:33 +0000 (0:00:00.021) 0:00:24.368 ***** 2026-02-26 16:55:33.432473 | controller | ok: [instance] 2026-02-26 16:55:33.797594 | controller | 2026-02-26 16:55:33.797628 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2026-02-26 16:55:33.797637 | controller | Thursday 26 February 2026 16:55:33 +0000 (0:00:00.276) 0:00:24.645 ***** 2026-02-26 16:55:33.797647 | controller | ok: [instance] 2026-02-26 16:55:34.101414 | controller | 2026-02-26 16:55:34.101446 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2026-02-26 16:55:34.101454 | controller | Thursday 26 February 2026 16:55:33 +0000 (0:00:00.365) 0:00:25.010 ***** 2026-02-26 16:55:34.101464 | controller | changed: [instance] 2026-02-26 16:55:34.385074 | controller | 2026-02-26 16:55:34.385104 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2026-02-26 16:55:34.385112 | controller | Thursday 26 February 2026 16:55:34 +0000 (0:00:00.303) 0:00:25.314 ***** 2026-02-26 16:55:34.385122 | controller | [WARNING]: Reset is not implemented for this connection 2026-02-26 16:55:34.416004 | controller | changed: [instance] 2026-02-26 16:55:34.416554 | controller | 2026-02-26 16:55:34.416580 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2026-02-26 16:55:34.490975 | controller | Thursday 26 February 2026 16:55:34 +0000 (0:00:00.277) 0:00:25.592 ***** 2026-02-26 16:55:34.491006 | controller | 2026-02-26 16:55:34.491015 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2026-02-26 16:55:34.491022 | controller | Thursday 26 February 2026 16:55:34 +0000 (0:00:00.036) 0:00:25.629 ***** 2026-02-26 16:55:34.491034 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2026-02-26 16:55:34.533940 | controller | 2026-02-26 16:55:34.533972 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2026-02-26 16:55:34.533981 | controller | Thursday 26 February 2026 16:55:34 +0000 (0:00:00.074) 0:00:25.704 ***** 2026-02-26 16:55:34.533995 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2026-02-26 16:55:34.580943 | controller | 2026-02-26 16:55:34.580969 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-02-26 16:55:34.580978 | controller | Thursday 26 February 2026 16:55:34 +0000 (0:00:00.043) 0:00:25.747 ***** 2026-02-26 16:55:34.580989 | controller | ok: [instance] => (item=compute) 2026-02-26 16:55:34.620445 | controller | ok: [instance] => (item=controller) 2026-02-26 16:55:34.620476 | controller | ok: [instance] => (item=crc) 2026-02-26 16:55:34.620486 | controller | 2026-02-26 16:55:34.620493 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-02-26 16:55:34.620500 | controller | Thursday 26 February 2026 16:55:34 +0000 (0:00:00.046) 0:00:25.794 ***** 2026-02-26 16:55:34.620511 | controller | ok: [instance] 2026-02-26 16:55:34.660985 | controller | 2026-02-26 16:55:34.661010 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-02-26 16:55:34.661027 | controller | Thursday 26 February 2026 16:55:34 +0000 (0:00:00.039) 0:00:25.833 ***** 2026-02-26 16:55:34.661038 | controller | ok: [instance] => changed=false 2026-02-26 16:55:34.661069 | controller | msg: All assertions passed 2026-02-26 16:55:34.661079 | controller | 2026-02-26 16:55:34.661226 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2026-02-26 16:55:34.661310 | controller | Thursday 26 February 2026 16:55:34 +0000 (0:00:00.040) 0:00:25.874 ***** 2026-02-26 16:55:34.702436 | controller | 2026-02-26 16:55:34.702674 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2026-02-26 16:55:34.702914 | controller | Thursday 26 February 2026 16:55:34 +0000 (0:00:00.041) 0:00:25.915 ***** 2026-02-26 16:55:34.779900 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.49', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2026-02-26 16:55:34.780231 | controller | ok: [instance] => (item={}) 2026-02-26 16:55:34.780301 | controller | 2026-02-26 16:55:34.780314 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2026-02-26 16:55:34.780435 | controller | Thursday 26 February 2026 16:55:34 +0000 (0:00:00.077) 0:00:25.993 ***** 2026-02-26 16:55:34.797324 | controller | skipping: [instance] 2026-02-26 16:55:34.797466 | controller | 2026-02-26 16:55:34.797606 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2026-02-26 16:55:34.797742 | controller | Thursday 26 February 2026 16:55:34 +0000 (0:00:00.017) 0:00:26.010 ***** 2026-02-26 16:55:35.010244 | controller | ok: [instance] 2026-02-26 16:55:35.351797 | controller | 2026-02-26 16:55:35.351844 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2026-02-26 16:55:35.351855 | controller | Thursday 26 February 2026 16:55:35 +0000 (0:00:00.212) 0:00:26.222 ***** 2026-02-26 16:55:35.351868 | controller | changed: [instance] 2026-02-26 16:55:36.099696 | controller | 2026-02-26 16:55:36.099725 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2026-02-26 16:55:36.099734 | controller | Thursday 26 February 2026 16:55:35 +0000 (0:00:00.341) 0:00:26.564 ***** 2026-02-26 16:55:36.099744 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2026-02-26 16:55:36.125543 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2026-02-26 16:55:36.125563 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2026-02-26 16:55:36.125571 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2026-02-26 16:55:36.125577 | controller | 2026-02-26 16:55:36.125582 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2026-02-26 16:55:36.125588 | controller | Thursday 26 February 2026 16:55:36 +0000 (0:00:00.747) 0:00:27.312 ***** 2026-02-26 16:55:36.125596 | controller | skipping: [instance] 2026-02-26 16:55:36.494213 | controller | 2026-02-26 16:55:36.494244 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2026-02-26 16:55:36.494252 | controller | Thursday 26 February 2026 16:55:36 +0000 (0:00:00.026) 0:00:27.338 ***** 2026-02-26 16:55:36.494261 | controller | changed: [instance] 2026-02-26 16:55:36.942801 | controller | 2026-02-26 16:55:36.942850 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2026-02-26 16:55:36.942859 | controller | Thursday 26 February 2026 16:55:36 +0000 (0:00:00.359) 0:00:27.698 ***** 2026-02-26 16:55:36.942865 | controller | 2026-02-26 16:55:36.942870 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-26 16:55:36.942876 | controller | Thursday 26 February 2026 16:55:36 +0000 (0:00:00.008) 0:00:27.706 ***** 2026-02-26 16:55:36.942893 | controller | changed: [instance] 2026-02-26 16:55:37.015710 | controller | 2026-02-26 16:55:37.015739 | controller | TASK [Ensure no default networks exists] *************************************** 2026-02-26 16:55:37.015764 | controller | Thursday 26 February 2026 16:55:36 +0000 (0:00:00.448) 0:00:28.155 ***** 2026-02-26 16:55:37.015774 | controller | 2026-02-26 16:55:38.237219 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2026-02-26 16:55:38.237250 | controller | Thursday 26 February 2026 16:55:37 +0000 (0:00:00.073) 0:00:28.228 ***** 2026-02-26 16:55:38.237262 | controller | ok: [instance] 2026-02-26 16:55:38.466408 | controller | 2026-02-26 16:55:38.466436 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2026-02-26 16:55:38.466444 | controller | Thursday 26 February 2026 16:55:38 +0000 (0:00:01.221) 0:00:29.450 ***** 2026-02-26 16:55:38.466453 | controller | ok: [instance] 2026-02-26 16:55:38.976943 | controller | 2026-02-26 16:55:38.976979 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2026-02-26 16:55:38.976989 | controller | Thursday 26 February 2026 16:55:38 +0000 (0:00:00.229) 0:00:29.679 ***** 2026-02-26 16:55:38.977001 | controller | ok: [instance] 2026-02-26 16:55:38.977031 | controller | 2026-02-26 16:55:38.977041 | controller | TASK [libvirt_manager : Removing default] ************************************** 2026-02-26 16:55:38.977065 | controller | Thursday 26 February 2026 16:55:38 +0000 (0:00:00.510) 0:00:30.189 ***** 2026-02-26 16:55:39.200969 | controller | ok: [instance] 2026-02-26 16:55:39.201067 | controller | 2026-02-26 16:55:39.201087 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2026-02-26 16:55:39.201099 | controller | Thursday 26 February 2026 16:55:39 +0000 (0:00:00.224) 0:00:30.413 ***** 2026-02-26 16:55:40.457914 | controller | ok: [instance] 2026-02-26 16:55:40.457962 | controller | 2026-02-26 16:55:40.457973 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2026-02-26 16:55:40.458087 | controller | Thursday 26 February 2026 16:55:40 +0000 (0:00:01.257) 0:00:31.671 ***** 2026-02-26 16:55:41.774585 | controller | ok: [instance] 2026-02-26 16:55:42.070049 | controller | 2026-02-26 16:55:42.070076 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2026-02-26 16:55:42.070084 | controller | Thursday 26 February 2026 16:55:41 +0000 (0:00:01.316) 0:00:32.987 ***** 2026-02-26 16:55:42.070094 | controller | changed: [instance] 2026-02-26 16:55:42.370414 | controller | 2026-02-26 16:55:42.370449 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2026-02-26 16:55:42.370458 | controller | Thursday 26 February 2026 16:55:42 +0000 (0:00:00.295) 0:00:33.283 ***** 2026-02-26 16:55:42.370468 | controller | changed: [instance] 2026-02-26 16:55:42.932493 | controller | 2026-02-26 16:55:42.932522 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2026-02-26 16:55:42.932530 | controller | Thursday 26 February 2026 16:55:42 +0000 (0:00:00.300) 0:00:33.583 ***** 2026-02-26 16:55:42.932540 | controller | changed: [instance] => (item=arptables) 2026-02-26 16:55:43.224940 | controller | changed: [instance] => (item=iptables) 2026-02-26 16:55:43.224974 | controller | changed: [instance] => (item=ip6tables) 2026-02-26 16:55:43.224983 | controller | 2026-02-26 16:55:43.224991 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2026-02-26 16:55:43.224998 | controller | Thursday 26 February 2026 16:55:42 +0000 (0:00:00.561) 0:00:34.145 ***** 2026-02-26 16:55:43.225010 | controller | ok: [instance] 2026-02-26 16:55:43.225037 | controller | 2026-02-26 16:55:43.225046 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2026-02-26 16:55:43.225098 | controller | Thursday 26 February 2026 16:55:43 +0000 (0:00:00.292) 0:00:34.438 ***** 2026-02-26 16:55:43.311523 | controller | ok: [instance] 2026-02-26 16:55:43.351765 | controller | 2026-02-26 16:55:43.351783 | controller | TASK [Ensure the required network configurations are applied] ****************** 2026-02-26 16:55:43.351790 | controller | Thursday 26 February 2026 16:55:43 +0000 (0:00:00.086) 0:00:34.524 ***** 2026-02-26 16:55:43.351798 | controller | 2026-02-26 16:55:43.373710 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2026-02-26 16:55:43.373736 | controller | Thursday 26 February 2026 16:55:43 +0000 (0:00:00.040) 0:00:34.565 ***** 2026-02-26 16:55:43.373749 | controller | skipping: [instance] 2026-02-26 16:55:43.395861 | controller | 2026-02-26 16:55:43.395878 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2026-02-26 16:55:43.395885 | controller | Thursday 26 February 2026 16:55:43 +0000 (0:00:00.021) 0:00:34.586 ***** 2026-02-26 16:55:43.395893 | controller | skipping: [instance] 2026-02-26 16:55:43.396003 | controller | 2026-02-26 16:55:43.396027 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-26 16:55:43.396039 | controller | Thursday 26 February 2026 16:55:43 +0000 (0:00:00.022) 0:00:34.609 ***** 2026-02-26 16:55:43.417793 | controller | skipping: [instance] 2026-02-26 16:55:43.443597 | controller | 2026-02-26 16:55:43.443614 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2026-02-26 16:55:43.443621 | controller | Thursday 26 February 2026 16:55:43 +0000 (0:00:00.021) 0:00:34.630 ***** 2026-02-26 16:55:43.443629 | controller | skipping: [instance] 2026-02-26 16:55:43.479916 | controller | 2026-02-26 16:55:43.479938 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2026-02-26 16:55:43.479946 | controller | Thursday 26 February 2026 16:55:43 +0000 (0:00:00.025) 0:00:34.656 ***** 2026-02-26 16:55:43.479956 | controller | ok: [instance] 2026-02-26 16:55:43.480127 | controller | 2026-02-26 16:55:43.480290 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2026-02-26 16:55:43.480445 | controller | Thursday 26 February 2026 16:55:43 +0000 (0:00:00.036) 0:00:34.693 ***** 2026-02-26 16:55:43.510589 | controller | skipping: [instance] 2026-02-26 16:55:43.510772 | controller | 2026-02-26 16:55:43.510959 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2026-02-26 16:55:43.511113 | controller | Thursday 26 February 2026 16:55:43 +0000 (0:00:00.030) 0:00:34.724 ***** 2026-02-26 16:55:43.534208 | controller | skipping: [instance] 2026-02-26 16:55:43.534372 | controller | 2026-02-26 16:55:43.534522 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2026-02-26 16:55:43.534691 | controller | Thursday 26 February 2026 16:55:43 +0000 (0:00:00.023) 0:00:34.747 ***** 2026-02-26 16:55:43.587462 | controller | ok: [instance] 2026-02-26 16:55:43.587628 | controller | 2026-02-26 16:55:43.587794 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2026-02-26 16:55:43.587935 | controller | Thursday 26 February 2026 16:55:43 +0000 (0:00:00.053) 0:00:34.801 ***** 2026-02-26 16:55:43.606944 | controller | skipping: [instance] 2026-02-26 16:55:43.607106 | controller | 2026-02-26 16:55:43.607262 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2026-02-26 16:55:43.607428 | controller | Thursday 26 February 2026 16:55:43 +0000 (0:00:00.019) 0:00:34.820 ***** 2026-02-26 16:55:43.652573 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2026-02-26 16:55:43.652754 | controller | 2026-02-26 16:55:43.652934 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-26 16:55:43.653059 | controller | Thursday 26 February 2026 16:55:43 +0000 (0:00:00.045) 0:00:34.866 ***** 2026-02-26 16:55:43.965774 | controller | ok: [instance -> localhost] 2026-02-26 16:55:48.844118 | controller | 2026-02-26 16:55:48.844153 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2026-02-26 16:55:48.844161 | controller | Thursday 26 February 2026 16:55:43 +0000 (0:00:00.312) 0:00:35.178 ***** 2026-02-26 16:55:48.844171 | controller | changed: [instance -> localhost] 2026-02-26 16:55:49.032388 | controller | 2026-02-26 16:55:49.032417 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-26 16:55:49.032426 | controller | Thursday 26 February 2026 16:55:48 +0000 (0:00:04.878) 0:00:40.057 ***** 2026-02-26 16:55:49.032437 | controller | changed: [instance] 2026-02-26 16:55:49.365922 | controller | 2026-02-26 16:55:49.365960 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2026-02-26 16:55:49.365970 | controller | Thursday 26 February 2026 16:55:49 +0000 (0:00:00.188) 0:00:40.245 ***** 2026-02-26 16:55:49.365990 | controller | changed: [instance] 2026-02-26 16:55:50.957526 | controller | 2026-02-26 16:55:50.957568 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2026-02-26 16:55:50.957576 | controller | Thursday 26 February 2026 16:55:49 +0000 (0:00:00.333) 0:00:40.578 ***** 2026-02-26 16:55:50.957586 | controller | changed: [instance -> localhost] 2026-02-26 16:55:51.297876 | controller | 2026-02-26 16:55:51.297909 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2026-02-26 16:55:51.297919 | controller | Thursday 26 February 2026 16:55:50 +0000 (0:00:01.591) 0:00:42.170 ***** 2026-02-26 16:55:51.297931 | controller | changed: [instance] 2026-02-26 16:55:51.326753 | controller | 2026-02-26 16:55:51.326772 | controller | TASK [reproducer : Select right domain] **************************************** 2026-02-26 16:55:51.326780 | controller | Thursday 26 February 2026 16:55:51 +0000 (0:00:00.340) 0:00:42.510 ***** 2026-02-26 16:55:51.326788 | controller | ok: [instance] 2026-02-26 16:55:51.460374 | controller | 2026-02-26 16:55:51.460395 | controller | TASK [Create the virtual networks] ********************************************* 2026-02-26 16:55:51.460402 | controller | Thursday 26 February 2026 16:55:51 +0000 (0:00:00.029) 0:00:42.539 ***** 2026-02-26 16:55:51.460411 | controller | 2026-02-26 16:55:51.479108 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2026-02-26 16:55:51.479128 | controller | Thursday 26 February 2026 16:55:51 +0000 (0:00:00.133) 0:00:42.673 ***** 2026-02-26 16:55:51.479140 | controller | ok: [instance] 2026-02-26 16:55:51.656439 | controller | 2026-02-26 16:55:51.656471 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2026-02-26 16:55:51.656480 | controller | Thursday 26 February 2026 16:55:51 +0000 (0:00:00.018) 0:00:42.692 ***** 2026-02-26 16:55:51.656490 | controller | ok: [instance] 2026-02-26 16:55:51.688902 | controller | 2026-02-26 16:55:51.688925 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2026-02-26 16:55:51.688934 | controller | Thursday 26 February 2026 16:55:51 +0000 (0:00:00.177) 0:00:42.869 ***** 2026-02-26 16:55:51.688945 | controller | skipping: [instance] 2026-02-26 16:55:51.716357 | controller | 2026-02-26 16:55:51.716377 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2026-02-26 16:55:51.716383 | controller | Thursday 26 February 2026 16:55:51 +0000 (0:00:00.032) 0:00:42.902 ***** 2026-02-26 16:55:51.716391 | controller | skipping: [instance] 2026-02-26 16:55:51.767485 | controller | 2026-02-26 16:55:51.767510 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2026-02-26 16:55:51.767530 | controller | Thursday 26 February 2026 16:55:51 +0000 (0:00:00.027) 0:00:42.929 ***** 2026-02-26 16:55:51.767542 | controller | ok: [instance] 2026-02-26 16:55:51.767708 | controller | 2026-02-26 16:55:51.767903 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2026-02-26 16:55:51.768070 | controller | Thursday 26 February 2026 16:55:51 +0000 (0:00:00.051) 0:00:42.980 ***** 2026-02-26 16:55:51.893858 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-26 16:55:51.894038 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-26 16:55:51.894178 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-26 16:55:51.894312 | controller | 2026-02-26 16:55:51.894449 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2026-02-26 16:55:51.894594 | controller | Thursday 26 February 2026 16:55:51 +0000 (0:00:00.126) 0:00:43.107 ***** 2026-02-26 16:55:51.927233 | controller | skipping: [instance] 2026-02-26 16:55:51.927402 | controller | 2026-02-26 16:55:51.927576 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2026-02-26 16:55:51.927703 | controller | Thursday 26 February 2026 16:55:51 +0000 (0:00:00.033) 0:00:43.140 ***** 2026-02-26 16:55:52.262480 | controller | changed: [instance] 2026-02-26 16:55:52.348083 | controller | 2026-02-26 16:55:52.348130 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2026-02-26 16:55:52.348145 | controller | Thursday 26 February 2026 16:55:52 +0000 (0:00:00.334) 0:00:43.475 ***** 2026-02-26 16:55:52.348178 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes) 2026-02-26 16:55:52.398644 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers) 2026-02-26 16:55:52.398676 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps) 2026-02-26 16:55:52.398684 | controller | 2026-02-26 16:55:52.398690 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-26 16:55:52.398696 | controller | Thursday 26 February 2026 16:55:52 +0000 (0:00:00.085) 0:00:43.561 ***** 2026-02-26 16:55:52.398706 | controller | changed: [instance] 2026-02-26 16:55:52.671776 | controller | 2026-02-26 16:55:52.671810 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-26 16:55:52.671846 | controller | Thursday 26 February 2026 16:55:52 +0000 (0:00:00.050) 0:00:43.611 ***** 2026-02-26 16:55:52.671862 | controller | changed: [instance] 2026-02-26 16:55:52.879289 | controller | 2026-02-26 16:55:52.879317 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-26 16:55:52.879325 | controller | Thursday 26 February 2026 16:55:52 +0000 (0:00:00.273) 0:00:43.884 ***** 2026-02-26 16:55:52.879335 | controller | changed: [instance] 2026-02-26 16:55:52.930835 | controller | 2026-02-26 16:55:52.930862 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-26 16:55:52.930869 | controller | Thursday 26 February 2026 16:55:52 +0000 (0:00:00.207) 0:00:44.092 ***** 2026-02-26 16:55:52.930878 | controller | changed: [instance] 2026-02-26 16:55:53.126359 | controller | 2026-02-26 16:55:53.126388 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-26 16:55:53.126396 | controller | Thursday 26 February 2026 16:55:52 +0000 (0:00:00.051) 0:00:44.144 ***** 2026-02-26 16:55:53.126406 | controller | changed: [instance] 2026-02-26 16:55:53.382929 | controller | 2026-02-26 16:55:53.382957 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-26 16:55:53.382966 | controller | Thursday 26 February 2026 16:55:53 +0000 (0:00:00.195) 0:00:44.339 ***** 2026-02-26 16:55:53.382978 | controller | changed: [instance] 2026-02-26 16:55:53.383004 | controller | 2026-02-26 16:55:53.383013 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-26 16:55:53.383140 | controller | Thursday 26 February 2026 16:55:53 +0000 (0:00:00.256) 0:00:44.596 ***** 2026-02-26 16:55:53.435430 | controller | changed: [instance] 2026-02-26 16:55:53.636302 | controller | 2026-02-26 16:55:53.636332 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-26 16:55:53.636340 | controller | Thursday 26 February 2026 16:55:53 +0000 (0:00:00.052) 0:00:44.648 ***** 2026-02-26 16:55:53.636350 | controller | changed: [instance] 2026-02-26 16:55:53.848654 | controller | 2026-02-26 16:55:53.848680 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-26 16:55:53.848688 | controller | Thursday 26 February 2026 16:55:53 +0000 (0:00:00.200) 0:00:44.849 ***** 2026-02-26 16:55:53.848698 | controller | changed: [instance] 2026-02-26 16:55:54.039778 | controller | 2026-02-26 16:55:54.039803 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ******************** 2026-02-26 16:55:54.039811 | controller | Thursday 26 February 2026 16:55:53 +0000 (0:00:00.212) 0:00:45.061 ***** 2026-02-26 16:55:54.039836 | controller | ok: [instance] 2026-02-26 16:55:54.539952 | controller | 2026-02-26 16:55:54.539989 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ****************** 2026-02-26 16:55:54.539999 | controller | Thursday 26 February 2026 16:55:54 +0000 (0:00:00.191) 0:00:45.252 ***** 2026-02-26 16:55:54.540011 | controller | changed: [instance] 2026-02-26 16:55:54.540032 | controller | 2026-02-26 16:55:54.540041 | controller | TASK [libvirt_manager : Remove ini file after conversion] ********************** 2026-02-26 16:55:54.540110 | controller | Thursday 26 February 2026 16:55:54 +0000 (0:00:00.500) 0:00:45.753 ***** 2026-02-26 16:55:54.723891 | controller | changed: [instance] 2026-02-26 16:55:54.747887 | controller | 2026-02-26 16:55:54.747919 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-26 16:55:54.747927 | controller | Thursday 26 February 2026 16:55:54 +0000 (0:00:00.183) 0:00:45.936 ***** 2026-02-26 16:55:54.747938 | controller | skipping: [instance] 2026-02-26 16:55:54.769903 | controller | 2026-02-26 16:55:54.769927 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-26 16:55:54.769940 | controller | Thursday 26 February 2026 16:55:54 +0000 (0:00:00.023) 0:00:45.960 ***** 2026-02-26 16:55:54.769950 | controller | skipping: [instance] 2026-02-26 16:55:54.769977 | controller | 2026-02-26 16:55:54.770151 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-26 16:55:54.793452 | controller | Thursday 26 February 2026 16:55:54 +0000 (0:00:00.022) 0:00:45.983 ***** 2026-02-26 16:55:54.793495 | controller | skipping: [instance] 2026-02-26 16:55:54.816387 | controller | 2026-02-26 16:55:54.816409 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-26 16:55:54.816418 | controller | Thursday 26 February 2026 16:55:54 +0000 (0:00:00.023) 0:00:46.006 ***** 2026-02-26 16:55:54.816428 | controller | skipping: [instance] 2026-02-26 16:55:54.833982 | controller | 2026-02-26 16:55:54.834000 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-26 16:55:54.834007 | controller | Thursday 26 February 2026 16:55:54 +0000 (0:00:00.023) 0:00:46.029 ***** 2026-02-26 16:55:54.834016 | controller | ok: [instance] 2026-02-26 16:55:54.834151 | controller | 2026-02-26 16:55:54.834286 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-26 16:55:54.834427 | controller | Thursday 26 February 2026 16:55:54 +0000 (0:00:00.017) 0:00:46.047 ***** 2026-02-26 16:55:54.914951 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-26 16:55:54.915118 | controller | 2026-02-26 16:55:54.915249 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-26 16:55:54.915369 | controller | Thursday 26 February 2026 16:55:54 +0000 (0:00:00.080) 0:00:46.128 ***** 2026-02-26 16:55:54.932164 | controller | skipping: [instance] 2026-02-26 16:55:54.932323 | controller | 2026-02-26 16:55:54.932489 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-26 16:55:54.932640 | controller | Thursday 26 February 2026 16:55:54 +0000 (0:00:00.017) 0:00:46.145 ***** 2026-02-26 16:55:55.130903 | controller | changed: [instance] 2026-02-26 16:55:55.130952 | controller | 2026-02-26 16:55:55.131185 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-26 16:55:55.522728 | controller | Thursday 26 February 2026 16:55:55 +0000 (0:00:00.198) 0:00:46.344 ***** 2026-02-26 16:55:55.522763 | controller | changed: [instance] 2026-02-26 16:55:55.579757 | controller | 2026-02-26 16:55:55.579779 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-26 16:55:55.579787 | controller | Thursday 26 February 2026 16:55:55 +0000 (0:00:00.391) 0:00:46.735 ***** 2026-02-26 16:55:55.579797 | controller | ok: [instance] 2026-02-26 16:55:55.609927 | controller | 2026-02-26 16:55:55.609973 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-26 16:55:55.609984 | controller | Thursday 26 February 2026 16:55:55 +0000 (0:00:00.057) 0:00:46.793 ***** 2026-02-26 16:55:55.609998 | controller | ok: [instance] 2026-02-26 16:55:55.610040 | controller | 2026-02-26 16:55:55.610050 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-26 16:55:55.610129 | controller | Thursday 26 February 2026 16:55:55 +0000 (0:00:00.030) 0:00:46.823 ***** 2026-02-26 16:55:55.990958 | controller | changed: [instance] 2026-02-26 16:55:55.991010 | controller | 2026-02-26 16:55:55.991023 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2026-02-26 16:55:55.991052 | controller | Thursday 26 February 2026 16:55:55 +0000 (0:00:00.380) 0:00:47.204 ***** 2026-02-26 16:55:56.095648 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2026-02-26 16:55:56.095700 | controller | 2026-02-26 16:55:56.095976 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2026-02-26 16:55:56.148975 | controller | Thursday 26 February 2026 16:55:56 +0000 (0:00:00.104) 0:00:47.308 ***** 2026-02-26 16:55:56.149018 | controller | ok: [instance] => (item=public) 2026-02-26 16:55:56.149073 | controller | ok: [instance] => (item=osp_trunk) 2026-02-26 16:55:56.149098 | controller | 2026-02-26 16:55:56.149109 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2026-02-26 16:55:56.149121 | controller | Thursday 26 February 2026 16:55:56 +0000 (0:00:00.053) 0:00:47.361 ***** 2026-02-26 16:55:56.569411 | controller | changed: [instance] => (item=cifmw-public) 2026-02-26 16:55:57.149306 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-26 16:55:57.149338 | controller | 2026-02-26 16:55:57.149346 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2026-02-26 16:55:57.149353 | controller | Thursday 26 February 2026 16:55:56 +0000 (0:00:00.420) 0:00:47.782 ***** 2026-02-26 16:55:57.149363 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 16:55:57.582788 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 16:55:57.582816 | controller | 2026-02-26 16:55:57.582864 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2026-02-26 16:55:57.582873 | controller | Thursday 26 February 2026 16:55:57 +0000 (0:00:00.579) 0:00:48.362 ***** 2026-02-26 16:55:57.582891 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 16:55:58.000955 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 16:55:58.000994 | controller | 2026-02-26 16:55:58.001004 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2026-02-26 16:55:58.001012 | controller | Thursday 26 February 2026 16:55:57 +0000 (0:00:00.433) 0:00:48.795 ***** 2026-02-26 16:55:58.001024 | controller | changed: [instance] => (item=cifmw-public) 2026-02-26 16:55:58.057808 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-26 16:55:58.057854 | controller | 2026-02-26 16:55:58.057864 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2026-02-26 16:55:58.057871 | controller | Thursday 26 February 2026 16:55:57 +0000 (0:00:00.418) 0:00:49.214 ***** 2026-02-26 16:55:58.057882 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2026-02-26 16:55:58.230758 | controller | 2026-02-26 16:55:58.230777 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2026-02-26 16:55:58.230784 | controller | Thursday 26 February 2026 16:55:58 +0000 (0:00:00.056) 0:00:49.271 ***** 2026-02-26 16:55:58.230793 | controller | ok: [instance] 2026-02-26 16:55:58.601908 | controller | 2026-02-26 16:55:58.601939 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2026-02-26 16:55:58.601948 | controller | Thursday 26 February 2026 16:55:58 +0000 (0:00:00.173) 0:00:49.444 ***** 2026-02-26 16:55:58.601958 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 16:55:58.601983 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 16:55:58.601989 | controller | 2026-02-26 16:55:58.601995 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2026-02-26 16:55:58.602002 | controller | Thursday 26 February 2026 16:55:58 +0000 (0:00:00.370) 0:00:49.814 ***** 2026-02-26 16:55:58.668228 | controller | 2026-02-26 16:55:58.702471 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-26 16:55:58.702491 | controller | Thursday 26 February 2026 16:55:58 +0000 (0:00:00.066) 0:00:49.881 ***** 2026-02-26 16:55:58.702502 | controller | skipping: [instance] 2026-02-26 16:55:59.882485 | controller | 2026-02-26 16:55:59.882510 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2026-02-26 16:55:59.882518 | controller | Thursday 26 February 2026 16:55:58 +0000 (0:00:00.034) 0:00:49.915 ***** 2026-02-26 16:55:59.882527 | controller | ok: [instance] 2026-02-26 16:56:00.065504 | controller | 2026-02-26 16:56:00.065523 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-26 16:56:00.065530 | controller | Thursday 26 February 2026 16:55:59 +0000 (0:00:01.179) 0:00:51.095 ***** 2026-02-26 16:56:00.065539 | controller | ok: [instance] 2026-02-26 16:56:00.415922 | controller | 2026-02-26 16:56:00.415956 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2026-02-26 16:56:00.415964 | controller | Thursday 26 February 2026 16:56:00 +0000 (0:00:00.183) 0:00:51.278 ***** 2026-02-26 16:56:00.415975 | controller | changed: [instance] 2026-02-26 16:56:00.416025 | controller | 2026-02-26 16:56:00.416054 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2026-02-26 16:56:00.416066 | controller | Thursday 26 February 2026 16:56:00 +0000 (0:00:00.350) 0:00:51.629 ***** 2026-02-26 16:56:02.056614 | controller | changed: [instance] 2026-02-26 16:56:02.402481 | controller | 2026-02-26 16:56:02.402510 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2026-02-26 16:56:02.402518 | controller | Thursday 26 February 2026 16:56:02 +0000 (0:00:01.640) 0:00:53.269 ***** 2026-02-26 16:56:02.402528 | controller | changed: [instance] 2026-02-26 16:56:02.436515 | controller | 2026-02-26 16:56:02.436538 | controller | TASK [Create extra network configuration] ************************************** 2026-02-26 16:56:02.436545 | controller | Thursday 26 February 2026 16:56:02 +0000 (0:00:00.346) 0:00:53.615 ***** 2026-02-26 16:56:02.436553 | controller | skipping: [instance] 2026-02-26 16:56:02.469597 | controller | 2026-02-26 16:56:02.469619 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2026-02-26 16:56:02.469628 | controller | Thursday 26 February 2026 16:56:02 +0000 (0:00:00.033) 0:00:53.648 ***** 2026-02-26 16:56:02.469639 | controller | skipping: [instance] 2026-02-26 16:56:02.915860 | controller | 2026-02-26 16:56:02.915894 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2026-02-26 16:56:02.915903 | controller | Thursday 26 February 2026 16:56:02 +0000 (0:00:00.033) 0:00:53.682 ***** 2026-02-26 16:56:02.915913 | controller | ok: [instance] 2026-02-26 16:56:03.062442 | controller | 2026-02-26 16:56:03.062461 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2026-02-26 16:56:03.062468 | controller | Thursday 26 February 2026 16:56:02 +0000 (0:00:00.445) 0:00:54.128 ***** 2026-02-26 16:56:03.062477 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 16:56:04.263901 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 16:56:04.263932 | controller | 2026-02-26 16:56:04.263940 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2026-02-26 16:56:04.263953 | controller | Thursday 26 February 2026 16:56:03 +0000 (0:00:00.146) 0:00:54.275 ***** 2026-02-26 16:56:04.263963 | controller | ok: [instance] 2026-02-26 16:56:04.263987 | controller | 2026-02-26 16:56:04.264008 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2026-02-26 16:56:04.264137 | controller | Thursday 26 February 2026 16:56:04 +0000 (0:00:01.201) 0:00:55.477 ***** 2026-02-26 16:56:08.062857 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2026-02-26 16:56:08.312989 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2026-02-26 16:56:08.313032 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2026-02-26 16:56:08.313043 | controller | 2026-02-26 16:56:08.313051 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2026-02-26 16:56:08.313058 | controller | Thursday 26 February 2026 16:56:08 +0000 (0:00:03.797) 0:00:59.275 ***** 2026-02-26 16:56:08.313071 | controller | changed: [instance] 2026-02-26 16:56:08.711060 | controller | 2026-02-26 16:56:08.711092 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2026-02-26 16:56:08.711100 | controller | Thursday 26 February 2026 16:56:08 +0000 (0:00:00.250) 0:00:59.525 ***** 2026-02-26 16:56:08.711110 | controller | changed: [instance] 2026-02-26 16:56:09.138990 | controller | 2026-02-26 16:56:09.139034 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2026-02-26 16:56:09.139042 | controller | Thursday 26 February 2026 16:56:08 +0000 (0:00:00.398) 0:00:59.923 ***** 2026-02-26 16:56:09.139053 | controller | changed: [instance] 2026-02-26 16:56:09.175802 | controller | 2026-02-26 16:56:09.175840 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2026-02-26 16:56:09.175850 | controller | Thursday 26 February 2026 16:56:09 +0000 (0:00:00.427) 0:01:00.351 ***** 2026-02-26 16:56:09.175860 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2026-02-26 16:56:09.590276 | controller | 2026-02-26 16:56:09.590297 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2026-02-26 16:56:09.590304 | controller | Thursday 26 February 2026 16:56:09 +0000 (0:00:00.037) 0:01:00.388 ***** 2026-02-26 16:56:09.590312 | controller | changed: [instance] 2026-02-26 16:56:09.617456 | controller | 2026-02-26 16:56:09.617519 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2026-02-26 16:56:09.617529 | controller | Thursday 26 February 2026 16:56:09 +0000 (0:00:00.414) 0:01:00.803 ***** 2026-02-26 16:56:09.617543 | controller | skipping: [instance] 2026-02-26 16:56:09.656987 | controller | 2026-02-26 16:56:09.657012 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2026-02-26 16:56:09.657020 | controller | Thursday 26 February 2026 16:56:09 +0000 (0:00:00.026) 0:01:00.829 ***** 2026-02-26 16:56:09.657032 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2026-02-26 16:56:09.657065 | controller | 2026-02-26 16:56:09.657083 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2026-02-26 16:56:09.657131 | controller | Thursday 26 February 2026 16:56:09 +0000 (0:00:00.040) 0:01:00.869 ***** 2026-02-26 16:56:10.054465 | controller | changed: [instance] 2026-02-26 16:56:10.078348 | controller | 2026-02-26 16:56:10.078366 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2026-02-26 16:56:10.078374 | controller | Thursday 26 February 2026 16:56:10 +0000 (0:00:00.397) 0:01:01.267 ***** 2026-02-26 16:56:10.078390 | controller | skipping: [instance] 2026-02-26 16:56:10.304416 | controller | 2026-02-26 16:56:10.304463 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2026-02-26 16:56:10.304473 | controller | Thursday 26 February 2026 16:56:10 +0000 (0:00:00.024) 0:01:01.291 ***** 2026-02-26 16:56:10.304485 | controller | ok: [instance] => (item=127.0.0.2) 2026-02-26 16:56:11.015996 | controller | 2026-02-26 16:56:11.016046 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2026-02-26 16:56:11.016056 | controller | Thursday 26 February 2026 16:56:10 +0000 (0:00:00.225) 0:01:01.516 ***** 2026-02-26 16:56:11.016070 | controller | changed: [instance] 2026-02-26 16:56:11.041764 | controller | 2026-02-26 16:56:11.041783 | controller | TASK [dnsmasq : Stop service] ************************************************** 2026-02-26 16:56:11.041791 | controller | Thursday 26 February 2026 16:56:11 +0000 (0:00:00.711) 0:01:02.228 ***** 2026-02-26 16:56:11.041800 | controller | skipping: [instance] 2026-02-26 16:56:11.067015 | controller | 2026-02-26 16:56:11.067088 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2026-02-26 16:56:11.067098 | controller | Thursday 26 February 2026 16:56:11 +0000 (0:00:00.026) 0:01:02.254 ***** 2026-02-26 16:56:11.067114 | controller | skipping: [instance] 2026-02-26 16:56:11.067136 | controller | 2026-02-26 16:56:11.067142 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2026-02-26 16:56:11.067149 | controller | Thursday 26 February 2026 16:56:11 +0000 (0:00:00.025) 0:01:02.280 ***** 2026-02-26 16:56:11.103758 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-26 16:56:11.222050 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2026-02-26 16:56:11.222085 | controller | skipping: [instance] 2026-02-26 16:56:11.222099 | controller | 2026-02-26 16:56:11.222110 | controller | TASK [Create dnsmasq networks] ************************************************* 2026-02-26 16:56:11.222121 | controller | Thursday 26 February 2026 16:56:11 +0000 (0:00:00.036) 0:01:02.316 ***** 2026-02-26 16:56:11.222136 | controller | 2026-02-26 16:56:11.256802 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-26 16:56:11.256841 | controller | Thursday 26 February 2026 16:56:11 +0000 (0:00:00.118) 0:01:02.435 ***** 2026-02-26 16:56:11.256855 | controller | ok: [instance] => changed=false 2026-02-26 16:56:11.299560 | controller | msg: All assertions passed 2026-02-26 16:56:11.299579 | controller | 2026-02-26 16:56:11.299586 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-26 16:56:11.299592 | controller | Thursday 26 February 2026 16:56:11 +0000 (0:00:00.034) 0:01:02.469 ***** 2026-02-26 16:56:11.299600 | controller | ok: [instance] => changed=false 2026-02-26 16:56:11.299740 | controller | msg: All assertions passed 2026-02-26 16:56:11.299893 | controller | 2026-02-26 16:56:11.300036 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-26 16:56:11.300172 | controller | Thursday 26 February 2026 16:56:11 +0000 (0:00:00.043) 0:01:02.513 ***** 2026-02-26 16:56:11.760857 | controller | changed: [instance] 2026-02-26 16:56:11.782376 | controller | 2026-02-26 16:56:11.782394 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-26 16:56:11.782402 | controller | Thursday 26 February 2026 16:56:11 +0000 (0:00:00.460) 0:01:02.973 ***** 2026-02-26 16:56:11.782411 | controller | skipping: [instance] 2026-02-26 16:56:11.808510 | controller | 2026-02-26 16:56:11.808530 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-26 16:56:11.808539 | controller | Thursday 26 February 2026 16:56:11 +0000 (0:00:00.022) 0:01:02.995 ***** 2026-02-26 16:56:11.808549 | controller | skipping: [instance] 2026-02-26 16:56:11.840043 | controller | 2026-02-26 16:56:11.840103 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-26 16:56:11.840114 | controller | Thursday 26 February 2026 16:56:11 +0000 (0:00:00.026) 0:01:03.021 ***** 2026-02-26 16:56:11.840129 | controller | ok: [instance] => changed=false 2026-02-26 16:56:11.876035 | controller | msg: All assertions passed 2026-02-26 16:56:11.876063 | controller | 2026-02-26 16:56:11.876073 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-26 16:56:11.876086 | controller | Thursday 26 February 2026 16:56:11 +0000 (0:00:00.030) 0:01:03.052 ***** 2026-02-26 16:56:11.876097 | controller | ok: [instance] => changed=false 2026-02-26 16:56:11.876125 | controller | msg: All assertions passed 2026-02-26 16:56:11.876376 | controller | 2026-02-26 16:56:12.325038 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-26 16:56:12.325106 | controller | Thursday 26 February 2026 16:56:11 +0000 (0:00:00.036) 0:01:03.089 ***** 2026-02-26 16:56:12.325125 | controller | changed: [instance] 2026-02-26 16:56:12.351315 | controller | 2026-02-26 16:56:12.351346 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-26 16:56:12.351357 | controller | Thursday 26 February 2026 16:56:12 +0000 (0:00:00.448) 0:01:03.538 ***** 2026-02-26 16:56:12.351369 | controller | skipping: [instance] 2026-02-26 16:56:12.378984 | controller | 2026-02-26 16:56:12.379017 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-26 16:56:12.379027 | controller | Thursday 26 February 2026 16:56:12 +0000 (0:00:00.026) 0:01:03.564 ***** 2026-02-26 16:56:12.379039 | controller | skipping: [instance] 2026-02-26 16:56:12.379081 | controller | 2026-02-26 16:56:12.379091 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2026-02-26 16:56:12.379122 | controller | Thursday 26 February 2026 16:56:12 +0000 (0:00:00.027) 0:01:03.592 ***** 2026-02-26 16:56:12.417878 | controller | skipping: [instance] 2026-02-26 16:56:12.967973 | controller | 2026-02-26 16:56:12.968039 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2026-02-26 16:56:12.968048 | controller | Thursday 26 February 2026 16:56:12 +0000 (0:00:00.038) 0:01:03.630 ***** 2026-02-26 16:56:12.968062 | controller | changed: [instance] => (item=cifmw-public) 2026-02-26 16:56:12.968082 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-26 16:56:12.968089 | controller | 2026-02-26 16:56:12.968113 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-26 16:56:12.968314 | controller | Thursday 26 February 2026 16:56:12 +0000 (0:00:00.549) 0:01:04.180 ***** 2026-02-26 16:56:13.011119 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2026-02-26 16:56:13.360697 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2026-02-26 16:56:13.360743 | controller | 2026-02-26 16:56:13.360752 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-26 16:56:13.360759 | controller | Thursday 26 February 2026 16:56:13 +0000 (0:00:00.042) 0:01:04.223 ***** 2026-02-26 16:56:13.360770 | controller | ok: [instance] 2026-02-26 16:56:13.360798 | controller | 2026-02-26 16:56:13.360806 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-26 16:56:13.407585 | controller | Thursday 26 February 2026 16:56:13 +0000 (0:00:00.349) 0:01:04.573 ***** 2026-02-26 16:56:13.407631 | controller | ok: [instance] 2026-02-26 16:56:13.630764 | controller | 2026-02-26 16:56:13.630791 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-26 16:56:13.630799 | controller | Thursday 26 February 2026 16:56:13 +0000 (0:00:00.047) 0:01:04.620 ***** 2026-02-26 16:56:13.630809 | controller | ok: [instance] 2026-02-26 16:56:13.675004 | controller | 2026-02-26 16:56:13.675046 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-26 16:56:13.675061 | controller | Thursday 26 February 2026 16:56:13 +0000 (0:00:00.223) 0:01:04.843 ***** 2026-02-26 16:56:13.675078 | controller | ok: [instance] 2026-02-26 16:56:14.048931 | controller | 2026-02-26 16:56:14.048965 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2026-02-26 16:56:14.048973 | controller | Thursday 26 February 2026 16:56:13 +0000 (0:00:00.044) 0:01:04.887 ***** 2026-02-26 16:56:14.048984 | controller | changed: [instance] 2026-02-26 16:56:14.049010 | controller | 2026-02-26 16:56:14.049212 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2026-02-26 16:56:14.418704 | controller | Thursday 26 February 2026 16:56:14 +0000 (0:00:00.374) 0:01:05.262 ***** 2026-02-26 16:56:14.418740 | controller | changed: [instance] 2026-02-26 16:56:14.795948 | controller | 2026-02-26 16:56:14.795999 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2026-02-26 16:56:14.796013 | controller | Thursday 26 February 2026 16:56:14 +0000 (0:00:00.368) 0:01:05.631 ***** 2026-02-26 16:56:14.796031 | controller | changed: [instance] 2026-02-26 16:56:14.796076 | controller | 2026-02-26 16:56:14.796386 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2026-02-26 16:56:14.903087 | controller | Thursday 26 February 2026 16:56:14 +0000 (0:00:00.377) 0:01:06.008 ***** 2026-02-26 16:56:14.903158 | controller | ok: [instance] 2026-02-26 16:56:15.276971 | controller | 2026-02-26 16:56:15.277015 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2026-02-26 16:56:15.277029 | controller | Thursday 26 February 2026 16:56:14 +0000 (0:00:00.107) 0:01:06.116 ***** 2026-02-26 16:56:15.277046 | controller | changed: [instance] 2026-02-26 16:56:15.277417 | controller | 2026-02-26 16:56:15.277457 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-26 16:56:15.312048 | controller | Thursday 26 February 2026 16:56:15 +0000 (0:00:00.373) 0:01:06.489 ***** 2026-02-26 16:56:15.312113 | controller | skipping: [instance] 2026-02-26 16:56:15.346703 | controller | 2026-02-26 16:56:15.346733 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-26 16:56:15.346743 | controller | Thursday 26 February 2026 16:56:15 +0000 (0:00:00.035) 0:01:06.525 ***** 2026-02-26 16:56:15.346755 | controller | skipping: [instance] 2026-02-26 16:56:15.378671 | controller | 2026-02-26 16:56:15.378688 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-26 16:56:15.378695 | controller | Thursday 26 February 2026 16:56:15 +0000 (0:00:00.034) 0:01:06.559 ***** 2026-02-26 16:56:15.378704 | controller | skipping: [instance] 2026-02-26 16:56:15.412182 | controller | 2026-02-26 16:56:15.412241 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-26 16:56:15.412256 | controller | Thursday 26 February 2026 16:56:15 +0000 (0:00:00.031) 0:01:06.591 ***** 2026-02-26 16:56:15.412276 | controller | skipping: [instance] 2026-02-26 16:56:15.437711 | controller | 2026-02-26 16:56:15.437732 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-26 16:56:15.437740 | controller | Thursday 26 February 2026 16:56:15 +0000 (0:00:00.033) 0:01:06.624 ***** 2026-02-26 16:56:15.437749 | controller | ok: [instance] 2026-02-26 16:56:15.576835 | controller | 2026-02-26 16:56:15.576859 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-26 16:56:15.576868 | controller | Thursday 26 February 2026 16:56:15 +0000 (0:00:00.025) 0:01:06.650 ***** 2026-02-26 16:56:15.576882 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-26 16:56:15.601484 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-26 16:56:15.601522 | controller | 2026-02-26 16:56:15.601537 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-26 16:56:15.601547 | controller | Thursday 26 February 2026 16:56:15 +0000 (0:00:00.139) 0:01:06.789 ***** 2026-02-26 16:56:15.601562 | controller | skipping: [instance] 2026-02-26 16:56:15.601859 | controller | 2026-02-26 16:56:15.602042 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-26 16:56:15.602196 | controller | Thursday 26 February 2026 16:56:15 +0000 (0:00:00.024) 0:01:06.814 ***** 2026-02-26 16:56:15.824648 | controller | ok: [instance] 2026-02-26 16:56:16.258990 | controller | 2026-02-26 16:56:16.259032 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-26 16:56:16.259046 | controller | Thursday 26 February 2026 16:56:15 +0000 (0:00:00.222) 0:01:07.037 ***** 2026-02-26 16:56:16.259063 | controller | changed: [instance] 2026-02-26 16:56:16.259127 | controller | 2026-02-26 16:56:16.259175 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-26 16:56:16.259189 | controller | Thursday 26 February 2026 16:56:16 +0000 (0:00:00.434) 0:01:07.471 ***** 2026-02-26 16:56:16.336050 | controller | ok: [instance] 2026-02-26 16:56:16.382035 | controller | 2026-02-26 16:56:16.382101 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-26 16:56:16.382113 | controller | Thursday 26 February 2026 16:56:16 +0000 (0:00:00.077) 0:01:07.548 ***** 2026-02-26 16:56:16.382130 | controller | ok: [instance] 2026-02-26 16:56:16.824847 | controller | 2026-02-26 16:56:16.824904 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-26 16:56:16.824914 | controller | Thursday 26 February 2026 16:56:16 +0000 (0:00:00.045) 0:01:07.594 ***** 2026-02-26 16:56:16.824930 | controller | changed: [instance] 2026-02-26 16:56:16.864468 | controller | 2026-02-26 16:56:16.864487 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2026-02-26 16:56:16.864495 | controller | Thursday 26 February 2026 16:56:16 +0000 (0:00:00.442) 0:01:08.037 ***** 2026-02-26 16:56:16.864505 | controller | ok: [instance] 2026-02-26 16:56:16.889109 | controller | 2026-02-26 16:56:16.889131 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2026-02-26 16:56:16.889153 | controller | Thursday 26 February 2026 16:56:16 +0000 (0:00:00.039) 0:01:08.076 ***** 2026-02-26 16:56:16.889164 | controller | ok: [instance] 2026-02-26 16:56:16.914721 | controller | 2026-02-26 16:56:16.914751 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2026-02-26 16:56:16.914764 | controller | Thursday 26 February 2026 16:56:16 +0000 (0:00:00.025) 0:01:08.102 ***** 2026-02-26 16:56:16.914778 | controller | ok: [instance] 2026-02-26 16:56:16.997159 | controller | 2026-02-26 16:56:16.997199 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2026-02-26 16:56:16.997216 | controller | Thursday 26 February 2026 16:56:16 +0000 (0:00:00.025) 0:01:08.127 ***** 2026-02-26 16:56:16.997231 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2026-02-26 16:56:17.142860 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2026-02-26 16:56:17.142896 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2026-02-26 16:56:17.142905 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2026-02-26 16:56:17.142910 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2026-02-26 16:56:17.142916 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2026-02-26 16:56:17.142921 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2026-02-26 16:56:17.142926 | controller | 2026-02-26 16:56:17.142932 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-26 16:56:17.142938 | controller | Thursday 26 February 2026 16:56:16 +0000 (0:00:00.081) 0:01:08.209 ***** 2026-02-26 16:56:17.142950 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2026-02-26 16:56:17.142986 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2026-02-26 16:56:17.143105 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2026-02-26 16:56:17.143220 | controller | 2026-02-26 16:56:17.143326 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-26 16:56:17.143433 | controller | Thursday 26 February 2026 16:56:17 +0000 (0:00:00.147) 0:01:08.356 ***** 2026-02-26 16:56:17.234993 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2026-02-26 16:56:17.235126 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2026-02-26 16:56:17.235256 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2026-02-26 16:56:17.235365 | controller | skipping: [instance] 2026-02-26 16:56:17.235453 | controller | 2026-02-26 16:56:17.235580 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-26 16:56:17.235669 | controller | Thursday 26 February 2026 16:56:17 +0000 (0:00:00.091) 0:01:08.447 ***** 2026-02-26 16:56:17.329271 | controller | skipping: [instance] => (item=compute-0 - storage) 2026-02-26 16:56:17.329378 | controller | skipping: [instance] => (item=controller-0 - storage) 2026-02-26 16:56:17.329503 | controller | skipping: [instance] => (item=crc-0 - storage) 2026-02-26 16:56:17.329625 | controller | skipping: [instance] 2026-02-26 16:56:17.329741 | controller | 2026-02-26 16:56:17.329872 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-26 16:56:17.330024 | controller | Thursday 26 February 2026 16:56:17 +0000 (0:00:00.094) 0:01:08.542 ***** 2026-02-26 16:56:17.418747 | controller | skipping: [instance] => (item=compute-0 - tenant) 2026-02-26 16:56:17.419020 | controller | skipping: [instance] => (item=controller-0 - tenant) 2026-02-26 16:56:17.419262 | controller | skipping: [instance] => (item=crc-0 - tenant) 2026-02-26 16:56:17.419478 | controller | skipping: [instance] 2026-02-26 16:56:17.419548 | controller | 2026-02-26 16:56:17.419656 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-26 16:56:17.419744 | controller | Thursday 26 February 2026 16:56:17 +0000 (0:00:00.089) 0:01:08.632 ***** 2026-02-26 16:56:17.507582 | controller | skipping: [instance] => (item=compute-0 - external) 2026-02-26 16:56:17.507712 | controller | skipping: [instance] => (item=controller-0 - external) 2026-02-26 16:56:17.507841 | controller | skipping: [instance] => (item=crc-0 - external) 2026-02-26 16:56:17.507947 | controller | skipping: [instance] 2026-02-26 16:56:17.508044 | controller | 2026-02-26 16:56:17.508149 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-26 16:56:17.508245 | controller | Thursday 26 February 2026 16:56:17 +0000 (0:00:00.088) 0:01:08.720 ***** 2026-02-26 16:56:17.598602 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2026-02-26 16:56:17.598891 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2026-02-26 16:56:17.598934 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2026-02-26 16:56:17.599069 | controller | skipping: [instance] 2026-02-26 16:56:17.599169 | controller | 2026-02-26 16:56:17.599257 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-26 16:56:17.599371 | controller | Thursday 26 February 2026 16:56:17 +0000 (0:00:00.091) 0:01:08.811 ***** 2026-02-26 16:56:17.746860 | controller | ok: [instance] => (item=compute-0 - public) 2026-02-26 16:56:17.746979 | controller | ok: [instance] => (item=controller-0 - public) 2026-02-26 16:56:17.747140 | controller | ok: [instance] => (item=crc-0 - public) 2026-02-26 16:56:17.747206 | controller | 2026-02-26 16:56:17.747362 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2026-02-26 16:56:17.747443 | controller | Thursday 26 February 2026 16:56:17 +0000 (0:00:00.148) 0:01:08.960 ***** 2026-02-26 16:56:17.862265 | controller | 2026-02-26 16:56:17.862519 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2026-02-26 16:56:17.862726 | controller | Thursday 26 February 2026 16:56:17 +0000 (0:00:00.115) 0:01:09.075 ***** 2026-02-26 16:56:17.915762 | controller | ok: [instance] 2026-02-26 16:56:17.916022 | controller | 2026-02-26 16:56:17.916261 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2026-02-26 16:56:17.916430 | controller | Thursday 26 February 2026 16:56:17 +0000 (0:00:00.053) 0:01:09.129 ***** 2026-02-26 16:56:18.021238 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:6e:9e:b5', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-26 16:56:18.021547 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:74:d9:1b', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-26 16:56:18.021688 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:e2:77:a5', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-26 16:56:18.021856 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:23:6c:17', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-26 16:56:18.022017 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:8c:ed:7b', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-26 16:56:18.022170 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:a5:91:60', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-26 16:56:18.022291 | controller | 2026-02-26 16:56:18.022416 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2026-02-26 16:56:18.022551 | controller | Thursday 26 February 2026 16:56:18 +0000 (0:00:00.105) 0:01:09.234 ***** 2026-02-26 16:56:18.082605 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2026-02-26 16:56:18.082796 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2026-02-26 16:56:18.082934 | controller | 2026-02-26 16:56:18.083065 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-26 16:56:18.083209 | controller | Thursday 26 February 2026 16:56:18 +0000 (0:00:00.061) 0:01:09.295 ***** 2026-02-26 16:56:18.290177 | controller | ok: [instance] 2026-02-26 16:56:18.323833 | controller | 2026-02-26 16:56:18.323876 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-26 16:56:18.323886 | controller | Thursday 26 February 2026 16:56:18 +0000 (0:00:00.207) 0:01:09.502 ***** 2026-02-26 16:56:18.323900 | controller | ok: [instance] 2026-02-26 16:56:18.536535 | controller | 2026-02-26 16:56:18.536578 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-26 16:56:18.536588 | controller | Thursday 26 February 2026 16:56:18 +0000 (0:00:00.033) 0:01:09.536 ***** 2026-02-26 16:56:18.536602 | controller | ok: [instance] 2026-02-26 16:56:18.570652 | controller | 2026-02-26 16:56:18.570675 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-26 16:56:18.570683 | controller | Thursday 26 February 2026 16:56:18 +0000 (0:00:00.212) 0:01:09.749 ***** 2026-02-26 16:56:18.570693 | controller | ok: [instance] 2026-02-26 16:56:18.594963 | controller | 2026-02-26 16:56:18.595002 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2026-02-26 16:56:18.595015 | controller | Thursday 26 February 2026 16:56:18 +0000 (0:00:00.033) 0:01:09.783 ***** 2026-02-26 16:56:18.595032 | controller | ok: [instance] 2026-02-26 16:56:18.595139 | controller | 2026-02-26 16:56:18.595287 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2026-02-26 16:56:18.595307 | controller | Thursday 26 February 2026 16:56:18 +0000 (0:00:00.024) 0:01:09.808 ***** 2026-02-26 16:56:18.789971 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:6e:9e:b5', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-26 16:56:18.790674 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:74:d9:1b', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-26 16:56:18.790694 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:e2:77:a5', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-26 16:56:18.835698 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:23:6c:17', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-26 16:56:18.835727 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:8c:ed:7b', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-26 16:56:18.835737 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:a5:91:60', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-26 16:56:18.835744 | controller | 2026-02-26 16:56:18.835750 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2026-02-26 16:56:18.835757 | controller | Thursday 26 February 2026 16:56:18 +0000 (0:00:00.194) 0:01:10.002 ***** 2026-02-26 16:56:18.835768 | controller | ok: [instance] 2026-02-26 16:56:21.094917 | controller | 2026-02-26 16:56:21.094952 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2026-02-26 16:56:21.094960 | controller | Thursday 26 February 2026 16:56:18 +0000 (0:00:00.045) 0:01:10.048 ***** 2026-02-26 16:56:21.094970 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:6e:9e:b5', 'entry': 'set:compute,52:54:00:6e:9e:b5,192.168.140.100,compute-0', 'state': 'present'}) 2026-02-26 16:56:21.122337 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:74:d9:1b', 'entry': 'set:controller,52:54:01:74:d9:1b,192.168.140.9,controller-0', 'state': 'present'}) 2026-02-26 16:56:21.122356 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:e2:77:a5', 'entry': 'set:ocp,52:54:02:e2:77:a5,192.168.140.10,crc-0', 'state': 'present'}) 2026-02-26 16:56:21.122364 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:23:6c:17', 'entry': 'set:compute,52:54:00:23:6c:17,192.168.101.100,compute-0', 'state': 'present'}) 2026-02-26 16:56:21.122370 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:8c:ed:7b', 'entry': 'set:controller,52:54:01:8c:ed:7b,192.168.101.9,controller-0', 'state': 'present'}) 2026-02-26 16:56:21.122375 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:a5:91:60', 'entry': 'set:ocp,52:54:02:a5:91:60,192.168.101.10,crc-0', 'state': 'present'}) 2026-02-26 16:56:21.122381 | controller | 2026-02-26 16:56:21.122386 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2026-02-26 16:56:21.122396 | controller | Thursday 26 February 2026 16:56:21 +0000 (0:00:02.258) 0:01:12.306 ***** 2026-02-26 16:56:21.122405 | controller | skipping: [instance] 2026-02-26 16:56:21.417562 | controller | 2026-02-26 16:56:21.417584 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2026-02-26 16:56:21.417600 | controller | Thursday 26 February 2026 16:56:21 +0000 (0:00:00.028) 0:01:12.335 ***** 2026-02-26 16:56:21.417610 | controller | ok: [instance] => (item=compute-0) 2026-02-26 16:56:21.537236 | controller | ok: [instance] => (item=controller-0) 2026-02-26 16:56:21.537253 | controller | ok: [instance] => (item=crc-0) 2026-02-26 16:56:21.537260 | controller | 2026-02-26 16:56:21.537265 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2026-02-26 16:56:21.537271 | controller | Thursday 26 February 2026 16:56:21 +0000 (0:00:00.294) 0:01:12.630 ***** 2026-02-26 16:56:21.537278 | controller | 2026-02-26 16:56:21.586475 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-26 16:56:21.586493 | controller | Thursday 26 February 2026 16:56:21 +0000 (0:00:00.119) 0:01:12.750 ***** 2026-02-26 16:56:21.586511 | controller | ok: [instance] 2026-02-26 16:56:21.791985 | controller | 2026-02-26 16:56:21.792025 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-26 16:56:21.792036 | controller | Thursday 26 February 2026 16:56:21 +0000 (0:00:00.049) 0:01:12.799 ***** 2026-02-26 16:56:21.792049 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-26 16:56:21.792097 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-26 16:56:21.792106 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-26 16:56:21.792113 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-26 16:56:21.792120 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-26 16:56:21.792136 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-26 16:56:21.792143 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-26 16:56:21.792155 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 16:56:21.792183 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 16:56:21.792193 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-26 16:56:21.792870 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-26 16:56:21.792899 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-26 16:56:21.792905 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-26 16:56:21.792911 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-26 16:56:21.792917 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-26 16:56:21.792927 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-26 16:56:21.792934 | controller | 2026-02-26 16:56:21.793151 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-26 16:56:24.905722 | controller | Thursday 26 February 2026 16:56:21 +0000 (0:00:00.205) 0:01:13.004 ***** 2026-02-26 16:56:24.905759 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-26 16:56:25.247974 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-26 16:56:25.248016 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-26 16:56:25.248026 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-26 16:56:25.248033 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-26 16:56:25.248052 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-26 16:56:25.248060 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-26 16:56:25.248066 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 16:56:25.248074 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 16:56:25.248080 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-26 16:56:25.248087 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-26 16:56:25.248094 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-26 16:56:25.248101 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-26 16:56:25.248107 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-26 16:56:25.248114 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-26 16:56:25.248120 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-26 16:56:25.248127 | controller | 2026-02-26 16:56:25.248134 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-26 16:56:25.248142 | controller | Thursday 26 February 2026 16:56:24 +0000 (0:00:03.112) 0:01:16.116 ***** 2026-02-26 16:56:25.248154 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-26 16:56:25.248182 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-26 16:56:25.248192 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-26 16:56:25.248198 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-26 16:56:25.248204 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-26 16:56:25.248209 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-26 16:56:25.248214 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-26 16:56:25.248222 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 16:56:25.248949 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 16:56:25.248970 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-26 16:56:25.248982 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-26 16:56:25.249096 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-26 16:56:25.249128 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-26 16:56:25.249135 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-26 16:56:25.249142 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-26 16:56:25.249148 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-26 16:56:25.249159 | controller | 2026-02-26 16:56:25.249166 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2026-02-26 16:56:25.249176 | controller | Thursday 26 February 2026 16:56:25 +0000 (0:00:00.343) 0:01:16.460 ***** 2026-02-26 16:56:25.269613 | controller | ok: [instance] 2026-02-26 16:56:25.312476 | controller | 2026-02-26 16:56:25.312494 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2026-02-26 16:56:25.312502 | controller | Thursday 26 February 2026 16:56:25 +0000 (0:00:00.022) 0:01:16.482 ***** 2026-02-26 16:56:25.312511 | controller | skipping: [instance] => (item=compute) 2026-02-26 16:56:25.344567 | controller | skipping: [instance] => (item=controller) 2026-02-26 16:56:25.344587 | controller | skipping: [instance] => (item=crc) 2026-02-26 16:56:25.344595 | controller | skipping: [instance] 2026-02-26 16:56:25.344601 | controller | 2026-02-26 16:56:25.344607 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2026-02-26 16:56:25.344613 | controller | Thursday 26 February 2026 16:56:25 +0000 (0:00:00.042) 0:01:16.525 ***** 2026-02-26 16:56:25.344621 | controller | skipping: [instance] 2026-02-26 16:56:25.714987 | controller | 2026-02-26 16:56:25.715026 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2026-02-26 16:56:25.715050 | controller | Thursday 26 February 2026 16:56:25 +0000 (0:00:00.032) 0:01:16.557 ***** 2026-02-26 16:56:25.715069 | controller | changed: [instance] 2026-02-26 16:56:25.715096 | controller | 2026-02-26 16:56:25.715508 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2026-02-26 16:56:25.715544 | controller | Thursday 26 February 2026 16:56:25 +0000 (0:00:00.359) 0:01:16.917 ***** 2026-02-26 16:56:27.340927 | controller | 2026-02-26 16:56:27.340963 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-26 16:56:27.340973 | controller | Thursday 26 February 2026 16:56:25 +0000 (0:00:00.010) 0:01:16.928 ***** 2026-02-26 16:56:27.340985 | controller | changed: [instance] 2026-02-26 16:56:27.693397 | controller | 2026-02-26 16:56:27.693422 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-26 16:56:27.693430 | controller | Thursday 26 February 2026 16:56:27 +0000 (0:00:01.625) 0:01:18.553 ***** 2026-02-26 16:56:27.693439 | controller | changed: [instance] 2026-02-26 16:56:28.041372 | controller | 2026-02-26 16:56:28.041403 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2026-02-26 16:56:28.041413 | controller | Thursday 26 February 2026 16:56:27 +0000 (0:00:00.352) 0:01:18.906 ***** 2026-02-26 16:56:28.041424 | controller | changed: [instance] 2026-02-26 16:56:28.400913 | controller | 2026-02-26 16:56:28.400949 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2026-02-26 16:56:28.400957 | controller | Thursday 26 February 2026 16:56:28 +0000 (0:00:00.347) 0:01:19.254 ***** 2026-02-26 16:56:28.400968 | controller | changed: [instance] 2026-02-26 16:56:28.401020 | controller | 2026-02-26 16:56:28.401031 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2026-02-26 16:56:28.401149 | controller | Thursday 26 February 2026 16:56:28 +0000 (0:00:00.359) 0:01:19.614 ***** 2026-02-26 16:56:28.771572 | controller | changed: [instance] 2026-02-26 16:56:28.804734 | controller | 2026-02-26 16:56:28.804766 | controller | TASK [Build utility records dataset] ******************************************* 2026-02-26 16:56:28.804780 | controller | Thursday 26 February 2026 16:56:28 +0000 (0:00:00.369) 0:01:19.984 ***** 2026-02-26 16:56:28.804795 | controller | 2026-02-26 16:56:28.896884 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-26 16:56:28.896907 | controller | Thursday 26 February 2026 16:56:28 +0000 (0:00:00.033) 0:01:20.017 ***** 2026-02-26 16:56:28.896917 | controller | ok: [instance] 2026-02-26 16:56:28.992552 | controller | 2026-02-26 16:56:28.992569 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-26 16:56:28.992576 | controller | Thursday 26 February 2026 16:56:28 +0000 (0:00:00.092) 0:01:20.110 ***** 2026-02-26 16:56:28.992588 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-26 16:56:29.448444 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 16:56:29.448468 | controller | 2026-02-26 16:56:29.448476 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-26 16:56:29.448483 | controller | Thursday 26 February 2026 16:56:28 +0000 (0:00:00.095) 0:01:20.205 ***** 2026-02-26 16:56:29.448492 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-26 16:56:29.732994 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 16:56:29.733033 | controller | 2026-02-26 16:56:29.733043 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-26 16:56:29.733050 | controller | Thursday 26 February 2026 16:56:29 +0000 (0:00:00.455) 0:01:20.661 ***** 2026-02-26 16:56:29.733063 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-26 16:56:30.176403 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-26 16:56:30.176447 | controller | 2026-02-26 16:56:30.176456 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-26 16:56:30.176462 | controller | Thursday 26 February 2026 16:56:29 +0000 (0:00:00.273) 0:01:20.934 ***** 2026-02-26 16:56:30.176468 | controller | 2026-02-26 16:56:30.176473 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-26 16:56:30.176478 | controller | Thursday 26 February 2026 16:56:29 +0000 (0:00:00.010) 0:01:20.945 ***** 2026-02-26 16:56:30.176488 | controller | changed: [instance] 2026-02-26 16:56:30.524533 | controller | 2026-02-26 16:56:30.524562 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-26 16:56:30.524570 | controller | Thursday 26 February 2026 16:56:30 +0000 (0:00:00.443) 0:01:21.388 ***** 2026-02-26 16:56:30.524579 | controller | changed: [instance] 2026-02-26 16:56:30.557266 | controller | 2026-02-26 16:56:30.557284 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2026-02-26 16:56:30.557292 | controller | Thursday 26 February 2026 16:56:30 +0000 (0:00:00.348) 0:01:21.737 ***** 2026-02-26 16:56:30.557300 | controller | skipping: [instance] 2026-02-26 16:56:30.634022 | controller | 2026-02-26 16:56:30.634062 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2026-02-26 16:56:30.634072 | controller | Thursday 26 February 2026 16:56:30 +0000 (0:00:00.032) 0:01:21.770 ***** 2026-02-26 16:56:30.634086 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2026-02-26 16:56:30.831946 | controller | 2026-02-26 16:56:30.831986 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2026-02-26 16:56:30.832003 | controller | Thursday 26 February 2026 16:56:30 +0000 (0:00:00.076) 0:01:21.847 ***** 2026-02-26 16:56:30.832014 | controller | ok: [instance] 2026-02-26 16:56:30.832033 | controller | 2026-02-26 16:56:30.832124 | controller | TASK [Deploy CRC if needed] **************************************************** 2026-02-26 16:56:30.832251 | controller | Thursday 26 February 2026 16:56:30 +0000 (0:00:00.198) 0:01:22.045 ***** 2026-02-26 16:56:30.853602 | controller | skipping: [instance] 2026-02-26 16:56:31.160721 | controller | 2026-02-26 16:56:31.160742 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2026-02-26 16:56:31.160750 | controller | Thursday 26 February 2026 16:56:30 +0000 (0:00:00.021) 0:01:22.066 ***** 2026-02-26 16:56:31.160759 | controller | ok: [instance] 2026-02-26 16:56:31.393924 | controller | 2026-02-26 16:56:31.393958 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2026-02-26 16:56:31.393980 | controller | Thursday 26 February 2026 16:56:31 +0000 (0:00:00.307) 0:01:22.373 ***** 2026-02-26 16:56:31.393993 | controller | ok: [instance] 2026-02-26 16:56:31.394027 | controller | 2026-02-26 16:56:31.394037 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2026-02-26 16:56:31.394140 | controller | Thursday 26 February 2026 16:56:31 +0000 (0:00:00.233) 0:01:22.606 ***** 2026-02-26 16:56:31.610935 | controller | ok: [instance] 2026-02-26 16:56:31.611042 | controller | 2026-02-26 16:56:31.611068 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2026-02-26 16:56:31.611080 | controller | Thursday 26 February 2026 16:56:31 +0000 (0:00:00.217) 0:01:22.824 ***** 2026-02-26 16:56:31.832116 | controller | ok: [instance] 2026-02-26 16:56:32.068436 | controller | 2026-02-26 16:56:32.068464 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2026-02-26 16:56:32.068472 | controller | Thursday 26 February 2026 16:56:31 +0000 (0:00:00.221) 0:01:23.045 ***** 2026-02-26 16:56:32.068482 | controller | ok: [instance] 2026-02-26 16:56:32.109123 | controller | 2026-02-26 16:56:32.109141 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-26 16:56:32.109148 | controller | Thursday 26 February 2026 16:56:32 +0000 (0:00:00.236) 0:01:23.281 ***** 2026-02-26 16:56:32.109157 | controller | 2026-02-26 16:56:32.306652 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-26 16:56:32.306687 | controller | Thursday 26 February 2026 16:56:32 +0000 (0:00:00.040) 0:01:23.322 ***** 2026-02-26 16:56:32.306702 | controller | ok: [instance] 2026-02-26 16:56:32.328979 | controller | 2026-02-26 16:56:32.329015 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-26 16:56:32.329024 | controller | Thursday 26 February 2026 16:56:32 +0000 (0:00:00.197) 0:01:23.519 ***** 2026-02-26 16:56:32.329037 | controller | ok: [instance] 2026-02-26 16:56:32.329045 | controller | 2026-02-26 16:56:32.329051 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-26 16:56:32.329060 | controller | Thursday 26 February 2026 16:56:32 +0000 (0:00:00.022) 0:01:23.542 ***** 2026-02-26 16:56:32.353946 | controller | skipping: [instance] 2026-02-26 16:56:32.354214 | controller | 2026-02-26 16:56:32.354241 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2026-02-26 16:56:32.634919 | controller | Thursday 26 February 2026 16:56:32 +0000 (0:00:00.025) 0:01:23.567 ***** 2026-02-26 16:56:32.634973 | controller | ok: [instance] 2026-02-26 16:56:32.635009 | controller | 2026-02-26 16:56:32.635210 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2026-02-26 16:56:32.853024 | controller | Thursday 26 February 2026 16:56:32 +0000 (0:00:00.280) 0:01:23.848 ***** 2026-02-26 16:56:32.853060 | controller | ok: [instance] 2026-02-26 16:56:33.021915 | controller | 2026-02-26 16:56:33.021972 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2026-02-26 16:56:33.021982 | controller | Thursday 26 February 2026 16:56:32 +0000 (0:00:00.217) 0:01:24.066 ***** 2026-02-26 16:56:33.021995 | controller | ok: [instance] 2026-02-26 16:56:33.076864 | controller | 2026-02-26 16:56:33.076898 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2026-02-26 16:56:33.076906 | controller | Thursday 26 February 2026 16:56:33 +0000 (0:00:00.168) 0:01:24.235 ***** 2026-02-26 16:56:33.076916 | controller | 2026-02-26 16:56:33.117016 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-26 16:56:33.117047 | controller | Thursday 26 February 2026 16:56:33 +0000 (0:00:00.054) 0:01:24.289 ***** 2026-02-26 16:56:33.117060 | controller | ok: [instance] => changed=false 2026-02-26 16:56:33.293919 | controller | msg: All assertions passed 2026-02-26 16:56:33.293965 | controller | 2026-02-26 16:56:33.293976 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-26 16:56:33.293984 | controller | Thursday 26 February 2026 16:56:33 +0000 (0:00:00.039) 0:01:24.329 ***** 2026-02-26 16:56:33.293996 | controller | ok: [instance] 2026-02-26 16:56:33.484714 | controller | 2026-02-26 16:56:33.484748 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-26 16:56:33.484756 | controller | Thursday 26 February 2026 16:56:33 +0000 (0:00:00.177) 0:01:24.506 ***** 2026-02-26 16:56:33.484766 | controller | ok: [instance] 2026-02-26 16:56:33.509705 | controller | 2026-02-26 16:56:33.509723 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-26 16:56:33.509731 | controller | Thursday 26 February 2026 16:56:33 +0000 (0:00:00.190) 0:01:24.697 ***** 2026-02-26 16:56:33.509740 | controller | ok: [instance] => changed=false 2026-02-26 16:56:33.700073 | controller | msg: All assertions passed 2026-02-26 16:56:33.700100 | controller | 2026-02-26 16:56:33.700108 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-26 16:56:33.700114 | controller | Thursday 26 February 2026 16:56:33 +0000 (0:00:00.024) 0:01:24.722 ***** 2026-02-26 16:56:33.700123 | controller | ok: [instance] 2026-02-26 16:56:33.872671 | controller | 2026-02-26 16:56:33.872705 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-26 16:56:33.872712 | controller | Thursday 26 February 2026 16:56:33 +0000 (0:00:00.190) 0:01:24.913 ***** 2026-02-26 16:56:33.872723 | controller | ok: [instance] 2026-02-26 16:56:33.919806 | controller | 2026-02-26 16:56:33.919848 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-26 16:56:33.919861 | controller | Thursday 26 February 2026 16:56:33 +0000 (0:00:00.172) 0:01:25.085 ***** 2026-02-26 16:56:33.919872 | controller | ok: [instance] 2026-02-26 16:56:34.295662 | controller | 2026-02-26 16:56:34.295692 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2026-02-26 16:56:34.295700 | controller | Thursday 26 February 2026 16:56:33 +0000 (0:00:00.047) 0:01:25.132 ***** 2026-02-26 16:56:34.295710 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2026-02-26 16:56:34.313237 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2026-02-26 16:56:34.313255 | controller | 2026-02-26 16:56:34.313262 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2026-02-26 16:56:34.313268 | controller | Thursday 26 February 2026 16:56:34 +0000 (0:00:00.375) 0:01:25.508 ***** 2026-02-26 16:56:34.313277 | controller | skipping: [instance] 2026-02-26 16:56:34.334752 | controller | 2026-02-26 16:56:34.334774 | controller | TASK [Load the architecture local kustomize patches] *************************** 2026-02-26 16:56:34.334788 | controller | Thursday 26 February 2026 16:56:34 +0000 (0:00:00.017) 0:01:25.526 ***** 2026-02-26 16:56:34.334798 | controller | skipping: [instance] 2026-02-26 16:56:34.461455 | controller | 2026-02-26 16:56:34.461477 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2026-02-26 16:56:34.461486 | controller | Thursday 26 February 2026 16:56:34 +0000 (0:00:00.021) 0:01:25.547 ***** 2026-02-26 16:56:34.461497 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2026-02-26 16:56:34.484992 | controller | 2026-02-26 16:56:34.485028 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2026-02-26 16:56:34.485036 | controller | Thursday 26 February 2026 16:56:34 +0000 (0:00:00.126) 0:01:25.674 ***** 2026-02-26 16:56:34.485047 | controller | skipping: [instance] 2026-02-26 16:56:34.485075 | controller | 2026-02-26 16:56:34.485083 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2026-02-26 16:56:34.485219 | controller | Thursday 26 February 2026 16:56:34 +0000 (0:00:00.023) 0:01:25.698 ***** 2026-02-26 16:56:34.894859 | controller | changed: [instance] 2026-02-26 16:56:35.428541 | controller | 2026-02-26 16:56:35.428572 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2026-02-26 16:56:35.428580 | controller | Thursday 26 February 2026 16:56:34 +0000 (0:00:00.409) 0:01:26.107 ***** 2026-02-26 16:56:35.428590 | controller | changed: [instance] 2026-02-26 16:56:35.860447 | controller | 2026-02-26 16:56:35.860476 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2026-02-26 16:56:35.860484 | controller | Thursday 26 February 2026 16:56:35 +0000 (0:00:00.492) 0:01:26.600 ***** 2026-02-26 16:56:35.860490 | controller | 2026-02-26 16:56:35.860495 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-26 16:56:35.860501 | controller | Thursday 26 February 2026 16:56:35 +0000 (0:00:00.040) 0:01:26.641 ***** 2026-02-26 16:56:35.860510 | controller | changed: [instance] 2026-02-26 16:56:36.500946 | controller | 2026-02-26 16:56:36.500984 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-26 16:56:36.500994 | controller | Thursday 26 February 2026 16:56:35 +0000 (0:00:00.432) 0:01:27.073 ***** 2026-02-26 16:56:36.501007 | controller | changed: [instance] 2026-02-26 16:56:36.501037 | controller | 2026-02-26 16:56:36.501046 | controller | TASK [Deploy virtualbmc] ******************************************************* 2026-02-26 16:56:36.501155 | controller | Thursday 26 February 2026 16:56:36 +0000 (0:00:00.640) 0:01:27.714 ***** 2026-02-26 16:56:36.534877 | controller | skipping: [instance] 2026-02-26 16:56:36.535015 | controller | 2026-02-26 16:56:36.535027 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2026-02-26 16:56:36.535036 | controller | Thursday 26 February 2026 16:56:36 +0000 (0:00:00.033) 0:01:27.747 ***** 2026-02-26 16:56:36.569426 | controller | skipping: [instance] 2026-02-26 16:56:37.114444 | controller | 2026-02-26 16:56:37.114473 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2026-02-26 16:56:37.114482 | controller | Thursday 26 February 2026 16:56:36 +0000 (0:00:00.035) 0:01:27.782 ***** 2026-02-26 16:56:37.114492 | controller | changed: [instance] => (item=workload) 2026-02-26 16:56:37.519624 | controller | changed: [instance] => (item=reproducer-inventory) 2026-02-26 16:56:37.519659 | controller | ok: [instance] => (item=volumes) 2026-02-26 16:56:37.519672 | controller | 2026-02-26 16:56:37.519678 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2026-02-26 16:56:37.519684 | controller | Thursday 26 February 2026 16:56:37 +0000 (0:00:00.544) 0:01:28.327 ***** 2026-02-26 16:56:37.519693 | controller | changed: [instance] => (item=workload) 2026-02-26 16:56:37.545489 | controller | changed: [instance] => (item=volumes) 2026-02-26 16:56:37.545508 | controller | 2026-02-26 16:56:37.545516 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2026-02-26 16:56:37.545522 | controller | Thursday 26 February 2026 16:56:37 +0000 (0:00:00.405) 0:01:28.732 ***** 2026-02-26 16:56:37.545531 | controller | skipping: [instance] 2026-02-26 16:56:38.586894 | controller | 2026-02-26 16:56:38.586924 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2026-02-26 16:56:38.586932 | controller | Thursday 26 February 2026 16:56:37 +0000 (0:00:00.026) 0:01:28.758 ***** 2026-02-26 16:56:38.586942 | controller | changed: [instance] => (item=compute) 2026-02-26 16:56:38.618981 | controller | changed: [instance] => (item=controller) 2026-02-26 16:56:38.619023 | controller | changed: [instance] => (item=crc) 2026-02-26 16:56:38.619033 | controller | 2026-02-26 16:56:38.619041 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2026-02-26 16:56:38.619048 | controller | Thursday 26 February 2026 16:56:38 +0000 (0:00:01.041) 0:01:29.799 ***** 2026-02-26 16:56:38.619062 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance 2026-02-26 16:56:38.619093 | controller | 2026-02-26 16:56:38.619103 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] ***************** 2026-02-26 16:56:38.619225 | controller | Thursday 26 February 2026 16:56:38 +0000 (0:00:00.032) 0:01:29.832 ***** 2026-02-26 16:56:38.795297 | controller | ok: [instance] 2026-02-26 16:56:38.814894 | controller | 2026-02-26 16:56:38.814922 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] ************* 2026-02-26 16:56:38.814930 | controller | Thursday 26 February 2026 16:56:38 +0000 (0:00:00.175) 0:01:30.008 ***** 2026-02-26 16:56:38.814939 | controller | skipping: [instance] 2026-02-26 16:56:39.172960 | controller | 2026-02-26 16:56:39.172997 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] *** 2026-02-26 16:56:39.173007 | controller | Thursday 26 February 2026 16:56:38 +0000 (0:00:00.019) 0:01:30.028 ***** 2026-02-26 16:56:39.173020 | controller | changed: [instance] 2026-02-26 16:56:39.173079 | controller | 2026-02-26 16:56:39.173111 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] ********************* 2026-02-26 16:56:39.173126 | controller | Thursday 26 February 2026 16:56:39 +0000 (0:00:00.357) 0:01:30.385 ***** 2026-02-26 16:56:39.193696 | controller | skipping: [instance] 2026-02-26 16:56:39.215024 | controller | 2026-02-26 16:56:39.215071 | controller | TASK [libvirt_manager : Write merged all-group.yml] **************************** 2026-02-26 16:56:39.215085 | controller | Thursday 26 February 2026 16:56:39 +0000 (0:00:00.020) 0:01:30.406 ***** 2026-02-26 16:56:39.215102 | controller | skipping: [instance] 2026-02-26 16:56:39.254246 | controller | 2026-02-26 16:56:39.254271 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2026-02-26 16:56:39.254280 | controller | Thursday 26 February 2026 16:56:39 +0000 (0:00:00.021) 0:01:30.428 ***** 2026-02-26 16:56:39.254290 | controller | skipping: [instance] 2026-02-26 16:56:39.317986 | controller | 2026-02-26 16:56:39.318015 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2026-02-26 16:56:39.318026 | controller | Thursday 26 February 2026 16:56:39 +0000 (0:00:00.039) 0:01:30.467 ***** 2026-02-26 16:56:39.318038 | controller | skipping: [instance] => (item=crc) 2026-02-26 16:56:39.318096 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2026-02-26 16:56:39.318116 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2026-02-26 16:56:39.318132 | controller | 2026-02-26 16:56:39.318140 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-26 16:56:39.318151 | controller | Thursday 26 February 2026 16:56:39 +0000 (0:00:00.063) 0:01:30.531 ***** 2026-02-26 16:56:39.516904 | controller | changed: [instance] 2026-02-26 16:56:39.516949 | controller | 2026-02-26 16:56:39.517176 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-26 16:56:39.691977 | controller | Thursday 26 February 2026 16:56:39 +0000 (0:00:00.199) 0:01:30.730 ***** 2026-02-26 16:56:39.692020 | controller | ok: [instance] 2026-02-26 16:57:32.795394 | controller | 2026-02-26 16:57:32.795436 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-26 16:57:32.795445 | controller | Thursday 26 February 2026 16:56:39 +0000 (0:00:00.174) 0:01:30.904 ***** 2026-02-26 16:57:32.795456 | controller | changed: [instance] 2026-02-26 16:57:32.795475 | controller | 2026-02-26 16:57:32.795711 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-26 16:57:32.994457 | controller | Thursday 26 February 2026 16:57:32 +0000 (0:00:53.103) 0:02:24.008 ***** 2026-02-26 16:57:32.994482 | controller | ok: [instance] 2026-02-26 16:57:33.036838 | controller | 2026-02-26 16:57:33.036858 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-26 16:57:33.036865 | controller | Thursday 26 February 2026 16:57:32 +0000 (0:00:00.199) 0:02:24.207 ***** 2026-02-26 16:57:33.036875 | controller | ok: [instance] => changed=false 2026-02-26 16:57:33.246905 | controller | msg: All assertions passed 2026-02-26 16:57:33.246939 | controller | 2026-02-26 16:57:33.246949 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-26 16:57:33.246957 | controller | Thursday 26 February 2026 16:57:33 +0000 (0:00:00.042) 0:02:24.249 ***** 2026-02-26 16:57:33.246969 | controller | changed: [instance] 2026-02-26 16:57:33.454279 | controller | 2026-02-26 16:57:33.454307 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-26 16:57:33.454314 | controller | Thursday 26 February 2026 16:57:33 +0000 (0:00:00.210) 0:02:24.460 ***** 2026-02-26 16:57:33.454334 | controller | ok: [instance] 2026-02-26 16:57:33.653748 | controller | 2026-02-26 16:57:33.653774 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-26 16:57:33.653783 | controller | Thursday 26 February 2026 16:57:33 +0000 (0:00:00.207) 0:02:24.667 ***** 2026-02-26 16:57:33.653794 | controller | ok: [instance] 2026-02-26 16:57:33.676369 | controller | 2026-02-26 16:57:33.676391 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-26 16:57:33.676400 | controller | Thursday 26 February 2026 16:57:33 +0000 (0:00:00.199) 0:02:24.866 ***** 2026-02-26 16:57:33.676411 | controller | skipping: [instance] 2026-02-26 16:57:33.871384 | controller | 2026-02-26 16:57:33.871404 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-26 16:57:33.871411 | controller | Thursday 26 February 2026 16:57:33 +0000 (0:00:00.022) 0:02:24.889 ***** 2026-02-26 16:57:33.871423 | controller | ok: [instance] 2026-02-26 16:57:33.911971 | controller | 2026-02-26 16:57:33.912007 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-26 16:57:33.912017 | controller | Thursday 26 February 2026 16:57:33 +0000 (0:00:00.194) 0:02:25.084 ***** 2026-02-26 16:57:33.912030 | controller | ok: [instance] => changed=false 2026-02-26 16:57:33.912061 | controller | msg: All assertions passed 2026-02-26 16:57:33.912069 | controller | 2026-02-26 16:57:33.912079 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-26 16:57:33.912106 | controller | Thursday 26 February 2026 16:57:33 +0000 (0:00:00.040) 0:02:25.125 ***** 2026-02-26 16:57:34.116905 | controller | ok: [instance] 2026-02-26 16:57:34.117074 | controller | 2026-02-26 16:57:34.117093 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2026-02-26 16:57:34.295476 | controller | Thursday 26 February 2026 16:57:34 +0000 (0:00:00.205) 0:02:25.330 ***** 2026-02-26 16:57:34.295502 | controller | ok: [instance] 2026-02-26 16:57:34.692482 | controller | 2026-02-26 16:57:34.692513 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2026-02-26 16:57:34.692527 | controller | Thursday 26 February 2026 16:57:34 +0000 (0:00:00.177) 0:02:25.508 ***** 2026-02-26 16:57:34.692537 | controller | changed: [instance] 2026-02-26 16:57:34.867350 | controller | 2026-02-26 16:57:34.867377 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2026-02-26 16:57:34.867385 | controller | Thursday 26 February 2026 16:57:34 +0000 (0:00:00.397) 0:02:25.905 ***** 2026-02-26 16:57:34.867394 | controller | ok: [instance] 2026-02-26 16:57:35.038702 | controller | 2026-02-26 16:57:35.038731 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2026-02-26 16:57:35.038738 | controller | Thursday 26 February 2026 16:57:34 +0000 (0:00:00.174) 0:02:26.080 ***** 2026-02-26 16:57:35.038748 | controller | ok: [instance] 2026-02-26 16:57:35.422358 | controller | 2026-02-26 16:57:35.422385 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2026-02-26 16:57:35.422394 | controller | Thursday 26 February 2026 16:57:35 +0000 (0:00:00.171) 0:02:26.251 ***** 2026-02-26 16:57:35.422407 | controller | changed: [instance] 2026-02-26 16:57:35.442787 | controller | 2026-02-26 16:57:35.442810 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2026-02-26 16:57:35.442839 | controller | Thursday 26 February 2026 16:57:35 +0000 (0:00:00.383) 0:02:26.635 ***** 2026-02-26 16:57:35.442854 | controller | ok: [instance] 2026-02-26 16:57:35.661711 | controller | 2026-02-26 16:57:35.661734 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2026-02-26 16:57:35.661742 | controller | Thursday 26 February 2026 16:57:35 +0000 (0:00:00.020) 0:02:26.655 ***** 2026-02-26 16:57:35.661751 | controller | ok: [instance] 2026-02-26 16:57:36.131688 | controller | 2026-02-26 16:57:36.131720 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2026-02-26 16:57:36.131728 | controller | Thursday 26 February 2026 16:57:35 +0000 (0:00:00.218) 0:02:26.874 ***** 2026-02-26 16:57:36.131739 | controller | ok: [instance] 2026-02-26 16:57:36.250074 | controller | 2026-02-26 16:57:36.250124 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2026-02-26 16:57:36.250138 | controller | Thursday 26 February 2026 16:57:36 +0000 (0:00:00.469) 0:02:27.344 ***** 2026-02-26 16:57:36.250157 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-26 16:57:36.250201 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-26 16:57:36.250213 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-26 16:57:36.250226 | controller | 2026-02-26 16:57:36.250322 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2026-02-26 16:57:36.250351 | controller | Thursday 26 February 2026 16:57:36 +0000 (0:00:00.118) 0:02:27.463 ***** 2026-02-26 16:57:36.496397 | controller | changed: [instance] 2026-02-26 16:57:36.719664 | controller | 2026-02-26 16:57:36.719698 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2026-02-26 16:57:36.719706 | controller | Thursday 26 February 2026 16:57:36 +0000 (0:00:00.246) 0:02:27.709 ***** 2026-02-26 16:57:36.719717 | controller | changed: [instance] 2026-02-26 16:57:37.008885 | controller | 2026-02-26 16:57:37.008909 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2026-02-26 16:57:37.008916 | controller | Thursday 26 February 2026 16:57:36 +0000 (0:00:00.223) 0:02:27.932 ***** 2026-02-26 16:57:37.008925 | controller | changed: [instance] 2026-02-26 16:57:37.009112 | controller | 2026-02-26 16:57:37.009143 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2026-02-26 16:57:37.037417 | controller | Thursday 26 February 2026 16:57:37 +0000 (0:00:00.289) 0:02:28.222 ***** 2026-02-26 16:57:37.037446 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-26 16:57:37.084943 | controller | 2026-02-26 16:57:37.084980 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-26 16:57:37.084989 | controller | Thursday 26 February 2026 16:57:37 +0000 (0:00:00.028) 0:02:28.250 ***** 2026-02-26 16:57:37.085001 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-26 16:57:37.085343 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-26 16:57:37.085375 | controller | 2026-02-26 16:57:37.309346 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-26 16:57:37.309380 | controller | Thursday 26 February 2026 16:57:37 +0000 (0:00:00.047) 0:02:28.298 ***** 2026-02-26 16:57:37.309392 | controller | ok: [instance] 2026-02-26 16:57:37.354956 | controller | 2026-02-26 16:57:37.355010 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-26 16:57:37.355024 | controller | Thursday 26 February 2026 16:57:37 +0000 (0:00:00.223) 0:02:28.522 ***** 2026-02-26 16:57:37.355042 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 16:57:37.355059 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 16:57:37.355069 | controller | 2026-02-26 16:57:37.355082 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-26 16:57:37.584020 | controller | Thursday 26 February 2026 16:57:37 +0000 (0:00:00.045) 0:02:28.568 ***** 2026-02-26 16:57:37.584070 | controller | ok: [instance] 2026-02-26 16:57:37.584117 | controller | 2026-02-26 16:57:37.584132 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-26 16:57:37.584170 | controller | Thursday 26 February 2026 16:57:37 +0000 (0:00:00.229) 0:02:28.797 ***** 2026-02-26 16:57:37.784503 | controller | ok: [instance] 2026-02-26 16:57:38.078529 | controller | 2026-02-26 16:57:38.078562 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2026-02-26 16:57:38.078571 | controller | Thursday 26 February 2026 16:57:37 +0000 (0:00:00.200) 0:02:28.997 ***** 2026-02-26 16:57:38.078581 | controller | changed: [instance] 2026-02-26 16:57:38.302870 | controller | 2026-02-26 16:57:38.302905 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-26 16:57:38.302914 | controller | Thursday 26 February 2026 16:57:38 +0000 (0:00:00.293) 0:02:29.291 ***** 2026-02-26 16:57:38.302925 | controller | ok: [instance] 2026-02-26 16:57:38.348835 | controller | 2026-02-26 16:57:38.348858 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-26 16:57:38.348866 | controller | Thursday 26 February 2026 16:57:38 +0000 (0:00:00.224) 0:02:29.515 ***** 2026-02-26 16:57:38.348877 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 16:57:38.586577 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 16:57:38.586611 | controller | 2026-02-26 16:57:38.586619 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-26 16:57:38.586625 | controller | Thursday 26 February 2026 16:57:38 +0000 (0:00:00.045) 0:02:29.561 ***** 2026-02-26 16:57:38.586636 | controller | ok: [instance] 2026-02-26 16:57:38.787462 | controller | 2026-02-26 16:57:38.787494 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-26 16:57:38.787502 | controller | Thursday 26 February 2026 16:57:38 +0000 (0:00:00.237) 0:02:29.799 ***** 2026-02-26 16:57:38.787513 | controller | ok: [instance] 2026-02-26 16:57:39.071345 | controller | 2026-02-26 16:57:39.071373 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2026-02-26 16:57:39.071381 | controller | Thursday 26 February 2026 16:57:38 +0000 (0:00:00.200) 0:02:30.000 ***** 2026-02-26 16:57:39.071391 | controller | changed: [instance] 2026-02-26 16:57:39.093612 | controller | 2026-02-26 16:57:39.093637 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2026-02-26 16:57:39.093647 | controller | Thursday 26 February 2026 16:57:39 +0000 (0:00:00.283) 0:02:30.284 ***** 2026-02-26 16:57:39.093668 | controller | skipping: [instance] 2026-02-26 16:57:39.120957 | controller | 2026-02-26 16:57:39.120982 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2026-02-26 16:57:39.120991 | controller | Thursday 26 February 2026 16:57:39 +0000 (0:00:00.022) 0:02:30.306 ***** 2026-02-26 16:57:39.121002 | controller | skipping: [instance] 2026-02-26 16:57:39.121032 | controller | 2026-02-26 16:57:39.121042 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2026-02-26 16:57:39.121153 | controller | Thursday 26 February 2026 16:57:39 +0000 (0:00:00.027) 0:02:30.334 ***** 2026-02-26 16:57:39.146607 | controller | skipping: [instance] 2026-02-26 16:57:39.171529 | controller | 2026-02-26 16:57:39.171547 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2026-02-26 16:57:39.171554 | controller | Thursday 26 February 2026 16:57:39 +0000 (0:00:00.025) 0:02:30.359 ***** 2026-02-26 16:57:39.171562 | controller | skipping: [instance] 2026-02-26 16:57:40.386960 | controller | 2026-02-26 16:57:40.386991 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-26 16:57:40.387003 | controller | Thursday 26 February 2026 16:57:39 +0000 (0:00:00.025) 0:02:30.384 ***** 2026-02-26 16:57:40.387013 | controller | changed: [instance] 2026-02-26 16:57:40.423798 | controller | 2026-02-26 16:57:40.423836 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-26 16:57:40.423847 | controller | Thursday 26 February 2026 16:57:40 +0000 (0:00:01.215) 0:02:31.599 ***** 2026-02-26 16:57:40.423857 | controller | ok: [instance] 2026-02-26 16:57:40.478515 | controller | 2026-02-26 16:57:40.478536 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-26 16:57:40.478543 | controller | Thursday 26 February 2026 16:57:40 +0000 (0:00:00.037) 0:02:31.637 ***** 2026-02-26 16:57:40.478557 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-26 16:57:40.673300 | controller | 2026-02-26 16:57:40.673325 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-26 16:57:40.673332 | controller | Thursday 26 February 2026 16:57:40 +0000 (0:00:00.054) 0:02:31.691 ***** 2026-02-26 16:57:40.673342 | controller | ok: [instance] 2026-02-26 16:57:40.734693 | controller | 2026-02-26 16:57:40.734712 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-26 16:57:40.734719 | controller | Thursday 26 February 2026 16:57:40 +0000 (0:00:00.194) 0:02:31.886 ***** 2026-02-26 16:57:40.734728 | controller | ok: [instance] 2026-02-26 16:57:40.780672 | controller | 2026-02-26 16:57:40.780694 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-26 16:57:40.780703 | controller | Thursday 26 February 2026 16:57:40 +0000 (0:00:00.061) 0:02:31.947 ***** 2026-02-26 16:57:40.780714 | controller | ok: [instance] 2026-02-26 16:57:40.824372 | controller | 2026-02-26 16:57:40.824394 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-26 16:57:40.824403 | controller | Thursday 26 February 2026 16:57:40 +0000 (0:00:00.045) 0:02:31.993 ***** 2026-02-26 16:57:40.824414 | controller | skipping: [instance] 2026-02-26 16:57:40.869483 | controller | 2026-02-26 16:57:40.869501 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-26 16:57:40.869508 | controller | Thursday 26 February 2026 16:57:40 +0000 (0:00:00.043) 0:02:32.037 ***** 2026-02-26 16:57:40.869517 | controller | skipping: [instance] 2026-02-26 16:57:40.869671 | controller | 2026-02-26 16:57:40.869855 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-26 16:57:40.870030 | controller | Thursday 26 February 2026 16:57:40 +0000 (0:00:00.045) 0:02:32.083 ***** 2026-02-26 16:57:40.928258 | controller | 2026-02-26 16:57:40.928445 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-26 16:57:40.928594 | controller | Thursday 26 February 2026 16:57:40 +0000 (0:00:00.058) 0:02:32.141 ***** 2026-02-26 16:57:41.332406 | controller | ok: [instance] => (item=artifacts) 2026-02-26 16:57:42.545244 | controller | ok: [instance] => (item=logs) 2026-02-26 16:57:42.545273 | controller | 2026-02-26 16:57:42.545281 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-26 16:57:42.545303 | controller | Thursday 26 February 2026 16:57:41 +0000 (0:00:00.403) 0:02:32.545 ***** 2026-02-26 16:57:42.545314 | controller | ok: [instance] 2026-02-26 16:57:42.765942 | controller | 2026-02-26 16:57:42.765985 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-26 16:57:42.765996 | controller | Thursday 26 February 2026 16:57:42 +0000 (0:00:01.212) 0:02:33.758 ***** 2026-02-26 16:57:42.766010 | controller | changed: [instance] 2026-02-26 16:57:43.141413 | controller | 2026-02-26 16:57:43.141447 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-26 16:57:43.141456 | controller | Thursday 26 February 2026 16:57:42 +0000 (0:00:00.220) 0:02:33.978 ***** 2026-02-26 16:57:43.141468 | controller | changed: [instance] 2026-02-26 16:57:43.515895 | controller | 2026-02-26 16:57:43.515926 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-26 16:57:43.515934 | controller | Thursday 26 February 2026 16:57:43 +0000 (0:00:00.375) 0:02:34.354 ***** 2026-02-26 16:57:43.515944 | controller | changed: [instance] 2026-02-26 16:57:43.516324 | controller | 2026-02-26 16:57:43.560277 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-26 16:57:43.560309 | controller | Thursday 26 February 2026 16:57:43 +0000 (0:00:00.374) 0:02:34.729 ***** 2026-02-26 16:57:43.560320 | controller | skipping: [instance] 2026-02-26 16:57:43.764984 | controller | 2026-02-26 16:57:43.765030 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-26 16:57:43.765041 | controller | Thursday 26 February 2026 16:57:43 +0000 (0:00:00.044) 0:02:34.773 ***** 2026-02-26 16:57:43.765060 | controller | ok: [instance] 2026-02-26 16:57:43.808441 | controller | 2026-02-26 16:57:43.808466 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-26 16:57:43.808475 | controller | Thursday 26 February 2026 16:57:43 +0000 (0:00:00.204) 0:02:34.978 ***** 2026-02-26 16:57:43.808485 | controller | skipping: [instance] 2026-02-26 16:57:44.039578 | controller | 2026-02-26 16:57:44.039610 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-26 16:57:44.039618 | controller | Thursday 26 February 2026 16:57:43 +0000 (0:00:00.042) 0:02:35.021 ***** 2026-02-26 16:57:44.039629 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2026-02-26 16:57:44.329661 | controller | changed: [instance] 2026-02-26 16:57:44.329695 | controller | 2026-02-26 16:57:44.329705 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-26 16:57:44.329712 | controller | Thursday 26 February 2026 16:57:44 +0000 (0:00:00.231) 0:02:35.252 ***** 2026-02-26 16:57:44.329724 | controller | changed: [instance] 2026-02-26 16:57:44.409506 | controller | 2026-02-26 16:57:44.409533 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-26 16:57:44.409541 | controller | Thursday 26 February 2026 16:57:44 +0000 (0:00:00.290) 0:02:35.542 ***** 2026-02-26 16:57:44.409551 | controller | skipping: [instance] 2026-02-26 16:57:44.438590 | controller | 2026-02-26 16:57:44.438613 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2026-02-26 16:57:44.438622 | controller | Thursday 26 February 2026 16:57:44 +0000 (0:00:00.080) 0:02:35.622 ***** 2026-02-26 16:57:44.438633 | controller | skipping: [instance] 2026-02-26 16:57:44.718251 | controller | 2026-02-26 16:57:44.718296 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2026-02-26 16:57:44.718305 | controller | Thursday 26 February 2026 16:57:44 +0000 (0:00:00.028) 0:02:35.651 ***** 2026-02-26 16:57:44.718317 | controller | changed: [instance] 2026-02-26 16:57:44.938929 | controller | 2026-02-26 16:57:44.938963 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2026-02-26 16:57:44.938972 | controller | Thursday 26 February 2026 16:57:44 +0000 (0:00:00.279) 0:02:35.931 ***** 2026-02-26 16:57:44.938982 | controller | changed: [instance] 2026-02-26 16:57:45.229888 | controller | 2026-02-26 16:57:45.229913 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2026-02-26 16:57:45.229921 | controller | Thursday 26 February 2026 16:57:44 +0000 (0:00:00.220) 0:02:36.151 ***** 2026-02-26 16:57:45.229935 | controller | changed: [instance] 2026-02-26 16:57:45.259324 | controller | 2026-02-26 16:57:45.259343 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2026-02-26 16:57:45.259350 | controller | Thursday 26 February 2026 16:57:45 +0000 (0:00:00.291) 0:02:36.443 ***** 2026-02-26 16:57:45.259360 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-26 16:57:45.306768 | controller | 2026-02-26 16:57:45.306792 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-26 16:57:45.306801 | controller | Thursday 26 February 2026 16:57:45 +0000 (0:00:00.029) 0:02:36.472 ***** 2026-02-26 16:57:45.306812 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-26 16:57:45.535520 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-26 16:57:45.535542 | controller | 2026-02-26 16:57:45.535550 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-26 16:57:45.535556 | controller | Thursday 26 February 2026 16:57:45 +0000 (0:00:00.047) 0:02:36.519 ***** 2026-02-26 16:57:45.535565 | controller | ok: [instance] 2026-02-26 16:57:45.581351 | controller | 2026-02-26 16:57:45.581374 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-26 16:57:45.581383 | controller | Thursday 26 February 2026 16:57:45 +0000 (0:00:00.228) 0:02:36.748 ***** 2026-02-26 16:57:45.581393 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 16:57:45.815934 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 16:57:45.815960 | controller | 2026-02-26 16:57:45.815969 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-26 16:57:45.815976 | controller | Thursday 26 February 2026 16:57:45 +0000 (0:00:00.045) 0:02:36.794 ***** 2026-02-26 16:57:45.815987 | controller | ok: [instance] 2026-02-26 16:57:45.816023 | controller | 2026-02-26 16:57:45.816033 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-26 16:57:45.816144 | controller | Thursday 26 February 2026 16:57:45 +0000 (0:00:00.234) 0:02:37.029 ***** 2026-02-26 16:57:46.019550 | controller | ok: [instance] 2026-02-26 16:57:46.311624 | controller | 2026-02-26 16:57:46.311655 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2026-02-26 16:57:46.311665 | controller | Thursday 26 February 2026 16:57:46 +0000 (0:00:00.203) 0:02:37.232 ***** 2026-02-26 16:57:46.311681 | controller | changed: [instance] 2026-02-26 16:57:46.546465 | controller | 2026-02-26 16:57:46.546494 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-26 16:57:46.546502 | controller | Thursday 26 February 2026 16:57:46 +0000 (0:00:00.291) 0:02:37.524 ***** 2026-02-26 16:57:46.546512 | controller | ok: [instance] 2026-02-26 16:57:46.592939 | controller | 2026-02-26 16:57:46.592977 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-26 16:57:46.592989 | controller | Thursday 26 February 2026 16:57:46 +0000 (0:00:00.234) 0:02:37.759 ***** 2026-02-26 16:57:46.593003 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 16:57:46.824953 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 16:57:46.824997 | controller | 2026-02-26 16:57:46.825007 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-26 16:57:46.825016 | controller | Thursday 26 February 2026 16:57:46 +0000 (0:00:00.046) 0:02:37.805 ***** 2026-02-26 16:57:46.825030 | controller | ok: [instance] 2026-02-26 16:57:46.825077 | controller | 2026-02-26 16:57:46.825087 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-26 16:57:47.032453 | controller | Thursday 26 February 2026 16:57:46 +0000 (0:00:00.232) 0:02:38.038 ***** 2026-02-26 16:57:47.032485 | controller | ok: [instance] 2026-02-26 16:57:47.322580 | controller | 2026-02-26 16:57:47.322609 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2026-02-26 16:57:47.322619 | controller | Thursday 26 February 2026 16:57:47 +0000 (0:00:00.207) 0:02:38.245 ***** 2026-02-26 16:57:47.322635 | controller | changed: [instance] 2026-02-26 16:57:47.344436 | controller | 2026-02-26 16:57:47.344459 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2026-02-26 16:57:47.344469 | controller | Thursday 26 February 2026 16:57:47 +0000 (0:00:00.290) 0:02:38.535 ***** 2026-02-26 16:57:47.344481 | controller | skipping: [instance] 2026-02-26 16:57:47.373942 | controller | 2026-02-26 16:57:47.373971 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2026-02-26 16:57:47.373981 | controller | Thursday 26 February 2026 16:57:47 +0000 (0:00:00.021) 0:02:38.557 ***** 2026-02-26 16:57:47.373993 | controller | skipping: [instance] 2026-02-26 16:57:47.374029 | controller | 2026-02-26 16:57:47.374039 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2026-02-26 16:57:47.374102 | controller | Thursday 26 February 2026 16:57:47 +0000 (0:00:00.029) 0:02:38.587 ***** 2026-02-26 16:57:47.401389 | controller | skipping: [instance] 2026-02-26 16:57:47.427588 | controller | 2026-02-26 16:57:47.427615 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2026-02-26 16:57:47.427622 | controller | Thursday 26 February 2026 16:57:47 +0000 (0:00:00.027) 0:02:38.614 ***** 2026-02-26 16:57:47.427629 | controller | skipping: [instance] 2026-02-26 16:57:47.645367 | controller | 2026-02-26 16:57:47.645395 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-26 16:57:47.645403 | controller | Thursday 26 February 2026 16:57:47 +0000 (0:00:00.026) 0:02:38.640 ***** 2026-02-26 16:57:47.645413 | controller | changed: [instance] 2026-02-26 16:57:47.682396 | controller | 2026-02-26 16:57:47.682417 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-26 16:57:47.682425 | controller | Thursday 26 February 2026 16:57:47 +0000 (0:00:00.217) 0:02:38.858 ***** 2026-02-26 16:57:47.682434 | controller | ok: [instance] 2026-02-26 16:57:47.734790 | controller | 2026-02-26 16:57:47.734813 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-26 16:57:47.734843 | controller | Thursday 26 February 2026 16:57:47 +0000 (0:00:00.037) 0:02:38.895 ***** 2026-02-26 16:57:47.734854 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-26 16:57:47.931582 | controller | 2026-02-26 16:57:47.931612 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-26 16:57:47.931620 | controller | Thursday 26 February 2026 16:57:47 +0000 (0:00:00.052) 0:02:38.948 ***** 2026-02-26 16:57:47.931631 | controller | ok: [instance] 2026-02-26 16:57:47.994470 | controller | 2026-02-26 16:57:47.994490 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-26 16:57:47.994498 | controller | Thursday 26 February 2026 16:57:47 +0000 (0:00:00.196) 0:02:39.144 ***** 2026-02-26 16:57:47.994507 | controller | ok: [instance] 2026-02-26 16:57:48.041006 | controller | 2026-02-26 16:57:48.041044 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-26 16:57:48.041055 | controller | Thursday 26 February 2026 16:57:47 +0000 (0:00:00.062) 0:02:39.207 ***** 2026-02-26 16:57:48.041069 | controller | ok: [instance] 2026-02-26 16:57:48.041103 | controller | 2026-02-26 16:57:48.041114 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-26 16:57:48.041236 | controller | Thursday 26 February 2026 16:57:48 +0000 (0:00:00.046) 0:02:39.253 ***** 2026-02-26 16:57:48.082914 | controller | skipping: [instance] 2026-02-26 16:57:48.083162 | controller | 2026-02-26 16:57:48.083186 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-26 16:57:48.126707 | controller | Thursday 26 February 2026 16:57:48 +0000 (0:00:00.042) 0:02:39.296 ***** 2026-02-26 16:57:48.126740 | controller | skipping: [instance] 2026-02-26 16:57:48.186578 | controller | 2026-02-26 16:57:48.186608 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-26 16:57:48.186621 | controller | Thursday 26 February 2026 16:57:48 +0000 (0:00:00.043) 0:02:39.339 ***** 2026-02-26 16:57:48.186635 | controller | 2026-02-26 16:57:48.582638 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-26 16:57:48.582664 | controller | Thursday 26 February 2026 16:57:48 +0000 (0:00:00.059) 0:02:39.399 ***** 2026-02-26 16:57:48.582676 | controller | ok: [instance] => (item=artifacts) 2026-02-26 16:57:49.787747 | controller | ok: [instance] => (item=logs) 2026-02-26 16:57:49.787775 | controller | 2026-02-26 16:57:49.787783 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-26 16:57:49.787789 | controller | Thursday 26 February 2026 16:57:48 +0000 (0:00:00.395) 0:02:39.795 ***** 2026-02-26 16:57:49.787798 | controller | ok: [instance] 2026-02-26 16:57:49.996918 | controller | 2026-02-26 16:57:49.996957 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-26 16:57:49.996967 | controller | Thursday 26 February 2026 16:57:49 +0000 (0:00:01.205) 0:02:41.000 ***** 2026-02-26 16:57:49.996980 | controller | changed: [instance] 2026-02-26 16:57:49.997009 | controller | 2026-02-26 16:57:49.997019 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-26 16:57:49.997046 | controller | Thursday 26 February 2026 16:57:49 +0000 (0:00:00.209) 0:02:41.210 ***** 2026-02-26 16:57:50.353962 | controller | changed: [instance] 2026-02-26 16:57:50.354025 | controller | 2026-02-26 16:57:50.354040 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-26 16:57:50.354173 | controller | Thursday 26 February 2026 16:57:50 +0000 (0:00:00.356) 0:02:41.567 ***** 2026-02-26 16:57:50.721952 | controller | changed: [instance] 2026-02-26 16:57:50.766706 | controller | 2026-02-26 16:57:50.766738 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-26 16:57:50.766748 | controller | Thursday 26 February 2026 16:57:50 +0000 (0:00:00.367) 0:02:41.935 ***** 2026-02-26 16:57:50.766760 | controller | skipping: [instance] 2026-02-26 16:57:50.961467 | controller | 2026-02-26 16:57:50.961489 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-26 16:57:50.961497 | controller | Thursday 26 February 2026 16:57:50 +0000 (0:00:00.044) 0:02:41.979 ***** 2026-02-26 16:57:50.961506 | controller | ok: [instance] 2026-02-26 16:57:51.001895 | controller | 2026-02-26 16:57:51.001921 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-26 16:57:51.001932 | controller | Thursday 26 February 2026 16:57:50 +0000 (0:00:00.194) 0:02:42.174 ***** 2026-02-26 16:57:51.001940 | controller | skipping: [instance] 2026-02-26 16:57:51.235017 | controller | 2026-02-26 16:57:51.235062 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-26 16:57:51.235076 | controller | Thursday 26 February 2026 16:57:50 +0000 (0:00:00.040) 0:02:42.214 ***** 2026-02-26 16:57:51.235093 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2026-02-26 16:57:51.509958 | controller | changed: [instance] 2026-02-26 16:57:51.510001 | controller | 2026-02-26 16:57:51.510014 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-26 16:57:51.510024 | controller | Thursday 26 February 2026 16:57:51 +0000 (0:00:00.233) 0:02:42.447 ***** 2026-02-26 16:57:51.510039 | controller | changed: [instance] 2026-02-26 16:57:51.556344 | controller | 2026-02-26 16:57:51.556379 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-26 16:57:51.556389 | controller | Thursday 26 February 2026 16:57:51 +0000 (0:00:00.275) 0:02:42.722 ***** 2026-02-26 16:57:51.556401 | controller | skipping: [instance] 2026-02-26 16:57:51.584373 | controller | 2026-02-26 16:57:51.584400 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2026-02-26 16:57:51.584410 | controller | Thursday 26 February 2026 16:57:51 +0000 (0:00:00.046) 0:02:42.769 ***** 2026-02-26 16:57:51.584421 | controller | skipping: [instance] 2026-02-26 16:57:51.829397 | controller | 2026-02-26 16:57:51.829429 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2026-02-26 16:57:51.829441 | controller | Thursday 26 February 2026 16:57:51 +0000 (0:00:00.028) 0:02:42.797 ***** 2026-02-26 16:57:51.829452 | controller | changed: [instance] 2026-02-26 16:57:52.055760 | controller | 2026-02-26 16:57:52.055786 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2026-02-26 16:57:52.055798 | controller | Thursday 26 February 2026 16:57:51 +0000 (0:00:00.244) 0:02:43.042 ***** 2026-02-26 16:57:52.055808 | controller | changed: [instance] 2026-02-26 16:57:52.376905 | controller | 2026-02-26 16:57:52.376941 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2026-02-26 16:57:52.376951 | controller | Thursday 26 February 2026 16:57:52 +0000 (0:00:00.226) 0:02:43.268 ***** 2026-02-26 16:57:52.376964 | controller | changed: [instance] 2026-02-26 16:57:52.377392 | controller | 2026-02-26 16:57:52.404569 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2026-02-26 16:57:52.404584 | controller | Thursday 26 February 2026 16:57:52 +0000 (0:00:00.321) 0:02:43.590 ***** 2026-02-26 16:57:52.404594 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-26 16:57:52.446924 | controller | 2026-02-26 16:57:52.446952 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-26 16:57:52.446963 | controller | Thursday 26 February 2026 16:57:52 +0000 (0:00:00.027) 0:02:43.617 ***** 2026-02-26 16:57:52.446975 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-26 16:57:52.675400 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-26 16:57:52.675423 | controller | 2026-02-26 16:57:52.675430 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-26 16:57:52.675436 | controller | Thursday 26 February 2026 16:57:52 +0000 (0:00:00.042) 0:02:43.659 ***** 2026-02-26 16:57:52.675445 | controller | ok: [instance] 2026-02-26 16:57:52.720683 | controller | 2026-02-26 16:57:52.720711 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-26 16:57:52.720721 | controller | Thursday 26 February 2026 16:57:52 +0000 (0:00:00.228) 0:02:43.888 ***** 2026-02-26 16:57:52.720732 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 16:57:52.957981 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 16:57:52.958031 | controller | 2026-02-26 16:57:52.958044 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-26 16:57:52.958054 | controller | Thursday 26 February 2026 16:57:52 +0000 (0:00:00.045) 0:02:43.933 ***** 2026-02-26 16:57:52.958071 | controller | ok: [instance] 2026-02-26 16:57:52.958118 | controller | 2026-02-26 16:57:52.958264 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-26 16:57:52.958297 | controller | Thursday 26 February 2026 16:57:52 +0000 (0:00:00.237) 0:02:44.171 ***** 2026-02-26 16:57:53.159321 | controller | ok: [instance] 2026-02-26 16:57:54.482662 | controller | 2026-02-26 16:57:54.482692 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2026-02-26 16:57:54.482700 | controller | Thursday 26 February 2026 16:57:53 +0000 (0:00:00.200) 0:02:44.372 ***** 2026-02-26 16:57:54.482711 | controller | changed: [instance] 2026-02-26 16:57:54.711720 | controller | 2026-02-26 16:57:54.711748 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-26 16:57:54.711756 | controller | Thursday 26 February 2026 16:57:54 +0000 (0:00:01.323) 0:02:45.695 ***** 2026-02-26 16:57:54.711766 | controller | ok: [instance] 2026-02-26 16:57:54.756933 | controller | 2026-02-26 16:57:54.756964 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-26 16:57:54.756972 | controller | Thursday 26 February 2026 16:57:54 +0000 (0:00:00.229) 0:02:45.924 ***** 2026-02-26 16:57:54.756983 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-26 16:57:54.985623 | controller | ok: [instance] => (item=cifmw-public) 2026-02-26 16:57:54.985665 | controller | 2026-02-26 16:57:54.985676 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-26 16:57:54.985683 | controller | Thursday 26 February 2026 16:57:54 +0000 (0:00:00.045) 0:02:45.969 ***** 2026-02-26 16:57:54.985696 | controller | ok: [instance] 2026-02-26 16:57:54.985724 | controller | 2026-02-26 16:57:54.985929 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-26 16:57:55.187701 | controller | Thursday 26 February 2026 16:57:54 +0000 (0:00:00.229) 0:02:46.198 ***** 2026-02-26 16:57:55.187737 | controller | ok: [instance] 2026-02-26 16:57:55.468965 | controller | 2026-02-26 16:57:55.469002 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2026-02-26 16:57:55.469012 | controller | Thursday 26 February 2026 16:57:55 +0000 (0:00:00.201) 0:02:46.400 ***** 2026-02-26 16:57:55.469025 | controller | changed: [instance] 2026-02-26 16:57:55.492356 | controller | 2026-02-26 16:57:55.492378 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2026-02-26 16:57:55.492386 | controller | Thursday 26 February 2026 16:57:55 +0000 (0:00:00.281) 0:02:46.681 ***** 2026-02-26 16:57:55.492398 | controller | skipping: [instance] 2026-02-26 16:57:55.520953 | controller | 2026-02-26 16:57:55.520986 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2026-02-26 16:57:55.520995 | controller | Thursday 26 February 2026 16:57:55 +0000 (0:00:00.023) 0:02:46.705 ***** 2026-02-26 16:57:55.521006 | controller | skipping: [instance] 2026-02-26 16:57:55.548363 | controller | 2026-02-26 16:57:55.548391 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2026-02-26 16:57:55.548400 | controller | Thursday 26 February 2026 16:57:55 +0000 (0:00:00.028) 0:02:46.734 ***** 2026-02-26 16:57:55.548412 | controller | skipping: [instance] 2026-02-26 16:57:55.574365 | controller | 2026-02-26 16:57:55.574390 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2026-02-26 16:57:55.574397 | controller | Thursday 26 February 2026 16:57:55 +0000 (0:00:00.027) 0:02:46.761 ***** 2026-02-26 16:57:55.574407 | controller | skipping: [instance] 2026-02-26 16:57:55.782857 | controller | 2026-02-26 16:57:55.782886 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-26 16:57:55.782894 | controller | Thursday 26 February 2026 16:57:55 +0000 (0:00:00.026) 0:02:46.787 ***** 2026-02-26 16:57:55.782905 | controller | changed: [instance] 2026-02-26 16:57:55.821560 | controller | 2026-02-26 16:57:55.821593 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-26 16:57:55.821603 | controller | Thursday 26 February 2026 16:57:55 +0000 (0:00:00.208) 0:02:46.995 ***** 2026-02-26 16:57:55.821615 | controller | ok: [instance] 2026-02-26 16:57:55.849664 | controller | 2026-02-26 16:57:55.849687 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-26 16:57:55.849697 | controller | Thursday 26 February 2026 16:57:55 +0000 (0:00:00.038) 0:02:47.034 ***** 2026-02-26 16:57:55.849708 | controller | skipping: [instance] 2026-02-26 16:57:55.877760 | controller | 2026-02-26 16:57:55.877781 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-26 16:57:55.877790 | controller | Thursday 26 February 2026 16:57:55 +0000 (0:00:00.028) 0:02:47.062 ***** 2026-02-26 16:57:55.877799 | controller | skipping: [instance] 2026-02-26 16:57:55.922975 | controller | 2026-02-26 16:57:55.923022 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-26 16:57:55.923034 | controller | Thursday 26 February 2026 16:57:55 +0000 (0:00:00.027) 0:02:47.090 ***** 2026-02-26 16:57:55.923048 | controller | skipping: [instance] 2026-02-26 16:57:55.949627 | controller | 2026-02-26 16:57:55.949655 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2026-02-26 16:57:55.949664 | controller | Thursday 26 February 2026 16:57:55 +0000 (0:00:00.045) 0:02:47.136 ***** 2026-02-26 16:57:55.949674 | controller | skipping: [instance] 2026-02-26 16:57:56.013274 | controller | 2026-02-26 16:57:56.013476 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2026-02-26 16:57:56.013503 | controller | Thursday 26 February 2026 16:57:55 +0000 (0:00:00.026) 0:02:47.162 ***** 2026-02-26 16:57:56.013529 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2026-02-26 16:57:56.253685 | controller | 2026-02-26 16:57:56.253707 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2026-02-26 16:57:56.253721 | controller | Thursday 26 February 2026 16:57:56 +0000 (0:00:00.063) 0:02:47.226 ***** 2026-02-26 16:57:56.253730 | controller | ok: [instance] => (item=crc) 2026-02-26 16:57:56.253894 | controller | 2026-02-26 16:57:56.254042 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2026-02-26 16:57:56.254171 | controller | Thursday 26 February 2026 16:57:56 +0000 (0:00:00.240) 0:02:47.466 ***** 2026-02-26 16:57:58.324479 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-26 16:57:58.324659 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-26 16:57:58.324795 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-26 16:57:58.324942 | controller | 2026-02-26 16:57:58.325075 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-26 16:57:58.325199 | controller | Thursday 26 February 2026 16:57:58 +0000 (0:00:02.070) 0:02:49.537 ***** 2026-02-26 16:57:59.178141 | controller | changed: [instance] 2026-02-26 16:57:59.963373 | controller | 2026-02-26 16:57:59.963409 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-26 16:57:59.963420 | controller | Thursday 26 February 2026 16:57:59 +0000 (0:00:00.853) 0:02:50.390 ***** 2026-02-26 16:57:59.963431 | controller | changed: [instance] 2026-02-26 16:58:00.839576 | controller | 2026-02-26 16:58:00.839609 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-26 16:58:00.839618 | controller | Thursday 26 February 2026 16:57:59 +0000 (0:00:00.785) 0:02:51.175 ***** 2026-02-26 16:58:00.839628 | controller | changed: [instance] 2026-02-26 16:58:01.605143 | controller | 2026-02-26 16:58:01.605177 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2026-02-26 16:58:01.605191 | controller | Thursday 26 February 2026 16:58:00 +0000 (0:00:00.876) 0:02:52.052 ***** 2026-02-26 16:58:01.605209 | controller | changed: [instance] => (item=compute-0.utility) 2026-02-26 16:58:24.720503 | controller | changed: [instance] => (item=controller-0.utility) 2026-02-26 16:58:24.720595 | controller | changed: [instance] => (item=crc-0.utility) 2026-02-26 16:58:24.720603 | controller | 2026-02-26 16:58:24.720609 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2026-02-26 16:58:24.720614 | controller | Thursday 26 February 2026 16:58:01 +0000 (0:00:00.765) 0:02:52.817 ***** 2026-02-26 16:58:24.720632 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2026-02-26 16:58:24.835987 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2026-02-26 16:58:24.836027 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2026-02-26 16:58:24.836034 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2026-02-26 16:58:24.836039 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2026-02-26 16:58:24.836044 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2026-02-26 16:58:24.836048 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left). 2026-02-26 16:58:24.836054 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j113491652998.24675', 'results_file': '/home/zuul/.ansible_async/j113491652998.24675', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2026-02-26 16:58:24.836074 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j583644130811.24693', 'results_file': '/home/zuul/.ansible_async/j583644130811.24693', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2026-02-26 16:58:24.836079 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j783331176123.24709', 'results_file': '/home/zuul/.ansible_async/j783331176123.24709', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2026-02-26 16:58:24.836103 | controller | 2026-02-26 16:58:24.836110 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2026-02-26 16:58:24.836115 | controller | Thursday 26 February 2026 16:58:24 +0000 (0:00:23.114) 0:03:15.931 ***** 2026-02-26 16:58:24.836129 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-26 16:58:24.864296 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-26 16:58:24.864345 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-26 16:58:24.864354 | controller | 2026-02-26 16:58:24.864360 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-26 16:58:24.864367 | controller | Thursday 26 February 2026 16:58:24 +0000 (0:00:00.117) 0:03:16.048 ***** 2026-02-26 16:58:24.864379 | controller | skipping: [instance] 2026-02-26 16:58:24.905494 | controller | 2026-02-26 16:58:24.905526 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2026-02-26 16:58:24.905535 | controller | Thursday 26 February 2026 16:58:24 +0000 (0:00:00.028) 0:03:16.077 ***** 2026-02-26 16:58:24.905546 | controller | 2026-02-26 16:58:24.990251 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-26 16:58:24.990277 | controller | Thursday 26 February 2026 16:58:24 +0000 (0:00:00.041) 0:03:16.118 ***** 2026-02-26 16:58:24.990297 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-26 16:58:25.213582 | controller | 2026-02-26 16:58:25.213606 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-26 16:58:25.213613 | controller | Thursday 26 February 2026 16:58:24 +0000 (0:00:00.084) 0:03:16.203 ***** 2026-02-26 16:58:25.213623 | controller | changed: [instance] 2026-02-26 16:58:25.437724 | controller | 2026-02-26 16:58:25.437753 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-26 16:58:25.437762 | controller | Thursday 26 February 2026 16:58:25 +0000 (0:00:00.223) 0:03:16.426 ***** 2026-02-26 16:58:25.437772 | controller | changed: [instance] 2026-02-26 16:58:25.901519 | controller | 2026-02-26 16:58:25.901565 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2026-02-26 16:58:25.901573 | controller | Thursday 26 February 2026 16:58:25 +0000 (0:00:00.224) 0:03:16.650 ***** 2026-02-26 16:58:25.901585 | controller | changed: [instance] 2026-02-26 16:58:25.927580 | controller | 2026-02-26 16:58:25.927602 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2026-02-26 16:58:25.927610 | controller | Thursday 26 February 2026 16:58:25 +0000 (0:00:00.463) 0:03:17.114 ***** 2026-02-26 16:58:25.927618 | controller | skipping: [instance] 2026-02-26 16:58:25.957167 | controller | 2026-02-26 16:58:25.957185 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-26 16:58:25.957192 | controller | Thursday 26 February 2026 16:58:25 +0000 (0:00:00.026) 0:03:17.140 ***** 2026-02-26 16:58:25.957201 | controller | skipping: [instance] 2026-02-26 16:58:26.012856 | controller | 2026-02-26 16:58:26.012881 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2026-02-26 16:58:26.012889 | controller | Thursday 26 February 2026 16:58:25 +0000 (0:00:00.029) 0:03:17.170 ***** 2026-02-26 16:58:26.012904 | controller | skipping: [instance] 2026-02-26 16:58:26.062208 | controller | 2026-02-26 16:58:26.062235 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2026-02-26 16:58:26.062243 | controller | Thursday 26 February 2026 16:58:26 +0000 (0:00:00.055) 0:03:17.225 ***** 2026-02-26 16:58:26.062253 | controller | skipping: [instance] 2026-02-26 16:58:26.142706 | controller | 2026-02-26 16:58:26.142746 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-26 16:58:26.142757 | controller | Thursday 26 February 2026 16:58:26 +0000 (0:00:00.049) 0:03:17.275 ***** 2026-02-26 16:58:26.142768 | controller | skipping: [instance] 2026-02-26 16:58:26.183902 | controller | 2026-02-26 16:58:26.183930 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2026-02-26 16:58:26.183938 | controller | Thursday 26 February 2026 16:58:26 +0000 (0:00:00.080) 0:03:17.355 ***** 2026-02-26 16:58:26.183947 | controller | 2026-02-26 16:58:26.273250 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-26 16:58:26.273285 | controller | Thursday 26 February 2026 16:58:26 +0000 (0:00:00.041) 0:03:17.397 ***** 2026-02-26 16:58:26.273304 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-26 16:58:26.504388 | controller | 2026-02-26 16:58:26.504422 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-26 16:58:26.504430 | controller | Thursday 26 February 2026 16:58:26 +0000 (0:00:00.088) 0:03:17.486 ***** 2026-02-26 16:58:26.504441 | controller | ok: [instance] 2026-02-26 16:58:26.759149 | controller | 2026-02-26 16:58:26.759191 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-26 16:58:26.759199 | controller | Thursday 26 February 2026 16:58:26 +0000 (0:00:00.230) 0:03:17.717 ***** 2026-02-26 16:58:26.759211 | controller | ok: [instance] 2026-02-26 16:58:27.187882 | controller | 2026-02-26 16:58:27.187930 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2026-02-26 16:58:27.187938 | controller | Thursday 26 February 2026 16:58:26 +0000 (0:00:00.254) 0:03:17.971 ***** 2026-02-26 16:58:27.187949 | controller | changed: [instance] 2026-02-26 16:58:27.222357 | controller | 2026-02-26 16:58:27.222376 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2026-02-26 16:58:27.222382 | controller | Thursday 26 February 2026 16:58:27 +0000 (0:00:00.428) 0:03:18.400 ***** 2026-02-26 16:58:27.222390 | controller | skipping: [instance] 2026-02-26 16:58:27.256419 | controller | 2026-02-26 16:58:27.256436 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-26 16:58:27.256443 | controller | Thursday 26 February 2026 16:58:27 +0000 (0:00:00.035) 0:03:18.435 ***** 2026-02-26 16:58:27.256451 | controller | skipping: [instance] 2026-02-26 16:58:29.044846 | controller | 2026-02-26 16:58:29.044911 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2026-02-26 16:58:29.044928 | controller | Thursday 26 February 2026 16:58:27 +0000 (0:00:00.033) 0:03:18.469 ***** 2026-02-26 16:58:29.044943 | controller | changed: [instance -> controller-0.instance] 2026-02-26 16:58:30.246809 | controller | 2026-02-26 16:58:30.246888 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2026-02-26 16:58:30.246898 | controller | Thursday 26 February 2026 16:58:29 +0000 (0:00:01.786) 0:03:20.256 ***** 2026-02-26 16:58:30.246912 | controller | changed: [instance -> controller-0.instance] 2026-02-26 16:58:30.291491 | controller | 2026-02-26 16:58:30.291527 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-26 16:58:30.291534 | controller | Thursday 26 February 2026 16:58:30 +0000 (0:00:01.202) 0:03:21.459 ***** 2026-02-26 16:58:30.291546 | controller | 2026-02-26 16:58:30.526972 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-26 16:58:30.527029 | controller | Thursday 26 February 2026 16:58:30 +0000 (0:00:00.045) 0:03:21.504 ***** 2026-02-26 16:58:30.527045 | controller | ok: [instance] 2026-02-26 16:58:30.563546 | controller | 2026-02-26 16:58:30.563586 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-26 16:58:30.563595 | controller | Thursday 26 February 2026 16:58:30 +0000 (0:00:00.234) 0:03:21.739 ***** 2026-02-26 16:58:30.563606 | controller | ok: [instance] 2026-02-26 16:58:30.596305 | controller | 2026-02-26 16:58:30.596326 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-26 16:58:30.596333 | controller | Thursday 26 February 2026 16:58:30 +0000 (0:00:00.037) 0:03:21.776 ***** 2026-02-26 16:58:30.596342 | controller | skipping: [instance] 2026-02-26 16:58:30.645591 | controller | 2026-02-26 16:58:30.645607 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2026-02-26 16:58:30.645614 | controller | Thursday 26 February 2026 16:58:30 +0000 (0:00:00.033) 0:03:21.809 ***** 2026-02-26 16:58:30.645623 | controller | 2026-02-26 16:58:30.745566 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-26 16:58:30.745597 | controller | Thursday 26 February 2026 16:58:30 +0000 (0:00:00.049) 0:03:21.858 ***** 2026-02-26 16:58:30.745609 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2026-02-26 16:58:31.008004 | controller | 2026-02-26 16:58:31.008065 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-26 16:58:31.008083 | controller | Thursday 26 February 2026 16:58:30 +0000 (0:00:00.099) 0:03:21.958 ***** 2026-02-26 16:58:31.008096 | controller | ok: [instance] 2026-02-26 16:58:31.241510 | controller | 2026-02-26 16:58:31.241558 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-26 16:58:31.241566 | controller | Thursday 26 February 2026 16:58:31 +0000 (0:00:00.262) 0:03:22.220 ***** 2026-02-26 16:58:31.241578 | controller | ok: [instance] 2026-02-26 16:58:31.655938 | controller | 2026-02-26 16:58:31.656005 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2026-02-26 16:58:31.656022 | controller | Thursday 26 February 2026 16:58:31 +0000 (0:00:00.233) 0:03:22.454 ***** 2026-02-26 16:58:31.656036 | controller | changed: [instance] 2026-02-26 16:58:32.477999 | controller | 2026-02-26 16:58:32.478052 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2026-02-26 16:58:32.478060 | controller | Thursday 26 February 2026 16:58:31 +0000 (0:00:00.414) 0:03:22.868 ***** 2026-02-26 16:58:32.478082 | controller | changed: [instance] 2026-02-26 16:58:32.478972 | controller | 2026-02-26 16:58:32.479027 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-26 16:58:32.479158 | controller | Thursday 26 February 2026 16:58:32 +0000 (0:00:00.822) 0:03:23.690 ***** 2026-02-26 16:58:32.507176 | controller | skipping: [instance] 2026-02-26 16:58:32.507277 | controller | 2026-02-26 16:58:32.507393 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2026-02-26 16:58:32.507474 | controller | Thursday 26 February 2026 16:58:32 +0000 (0:00:00.030) 0:03:23.720 ***** 2026-02-26 16:58:32.561562 | controller | skipping: [instance] 2026-02-26 16:58:32.561656 | controller | 2026-02-26 16:58:32.561777 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2026-02-26 16:58:32.561924 | controller | Thursday 26 February 2026 16:58:32 +0000 (0:00:00.051) 0:03:23.771 ***** 2026-02-26 16:58:32.613837 | controller | skipping: [instance] 2026-02-26 16:58:32.613928 | controller | 2026-02-26 16:58:32.614016 | controller | TASK [Create VBMC entity] ****************************************************** 2026-02-26 16:58:32.614133 | controller | Thursday 26 February 2026 16:58:32 +0000 (0:00:00.055) 0:03:23.826 ***** 2026-02-26 16:58:32.668870 | controller | skipping: [instance] => (item=compute-0) 2026-02-26 16:58:32.668968 | controller | skipping: [instance] => (item=controller-0) 2026-02-26 16:58:32.669049 | controller | skipping: [instance] => (item=crc-0) 2026-02-26 16:58:32.669150 | controller | skipping: [instance] 2026-02-26 16:58:32.669233 | controller | 2026-02-26 16:58:32.669319 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2026-02-26 16:58:32.669406 | controller | Thursday 26 February 2026 16:58:32 +0000 (0:00:00.055) 0:03:23.882 ***** 2026-02-26 16:58:32.958961 | controller | ok: [instance] 2026-02-26 16:58:32.959026 | controller | 2026-02-26 16:58:32.959147 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2026-02-26 16:58:32.959242 | controller | Thursday 26 February 2026 16:58:32 +0000 (0:00:00.289) 0:03:24.171 ***** 2026-02-26 16:58:33.358246 | controller | changed: [instance] 2026-02-26 16:58:33.358327 | controller | 2026-02-26 16:58:33.358424 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2026-02-26 16:58:33.358502 | controller | Thursday 26 February 2026 16:58:33 +0000 (0:00:00.399) 0:03:24.570 ***** 2026-02-26 16:58:33.404738 | controller | skipping: [instance] 2026-02-26 16:58:33.404835 | controller | 2026-02-26 16:58:33.404955 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2026-02-26 16:58:33.405048 | controller | Thursday 26 February 2026 16:58:33 +0000 (0:00:00.047) 0:03:24.617 ***** 2026-02-26 16:58:33.441557 | controller | skipping: [instance] 2026-02-26 16:58:33.441650 | controller | 2026-02-26 16:58:33.441762 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2026-02-26 16:58:33.441880 | controller | Thursday 26 February 2026 16:58:33 +0000 (0:00:00.037) 0:03:24.655 ***** 2026-02-26 16:58:33.478095 | controller | skipping: [instance] 2026-02-26 16:58:33.478184 | controller | 2026-02-26 16:58:33.478274 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2026-02-26 16:58:33.478372 | controller | Thursday 26 February 2026 16:58:33 +0000 (0:00:00.036) 0:03:24.691 ***** 2026-02-26 16:58:34.317430 | controller | changed: [instance] 2026-02-26 16:58:34.317491 | controller | 2026-02-26 16:58:34.317582 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2026-02-26 16:58:34.317680 | controller | Thursday 26 February 2026 16:58:34 +0000 (0:00:00.837) 0:03:25.529 ***** 2026-02-26 16:58:35.094997 | controller | changed: [instance] 2026-02-26 16:58:35.095072 | controller | 2026-02-26 16:58:35.095161 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2026-02-26 16:58:35.095267 | controller | Thursday 26 February 2026 16:58:35 +0000 (0:00:00.778) 0:03:26.307 ***** 2026-02-26 16:58:35.145947 | controller | skipping: [instance] 2026-02-26 16:58:35.146038 | controller | 2026-02-26 16:58:35.146175 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2026-02-26 16:58:35.146256 | controller | Thursday 26 February 2026 16:58:35 +0000 (0:00:00.051) 0:03:26.359 ***** 2026-02-26 16:58:35.222162 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2026-02-26 16:58:35.222262 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2026-02-26 16:58:35.222487 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2026-02-26 16:58:35.222552 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2026-02-26 16:58:35.222562 | controller | 2026-02-26 16:58:35.222639 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2026-02-26 16:58:35.222727 | controller | Thursday 26 February 2026 16:58:35 +0000 (0:00:00.076) 0:03:26.435 ***** 2026-02-26 16:58:35.274769 | controller | skipping: [instance] 2026-02-26 16:58:35.274802 | controller | 2026-02-26 16:58:35.274913 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2026-02-26 16:58:35.275011 | controller | Thursday 26 February 2026 16:58:35 +0000 (0:00:00.052) 0:03:26.487 ***** 2026-02-26 16:58:35.320124 | controller | skipping: [instance] 2026-02-26 16:58:35.320265 | controller | 2026-02-26 16:58:35.320378 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2026-02-26 16:58:35.320486 | controller | Thursday 26 February 2026 16:58:35 +0000 (0:00:00.045) 0:03:26.533 ***** 2026-02-26 16:58:35.364333 | controller | skipping: [instance] 2026-02-26 16:58:35.364468 | controller | 2026-02-26 16:58:35.364587 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2026-02-26 16:58:35.364702 | controller | Thursday 26 February 2026 16:58:35 +0000 (0:00:00.044) 0:03:26.577 ***** 2026-02-26 16:58:35.409879 | controller | skipping: [instance] 2026-02-26 16:58:36.109952 | controller | 2026-02-26 16:58:36.110003 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2026-02-26 16:58:36.110013 | controller | Thursday 26 February 2026 16:58:35 +0000 (0:00:00.044) 0:03:26.622 ***** 2026-02-26 16:58:36.110041 | controller | changed: [instance] 2026-02-26 16:58:36.110150 | controller | 2026-02-26 16:58:36.110167 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2026-02-26 16:58:36.110256 | controller | Thursday 26 February 2026 16:58:36 +0000 (0:00:00.700) 0:03:27.322 ***** 2026-02-26 16:58:36.155710 | controller | skipping: [instance] 2026-02-26 16:58:36.155757 | controller | 2026-02-26 16:58:36.155769 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2026-02-26 16:58:36.155935 | controller | Thursday 26 February 2026 16:58:36 +0000 (0:00:00.045) 0:03:27.368 ***** 2026-02-26 16:58:36.202217 | controller | skipping: [instance] 2026-02-26 16:58:36.202305 | controller | 2026-02-26 16:58:36.202417 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2026-02-26 16:58:36.202519 | controller | Thursday 26 February 2026 16:58:36 +0000 (0:00:00.046) 0:03:27.415 ***** 2026-02-26 16:58:36.243182 | controller | skipping: [instance] 2026-02-26 16:58:36.243269 | controller | 2026-02-26 16:58:36.243376 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-26 16:58:36.243476 | controller | Thursday 26 February 2026 16:58:36 +0000 (0:00:00.040) 0:03:27.456 ***** 2026-02-26 16:58:36.290483 | controller | skipping: [instance] 2026-02-26 16:58:36.290568 | controller | 2026-02-26 16:58:36.290668 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-26 16:58:36.290764 | controller | Thursday 26 February 2026 16:58:36 +0000 (0:00:00.047) 0:03:27.503 ***** 2026-02-26 16:58:36.333673 | controller | skipping: [instance] 2026-02-26 16:58:36.333730 | controller | 2026-02-26 16:58:36.333741 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-26 16:58:36.333750 | controller | Thursday 26 February 2026 16:58:36 +0000 (0:00:00.042) 0:03:27.546 ***** 2026-02-26 16:58:36.376899 | controller | skipping: [instance] 2026-02-26 16:58:36.376983 | controller | 2026-02-26 16:58:36.377099 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-26 16:58:36.377201 | controller | Thursday 26 February 2026 16:58:36 +0000 (0:00:00.043) 0:03:27.590 ***** 2026-02-26 16:58:36.425109 | controller | skipping: [instance] 2026-02-26 16:58:36.466967 | controller | 2026-02-26 16:58:36.466988 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-26 16:58:36.466996 | controller | Thursday 26 February 2026 16:58:36 +0000 (0:00:00.042) 0:03:27.632 ***** 2026-02-26 16:58:36.467006 | controller | skipping: [instance] 2026-02-26 16:58:36.513788 | controller | 2026-02-26 16:58:36.513811 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-26 16:58:36.513833 | controller | Thursday 26 February 2026 16:58:36 +0000 (0:00:00.046) 0:03:27.679 ***** 2026-02-26 16:58:36.513846 | controller | skipping: [instance] 2026-02-26 16:58:36.565413 | controller | 2026-02-26 16:58:36.565447 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-26 16:58:36.565458 | controller | Thursday 26 February 2026 16:58:36 +0000 (0:00:00.046) 0:03:27.726 ***** 2026-02-26 16:58:36.565471 | controller | skipping: [instance] 2026-02-26 16:58:36.603880 | controller | 2026-02-26 16:58:36.603907 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2026-02-26 16:58:36.603923 | controller | Thursday 26 February 2026 16:58:36 +0000 (0:00:00.051) 0:03:27.778 ***** 2026-02-26 16:58:36.603934 | controller | skipping: [instance] 2026-02-26 16:58:36.867245 | controller | 2026-02-26 16:58:36.867295 | controller | TASK [reproducer : Configure Controller node] ********************************** 2026-02-26 16:58:36.867312 | controller | Thursday 26 February 2026 16:58:36 +0000 (0:00:00.038) 0:03:27.816 ***** 2026-02-26 16:58:36.867324 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2026-02-26 16:58:38.483722 | controller | 2026-02-26 16:58:38.483773 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-26 16:58:38.483782 | controller | Thursday 26 February 2026 16:58:36 +0000 (0:00:00.262) 0:03:28.079 ***** 2026-02-26 16:58:38.483795 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-26 16:58:38.515472 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-26 16:58:38.515508 | controller | 2026-02-26 16:58:38.515518 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-26 16:58:38.515525 | controller | Thursday 26 February 2026 16:58:38 +0000 (0:00:01.616) 0:03:29.695 ***** 2026-02-26 16:58:38.515538 | controller | skipping: [instance] 2026-02-26 16:58:39.235350 | controller | 2026-02-26 16:58:39.235388 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-26 16:58:39.235395 | controller | Thursday 26 February 2026 16:58:38 +0000 (0:00:00.032) 0:03:29.728 ***** 2026-02-26 16:58:39.235405 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:58:39.274241 | controller | 2026-02-26 16:58:39.274274 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-26 16:58:39.274282 | controller | Thursday 26 February 2026 16:58:39 +0000 (0:00:00.719) 0:03:30.448 ***** 2026-02-26 16:58:39.274291 | controller | skipping: [instance] 2026-02-26 16:58:39.314246 | controller | 2026-02-26 16:58:39.314267 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-26 16:58:39.314274 | controller | Thursday 26 February 2026 16:58:39 +0000 (0:00:00.039) 0:03:30.487 ***** 2026-02-26 16:58:39.314283 | controller | skipping: [instance] 2026-02-26 16:58:39.355448 | controller | 2026-02-26 16:58:39.355473 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-26 16:58:39.355483 | controller | Thursday 26 February 2026 16:58:39 +0000 (0:00:00.039) 0:03:30.527 ***** 2026-02-26 16:58:39.355493 | controller | skipping: [instance] 2026-02-26 16:58:39.404632 | controller | 2026-02-26 16:58:39.404682 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-26 16:58:39.404695 | controller | Thursday 26 February 2026 16:58:39 +0000 (0:00:00.041) 0:03:30.568 ***** 2026-02-26 16:58:39.404712 | controller | skipping: [instance] 2026-02-26 16:58:39.444965 | controller | 2026-02-26 16:58:39.445118 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2026-02-26 16:58:39.445131 | controller | Thursday 26 February 2026 16:58:39 +0000 (0:00:00.048) 0:03:30.617 ***** 2026-02-26 16:58:39.445148 | controller | skipping: [instance] 2026-02-26 16:58:39.445227 | controller | 2026-02-26 16:58:39.445236 | controller | TASK [reproducer : Install repos] ********************************************** 2026-02-26 16:58:39.486850 | controller | Thursday 26 February 2026 16:58:39 +0000 (0:00:00.040) 0:03:30.658 ***** 2026-02-26 16:58:39.486897 | controller | skipping: [instance] 2026-02-26 16:58:39.528642 | controller | 2026-02-26 16:58:39.528663 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2026-02-26 16:58:39.528671 | controller | Thursday 26 February 2026 16:58:39 +0000 (0:00:00.041) 0:03:30.699 ***** 2026-02-26 16:58:39.528681 | controller | skipping: [instance] 2026-02-26 16:58:39.572096 | controller | 2026-02-26 16:58:39.572139 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2026-02-26 16:58:39.572154 | controller | Thursday 26 February 2026 16:58:39 +0000 (0:00:00.041) 0:03:30.741 ***** 2026-02-26 16:58:39.572172 | controller | skipping: [instance] 2026-02-26 16:58:40.805818 | controller | 2026-02-26 16:58:40.805875 | controller | TASK [reproducer : Install some tools] ***************************************** 2026-02-26 16:58:40.805884 | controller | Thursday 26 February 2026 16:58:39 +0000 (0:00:00.043) 0:03:30.784 ***** 2026-02-26 16:58:40.805894 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:58:42.024954 | controller | 2026-02-26 16:58:42.025058 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2026-02-26 16:58:42.025069 | controller | Thursday 26 February 2026 16:58:40 +0000 (0:00:01.233) 0:03:32.018 ***** 2026-02-26 16:58:42.025091 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:58:42.025151 | controller | 2026-02-26 16:58:42.025181 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2026-02-26 16:58:42.025191 | controller | Thursday 26 February 2026 16:58:42 +0000 (0:00:01.219) 0:03:33.237 ***** 2026-02-26 16:58:42.730280 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:58:42.730337 | controller | 2026-02-26 16:58:42.730423 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2026-02-26 16:58:42.730520 | controller | Thursday 26 February 2026 16:58:42 +0000 (0:00:00.705) 0:03:33.943 ***** 2026-02-26 16:58:43.867530 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:58:43.867590 | controller | 2026-02-26 16:58:43.867848 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2026-02-26 16:58:44.967174 | controller | Thursday 26 February 2026 16:58:43 +0000 (0:00:01.137) 0:03:35.080 ***** 2026-02-26 16:58:44.967219 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-26 16:58:45.749762 | controller | skipping: [instance] => (item=compute-0) 2026-02-26 16:58:45.749801 | controller | skipping: [instance] => (item=controller-0) 2026-02-26 16:58:45.749808 | controller | skipping: [instance] => (item=crc-0) 2026-02-26 16:58:45.749814 | controller | 2026-02-26 16:58:45.749850 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2026-02-26 16:58:45.749862 | controller | Thursday 26 February 2026 16:58:44 +0000 (0:00:01.098) 0:03:36.179 ***** 2026-02-26 16:58:45.749873 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-26 16:58:47.670953 | controller | skipping: [instance] => (item=compute-0) 2026-02-26 16:58:47.671011 | controller | skipping: [instance] => (item=controller-0) 2026-02-26 16:58:47.671020 | controller | skipping: [instance] => (item=crc-0) 2026-02-26 16:58:47.671026 | controller | 2026-02-26 16:58:47.671032 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2026-02-26 16:58:47.671038 | controller | Thursday 26 February 2026 16:58:45 +0000 (0:00:00.782) 0:03:36.961 ***** 2026-02-26 16:58:47.671050 | controller | skipping: [instance] => (item=instance) 2026-02-26 16:58:47.671082 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2026-02-26 16:58:47.671089 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-26 16:58:47.671094 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2026-02-26 16:58:47.671101 | controller | 2026-02-26 16:58:47.671240 | controller | TASK [reproducer : Create kube directory] ************************************** 2026-02-26 16:58:47.671281 | controller | Thursday 26 February 2026 16:58:47 +0000 (0:00:01.921) 0:03:38.883 ***** 2026-02-26 16:58:48.335060 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:58:49.510061 | controller | 2026-02-26 16:58:49.510112 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2026-02-26 16:58:49.510122 | controller | Thursday 26 February 2026 16:58:48 +0000 (0:00:00.664) 0:03:39.547 ***** 2026-02-26 16:58:49.510136 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:58:50.541406 | controller | 2026-02-26 16:58:50.541443 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2026-02-26 16:58:50.541451 | controller | Thursday 26 February 2026 16:58:49 +0000 (0:00:01.168) 0:03:40.715 ***** 2026-02-26 16:58:50.541463 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:58:50.589570 | controller | 2026-02-26 16:58:50.589595 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2026-02-26 16:58:50.589603 | controller | Thursday 26 February 2026 16:58:50 +0000 (0:00:01.038) 0:03:41.754 ***** 2026-02-26 16:58:50.589613 | controller | skipping: [instance] 2026-02-26 16:58:51.214405 | controller | 2026-02-26 16:58:51.214443 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2026-02-26 16:58:51.214451 | controller | Thursday 26 February 2026 16:58:50 +0000 (0:00:00.048) 0:03:41.802 ***** 2026-02-26 16:58:51.214462 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:58:51.830813 | controller | 2026-02-26 16:58:51.830867 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2026-02-26 16:58:51.830874 | controller | Thursday 26 February 2026 16:58:51 +0000 (0:00:00.624) 0:03:42.427 ***** 2026-02-26 16:58:51.830885 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:58:51.881181 | controller | 2026-02-26 16:58:51.881207 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2026-02-26 16:58:51.881217 | controller | Thursday 26 February 2026 16:58:51 +0000 (0:00:00.615) 0:03:43.042 ***** 2026-02-26 16:58:51.881230 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:58:51.959778 | controller | 2026-02-26 16:58:51.959802 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2026-02-26 16:58:51.959811 | controller | Thursday 26 February 2026 16:58:51 +0000 (0:00:00.051) 0:03:43.093 ***** 2026-02-26 16:58:51.959848 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2026-02-26 16:58:52.024925 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2026-02-26 16:58:52.024949 | controller | 2026-02-26 16:58:52.024958 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-26 16:58:52.024965 | controller | Thursday 26 February 2026 16:58:51 +0000 (0:00:00.078) 0:03:43.172 ***** 2026-02-26 16:58:52.024977 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-26 16:58:52.088434 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2026-02-26 16:58:52.088454 | controller | 2026-02-26 16:58:52.088461 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-26 16:58:52.088467 | controller | Thursday 26 February 2026 16:58:52 +0000 (0:00:00.065) 0:03:43.237 ***** 2026-02-26 16:58:52.088476 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-26 16:58:52.146328 | controller | _secret_file: '' 2026-02-26 16:58:52.146347 | controller | 2026-02-26 16:58:52.146354 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-26 16:58:52.146360 | controller | Thursday 26 February 2026 16:58:52 +0000 (0:00:00.063) 0:03:43.301 ***** 2026-02-26 16:58:52.146368 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-26 16:58:52.201282 | controller | _secret_content: my-default-location-place 2026-02-26 16:58:52.201302 | controller | 2026-02-26 16:58:52.201309 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-26 16:58:52.201320 | controller | Thursday 26 February 2026 16:58:52 +0000 (0:00:00.058) 0:03:43.359 ***** 2026-02-26 16:58:52.201329 | controller | skipping: [instance] 2026-02-26 16:58:52.255668 | controller | 2026-02-26 16:58:52.255688 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-26 16:58:52.255694 | controller | Thursday 26 February 2026 16:58:52 +0000 (0:00:00.055) 0:03:43.414 ***** 2026-02-26 16:58:52.255703 | controller | skipping: [instance] 2026-02-26 16:58:52.315358 | controller | 2026-02-26 16:58:52.315378 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-26 16:58:52.315386 | controller | Thursday 26 February 2026 16:58:52 +0000 (0:00:00.054) 0:03:43.468 ***** 2026-02-26 16:58:52.315401 | controller | skipping: [instance] 2026-02-26 16:58:53.411637 | controller | 2026-02-26 16:58:53.411675 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-26 16:58:53.411683 | controller | Thursday 26 February 2026 16:58:52 +0000 (0:00:00.059) 0:03:43.528 ***** 2026-02-26 16:58:53.411694 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:58:53.475399 | controller | 2026-02-26 16:58:53.475444 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-26 16:58:53.475453 | controller | Thursday 26 February 2026 16:58:53 +0000 (0:00:01.095) 0:03:44.624 ***** 2026-02-26 16:58:53.475465 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-26 16:58:53.535412 | controller | _secret_dest: /home/zuul/ipmi-things 2026-02-26 16:58:53.535440 | controller | 2026-02-26 16:58:53.535448 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-26 16:58:53.535455 | controller | Thursday 26 February 2026 16:58:53 +0000 (0:00:00.063) 0:03:44.687 ***** 2026-02-26 16:58:53.535465 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-26 16:58:53.593386 | controller | _secret_file: /tmp/ipmi-things 2026-02-26 16:58:53.593431 | controller | 2026-02-26 16:58:53.593439 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-26 16:58:53.593445 | controller | Thursday 26 February 2026 16:58:53 +0000 (0:00:00.060) 0:03:44.747 ***** 2026-02-26 16:58:53.593456 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-26 16:58:53.653719 | controller | _secret_content: '' 2026-02-26 16:58:53.653742 | controller | 2026-02-26 16:58:53.653749 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-26 16:58:53.653755 | controller | Thursday 26 February 2026 16:58:53 +0000 (0:00:00.058) 0:03:44.805 ***** 2026-02-26 16:58:53.653765 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2026-02-26 16:58:54.301445 | controller | msg: All assertions passed 2026-02-26 16:58:54.301485 | controller | 2026-02-26 16:58:54.301494 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-26 16:58:54.301500 | controller | Thursday 26 February 2026 16:58:53 +0000 (0:00:00.060) 0:03:44.866 ***** 2026-02-26 16:58:54.301510 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:58:55.438942 | controller | 2026-02-26 16:58:55.438982 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-26 16:58:55.438990 | controller | Thursday 26 February 2026 16:58:54 +0000 (0:00:00.647) 0:03:45.514 ***** 2026-02-26 16:58:55.439003 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:58:55.439169 | controller | 2026-02-26 16:58:55.439180 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-26 16:58:55.439188 | controller | Thursday 26 February 2026 16:58:55 +0000 (0:00:01.137) 0:03:46.651 ***** 2026-02-26 16:58:55.507601 | controller | skipping: [instance] 2026-02-26 16:58:55.507998 | controller | 2026-02-26 16:58:56.154418 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2026-02-26 16:58:56.154456 | controller | Thursday 26 February 2026 16:58:55 +0000 (0:00:00.069) 0:03:46.720 ***** 2026-02-26 16:58:56.154469 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:58:56.821687 | controller | 2026-02-26 16:58:56.821725 | controller | TASK [reproducer : Check if async file is still available] ********************* 2026-02-26 16:58:56.821733 | controller | Thursday 26 February 2026 16:58:56 +0000 (0:00:00.646) 0:03:47.366 ***** 2026-02-26 16:58:56.821745 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:59:42.180341 | controller | 2026-02-26 16:59:42.180584 | controller | TASK [reproducer : Check package install status] ******************************* 2026-02-26 16:59:42.180593 | controller | Thursday 26 February 2026 16:58:56 +0000 (0:00:00.667) 0:03:48.034 ***** 2026-02-26 16:59:42.180604 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2026-02-26 16:59:42.180774 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2026-02-26 16:59:42.180955 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2026-02-26 16:59:42.181097 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2026-02-26 16:59:42.181239 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2026-02-26 16:59:42.181374 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2026-02-26 16:59:42.181501 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2026-02-26 16:59:42.181632 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2026-02-26 16:59:42.181757 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:59:42.181909 | controller | 2026-02-26 16:59:42.182043 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2026-02-26 16:59:42.182168 | controller | Thursday 26 February 2026 16:59:42 +0000 (0:00:45.354) 0:04:33.388 ***** 2026-02-26 16:59:42.776712 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:59:45.900959 | controller | 2026-02-26 16:59:45.901022 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2026-02-26 16:59:45.901031 | controller | Thursday 26 February 2026 16:59:42 +0000 (0:00:00.600) 0:04:33.989 ***** 2026-02-26 16:59:45.901045 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:59:45.955155 | controller | 2026-02-26 16:59:45.955191 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2026-02-26 16:59:45.955200 | controller | Thursday 26 February 2026 16:59:45 +0000 (0:00:03.123) 0:04:37.112 ***** 2026-02-26 16:59:45.955211 | controller | skipping: [instance] 2026-02-26 16:59:46.018021 | controller | 2026-02-26 16:59:46.018061 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2026-02-26 16:59:46.018069 | controller | Thursday 26 February 2026 16:59:45 +0000 (0:00:00.054) 0:04:37.167 ***** 2026-02-26 16:59:46.018079 | controller | skipping: [instance] 2026-02-26 16:59:46.641739 | controller | 2026-02-26 16:59:46.641781 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2026-02-26 16:59:46.641790 | controller | Thursday 26 February 2026 16:59:46 +0000 (0:00:00.063) 0:04:37.231 ***** 2026-02-26 16:59:46.641802 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:59:47.260941 | controller | 2026-02-26 16:59:47.260996 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2026-02-26 16:59:47.261005 | controller | Thursday 26 February 2026 16:59:46 +0000 (0:00:00.617) 0:04:37.848 ***** 2026-02-26 16:59:47.261018 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:59:47.603248 | controller | 2026-02-26 16:59:47.603303 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2026-02-26 16:59:47.603313 | controller | Thursday 26 February 2026 16:59:47 +0000 (0:00:00.618) 0:04:38.467 ***** 2026-02-26 16:59:47.603326 | controller | changed: [instance] 2026-02-26 16:59:48.259987 | controller | 2026-02-26 16:59:48.260044 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2026-02-26 16:59:48.260054 | controller | Thursday 26 February 2026 16:59:47 +0000 (0:00:00.342) 0:04:38.809 ***** 2026-02-26 16:59:48.260068 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:59:49.463667 | controller | 2026-02-26 16:59:49.463714 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2026-02-26 16:59:49.463724 | controller | Thursday 26 February 2026 16:59:48 +0000 (0:00:00.655) 0:04:39.465 ***** 2026-02-26 16:59:49.463736 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:59:49.513468 | controller | 2026-02-26 16:59:49.513501 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-26 16:59:49.513510 | controller | Thursday 26 February 2026 16:59:49 +0000 (0:00:01.211) 0:04:40.676 ***** 2026-02-26 16:59:49.513522 | controller | skipping: [instance] 2026-02-26 16:59:49.569748 | controller | 2026-02-26 16:59:49.569782 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-26 16:59:49.569792 | controller | Thursday 26 February 2026 16:59:49 +0000 (0:00:00.050) 0:04:40.726 ***** 2026-02-26 16:59:49.569804 | controller | skipping: [instance] 2026-02-26 16:59:49.619884 | controller | 2026-02-26 16:59:49.619910 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-26 16:59:49.619918 | controller | Thursday 26 February 2026 16:59:49 +0000 (0:00:00.055) 0:04:40.782 ***** 2026-02-26 16:59:49.619929 | controller | skipping: [instance] 2026-02-26 16:59:49.620259 | controller | 2026-02-26 16:59:49.689790 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2026-02-26 16:59:49.689814 | controller | Thursday 26 February 2026 16:59:49 +0000 (0:00:00.050) 0:04:40.833 ***** 2026-02-26 16:59:49.689842 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:59:49.735331 | controller | 2026-02-26 16:59:49.735349 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2026-02-26 16:59:49.735357 | controller | Thursday 26 February 2026 16:59:49 +0000 (0:00:00.069) 0:04:40.902 ***** 2026-02-26 16:59:49.735366 | controller | skipping: [instance] 2026-02-26 16:59:49.781913 | controller | 2026-02-26 16:59:49.781938 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2026-02-26 16:59:49.781949 | controller | Thursday 26 February 2026 16:59:49 +0000 (0:00:00.045) 0:04:40.948 ***** 2026-02-26 16:59:49.781961 | controller | skipping: [instance] 2026-02-26 16:59:49.782267 | controller | 2026-02-26 16:59:49.782287 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2026-02-26 16:59:49.842620 | controller | Thursday 26 February 2026 16:59:49 +0000 (0:00:00.046) 0:04:40.994 ***** 2026-02-26 16:59:49.842642 | controller | skipping: [instance] 2026-02-26 16:59:50.622278 | controller | 2026-02-26 16:59:50.622331 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2026-02-26 16:59:50.622340 | controller | Thursday 26 February 2026 16:59:49 +0000 (0:00:00.060) 0:04:41.055 ***** 2026-02-26 16:59:50.622354 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:59:50.742565 | controller | 2026-02-26 16:59:50.742612 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2026-02-26 16:59:50.742621 | controller | Thursday 26 February 2026 16:59:50 +0000 (0:00:00.778) 0:04:41.834 ***** 2026-02-26 16:59:50.742634 | controller | skipping: [instance] => (item=secret) 2026-02-26 16:59:51.910498 | controller | skipping: [instance] => (item=configmap) 2026-02-26 16:59:51.910555 | controller | skipping: [instance] => (item=pod) 2026-02-26 16:59:51.910563 | controller | skipping: [instance] => (item=service) 2026-02-26 16:59:51.910569 | controller | skipping: [instance] => (item=route) 2026-02-26 16:59:51.910574 | controller | skipping: [instance] 2026-02-26 16:59:51.910582 | controller | 2026-02-26 16:59:51.910588 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2026-02-26 16:59:51.910595 | controller | Thursday 26 February 2026 16:59:50 +0000 (0:00:00.120) 0:04:41.954 ***** 2026-02-26 16:59:51.910608 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:59:52.978776 | controller | 2026-02-26 16:59:52.978853 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2026-02-26 16:59:52.978866 | controller | Thursday 26 February 2026 16:59:51 +0000 (0:00:01.167) 0:04:43.122 ***** 2026-02-26 16:59:52.978880 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:59:53.029726 | controller | 2026-02-26 16:59:53.029755 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2026-02-26 16:59:53.029764 | controller | Thursday 26 February 2026 16:59:52 +0000 (0:00:01.068) 0:04:44.190 ***** 2026-02-26 16:59:53.029775 | controller | skipping: [instance] 2026-02-26 16:59:53.080467 | controller | 2026-02-26 16:59:53.080495 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2026-02-26 16:59:53.080504 | controller | Thursday 26 February 2026 16:59:53 +0000 (0:00:00.051) 0:04:44.242 ***** 2026-02-26 16:59:53.080524 | controller | skipping: [instance] 2026-02-26 16:59:53.161990 | controller | 2026-02-26 16:59:53.162021 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2026-02-26 16:59:53.162030 | controller | Thursday 26 February 2026 16:59:53 +0000 (0:00:00.049) 0:04:44.292 ***** 2026-02-26 16:59:53.162050 | controller | skipping: [instance] => (item=secret) 2026-02-26 16:59:53.162428 | controller | skipping: [instance] => (item=configmap) 2026-02-26 16:59:53.162656 | controller | skipping: [instance] => (item=service) 2026-02-26 16:59:53.162673 | controller | skipping: [instance] => (item=route) 2026-02-26 16:59:53.163088 | controller | skipping: [instance] 2026-02-26 16:59:53.163311 | controller | 2026-02-26 16:59:53.163325 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2026-02-26 16:59:53.210712 | controller | Thursday 26 February 2026 16:59:53 +0000 (0:00:00.082) 0:04:44.375 ***** 2026-02-26 16:59:53.210738 | controller | skipping: [instance] 2026-02-26 16:59:54.978308 | controller | 2026-02-26 16:59:54.978362 | controller | TASK [podman : Ensure podman is installed] ************************************* 2026-02-26 16:59:54.978371 | controller | Thursday 26 February 2026 16:59:53 +0000 (0:00:00.048) 0:04:44.423 ***** 2026-02-26 16:59:54.978384 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:59:55.947394 | controller | 2026-02-26 16:59:55.947452 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2026-02-26 16:59:55.947461 | controller | Thursday 26 February 2026 16:59:54 +0000 (0:00:01.766) 0:04:46.190 ***** 2026-02-26 16:59:55.947475 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 16:59:55.994444 | controller | 2026-02-26 16:59:55.994463 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2026-02-26 16:59:55.994471 | controller | Thursday 26 February 2026 16:59:55 +0000 (0:00:00.969) 0:04:47.159 ***** 2026-02-26 16:59:55.994480 | controller | skipping: [instance] 2026-02-26 16:59:56.043433 | controller | 2026-02-26 16:59:56.043455 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2026-02-26 16:59:56.043464 | controller | Thursday 26 February 2026 16:59:55 +0000 (0:00:00.047) 0:04:47.207 ***** 2026-02-26 16:59:56.043474 | controller | skipping: [instance] 2026-02-26 16:59:56.102576 | controller | 2026-02-26 16:59:56.102600 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2026-02-26 16:59:56.102610 | controller | Thursday 26 February 2026 16:59:56 +0000 (0:00:00.049) 0:04:47.256 ***** 2026-02-26 16:59:56.102622 | controller | skipping: [instance] 2026-02-26 17:00:07.609942 | controller | 2026-02-26 17:00:07.609997 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2026-02-26 17:00:07.610006 | controller | Thursday 26 February 2026 16:59:56 +0000 (0:00:00.058) 0:04:47.315 ***** 2026-02-26 17:00:07.610019 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:09.279980 | controller | 2026-02-26 17:00:09.280044 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2026-02-26 17:00:09.280054 | controller | Thursday 26 February 2026 17:00:07 +0000 (0:00:11.506) 0:04:58.822 ***** 2026-02-26 17:00:09.280076 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:10.561919 | controller | 2026-02-26 17:00:10.561972 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-26 17:00:10.561980 | controller | Thursday 26 February 2026 17:00:09 +0000 (0:00:01.667) 0:05:00.489 ***** 2026-02-26 17:00:10.561993 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-26 17:00:10.562474 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-26 17:00:10.562614 | controller | 2026-02-26 17:00:10.562750 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2026-02-26 17:00:10.562914 | controller | Thursday 26 February 2026 17:00:10 +0000 (0:00:01.280) 0:05:01.769 ***** 2026-02-26 17:00:10.602765 | controller | skipping: [instance] 2026-02-26 17:00:10.603009 | controller | 2026-02-26 17:00:10.603216 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2026-02-26 17:00:10.603413 | controller | Thursday 26 February 2026 17:00:10 +0000 (0:00:00.046) 0:05:01.816 ***** 2026-02-26 17:00:11.220171 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:11.220422 | controller | 2026-02-26 17:00:11.220587 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2026-02-26 17:00:11.220731 | controller | Thursday 26 February 2026 17:00:11 +0000 (0:00:00.616) 0:05:02.432 ***** 2026-02-26 17:00:11.273728 | controller | skipping: [instance] 2026-02-26 17:00:11.273910 | controller | 2026-02-26 17:00:11.274044 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2026-02-26 17:00:11.274168 | controller | Thursday 26 February 2026 17:00:11 +0000 (0:00:00.054) 0:05:02.486 ***** 2026-02-26 17:00:11.330666 | controller | skipping: [instance] 2026-02-26 17:00:11.330890 | controller | 2026-02-26 17:00:11.331075 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-26 17:00:11.331213 | controller | Thursday 26 February 2026 17:00:11 +0000 (0:00:00.056) 0:05:02.543 ***** 2026-02-26 17:00:11.384879 | controller | skipping: [instance] 2026-02-26 17:00:11.385049 | controller | 2026-02-26 17:00:11.385209 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-26 17:00:11.385336 | controller | Thursday 26 February 2026 17:00:11 +0000 (0:00:00.054) 0:05:02.598 ***** 2026-02-26 17:00:11.434364 | controller | skipping: [instance] 2026-02-26 17:00:11.434542 | controller | 2026-02-26 17:00:11.434709 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2026-02-26 17:00:11.434926 | controller | Thursday 26 February 2026 17:00:11 +0000 (0:00:00.049) 0:05:02.647 ***** 2026-02-26 17:00:11.576194 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'}) 2026-02-26 17:00:11.576363 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'}) 2026-02-26 17:00:11.576497 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'}) 2026-02-26 17:00:11.576614 | controller | 2026-02-26 17:00:11.576735 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2026-02-26 17:00:11.576909 | controller | Thursday 26 February 2026 17:00:11 +0000 (0:00:00.141) 0:05:02.789 ***** 2026-02-26 17:00:12.662980 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:12.663190 | controller | 2026-02-26 17:00:12.663337 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2026-02-26 17:00:12.663477 | controller | Thursday 26 February 2026 17:00:12 +0000 (0:00:01.086) 0:05:03.875 ***** 2026-02-26 17:00:12.714298 | controller | skipping: [instance] 2026-02-26 17:00:12.714454 | controller | 2026-02-26 17:00:12.714615 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2026-02-26 17:00:12.714764 | controller | Thursday 26 February 2026 17:00:12 +0000 (0:00:00.051) 0:05:03.927 ***** 2026-02-26 17:00:12.865203 | controller | 2026-02-26 17:00:12.865267 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2026-02-26 17:00:12.865278 | controller | Thursday 26 February 2026 17:00:12 +0000 (0:00:00.149) 0:05:04.077 ***** 2026-02-26 17:00:12.927759 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:12.927815 | controller | 2026-02-26 17:00:12.927958 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-26 17:00:12.928040 | controller | Thursday 26 February 2026 17:00:12 +0000 (0:00:00.063) 0:05:04.141 ***** 2026-02-26 17:00:12.981536 | controller | skipping: [instance] 2026-02-26 17:00:12.981623 | controller | 2026-02-26 17:00:12.981737 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-26 17:00:12.981908 | controller | Thursday 26 February 2026 17:00:12 +0000 (0:00:00.053) 0:05:04.194 ***** 2026-02-26 17:00:13.028019 | controller | skipping: [instance] 2026-02-26 17:00:13.028198 | controller | 2026-02-26 17:00:13.028267 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2026-02-26 17:00:13.028279 | controller | Thursday 26 February 2026 17:00:13 +0000 (0:00:00.046) 0:05:04.241 ***** 2026-02-26 17:00:14.446804 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:14.446893 | controller | 2026-02-26 17:00:14.446939 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2026-02-26 17:00:14.447076 | controller | Thursday 26 February 2026 17:00:14 +0000 (0:00:01.418) 0:05:05.659 ***** 2026-02-26 17:00:22.622511 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1) 2026-02-26 17:00:22.622582 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b) 2026-02-26 17:00:22.622711 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282) 2026-02-26 17:00:22.622794 | controller | 2026-02-26 17:00:22.622921 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2026-02-26 17:00:22.623010 | controller | Thursday 26 February 2026 17:00:22 +0000 (0:00:08.175) 0:05:13.835 ***** 2026-02-26 17:00:22.734228 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2026-02-26 17:00:22.734318 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2026-02-26 17:00:22.734418 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2026-02-26 17:00:22.734502 | controller | 2026-02-26 17:00:22.734597 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2026-02-26 17:00:22.734706 | controller | Thursday 26 February 2026 17:00:22 +0000 (0:00:00.112) 0:05:13.947 ***** 2026-02-26 17:00:22.991570 | controller | ok: [instance -> localhost] 2026-02-26 17:00:22.991649 | controller | 2026-02-26 17:00:22.991735 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2026-02-26 17:00:22.991858 | controller | Thursday 26 February 2026 17:00:22 +0000 (0:00:00.251) 0:05:14.199 ***** 2026-02-26 17:00:25.148032 | controller | changed: [instance -> localhost] => (item=controller-0) 2026-02-26 17:00:25.148293 | controller | 2026-02-26 17:00:25.840120 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2026-02-26 17:00:25.840173 | controller | Thursday 26 February 2026 17:00:25 +0000 (0:00:02.161) 0:05:16.360 ***** 2026-02-26 17:00:25.840188 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:26.645087 | controller | 2026-02-26 17:00:26.645139 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2026-02-26 17:00:26.645148 | controller | Thursday 26 February 2026 17:00:25 +0000 (0:00:00.691) 0:05:17.052 ***** 2026-02-26 17:00:26.645159 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:27.858493 | controller | 2026-02-26 17:00:27.858554 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2026-02-26 17:00:27.858564 | controller | Thursday 26 February 2026 17:00:26 +0000 (0:00:00.805) 0:05:17.857 ***** 2026-02-26 17:00:27.858578 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:28.582079 | controller | 2026-02-26 17:00:28.582133 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2026-02-26 17:00:28.582143 | controller | Thursday 26 February 2026 17:00:27 +0000 (0:00:01.213) 0:05:19.070 ***** 2026-02-26 17:00:28.582158 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:28.582185 | controller | 2026-02-26 17:00:28.582306 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2026-02-26 17:00:28.582316 | controller | Thursday 26 February 2026 17:00:28 +0000 (0:00:00.724) 0:05:19.794 ***** 2026-02-26 17:00:29.753735 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:30.382305 | controller | 2026-02-26 17:00:30.382348 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2026-02-26 17:00:30.382356 | controller | Thursday 26 February 2026 17:00:29 +0000 (0:00:01.167) 0:05:20.961 ***** 2026-02-26 17:00:30.382377 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:31.037098 | controller | 2026-02-26 17:00:31.037143 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2026-02-26 17:00:31.037152 | controller | Thursday 26 February 2026 17:00:30 +0000 (0:00:00.632) 0:05:21.594 ***** 2026-02-26 17:00:31.037164 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:32.597654 | controller | 2026-02-26 17:00:32.597696 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2026-02-26 17:00:32.597705 | controller | Thursday 26 February 2026 17:00:31 +0000 (0:00:00.655) 0:05:22.249 ***** 2026-02-26 17:00:32.597717 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-26 17:00:32.640720 | controller | 2026-02-26 17:00:32.640750 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-26 17:00:32.640757 | controller | Thursday 26 February 2026 17:00:32 +0000 (0:00:01.560) 0:05:23.810 ***** 2026-02-26 17:00:32.640768 | controller | skipping: [instance] 2026-02-26 17:00:32.685330 | controller | 2026-02-26 17:00:32.685357 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-26 17:00:32.685364 | controller | Thursday 26 February 2026 17:00:32 +0000 (0:00:00.043) 0:05:23.853 ***** 2026-02-26 17:00:32.685374 | controller | skipping: [instance] 2026-02-26 17:00:32.726627 | controller | 2026-02-26 17:00:32.726653 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-26 17:00:32.726661 | controller | Thursday 26 February 2026 17:00:32 +0000 (0:00:00.044) 0:05:23.897 ***** 2026-02-26 17:00:32.726672 | controller | skipping: [instance] 2026-02-26 17:00:32.770621 | controller | 2026-02-26 17:00:32.770645 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-26 17:00:32.770653 | controller | Thursday 26 February 2026 17:00:32 +0000 (0:00:00.041) 0:05:23.939 ***** 2026-02-26 17:00:32.770662 | controller | skipping: [instance] 2026-02-26 17:00:32.770899 | controller | 2026-02-26 17:00:32.770917 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-26 17:00:32.813450 | controller | Thursday 26 February 2026 17:00:32 +0000 (0:00:00.044) 0:05:23.983 ***** 2026-02-26 17:00:32.813493 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:32.933776 | controller | 2026-02-26 17:00:32.933798 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-26 17:00:32.933807 | controller | Thursday 26 February 2026 17:00:32 +0000 (0:00:00.042) 0:05:24.026 ***** 2026-02-26 17:00:32.933851 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-26 17:00:32.992165 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2026-02-26 17:00:32.992187 | controller | 2026-02-26 17:00:32.992194 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-26 17:00:32.992200 | controller | Thursday 26 February 2026 17:00:32 +0000 (0:00:00.120) 0:05:24.146 ***** 2026-02-26 17:00:32.992209 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2026-02-26 17:00:36.678496 | controller | 2026-02-26 17:00:36.678544 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2026-02-26 17:00:36.678553 | controller | Thursday 26 February 2026 17:00:32 +0000 (0:00:00.058) 0:05:24.205 ***** 2026-02-26 17:00:36.678567 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-26 17:00:37.737715 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2026-02-26 17:00:37.737768 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-26 17:00:37.737777 | controller | 2026-02-26 17:00:37.737785 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2026-02-26 17:00:37.737792 | controller | Thursday 26 February 2026 17:00:36 +0000 (0:00:03.685) 0:05:27.890 ***** 2026-02-26 17:00:37.737804 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:38.256256 | controller | 2026-02-26 17:00:38.256306 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-26 17:00:38.256315 | controller | Thursday 26 February 2026 17:00:37 +0000 (0:00:01.055) 0:05:28.945 ***** 2026-02-26 17:00:38.256333 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:39.447753 | controller | 2026-02-26 17:00:39.447806 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-26 17:00:39.447815 | controller | Thursday 26 February 2026 17:00:38 +0000 (0:00:00.516) 0:05:29.462 ***** 2026-02-26 17:00:39.447846 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:39.542029 | controller | 2026-02-26 17:00:39.542061 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-26 17:00:39.542069 | controller | Thursday 26 February 2026 17:00:39 +0000 (0:00:01.197) 0:05:30.660 ***** 2026-02-26 17:00:39.542079 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:39.606473 | controller | 2026-02-26 17:00:39.606520 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-26 17:00:39.606530 | controller | Thursday 26 February 2026 17:00:39 +0000 (0:00:00.094) 0:05:30.754 ***** 2026-02-26 17:00:39.606542 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:40.724259 | controller | 2026-02-26 17:00:40.724310 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-26 17:00:40.724320 | controller | Thursday 26 February 2026 17:00:39 +0000 (0:00:00.064) 0:05:30.819 ***** 2026-02-26 17:00:40.724334 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:41.695099 | controller | 2026-02-26 17:00:41.695153 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2026-02-26 17:00:41.695163 | controller | Thursday 26 February 2026 17:00:40 +0000 (0:00:01.117) 0:05:31.936 ***** 2026-02-26 17:00:41.695184 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:47.758391 | controller | 2026-02-26 17:00:47.758431 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2026-02-26 17:00:47.758440 | controller | Thursday 26 February 2026 17:00:41 +0000 (0:00:00.970) 0:05:32.907 ***** 2026-02-26 17:00:47.758450 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2026-02-26 17:00:47.977769 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:47.977806 | controller | 2026-02-26 17:00:47.977814 | controller | TASK [Configure ntp service] *************************************************** 2026-02-26 17:00:47.977837 | controller | Thursday 26 February 2026 17:00:47 +0000 (0:00:06.063) 0:05:38.971 ***** 2026-02-26 17:00:47.977853 | controller | 2026-02-26 17:00:49.051054 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2026-02-26 17:00:49.051107 | controller | Thursday 26 February 2026 17:00:47 +0000 (0:00:00.219) 0:05:39.190 ***** 2026-02-26 17:00:49.051121 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:50.127913 | controller | 2026-02-26 17:00:50.127962 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2026-02-26 17:00:50.127970 | controller | Thursday 26 February 2026 17:00:49 +0000 (0:00:01.073) 0:05:40.263 ***** 2026-02-26 17:00:50.127982 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2026-02-26 17:00:51.193778 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2026-02-26 17:00:51.193856 | controller | 2026-02-26 17:00:51.193865 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2026-02-26 17:00:51.193871 | controller | Thursday 26 February 2026 17:00:50 +0000 (0:00:01.076) 0:05:41.340 ***** 2026-02-26 17:00:51.193881 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:51.980067 | controller | 2026-02-26 17:00:51.980114 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2026-02-26 17:00:51.980128 | controller | Thursday 26 February 2026 17:00:51 +0000 (0:00:01.065) 0:05:42.406 ***** 2026-02-26 17:00:51.980140 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:52.131208 | controller | 2026-02-26 17:00:52.131238 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2026-02-26 17:00:52.131246 | controller | Thursday 26 February 2026 17:00:51 +0000 (0:00:00.786) 0:05:43.192 ***** 2026-02-26 17:00:52.131257 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2026-02-26 17:00:52.682874 | controller | 2026-02-26 17:00:52.682922 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2026-02-26 17:00:52.682931 | controller | Thursday 26 February 2026 17:00:52 +0000 (0:00:00.151) 0:05:43.344 ***** 2026-02-26 17:00:52.682943 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:53.273140 | controller | 2026-02-26 17:00:53.273187 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2026-02-26 17:00:53.273195 | controller | Thursday 26 February 2026 17:00:52 +0000 (0:00:00.551) 0:05:43.895 ***** 2026-02-26 17:00:53.273207 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-26 17:00:54.101763 | controller | 2026-02-26 17:00:54.101802 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2026-02-26 17:00:54.101811 | controller | Thursday 26 February 2026 17:00:53 +0000 (0:00:00.590) 0:05:44.485 ***** 2026-02-26 17:00:54.101837 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-26 17:00:54.734585 | controller | 2026-02-26 17:00:54.734621 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2026-02-26 17:00:54.734629 | controller | Thursday 26 February 2026 17:00:54 +0000 (0:00:00.829) 0:05:45.314 ***** 2026-02-26 17:00:54.734656 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-26 17:00:54.801923 | controller | 2026-02-26 17:00:54.801951 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2026-02-26 17:00:54.801960 | controller | Thursday 26 February 2026 17:00:54 +0000 (0:00:00.632) 0:05:45.947 ***** 2026-02-26 17:00:54.801972 | controller | 2026-02-26 17:00:55.359906 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2026-02-26 17:00:55.359952 | controller | Thursday 26 February 2026 17:00:54 +0000 (0:00:00.067) 0:05:46.014 ***** 2026-02-26 17:00:55.359966 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-26 17:00:56.155815 | controller | 2026-02-26 17:00:56.155890 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2026-02-26 17:00:56.155899 | controller | Thursday 26 February 2026 17:00:55 +0000 (0:00:00.557) 0:05:46.572 ***** 2026-02-26 17:00:56.155911 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-26 17:00:56.195124 | controller | 2026-02-26 17:00:56.195148 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2026-02-26 17:00:56.195155 | controller | Thursday 26 February 2026 17:00:56 +0000 (0:00:00.794) 0:05:47.367 ***** 2026-02-26 17:00:56.195164 | controller | skipping: [instance] 2026-02-26 17:00:56.238474 | controller | 2026-02-26 17:00:56.238496 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2026-02-26 17:00:56.238504 | controller | Thursday 26 February 2026 17:00:56 +0000 (0:00:00.040) 0:05:47.408 ***** 2026-02-26 17:00:56.238513 | controller | skipping: [instance] 2026-02-26 17:00:56.510810 | controller | 2026-02-26 17:00:56.510858 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2026-02-26 17:00:56.510866 | controller | Thursday 26 February 2026 17:00:56 +0000 (0:00:00.043) 0:05:47.451 ***** 2026-02-26 17:00:56.510877 | controller | changed: [instance] 2026-02-26 17:00:56.593505 | controller | 2026-02-26 17:00:56.593532 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2026-02-26 17:00:56.593541 | controller | Thursday 26 February 2026 17:00:56 +0000 (0:00:00.271) 0:05:47.723 ***** 2026-02-26 17:00:56.593552 | controller | skipping: [instance] => (item=) 2026-02-26 17:00:56.634474 | controller | 2026-02-26 17:00:56.634496 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2026-02-26 17:00:56.634505 | controller | Thursday 26 February 2026 17:00:56 +0000 (0:00:00.082) 0:05:47.806 ***** 2026-02-26 17:00:56.634516 | controller | ok: [instance] 2026-02-26 17:00:56.718404 | controller | 2026-02-26 17:00:56.718428 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-26 17:00:56.718436 | controller | Thursday 26 February 2026 17:00:56 +0000 (0:00:00.041) 0:05:47.847 ***** 2026-02-26 17:00:56.718446 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-26 17:00:57.017873 | controller | 2026-02-26 17:00:57.017909 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-26 17:00:57.017917 | controller | Thursday 26 February 2026 17:00:56 +0000 (0:00:00.082) 0:05:47.930 ***** 2026-02-26 17:00:57.017933 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-26 17:00:57.069233 | controller | 2026-02-26 17:00:57.069261 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2026-02-26 17:00:57.069271 | controller | Thursday 26 February 2026 17:00:57 +0000 (0:00:00.300) 0:05:48.230 ***** 2026-02-26 17:00:57.069283 | controller | 2026-02-26 17:00:57.138712 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-26 17:00:57.138736 | controller | Thursday 26 February 2026 17:00:57 +0000 (0:00:00.051) 0:05:48.282 ***** 2026-02-26 17:00:57.138750 | controller | ok: [instance] 2026-02-26 17:00:57.208836 | controller | 2026-02-26 17:00:57.208860 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-26 17:00:57.208868 | controller | Thursday 26 February 2026 17:00:57 +0000 (0:00:00.069) 0:05:48.351 ***** 2026-02-26 17:00:57.208878 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-26 17:00:57.500882 | controller | 2026-02-26 17:00:57.500906 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-26 17:00:57.500914 | controller | Thursday 26 February 2026 17:00:57 +0000 (0:00:00.065) 0:05:48.417 ***** 2026-02-26 17:00:57.500925 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-26 17:00:57.570286 | controller | 2026-02-26 17:00:57.570318 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-26 17:00:57.570346 | controller | Thursday 26 February 2026 17:00:57 +0000 (0:00:00.296) 0:05:48.713 ***** 2026-02-26 17:00:57.570367 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-26 17:00:58.056078 | controller | skipping: [instance] 2026-02-26 17:00:58.056121 | controller | 2026-02-26 17:00:58.056130 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2026-02-26 17:00:58.056137 | controller | Thursday 26 February 2026 17:00:57 +0000 (0:00:00.066) 0:05:48.780 ***** 2026-02-26 17:00:58.056148 | controller | changed: [instance] 2026-02-26 17:00:58.760434 | controller | 2026-02-26 17:00:58.760468 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-26 17:00:58.760477 | controller | Thursday 26 February 2026 17:00:58 +0000 (0:00:00.475) 0:05:49.256 ***** 2026-02-26 17:00:58.760482 | controller | 2026-02-26 17:00:58.760488 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2026-02-26 17:00:58.760493 | controller | Thursday 26 February 2026 17:00:58 +0000 (0:00:00.012) 0:05:49.268 ***** 2026-02-26 17:00:58.760505 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:00:59.199851 | controller | 2026-02-26 17:00:59.199890 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-26 17:00:59.199898 | controller | Thursday 26 February 2026 17:00:58 +0000 (0:00:00.704) 0:05:49.973 ***** 2026-02-26 17:00:59.199910 | controller | changed: [instance] 2026-02-26 17:00:59.382307 | controller | 2026-02-26 17:00:59.382349 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2026-02-26 17:00:59.382358 | controller | Thursday 26 February 2026 17:00:59 +0000 (0:00:00.439) 0:05:50.412 ***** 2026-02-26 17:00:59.382370 | controller | skipping: [instance] => (item=controller-0) 2026-02-26 17:01:00.925280 | controller | skipping: [instance] => (item=crc-0) 2026-02-26 17:01:00.925350 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2026-02-26 17:01:00.925360 | controller | 2026-02-26 17:01:00.925366 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2026-02-26 17:01:00.925373 | controller | Thursday 26 February 2026 17:00:59 +0000 (0:00:00.182) 0:05:50.594 ***** 2026-02-26 17:01:00.925385 | controller | changed: [instance -> compute-0(compute-0.instance)] 2026-02-26 17:01:00.952008 | controller | 2026-02-26 17:01:00.952070 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-26 17:01:00.952081 | controller | Thursday 26 February 2026 17:01:00 +0000 (0:00:01.542) 0:05:52.137 ***** 2026-02-26 17:01:00.952099 | controller | skipping: [instance] 2026-02-26 17:01:01.540562 | controller | 2026-02-26 17:01:01.540614 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-26 17:01:01.540623 | controller | Thursday 26 February 2026 17:01:00 +0000 (0:00:00.027) 0:05:52.164 ***** 2026-02-26 17:01:01.540637 | controller | ok: [instance -> compute-0(compute-0.instance)] 2026-02-26 17:01:01.540644 | controller | 2026-02-26 17:01:01.540649 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-26 17:01:01.540657 | controller | Thursday 26 February 2026 17:01:01 +0000 (0:00:00.588) 0:05:52.753 ***** 2026-02-26 17:01:01.584372 | controller | skipping: [instance] 2026-02-26 17:01:01.584435 | controller | 2026-02-26 17:01:01.584446 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-26 17:01:01.584533 | controller | Thursday 26 February 2026 17:01:01 +0000 (0:00:00.044) 0:05:52.797 ***** 2026-02-26 17:01:01.635628 | controller | skipping: [instance] 2026-02-26 17:01:01.683808 | controller | 2026-02-26 17:01:01.683857 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-26 17:01:01.683867 | controller | Thursday 26 February 2026 17:01:01 +0000 (0:00:00.051) 0:05:52.848 ***** 2026-02-26 17:01:01.683885 | controller | skipping: [instance] 2026-02-26 17:01:01.684065 | controller | 2026-02-26 17:01:01.684238 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-26 17:01:01.684408 | controller | Thursday 26 February 2026 17:01:01 +0000 (0:00:00.048) 0:05:52.897 ***** 2026-02-26 17:01:01.736244 | controller | skipping: [instance] 2026-02-26 17:01:01.782875 | controller | 2026-02-26 17:01:01.782896 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2026-02-26 17:01:01.782904 | controller | Thursday 26 February 2026 17:01:01 +0000 (0:00:00.052) 0:05:52.949 ***** 2026-02-26 17:01:01.782913 | controller | skipping: [instance] 2026-02-26 17:01:01.808897 | controller | 2026-02-26 17:01:01.808944 | controller | TASK [reproducer : Create repositories on computes] **************************** 2026-02-26 17:01:01.808955 | controller | Thursday 26 February 2026 17:01:01 +0000 (0:00:00.046) 0:05:52.995 ***** 2026-02-26 17:01:01.808970 | controller | skipping: [instance] 2026-02-26 17:01:01.844940 | controller | 2026-02-26 17:01:01.844975 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2026-02-26 17:01:01.844983 | controller | Thursday 26 February 2026 17:01:01 +0000 (0:00:00.025) 0:05:53.021 ***** 2026-02-26 17:01:01.844995 | controller | skipping: [instance] 2026-02-26 17:01:01.845148 | controller | 2026-02-26 17:01:01.845159 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2026-02-26 17:01:02.012260 | controller | Thursday 26 February 2026 17:01:01 +0000 (0:00:00.036) 0:05:53.058 ***** 2026-02-26 17:01:02.012305 | controller | ok: [instance] 2026-02-26 17:01:02.121735 | controller | 2026-02-26 17:01:02.121769 | controller | TASK [reproducer : Push local code] ******************************************** 2026-02-26 17:01:02.121780 | controller | Thursday 26 February 2026 17:01:02 +0000 (0:00:00.166) 0:05:53.225 ***** 2026-02-26 17:01:02.121795 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2026-02-26 17:01:02.169725 | controller | 2026-02-26 17:01:02.169749 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2026-02-26 17:01:02.169756 | controller | Thursday 26 February 2026 17:01:02 +0000 (0:00:00.109) 0:05:53.334 ***** 2026-02-26 17:01:02.169767 | controller | skipping: [instance] 2026-02-26 17:01:02.214479 | controller | 2026-02-26 17:01:02.214502 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2026-02-26 17:01:02.214510 | controller | Thursday 26 February 2026 17:01:02 +0000 (0:00:00.048) 0:05:53.382 ***** 2026-02-26 17:01:02.214520 | controller | skipping: [instance] 2026-02-26 17:01:02.262975 | controller | 2026-02-26 17:01:02.262999 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2026-02-26 17:01:02.263006 | controller | Thursday 26 February 2026 17:01:02 +0000 (0:00:00.044) 0:05:53.427 ***** 2026-02-26 17:01:02.263023 | controller | skipping: [instance] 2026-02-26 17:01:02.263097 | controller | 2026-02-26 17:01:02.263229 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2026-02-26 17:01:02.263363 | controller | Thursday 26 February 2026 17:01:02 +0000 (0:00:00.048) 0:05:53.476 ***** 2026-02-26 17:01:02.310301 | controller | skipping: [instance] 2026-02-26 17:01:02.310493 | controller | 2026-02-26 17:01:02.310626 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2026-02-26 17:01:02.310752 | controller | Thursday 26 February 2026 17:01:02 +0000 (0:00:00.047) 0:05:53.523 ***** 2026-02-26 17:01:02.349183 | controller | skipping: [instance] 2026-02-26 17:01:02.349300 | controller | 2026-02-26 17:01:02.349419 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2026-02-26 17:01:02.349551 | controller | Thursday 26 February 2026 17:01:02 +0000 (0:00:00.038) 0:05:53.562 ***** 2026-02-26 17:01:02.926023 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2026-02-26 17:01:02.926134 | controller | 2026-02-26 17:01:02.926148 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2026-02-26 17:01:02.926232 | controller | Thursday 26 February 2026 17:01:02 +0000 (0:00:00.576) 0:05:54.138 ***** 2026-02-26 17:01:03.576956 | controller | ok: [instance -> localhost] => (item=ci-framework) 2026-02-26 17:01:03.577052 | controller | 2026-02-26 17:01:03.577221 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2026-02-26 17:01:03.577282 | controller | Thursday 26 February 2026 17:01:03 +0000 (0:00:00.650) 0:05:54.789 ***** 2026-02-26 17:01:03.635853 | controller | skipping: [instance] => (item=ci-framework) 2026-02-26 17:01:03.732987 | controller | skipping: [instance] 2026-02-26 17:01:03.733035 | controller | 2026-02-26 17:01:03.733044 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2026-02-26 17:01:03.733052 | controller | Thursday 26 February 2026 17:01:03 +0000 (0:00:00.057) 0:05:54.847 ***** 2026-02-26 17:01:03.733064 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2026-02-26 17:01:04.274963 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2026-02-26 17:01:04.275041 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2026-02-26 17:01:04.275051 | controller | 2026-02-26 17:01:04.275059 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2026-02-26 17:01:04.275067 | controller | Thursday 26 February 2026 17:01:03 +0000 (0:00:00.098) 0:05:54.945 ***** 2026-02-26 17:01:04.275091 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:04.275129 | controller | 2026-02-26 17:01:04.327102 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2026-02-26 17:01:04.327135 | controller | Thursday 26 February 2026 17:01:04 +0000 (0:00:00.541) 0:05:55.487 ***** 2026-02-26 17:01:04.327147 | controller | skipping: [instance] 2026-02-26 17:01:04.327204 | controller | 2026-02-26 17:01:04.327217 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2026-02-26 17:01:04.327312 | controller | Thursday 26 February 2026 17:01:04 +0000 (0:00:00.051) 0:05:55.539 ***** 2026-02-26 17:01:04.875071 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:04.875139 | controller | 2026-02-26 17:01:04.875154 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2026-02-26 17:01:04.875262 | controller | Thursday 26 February 2026 17:01:04 +0000 (0:00:00.548) 0:05:56.087 ***** 2026-02-26 17:01:04.924759 | controller | skipping: [instance] 2026-02-26 17:01:04.924847 | controller | 2026-02-26 17:01:04.924989 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2026-02-26 17:01:04.925083 | controller | Thursday 26 February 2026 17:01:04 +0000 (0:00:00.049) 0:05:56.137 ***** 2026-02-26 17:01:05.471558 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:05.471652 | controller | 2026-02-26 17:01:05.471756 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2026-02-26 17:01:05.471769 | controller | Thursday 26 February 2026 17:01:05 +0000 (0:00:00.546) 0:05:56.684 ***** 2026-02-26 17:01:08.614423 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:08.614767 | controller | 2026-02-26 17:01:29.533954 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2026-02-26 17:01:29.534024 | controller | Thursday 26 February 2026 17:01:08 +0000 (0:00:03.142) 0:05:59.826 ***** 2026-02-26 17:01:29.534043 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:29.534116 | controller | 2026-02-26 17:01:29.534175 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2026-02-26 17:01:29.534193 | controller | Thursday 26 February 2026 17:01:29 +0000 (0:00:20.919) 0:06:20.746 ***** 2026-02-26 17:01:30.794041 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:30.794119 | controller | 2026-02-26 17:01:30.794233 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2026-02-26 17:01:30.794247 | controller | Thursday 26 February 2026 17:01:30 +0000 (0:00:01.260) 0:06:22.006 ***** 2026-02-26 17:01:30.913672 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2026-02-26 17:01:30.913775 | controller | 2026-02-26 17:01:30.913979 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2026-02-26 17:01:30.914060 | controller | Thursday 26 February 2026 17:01:30 +0000 (0:00:00.120) 0:06:22.126 ***** 2026-02-26 17:01:31.444122 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:31.444193 | controller | 2026-02-26 17:01:31.444236 | controller | TASK [reproducer : Rotate log if present] ************************************** 2026-02-26 17:01:31.444367 | controller | Thursday 26 February 2026 17:01:31 +0000 (0:00:00.529) 0:06:22.656 ***** 2026-02-26 17:01:31.485576 | controller | skipping: [instance] 2026-02-26 17:01:31.485670 | controller | 2026-02-26 17:01:31.485792 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2026-02-26 17:01:31.485956 | controller | Thursday 26 February 2026 17:01:31 +0000 (0:00:00.042) 0:06:22.698 ***** 2026-02-26 17:01:31.531520 | controller | skipping: [instance] 2026-02-26 17:01:31.531615 | controller | 2026-02-26 17:01:31.531716 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2026-02-26 17:01:31.531813 | controller | Thursday 26 February 2026 17:01:31 +0000 (0:00:00.046) 0:06:22.744 ***** 2026-02-26 17:01:31.638674 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:31.638758 | controller | 2026-02-26 17:01:31.638883 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-26 17:01:31.638989 | controller | Thursday 26 February 2026 17:01:31 +0000 (0:00:00.106) 0:06:22.851 ***** 2026-02-26 17:01:32.218364 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:32.218596 | controller | 2026-02-26 17:01:32.266111 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-26 17:01:32.266165 | controller | Thursday 26 February 2026 17:01:32 +0000 (0:00:00.579) 0:06:23.430 ***** 2026-02-26 17:01:32.266180 | controller | skipping: [instance] 2026-02-26 17:01:32.266205 | controller | 2026-02-26 17:01:32.266213 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-26 17:01:32.317552 | controller | Thursday 26 February 2026 17:01:32 +0000 (0:00:00.048) 0:06:23.479 ***** 2026-02-26 17:01:32.317596 | controller | skipping: [instance] 2026-02-26 17:01:32.317620 | controller | 2026-02-26 17:01:32.317726 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-26 17:01:32.317858 | controller | Thursday 26 February 2026 17:01:32 +0000 (0:00:00.051) 0:06:23.530 ***** 2026-02-26 17:01:32.367408 | controller | skipping: [instance] 2026-02-26 17:01:32.367460 | controller | 2026-02-26 17:01:32.367557 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-26 17:01:32.367674 | controller | Thursday 26 February 2026 17:01:32 +0000 (0:00:00.049) 0:06:23.580 ***** 2026-02-26 17:01:32.426186 | controller | skipping: [instance] 2026-02-26 17:01:32.426233 | controller | 2026-02-26 17:01:32.426343 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-26 17:01:32.426437 | controller | Thursday 26 February 2026 17:01:32 +0000 (0:00:00.059) 0:06:23.639 ***** 2026-02-26 17:01:34.070789 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 17:01:34.070914 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 17:01:34.071023 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 17:01:34.071039 | controller | changed: [instance -> controller-0] 2026-02-26 17:01:34.071091 | controller | 2026-02-26 17:01:34.071200 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-26 17:01:34.071288 | controller | Thursday 26 February 2026 17:01:34 +0000 (0:00:01.643) 0:06:25.283 ***** 2026-02-26 17:01:35.193644 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:35.193808 | controller | 2026-02-26 17:01:35.193907 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-26 17:01:35.193921 | controller | Thursday 26 February 2026 17:01:35 +0000 (0:00:01.122) 0:06:26.406 ***** 2026-02-26 17:01:36.600806 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:36.600959 | controller | 2026-02-26 17:01:36.600982 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-26 17:01:44.594932 | controller | Thursday 26 February 2026 17:01:36 +0000 (0:00:01.407) 0:06:27.813 ***** 2026-02-26 17:01:44.595005 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:44.595076 | controller | 2026-02-26 17:01:44.595224 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-26 17:01:44.595280 | controller | Thursday 26 February 2026 17:01:44 +0000 (0:00:07.994) 0:06:35.807 ***** 2026-02-26 17:01:45.658213 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:45.658298 | controller | 2026-02-26 17:01:45.658468 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-26 17:01:45.658513 | controller | Thursday 26 February 2026 17:01:45 +0000 (0:00:01.063) 0:06:36.871 ***** 2026-02-26 17:01:45.704018 | controller | skipping: [instance] 2026-02-26 17:01:46.909344 | controller | 2026-02-26 17:01:46.909382 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-26 17:01:46.909390 | controller | Thursday 26 February 2026 17:01:45 +0000 (0:00:00.045) 0:06:36.916 ***** 2026-02-26 17:01:46.909401 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:46.968259 | controller | 2026-02-26 17:01:46.968292 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-26 17:01:46.968301 | controller | Thursday 26 February 2026 17:01:46 +0000 (0:00:01.205) 0:06:38.122 ***** 2026-02-26 17:01:46.968323 | controller | skipping: [instance] 2026-02-26 17:01:47.023525 | controller | 2026-02-26 17:01:47.023571 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-26 17:01:47.023581 | controller | Thursday 26 February 2026 17:01:46 +0000 (0:00:00.058) 0:06:38.180 ***** 2026-02-26 17:01:47.023594 | controller | skipping: [instance] 2026-02-26 17:01:47.079171 | controller | 2026-02-26 17:01:47.079214 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-26 17:01:47.079222 | controller | Thursday 26 February 2026 17:01:47 +0000 (0:00:00.055) 0:06:38.236 ***** 2026-02-26 17:01:47.079234 | controller | skipping: [instance] 2026-02-26 17:01:47.079382 | controller | 2026-02-26 17:01:47.079460 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-26 17:01:47.079476 | controller | Thursday 26 February 2026 17:01:47 +0000 (0:00:00.055) 0:06:38.292 ***** 2026-02-26 17:01:47.925458 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:48.838784 | controller | 2026-02-26 17:01:48.838886 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-26 17:01:48.838899 | controller | Thursday 26 February 2026 17:01:47 +0000 (0:00:00.845) 0:06:39.138 ***** 2026-02-26 17:01:48.838921 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:48.884497 | controller | 2026-02-26 17:01:48.884530 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-26 17:01:48.884538 | controller | Thursday 26 February 2026 17:01:48 +0000 (0:00:00.913) 0:06:40.051 ***** 2026-02-26 17:01:48.884549 | controller | skipping: [instance] 2026-02-26 17:01:48.884569 | controller | 2026-02-26 17:01:48.884775 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-26 17:01:48.930203 | controller | Thursday 26 February 2026 17:01:48 +0000 (0:00:00.046) 0:06:40.097 ***** 2026-02-26 17:01:48.930313 | controller | skipping: [instance] 2026-02-26 17:01:48.930370 | controller | 2026-02-26 17:01:48.930381 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-26 17:01:48.976365 | controller | Thursday 26 February 2026 17:01:48 +0000 (0:00:00.045) 0:06:40.143 ***** 2026-02-26 17:01:48.976405 | controller | skipping: [instance] 2026-02-26 17:01:48.976453 | controller | 2026-02-26 17:01:48.976465 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-26 17:01:48.976623 | controller | Thursday 26 February 2026 17:01:48 +0000 (0:00:00.046) 0:06:40.189 ***** 2026-02-26 17:01:49.032943 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:49.032995 | controller | 2026-02-26 17:01:49.033086 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-26 17:01:49.033153 | controller | Thursday 26 February 2026 17:01:49 +0000 (0:00:00.056) 0:06:40.246 ***** 2026-02-26 17:01:49.073774 | controller | skipping: [instance] 2026-02-26 17:01:49.117898 | controller | 2026-02-26 17:01:49.117925 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-26 17:01:49.117934 | controller | Thursday 26 February 2026 17:01:49 +0000 (0:00:00.040) 0:06:40.286 ***** 2026-02-26 17:01:49.117945 | controller | skipping: [instance] 2026-02-26 17:01:49.117976 | controller | 2026-02-26 17:01:49.117983 | controller | TASK [Download the RPM] ******************************************************** 2026-02-26 17:01:49.117990 | controller | Thursday 26 February 2026 17:01:49 +0000 (0:00:00.043) 0:06:40.330 ***** 2026-02-26 17:01:49.160199 | controller | skipping: [instance] 2026-02-26 17:01:49.160328 | controller | 2026-02-26 17:01:49.160374 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-26 17:01:49.160494 | controller | Thursday 26 February 2026 17:01:49 +0000 (0:00:00.042) 0:06:40.373 ***** 2026-02-26 17:01:49.204972 | controller | skipping: [instance] 2026-02-26 17:01:49.205122 | controller | 2026-02-26 17:01:49.205225 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-26 17:01:49.205333 | controller | Thursday 26 February 2026 17:01:49 +0000 (0:00:00.044) 0:06:40.418 ***** 2026-02-26 17:01:49.252599 | controller | skipping: [instance] 2026-02-26 17:01:49.252660 | controller | 2026-02-26 17:01:49.252769 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-26 17:01:49.252886 | controller | Thursday 26 February 2026 17:01:49 +0000 (0:00:00.047) 0:06:40.465 ***** 2026-02-26 17:01:49.295547 | controller | skipping: [instance] 2026-02-26 17:01:49.295663 | controller | 2026-02-26 17:01:49.295797 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-26 17:01:49.295966 | controller | Thursday 26 February 2026 17:01:49 +0000 (0:00:00.043) 0:06:40.508 ***** 2026-02-26 17:01:49.339872 | controller | skipping: [instance] 2026-02-26 17:01:49.339987 | controller | 2026-02-26 17:01:49.340107 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-26 17:01:49.340229 | controller | Thursday 26 February 2026 17:01:49 +0000 (0:00:00.044) 0:06:40.553 ***** 2026-02-26 17:01:49.837482 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:49.837546 | controller | 2026-02-26 17:01:49.837651 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-26 17:01:49.837749 | controller | Thursday 26 February 2026 17:01:49 +0000 (0:00:00.497) 0:06:41.050 ***** 2026-02-26 17:01:49.977537 | controller | skipping: [instance] 2026-02-26 17:01:49.977622 | controller | 2026-02-26 17:01:49.977757 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-26 17:01:49.977893 | controller | Thursday 26 February 2026 17:01:49 +0000 (0:00:00.140) 0:06:41.190 ***** 2026-02-26 17:01:50.032116 | controller | skipping: [instance] 2026-02-26 17:01:50.032201 | controller | 2026-02-26 17:01:50.032310 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-26 17:01:50.032411 | controller | Thursday 26 February 2026 17:01:50 +0000 (0:00:00.054) 0:06:41.245 ***** 2026-02-26 17:01:50.075422 | controller | skipping: [instance] 2026-02-26 17:01:50.075507 | controller | 2026-02-26 17:01:50.075600 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-26 17:01:50.075693 | controller | Thursday 26 February 2026 17:01:50 +0000 (0:00:00.043) 0:06:41.288 ***** 2026-02-26 17:01:50.129139 | controller | skipping: [instance] 2026-02-26 17:01:50.129218 | controller | 2026-02-26 17:01:50.129320 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-26 17:01:50.129419 | controller | Thursday 26 February 2026 17:01:50 +0000 (0:00:00.053) 0:06:41.342 ***** 2026-02-26 17:01:50.184692 | controller | skipping: [instance] 2026-02-26 17:01:50.184765 | controller | 2026-02-26 17:01:50.184893 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-26 17:01:50.184985 | controller | Thursday 26 February 2026 17:01:50 +0000 (0:00:00.055) 0:06:41.398 ***** 2026-02-26 17:01:50.240908 | controller | skipping: [instance] 2026-02-26 17:01:50.240969 | controller | 2026-02-26 17:01:50.241084 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-26 17:01:50.241179 | controller | Thursday 26 February 2026 17:01:50 +0000 (0:00:00.056) 0:06:41.454 ***** 2026-02-26 17:01:50.295314 | controller | skipping: [instance] 2026-02-26 17:01:50.295417 | controller | 2026-02-26 17:01:50.295524 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-26 17:01:50.295620 | controller | Thursday 26 February 2026 17:01:50 +0000 (0:00:00.054) 0:06:41.508 ***** 2026-02-26 17:01:50.349455 | controller | skipping: [instance] 2026-02-26 17:01:50.349517 | controller | 2026-02-26 17:01:50.349607 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-26 17:01:50.349700 | controller | Thursday 26 February 2026 17:01:50 +0000 (0:00:00.053) 0:06:41.562 ***** 2026-02-26 17:01:50.948111 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:50.948172 | controller | 2026-02-26 17:01:50.948271 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-26 17:01:50.948377 | controller | Thursday 26 February 2026 17:01:50 +0000 (0:00:00.598) 0:06:42.161 ***** 2026-02-26 17:01:52.016208 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 17:01:52.016273 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 17:01:52.016677 | controller | changed: [instance -> controller-0] 2026-02-26 17:01:52.758007 | controller | 2026-02-26 17:01:52.758059 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-26 17:01:52.758068 | controller | Thursday 26 February 2026 17:01:52 +0000 (0:00:01.067) 0:06:43.229 ***** 2026-02-26 17:01:52.758081 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:52.758234 | controller | 2026-02-26 17:01:52.758281 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-26 17:01:53.309422 | controller | Thursday 26 February 2026 17:01:52 +0000 (0:00:00.741) 0:06:43.970 ***** 2026-02-26 17:01:53.309665 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:53.380562 | controller | 2026-02-26 17:01:53.380596 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-26 17:01:53.380604 | controller | Thursday 26 February 2026 17:01:53 +0000 (0:00:00.551) 0:06:44.521 ***** 2026-02-26 17:01:53.380622 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 17:01:53.430937 | controller | ok: [instance -> controller-0] 2026-02-26 17:01:53.431000 | controller | 2026-02-26 17:01:53.431009 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-26 17:01:53.431016 | controller | Thursday 26 February 2026 17:01:53 +0000 (0:00:00.071) 0:06:44.592 ***** 2026-02-26 17:01:53.431030 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:01:53.431194 | controller | 2026-02-26 17:01:53.431215 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-26 17:01:53.431506 | controller | Thursday 26 February 2026 17:01:53 +0000 (0:00:00.051) 0:06:44.644 ***** 2026-02-26 17:02:24.125987 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:24.126124 | controller | 2026-02-26 17:02:24.126298 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-26 17:02:24.126312 | controller | Thursday 26 February 2026 17:02:24 +0000 (0:00:30.692) 0:07:15.336 ***** 2026-02-26 17:02:24.669742 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:24.669902 | controller | 2026-02-26 17:02:24.669997 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-26 17:02:24.670009 | controller | Thursday 26 February 2026 17:02:24 +0000 (0:00:00.545) 0:07:15.882 ***** 2026-02-26 17:02:25.257015 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:25.257097 | controller | 2026-02-26 17:02:25.257223 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-26 17:02:25.257241 | controller | Thursday 26 February 2026 17:02:25 +0000 (0:00:00.587) 0:07:16.469 ***** 2026-02-26 17:02:31.401770 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:31.401868 | controller | 2026-02-26 17:02:31.401962 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-26 17:02:31.402063 | controller | Thursday 26 February 2026 17:02:31 +0000 (0:00:06.144) 0:07:22.614 ***** 2026-02-26 17:02:31.462860 | controller | skipping: [instance] 2026-02-26 17:02:31.462927 | controller | 2026-02-26 17:02:31.463046 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-26 17:02:31.463061 | controller | Thursday 26 February 2026 17:02:31 +0000 (0:00:00.061) 0:07:22.675 ***** 2026-02-26 17:02:32.081879 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:32.081962 | controller | 2026-02-26 17:02:32.082065 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-26 17:02:32.082078 | controller | Thursday 26 February 2026 17:02:32 +0000 (0:00:00.618) 0:07:23.294 ***** 2026-02-26 17:02:32.616621 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:32.665950 | controller | 2026-02-26 17:02:32.665983 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-26 17:02:32.665993 | controller | Thursday 26 February 2026 17:02:32 +0000 (0:00:00.534) 0:07:23.828 ***** 2026-02-26 17:02:32.666006 | controller | skipping: [instance] 2026-02-26 17:02:32.714451 | controller | 2026-02-26 17:02:32.714474 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-26 17:02:32.714482 | controller | Thursday 26 February 2026 17:02:32 +0000 (0:00:00.049) 0:07:23.878 ***** 2026-02-26 17:02:32.714498 | controller | skipping: [instance] 2026-02-26 17:02:32.714603 | controller | 2026-02-26 17:02:32.714613 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-26 17:02:32.714676 | controller | Thursday 26 February 2026 17:02:32 +0000 (0:00:00.048) 0:07:23.927 ***** 2026-02-26 17:02:32.758943 | controller | skipping: [instance] 2026-02-26 17:02:32.758966 | controller | 2026-02-26 17:02:32.758976 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-26 17:02:32.759044 | controller | Thursday 26 February 2026 17:02:32 +0000 (0:00:00.044) 0:07:23.972 ***** 2026-02-26 17:02:32.806334 | controller | skipping: [instance] 2026-02-26 17:02:32.806548 | controller | 2026-02-26 17:02:32.806568 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-26 17:02:32.856735 | controller | Thursday 26 February 2026 17:02:32 +0000 (0:00:00.047) 0:07:24.019 ***** 2026-02-26 17:02:32.856774 | controller | skipping: [instance] 2026-02-26 17:02:32.905533 | controller | 2026-02-26 17:02:32.905553 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-26 17:02:32.905561 | controller | Thursday 26 February 2026 17:02:32 +0000 (0:00:00.049) 0:07:24.069 ***** 2026-02-26 17:02:32.905571 | controller | skipping: [instance] 2026-02-26 17:02:35.714993 | controller | 2026-02-26 17:02:35.715038 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-26 17:02:35.715047 | controller | Thursday 26 February 2026 17:02:32 +0000 (0:00:00.049) 0:07:24.118 ***** 2026-02-26 17:02:35.715059 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 17:02:35.715091 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 17:02:35.715105 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 17:02:35.715110 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 17:02:35.715115 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 17:02:35.715120 | controller | changed: [instance -> controller-0] 2026-02-26 17:02:35.715132 | controller | 2026-02-26 17:02:35.715139 | controller | TASK [Prepare install_yamls make targets] ************************************** 2026-02-26 17:02:35.884812 | controller | Thursday 26 February 2026 17:02:35 +0000 (0:00:02.808) 0:07:26.926 ***** 2026-02-26 17:02:35.884865 | controller | 2026-02-26 17:02:35.884902 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2026-02-26 17:02:35.885014 | controller | Thursday 26 February 2026 17:02:35 +0000 (0:00:00.170) 0:07:27.097 ***** 2026-02-26 17:02:37.579365 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 17:02:37.579434 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 17:02:37.579444 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 17:02:37.579860 | controller | changed: [instance -> controller-0] 2026-02-26 17:02:37.648156 | controller | 2026-02-26 17:02:37.648199 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2026-02-26 17:02:37.648211 | controller | Thursday 26 February 2026 17:02:37 +0000 (0:00:01.694) 0:07:28.791 ***** 2026-02-26 17:02:37.648224 | controller | 2026-02-26 17:02:37.648250 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2026-02-26 17:02:37.648432 | controller | Thursday 26 February 2026 17:02:37 +0000 (0:00:00.069) 0:07:28.861 ***** 2026-02-26 17:02:37.698814 | controller | skipping: [instance] 2026-02-26 17:02:37.698887 | controller | 2026-02-26 17:02:37.698899 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2026-02-26 17:02:37.698913 | controller | Thursday 26 February 2026 17:02:37 +0000 (0:00:00.050) 0:07:28.911 ***** 2026-02-26 17:02:37.750632 | controller | skipping: [instance] 2026-02-26 17:02:37.750690 | controller | 2026-02-26 17:02:37.751045 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2026-02-26 17:02:37.829017 | controller | Thursday 26 February 2026 17:02:37 +0000 (0:00:00.052) 0:07:28.963 ***** 2026-02-26 17:02:37.829062 | controller | 2026-02-26 17:02:37.829124 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-26 17:02:37.829140 | controller | Thursday 26 February 2026 17:02:37 +0000 (0:00:00.078) 0:07:29.041 ***** 2026-02-26 17:02:37.869986 | controller | skipping: [instance] 2026-02-26 17:02:37.870101 | controller | 2026-02-26 17:02:37.870115 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-26 17:02:37.870223 | controller | Thursday 26 February 2026 17:02:37 +0000 (0:00:00.041) 0:07:29.083 ***** 2026-02-26 17:02:37.920332 | controller | skipping: [instance] 2026-02-26 17:02:37.970742 | controller | 2026-02-26 17:02:37.970772 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-26 17:02:37.970783 | controller | Thursday 26 February 2026 17:02:37 +0000 (0:00:00.050) 0:07:29.133 ***** 2026-02-26 17:02:37.970796 | controller | skipping: [instance] 2026-02-26 17:02:38.022075 | controller | 2026-02-26 17:02:38.022137 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-26 17:02:38.022150 | controller | Thursday 26 February 2026 17:02:37 +0000 (0:00:00.050) 0:07:29.183 ***** 2026-02-26 17:02:38.022364 | controller | skipping: [instance] 2026-02-26 17:02:38.128855 | controller | 2026-02-26 17:02:38.128891 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2026-02-26 17:02:38.128901 | controller | Thursday 26 February 2026 17:02:38 +0000 (0:00:00.051) 0:07:29.234 ***** 2026-02-26 17:02:38.128917 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-26 17:02:38.128953 | controller | ok: [instance -> controller-0] 2026-02-26 17:02:38.128963 | controller | 2026-02-26 17:02:38.128989 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2026-02-26 17:02:38.129200 | controller | Thursday 26 February 2026 17:02:38 +0000 (0:00:00.105) 0:07:29.340 ***** 2026-02-26 17:02:38.197998 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:39.230033 | controller | 2026-02-26 17:02:39.230124 | controller | TASK [install_yamls : Get environment structure] ******************************* 2026-02-26 17:02:39.230133 | controller | Thursday 26 February 2026 17:02:38 +0000 (0:00:00.069) 0:07:29.410 ***** 2026-02-26 17:02:39.230151 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:39.230248 | controller | 2026-02-26 17:02:39.230267 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2026-02-26 17:02:39.230364 | controller | Thursday 26 February 2026 17:02:39 +0000 (0:00:01.032) 0:07:30.442 ***** 2026-02-26 17:02:39.278774 | controller | skipping: [instance] 2026-02-26 17:02:39.278884 | controller | 2026-02-26 17:02:39.279047 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2026-02-26 17:02:39.279173 | controller | Thursday 26 February 2026 17:02:39 +0000 (0:00:00.049) 0:07:30.492 ***** 2026-02-26 17:02:39.337174 | controller | skipping: [instance] 2026-02-26 17:02:39.337255 | controller | 2026-02-26 17:02:39.337374 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2026-02-26 17:02:39.337483 | controller | Thursday 26 February 2026 17:02:39 +0000 (0:00:00.058) 0:07:30.550 ***** 2026-02-26 17:02:39.383548 | controller | skipping: [instance] 2026-02-26 17:02:39.383663 | controller | 2026-02-26 17:02:39.383795 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2026-02-26 17:02:39.383964 | controller | Thursday 26 February 2026 17:02:39 +0000 (0:00:00.046) 0:07:30.596 ***** 2026-02-26 17:02:39.451935 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:39.451999 | controller | 2026-02-26 17:02:39.452100 | controller | TASK [install_yamls : Show the env structure] ********************************** 2026-02-26 17:02:39.452207 | controller | Thursday 26 February 2026 17:02:39 +0000 (0:00:00.068) 0:07:30.665 ***** 2026-02-26 17:02:39.504158 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:39.504249 | controller | 2026-02-26 17:02:39.504391 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2026-02-26 17:02:39.504507 | controller | Thursday 26 February 2026 17:02:39 +0000 (0:00:00.052) 0:07:30.717 ***** 2026-02-26 17:02:39.576687 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:39.576811 | controller | 2026-02-26 17:02:39.576951 | controller | TASK [install_yamls : Generate make targets] *********************************** 2026-02-26 17:02:39.577044 | controller | Thursday 26 February 2026 17:02:39 +0000 (0:00:00.072) 0:07:30.789 ***** 2026-02-26 17:02:40.327031 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:40.327098 | controller | 2026-02-26 17:02:40.327349 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2026-02-26 17:02:40.393715 | controller | Thursday 26 February 2026 17:02:40 +0000 (0:00:00.750) 0:07:31.539 ***** 2026-02-26 17:02:40.393747 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:41.404788 | controller | 2026-02-26 17:02:41.404896 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2026-02-26 17:02:41.404910 | controller | Thursday 26 February 2026 17:02:40 +0000 (0:00:00.066) 0:07:31.606 ***** 2026-02-26 17:02:41.404922 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:41.464586 | controller | 2026-02-26 17:02:41.464669 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2026-02-26 17:02:41.464683 | controller | Thursday 26 February 2026 17:02:41 +0000 (0:00:01.010) 0:07:32.617 ***** 2026-02-26 17:02:41.464700 | controller | skipping: [instance] 2026-02-26 17:02:41.464728 | controller | 2026-02-26 17:02:41.464736 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-26 17:02:41.464746 | controller | Thursday 26 February 2026 17:02:41 +0000 (0:00:00.060) 0:07:32.677 ***** 2026-02-26 17:02:42.470624 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:42.470716 | controller | 2026-02-26 17:02:42.470745 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-26 17:02:42.470946 | controller | Thursday 26 February 2026 17:02:42 +0000 (0:00:01.005) 0:07:33.683 ***** 2026-02-26 17:02:42.540879 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:43.625857 | controller | 2026-02-26 17:02:43.625924 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2026-02-26 17:02:43.625935 | controller | Thursday 26 February 2026 17:02:42 +0000 (0:00:00.070) 0:07:33.753 ***** 2026-02-26 17:02:43.625951 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:44.192023 | controller | 2026-02-26 17:02:44.192110 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2026-02-26 17:02:44.192126 | controller | Thursday 26 February 2026 17:02:43 +0000 (0:00:01.084) 0:07:34.838 ***** 2026-02-26 17:02:44.192151 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-26 17:02:44.192198 | controller | 2026-02-26 17:02:44.192230 | controller | TASK [Configure CRC network if needed] ***************************************** 2026-02-26 17:02:44.345929 | controller | Thursday 26 February 2026 17:02:44 +0000 (0:00:00.566) 0:07:35.404 ***** 2026-02-26 17:02:44.345972 | controller | 2026-02-26 17:02:45.709908 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2026-02-26 17:02:45.709952 | controller | Thursday 26 February 2026 17:02:44 +0000 (0:00:00.153) 0:07:35.558 ***** 2026-02-26 17:02:45.709967 | controller | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-26 17:02:45.712881 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false 2026-02-26 17:02:45.713109 | controller | module_stderr: |- 2026-02-26 17:02:45.713174 | controller | Shared connection to controller-0.utility closed. 2026-02-26 17:02:45.713183 | controller | module_stdout: |- 2026-02-26 17:02:45.713190 | controller | Traceback (most recent call last): 2026-02-26 17:02:45.713198 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 700, in urlopen 2026-02-26 17:02:45.713205 | controller | httplib_response = self._make_request( 2026-02-26 17:02:45.713212 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 383, in _make_request 2026-02-26 17:02:45.713219 | controller | self._validate_conn(conn) 2026-02-26 17:02:45.713236 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1015, in _validate_conn 2026-02-26 17:02:45.713288 | controller | conn.connect() 2026-02-26 17:02:45.713296 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connection.py", line 411, in connect 2026-02-26 17:02:45.713304 | controller | self.sock = ssl_wrap_socket( 2026-02-26 17:02:45.713621 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket 2026-02-26 17:02:45.713641 | controller | ssl_sock = _ssl_wrap_socket_impl( 2026-02-26 17:02:45.713740 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl 2026-02-26 17:02:45.713767 | controller | return ssl_context.wrap_socket(sock, server_hostname=server_hostname) 2026-02-26 17:02:45.713780 | controller | File "/usr/lib64/python3.9/ssl.py", line 501, in wrap_socket 2026-02-26 17:02:45.713802 | controller | return self.sslsocket_class._create( 2026-02-26 17:02:45.713854 | controller | File "/usr/lib64/python3.9/ssl.py", line 1076, in _create 2026-02-26 17:02:45.714113 | controller | self.do_handshake() 2026-02-26 17:02:45.714703 | controller | File "/usr/lib64/python3.9/ssl.py", line 1345, in do_handshake 2026-02-26 17:02:45.714718 | controller | self._sslobj.do_handshake() 2026-02-26 17:02:45.714728 | controller | ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147) 2026-02-26 17:02:45.714912 | controller | 2026-02-26 17:02:45.714930 | controller | During handling of the above exception, another exception occurred: 2026-02-26 17:02:45.714937 | controller | 2026-02-26 17:02:45.714943 | controller | Traceback (most recent call last): 2026-02-26 17:02:45.714949 | controller | File "/tmp/ansible-tmp-1772125364.3895886-28499-189333464722119/AnsiballZ_k8s_info.py", line 107, in 2026-02-26 17:02:45.714957 | controller | _ansiballz_main() 2026-02-26 17:02:45.714966 | controller | File "/tmp/ansible-tmp-1772125364.3895886-28499-189333464722119/AnsiballZ_k8s_info.py", line 99, in _ansiballz_main 2026-02-26 17:02:45.715110 | controller | invoke_module(zipped_mod, temp_path, ANSIBALLZ_PARAMS) 2026-02-26 17:02:45.715127 | controller | File "/tmp/ansible-tmp-1772125364.3895886-28499-189333464722119/AnsiballZ_k8s_info.py", line 47, in invoke_module 2026-02-26 17:02:45.715703 | controller | runpy.run_module(mod_name='ansible_collections.kubernetes.core.plugins.modules.k8s_info', init_globals=dict(_module_fqn='ansible_collections.kubernetes.core.plugins.modules.k8s_info', _modlib_path=modlib_path), 2026-02-26 17:02:45.715733 | controller | File "/usr/lib64/python3.9/runpy.py", line 225, in run_module 2026-02-26 17:02:45.715799 | controller | return _run_module_code(code, init_globals, run_name, mod_spec) 2026-02-26 17:02:45.715807 | controller | File "/usr/lib64/python3.9/runpy.py", line 97, in _run_module_code 2026-02-26 17:02:45.715813 | controller | _run_code(code, mod_globals, init_globals, 2026-02-26 17:02:45.715832 | controller | File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-26 17:02:45.715845 | controller | exec(code, run_globals) 2026-02-26 17:02:45.715852 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_iqkcupap/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 229, in 2026-02-26 17:02:45.715861 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_iqkcupap/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 221, in main 2026-02-26 17:02:45.715943 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_iqkcupap/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 352, in get_api_client 2026-02-26 17:02:45.716059 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_iqkcupap/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 246, in wrapper 2026-02-26 17:02:45.716198 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_iqkcupap/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 259, in create_api_client 2026-02-26 17:02:45.716351 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 84, in __init__ 2026-02-26 17:02:45.716482 | controller | self.__discoverer = discoverer(self, cache_file) 2026-02-26 17:02:45.716611 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_iqkcupap/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 190, in __init__ 2026-02-26 17:02:45.716738 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_iqkcupap/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 45, in __init__ 2026-02-26 17:02:45.716899 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload_iqkcupap/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 92, in __init_cache 2026-02-26 17:02:45.717042 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/discovery.py", line 146, in _load_server_info 2026-02-26 17:02:45.717168 | controller | 'kubernetes': self.client.request('get', '/version', serializer=just_json) 2026-02-26 17:02:45.717312 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 55, in inner 2026-02-26 17:02:45.717440 | controller | resp = func(self, *args, **kwargs) 2026-02-26 17:02:45.717567 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 277, in request 2026-02-26 17:02:45.717691 | controller | api_response = self.client.call_api( 2026-02-26 17:02:45.717925 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 348, in call_api 2026-02-26 17:02:45.718082 | controller | return self.__call_api(resource_path, method, 2026-02-26 17:02:45.718215 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 180, in __call_api 2026-02-26 17:02:45.718355 | controller | response_data = self.request( 2026-02-26 17:02:45.718487 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 373, in request 2026-02-26 17:02:45.718615 | controller | return self.rest_client.GET(url, 2026-02-26 17:02:45.718742 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 244, in GET 2026-02-26 17:02:45.718895 | controller | return self.request("GET", url, 2026-02-26 17:02:45.719032 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 217, in request 2026-02-26 17:02:45.719167 | controller | r = self.pool_manager.request(method, url, 2026-02-26 17:02:45.719307 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 74, in request 2026-02-26 17:02:45.719435 | controller | return self.request_encode_url( 2026-02-26 17:02:45.719560 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 96, in request_encode_url 2026-02-26 17:02:45.719683 | controller | return self.urlopen(method, url, **extra_kw) 2026-02-26 17:02:45.719805 | controller | File "/usr/lib/python3.9/site-packages/urllib3/poolmanager.py", line 376, in urlopen 2026-02-26 17:02:45.719956 | controller | response = conn.urlopen(method, u.request_uri, **kw) 2026-02-26 17:02:45.720086 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-26 17:02:45.720209 | controller | return self.urlopen( 2026-02-26 17:02:45.720347 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-26 17:02:45.720471 | controller | return self.urlopen( 2026-02-26 17:02:45.720595 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-26 17:02:45.720716 | controller | return self.urlopen( 2026-02-26 17:02:45.720862 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 756, in urlopen 2026-02-26 17:02:45.720993 | controller | retries = retries.increment( 2026-02-26 17:02:45.721116 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/retry.py", line 576, in increment 2026-02-26 17:02:45.721324 | controller | raise MaxRetryError(_pool, url, error or ResponseError(cause)) 2026-02-26 17:02:45.721472 | controller | urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-26 17:02:45.721598 | controller | msg: |- 2026-02-26 17:02:45.721728 | controller | MODULE FAILURE 2026-02-26 17:02:45.721878 | controller | See stdout/stderr for the exact error 2026-02-26 17:02:45.722011 | controller | rc: 1 2026-02-26 17:02:45.722198 | controller | 2026-02-26 17:02:45.722346 | controller | TASK [Create dnsmasq dir] ****************************************************** 2026-02-26 17:02:45.722475 | controller | Thursday 26 February 2026 17:02:45 +0000 (0:00:01.376) 0:07:36.935 ***** 2026-02-26 17:02:46.013772 | controller | changed: [instance] 2026-02-26 17:02:46.013867 | controller | 2026-02-26 17:02:46.013883 | controller | TASK [Get journalctl in a file] ************************************************ 2026-02-26 17:02:46.312756 | controller | Thursday 26 February 2026 17:02:46 +0000 (0:00:00.290) 0:07:37.226 ***** 2026-02-26 17:02:46.312840 | controller | changed: [instance] 2026-02-26 17:02:46.798336 | controller | 2026-02-26 17:02:46.798379 | controller | TASK [Dump journalctl output] ************************************************** 2026-02-26 17:02:46.798388 | controller | Thursday 26 February 2026 17:02:46 +0000 (0:00:00.298) 0:07:37.525 ***** 2026-02-26 17:02:46.798400 | controller | changed: [instance] 2026-02-26 17:02:47.372533 | controller | 2026-02-26 17:02:47.372574 | controller | TASK [Copy all dnsmasq config] ************************************************* 2026-02-26 17:02:47.372582 | controller | Thursday 26 February 2026 17:02:46 +0000 (0:00:00.485) 0:07:38.010 ***** 2026-02-26 17:02:47.372593 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-26 17:02:47.597632 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2026-02-26 17:02:47.597683 | controller | 2026-02-26 17:02:47.597691 | controller | TASK [Create log directory] **************************************************** 2026-02-26 17:02:47.597698 | controller | Thursday 26 February 2026 17:02:47 +0000 (0:00:00.573) 0:07:38.584 ***** 2026-02-26 17:02:47.597711 | controller | changed: [instance] 2026-02-26 17:02:47.597743 | controller | 2026-02-26 17:02:47.598081 | controller | TASK [Sync logs from controller-0] ********************************************* 2026-02-26 17:02:47.598131 | controller | Thursday 26 February 2026 17:02:47 +0000 (0:00:00.225) 0:07:38.810 ***** 2026-02-26 17:02:48.498947 | controller | changed: [instance] 2026-02-26 17:02:48.499011 | controller | 2026-02-26 17:02:48.499021 | controller | PLAY RECAP ********************************************************************* 2026-02-26 17:02:48.499028 | controller | instance : ok=541 changed=208 unreachable=0 failed=1 skipped=229 rescued=0 ignored=0 2026-02-26 17:02:48.499033 | controller | 2026-02-26 17:02:48.499038 | controller | Thursday 26 February 2026 17:02:48 +0000 (0:00:00.898) 0:07:39.709 ***** 2026-02-26 17:02:48.499044 | controller | =============================================================================== 2026-02-26 17:02:48.499049 | controller | libvirt_manager : Download base image ---------------------------------- 53.10s 2026-02-26 17:02:48.499054 | controller | reproducer : Check package install status ------------------------------ 45.35s 2026-02-26 17:02:48.499059 | controller | ci_setup : Install needed packages ------------------------------------- 30.69s 2026-02-26 17:02:48.499067 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 23.11s 2026-02-26 17:02:48.499082 | controller | reproducer : Install collections on controller-0 ----------------------- 20.92s 2026-02-26 17:02:48.499104 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 11.51s 2026-02-26 17:02:48.499685 | controller | libvirt_manager : Install packages required for using KVM --------------- 8.58s 2026-02-26 17:02:48.500462 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 8.18s 2026-02-26 17:02:48.500479 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.99s 2026-02-26 17:02:48.500486 | controller | ci_setup : Install openshift client ------------------------------------- 6.14s 2026-02-26 17:02:48.500491 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.06s 2026-02-26 17:02:48.500499 | controller | ci_nmstate : Install required packages on localhost --------------------- 4.88s 2026-02-26 17:02:48.653720 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.80s 2026-02-26 17:02:48.653767 | controller | networking_mapper : Gather the facts ------------------------------------ 3.69s 2026-02-26 17:02:48.653775 | controller | reproducer : Clone repository if needed: architecture ------------------- 3.14s 2026-02-26 17:02:48.653780 | controller | sushy_emulator : Install required packages ------------------------------ 3.12s 2026-02-26 17:02:48.653786 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.11s 2026-02-26 17:02:48.653791 | controller | ci_setup : Manage directories ------------------------------------------- 2.81s 2026-02-26 17:02:48.653796 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.26s 2026-02-26 17:02:48.653801 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.16s 2026-02-26 17:02:48.653835 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml'] 2026-02-26 17:02:48.662124 | controller | WARNING An error occurred during the test sequence action: 'converge'. Cleaning up. 2026-02-26 17:02:48.662154 | controller | INFO Running crc_layout > cleanup 2026-02-26 17:02:48.662541 | controller | WARNING Skipping, cleanup playbook not configured. 2026-02-26 17:02:48.669845 | controller | INFO Running crc_layout > destroy 2026-02-26 17:02:48.670183 | controller | WARNING Skipping, instances are delegated. 2026-02-26 17:02:48.670500 | controller | INFO Pruning extra files from scenario ephemeral directory 2026-02-26 17:02:48.672214 | controller | INFO Writing /tmp/report.html report. 2026-02-26 17:02:48.830098 | [controller] Waiting on logger 2026-02-26 17:02:54.011987 | [controller] Waiting on logger 2026-02-26 17:03:04.443847 | [controller] Waiting on logger 2026-02-26 17:03:14.876025 | [controller] Waiting on logger 2026-02-26 17:03:18.801379 | [Zuul] Log Stream did not terminate 2026-02-26 17:03:18.801612 | controller | ERROR 2026-02-26 17:03:18.801707 | controller | { 2026-02-26 17:03:18.801744 | controller | "delta": "0:09:32.757892", 2026-02-26 17:03:18.801771 | controller | "end": "2026-02-26 17:02:48.747133", 2026-02-26 17:03:18.801793 | controller | "msg": "non-zero return code", 2026-02-26 17:03:18.801828 | controller | "rc": 1, 2026-02-26 17:03:18.801849 | controller | "start": "2026-02-26 16:53:15.989241" 2026-02-26 17:03:18.801868 | controller | } failure 2026-02-26 17:03:18.857435 | 2026-02-26 17:03:18.857495 | PLAY RECAP 2026-02-26 17:03:18.857542 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0 2026-02-26 17:03:18.857591 | 2026-02-26 17:03:18.921850 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-26 17:03:18.922590 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-26 17:03:19.427256 | 2026-02-26 17:03:19.427371 | PLAY [Run ci/playbooks/collect-logs.yml] 2026-02-26 17:03:19.447065 | 2026-02-26 17:03:19.447138 | TASK [Filter out host if needed] 2026-02-26 17:03:19.455602 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2026-02-26 17:03:19.460156 | 2026-02-26 17:03:19.460223 | TASK [Ensure file is present] 2026-02-26 17:03:19.854858 | controller | ok 2026-02-26 17:03:19.859892 | 2026-02-26 17:03:19.859951 | TASK [Manage molecule report file] 2026-02-26 17:03:19.881924 | [controller] Waiting on logger 2026-02-26 17:03:29.275983 | [controller] Waiting on logger 2026-02-26 17:03:39.707928 | [controller] Waiting on logger 2026-02-26 17:03:49.051761 | [controller] Waiting on logger 2026-02-26 17:03:50.283499 | [Zuul] Log Stream did not terminate 2026-02-26 17:03:50.283687 | controller | changed 2026-02-26 17:03:50.289141 | 2026-02-26 17:03:50.289203 | TASK [Check if we get ci-framework-data basedir] 2026-02-26 17:03:50.581501 | controller | ok 2026-02-26 17:03:50.586723 | 2026-02-26 17:03:50.586797 | TASK [Create ci-framework-data log directory for zuul] 2026-02-26 17:03:51.011441 | controller | changed 2026-02-26 17:03:51.016896 | 2026-02-26 17:03:51.016959 | TASK [Copy ci-framework interesting files] 2026-02-26 17:03:51.037464 | [controller] Waiting on logger 2026-02-26 17:04:01.467859 | [controller] Waiting on logger 2026-02-26 17:04:10.848689 | [controller] Waiting on logger 2026-02-26 17:04:21.244077 | [controller] Waiting on logger 2026-02-26 17:04:21.360715 | [Zuul] Log Stream did not terminate 2026-02-26 17:04:21.360902 | controller | changed 2026-02-26 17:04:21.365982 | 2026-02-26 17:04:21.366044 | TASK [Get SELinux listing] 2026-02-26 17:04:24.444141 | [controller] Waiting on logger 2026-02-26 17:04:34.875937 | [controller] Waiting on logger 2026-02-26 17:04:44.219789 | [controller] Waiting on logger 2026-02-26 17:04:51.676656 | [Zuul] Log Stream did not terminate 2026-02-26 17:04:51.676872 | controller | changed 2026-02-26 17:04:51.682437 | 2026-02-26 17:04:51.682504 | TASK [Generate log index] 2026-02-26 17:04:53.038829 | controller | changed 2026-02-26 17:04:53.043757 | 2026-02-26 17:04:53.043836 | TASK [Get some env related data] 2026-02-26 17:04:53.067345 | [controller] Waiting on logger 2026-02-26 17:05:03.484399 | [controller] Waiting on logger 2026-02-26 17:05:12.864662 | [controller] Waiting on logger 2026-02-26 17:05:23.260052 | [controller] Waiting on logger 2026-02-26 17:05:24.401838 | [Zuul] Log Stream did not terminate 2026-02-26 17:05:24.402007 | controller | changed 2026-02-26 17:05:24.422946 | 2026-02-26 17:05:24.423019 | TASK [Generate list of logs to collect in home directory] 2026-02-26 17:05:24.775796 | controller | ok: All paths examined 2026-02-26 17:05:24.781547 | 2026-02-26 17:05:24.781620 | LOOP [Copy logs from home directory] 2026-02-26 17:05:25.429371 | controller | changed: 2026-02-26 17:05:25.429614 | controller | { 2026-02-26 17:05:25.429644 | controller | "atime": 1743544925.4788878, 2026-02-26 17:05:25.429664 | controller | "ctime": 1743545329.1409318, 2026-02-26 17:05:25.429682 | controller | "dev": 64513, 2026-02-26 17:05:25.429698 | controller | "gid": 1000, 2026-02-26 17:05:25.429713 | controller | "gr_name": "zuul", 2026-02-26 17:05:25.429738 | controller | "inode": 4518807, 2026-02-26 17:05:25.429758 | controller | "isblk": false, 2026-02-26 17:05:25.429774 | controller | "ischr": false, 2026-02-26 17:05:25.429798 | controller | "isdir": false, 2026-02-26 17:05:25.429813 | controller | "isfifo": false, 2026-02-26 17:05:25.429830 | controller | "isgid": false, 2026-02-26 17:05:25.429845 | controller | "islnk": false, 2026-02-26 17:05:25.429859 | controller | "isreg": true, 2026-02-26 17:05:25.429872 | controller | "issock": false, 2026-02-26 17:05:25.429885 | controller | "isuid": false, 2026-02-26 17:05:25.429898 | controller | "mode": "0644", 2026-02-26 17:05:25.429911 | controller | "mtime": 1743545329.1409318, 2026-02-26 17:05:25.429924 | controller | "nlink": 1, 2026-02-26 17:05:25.429938 | controller | "path": "/home/zuul/crc-setup.log", 2026-02-26 17:05:25.429952 | controller | "pw_name": "zuul", 2026-02-26 17:05:25.429966 | controller | "rgrp": true, 2026-02-26 17:05:25.429979 | controller | "roth": true, 2026-02-26 17:05:25.429992 | controller | "rusr": true, 2026-02-26 17:05:25.430005 | controller | "size": 4108, 2026-02-26 17:05:25.430018 | controller | "uid": 1000, 2026-02-26 17:05:25.430032 | controller | "wgrp": false, 2026-02-26 17:05:25.430047 | controller | "woth": false, 2026-02-26 17:05:25.430061 | controller | "wusr": true, 2026-02-26 17:05:25.430074 | controller | "xgrp": false, 2026-02-26 17:05:25.430087 | controller | "xoth": false, 2026-02-26 17:05:25.430101 | controller | "xusr": false 2026-02-26 17:05:25.430114 | controller | } 2026-02-26 17:05:26.050503 | controller | changed: 2026-02-26 17:05:26.050604 | controller | { 2026-02-26 17:05:26.050633 | controller | "atime": 1743545331.0429637, 2026-02-26 17:05:26.050658 | controller | "ctime": 1743545842.0111232, 2026-02-26 17:05:26.050676 | controller | "dev": 64513, 2026-02-26 17:05:26.050693 | controller | "gid": 1000, 2026-02-26 17:05:26.050709 | controller | "gr_name": "zuul", 2026-02-26 17:05:26.050734 | controller | "inode": 4194437, 2026-02-26 17:05:26.050753 | controller | "isblk": false, 2026-02-26 17:05:26.050768 | controller | "ischr": false, 2026-02-26 17:05:26.050783 | controller | "isdir": false, 2026-02-26 17:05:26.050797 | controller | "isfifo": false, 2026-02-26 17:05:26.050810 | controller | "isgid": false, 2026-02-26 17:05:26.050824 | controller | "islnk": false, 2026-02-26 17:05:26.050840 | controller | "isreg": true, 2026-02-26 17:05:26.050854 | controller | "issock": false, 2026-02-26 17:05:26.050867 | controller | "isuid": false, 2026-02-26 17:05:26.050883 | controller | "mode": "0644", 2026-02-26 17:05:26.050897 | controller | "mtime": 1743545842.0111232, 2026-02-26 17:05:26.050912 | controller | "nlink": 1, 2026-02-26 17:05:26.050926 | controller | "path": "/home/zuul/crc-start.log", 2026-02-26 17:05:26.050941 | controller | "pw_name": "zuul", 2026-02-26 17:05:26.050955 | controller | "rgrp": true, 2026-02-26 17:05:26.050970 | controller | "roth": true, 2026-02-26 17:05:26.050983 | controller | "rusr": true, 2026-02-26 17:05:26.050997 | controller | "size": 4023, 2026-02-26 17:05:26.051010 | controller | "uid": 1000, 2026-02-26 17:05:26.051023 | controller | "wgrp": false, 2026-02-26 17:05:26.051036 | controller | "woth": false, 2026-02-26 17:05:26.051050 | controller | "wusr": true, 2026-02-26 17:05:26.051062 | controller | "xgrp": false, 2026-02-26 17:05:26.051075 | controller | "xoth": false, 2026-02-26 17:05:26.051088 | controller | "xusr": false 2026-02-26 17:05:26.051101 | controller | } 2026-02-26 17:05:26.708086 | controller | changed: 2026-02-26 17:05:26.708175 | controller | { 2026-02-26 17:05:26.708202 | controller | "atime": 1772124776.823538, 2026-02-26 17:05:26.708222 | controller | "ctime": 1772124793.5755405, 2026-02-26 17:05:26.708241 | controller | "dev": 64513, 2026-02-26 17:05:26.708259 | controller | "gid": 1000, 2026-02-26 17:05:26.708276 | controller | "gr_name": "zuul", 2026-02-26 17:05:26.708313 | controller | "inode": 4685793, 2026-02-26 17:05:26.708341 | controller | "isblk": false, 2026-02-26 17:05:26.708360 | controller | "ischr": false, 2026-02-26 17:05:26.708377 | controller | "isdir": false, 2026-02-26 17:05:26.708394 | controller | "isfifo": false, 2026-02-26 17:05:26.708410 | controller | "isgid": false, 2026-02-26 17:05:26.708425 | controller | "islnk": false, 2026-02-26 17:05:26.708441 | controller | "isreg": true, 2026-02-26 17:05:26.708456 | controller | "issock": false, 2026-02-26 17:05:26.708471 | controller | "isuid": false, 2026-02-26 17:05:26.708486 | controller | "mode": "0644", 2026-02-26 17:05:26.708501 | controller | "mtime": 1772124793.5755405, 2026-02-26 17:05:26.708516 | controller | "nlink": 1, 2026-02-26 17:05:26.708533 | controller | "path": "/home/zuul/ansible.log", 2026-02-26 17:05:26.708549 | controller | "pw_name": "zuul", 2026-02-26 17:05:26.708565 | controller | "rgrp": true, 2026-02-26 17:05:26.708580 | controller | "roth": true, 2026-02-26 17:05:26.708596 | controller | "rusr": true, 2026-02-26 17:05:26.708612 | controller | "size": 6749, 2026-02-26 17:05:26.708627 | controller | "uid": 1000, 2026-02-26 17:05:26.708643 | controller | "wgrp": false, 2026-02-26 17:05:26.708658 | controller | "woth": false, 2026-02-26 17:05:26.708673 | controller | "wusr": true, 2026-02-26 17:05:26.708688 | controller | "xgrp": false, 2026-02-26 17:05:26.708704 | controller | "xoth": false, 2026-02-26 17:05:26.708719 | controller | "xusr": false 2026-02-26 17:05:26.708749 | controller | } 2026-02-26 17:05:26.718983 | 2026-02-26 17:05:26.719089 | TASK [Copy crio stats log file] 2026-02-26 17:05:26.733229 | controller | skipping: Conditional result was False 2026-02-26 17:05:26.738710 | 2026-02-26 17:05:26.738789 | TASK [Get SELinux related data] 2026-02-26 17:05:27.803972 | [controller] Waiting on logger 2026-02-26 17:05:42.331948 | [controller] Waiting on logger 2026-02-26 17:05:52.763809 | [controller] Waiting on logger 2026-02-26 17:05:57.081423 | [Zuul] Log Stream did not terminate 2026-02-26 17:05:57.081630 | controller | ERROR 2026-02-26 17:05:57.081749 | controller | { 2026-02-26 17:05:57.081786 | controller | "delta": "0:00:00.012059", 2026-02-26 17:05:57.081810 | controller | "end": "2026-02-26 17:05:27.044027", 2026-02-26 17:05:57.081831 | controller | "msg": "non-zero return code", 2026-02-26 17:05:57.081850 | controller | "rc": 1, 2026-02-26 17:05:57.081868 | controller | "start": "2026-02-26 17:05:27.031968" 2026-02-26 17:05:57.081888 | controller | } 2026-02-26 17:05:57.081916 | controller | ERROR: Ignoring Errors 2026-02-26 17:05:57.087091 | 2026-02-26 17:05:57.087165 | TASK [Create system configuration directory] 2026-02-26 17:05:57.390094 | controller | changed 2026-02-26 17:05:57.394918 | 2026-02-26 17:05:57.394979 | TASK [Get some of the system configurations] 2026-02-26 17:05:57.417777 | [controller] Waiting on logger 2026-02-26 17:06:07.291868 | [controller] Waiting on logger 2026-02-26 17:06:08.083599 | controller | changed 2026-02-26 17:06:08.088684 | 2026-02-26 17:06:08.088757 | TASK [Copy generated documentation if available] 2026-02-26 17:06:08.101742 | controller | skipping: Conditional result was False 2026-02-26 17:06:08.107027 | 2026-02-26 17:06:08.107091 | TASK [Copy generated AsciiDoc documentation if available] 2026-02-26 17:06:08.120208 | controller | skipping: Conditional result was False 2026-02-26 17:06:08.125321 | 2026-02-26 17:06:08.125384 | TASK [Compress logs bigger than 2MB] 2026-02-26 17:06:08.146710 | [controller] Waiting on logger 2026-02-26 17:06:18.555939 | [controller] Waiting on logger 2026-02-26 17:06:27.936334 | [controller] Waiting on logger 2026-02-26 17:06:38.331912 | [controller] Waiting on logger 2026-02-26 17:06:38.447962 | [Zuul] Log Stream did not terminate 2026-02-26 17:06:38.448231 | controller | changed 2026-02-26 17:06:38.453589 | 2026-02-26 17:06:38.453653 | TASK [Copy files from workspace on node] 2026-02-26 17:06:38.471359 | controller | ok 2026-02-26 17:06:38.493325 | 2026-02-26 17:06:38.493393 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-26 17:06:38.506801 | controller | skipping: Conditional result was False 2026-02-26 17:06:38.512487 | 2026-02-26 17:06:38.512555 | TASK [fetch-output : Set log path for single node] 2026-02-26 17:06:38.540670 | controller | ok 2026-02-26 17:06:38.545515 | 2026-02-26 17:06:38.545579 | LOOP [fetch-output : Ensure local output dirs] 2026-02-26 17:06:38.739218 | controller -> localhost | ok: "/var/lib/zuul/builds/685d343c8f124555be0d56023affbe1d/work/logs" 2026-02-26 17:06:38.739513 | controller -> localhost | changed: All items complete 2026-02-26 17:06:38.739550 | 2026-02-26 17:06:38.916279 | controller -> localhost | changed: "/var/lib/zuul/builds/685d343c8f124555be0d56023affbe1d/work/artifacts" 2026-02-26 17:06:39.090874 | controller -> localhost | changed: "/var/lib/zuul/builds/685d343c8f124555be0d56023affbe1d/work/docs" 2026-02-26 17:06:39.103732 | 2026-02-26 17:06:39.103835 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-26 17:06:39.753526 | controller | changed: 2026-02-26 17:06:39.753724 | controller | .d..t...... ./ 2026-02-26 17:06:39.753756 | controller | >f+++++++++ README.html 2026-02-26 17:06:39.753777 | controller | >f+++++++++ ansible-execution.log 2026-02-26 17:06:39.753797 | controller | >f+++++++++ ansible.log 2026-02-26 17:06:39.753816 | controller | >f+++++++++ crc-setup.log 2026-02-26 17:06:39.753834 | controller | >f+++++++++ crc-start.log 2026-02-26 17:06:39.753852 | controller | >f+++++++++ dmesg.log 2026-02-26 17:06:39.753869 | controller | >f+++++++++ installed-pkgs.log 2026-02-26 17:06:39.753885 | controller | >f+++++++++ python.log 2026-02-26 17:06:39.753901 | controller | >f+++++++++ registries.conf 2026-02-26 17:06:39.753947 | controller | >f+++++++++ report.html 2026-02-26 17:06:39.753974 | controller | >f+++++++++ selinux-denials.log 2026-02-26 17:06:39.753993 | controller | >f+++++++++ selinux-listing.log 2026-02-26 17:06:39.754047 | controller | cd+++++++++ ci-framework-data/ 2026-02-26 17:06:39.754069 | controller | cd+++++++++ ci-framework-data/artifacts/ 2026-02-26 17:06:39.754086 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2026-02-26 17:06:39.754130 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2026-02-26 17:06:39.754148 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2026-02-26 17:06:39.754164 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2026-02-26 17:06:39.754204 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2026-02-26 17:06:39.754222 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2026-02-26 17:06:39.754238 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2026-02-26 17:06:39.754274 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2026-02-26 17:06:39.754317 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2026-02-26 17:06:39.754341 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2026-02-26 17:06:39.754357 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2026-02-26 17:06:39.754372 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2026-02-26 17:06:39.754413 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2026-02-26 17:06:39.754432 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:6e:9e:b5 2026-02-26 17:06:39.754449 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:74:d9:1b 2026-02-26 17:06:39.754518 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:e2:77:a5 2026-02-26 17:06:39.754541 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:23:6c:17 2026-02-26 17:06:39.754560 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:8c:ed:7b 2026-02-26 17:06:39.754577 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:a5:91:60 2026-02-26 17:06:39.754593 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2026-02-26 17:06:39.754609 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2026-02-26 17:06:39.754624 | controller | cd+++++++++ ci-framework-data/logs/ 2026-02-26 17:06:39.754650 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2026-02-26 17:06:39.754674 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2026-02-26 17:06:39.754711 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2026-02-26 17:06:39.754735 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2026-02-26 17:06:39.754760 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2026-02-26 17:06:39.754784 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2026-02-26 17:06:39.754807 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2026-02-26 17:06:39.754829 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2026-02-26 17:06:39.754850 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2026-02-26 17:06:39.754872 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2026-02-26 17:06:39.754893 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2026-02-26 17:06:39.755016 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2026-02-26 17:06:39.755050 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2026-02-26 17:06:39.755071 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2026-02-26 17:06:39.755089 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2026-02-26 17:06:39.755107 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2026-02-26 17:06:39.755125 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2026-02-26 17:06:39.755142 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2026-02-26 17:06:39.755159 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2026-02-26 17:06:39.755175 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2026-02-26 17:06:39.755190 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2026-02-26 17:06:39.755206 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2026-02-26 17:06:39.755222 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2026-02-26 17:06:39.755237 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2026-02-26 17:06:39.755252 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2026-02-26 17:06:39.755267 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2026-02-26 17:06:39.755281 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2026-02-26 17:06:39.755321 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2026-02-26 17:06:39.755344 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2026-02-26 17:06:39.755363 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2026-02-26 17:06:39.755380 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2026-02-26 17:06:39.755396 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2026-02-26 17:06:39.755412 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2026-02-26 17:06:39.755427 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2026-02-26 17:06:39.755442 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2026-02-26 17:06:39.755457 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2026-02-26 17:06:39.755473 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2026-02-26 17:06:39.755488 | controller | cd+++++++++ registries.conf.d/ 2026-02-26 17:06:39.755503 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2026-02-26 17:06:39.755517 | controller | cd+++++++++ system-config/ 2026-02-26 17:06:39.755531 | controller | cd+++++++++ system-config/libvirt/ 2026-02-26 17:06:39.755547 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2026-02-26 17:06:39.755566 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2026-02-26 17:06:39.755582 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2026-02-26 17:06:39.755597 | controller | >f+++++++++ system-config/libvirt/network.conf 2026-02-26 17:06:39.755611 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2026-02-26 17:06:39.755625 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2026-02-26 17:06:39.755639 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2026-02-26 17:06:39.755653 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2026-02-26 17:06:39.755667 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2026-02-26 17:06:39.755710 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2026-02-26 17:06:39.755728 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2026-02-26 17:06:39.755744 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2026-02-26 17:06:39.755759 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2026-02-26 17:06:39.755773 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2026-02-26 17:06:39.755788 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2026-02-26 17:06:39.755802 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2026-02-26 17:06:40.236797 | controller | changed: .d..t...... ./ 2026-02-26 17:06:40.701136 | controller | changed: .d..t...... ./ 2026-02-26 17:06:40.728619 | 2026-02-26 17:06:40.728723 | TASK [Return artifact to Zuul] 2026-02-26 17:06:40.757028 | controller | ok 2026-02-26 17:06:40.775974 | 2026-02-26 17:06:40.776032 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2026-02-26 17:06:40.776144 | 2026-02-26 17:06:40.776172 | PLAY RECAP 2026-02-26 17:06:40.776211 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2026-02-26 17:06:40.776233 | 2026-02-26 17:06:40.858749 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-26 17:06:40.859485 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-26 17:06:41.355005 | 2026-02-26 17:06:41.355102 | PLAY [all] 2026-02-26 17:06:41.373202 | 2026-02-26 17:06:41.373286 | TASK [include_role : fetch-output] 2026-02-26 17:06:41.401462 | controller | ok 2026-02-26 17:06:41.417812 | 2026-02-26 17:06:41.417892 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-26 17:06:41.461860 | controller | skipping: Conditional result was False 2026-02-26 17:06:41.467386 | 2026-02-26 17:06:41.467455 | TASK [fetch-output : Set log path for single node] 2026-02-26 17:06:41.495779 | controller | ok 2026-02-26 17:06:41.500585 | 2026-02-26 17:06:41.500654 | LOOP [fetch-output : Ensure local output dirs] 2026-02-26 17:06:41.818466 | controller -> localhost | ok: "/var/lib/zuul/builds/685d343c8f124555be0d56023affbe1d/work/logs" 2026-02-26 17:06:41.998127 | controller -> localhost | ok: "/var/lib/zuul/builds/685d343c8f124555be0d56023affbe1d/work/artifacts" 2026-02-26 17:06:42.178367 | controller -> localhost | ok: "/var/lib/zuul/builds/685d343c8f124555be0d56023affbe1d/work/docs" 2026-02-26 17:06:42.191448 | 2026-02-26 17:06:42.191554 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-26 17:06:42.796092 | controller | ok 2026-02-26 17:06:42.796371 | controller | ok: All items complete 2026-02-26 17:06:42.796420 | 2026-02-26 17:06:43.269806 | controller | ok 2026-02-26 17:06:43.733790 | controller | ok 2026-02-26 17:06:43.745332 | 2026-02-26 17:06:43.745427 | TASK [include_role : fetch-output-openshift] 2026-02-26 17:06:43.758323 | controller | skipping: Conditional result was False 2026-02-26 17:06:43.763700 | 2026-02-26 17:06:43.763764 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-02-26 17:06:44.093933 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.005989 2026-02-26 17:06:44.281023 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006058 2026-02-26 17:06:44.307075 | 2026-02-26 17:06:44.307135 | PLAY [all] 2026-02-26 17:06:44.322055 | 2026-02-26 17:06:44.322173 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-02-26 17:06:44.808691 | controller | changed 2026-02-26 17:06:44.830146 | 2026-02-26 17:06:44.830199 | PLAY RECAP 2026-02-26 17:06:44.830243 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-02-26 17:06:44.830266 | 2026-02-26 17:06:44.895261 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-26 17:06:44.895967 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2026-02-26 17:06:45.431072 | 2026-02-26 17:06:45.431191 | PLAY [localhost] 2026-02-26 17:06:45.448403 | 2026-02-26 17:06:45.448479 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-02-26 17:06:45.749094 | localhost | changed 2026-02-26 17:06:45.753456 | 2026-02-26 17:06:45.753542 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-02-26 17:06:45.770963 | localhost | ok 2026-02-26 17:06:45.778440 | 2026-02-26 17:06:45.778511 | TASK [add-fileserver : Create SSH private key tempfile] 2026-02-26 17:06:46.069067 | localhost | changed 2026-02-26 17:06:46.074515 | 2026-02-26 17:06:46.074587 | TASK [add-fileserver : Create SSH private key from secret] 2026-02-26 17:06:46.608648 | localhost | changed 2026-02-26 17:06:46.613331 | 2026-02-26 17:06:46.613395 | TASK [add-fileserver : Add fileserver ssh key] 2026-02-26 17:06:46.953852 | localhost | Identity added: /var/lib/zuul/builds/685d343c8f124555be0d56023affbe1d/work/tmp/ansible.6qmoy9u0 (/var/lib/zuul/builds/685d343c8f124555be0d56023affbe1d/work/tmp/ansible.6qmoy9u0) 2026-02-26 17:06:46.954011 | localhost | ok: Runtime: 0:00:00.005575 2026-02-26 17:06:46.958277 | 2026-02-26 17:06:46.958368 | TASK [add-fileserver : Remove SSH private key from disk] 2026-02-26 17:06:47.168099 | localhost | ok: Runtime: 0:00:00.003888 2026-02-26 17:06:47.172528 | 2026-02-26 17:06:47.172594 | TASK [add-fileserver : Add fileserver to inventory] 2026-02-26 17:06:47.220219 | localhost | changed 2026-02-26 17:06:47.224978 | 2026-02-26 17:06:47.225047 | TASK [add-fileserver : Add fileserver server to known hosts] 2026-02-26 17:06:47.525711 | localhost | changed 2026-02-26 17:06:47.544641 | 2026-02-26 17:06:47.544726 | PLAY [localhost] 2026-02-26 17:06:47.555746 | 2026-02-26 17:06:47.555809 | TASK [Generate bulk log download script] 2026-02-26 17:06:47.573865 | localhost | ok 2026-02-26 17:06:47.584894 | 2026-02-26 17:06:47.584968 | TASK [local-log-download : Check API endpoint is defined] 2026-02-26 17:06:47.611714 | localhost | ok: All assertions passed 2026-02-26 17:06:47.616000 | 2026-02-26 17:06:47.616065 | TASK [local-log-download : Create download script] 2026-02-26 17:06:47.952503 | localhost -> localhost | changed 2026-02-26 17:06:47.960984 | 2026-02-26 17:06:47.961065 | TASK [Register quick-download link] 2026-02-26 17:06:47.977772 | localhost | ok 2026-02-26 17:06:48.014510 | 2026-02-26 17:06:48.014576 | PLAY [logserver.rdoproject.org] 2026-02-26 17:06:48.023615 | 2026-02-26 17:06:48.023687 | TASK [Set zuul-log-path fact] 2026-02-26 17:06:48.039259 | logserver.rdoproject.org | ok 2026-02-26 17:06:48.047737 | 2026-02-26 17:06:48.047803 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-26 17:06:48.073606 | logserver.rdoproject.org | ok 2026-02-26 17:06:48.078717 | 2026-02-26 17:06:48.078782 | TASK [upload-logs : Create log directories] 2026-02-26 17:06:49.962177 | logserver.rdoproject.org | changed 2026-02-26 17:06:49.965182 | 2026-02-26 17:06:49.965246 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-02-26 17:06:50.181773 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.004799 2026-02-26 17:06:50.186085 | 2026-02-26 17:06:50.186158 | TASK [upload-logs : Upload logs to log server] 2026-02-26 17:06:51.722840 | logserver.rdoproject.org | Output suppressed because no_log was given 2026-02-26 17:06:51.725785 | 2026-02-26 17:06:51.725851 | LOOP [upload-logs : Compress console log and json output] 2026-02-26 17:06:51.762725 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-26 17:06:51.770876 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-26 17:06:51.783761 | 2026-02-26 17:06:51.783843 | LOOP [upload-logs : Upload compressed console log and json output] 2026-02-26 17:06:51.817597 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-26 17:06:51.817893 | 2026-02-26 17:06:51.821049 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-26 17:06:51.831827 | 2026-02-26 17:06:51.831913 | LOOP [upload-logs : Upload console log and json output]