2026-02-25 13:03:38.695580 | Job console starting... 2026-02-25 13:03:38.911351 | Updating repositories 2026-02-25 13:03:40.602107 | Preparing job workspace 2026-02-25 13:03:47.454815 | Running Ansible setup... 2026-02-25 13:03:50.905796 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-25 13:03:51.368269 | 2026-02-25 13:03:51.368384 | PLAY [localhost] 2026-02-25 13:03:51.376580 | 2026-02-25 13:03:51.376653 | TASK [Gathering Facts] 2026-02-25 13:03:52.110767 | localhost | ok 2026-02-25 13:03:52.122691 | 2026-02-25 13:03:52.122766 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-02-25 13:03:52.409380 | localhost -> localhost | changed 2026-02-25 13:03:52.414325 | 2026-02-25 13:03:52.414413 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-02-25 13:03:53.044266 | localhost -> localhost | changed 2026-02-25 13:03:53.052000 | 2026-02-25 13:03:53.052073 | TASK [Setup log path fact] 2026-02-25 13:03:53.068652 | localhost | ok 2026-02-25 13:03:53.078760 | 2026-02-25 13:03:53.078827 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-25 13:03:53.096057 | localhost | ok 2026-02-25 13:03:53.102692 | 2026-02-25 13:03:53.102755 | TASK [emit-job-header : Print job information] 2026-02-25 13:03:53.129101 | # Job Information 2026-02-25 13:03:53.129209 | Ansible Version: 2.15.12 2026-02-25 13:03:53.129238 | Job: cifmw-molecule-reproducer 2026-02-25 13:03:53.129259 | Pipeline: github-check 2026-02-25 13:03:53.129278 | Executor: ibm-bm4-ze.softwarefactory-project.io 2026-02-25 13:03:53.129311 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3678 2026-02-25 13:03:53.129338 | Log URL (when completed): https://logserver.rdoproject.org/2e9/rdoproject.org/2e99f4167fff487691e9cb99720f2061/ 2026-02-25 13:03:53.129359 | Event ID: 43f5d420-124a-11f1-9b12-b4432c362e41 2026-02-25 13:03:53.132742 | 2026-02-25 13:03:53.132806 | LOOP [emit-job-header : Print node information] 2026-02-25 13:03:53.212310 | localhost | ok: 2026-02-25 13:03:53.212492 | localhost | # Node Information 2026-02-25 13:03:53.212522 | localhost | Inventory Hostname: controller 2026-02-25 13:03:53.212546 | localhost | Hostname: np0005629450 2026-02-25 13:03:53.212566 | localhost | Username: zuul 2026-02-25 13:03:53.212586 | localhost | Distro: CentOS 9 2026-02-25 13:03:53.212605 | localhost | Provider: ibm-bm4-nodepool 2026-02-25 13:03:53.212624 | localhost | Region: regionOne 2026-02-25 13:03:53.212641 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2026-02-25 13:03:53.212659 | localhost | Product Name: OpenStack Compute 2026-02-25 13:03:53.212682 | localhost | Interface IP: 192.168.26.102 2026-02-25 13:03:53.233831 | 2026-02-25 13:03:53.233896 | PLAY [all] 2026-02-25 13:03:53.239748 | 2026-02-25 13:03:53.239808 | TASK [Gather network facts] 2026-02-25 13:03:53.686002 | controller | ok 2026-02-25 13:03:53.698955 | 2026-02-25 13:03:53.699013 | TASK [include_role : start-zuul-console] 2026-02-25 13:03:53.716493 | controller | ok 2026-02-25 13:03:53.726581 | 2026-02-25 13:03:53.726640 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-02-25 13:03:54.090106 | controller | ok 2026-02-25 13:03:54.097521 | 2026-02-25 13:03:54.097577 | TASK [include_role : add-build-sshkey] 2026-02-25 13:03:54.114248 | controller | ok 2026-02-25 13:03:54.125581 | 2026-02-25 13:03:54.125641 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-02-25 13:03:54.300494 | controller -> localhost | ok 2026-02-25 13:03:54.305588 | 2026-02-25 13:03:54.305649 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-02-25 13:03:54.323844 | controller | ok 2026-02-25 13:03:54.335140 | controller | included: /var/lib/zuul/builds/2e99f4167fff487691e9cb99720f2061/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-02-25 13:03:54.340184 | 2026-02-25 13:03:54.340243 | TASK [add-build-sshkey : Create Temp SSH key] 2026-02-25 13:03:54.728441 | controller -> localhost | Generating public/private rsa key pair. 2026-02-25 13:03:54.728630 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/2e99f4167fff487691e9cb99720f2061/work/2e99f4167fff487691e9cb99720f2061_id_rsa. 2026-02-25 13:03:54.728666 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/2e99f4167fff487691e9cb99720f2061/work/2e99f4167fff487691e9cb99720f2061_id_rsa.pub. 2026-02-25 13:03:54.728704 | controller -> localhost | The key fingerprint is: 2026-02-25 13:03:54.728727 | controller -> localhost | SHA256:NeC0y8HtX/fL1nS917v2ebNI3CtIIDnoMzCZzf4XdEU zuul-build-sshkey 2026-02-25 13:03:54.728748 | controller -> localhost | The key's randomart image is: 2026-02-25 13:03:54.728768 | controller -> localhost | +---[RSA 3072]----+ 2026-02-25 13:03:54.728788 | controller -> localhost | | o .E | 2026-02-25 13:03:54.728808 | controller -> localhost | | + + . | 2026-02-25 13:03:54.728830 | controller -> localhost | | = . * + . | 2026-02-25 13:03:54.728850 | controller -> localhost | | = + = B o | 2026-02-25 13:03:54.728869 | controller -> localhost | | = S + . o| 2026-02-25 13:03:54.728889 | controller -> localhost | | = . o....=| 2026-02-25 13:03:54.728908 | controller -> localhost | | + o oo o*| 2026-02-25 13:03:54.728929 | controller -> localhost | | . . ...o=O| 2026-02-25 13:03:54.728950 | controller -> localhost | | . .+OX| 2026-02-25 13:03:54.728968 | controller -> localhost | +----[SHA256]-----+ 2026-02-25 13:03:54.729015 | controller -> localhost | ok: Runtime: 0:00:00.095799 2026-02-25 13:03:54.734523 | 2026-02-25 13:03:54.734585 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-02-25 13:03:54.752072 | controller | ok 2026-02-25 13:03:54.760632 | controller | included: /var/lib/zuul/builds/2e99f4167fff487691e9cb99720f2061/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-02-25 13:03:54.767775 | 2026-02-25 13:03:54.767834 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-02-25 13:03:54.781107 | controller | skipping: Conditional result was False 2026-02-25 13:03:54.786072 | 2026-02-25 13:03:54.786132 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-02-25 13:03:55.241881 | controller | changed 2026-02-25 13:03:55.246500 | 2026-02-25 13:03:55.246557 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-02-25 13:03:55.507470 | controller | ok 2026-02-25 13:03:55.512056 | 2026-02-25 13:03:55.512131 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-02-25 13:03:56.637724 | controller | changed 2026-02-25 13:03:56.642318 | 2026-02-25 13:03:56.642382 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-02-25 13:03:57.757253 | controller | changed 2026-02-25 13:03:57.761729 | 2026-02-25 13:03:57.761789 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-02-25 13:03:57.776238 | controller | skipping: Conditional result was False 2026-02-25 13:03:57.781775 | 2026-02-25 13:03:57.781837 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-02-25 13:03:58.078838 | controller -> localhost | changed 2026-02-25 13:03:58.088041 | 2026-02-25 13:03:58.088112 | TASK [add-build-sshkey : Add back temp key] 2026-02-25 13:03:58.314853 | controller -> localhost | Identity added: /var/lib/zuul/builds/2e99f4167fff487691e9cb99720f2061/work/2e99f4167fff487691e9cb99720f2061_id_rsa (zuul-build-sshkey) 2026-02-25 13:03:58.315063 | controller -> localhost | ok: Runtime: 0:00:00.009094 2026-02-25 13:03:58.320884 | 2026-02-25 13:03:58.320965 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-02-25 13:03:58.665393 | controller | ok 2026-02-25 13:03:58.669382 | 2026-02-25 13:03:58.669442 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-02-25 13:03:58.693320 | controller | skipping: Conditional result was False 2026-02-25 13:03:58.701613 | 2026-02-25 13:03:58.701672 | TASK [include_role : validate-host] 2026-02-25 13:03:58.718955 | controller | ok 2026-02-25 13:03:58.735812 | 2026-02-25 13:03:58.735874 | TASK [validate-host : Define zuul_info_dir fact] 2026-02-25 13:03:58.763470 | controller | ok 2026-02-25 13:03:58.767550 | 2026-02-25 13:03:58.767608 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-02-25 13:03:58.973116 | controller -> localhost | ok 2026-02-25 13:03:58.978458 | 2026-02-25 13:03:58.978517 | TASK [validate-host : Collect information about the host] 2026-02-25 13:03:59.679368 | controller | ok 2026-02-25 13:03:59.686962 | 2026-02-25 13:03:59.687024 | TASK [validate-host : Sanitize hostname] 2026-02-25 13:03:59.746265 | controller | ok 2026-02-25 13:03:59.751317 | 2026-02-25 13:03:59.751388 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-02-25 13:04:00.132748 | controller -> localhost | changed 2026-02-25 13:04:00.138382 | 2026-02-25 13:04:00.138453 | TASK [validate-host : Collect information about zuul worker] 2026-02-25 13:04:00.555017 | controller | ok 2026-02-25 13:04:00.560091 | 2026-02-25 13:04:00.560170 | TASK [validate-host : Write out all zuul information for each host] 2026-02-25 13:04:00.907925 | controller -> localhost | changed 2026-02-25 13:04:00.918020 | 2026-02-25 13:04:00.918096 | TASK [include_role : prepare-workspace-openshift] 2026-02-25 13:04:00.933387 | controller | skipping: Conditional result was False 2026-02-25 13:04:00.939342 | 2026-02-25 13:04:00.939409 | TASK [include_role : remove-zuul-sshkey] 2026-02-25 13:04:00.953630 | controller | skipping: Conditional result was False 2026-02-25 13:04:00.959581 | 2026-02-25 13:04:00.959647 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-02-25 13:04:01.217975 | controller | ok: "logs" 2026-02-25 13:04:01.218234 | controller | ok: All items complete 2026-02-25 13:04:01.218264 | 2026-02-25 13:04:01.460452 | controller | ok: "artifacts" 2026-02-25 13:04:01.691359 | controller | ok: "docs" 2026-02-25 13:04:01.702033 | 2026-02-25 13:04:01.702101 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-02-25 13:04:01.969887 | controller | changed: "logs" 2026-02-25 13:04:02.223359 | controller | changed: "artifacts" 2026-02-25 13:04:02.464318 | controller | changed: "docs" 2026-02-25 13:04:02.490807 | 2026-02-25 13:04:02.490863 | PLAY RECAP 2026-02-25 13:04:02.490906 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-25 13:04:02.490944 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-25 13:04:02.490965 | 2026-02-25 13:04:02.564437 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-25 13:04:02.565185 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-25 13:04:03.074376 | 2026-02-25 13:04:03.074475 | PLAY [all] 2026-02-25 13:04:03.093847 | 2026-02-25 13:04:03.093922 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-25 13:04:03.143488 | controller | ok 2026-02-25 13:04:03.148420 | 2026-02-25 13:04:03.148503 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-25 13:04:03.542797 | controller | changed 2026-02-25 13:04:03.548395 | 2026-02-25 13:04:03.548475 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-25 13:04:04.817934 | controller | changed 2026-02-25 13:04:04.828154 | 2026-02-25 13:04:04.828230 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2026-02-25 13:04:05.249879 | controller | changed: 2026-02-25 13:04:05.250259 | controller | { 2026-02-25 13:04:05.250320 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2026-02-25 13:04:05.250367 | controller | } 2026-02-25 13:04:05.536266 | controller | changed: 2026-02-25 13:04:05.536402 | controller | { 2026-02-25 13:04:05.536430 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2026-02-25 13:04:05.536451 | controller | } 2026-02-25 13:04:05.835345 | controller | changed: 2026-02-25 13:04:05.835434 | controller | { 2026-02-25 13:04:05.835461 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2026-02-25 13:04:05.835482 | controller | } 2026-02-25 13:04:06.139944 | controller | changed: 2026-02-25 13:04:06.140009 | controller | { 2026-02-25 13:04:06.140034 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2026-02-25 13:04:06.140054 | controller | } 2026-02-25 13:04:06.417340 | controller | changed: 2026-02-25 13:04:06.417405 | controller | { 2026-02-25 13:04:06.417430 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2026-02-25 13:04:06.417450 | controller | } 2026-02-25 13:04:06.701556 | controller | changed: 2026-02-25 13:04:06.701629 | controller | { 2026-02-25 13:04:06.701656 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2026-02-25 13:04:06.701677 | controller | } 2026-02-25 13:04:06.982313 | controller | changed: 2026-02-25 13:04:06.982395 | controller | { 2026-02-25 13:04:06.982420 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2026-02-25 13:04:06.982441 | controller | } 2026-02-25 13:04:07.259456 | controller | changed: 2026-02-25 13:04:07.259673 | controller | { 2026-02-25 13:04:07.259715 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2026-02-25 13:04:07.259739 | controller | } 2026-02-25 13:04:07.538164 | controller | changed: 2026-02-25 13:04:07.538434 | controller | { 2026-02-25 13:04:07.538462 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2026-02-25 13:04:07.538483 | controller | } 2026-02-25 13:04:07.885291 | controller | changed: 2026-02-25 13:04:07.885438 | controller | { 2026-02-25 13:04:07.885465 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2026-02-25 13:04:07.885486 | controller | } 2026-02-25 13:04:08.128850 | controller | changed: 2026-02-25 13:04:08.129070 | controller | { 2026-02-25 13:04:08.129098 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2026-02-25 13:04:08.129120 | controller | } 2026-02-25 13:04:08.413899 | controller | changed: 2026-02-25 13:04:08.414132 | controller | { 2026-02-25 13:04:08.414160 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2026-02-25 13:04:08.414183 | controller | } 2026-02-25 13:04:08.694737 | controller | changed: 2026-02-25 13:04:08.694930 | controller | { 2026-02-25 13:04:08.694956 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com" 2026-02-25 13:04:08.694983 | controller | } 2026-02-25 13:04:08.982219 | controller | changed: 2026-02-25 13:04:08.982334 | controller | { 2026-02-25 13:04:08.982361 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2026-02-25 13:04:08.982382 | controller | } 2026-02-25 13:04:09.271838 | controller | changed: 2026-02-25 13:04:09.272021 | controller | { 2026-02-25 13:04:09.272045 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2026-02-25 13:04:09.272065 | controller | } 2026-02-25 13:04:09.558741 | controller | changed: 2026-02-25 13:04:09.558868 | controller | { 2026-02-25 13:04:09.558894 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2026-02-25 13:04:09.558913 | controller | } 2026-02-25 13:04:09.850477 | controller | changed: 2026-02-25 13:04:09.850658 | controller | { 2026-02-25 13:04:09.850698 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2026-02-25 13:04:09.850721 | controller | } 2026-02-25 13:04:10.134445 | controller | changed: 2026-02-25 13:04:10.134562 | controller | { 2026-02-25 13:04:10.134590 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2026-02-25 13:04:10.134627 | controller | } 2026-02-25 13:04:10.424920 | controller | changed: 2026-02-25 13:04:10.425073 | controller | { 2026-02-25 13:04:10.425099 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2026-02-25 13:04:10.425118 | controller | } 2026-02-25 13:04:10.711037 | controller | changed: 2026-02-25 13:04:10.711176 | controller | { 2026-02-25 13:04:10.711200 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2026-02-25 13:04:10.711219 | controller | } 2026-02-25 13:04:10.995897 | controller | changed: 2026-02-25 13:04:10.996067 | controller | { 2026-02-25 13:04:10.996095 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2026-02-25 13:04:10.996114 | controller | } 2026-02-25 13:04:11.286254 | controller | changed: 2026-02-25 13:04:11.286480 | controller | { 2026-02-25 13:04:11.286511 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2026-02-25 13:04:11.286532 | controller | } 2026-02-25 13:04:11.580520 | controller | changed: 2026-02-25 13:04:11.580917 | controller | { 2026-02-25 13:04:11.580970 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2026-02-25 13:04:11.580993 | controller | } 2026-02-25 13:04:11.874155 | controller | changed: 2026-02-25 13:04:11.874274 | controller | { 2026-02-25 13:04:11.874322 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2026-02-25 13:04:11.874348 | controller | } 2026-02-25 13:04:12.181646 | controller | changed: 2026-02-25 13:04:12.181709 | controller | { 2026-02-25 13:04:12.181736 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2026-02-25 13:04:12.181756 | controller | } 2026-02-25 13:04:12.479606 | controller | changed: 2026-02-25 13:04:12.479698 | controller | { 2026-02-25 13:04:12.479724 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2026-02-25 13:04:12.479743 | controller | } 2026-02-25 13:04:12.501521 | 2026-02-25 13:04:12.501591 | TASK [Set timezone to UTC] 2026-02-25 13:04:14.055263 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2026-02-25 13:04:14.060774 | 2026-02-25 13:04:14.060841 | TASK [Create nodepool directory] 2026-02-25 13:04:14.333758 | controller | changed 2026-02-25 13:04:14.338867 | 2026-02-25 13:04:14.338931 | TASK [Create nodepool sub_nodes file] 2026-02-25 13:04:15.355156 | controller | changed 2026-02-25 13:04:15.359861 | 2026-02-25 13:04:15.359927 | TASK [Create nodepool sub_nodes_private file] 2026-02-25 13:04:16.383494 | controller | changed 2026-02-25 13:04:16.388268 | 2026-02-25 13:04:16.388348 | LOOP [Populate nodepool sub_nodes file] 2026-02-25 13:04:16.416464 | 2026-02-25 13:04:16.416593 | LOOP [Populate nodepool sub_nodes_private file] 2026-02-25 13:04:16.444499 | 2026-02-25 13:04:16.444627 | TASK [Create nodepool primary file] 2026-02-25 13:04:16.467348 | controller | skipping: Conditional result was False 2026-02-25 13:04:16.472693 | 2026-02-25 13:04:16.472772 | TASK [Create nodepool node_private for this node] 2026-02-25 13:04:17.499911 | controller | changed 2026-02-25 13:04:17.505217 | 2026-02-25 13:04:17.505280 | LOOP [Copy ssh keys to nodepool directory] 2026-02-25 13:04:17.875016 | controller | ok: Item: id_rsa Runtime: 0:00:00.004642 2026-02-25 13:04:17.875176 | 2026-02-25 13:04:18.101310 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.004744 2026-02-25 13:04:18.112762 | 2026-02-25 13:04:18.112827 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2026-02-25 13:04:19.188818 | controller | changed 2026-02-25 13:04:19.193455 | 2026-02-25 13:04:19.193519 | TASK [Validate sudoers config after edits] 2026-02-25 13:04:19.476237 | controller | /etc/sudoers: parsed OK 2026-02-25 13:04:19.476297 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2026-02-25 13:04:19.476305 | controller | /etc/sudoers.d/zuul: parsed OK 2026-02-25 13:04:19.476311 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2026-02-25 13:04:19.717752 | controller | ok: Runtime: 0:00:00.006738 2026-02-25 13:04:19.722701 | 2026-02-25 13:04:19.722758 | TASK [Show the environment passed in to job shell scripts] 2026-02-25 13:04:19.997897 | controller | SHELL=/bin/bash 2026-02-25 13:04:19.997956 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2026-02-25 13:04:19.997966 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2026-02-25 13:04:19.997974 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/78/3678/94dc1b7a74bfc86eea515d4091fec5f6f9176cd4 2026-02-25 13:04:19.997984 | controller | PWD=/home/zuul 2026-02-25 13:04:19.997999 | controller | ZUUL_PIPELINE=github-check 2026-02-25 13:04:19.998063 | controller | LOGNAME=zuul 2026-02-25 13:04:19.998073 | controller | XDG_SESSION_TYPE=tty 2026-02-25 13:04:19.998079 | controller | _=/usr/bin/env 2026-02-25 13:04:19.998084 | controller | MOTD_SHOWN=pam 2026-02-25 13:04:19.998089 | controller | HOME=/home/zuul 2026-02-25 13:04:19.998094 | controller | LANG=en_US.UTF-8 2026-02-25 13:04:19.998098 | controller | SSH_CONNECTION=192.168.26.12 37786 192.168.26.102 22 2026-02-25 13:04:19.998104 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2026-02-25 13:04:19.998114 | controller | ZUUL_CHANGE_IDS=3678,94dc1b7a74bfc86eea515d4091fec5f6f9176cd4 2026-02-25 13:04:19.998119 | controller | WORKSPACE=/home/zuul/workspace 2026-02-25 13:04:19.998125 | controller | XDG_SESSION_CLASS=user 2026-02-25 13:04:19.998130 | controller | SELINUX_ROLE_REQUESTED= 2026-02-25 13:04:19.998135 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2026-02-25 13:04:19.998140 | controller | USER=zuul 2026-02-25 13:04:19.998146 | controller | ZUUL_VOTING=True 2026-02-25 13:04:19.998150 | controller | BUILD_TIMEOUT=5400000 2026-02-25 13:04:19.998156 | controller | SELINUX_USE_CURRENT_RANGE= 2026-02-25 13:04:19.998161 | controller | SHLVL=1 2026-02-25 13:04:19.998166 | controller | ZUUL_PATCHSET=94dc1b7a74bfc86eea515d4091fec5f6f9176cd4 2026-02-25 13:04:19.998171 | controller | XDG_SESSION_ID=1 2026-02-25 13:04:19.998176 | controller | ZUUL_BRANCH=main 2026-02-25 13:04:19.998182 | controller | XDG_RUNTIME_DIR=/run/user/1000 2026-02-25 13:04:19.998187 | controller | SSH_CLIENT=192.168.26.12 37786 22 2026-02-25 13:04:19.998192 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2026-02-25 13:04:19.998197 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2026-02-25 13:04:19.998202 | controller | which_declare=declare -f 2026-02-25 13:04:19.998208 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2026-02-25 13:04:19.998214 | controller | SELINUX_LEVEL_REQUESTED= 2026-02-25 13:04:19.998219 | controller | ZUUL_CHANGE=3678 2026-02-25 13:04:19.998223 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2026-02-25 13:04:19.998228 | controller | ZUUL_UUID=2e99f4167fff487691e9cb99720f2061 2026-02-25 13:04:19.998233 | controller | BASH_FUNC_which%%=() { ( alias; 2026-02-25 13:04:19.998238 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2026-02-25 13:04:19.998244 | controller | } 2026-02-25 13:04:20.251426 | controller | ok: Runtime: 0:00:00.007404 2026-02-25 13:04:20.256481 | 2026-02-25 13:04:20.256539 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2026-02-25 13:04:20.269360 | controller | skipping: Conditional result was False 2026-02-25 13:04:20.273944 | 2026-02-25 13:04:20.274002 | TASK [Symlink /home/zuul-worker/workspace] 2026-02-25 13:04:20.815940 | controller | skipping: Conditional result was False 2026-02-25 13:04:20.821327 | 2026-02-25 13:04:20.821388 | TASK [Ensure legacy workspace directory] 2026-02-25 13:04:21.082493 | controller | changed 2026-02-25 13:04:21.099363 | 2026-02-25 13:04:21.099412 | PLAY RECAP 2026-02-25 13:04:21.099455 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-25 13:04:21.099477 | 2026-02-25 13:04:21.175040 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-25 13:04:21.175751 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-25 13:04:21.638475 | 2026-02-25 13:04:21.638605 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2026-02-25 13:04:21.656736 | 2026-02-25 13:04:21.656807 | TASK [Create zuul-output directory] 2026-02-25 13:04:22.031138 | controller | changed 2026-02-25 13:04:22.035580 | 2026-02-25 13:04:22.035646 | TASK [Slurp Zuul inventory test] 2026-02-25 13:04:22.282996 | controller -> localhost | ok 2026-02-25 13:04:22.288784 | 2026-02-25 13:04:22.288843 | TASK [Save zuul inventory] 2026-02-25 13:04:23.570000 | controller | changed 2026-02-25 13:04:23.575212 | 2026-02-25 13:04:23.575276 | TASK [Save zuul vars without the change_message] 2026-02-25 13:04:24.676723 | controller | changed 2026-02-25 13:04:24.695387 | 2026-02-25 13:04:24.695457 | PLAY RECAP 2026-02-25 13:04:24.695502 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-25 13:04:24.695525 | 2026-02-25 13:04:24.760763 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-25 13:04:24.761468 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-25 13:04:25.288019 | 2026-02-25 13:04:25.288140 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2026-02-25 13:04:25.308308 | 2026-02-25 13:04:25.308381 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2026-02-25 13:04:25.326776 | controller | ok 2026-02-25 13:04:25.343154 | 2026-02-25 13:04:25.343234 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-25 13:04:25.366264 | controller | skipping: Conditional result was False 2026-02-25 13:04:25.371866 | 2026-02-25 13:04:25.371936 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-25 13:04:25.763798 | controller | ok 2026-02-25 13:04:25.769529 | 2026-02-25 13:04:25.769615 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-25 13:04:26.773287 | controller | ok 2026-02-25 13:04:26.782288 | 2026-02-25 13:04:26.782369 | TASK [Prepare workspace] 2026-02-25 13:04:26.799771 | controller | ok 2026-02-25 13:04:26.815796 | 2026-02-25 13:04:26.815863 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-02-25 13:04:27.189659 | controller | ok 2026-02-25 13:04:27.195327 | 2026-02-25 13:04:27.195392 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-02-25 13:04:29.668884 | controller | Output suppressed because no_log was given 2026-02-25 13:04:29.677790 | 2026-02-25 13:04:29.677861 | LOOP [Create zuul-output directory] 2026-02-25 13:04:29.951103 | controller | changed: "/home/zuul/ci-framework-data/logs" 2026-02-25 13:04:30.180510 | controller | ok: "/home/zuul/zuul-output/logs" 2026-02-25 13:04:30.188168 | 2026-02-25 13:04:30.188350 | TASK [Install required packages] 2026-02-25 13:04:54.445798 | controller | ok: Nothing to do 2026-02-25 13:04:54.450358 | 2026-02-25 13:04:54.450417 | TASK [Install venv] 2026-02-25 13:05:49.968526 | controller | changed 2026-02-25 13:05:50.012468 | 2026-02-25 13:05:50.012556 | PLAY RECAP 2026-02-25 13:05:50.012606 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-02-25 13:05:50.012627 | 2026-02-25 13:05:50.071060 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-25 13:05:50.072498 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-25 13:05:50.544818 | 2026-02-25 13:05:50.544908 | PLAY [Run ci/playbooks/molecule-test.yml] 2026-02-25 13:05:50.563937 | 2026-02-25 13:05:50.564003 | TASK [Gather required facts] 2026-02-25 13:05:51.082556 | controller | ok 2026-02-25 13:05:51.087784 | 2026-02-25 13:05:51.087861 | TASK [Load environment var if instructed to] 2026-02-25 13:05:51.112069 | controller | skipping: Conditional result was False 2026-02-25 13:05:51.117020 | 2026-02-25 13:05:51.117080 | TASK [Ensure group_vars dir exists] 2026-02-25 13:05:51.471255 | controller | ok 2026-02-25 13:05:51.476259 | 2026-02-25 13:05:51.476341 | TASK [Print related variables] 2026-02-25 13:05:51.504821 | controller | ok: 2026-02-25 13:05:51.504923 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2026-02-25 13:05:51.504951 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2026-02-25 13:05:51.509192 | 2026-02-25 13:05:51.509251 | TASK [Run molecule] 2026-02-25 13:05:52.504993 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2026-02-25 13:05:52.781192 | controller | INFO Performing prerun with role_name_check=0... 2026-02-25 13:06:09.576130 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 13:06:09.576519 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 13:06:09.577551 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 13:06:09.577927 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 13:06:09.577959 | controller | WARNING Another version of 'cifmw.general' 1.0.0+94dc1b7a was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+94dc1b7a (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 13:06:09.578369 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 13:06:09.578814 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 13:06:09.579261 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 13:06:09.579652 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 13:06:09.580098 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 13:06:09.580513 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 13:06:09.580944 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 13:06:09.581372 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 13:06:09.581811 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 13:06:09.582247 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-25 13:06:09.592302 | controller | INFO Running crc_layout > prepare 2026-02-25 13:06:10.304108 | controller | 2026-02-25 13:06:10.304193 | controller | PLAY [Prepare] ***************************************************************** 2026-02-25 13:06:10.304295 | controller | 2026-02-25 13:06:10.304390 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-25 13:06:10.304475 | controller | Wednesday 25 February 2026 13:06:10 +0000 (0:00:00.029) 0:00:00.029 **** 2026-02-25 13:06:11.158322 | controller | ok: [instance] 2026-02-25 13:06:11.158390 | controller | 2026-02-25 13:06:11.158525 | controller | TASK [Create custom basedir] *************************************************** 2026-02-25 13:06:11.158619 | controller | Wednesday 25 February 2026 13:06:11 +0000 (0:00:00.854) 0:00:00.884 **** 2026-02-25 13:06:11.487201 | controller | changed: [instance] 2026-02-25 13:06:11.487266 | controller | 2026-02-25 13:06:11.487372 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2026-02-25 13:06:11.487472 | controller | Wednesday 25 February 2026 13:06:11 +0000 (0:00:00.329) 0:00:01.213 **** 2026-02-25 13:06:11.509315 | controller | skipping: [instance] 2026-02-25 13:06:11.509425 | controller | 2026-02-25 13:06:11.509561 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2026-02-25 13:06:11.509692 | controller | Wednesday 25 February 2026 13:06:11 +0000 (0:00:00.022) 0:00:01.235 **** 2026-02-25 13:06:11.555824 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2026-02-25 13:06:11.555990 | controller | 2026-02-25 13:06:11.556184 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2026-02-25 13:06:11.556354 | controller | Wednesday 25 February 2026 13:06:11 +0000 (0:00:00.046) 0:00:01.282 **** 2026-02-25 13:06:11.849107 | controller | ok: [instance] 2026-02-25 13:06:11.849214 | controller | 2026-02-25 13:06:11.849227 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2026-02-25 13:06:11.849306 | controller | Wednesday 25 February 2026 13:06:11 +0000 (0:00:00.293) 0:00:01.575 **** 2026-02-25 13:06:12.072459 | controller | ok: [instance] 2026-02-25 13:06:12.072522 | controller | 2026-02-25 13:06:12.072613 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2026-02-25 13:06:12.072708 | controller | Wednesday 25 February 2026 13:06:12 +0000 (0:00:00.223) 0:00:01.798 **** 2026-02-25 13:06:12.787063 | controller | ok: [instance] => (item=ubi-9-appstream) 2026-02-25 13:06:12.787220 | controller | ok: [instance] => (item=ubi-9-baseos) 2026-02-25 13:06:12.787233 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2026-02-25 13:06:12.787336 | controller | 2026-02-25 13:06:12.787347 | controller | TASK [Deploy repo-setup] ******************************************************* 2026-02-25 13:06:12.787417 | controller | Wednesday 25 February 2026 13:06:12 +0000 (0:00:00.714) 0:00:02.512 **** 2026-02-25 13:06:12.847467 | controller | 2026-02-25 13:06:12.847587 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-25 13:06:12.847812 | controller | Wednesday 25 February 2026 13:06:12 +0000 (0:00:00.060) 0:00:02.573 **** 2026-02-25 13:06:13.386304 | controller | changed: [instance] => (item=tmp) 2026-02-25 13:06:13.386403 | controller | changed: [instance] => (item=artifacts/repositories) 2026-02-25 13:06:13.386417 | controller | changed: [instance] => (item=venv/repo_setup) 2026-02-25 13:06:13.386486 | controller | 2026-02-25 13:06:13.386581 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-25 13:06:13.386689 | controller | Wednesday 25 February 2026 13:06:13 +0000 (0:00:00.538) 0:00:03.112 **** 2026-02-25 13:06:14.247844 | controller | ok: [instance] 2026-02-25 13:06:14.247945 | controller | 2026-02-25 13:06:14.248117 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-25 13:06:14.248171 | controller | Wednesday 25 February 2026 13:06:14 +0000 (0:00:00.861) 0:00:03.974 **** 2026-02-25 13:06:15.365562 | controller | changed: [instance] 2026-02-25 13:06:22.827784 | controller | 2026-02-25 13:06:22.827835 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-25 13:06:22.827844 | controller | Wednesday 25 February 2026 13:06:15 +0000 (0:00:01.117) 0:00:05.091 **** 2026-02-25 13:06:22.827856 | controller | changed: [instance] 2026-02-25 13:06:22.827982 | controller | 2026-02-25 13:06:22.828564 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-25 13:06:22.829592 | controller | Wednesday 25 February 2026 13:06:22 +0000 (0:00:07.458) 0:00:12.549 **** 2026-02-25 13:06:23.538750 | controller | changed: [instance] 2026-02-25 13:06:23.538803 | controller | 2026-02-25 13:06:23.538813 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-25 13:06:23.538980 | controller | Wednesday 25 February 2026 13:06:23 +0000 (0:00:00.715) 0:00:13.264 **** 2026-02-25 13:06:23.565608 | controller | skipping: [instance] 2026-02-25 13:06:24.757826 | controller | 2026-02-25 13:06:24.757883 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-25 13:06:24.757892 | controller | Wednesday 25 February 2026 13:06:23 +0000 (0:00:00.026) 0:00:13.291 **** 2026-02-25 13:06:24.757907 | controller | changed: [instance] 2026-02-25 13:06:24.803411 | controller | 2026-02-25 13:06:24.803463 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-25 13:06:24.803471 | controller | Wednesday 25 February 2026 13:06:24 +0000 (0:00:01.191) 0:00:14.483 **** 2026-02-25 13:06:24.803483 | controller | skipping: [instance] 2026-02-25 13:06:24.845839 | controller | 2026-02-25 13:06:24.845906 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-25 13:06:24.845919 | controller | Wednesday 25 February 2026 13:06:24 +0000 (0:00:00.045) 0:00:14.529 **** 2026-02-25 13:06:24.845938 | controller | skipping: [instance] 2026-02-25 13:06:24.883757 | controller | 2026-02-25 13:06:24.883795 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-25 13:06:24.883808 | controller | Wednesday 25 February 2026 13:06:24 +0000 (0:00:00.042) 0:00:14.571 **** 2026-02-25 13:06:24.883823 | controller | skipping: [instance] 2026-02-25 13:06:25.433426 | controller | 2026-02-25 13:06:25.433452 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-25 13:06:25.433461 | controller | Wednesday 25 February 2026 13:06:24 +0000 (0:00:00.038) 0:00:14.609 **** 2026-02-25 13:06:25.433472 | controller | changed: [instance] 2026-02-25 13:06:25.902822 | controller | 2026-02-25 13:06:25.902901 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-25 13:06:25.902912 | controller | Wednesday 25 February 2026 13:06:25 +0000 (0:00:00.549) 0:00:15.159 **** 2026-02-25 13:06:25.902932 | controller | changed: [instance] 2026-02-25 13:06:25.902989 | controller | 2026-02-25 13:06:25.903121 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-25 13:06:25.903162 | controller | Wednesday 25 February 2026 13:06:25 +0000 (0:00:00.469) 0:00:15.628 **** 2026-02-25 13:06:25.937254 | controller | skipping: [instance] 2026-02-25 13:06:25.968349 | controller | 2026-02-25 13:06:25.968379 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-25 13:06:25.968389 | controller | Wednesday 25 February 2026 13:06:25 +0000 (0:00:00.034) 0:00:15.663 **** 2026-02-25 13:06:25.968402 | controller | skipping: [instance] 2026-02-25 13:06:25.999840 | controller | 2026-02-25 13:06:25.999893 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-25 13:06:25.999905 | controller | Wednesday 25 February 2026 13:06:25 +0000 (0:00:00.030) 0:00:15.694 **** 2026-02-25 13:06:25.999919 | controller | skipping: [instance] 2026-02-25 13:06:25.999953 | controller | 2026-02-25 13:06:25.999964 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-25 13:06:26.000110 | controller | Wednesday 25 February 2026 13:06:25 +0000 (0:00:00.031) 0:00:15.726 **** 2026-02-25 13:06:26.047125 | controller | ok: [instance] 2026-02-25 13:06:26.084815 | controller | 2026-02-25 13:06:26.084847 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-25 13:06:26.084858 | controller | Wednesday 25 February 2026 13:06:26 +0000 (0:00:00.047) 0:00:15.773 **** 2026-02-25 13:06:26.084879 | controller | skipping: [instance] 2026-02-25 13:06:26.118967 | controller | 2026-02-25 13:06:26.118986 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-25 13:06:26.118994 | controller | Wednesday 25 February 2026 13:06:26 +0000 (0:00:00.037) 0:00:15.810 **** 2026-02-25 13:06:26.119005 | controller | skipping: [instance] 2026-02-25 13:06:26.119217 | controller | 2026-02-25 13:06:26.119389 | controller | TASK [Download the RPM] ******************************************************** 2026-02-25 13:06:26.119501 | controller | Wednesday 25 February 2026 13:06:26 +0000 (0:00:00.034) 0:00:15.845 **** 2026-02-25 13:06:26.152900 | controller | skipping: [instance] 2026-02-25 13:06:26.153153 | controller | 2026-02-25 13:06:26.153372 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-25 13:06:26.153579 | controller | Wednesday 25 February 2026 13:06:26 +0000 (0:00:00.033) 0:00:15.879 **** 2026-02-25 13:06:26.188161 | controller | skipping: [instance] 2026-02-25 13:06:26.188292 | controller | 2026-02-25 13:06:26.188414 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-25 13:06:26.188529 | controller | Wednesday 25 February 2026 13:06:26 +0000 (0:00:00.035) 0:00:15.914 **** 2026-02-25 13:06:26.221104 | controller | skipping: [instance] 2026-02-25 13:06:26.221315 | controller | 2026-02-25 13:06:26.221512 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-25 13:06:26.221619 | controller | Wednesday 25 February 2026 13:06:26 +0000 (0:00:00.032) 0:00:15.947 **** 2026-02-25 13:06:26.254515 | controller | skipping: [instance] 2026-02-25 13:06:26.254629 | controller | 2026-02-25 13:06:26.254830 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-25 13:06:26.254951 | controller | Wednesday 25 February 2026 13:06:26 +0000 (0:00:00.033) 0:00:15.980 **** 2026-02-25 13:06:26.286502 | controller | skipping: [instance] 2026-02-25 13:06:26.286617 | controller | 2026-02-25 13:06:26.286811 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-25 13:06:26.286922 | controller | Wednesday 25 February 2026 13:06:26 +0000 (0:00:00.032) 0:00:16.013 **** 2026-02-25 13:06:26.497413 | controller | ok: [instance] 2026-02-25 13:06:26.497610 | controller | 2026-02-25 13:06:26.497927 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-25 13:06:26.498062 | controller | Wednesday 25 February 2026 13:06:26 +0000 (0:00:00.210) 0:00:16.223 **** 2026-02-25 13:06:26.724289 | controller | changed: [instance] 2026-02-25 13:06:26.971804 | controller | 2026-02-25 13:06:26.971864 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-25 13:06:26.971874 | controller | Wednesday 25 February 2026 13:06:26 +0000 (0:00:00.226) 0:00:16.450 **** 2026-02-25 13:06:26.971891 | controller | changed: [instance] 2026-02-25 13:06:26.972030 | controller | 2026-02-25 13:06:26.972062 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-25 13:06:26.972075 | controller | Wednesday 25 February 2026 13:06:26 +0000 (0:00:00.247) 0:00:16.697 **** 2026-02-25 13:06:26.995831 | controller | skipping: [instance] 2026-02-25 13:06:27.022417 | controller | 2026-02-25 13:06:27.022446 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-25 13:06:27.022455 | controller | Wednesday 25 February 2026 13:06:26 +0000 (0:00:00.024) 0:00:16.721 **** 2026-02-25 13:06:27.022466 | controller | skipping: [instance] 2026-02-25 13:06:27.048837 | controller | 2026-02-25 13:06:27.048876 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-25 13:06:27.048886 | controller | Wednesday 25 February 2026 13:06:27 +0000 (0:00:00.026) 0:00:16.748 **** 2026-02-25 13:06:27.048898 | controller | skipping: [instance] 2026-02-25 13:06:27.048935 | controller | 2026-02-25 13:06:27.048945 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-25 13:06:27.049122 | controller | Wednesday 25 February 2026 13:06:27 +0000 (0:00:00.026) 0:00:16.775 **** 2026-02-25 13:06:27.072687 | controller | skipping: [instance] 2026-02-25 13:06:27.095991 | controller | 2026-02-25 13:06:27.096022 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-25 13:06:27.096047 | controller | Wednesday 25 February 2026 13:06:27 +0000 (0:00:00.023) 0:00:16.798 **** 2026-02-25 13:06:27.096063 | controller | skipping: [instance] 2026-02-25 13:06:27.096260 | controller | 2026-02-25 13:06:27.096387 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-25 13:06:27.096509 | controller | Wednesday 25 February 2026 13:06:27 +0000 (0:00:00.023) 0:00:16.822 **** 2026-02-25 13:06:27.119402 | controller | skipping: [instance] 2026-02-25 13:06:27.119640 | controller | 2026-02-25 13:06:27.119934 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-25 13:06:27.120209 | controller | Wednesday 25 February 2026 13:06:27 +0000 (0:00:00.023) 0:00:16.845 **** 2026-02-25 13:06:27.137855 | controller | skipping: [instance] 2026-02-25 13:06:27.137987 | controller | 2026-02-25 13:06:27.138131 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-25 13:06:27.138280 | controller | Wednesday 25 February 2026 13:06:27 +0000 (0:00:00.018) 0:00:16.864 **** 2026-02-25 13:06:27.174645 | controller | skipping: [instance] 2026-02-25 13:06:27.174968 | controller | 2026-02-25 13:06:27.175251 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-25 13:06:27.175433 | controller | Wednesday 25 February 2026 13:06:27 +0000 (0:00:00.036) 0:00:16.901 **** 2026-02-25 13:06:27.192941 | controller | skipping: [instance] 2026-02-25 13:06:27.193231 | controller | 2026-02-25 13:06:27.193437 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-25 13:06:27.193557 | controller | Wednesday 25 February 2026 13:06:27 +0000 (0:00:00.018) 0:00:16.919 **** 2026-02-25 13:06:27.213460 | controller | skipping: [instance] 2026-02-25 13:06:27.213768 | controller | 2026-02-25 13:06:27.214033 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2026-02-25 13:06:27.214295 | controller | Wednesday 25 February 2026 13:06:27 +0000 (0:00:00.020) 0:00:16.939 **** 2026-02-25 13:06:27.250449 | controller | skipping: [instance] 2026-02-25 13:06:27.250595 | controller | 2026-02-25 13:06:27.250764 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2026-02-25 13:06:27.250903 | controller | Wednesday 25 February 2026 13:06:27 +0000 (0:00:00.037) 0:00:16.977 **** 2026-02-25 13:06:27.286366 | controller | skipping: [instance] 2026-02-25 13:06:27.286601 | controller | 2026-02-25 13:06:27.286755 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2026-02-25 13:06:27.286880 | controller | Wednesday 25 February 2026 13:06:27 +0000 (0:00:00.035) 0:00:17.012 **** 2026-02-25 13:06:27.318233 | controller | skipping: [instance] 2026-02-25 13:06:27.318500 | controller | 2026-02-25 13:06:27.318721 | controller | TASK [test_deps : Install additional packages] ********************************* 2026-02-25 13:06:27.318857 | controller | Wednesday 25 February 2026 13:06:27 +0000 (0:00:00.031) 0:00:17.044 **** 2026-02-25 13:06:27.351210 | controller | skipping: [instance] 2026-02-25 13:06:27.351374 | controller | 2026-02-25 13:06:27.351526 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2026-02-25 13:06:27.351687 | controller | Wednesday 25 February 2026 13:06:27 +0000 (0:00:00.033) 0:00:17.077 **** 2026-02-25 13:07:07.848807 | controller | ok: [instance] 2026-02-25 13:07:09.100612 | controller | 2026-02-25 13:07:09.100654 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2026-02-25 13:07:09.100662 | controller | Wednesday 25 February 2026 13:07:07 +0000 (0:00:40.496) 0:00:57.574 **** 2026-02-25 13:07:09.100691 | controller | ok: [instance] 2026-02-25 13:07:09.139612 | controller | 2026-02-25 13:07:09.139643 | controller | TASK [test_deps : Install extra packages] ************************************** 2026-02-25 13:07:09.139656 | controller | Wednesday 25 February 2026 13:07:09 +0000 (0:00:01.251) 0:00:58.826 **** 2026-02-25 13:07:09.139703 | controller | skipping: [instance] 2026-02-25 13:07:09.190861 | controller | 2026-02-25 13:07:09.190901 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-25 13:07:09.190916 | controller | Wednesday 25 February 2026 13:07:09 +0000 (0:00:00.039) 0:00:58.865 **** 2026-02-25 13:07:09.190934 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2026-02-25 13:07:09.191345 | controller | 2026-02-25 13:07:09.191366 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-25 13:07:09.191419 | controller | Wednesday 25 February 2026 13:07:09 +0000 (0:00:00.051) 0:00:58.916 **** 2026-02-25 13:07:09.216972 | controller | ok: [instance] => 2026-02-25 13:07:09.217034 | controller | cifmw_ci_setup_packages: 2026-02-25 13:07:09.217137 | controller | - bash-completion 2026-02-25 13:07:09.217240 | controller | - ca-certificates 2026-02-25 13:07:09.217318 | controller | - git-core 2026-02-25 13:07:09.217407 | controller | - make 2026-02-25 13:07:09.217476 | controller | - tar 2026-02-25 13:07:09.217556 | controller | - tmux 2026-02-25 13:07:09.217642 | controller | - python3-pip 2026-02-25 13:07:09.217738 | controller | 2026-02-25 13:07:09.217827 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-25 13:07:09.217908 | controller | Wednesday 25 February 2026 13:07:09 +0000 (0:00:00.026) 0:00:58.943 **** 2026-02-25 13:07:17.574971 | controller | changed: [instance] 2026-02-25 13:07:17.575131 | controller | 2026-02-25 13:07:17.575305 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-25 13:07:17.575356 | controller | Wednesday 25 February 2026 13:07:17 +0000 (0:00:08.357) 0:01:07.300 **** 2026-02-25 13:07:18.217555 | controller | ok: [instance] 2026-02-25 13:07:18.441796 | controller | 2026-02-25 13:07:18.441857 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-25 13:07:18.441868 | controller | Wednesday 25 February 2026 13:07:18 +0000 (0:00:00.642) 0:01:07.943 **** 2026-02-25 13:07:18.441881 | controller | changed: [instance] 2026-02-25 13:07:18.441965 | controller | 2026-02-25 13:07:18.442011 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-25 13:07:24.455204 | controller | Wednesday 25 February 2026 13:07:18 +0000 (0:00:00.224) 0:01:08.167 **** 2026-02-25 13:07:24.455258 | controller | changed: [instance] 2026-02-25 13:07:24.494457 | controller | 2026-02-25 13:07:24.494490 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-25 13:07:24.494499 | controller | Wednesday 25 February 2026 13:07:24 +0000 (0:00:06.013) 0:01:14.180 **** 2026-02-25 13:07:24.494513 | controller | ok: [instance] 2026-02-25 13:07:24.775618 | controller | 2026-02-25 13:07:24.775680 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-25 13:07:24.775693 | controller | Wednesday 25 February 2026 13:07:24 +0000 (0:00:00.039) 0:01:14.220 **** 2026-02-25 13:07:24.775705 | controller | changed: [instance] 2026-02-25 13:07:25.051935 | controller | 2026-02-25 13:07:25.051994 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-25 13:07:25.052010 | controller | Wednesday 25 February 2026 13:07:24 +0000 (0:00:00.280) 0:01:14.501 **** 2026-02-25 13:07:25.052029 | controller | changed: [instance] 2026-02-25 13:07:25.072265 | controller | 2026-02-25 13:07:25.072296 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-25 13:07:25.072305 | controller | Wednesday 25 February 2026 13:07:25 +0000 (0:00:00.276) 0:01:14.778 **** 2026-02-25 13:07:25.072316 | controller | skipping: [instance] 2026-02-25 13:07:25.090645 | controller | 2026-02-25 13:07:25.090686 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-25 13:07:25.090698 | controller | Wednesday 25 February 2026 13:07:25 +0000 (0:00:00.020) 0:01:14.798 **** 2026-02-25 13:07:25.090709 | controller | skipping: [instance] 2026-02-25 13:07:25.109988 | controller | 2026-02-25 13:07:25.110057 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-25 13:07:25.110073 | controller | Wednesday 25 February 2026 13:07:25 +0000 (0:00:00.018) 0:01:14.816 **** 2026-02-25 13:07:25.110093 | controller | skipping: [instance] 2026-02-25 13:07:25.127448 | controller | 2026-02-25 13:07:25.127479 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-25 13:07:25.127489 | controller | Wednesday 25 February 2026 13:07:25 +0000 (0:00:00.018) 0:01:14.835 **** 2026-02-25 13:07:25.127500 | controller | skipping: [instance] 2026-02-25 13:07:25.145531 | controller | 2026-02-25 13:07:25.145561 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-25 13:07:25.145585 | controller | Wednesday 25 February 2026 13:07:25 +0000 (0:00:00.017) 0:01:14.853 **** 2026-02-25 13:07:25.145600 | controller | skipping: [instance] 2026-02-25 13:07:25.168825 | controller | 2026-02-25 13:07:25.168876 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-25 13:07:25.168885 | controller | Wednesday 25 February 2026 13:07:25 +0000 (0:00:00.017) 0:01:14.871 **** 2026-02-25 13:07:25.168898 | controller | skipping: [instance] 2026-02-25 13:07:26.169624 | controller | 2026-02-25 13:07:26.169688 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-25 13:07:26.169701 | controller | Wednesday 25 February 2026 13:07:25 +0000 (0:00:00.023) 0:01:14.894 **** 2026-02-25 13:07:26.169715 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2026-02-25 13:07:26.512841 | controller | changed: [instance] => (item=/opt/basedir/logs) 2026-02-25 13:07:26.512898 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2026-02-25 13:07:26.512909 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2026-02-25 13:07:26.512918 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2026-02-25 13:07:26.512926 | controller | 2026-02-25 13:07:26.512935 | controller | TASK [Create secret file] ****************************************************** 2026-02-25 13:07:26.512944 | controller | Wednesday 25 February 2026 13:07:26 +0000 (0:00:00.999) 0:01:15.894 **** 2026-02-25 13:07:26.512960 | controller | changed: [instance] 2026-02-25 13:07:26.512994 | controller | 2026-02-25 13:07:26.513004 | controller | PLAY RECAP ********************************************************************* 2026-02-25 13:07:26.513013 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2026-02-25 13:07:26.513021 | controller | 2026-02-25 13:07:26.513028 | controller | Wednesday 25 February 2026 13:07:26 +0000 (0:00:00.343) 0:01:16.238 **** 2026-02-25 13:07:26.513035 | controller | =============================================================================== 2026-02-25 13:07:26.513042 | controller | test_deps : Install selinux python libs -------------------------------- 40.50s 2026-02-25 13:07:26.513049 | controller | ci_setup : Install needed packages -------------------------------------- 8.36s 2026-02-25 13:07:26.513056 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.46s 2026-02-25 13:07:26.513065 | controller | ci_setup : Install openshift client ------------------------------------- 6.01s 2026-02-25 13:07:26.513093 | controller | test_deps : Install python yaml libs ------------------------------------ 1.25s 2026-02-25 13:07:26.513101 | controller | repo_setup : Run repo-setup --------------------------------------------- 1.19s 2026-02-25 13:07:26.513110 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.12s 2026-02-25 13:07:26.513736 | controller | ci_setup : Manage directories ------------------------------------------- 1.00s 2026-02-25 13:07:26.514204 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.86s 2026-02-25 13:07:26.514243 | controller | Gathering Facts --------------------------------------------------------- 0.85s 2026-02-25 13:07:26.514250 | controller | repo_setup : Install repo-setup package --------------------------------- 0.72s 2026-02-25 13:07:26.514256 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.71s 2026-02-25 13:07:26.514261 | controller | ci_setup : Gather version of openshift client --------------------------- 0.64s 2026-02-25 13:07:26.514266 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.55s 2026-02-25 13:07:26.514276 | controller | repo_setup : Ensure directories are present ----------------------------- 0.54s 2026-02-25 13:07:26.579230 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.47s 2026-02-25 13:07:26.579251 | controller | Create secret file ------------------------------------------------------ 0.34s 2026-02-25 13:07:26.579258 | controller | Create custom basedir --------------------------------------------------- 0.33s 2026-02-25 13:07:26.579263 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.29s 2026-02-25 13:07:26.579275 | controller | ci_setup : Create completion file --------------------------------------- 0.28s 2026-02-25 13:07:26.579285 | controller | INFO Running crc_layout > converge 2026-02-25 13:07:27.143883 | controller | 2026-02-25 13:07:27.144125 | controller | PLAY [Converge] **************************************************************** 2026-02-25 13:07:27.144257 | controller | 2026-02-25 13:07:27.144377 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-25 13:07:27.144503 | controller | Wednesday 25 February 2026 13:07:27 +0000 (0:00:00.025) 0:00:00.025 **** 2026-02-25 13:07:27.983385 | controller | ok: [instance] 2026-02-25 13:07:28.006719 | controller | 2026-02-25 13:07:28.006741 | controller | TASK [Load networking definition from scenario file] *************************** 2026-02-25 13:07:28.006752 | controller | Wednesday 25 February 2026 13:07:27 +0000 (0:00:00.839) 0:00:00.864 **** 2026-02-25 13:07:28.006763 | controller | ok: [instance] 2026-02-25 13:07:28.006940 | controller | 2026-02-25 13:07:28.006961 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-25 13:07:29.655863 | controller | Wednesday 25 February 2026 13:07:28 +0000 (0:00:00.024) 0:00:00.888 **** 2026-02-25 13:07:29.655928 | controller | changed: [instance] 2026-02-25 13:07:29.685102 | controller | 2026-02-25 13:07:29.685144 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-25 13:07:29.685152 | controller | Wednesday 25 February 2026 13:07:29 +0000 (0:00:01.648) 0:00:02.537 **** 2026-02-25 13:07:29.685164 | controller | ok: [instance] 2026-02-25 13:07:29.708500 | controller | 2026-02-25 13:07:29.708521 | controller | TASK [reproducer : Load CI job environment] ************************************ 2026-02-25 13:07:29.708530 | controller | Wednesday 25 February 2026 13:07:29 +0000 (0:00:00.029) 0:00:02.567 **** 2026-02-25 13:07:29.708540 | controller | skipping: [instance] 2026-02-25 13:07:29.759915 | controller | 2026-02-25 13:07:29.759966 | controller | TASK [Build final libvirt layout] ********************************************** 2026-02-25 13:07:29.759977 | controller | Wednesday 25 February 2026 13:07:29 +0000 (0:00:00.023) 0:00:02.590 **** 2026-02-25 13:07:29.759992 | controller | 2026-02-25 13:07:29.841685 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2026-02-25 13:07:29.841716 | controller | Wednesday 25 February 2026 13:07:29 +0000 (0:00:00.051) 0:00:02.641 **** 2026-02-25 13:07:29.841730 | controller | ok: [instance] 2026-02-25 13:07:29.906846 | controller | 2026-02-25 13:07:29.906885 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2026-02-25 13:07:29.906900 | controller | Wednesday 25 February 2026 13:07:29 +0000 (0:00:00.081) 0:00:02.723 **** 2026-02-25 13:07:29.906918 | controller | skipping: [instance] 2026-02-25 13:07:29.907320 | controller | 2026-02-25 13:07:29.933736 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2026-02-25 13:07:29.933766 | controller | Wednesday 25 February 2026 13:07:29 +0000 (0:00:00.065) 0:00:02.788 **** 2026-02-25 13:07:29.933778 | controller | ok: [instance] 2026-02-25 13:07:29.959457 | controller | 2026-02-25 13:07:29.959478 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2026-02-25 13:07:29.959488 | controller | Wednesday 25 February 2026 13:07:29 +0000 (0:00:00.026) 0:00:02.815 **** 2026-02-25 13:07:29.959498 | controller | ok: [instance] => changed=false 2026-02-25 13:07:29.959658 | controller | msg: All assertions passed 2026-02-25 13:07:29.959846 | controller | 2026-02-25 13:07:29.959999 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2026-02-25 13:07:29.960143 | controller | Wednesday 25 February 2026 13:07:29 +0000 (0:00:00.026) 0:00:02.841 **** 2026-02-25 13:07:30.002750 | controller | ok: [instance] 2026-02-25 13:07:30.002859 | controller | 2026-02-25 13:07:30.002996 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2026-02-25 13:07:30.003122 | controller | Wednesday 25 February 2026 13:07:30 +0000 (0:00:00.043) 0:00:02.884 **** 2026-02-25 13:07:30.472904 | controller | ok: [instance] => (item=artifacts) 2026-02-25 13:07:30.472973 | controller | ok: [instance] => (item=logs) 2026-02-25 13:07:30.473208 | controller | 2026-02-25 13:07:30.473229 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2026-02-25 13:07:30.548141 | controller | Wednesday 25 February 2026 13:07:30 +0000 (0:00:00.469) 0:00:03.354 **** 2026-02-25 13:07:30.548165 | controller | 2026-02-25 13:07:30.738442 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2026-02-25 13:07:30.738471 | controller | Wednesday 25 February 2026 13:07:30 +0000 (0:00:00.075) 0:00:03.430 **** 2026-02-25 13:07:30.738486 | controller | ok: [instance] 2026-02-25 13:07:31.031809 | controller | 2026-02-25 13:07:31.031859 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2026-02-25 13:07:31.031869 | controller | Wednesday 25 February 2026 13:07:30 +0000 (0:00:00.189) 0:00:03.620 **** 2026-02-25 13:07:31.031884 | controller | changed: [instance] 2026-02-25 13:07:31.031923 | controller | 2026-02-25 13:07:31.032112 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2026-02-25 13:07:31.032153 | controller | Wednesday 25 February 2026 13:07:31 +0000 (0:00:00.293) 0:00:03.913 **** 2026-02-25 13:07:31.328321 | controller | ok: [instance] 2026-02-25 13:07:31.359792 | controller | 2026-02-25 13:07:31.359841 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2026-02-25 13:07:31.359850 | controller | Wednesday 25 February 2026 13:07:31 +0000 (0:00:00.296) 0:00:04.209 **** 2026-02-25 13:07:31.359863 | controller | skipping: [instance] 2026-02-25 13:07:31.359889 | controller | 2026-02-25 13:07:31.359898 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2026-02-25 13:07:31.359921 | controller | Wednesday 25 February 2026 13:07:31 +0000 (0:00:00.032) 0:00:04.241 **** 2026-02-25 13:07:31.379261 | controller | skipping: [instance] 2026-02-25 13:07:31.402570 | controller | 2026-02-25 13:07:31.402595 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2026-02-25 13:07:31.402605 | controller | Wednesday 25 February 2026 13:07:31 +0000 (0:00:00.019) 0:00:04.261 **** 2026-02-25 13:07:31.402616 | controller | ok: [instance] 2026-02-25 13:07:31.431104 | controller | 2026-02-25 13:07:31.431124 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2026-02-25 13:07:31.431133 | controller | Wednesday 25 February 2026 13:07:31 +0000 (0:00:00.023) 0:00:04.284 **** 2026-02-25 13:07:31.431143 | controller | skipping: [instance] 2026-02-25 13:07:39.769273 | controller | 2026-02-25 13:07:39.769321 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2026-02-25 13:07:39.769330 | controller | Wednesday 25 February 2026 13:07:31 +0000 (0:00:00.028) 0:00:04.313 **** 2026-02-25 13:07:39.769342 | controller | changed: [instance] 2026-02-25 13:07:39.991294 | controller | 2026-02-25 13:07:39.991329 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2026-02-25 13:07:39.991339 | controller | Wednesday 25 February 2026 13:07:39 +0000 (0:00:08.337) 0:00:12.650 **** 2026-02-25 13:07:39.991350 | controller | changed: [instance] 2026-02-25 13:07:40.494305 | controller | 2026-02-25 13:07:40.494353 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2026-02-25 13:07:40.494363 | controller | Wednesday 25 February 2026 13:07:39 +0000 (0:00:00.222) 0:00:12.872 **** 2026-02-25 13:07:40.494375 | controller | changed: [instance] 2026-02-25 13:07:41.106518 | controller | 2026-02-25 13:07:41.106556 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2026-02-25 13:07:41.106565 | controller | Wednesday 25 February 2026 13:07:40 +0000 (0:00:00.502) 0:00:13.375 **** 2026-02-25 13:07:41.106577 | controller | changed: [instance] 2026-02-25 13:07:41.302312 | controller | 2026-02-25 13:07:41.302330 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2026-02-25 13:07:41.302337 | controller | Wednesday 25 February 2026 13:07:41 +0000 (0:00:00.612) 0:00:13.988 **** 2026-02-25 13:07:41.302346 | controller | ok: [instance] 2026-02-25 13:07:41.974259 | controller | 2026-02-25 13:07:41.974291 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2026-02-25 13:07:41.974299 | controller | Wednesday 25 February 2026 13:07:41 +0000 (0:00:00.196) 0:00:14.184 **** 2026-02-25 13:07:41.974309 | controller | ok: [instance] 2026-02-25 13:07:42.745443 | controller | 2026-02-25 13:07:42.745472 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2026-02-25 13:07:42.745490 | controller | Wednesday 25 February 2026 13:07:41 +0000 (0:00:00.671) 0:00:14.855 **** 2026-02-25 13:07:42.745500 | controller | changed: [instance] 2026-02-25 13:07:42.745815 | controller | 2026-02-25 13:07:42.827834 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2026-02-25 13:07:42.827885 | controller | Wednesday 25 February 2026 13:07:42 +0000 (0:00:00.771) 0:00:15.627 **** 2026-02-25 13:07:42.827903 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2026-02-25 13:07:42.827942 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2026-02-25 13:07:42.827951 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2026-02-25 13:07:42.827960 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2026-02-25 13:07:42.827967 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2026-02-25 13:07:42.827977 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2026-02-25 13:07:42.828299 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2026-02-25 13:07:42.828321 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2026-02-25 13:07:43.152793 | controller | 2026-02-25 13:07:43.152847 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2026-02-25 13:07:43.152858 | controller | Wednesday 25 February 2026 13:07:42 +0000 (0:00:00.082) 0:00:15.709 **** 2026-02-25 13:07:43.152874 | controller | ok: [instance] 2026-02-25 13:07:43.152908 | controller | 2026-02-25 13:07:43.152937 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2026-02-25 13:07:43.153090 | controller | Wednesday 25 February 2026 13:07:43 +0000 (0:00:00.325) 0:00:16.034 **** 2026-02-25 13:07:43.473857 | controller | ok: [instance] 2026-02-25 13:07:43.796847 | controller | 2026-02-25 13:07:43.796880 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2026-02-25 13:07:43.796888 | controller | Wednesday 25 February 2026 13:07:43 +0000 (0:00:00.320) 0:00:16.355 **** 2026-02-25 13:07:43.796898 | controller | ok: [instance] 2026-02-25 13:07:43.796927 | controller | 2026-02-25 13:07:43.796933 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2026-02-25 13:07:43.796940 | controller | Wednesday 25 February 2026 13:07:43 +0000 (0:00:00.322) 0:00:16.677 **** 2026-02-25 13:07:44.118025 | controller | ok: [instance] 2026-02-25 13:07:44.118096 | controller | 2026-02-25 13:07:44.118267 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2026-02-25 13:07:44.118311 | controller | Wednesday 25 February 2026 13:07:44 +0000 (0:00:00.321) 0:00:16.999 **** 2026-02-25 13:07:44.448528 | controller | ok: [instance] 2026-02-25 13:07:44.776812 | controller | 2026-02-25 13:07:44.776859 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2026-02-25 13:07:44.776868 | controller | Wednesday 25 February 2026 13:07:44 +0000 (0:00:00.330) 0:00:17.329 **** 2026-02-25 13:07:44.776882 | controller | ok: [instance] 2026-02-25 13:07:45.100241 | controller | 2026-02-25 13:07:45.100288 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2026-02-25 13:07:45.100296 | controller | Wednesday 25 February 2026 13:07:44 +0000 (0:00:00.328) 0:00:17.658 **** 2026-02-25 13:07:45.100308 | controller | ok: [instance] 2026-02-25 13:07:45.416736 | controller | 2026-02-25 13:07:45.416766 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2026-02-25 13:07:45.416775 | controller | Wednesday 25 February 2026 13:07:45 +0000 (0:00:00.323) 0:00:17.981 **** 2026-02-25 13:07:45.416795 | controller | ok: [instance] 2026-02-25 13:07:45.416817 | controller | 2026-02-25 13:07:45.417060 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2026-02-25 13:07:45.737128 | controller | Wednesday 25 February 2026 13:07:45 +0000 (0:00:00.317) 0:00:18.298 **** 2026-02-25 13:07:45.737157 | controller | ok: [instance] 2026-02-25 13:07:46.056204 | controller | 2026-02-25 13:07:46.056258 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2026-02-25 13:07:46.056267 | controller | Wednesday 25 February 2026 13:07:45 +0000 (0:00:00.320) 0:00:18.618 **** 2026-02-25 13:07:46.056279 | controller | ok: [instance] 2026-02-25 13:07:46.378235 | controller | 2026-02-25 13:07:46.378282 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2026-02-25 13:07:46.378291 | controller | Wednesday 25 February 2026 13:07:46 +0000 (0:00:00.318) 0:00:18.937 **** 2026-02-25 13:07:46.378303 | controller | ok: [instance] 2026-02-25 13:07:46.693756 | controller | 2026-02-25 13:07:46.693809 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2026-02-25 13:07:46.693820 | controller | Wednesday 25 February 2026 13:07:46 +0000 (0:00:00.322) 0:00:19.259 **** 2026-02-25 13:07:46.693835 | controller | ok: [instance] 2026-02-25 13:07:47.018987 | controller | 2026-02-25 13:07:47.019030 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2026-02-25 13:07:47.019039 | controller | Wednesday 25 February 2026 13:07:46 +0000 (0:00:00.315) 0:00:19.575 **** 2026-02-25 13:07:47.019051 | controller | ok: [instance] 2026-02-25 13:07:47.334002 | controller | 2026-02-25 13:07:47.334034 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2026-02-25 13:07:47.334043 | controller | Wednesday 25 February 2026 13:07:47 +0000 (0:00:00.325) 0:00:19.900 **** 2026-02-25 13:07:47.334054 | controller | ok: [instance] 2026-02-25 13:07:47.642849 | controller | 2026-02-25 13:07:47.642904 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2026-02-25 13:07:47.642915 | controller | Wednesday 25 February 2026 13:07:47 +0000 (0:00:00.315) 0:00:20.215 **** 2026-02-25 13:07:47.642930 | controller | ok: [instance] 2026-02-25 13:07:47.964356 | controller | 2026-02-25 13:07:47.964392 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2026-02-25 13:07:47.964401 | controller | Wednesday 25 February 2026 13:07:47 +0000 (0:00:00.308) 0:00:20.524 **** 2026-02-25 13:07:47.964411 | controller | ok: [instance] 2026-02-25 13:07:48.280956 | controller | 2026-02-25 13:07:48.281013 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2026-02-25 13:07:48.281024 | controller | Wednesday 25 February 2026 13:07:47 +0000 (0:00:00.321) 0:00:20.846 **** 2026-02-25 13:07:48.281038 | controller | ok: [instance] 2026-02-25 13:07:48.590240 | controller | 2026-02-25 13:07:48.590278 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2026-02-25 13:07:48.590287 | controller | Wednesday 25 February 2026 13:07:48 +0000 (0:00:00.316) 0:00:21.162 **** 2026-02-25 13:07:48.590298 | controller | ok: [instance] 2026-02-25 13:07:48.923294 | controller | 2026-02-25 13:07:48.923324 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2026-02-25 13:07:48.923334 | controller | Wednesday 25 February 2026 13:07:48 +0000 (0:00:00.309) 0:00:21.471 **** 2026-02-25 13:07:48.923346 | controller | ok: [instance] 2026-02-25 13:07:49.233654 | controller | 2026-02-25 13:07:49.233701 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2026-02-25 13:07:49.233711 | controller | Wednesday 25 February 2026 13:07:48 +0000 (0:00:00.333) 0:00:21.805 **** 2026-02-25 13:07:49.233722 | controller | ok: [instance] 2026-02-25 13:07:49.549819 | controller | 2026-02-25 13:07:49.549870 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2026-02-25 13:07:49.549880 | controller | Wednesday 25 February 2026 13:07:49 +0000 (0:00:00.310) 0:00:22.115 **** 2026-02-25 13:07:49.549892 | controller | ok: [instance] 2026-02-25 13:07:49.549918 | controller | 2026-02-25 13:07:49.549927 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2026-02-25 13:07:49.550061 | controller | Wednesday 25 February 2026 13:07:49 +0000 (0:00:00.316) 0:00:22.431 **** 2026-02-25 13:07:49.860810 | controller | ok: [instance] 2026-02-25 13:07:50.180235 | controller | 2026-02-25 13:07:50.180275 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2026-02-25 13:07:50.180285 | controller | Wednesday 25 February 2026 13:07:49 +0000 (0:00:00.310) 0:00:22.742 **** 2026-02-25 13:07:50.180296 | controller | ok: [instance] 2026-02-25 13:07:50.497022 | controller | 2026-02-25 13:07:50.497045 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2026-02-25 13:07:50.497053 | controller | Wednesday 25 February 2026 13:07:50 +0000 (0:00:00.319) 0:00:23.061 **** 2026-02-25 13:07:50.497062 | controller | ok: [instance] 2026-02-25 13:07:50.518869 | controller | 2026-02-25 13:07:50.518929 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2026-02-25 13:07:50.518943 | controller | Wednesday 25 February 2026 13:07:50 +0000 (0:00:00.317) 0:00:23.378 **** 2026-02-25 13:07:50.518961 | controller | skipping: [instance] 2026-02-25 13:07:50.804214 | controller | 2026-02-25 13:07:50.804263 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2026-02-25 13:07:50.804274 | controller | Wednesday 25 February 2026 13:07:50 +0000 (0:00:00.021) 0:00:23.400 **** 2026-02-25 13:07:50.804285 | controller | ok: [instance] 2026-02-25 13:07:51.171700 | controller | 2026-02-25 13:07:51.171725 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2026-02-25 13:07:51.171733 | controller | Wednesday 25 February 2026 13:07:50 +0000 (0:00:00.285) 0:00:23.686 **** 2026-02-25 13:07:51.171742 | controller | ok: [instance] 2026-02-25 13:07:51.475755 | controller | 2026-02-25 13:07:51.475807 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2026-02-25 13:07:51.475816 | controller | Wednesday 25 February 2026 13:07:51 +0000 (0:00:00.367) 0:00:24.053 **** 2026-02-25 13:07:51.475829 | controller | changed: [instance] 2026-02-25 13:07:51.475916 | controller | 2026-02-25 13:07:51.475939 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2026-02-25 13:07:51.758084 | controller | Wednesday 25 February 2026 13:07:51 +0000 (0:00:00.304) 0:00:24.357 **** 2026-02-25 13:07:51.758134 | controller | [WARNING]: Reset is not implemented for this connection 2026-02-25 13:07:51.767792 | controller | changed: [instance] 2026-02-25 13:07:51.768136 | controller | 2026-02-25 13:07:51.768156 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2026-02-25 13:07:51.768166 | controller | Wednesday 25 February 2026 13:07:51 +0000 (0:00:00.275) 0:00:24.633 **** 2026-02-25 13:07:51.840044 | controller | 2026-02-25 13:07:51.840066 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2026-02-25 13:07:51.840073 | controller | Wednesday 25 February 2026 13:07:51 +0000 (0:00:00.016) 0:00:24.649 **** 2026-02-25 13:07:51.840082 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2026-02-25 13:07:51.902835 | controller | 2026-02-25 13:07:51.902897 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2026-02-25 13:07:51.902913 | controller | Wednesday 25 February 2026 13:07:51 +0000 (0:00:00.072) 0:00:24.721 **** 2026-02-25 13:07:51.902939 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2026-02-25 13:07:51.949953 | controller | 2026-02-25 13:07:51.950000 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-02-25 13:07:51.950011 | controller | Wednesday 25 February 2026 13:07:51 +0000 (0:00:00.062) 0:00:24.784 **** 2026-02-25 13:07:51.950025 | controller | ok: [instance] => (item=compute) 2026-02-25 13:07:51.992227 | controller | ok: [instance] => (item=controller) 2026-02-25 13:07:51.992268 | controller | ok: [instance] => (item=crc) 2026-02-25 13:07:51.992277 | controller | 2026-02-25 13:07:51.992283 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-02-25 13:07:51.992289 | controller | Wednesday 25 February 2026 13:07:51 +0000 (0:00:00.046) 0:00:24.831 **** 2026-02-25 13:07:51.992300 | controller | ok: [instance] 2026-02-25 13:07:52.035406 | controller | 2026-02-25 13:07:52.035425 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-02-25 13:07:52.035447 | controller | Wednesday 25 February 2026 13:07:51 +0000 (0:00:00.042) 0:00:24.874 **** 2026-02-25 13:07:52.035456 | controller | ok: [instance] => changed=false 2026-02-25 13:07:52.078944 | controller | msg: All assertions passed 2026-02-25 13:07:52.078965 | controller | 2026-02-25 13:07:52.078974 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2026-02-25 13:07:52.078981 | controller | Wednesday 25 February 2026 13:07:52 +0000 (0:00:00.042) 0:00:24.917 **** 2026-02-25 13:07:52.078990 | controller | 2026-02-25 13:07:52.079170 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2026-02-25 13:07:52.079346 | controller | Wednesday 25 February 2026 13:07:52 +0000 (0:00:00.044) 0:00:24.961 **** 2026-02-25 13:07:52.156941 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.49', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2026-02-25 13:07:52.157115 | controller | ok: [instance] => (item={}) 2026-02-25 13:07:52.157272 | controller | 2026-02-25 13:07:52.157423 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2026-02-25 13:07:52.157554 | controller | Wednesday 25 February 2026 13:07:52 +0000 (0:00:00.077) 0:00:25.039 **** 2026-02-25 13:07:52.175553 | controller | skipping: [instance] 2026-02-25 13:07:52.175742 | controller | 2026-02-25 13:07:52.175901 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2026-02-25 13:07:52.176046 | controller | Wednesday 25 February 2026 13:07:52 +0000 (0:00:00.018) 0:00:25.057 **** 2026-02-25 13:07:52.391288 | controller | ok: [instance] 2026-02-25 13:07:52.734360 | controller | 2026-02-25 13:07:52.734404 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2026-02-25 13:07:52.734413 | controller | Wednesday 25 February 2026 13:07:52 +0000 (0:00:00.214) 0:00:25.272 **** 2026-02-25 13:07:52.734423 | controller | changed: [instance] 2026-02-25 13:07:53.498479 | controller | 2026-02-25 13:07:53.498521 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2026-02-25 13:07:53.498530 | controller | Wednesday 25 February 2026 13:07:52 +0000 (0:00:00.343) 0:00:25.616 **** 2026-02-25 13:07:53.498542 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2026-02-25 13:07:53.525819 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2026-02-25 13:07:53.525869 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2026-02-25 13:07:53.525878 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2026-02-25 13:07:53.525887 | controller | 2026-02-25 13:07:53.525894 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2026-02-25 13:07:53.525902 | controller | Wednesday 25 February 2026 13:07:53 +0000 (0:00:00.763) 0:00:26.379 **** 2026-02-25 13:07:53.525915 | controller | skipping: [instance] 2026-02-25 13:07:53.896936 | controller | 2026-02-25 13:07:53.896983 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2026-02-25 13:07:53.896995 | controller | Wednesday 25 February 2026 13:07:53 +0000 (0:00:00.028) 0:00:26.407 **** 2026-02-25 13:07:53.897010 | controller | changed: [instance] 2026-02-25 13:07:53.897045 | controller | 2026-02-25 13:07:53.897054 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2026-02-25 13:07:53.897061 | controller | Wednesday 25 February 2026 13:07:53 +0000 (0:00:00.361) 0:00:26.769 **** 2026-02-25 13:07:53.897068 | controller | 2026-02-25 13:07:53.897079 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-25 13:07:53.897108 | controller | Wednesday 25 February 2026 13:07:53 +0000 (0:00:00.008) 0:00:26.778 **** 2026-02-25 13:07:54.325035 | controller | changed: [instance] 2026-02-25 13:07:54.325315 | controller | 2026-02-25 13:07:54.325333 | controller | TASK [Ensure no default networks exists] *************************************** 2026-02-25 13:07:54.401904 | controller | Wednesday 25 February 2026 13:07:54 +0000 (0:00:00.428) 0:00:27.206 **** 2026-02-25 13:07:54.401930 | controller | 2026-02-25 13:07:55.600387 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2026-02-25 13:07:55.600429 | controller | Wednesday 25 February 2026 13:07:54 +0000 (0:00:00.076) 0:00:27.283 **** 2026-02-25 13:07:55.600441 | controller | ok: [instance] 2026-02-25 13:07:55.835308 | controller | 2026-02-25 13:07:55.835327 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2026-02-25 13:07:55.835335 | controller | Wednesday 25 February 2026 13:07:55 +0000 (0:00:01.198) 0:00:28.481 **** 2026-02-25 13:07:55.835343 | controller | ok: [instance] 2026-02-25 13:07:56.382143 | controller | 2026-02-25 13:07:56.382177 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2026-02-25 13:07:56.382186 | controller | Wednesday 25 February 2026 13:07:55 +0000 (0:00:00.235) 0:00:28.717 **** 2026-02-25 13:07:56.382196 | controller | ok: [instance] 2026-02-25 13:07:56.610609 | controller | 2026-02-25 13:07:56.610652 | controller | TASK [libvirt_manager : Removing default] ************************************** 2026-02-25 13:07:56.610661 | controller | Wednesday 25 February 2026 13:07:56 +0000 (0:00:00.546) 0:00:29.263 **** 2026-02-25 13:07:56.610710 | controller | ok: [instance] 2026-02-25 13:07:57.802414 | controller | 2026-02-25 13:07:57.802450 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2026-02-25 13:07:57.802458 | controller | Wednesday 25 February 2026 13:07:56 +0000 (0:00:00.227) 0:00:29.491 **** 2026-02-25 13:07:57.802469 | controller | ok: [instance] 2026-02-25 13:07:58.111108 | controller | 2026-02-25 13:07:58.111142 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2026-02-25 13:07:58.111151 | controller | Wednesday 25 February 2026 13:07:57 +0000 (0:00:01.192) 0:00:30.683 **** 2026-02-25 13:07:58.111162 | controller | ok: [instance] 2026-02-25 13:07:58.416159 | controller | 2026-02-25 13:07:58.416192 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2026-02-25 13:07:58.416201 | controller | Wednesday 25 February 2026 13:07:58 +0000 (0:00:00.308) 0:00:30.992 **** 2026-02-25 13:07:58.416211 | controller | changed: [instance] 2026-02-25 13:07:59.726676 | controller | 2026-02-25 13:07:59.726731 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2026-02-25 13:07:59.726741 | controller | Wednesday 25 February 2026 13:07:58 +0000 (0:00:00.304) 0:00:31.297 **** 2026-02-25 13:07:59.726753 | controller | changed: [instance] 2026-02-25 13:08:00.285652 | controller | 2026-02-25 13:08:00.285707 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2026-02-25 13:08:00.285716 | controller | Wednesday 25 February 2026 13:07:59 +0000 (0:00:01.310) 0:00:32.608 **** 2026-02-25 13:08:00.285728 | controller | changed: [instance] => (item=arptables) 2026-02-25 13:08:00.592437 | controller | changed: [instance] => (item=iptables) 2026-02-25 13:08:00.592472 | controller | changed: [instance] => (item=ip6tables) 2026-02-25 13:08:00.592479 | controller | 2026-02-25 13:08:00.592485 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2026-02-25 13:08:00.592492 | controller | Wednesday 25 February 2026 13:08:00 +0000 (0:00:00.558) 0:00:33.166 **** 2026-02-25 13:08:00.592501 | controller | ok: [instance] 2026-02-25 13:08:00.705784 | controller | 2026-02-25 13:08:00.705853 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2026-02-25 13:08:00.705869 | controller | Wednesday 25 February 2026 13:08:00 +0000 (0:00:00.307) 0:00:33.474 **** 2026-02-25 13:08:00.705890 | controller | ok: [instance] 2026-02-25 13:08:00.705953 | controller | 2026-02-25 13:08:00.706043 | controller | TASK [Ensure the required network configurations are applied] ****************** 2026-02-25 13:08:00.706066 | controller | Wednesday 25 February 2026 13:08:00 +0000 (0:00:00.113) 0:00:33.587 **** 2026-02-25 13:08:00.769426 | controller | 2026-02-25 13:08:00.793137 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2026-02-25 13:08:00.793163 | controller | Wednesday 25 February 2026 13:08:00 +0000 (0:00:00.063) 0:00:33.651 **** 2026-02-25 13:08:00.793173 | controller | skipping: [instance] 2026-02-25 13:08:00.816747 | controller | 2026-02-25 13:08:00.816780 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2026-02-25 13:08:00.816791 | controller | Wednesday 25 February 2026 13:08:00 +0000 (0:00:00.024) 0:00:33.675 **** 2026-02-25 13:08:00.816804 | controller | skipping: [instance] 2026-02-25 13:08:00.817159 | controller | 2026-02-25 13:08:00.839426 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-25 13:08:00.839448 | controller | Wednesday 25 February 2026 13:08:00 +0000 (0:00:00.023) 0:00:33.698 **** 2026-02-25 13:08:00.839460 | controller | skipping: [instance] 2026-02-25 13:08:00.865488 | controller | 2026-02-25 13:08:00.865508 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2026-02-25 13:08:00.865517 | controller | Wednesday 25 February 2026 13:08:00 +0000 (0:00:00.022) 0:00:33.721 **** 2026-02-25 13:08:00.865527 | controller | skipping: [instance] 2026-02-25 13:08:00.865699 | controller | 2026-02-25 13:08:00.865867 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2026-02-25 13:08:00.866015 | controller | Wednesday 25 February 2026 13:08:00 +0000 (0:00:00.026) 0:00:33.747 **** 2026-02-25 13:08:00.907087 | controller | ok: [instance] 2026-02-25 13:08:00.907315 | controller | 2026-02-25 13:08:00.907584 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2026-02-25 13:08:00.907862 | controller | Wednesday 25 February 2026 13:08:00 +0000 (0:00:00.041) 0:00:33.789 **** 2026-02-25 13:08:00.943308 | controller | skipping: [instance] 2026-02-25 13:08:00.943483 | controller | 2026-02-25 13:08:00.943635 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2026-02-25 13:08:00.943806 | controller | Wednesday 25 February 2026 13:08:00 +0000 (0:00:00.036) 0:00:33.825 **** 2026-02-25 13:08:00.966139 | controller | skipping: [instance] 2026-02-25 13:08:00.966299 | controller | 2026-02-25 13:08:00.966474 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2026-02-25 13:08:00.966617 | controller | Wednesday 25 February 2026 13:08:00 +0000 (0:00:00.022) 0:00:33.848 **** 2026-02-25 13:08:01.022828 | controller | ok: [instance] 2026-02-25 13:08:01.023060 | controller | 2026-02-25 13:08:01.023282 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2026-02-25 13:08:01.023503 | controller | Wednesday 25 February 2026 13:08:01 +0000 (0:00:00.056) 0:00:33.904 **** 2026-02-25 13:08:01.045880 | controller | skipping: [instance] 2026-02-25 13:08:01.046058 | controller | 2026-02-25 13:08:01.046222 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2026-02-25 13:08:01.046398 | controller | Wednesday 25 February 2026 13:08:01 +0000 (0:00:00.023) 0:00:33.928 **** 2026-02-25 13:08:01.094230 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2026-02-25 13:08:01.094390 | controller | 2026-02-25 13:08:01.094526 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-25 13:08:01.094654 | controller | Wednesday 25 February 2026 13:08:01 +0000 (0:00:00.048) 0:00:33.976 **** 2026-02-25 13:08:01.415373 | controller | ok: [instance -> localhost] 2026-02-25 13:08:06.137118 | controller | 2026-02-25 13:08:06.137168 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2026-02-25 13:08:06.137178 | controller | Wednesday 25 February 2026 13:08:01 +0000 (0:00:00.320) 0:00:34.296 **** 2026-02-25 13:08:06.137188 | controller | changed: [instance -> localhost] 2026-02-25 13:08:06.332370 | controller | 2026-02-25 13:08:06.332420 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-25 13:08:06.332429 | controller | Wednesday 25 February 2026 13:08:06 +0000 (0:00:04.721) 0:00:39.018 **** 2026-02-25 13:08:06.332440 | controller | changed: [instance] 2026-02-25 13:08:06.669803 | controller | 2026-02-25 13:08:06.669852 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2026-02-25 13:08:06.669862 | controller | Wednesday 25 February 2026 13:08:06 +0000 (0:00:00.195) 0:00:39.213 **** 2026-02-25 13:08:06.669886 | controller | changed: [instance] 2026-02-25 13:08:08.265646 | controller | 2026-02-25 13:08:08.265704 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2026-02-25 13:08:08.265714 | controller | Wednesday 25 February 2026 13:08:06 +0000 (0:00:00.337) 0:00:39.551 **** 2026-02-25 13:08:08.265725 | controller | changed: [instance -> localhost] 2026-02-25 13:08:08.618760 | controller | 2026-02-25 13:08:08.618807 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2026-02-25 13:08:08.618816 | controller | Wednesday 25 February 2026 13:08:08 +0000 (0:00:01.595) 0:00:41.147 **** 2026-02-25 13:08:08.618828 | controller | changed: [instance] 2026-02-25 13:08:08.618887 | controller | 2026-02-25 13:08:08.618907 | controller | TASK [reproducer : Select right domain] **************************************** 2026-02-25 13:08:08.618991 | controller | Wednesday 25 February 2026 13:08:08 +0000 (0:00:00.353) 0:00:41.500 **** 2026-02-25 13:08:08.651743 | controller | ok: [instance] 2026-02-25 13:08:08.767178 | controller | 2026-02-25 13:08:08.767211 | controller | TASK [Create the virtual networks] ********************************************* 2026-02-25 13:08:08.767220 | controller | Wednesday 25 February 2026 13:08:08 +0000 (0:00:00.033) 0:00:41.533 **** 2026-02-25 13:08:08.767230 | controller | 2026-02-25 13:08:08.785728 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2026-02-25 13:08:08.785751 | controller | Wednesday 25 February 2026 13:08:08 +0000 (0:00:00.115) 0:00:41.649 **** 2026-02-25 13:08:08.785762 | controller | ok: [instance] 2026-02-25 13:08:08.785847 | controller | 2026-02-25 13:08:08.785897 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2026-02-25 13:08:08.785917 | controller | Wednesday 25 February 2026 13:08:08 +0000 (0:00:00.018) 0:00:41.667 **** 2026-02-25 13:08:08.968552 | controller | ok: [instance] 2026-02-25 13:08:08.997826 | controller | 2026-02-25 13:08:08.997857 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2026-02-25 13:08:08.997868 | controller | Wednesday 25 February 2026 13:08:08 +0000 (0:00:00.182) 0:00:41.850 **** 2026-02-25 13:08:08.997881 | controller | skipping: [instance] 2026-02-25 13:08:09.025723 | controller | 2026-02-25 13:08:09.025740 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2026-02-25 13:08:09.025746 | controller | Wednesday 25 February 2026 13:08:08 +0000 (0:00:00.029) 0:00:41.879 **** 2026-02-25 13:08:09.025757 | controller | skipping: [instance] 2026-02-25 13:08:09.077836 | controller | 2026-02-25 13:08:09.077925 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2026-02-25 13:08:09.077941 | controller | Wednesday 25 February 2026 13:08:09 +0000 (0:00:00.027) 0:00:41.907 **** 2026-02-25 13:08:09.077962 | controller | ok: [instance] 2026-02-25 13:08:09.204317 | controller | 2026-02-25 13:08:09.204353 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2026-02-25 13:08:09.204362 | controller | Wednesday 25 February 2026 13:08:09 +0000 (0:00:00.052) 0:00:41.959 **** 2026-02-25 13:08:09.204373 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-25 13:08:09.238692 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-25 13:08:09.238722 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-25 13:08:09.238731 | controller | 2026-02-25 13:08:09.238738 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2026-02-25 13:08:09.238744 | controller | Wednesday 25 February 2026 13:08:09 +0000 (0:00:00.126) 0:00:42.085 **** 2026-02-25 13:08:09.238755 | controller | skipping: [instance] 2026-02-25 13:08:09.572663 | controller | 2026-02-25 13:08:09.572713 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2026-02-25 13:08:09.572721 | controller | Wednesday 25 February 2026 13:08:09 +0000 (0:00:00.034) 0:00:42.120 **** 2026-02-25 13:08:09.572731 | controller | changed: [instance] 2026-02-25 13:08:09.693851 | controller | 2026-02-25 13:08:09.693902 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2026-02-25 13:08:09.693914 | controller | Wednesday 25 February 2026 13:08:09 +0000 (0:00:00.333) 0:00:42.454 **** 2026-02-25 13:08:09.693942 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes) 2026-02-25 13:08:09.693979 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers) 2026-02-25 13:08:09.693989 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps) 2026-02-25 13:08:09.693997 | controller | 2026-02-25 13:08:09.694006 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-25 13:08:09.694034 | controller | Wednesday 25 February 2026 13:08:09 +0000 (0:00:00.120) 0:00:42.575 **** 2026-02-25 13:08:09.748796 | controller | changed: [instance] 2026-02-25 13:08:09.748885 | controller | 2026-02-25 13:08:09.748927 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-25 13:08:09.748943 | controller | Wednesday 25 February 2026 13:08:09 +0000 (0:00:00.055) 0:00:42.630 **** 2026-02-25 13:08:10.060472 | controller | changed: [instance] 2026-02-25 13:08:10.277138 | controller | 2026-02-25 13:08:10.277167 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-25 13:08:10.277176 | controller | Wednesday 25 February 2026 13:08:10 +0000 (0:00:00.311) 0:00:42.942 **** 2026-02-25 13:08:10.277187 | controller | changed: [instance] 2026-02-25 13:08:10.330398 | controller | 2026-02-25 13:08:10.330425 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-25 13:08:10.330445 | controller | Wednesday 25 February 2026 13:08:10 +0000 (0:00:00.216) 0:00:43.158 **** 2026-02-25 13:08:10.330456 | controller | changed: [instance] 2026-02-25 13:08:10.532009 | controller | 2026-02-25 13:08:10.532035 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-25 13:08:10.532042 | controller | Wednesday 25 February 2026 13:08:10 +0000 (0:00:00.053) 0:00:43.212 **** 2026-02-25 13:08:10.532052 | controller | changed: [instance] 2026-02-25 13:08:10.743375 | controller | 2026-02-25 13:08:10.743400 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-25 13:08:10.743408 | controller | Wednesday 25 February 2026 13:08:10 +0000 (0:00:00.201) 0:00:43.413 **** 2026-02-25 13:08:10.743417 | controller | changed: [instance] 2026-02-25 13:08:10.798061 | controller | 2026-02-25 13:08:10.798081 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-25 13:08:10.798089 | controller | Wednesday 25 February 2026 13:08:10 +0000 (0:00:00.211) 0:00:43.625 **** 2026-02-25 13:08:10.798097 | controller | changed: [instance] 2026-02-25 13:08:10.995820 | controller | 2026-02-25 13:08:10.995843 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-25 13:08:10.995852 | controller | Wednesday 25 February 2026 13:08:10 +0000 (0:00:00.054) 0:00:43.679 **** 2026-02-25 13:08:10.995863 | controller | changed: [instance] 2026-02-25 13:08:11.204182 | controller | 2026-02-25 13:08:11.204217 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-25 13:08:11.204225 | controller | Wednesday 25 February 2026 13:08:10 +0000 (0:00:00.197) 0:00:43.877 **** 2026-02-25 13:08:11.204235 | controller | changed: [instance] 2026-02-25 13:08:11.396187 | controller | 2026-02-25 13:08:11.396224 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ******************** 2026-02-25 13:08:11.396233 | controller | Wednesday 25 February 2026 13:08:11 +0000 (0:00:00.208) 0:00:44.085 **** 2026-02-25 13:08:11.396243 | controller | ok: [instance] 2026-02-25 13:08:11.882855 | controller | 2026-02-25 13:08:11.882898 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ****************** 2026-02-25 13:08:11.882908 | controller | Wednesday 25 February 2026 13:08:11 +0000 (0:00:00.191) 0:00:44.277 **** 2026-02-25 13:08:11.882921 | controller | changed: [instance] 2026-02-25 13:08:11.883001 | controller | 2026-02-25 13:08:11.883046 | controller | TASK [libvirt_manager : Remove ini file after conversion] ********************** 2026-02-25 13:08:11.883062 | controller | Wednesday 25 February 2026 13:08:11 +0000 (0:00:00.486) 0:00:44.764 **** 2026-02-25 13:08:12.060038 | controller | changed: [instance] 2026-02-25 13:08:12.085210 | controller | 2026-02-25 13:08:12.085230 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-25 13:08:12.085238 | controller | Wednesday 25 February 2026 13:08:12 +0000 (0:00:00.177) 0:00:44.941 **** 2026-02-25 13:08:12.085248 | controller | skipping: [instance] 2026-02-25 13:08:12.108492 | controller | 2026-02-25 13:08:12.108509 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-25 13:08:12.108515 | controller | Wednesday 25 February 2026 13:08:12 +0000 (0:00:00.025) 0:00:44.967 **** 2026-02-25 13:08:12.108523 | controller | skipping: [instance] 2026-02-25 13:08:12.133392 | controller | 2026-02-25 13:08:12.133414 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-25 13:08:12.133423 | controller | Wednesday 25 February 2026 13:08:12 +0000 (0:00:00.023) 0:00:44.990 **** 2026-02-25 13:08:12.133433 | controller | skipping: [instance] 2026-02-25 13:08:12.157807 | controller | 2026-02-25 13:08:12.157824 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-25 13:08:12.157831 | controller | Wednesday 25 February 2026 13:08:12 +0000 (0:00:00.024) 0:00:45.015 **** 2026-02-25 13:08:12.157840 | controller | skipping: [instance] 2026-02-25 13:08:12.178077 | controller | 2026-02-25 13:08:12.178097 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-25 13:08:12.178106 | controller | Wednesday 25 February 2026 13:08:12 +0000 (0:00:00.024) 0:00:45.039 **** 2026-02-25 13:08:12.178116 | controller | ok: [instance] 2026-02-25 13:08:12.261529 | controller | 2026-02-25 13:08:12.261568 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-25 13:08:12.261578 | controller | Wednesday 25 February 2026 13:08:12 +0000 (0:00:00.020) 0:00:45.060 **** 2026-02-25 13:08:12.261600 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-25 13:08:12.279562 | controller | 2026-02-25 13:08:12.279583 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-25 13:08:12.279591 | controller | Wednesday 25 February 2026 13:08:12 +0000 (0:00:00.082) 0:00:45.142 **** 2026-02-25 13:08:12.279601 | controller | skipping: [instance] 2026-02-25 13:08:12.279777 | controller | 2026-02-25 13:08:12.279911 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-25 13:08:12.280030 | controller | Wednesday 25 February 2026 13:08:12 +0000 (0:00:00.019) 0:00:45.161 **** 2026-02-25 13:08:12.485464 | controller | changed: [instance] 2026-02-25 13:08:12.875910 | controller | 2026-02-25 13:08:12.875969 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-25 13:08:12.875984 | controller | Wednesday 25 February 2026 13:08:12 +0000 (0:00:00.205) 0:00:45.367 **** 2026-02-25 13:08:12.876003 | controller | changed: [instance] 2026-02-25 13:08:12.937269 | controller | 2026-02-25 13:08:12.937311 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-25 13:08:12.937320 | controller | Wednesday 25 February 2026 13:08:12 +0000 (0:00:00.389) 0:00:45.756 **** 2026-02-25 13:08:12.937332 | controller | ok: [instance] 2026-02-25 13:08:12.968291 | controller | 2026-02-25 13:08:12.968324 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-25 13:08:12.968333 | controller | Wednesday 25 February 2026 13:08:12 +0000 (0:00:00.062) 0:00:45.819 **** 2026-02-25 13:08:12.968344 | controller | ok: [instance] 2026-02-25 13:08:13.347168 | controller | 2026-02-25 13:08:13.347211 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-25 13:08:13.347219 | controller | Wednesday 25 February 2026 13:08:12 +0000 (0:00:00.031) 0:00:45.850 **** 2026-02-25 13:08:13.347231 | controller | changed: [instance] 2026-02-25 13:08:13.428846 | controller | 2026-02-25 13:08:13.428875 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2026-02-25 13:08:13.428883 | controller | Wednesday 25 February 2026 13:08:13 +0000 (0:00:00.378) 0:00:46.228 **** 2026-02-25 13:08:13.428895 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2026-02-25 13:08:13.478245 | controller | 2026-02-25 13:08:13.478264 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2026-02-25 13:08:13.478272 | controller | Wednesday 25 February 2026 13:08:13 +0000 (0:00:00.081) 0:00:46.310 **** 2026-02-25 13:08:13.478280 | controller | ok: [instance] => (item=public) 2026-02-25 13:08:13.915621 | controller | ok: [instance] => (item=osp_trunk) 2026-02-25 13:08:13.915684 | controller | 2026-02-25 13:08:13.915696 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2026-02-25 13:08:13.915703 | controller | Wednesday 25 February 2026 13:08:13 +0000 (0:00:00.049) 0:00:46.360 **** 2026-02-25 13:08:13.915714 | controller | changed: [instance] => (item=cifmw-public) 2026-02-25 13:08:14.512425 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-25 13:08:14.512468 | controller | 2026-02-25 13:08:14.512487 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2026-02-25 13:08:14.512494 | controller | Wednesday 25 February 2026 13:08:13 +0000 (0:00:00.436) 0:00:46.797 **** 2026-02-25 13:08:14.512505 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 13:08:14.956209 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 13:08:14.956250 | controller | 2026-02-25 13:08:14.956257 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2026-02-25 13:08:14.956264 | controller | Wednesday 25 February 2026 13:08:14 +0000 (0:00:00.596) 0:00:47.393 **** 2026-02-25 13:08:14.956274 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 13:08:15.389891 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 13:08:15.389954 | controller | 2026-02-25 13:08:15.389968 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2026-02-25 13:08:15.389980 | controller | Wednesday 25 February 2026 13:08:14 +0000 (0:00:00.444) 0:00:47.837 **** 2026-02-25 13:08:15.389998 | controller | changed: [instance] => (item=cifmw-public) 2026-02-25 13:08:15.452761 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-25 13:08:15.452812 | controller | 2026-02-25 13:08:15.452825 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2026-02-25 13:08:15.452836 | controller | Wednesday 25 February 2026 13:08:15 +0000 (0:00:00.433) 0:00:48.271 **** 2026-02-25 13:08:15.452854 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2026-02-25 13:08:15.646481 | controller | 2026-02-25 13:08:15.646525 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2026-02-25 13:08:15.646535 | controller | Wednesday 25 February 2026 13:08:15 +0000 (0:00:00.062) 0:00:48.334 **** 2026-02-25 13:08:15.646546 | controller | ok: [instance] 2026-02-25 13:08:16.039222 | controller | 2026-02-25 13:08:16.039262 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2026-02-25 13:08:16.039271 | controller | Wednesday 25 February 2026 13:08:15 +0000 (0:00:00.193) 0:00:48.528 **** 2026-02-25 13:08:16.039282 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 13:08:16.113055 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 13:08:16.113076 | controller | 2026-02-25 13:08:16.113084 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2026-02-25 13:08:16.113091 | controller | Wednesday 25 February 2026 13:08:16 +0000 (0:00:00.392) 0:00:48.920 **** 2026-02-25 13:08:16.113101 | controller | 2026-02-25 13:08:16.154843 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-25 13:08:16.154875 | controller | Wednesday 25 February 2026 13:08:16 +0000 (0:00:00.074) 0:00:48.995 **** 2026-02-25 13:08:16.154892 | controller | skipping: [instance] 2026-02-25 13:08:16.155170 | controller | 2026-02-25 13:08:16.155201 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2026-02-25 13:08:17.374325 | controller | Wednesday 25 February 2026 13:08:16 +0000 (0:00:00.041) 0:00:49.036 **** 2026-02-25 13:08:17.374375 | controller | ok: [instance] 2026-02-25 13:08:17.558474 | controller | 2026-02-25 13:08:17.558501 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-25 13:08:17.558521 | controller | Wednesday 25 February 2026 13:08:17 +0000 (0:00:01.218) 0:00:50.255 **** 2026-02-25 13:08:17.558531 | controller | ok: [instance] 2026-02-25 13:08:17.909386 | controller | 2026-02-25 13:08:17.909429 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2026-02-25 13:08:17.909438 | controller | Wednesday 25 February 2026 13:08:17 +0000 (0:00:00.184) 0:00:50.440 **** 2026-02-25 13:08:17.909449 | controller | changed: [instance] 2026-02-25 13:08:19.558141 | controller | 2026-02-25 13:08:19.558184 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2026-02-25 13:08:19.558192 | controller | Wednesday 25 February 2026 13:08:17 +0000 (0:00:00.350) 0:00:50.790 **** 2026-02-25 13:08:19.558203 | controller | changed: [instance] 2026-02-25 13:08:19.917802 | controller | 2026-02-25 13:08:19.917847 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2026-02-25 13:08:19.917856 | controller | Wednesday 25 February 2026 13:08:19 +0000 (0:00:01.648) 0:00:52.439 **** 2026-02-25 13:08:19.917869 | controller | changed: [instance] 2026-02-25 13:08:19.951779 | controller | 2026-02-25 13:08:19.951828 | controller | TASK [Create extra network configuration] ************************************** 2026-02-25 13:08:19.951840 | controller | Wednesday 25 February 2026 13:08:19 +0000 (0:00:00.359) 0:00:52.799 **** 2026-02-25 13:08:19.951854 | controller | skipping: [instance] 2026-02-25 13:08:19.951890 | controller | 2026-02-25 13:08:19.951921 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2026-02-25 13:08:19.952073 | controller | Wednesday 25 February 2026 13:08:19 +0000 (0:00:00.034) 0:00:52.833 **** 2026-02-25 13:08:19.980806 | controller | skipping: [instance] 2026-02-25 13:08:19.980906 | controller | 2026-02-25 13:08:19.980963 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2026-02-25 13:08:19.981056 | controller | Wednesday 25 February 2026 13:08:19 +0000 (0:00:00.029) 0:00:52.863 **** 2026-02-25 13:08:20.428581 | controller | ok: [instance] 2026-02-25 13:08:20.571797 | controller | 2026-02-25 13:08:20.571844 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2026-02-25 13:08:20.571854 | controller | Wednesday 25 February 2026 13:08:20 +0000 (0:00:00.447) 0:00:53.310 **** 2026-02-25 13:08:20.571867 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 13:08:20.571897 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 13:08:20.572172 | controller | 2026-02-25 13:08:21.786284 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2026-02-25 13:08:21.786328 | controller | Wednesday 25 February 2026 13:08:20 +0000 (0:00:00.143) 0:00:53.453 **** 2026-02-25 13:08:21.786341 | controller | ok: [instance] 2026-02-25 13:08:25.412934 | controller | 2026-02-25 13:08:25.412980 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2026-02-25 13:08:25.412989 | controller | Wednesday 25 February 2026 13:08:21 +0000 (0:00:01.213) 0:00:54.667 **** 2026-02-25 13:08:25.413001 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2026-02-25 13:08:25.625710 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2026-02-25 13:08:25.625730 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2026-02-25 13:08:25.625738 | controller | 2026-02-25 13:08:25.625743 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2026-02-25 13:08:25.625750 | controller | Wednesday 25 February 2026 13:08:25 +0000 (0:00:03.626) 0:00:58.294 **** 2026-02-25 13:08:25.625758 | controller | changed: [instance] 2026-02-25 13:08:25.986738 | controller | 2026-02-25 13:08:25.986786 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2026-02-25 13:08:25.986796 | controller | Wednesday 25 February 2026 13:08:25 +0000 (0:00:00.213) 0:00:58.507 **** 2026-02-25 13:08:25.986808 | controller | changed: [instance] 2026-02-25 13:08:26.381526 | controller | 2026-02-25 13:08:26.381576 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2026-02-25 13:08:26.381586 | controller | Wednesday 25 February 2026 13:08:25 +0000 (0:00:00.360) 0:00:58.868 **** 2026-02-25 13:08:26.381610 | controller | changed: [instance] 2026-02-25 13:08:26.415301 | controller | 2026-02-25 13:08:26.415344 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2026-02-25 13:08:26.415358 | controller | Wednesday 25 February 2026 13:08:26 +0000 (0:00:00.394) 0:00:59.262 **** 2026-02-25 13:08:26.415377 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2026-02-25 13:08:26.812349 | controller | 2026-02-25 13:08:26.812403 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2026-02-25 13:08:26.812412 | controller | Wednesday 25 February 2026 13:08:26 +0000 (0:00:00.034) 0:00:59.297 **** 2026-02-25 13:08:26.812426 | controller | changed: [instance] 2026-02-25 13:08:26.834435 | controller | 2026-02-25 13:08:26.834463 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2026-02-25 13:08:26.834473 | controller | Wednesday 25 February 2026 13:08:26 +0000 (0:00:00.396) 0:00:59.693 **** 2026-02-25 13:08:26.834485 | controller | skipping: [instance] 2026-02-25 13:08:26.869816 | controller | 2026-02-25 13:08:26.869868 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2026-02-25 13:08:26.869880 | controller | Wednesday 25 February 2026 13:08:26 +0000 (0:00:00.022) 0:00:59.716 **** 2026-02-25 13:08:26.869894 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2026-02-25 13:08:26.869919 | controller | 2026-02-25 13:08:26.869930 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2026-02-25 13:08:26.870025 | controller | Wednesday 25 February 2026 13:08:26 +0000 (0:00:00.035) 0:00:59.751 **** 2026-02-25 13:08:27.258652 | controller | changed: [instance] 2026-02-25 13:08:27.280192 | controller | 2026-02-25 13:08:27.280213 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2026-02-25 13:08:27.280223 | controller | Wednesday 25 February 2026 13:08:27 +0000 (0:00:00.388) 0:01:00.140 **** 2026-02-25 13:08:27.280241 | controller | skipping: [instance] 2026-02-25 13:08:27.491785 | controller | 2026-02-25 13:08:27.491831 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2026-02-25 13:08:27.491841 | controller | Wednesday 25 February 2026 13:08:27 +0000 (0:00:00.021) 0:01:00.162 **** 2026-02-25 13:08:27.491855 | controller | ok: [instance] => (item=127.0.0.2) 2026-02-25 13:08:28.167411 | controller | 2026-02-25 13:08:28.167452 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2026-02-25 13:08:28.167461 | controller | Wednesday 25 February 2026 13:08:27 +0000 (0:00:00.211) 0:01:00.373 **** 2026-02-25 13:08:28.167473 | controller | changed: [instance] 2026-02-25 13:08:28.187555 | controller | 2026-02-25 13:08:28.187577 | controller | TASK [dnsmasq : Stop service] ************************************************** 2026-02-25 13:08:28.187586 | controller | Wednesday 25 February 2026 13:08:28 +0000 (0:00:00.675) 0:01:01.048 **** 2026-02-25 13:08:28.187598 | controller | skipping: [instance] 2026-02-25 13:08:28.206758 | controller | 2026-02-25 13:08:28.206800 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2026-02-25 13:08:28.206808 | controller | Wednesday 25 February 2026 13:08:28 +0000 (0:00:00.020) 0:01:01.069 **** 2026-02-25 13:08:28.206826 | controller | skipping: [instance] 2026-02-25 13:08:28.206832 | controller | 2026-02-25 13:08:28.206837 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2026-02-25 13:08:28.206844 | controller | Wednesday 25 February 2026 13:08:28 +0000 (0:00:00.019) 0:01:01.088 **** 2026-02-25 13:08:28.239798 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-25 13:08:28.239820 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2026-02-25 13:08:28.239830 | controller | skipping: [instance] 2026-02-25 13:08:28.239837 | controller | 2026-02-25 13:08:28.239844 | controller | TASK [Create dnsmasq networks] ************************************************* 2026-02-25 13:08:28.239854 | controller | Wednesday 25 February 2026 13:08:28 +0000 (0:00:00.032) 0:01:01.121 **** 2026-02-25 13:08:28.349591 | controller | 2026-02-25 13:08:28.380143 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-25 13:08:28.380160 | controller | Wednesday 25 February 2026 13:08:28 +0000 (0:00:00.110) 0:01:01.231 **** 2026-02-25 13:08:28.380170 | controller | ok: [instance] => changed=false 2026-02-25 13:08:28.452255 | controller | msg: All assertions passed 2026-02-25 13:08:28.452272 | controller | 2026-02-25 13:08:28.452279 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-25 13:08:28.452284 | controller | Wednesday 25 February 2026 13:08:28 +0000 (0:00:00.030) 0:01:01.262 **** 2026-02-25 13:08:28.452292 | controller | ok: [instance] => changed=false 2026-02-25 13:08:28.452419 | controller | msg: All assertions passed 2026-02-25 13:08:28.452529 | controller | 2026-02-25 13:08:28.452658 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-25 13:08:28.452806 | controller | Wednesday 25 February 2026 13:08:28 +0000 (0:00:00.072) 0:01:01.334 **** 2026-02-25 13:08:28.888533 | controller | changed: [instance] 2026-02-25 13:08:28.909512 | controller | 2026-02-25 13:08:28.909529 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-25 13:08:28.909536 | controller | Wednesday 25 February 2026 13:08:28 +0000 (0:00:00.435) 0:01:01.770 **** 2026-02-25 13:08:28.909544 | controller | skipping: [instance] 2026-02-25 13:08:28.934406 | controller | 2026-02-25 13:08:28.934438 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-25 13:08:28.934451 | controller | Wednesday 25 February 2026 13:08:28 +0000 (0:00:00.021) 0:01:01.791 **** 2026-02-25 13:08:28.934466 | controller | skipping: [instance] 2026-02-25 13:08:28.964795 | controller | 2026-02-25 13:08:28.964817 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-25 13:08:28.964824 | controller | Wednesday 25 February 2026 13:08:28 +0000 (0:00:00.024) 0:01:01.816 **** 2026-02-25 13:08:28.964833 | controller | ok: [instance] => changed=false 2026-02-25 13:08:29.003754 | controller | msg: All assertions passed 2026-02-25 13:08:29.003770 | controller | 2026-02-25 13:08:29.003777 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-25 13:08:29.003787 | controller | Wednesday 25 February 2026 13:08:28 +0000 (0:00:00.030) 0:01:01.846 **** 2026-02-25 13:08:29.003795 | controller | ok: [instance] => changed=false 2026-02-25 13:08:29.438038 | controller | msg: All assertions passed 2026-02-25 13:08:29.438060 | controller | 2026-02-25 13:08:29.438067 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-25 13:08:29.438073 | controller | Wednesday 25 February 2026 13:08:29 +0000 (0:00:00.038) 0:01:01.885 **** 2026-02-25 13:08:29.438082 | controller | changed: [instance] 2026-02-25 13:08:29.460831 | controller | 2026-02-25 13:08:29.460876 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-25 13:08:29.460887 | controller | Wednesday 25 February 2026 13:08:29 +0000 (0:00:00.434) 0:01:02.319 **** 2026-02-25 13:08:29.460901 | controller | skipping: [instance] 2026-02-25 13:08:29.484363 | controller | 2026-02-25 13:08:29.484390 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-25 13:08:29.484401 | controller | Wednesday 25 February 2026 13:08:29 +0000 (0:00:00.022) 0:01:02.342 **** 2026-02-25 13:08:29.484413 | controller | skipping: [instance] 2026-02-25 13:08:29.513263 | controller | 2026-02-25 13:08:29.513287 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2026-02-25 13:08:29.513296 | controller | Wednesday 25 February 2026 13:08:29 +0000 (0:00:00.023) 0:01:02.366 **** 2026-02-25 13:08:29.513307 | controller | skipping: [instance] 2026-02-25 13:08:29.979374 | controller | 2026-02-25 13:08:29.979403 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2026-02-25 13:08:29.979411 | controller | Wednesday 25 February 2026 13:08:29 +0000 (0:00:00.028) 0:01:02.395 **** 2026-02-25 13:08:29.979422 | controller | changed: [instance] => (item=cifmw-public) 2026-02-25 13:08:30.016717 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-25 13:08:30.016759 | controller | 2026-02-25 13:08:30.016768 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-25 13:08:30.016775 | controller | Wednesday 25 February 2026 13:08:29 +0000 (0:00:00.465) 0:01:02.860 **** 2026-02-25 13:08:30.016787 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2026-02-25 13:08:30.353352 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2026-02-25 13:08:30.353392 | controller | 2026-02-25 13:08:30.353400 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-25 13:08:30.353407 | controller | Wednesday 25 February 2026 13:08:30 +0000 (0:00:00.037) 0:01:02.898 **** 2026-02-25 13:08:30.353418 | controller | ok: [instance] 2026-02-25 13:08:30.391809 | controller | 2026-02-25 13:08:30.391985 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-25 13:08:30.392002 | controller | Wednesday 25 February 2026 13:08:30 +0000 (0:00:00.336) 0:01:03.234 **** 2026-02-25 13:08:30.392026 | controller | ok: [instance] 2026-02-25 13:08:30.592422 | controller | 2026-02-25 13:08:30.592460 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-25 13:08:30.592472 | controller | Wednesday 25 February 2026 13:08:30 +0000 (0:00:00.038) 0:01:03.273 **** 2026-02-25 13:08:30.592488 | controller | ok: [instance] 2026-02-25 13:08:30.627834 | controller | 2026-02-25 13:08:30.627878 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-25 13:08:30.627887 | controller | Wednesday 25 February 2026 13:08:30 +0000 (0:00:00.200) 0:01:03.474 **** 2026-02-25 13:08:30.627903 | controller | ok: [instance] 2026-02-25 13:08:30.973867 | controller | 2026-02-25 13:08:30.973916 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2026-02-25 13:08:30.973925 | controller | Wednesday 25 February 2026 13:08:30 +0000 (0:00:00.035) 0:01:03.509 **** 2026-02-25 13:08:30.973935 | controller | changed: [instance] 2026-02-25 13:08:30.973959 | controller | 2026-02-25 13:08:30.974159 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2026-02-25 13:08:31.318625 | controller | Wednesday 25 February 2026 13:08:30 +0000 (0:00:00.345) 0:01:03.855 **** 2026-02-25 13:08:31.318680 | controller | changed: [instance] 2026-02-25 13:08:31.655799 | controller | 2026-02-25 13:08:31.655847 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2026-02-25 13:08:31.655856 | controller | Wednesday 25 February 2026 13:08:31 +0000 (0:00:00.344) 0:01:04.200 **** 2026-02-25 13:08:31.655869 | controller | changed: [instance] 2026-02-25 13:08:31.655895 | controller | 2026-02-25 13:08:31.655904 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2026-02-25 13:08:31.750086 | controller | Wednesday 25 February 2026 13:08:31 +0000 (0:00:00.337) 0:01:04.537 **** 2026-02-25 13:08:31.750124 | controller | ok: [instance] 2026-02-25 13:08:32.082344 | controller | 2026-02-25 13:08:32.082364 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2026-02-25 13:08:32.082371 | controller | Wednesday 25 February 2026 13:08:31 +0000 (0:00:00.094) 0:01:04.631 **** 2026-02-25 13:08:32.082381 | controller | changed: [instance] 2026-02-25 13:08:32.108850 | controller | 2026-02-25 13:08:32.108893 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-25 13:08:32.108904 | controller | Wednesday 25 February 2026 13:08:32 +0000 (0:00:00.332) 0:01:04.964 **** 2026-02-25 13:08:32.108917 | controller | skipping: [instance] 2026-02-25 13:08:32.133745 | controller | 2026-02-25 13:08:32.133767 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-25 13:08:32.133775 | controller | Wednesday 25 February 2026 13:08:32 +0000 (0:00:00.026) 0:01:04.990 **** 2026-02-25 13:08:32.133785 | controller | skipping: [instance] 2026-02-25 13:08:32.160814 | controller | 2026-02-25 13:08:32.160840 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-25 13:08:32.160850 | controller | Wednesday 25 February 2026 13:08:32 +0000 (0:00:00.025) 0:01:05.015 **** 2026-02-25 13:08:32.160861 | controller | skipping: [instance] 2026-02-25 13:08:32.161065 | controller | 2026-02-25 13:08:32.161091 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-25 13:08:32.186856 | controller | Wednesday 25 February 2026 13:08:32 +0000 (0:00:00.027) 0:01:05.042 **** 2026-02-25 13:08:32.186905 | controller | skipping: [instance] 2026-02-25 13:08:32.186948 | controller | 2026-02-25 13:08:32.186963 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-25 13:08:32.187019 | controller | Wednesday 25 February 2026 13:08:32 +0000 (0:00:00.025) 0:01:05.068 **** 2026-02-25 13:08:32.208323 | controller | ok: [instance] 2026-02-25 13:08:32.306652 | controller | 2026-02-25 13:08:32.306706 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-25 13:08:32.306717 | controller | Wednesday 25 February 2026 13:08:32 +0000 (0:00:00.021) 0:01:05.090 **** 2026-02-25 13:08:32.306733 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-25 13:08:32.328095 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-25 13:08:32.328134 | controller | 2026-02-25 13:08:32.328147 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-25 13:08:32.328158 | controller | Wednesday 25 February 2026 13:08:32 +0000 (0:00:00.097) 0:01:05.188 **** 2026-02-25 13:08:32.328173 | controller | skipping: [instance] 2026-02-25 13:08:32.328410 | controller | 2026-02-25 13:08:32.328653 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-25 13:08:32.328960 | controller | Wednesday 25 February 2026 13:08:32 +0000 (0:00:00.021) 0:01:05.210 **** 2026-02-25 13:08:32.528874 | controller | ok: [instance] 2026-02-25 13:08:32.528930 | controller | 2026-02-25 13:08:32.528944 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-25 13:08:32.528960 | controller | Wednesday 25 February 2026 13:08:32 +0000 (0:00:00.200) 0:01:05.410 **** 2026-02-25 13:08:32.921969 | controller | changed: [instance] 2026-02-25 13:08:32.922011 | controller | 2026-02-25 13:08:32.922020 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-25 13:08:32.922032 | controller | Wednesday 25 February 2026 13:08:32 +0000 (0:00:00.392) 0:01:05.803 **** 2026-02-25 13:08:32.983862 | controller | ok: [instance] 2026-02-25 13:08:32.984075 | controller | 2026-02-25 13:08:32.984117 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-25 13:08:33.017907 | controller | Wednesday 25 February 2026 13:08:32 +0000 (0:00:00.062) 0:01:05.865 **** 2026-02-25 13:08:33.017976 | controller | ok: [instance] 2026-02-25 13:08:33.018028 | controller | 2026-02-25 13:08:33.018044 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-25 13:08:33.018173 | controller | Wednesday 25 February 2026 13:08:33 +0000 (0:00:00.033) 0:01:05.899 **** 2026-02-25 13:08:33.430846 | controller | changed: [instance] 2026-02-25 13:08:33.430883 | controller | 2026-02-25 13:08:33.430892 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2026-02-25 13:08:33.430903 | controller | Wednesday 25 February 2026 13:08:33 +0000 (0:00:00.413) 0:01:06.312 **** 2026-02-25 13:08:33.460829 | controller | ok: [instance] 2026-02-25 13:08:33.460900 | controller | 2026-02-25 13:08:33.460920 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2026-02-25 13:08:33.460931 | controller | Wednesday 25 February 2026 13:08:33 +0000 (0:00:00.030) 0:01:06.342 **** 2026-02-25 13:08:33.480876 | controller | ok: [instance] 2026-02-25 13:08:33.480948 | controller | 2026-02-25 13:08:33.481308 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2026-02-25 13:08:33.500405 | controller | Wednesday 25 February 2026 13:08:33 +0000 (0:00:00.019) 0:01:06.362 **** 2026-02-25 13:08:33.500425 | controller | ok: [instance] 2026-02-25 13:08:33.572849 | controller | 2026-02-25 13:08:33.572899 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2026-02-25 13:08:33.572915 | controller | Wednesday 25 February 2026 13:08:33 +0000 (0:00:00.019) 0:01:06.382 **** 2026-02-25 13:08:33.572930 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2026-02-25 13:08:33.572964 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2026-02-25 13:08:33.572975 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2026-02-25 13:08:33.573756 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2026-02-25 13:08:33.703759 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2026-02-25 13:08:33.703838 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2026-02-25 13:08:33.703846 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2026-02-25 13:08:33.703851 | controller | 2026-02-25 13:08:33.703857 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 13:08:33.703864 | controller | Wednesday 25 February 2026 13:08:33 +0000 (0:00:00.072) 0:01:06.454 **** 2026-02-25 13:08:33.703877 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2026-02-25 13:08:33.703958 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2026-02-25 13:08:33.703970 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2026-02-25 13:08:33.704053 | controller | 2026-02-25 13:08:33.704154 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 13:08:33.704253 | controller | Wednesday 25 February 2026 13:08:33 +0000 (0:00:00.131) 0:01:06.585 **** 2026-02-25 13:08:33.783361 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2026-02-25 13:08:33.783579 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2026-02-25 13:08:33.783830 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2026-02-25 13:08:33.783933 | controller | skipping: [instance] 2026-02-25 13:08:33.784025 | controller | 2026-02-25 13:08:33.784133 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 13:08:33.784230 | controller | Wednesday 25 February 2026 13:08:33 +0000 (0:00:00.079) 0:01:06.665 **** 2026-02-25 13:08:33.898588 | controller | skipping: [instance] => (item=compute-0 - storage) 2026-02-25 13:08:33.898741 | controller | skipping: [instance] => (item=controller-0 - storage) 2026-02-25 13:08:33.898860 | controller | skipping: [instance] => (item=crc-0 - storage) 2026-02-25 13:08:33.898968 | controller | skipping: [instance] 2026-02-25 13:08:33.899069 | controller | 2026-02-25 13:08:33.899178 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 13:08:33.899312 | controller | Wednesday 25 February 2026 13:08:33 +0000 (0:00:00.115) 0:01:06.780 **** 2026-02-25 13:08:33.983172 | controller | skipping: [instance] => (item=compute-0 - tenant) 2026-02-25 13:08:33.983295 | controller | skipping: [instance] => (item=controller-0 - tenant) 2026-02-25 13:08:33.983395 | controller | skipping: [instance] => (item=crc-0 - tenant) 2026-02-25 13:08:33.983494 | controller | skipping: [instance] 2026-02-25 13:08:33.983585 | controller | 2026-02-25 13:08:33.983692 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 13:08:33.983835 | controller | Wednesday 25 February 2026 13:08:33 +0000 (0:00:00.084) 0:01:06.865 **** 2026-02-25 13:08:34.066985 | controller | skipping: [instance] => (item=compute-0 - external) 2026-02-25 13:08:34.067104 | controller | skipping: [instance] => (item=controller-0 - external) 2026-02-25 13:08:34.067236 | controller | skipping: [instance] => (item=crc-0 - external) 2026-02-25 13:08:34.067353 | controller | skipping: [instance] 2026-02-25 13:08:34.067453 | controller | 2026-02-25 13:08:34.067551 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 13:08:34.067657 | controller | Wednesday 25 February 2026 13:08:34 +0000 (0:00:00.083) 0:01:06.949 **** 2026-02-25 13:08:34.194057 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2026-02-25 13:08:34.194287 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2026-02-25 13:08:34.194490 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2026-02-25 13:08:34.194653 | controller | skipping: [instance] 2026-02-25 13:08:34.194787 | controller | 2026-02-25 13:08:34.194894 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-25 13:08:34.194998 | controller | Wednesday 25 February 2026 13:08:34 +0000 (0:00:00.126) 0:01:07.076 **** 2026-02-25 13:08:34.332347 | controller | ok: [instance] => (item=compute-0 - public) 2026-02-25 13:08:34.332571 | controller | ok: [instance] => (item=controller-0 - public) 2026-02-25 13:08:34.333300 | controller | ok: [instance] => (item=crc-0 - public) 2026-02-25 13:08:34.443816 | controller | 2026-02-25 13:08:34.443841 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2026-02-25 13:08:34.443850 | controller | Wednesday 25 February 2026 13:08:34 +0000 (0:00:00.138) 0:01:07.214 **** 2026-02-25 13:08:34.443860 | controller | 2026-02-25 13:08:34.443990 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2026-02-25 13:08:34.444099 | controller | Wednesday 25 February 2026 13:08:34 +0000 (0:00:00.111) 0:01:07.326 **** 2026-02-25 13:08:34.486905 | controller | ok: [instance] 2026-02-25 13:08:34.487046 | controller | 2026-02-25 13:08:34.487158 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2026-02-25 13:08:34.487263 | controller | Wednesday 25 February 2026 13:08:34 +0000 (0:00:00.043) 0:01:07.369 **** 2026-02-25 13:08:34.587198 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:75:6f:61', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-25 13:08:34.587431 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:31:96:0d', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-25 13:08:34.587624 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:b0:92:be', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-25 13:08:34.587730 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:b5:ae:13', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-25 13:08:34.587850 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:22:4e:61', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-25 13:08:34.587948 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:80:af:27', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-25 13:08:34.588046 | controller | 2026-02-25 13:08:34.588149 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2026-02-25 13:08:34.588272 | controller | Wednesday 25 February 2026 13:08:34 +0000 (0:00:00.100) 0:01:07.469 **** 2026-02-25 13:08:34.641245 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2026-02-25 13:08:34.641501 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2026-02-25 13:08:34.641580 | controller | 2026-02-25 13:08:34.641724 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-25 13:08:34.641837 | controller | Wednesday 25 February 2026 13:08:34 +0000 (0:00:00.054) 0:01:07.523 **** 2026-02-25 13:08:34.817622 | controller | ok: [instance] 2026-02-25 13:08:34.840772 | controller | 2026-02-25 13:08:34.840809 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-25 13:08:34.840818 | controller | Wednesday 25 February 2026 13:08:34 +0000 (0:00:00.176) 0:01:07.699 **** 2026-02-25 13:08:34.840830 | controller | ok: [instance] 2026-02-25 13:08:35.013252 | controller | 2026-02-25 13:08:35.013279 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-25 13:08:35.013286 | controller | Wednesday 25 February 2026 13:08:34 +0000 (0:00:00.023) 0:01:07.722 **** 2026-02-25 13:08:35.013296 | controller | ok: [instance] 2026-02-25 13:08:35.036113 | controller | 2026-02-25 13:08:35.036135 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-25 13:08:35.036144 | controller | Wednesday 25 February 2026 13:08:35 +0000 (0:00:00.172) 0:01:07.895 **** 2026-02-25 13:08:35.036155 | controller | ok: [instance] 2026-02-25 13:08:35.055313 | controller | 2026-02-25 13:08:35.055328 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2026-02-25 13:08:35.055335 | controller | Wednesday 25 February 2026 13:08:35 +0000 (0:00:00.022) 0:01:07.918 **** 2026-02-25 13:08:35.055343 | controller | ok: [instance] 2026-02-25 13:08:35.227622 | controller | 2026-02-25 13:08:35.227643 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2026-02-25 13:08:35.227650 | controller | Wednesday 25 February 2026 13:08:35 +0000 (0:00:00.019) 0:01:07.937 **** 2026-02-25 13:08:35.227659 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:75:6f:61', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-25 13:08:35.267492 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:31:96:0d', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-25 13:08:35.267525 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:b0:92:be', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-25 13:08:35.267538 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:b5:ae:13', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-25 13:08:35.267549 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:22:4e:61', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-25 13:08:35.267558 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:80:af:27', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-25 13:08:35.267568 | controller | 2026-02-25 13:08:35.267578 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2026-02-25 13:08:35.267587 | controller | Wednesday 25 February 2026 13:08:35 +0000 (0:00:00.171) 0:01:08.108 **** 2026-02-25 13:08:35.267602 | controller | ok: [instance] 2026-02-25 13:08:37.409807 | controller | 2026-02-25 13:08:37.409866 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2026-02-25 13:08:37.409874 | controller | Wednesday 25 February 2026 13:08:35 +0000 (0:00:00.040) 0:01:08.149 **** 2026-02-25 13:08:37.409888 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:75:6f:61', 'entry': 'set:compute,52:54:00:75:6f:61,192.168.140.100,compute-0', 'state': 'present'}) 2026-02-25 13:08:37.409919 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:31:96:0d', 'entry': 'set:controller,52:54:01:31:96:0d,192.168.140.9,controller-0', 'state': 'present'}) 2026-02-25 13:08:37.409925 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:b0:92:be', 'entry': 'set:ocp,52:54:02:b0:92:be,192.168.140.10,crc-0', 'state': 'present'}) 2026-02-25 13:08:37.409932 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:b5:ae:13', 'entry': 'set:compute,52:54:00:b5:ae:13,192.168.101.100,compute-0', 'state': 'present'}) 2026-02-25 13:08:37.409956 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:22:4e:61', 'entry': 'set:controller,52:54:01:22:4e:61,192.168.101.9,controller-0', 'state': 'present'}) 2026-02-25 13:08:37.410384 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:80:af:27', 'entry': 'set:ocp,52:54:02:80:af:27,192.168.101.10,crc-0', 'state': 'present'}) 2026-02-25 13:08:37.433339 | controller | 2026-02-25 13:08:37.433366 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2026-02-25 13:08:37.433383 | controller | Wednesday 25 February 2026 13:08:37 +0000 (0:00:02.142) 0:01:10.291 **** 2026-02-25 13:08:37.433397 | controller | skipping: [instance] 2026-02-25 13:08:37.649404 | controller | 2026-02-25 13:08:37.649427 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2026-02-25 13:08:37.649434 | controller | Wednesday 25 February 2026 13:08:37 +0000 (0:00:00.024) 0:01:10.315 **** 2026-02-25 13:08:37.649444 | controller | ok: [instance] => (item=compute-0) 2026-02-25 13:08:37.767020 | controller | ok: [instance] => (item=controller-0) 2026-02-25 13:08:37.767054 | controller | ok: [instance] => (item=crc-0) 2026-02-25 13:08:37.767068 | controller | 2026-02-25 13:08:37.767078 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2026-02-25 13:08:37.767088 | controller | Wednesday 25 February 2026 13:08:37 +0000 (0:00:00.215) 0:01:10.530 **** 2026-02-25 13:08:37.767103 | controller | 2026-02-25 13:08:37.811059 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-25 13:08:37.811092 | controller | Wednesday 25 February 2026 13:08:37 +0000 (0:00:00.117) 0:01:10.648 **** 2026-02-25 13:08:37.811111 | controller | ok: [instance] 2026-02-25 13:08:37.811348 | controller | 2026-02-25 13:08:37.811536 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-25 13:08:37.811696 | controller | Wednesday 25 February 2026 13:08:37 +0000 (0:00:00.044) 0:01:10.693 **** 2026-02-25 13:08:38.020161 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 13:08:38.020442 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 13:08:38.020736 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-25 13:08:38.020956 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-25 13:08:38.021080 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-25 13:08:38.021204 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-25 13:08:38.021319 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-25 13:08:38.021438 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 13:08:38.021561 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 13:08:38.021695 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-25 13:08:38.021832 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 13:08:38.021948 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 13:08:38.022060 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-25 13:08:38.022170 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-25 13:08:38.022281 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-25 13:08:38.022451 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-25 13:08:38.022560 | controller | 2026-02-25 13:08:38.022686 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-25 13:08:38.022833 | controller | Wednesday 25 February 2026 13:08:38 +0000 (0:00:00.208) 0:01:10.902 **** 2026-02-25 13:08:41.148856 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 13:08:41.148948 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 13:08:41.148964 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-25 13:08:41.148979 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-25 13:08:41.150285 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-25 13:08:41.150333 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-25 13:08:41.529835 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-25 13:08:41.529873 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 13:08:41.529882 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 13:08:41.529889 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-25 13:08:41.529896 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 13:08:41.529902 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 13:08:41.529908 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-25 13:08:41.529914 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-25 13:08:41.529920 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-25 13:08:41.529927 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-25 13:08:41.529933 | controller | 2026-02-25 13:08:41.529940 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-25 13:08:41.529948 | controller | Wednesday 25 February 2026 13:08:41 +0000 (0:00:03.128) 0:01:14.030 **** 2026-02-25 13:08:41.529960 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 13:08:41.529987 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-25 13:08:41.529998 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-25 13:08:41.530004 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-25 13:08:41.530011 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-25 13:08:41.530019 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-25 13:08:41.530764 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-25 13:08:41.530788 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 13:08:41.530952 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 13:08:41.530967 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-25 13:08:41.530974 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 13:08:41.530979 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-25 13:08:41.530984 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-25 13:08:41.530989 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-25 13:08:41.530994 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-25 13:08:41.531000 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-25 13:08:41.531010 | controller | 2026-02-25 13:08:41.531018 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2026-02-25 13:08:41.551780 | controller | Wednesday 25 February 2026 13:08:41 +0000 (0:00:00.381) 0:01:14.411 **** 2026-02-25 13:08:41.551809 | controller | ok: [instance] 2026-02-25 13:08:41.649789 | controller | 2026-02-25 13:08:41.649809 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2026-02-25 13:08:41.649818 | controller | Wednesday 25 February 2026 13:08:41 +0000 (0:00:00.022) 0:01:14.433 **** 2026-02-25 13:08:41.649828 | controller | skipping: [instance] => (item=compute) 2026-02-25 13:08:41.650052 | controller | skipping: [instance] => (item=controller) 2026-02-25 13:08:41.650067 | controller | skipping: [instance] => (item=crc) 2026-02-25 13:08:41.650074 | controller | skipping: [instance] 2026-02-25 13:08:41.650082 | controller | 2026-02-25 13:08:41.682883 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2026-02-25 13:08:41.682935 | controller | Wednesday 25 February 2026 13:08:41 +0000 (0:00:00.098) 0:01:14.531 **** 2026-02-25 13:08:41.682957 | controller | skipping: [instance] 2026-02-25 13:08:42.062829 | controller | 2026-02-25 13:08:42.062875 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2026-02-25 13:08:42.062886 | controller | Wednesday 25 February 2026 13:08:41 +0000 (0:00:00.033) 0:01:14.564 **** 2026-02-25 13:08:42.062903 | controller | changed: [instance] 2026-02-25 13:08:42.062932 | controller | 2026-02-25 13:08:42.062940 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2026-02-25 13:08:42.062946 | controller | Wednesday 25 February 2026 13:08:42 +0000 (0:00:00.368) 0:01:14.933 **** 2026-02-25 13:08:42.062955 | controller | 2026-02-25 13:08:42.062980 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-25 13:08:42.063114 | controller | Wednesday 25 February 2026 13:08:42 +0000 (0:00:00.010) 0:01:14.944 **** 2026-02-25 13:08:42.696782 | controller | changed: [instance] 2026-02-25 13:08:43.055479 | controller | 2026-02-25 13:08:43.055527 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-25 13:08:43.055536 | controller | Wednesday 25 February 2026 13:08:42 +0000 (0:00:00.634) 0:01:15.578 **** 2026-02-25 13:08:43.055548 | controller | changed: [instance] 2026-02-25 13:08:43.397818 | controller | 2026-02-25 13:08:43.397862 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2026-02-25 13:08:43.397873 | controller | Wednesday 25 February 2026 13:08:43 +0000 (0:00:00.358) 0:01:15.936 **** 2026-02-25 13:08:43.397886 | controller | changed: [instance] 2026-02-25 13:08:43.397915 | controller | 2026-02-25 13:08:43.397925 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2026-02-25 13:08:43.397996 | controller | Wednesday 25 February 2026 13:08:43 +0000 (0:00:00.342) 0:01:16.279 **** 2026-02-25 13:08:43.760823 | controller | changed: [instance] 2026-02-25 13:08:43.760888 | controller | 2026-02-25 13:08:43.760897 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2026-02-25 13:08:43.760907 | controller | Wednesday 25 February 2026 13:08:43 +0000 (0:00:00.362) 0:01:16.642 **** 2026-02-25 13:08:44.135678 | controller | changed: [instance] 2026-02-25 13:08:44.135820 | controller | 2026-02-25 13:08:44.135881 | controller | TASK [Build utility records dataset] ******************************************* 2026-02-25 13:08:44.135963 | controller | Wednesday 25 February 2026 13:08:44 +0000 (0:00:00.374) 0:01:17.017 **** 2026-02-25 13:08:44.169429 | controller | 2026-02-25 13:08:44.260629 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-25 13:08:44.260654 | controller | Wednesday 25 February 2026 13:08:44 +0000 (0:00:00.033) 0:01:17.051 **** 2026-02-25 13:08:44.260688 | controller | ok: [instance] 2026-02-25 13:08:44.357777 | controller | 2026-02-25 13:08:44.357820 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-25 13:08:44.357830 | controller | Wednesday 25 February 2026 13:08:44 +0000 (0:00:00.091) 0:01:17.142 **** 2026-02-25 13:08:44.357846 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-25 13:08:44.811412 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 13:08:44.811452 | controller | 2026-02-25 13:08:44.811460 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-25 13:08:44.811467 | controller | Wednesday 25 February 2026 13:08:44 +0000 (0:00:00.097) 0:01:17.239 **** 2026-02-25 13:08:44.811478 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-25 13:08:45.108496 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 13:08:45.108533 | controller | 2026-02-25 13:08:45.108542 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-25 13:08:45.108550 | controller | Wednesday 25 February 2026 13:08:44 +0000 (0:00:00.453) 0:01:17.692 **** 2026-02-25 13:08:45.108562 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-25 13:08:45.573187 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-25 13:08:45.573241 | controller | 2026-02-25 13:08:45.573249 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-25 13:08:45.573257 | controller | Wednesday 25 February 2026 13:08:45 +0000 (0:00:00.286) 0:01:17.979 **** 2026-02-25 13:08:45.573262 | controller | 2026-02-25 13:08:45.573268 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-25 13:08:45.573273 | controller | Wednesday 25 February 2026 13:08:45 +0000 (0:00:00.010) 0:01:17.989 **** 2026-02-25 13:08:45.573284 | controller | changed: [instance] 2026-02-25 13:08:45.934831 | controller | 2026-02-25 13:08:45.934899 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-25 13:08:45.934915 | controller | Wednesday 25 February 2026 13:08:45 +0000 (0:00:00.464) 0:01:18.454 **** 2026-02-25 13:08:45.934939 | controller | changed: [instance] 2026-02-25 13:08:45.935008 | controller | 2026-02-25 13:08:45.935122 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2026-02-25 13:08:45.935170 | controller | Wednesday 25 February 2026 13:08:45 +0000 (0:00:00.362) 0:01:18.816 **** 2026-02-25 13:08:45.970867 | controller | skipping: [instance] 2026-02-25 13:08:46.048250 | controller | 2026-02-25 13:08:46.048282 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2026-02-25 13:08:46.048291 | controller | Wednesday 25 February 2026 13:08:45 +0000 (0:00:00.035) 0:01:18.852 **** 2026-02-25 13:08:46.048302 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2026-02-25 13:08:46.241189 | controller | 2026-02-25 13:08:46.241248 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2026-02-25 13:08:46.241264 | controller | Wednesday 25 February 2026 13:08:46 +0000 (0:00:00.077) 0:01:18.929 **** 2026-02-25 13:08:46.241283 | controller | ok: [instance] 2026-02-25 13:08:46.262737 | controller | 2026-02-25 13:08:46.262783 | controller | TASK [Deploy CRC if needed] **************************************************** 2026-02-25 13:08:46.262793 | controller | Wednesday 25 February 2026 13:08:46 +0000 (0:00:00.192) 0:01:19.122 **** 2026-02-25 13:08:46.262820 | controller | skipping: [instance] 2026-02-25 13:08:46.627115 | controller | 2026-02-25 13:08:46.627149 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2026-02-25 13:08:46.627159 | controller | Wednesday 25 February 2026 13:08:46 +0000 (0:00:00.021) 0:01:19.144 **** 2026-02-25 13:08:46.627171 | controller | ok: [instance] 2026-02-25 13:08:46.861852 | controller | 2026-02-25 13:08:46.861902 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2026-02-25 13:08:46.861916 | controller | Wednesday 25 February 2026 13:08:46 +0000 (0:00:00.364) 0:01:19.508 **** 2026-02-25 13:08:46.861933 | controller | ok: [instance] 2026-02-25 13:08:47.096216 | controller | 2026-02-25 13:08:47.096262 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2026-02-25 13:08:47.096271 | controller | Wednesday 25 February 2026 13:08:46 +0000 (0:00:00.234) 0:01:19.743 **** 2026-02-25 13:08:47.096283 | controller | ok: [instance] 2026-02-25 13:08:47.312150 | controller | 2026-02-25 13:08:47.312169 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2026-02-25 13:08:47.312176 | controller | Wednesday 25 February 2026 13:08:47 +0000 (0:00:00.234) 0:01:19.977 **** 2026-02-25 13:08:47.312185 | controller | ok: [instance] 2026-02-25 13:08:47.536902 | controller | 2026-02-25 13:08:47.536965 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2026-02-25 13:08:47.536980 | controller | Wednesday 25 February 2026 13:08:47 +0000 (0:00:00.216) 0:01:20.194 **** 2026-02-25 13:08:47.536998 | controller | ok: [instance] 2026-02-25 13:08:47.537041 | controller | 2026-02-25 13:08:47.537056 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-25 13:08:47.537095 | controller | Wednesday 25 February 2026 13:08:47 +0000 (0:00:00.224) 0:01:20.418 **** 2026-02-25 13:08:47.588150 | controller | 2026-02-25 13:08:47.771813 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-25 13:08:47.771860 | controller | Wednesday 25 February 2026 13:08:47 +0000 (0:00:00.051) 0:01:20.470 **** 2026-02-25 13:08:47.771876 | controller | ok: [instance] 2026-02-25 13:08:47.771927 | controller | 2026-02-25 13:08:47.771956 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-25 13:08:47.771969 | controller | Wednesday 25 February 2026 13:08:47 +0000 (0:00:00.183) 0:01:20.653 **** 2026-02-25 13:08:47.795128 | controller | ok: [instance] 2026-02-25 13:08:47.795195 | controller | 2026-02-25 13:08:47.795372 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-25 13:08:47.819912 | controller | Wednesday 25 February 2026 13:08:47 +0000 (0:00:00.023) 0:01:20.677 **** 2026-02-25 13:08:47.819955 | controller | skipping: [instance] 2026-02-25 13:08:48.108305 | controller | 2026-02-25 13:08:48.108328 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2026-02-25 13:08:48.108336 | controller | Wednesday 25 February 2026 13:08:47 +0000 (0:00:00.024) 0:01:20.701 **** 2026-02-25 13:08:48.108346 | controller | ok: [instance] 2026-02-25 13:08:48.362370 | controller | 2026-02-25 13:08:48.362416 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2026-02-25 13:08:48.362425 | controller | Wednesday 25 February 2026 13:08:48 +0000 (0:00:00.288) 0:01:20.990 **** 2026-02-25 13:08:48.362436 | controller | ok: [instance] 2026-02-25 13:08:48.547865 | controller | 2026-02-25 13:08:48.548088 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2026-02-25 13:08:48.548099 | controller | Wednesday 25 February 2026 13:08:48 +0000 (0:00:00.253) 0:01:21.244 **** 2026-02-25 13:08:48.548110 | controller | ok: [instance] 2026-02-25 13:08:48.642257 | controller | 2026-02-25 13:08:48.642274 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2026-02-25 13:08:48.642281 | controller | Wednesday 25 February 2026 13:08:48 +0000 (0:00:00.185) 0:01:21.429 **** 2026-02-25 13:08:48.642289 | controller | 2026-02-25 13:08:48.687873 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-25 13:08:48.687918 | controller | Wednesday 25 February 2026 13:08:48 +0000 (0:00:00.094) 0:01:21.524 **** 2026-02-25 13:08:48.687933 | controller | ok: [instance] => changed=false 2026-02-25 13:08:48.687973 | controller | msg: All assertions passed 2026-02-25 13:08:48.687987 | controller | 2026-02-25 13:08:48.687997 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-25 13:08:48.688007 | controller | Wednesday 25 February 2026 13:08:48 +0000 (0:00:00.045) 0:01:21.569 **** 2026-02-25 13:08:48.864770 | controller | ok: [instance] 2026-02-25 13:08:48.864965 | controller | 2026-02-25 13:08:48.864996 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-25 13:08:48.865015 | controller | Wednesday 25 February 2026 13:08:48 +0000 (0:00:00.177) 0:01:21.746 **** 2026-02-25 13:08:49.045006 | controller | ok: [instance] 2026-02-25 13:08:49.070579 | controller | 2026-02-25 13:08:49.070611 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-25 13:08:49.070624 | controller | Wednesday 25 February 2026 13:08:49 +0000 (0:00:00.180) 0:01:21.927 **** 2026-02-25 13:08:49.070640 | controller | ok: [instance] => changed=false 2026-02-25 13:08:49.248583 | controller | msg: All assertions passed 2026-02-25 13:08:49.248601 | controller | 2026-02-25 13:08:49.248608 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-25 13:08:49.248614 | controller | Wednesday 25 February 2026 13:08:49 +0000 (0:00:00.025) 0:01:21.952 **** 2026-02-25 13:08:49.248622 | controller | ok: [instance] 2026-02-25 13:08:49.419868 | controller | 2026-02-25 13:08:49.419915 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-25 13:08:49.419929 | controller | Wednesday 25 February 2026 13:08:49 +0000 (0:00:00.178) 0:01:22.130 **** 2026-02-25 13:08:49.419947 | controller | ok: [instance] 2026-02-25 13:08:49.469901 | controller | 2026-02-25 13:08:49.469943 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-25 13:08:49.469953 | controller | Wednesday 25 February 2026 13:08:49 +0000 (0:00:00.170) 0:01:22.301 **** 2026-02-25 13:08:49.469966 | controller | ok: [instance] 2026-02-25 13:08:49.469992 | controller | 2026-02-25 13:08:49.469999 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2026-02-25 13:08:49.470007 | controller | Wednesday 25 February 2026 13:08:49 +0000 (0:00:00.049) 0:01:22.351 **** 2026-02-25 13:08:49.842449 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2026-02-25 13:08:49.863515 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2026-02-25 13:08:49.863532 | controller | 2026-02-25 13:08:49.863540 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2026-02-25 13:08:49.863546 | controller | Wednesday 25 February 2026 13:08:49 +0000 (0:00:00.372) 0:01:22.724 **** 2026-02-25 13:08:49.863556 | controller | skipping: [instance] 2026-02-25 13:08:49.888326 | controller | 2026-02-25 13:08:49.888358 | controller | TASK [Load the architecture local kustomize patches] *************************** 2026-02-25 13:08:49.888377 | controller | Wednesday 25 February 2026 13:08:49 +0000 (0:00:00.020) 0:01:22.745 **** 2026-02-25 13:08:49.888394 | controller | skipping: [instance] 2026-02-25 13:08:50.014968 | controller | 2026-02-25 13:08:50.014988 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2026-02-25 13:08:50.014997 | controller | Wednesday 25 February 2026 13:08:49 +0000 (0:00:00.024) 0:01:22.769 **** 2026-02-25 13:08:50.015007 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2026-02-25 13:08:50.040900 | controller | 2026-02-25 13:08:50.040945 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2026-02-25 13:08:50.040955 | controller | Wednesday 25 February 2026 13:08:50 +0000 (0:00:00.127) 0:01:22.896 **** 2026-02-25 13:08:50.040968 | controller | skipping: [instance] 2026-02-25 13:08:50.040998 | controller | 2026-02-25 13:08:50.041007 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2026-02-25 13:08:50.041070 | controller | Wednesday 25 February 2026 13:08:50 +0000 (0:00:00.025) 0:01:22.922 **** 2026-02-25 13:08:50.444119 | controller | changed: [instance] 2026-02-25 13:08:50.968776 | controller | 2026-02-25 13:08:50.968818 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2026-02-25 13:08:50.968829 | controller | Wednesday 25 February 2026 13:08:50 +0000 (0:00:00.403) 0:01:23.326 **** 2026-02-25 13:08:50.968842 | controller | changed: [instance] 2026-02-25 13:08:50.968891 | controller | 2026-02-25 13:08:50.968904 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2026-02-25 13:08:50.969218 | controller | Wednesday 25 February 2026 13:08:50 +0000 (0:00:00.514) 0:01:23.840 **** 2026-02-25 13:08:50.969253 | controller | 2026-02-25 13:08:51.390002 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-25 13:08:51.390043 | controller | Wednesday 25 February 2026 13:08:50 +0000 (0:00:00.010) 0:01:23.850 **** 2026-02-25 13:08:51.390055 | controller | changed: [instance] 2026-02-25 13:08:51.390080 | controller | 2026-02-25 13:08:51.390089 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-25 13:08:51.390193 | controller | Wednesday 25 February 2026 13:08:51 +0000 (0:00:00.421) 0:01:24.271 **** 2026-02-25 13:08:52.031773 | controller | changed: [instance] 2026-02-25 13:08:52.065175 | controller | 2026-02-25 13:08:52.065209 | controller | TASK [Deploy virtualbmc] ******************************************************* 2026-02-25 13:08:52.065218 | controller | Wednesday 25 February 2026 13:08:52 +0000 (0:00:00.641) 0:01:24.913 **** 2026-02-25 13:08:52.065229 | controller | skipping: [instance] 2026-02-25 13:08:52.098156 | controller | 2026-02-25 13:08:52.098174 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2026-02-25 13:08:52.098181 | controller | Wednesday 25 February 2026 13:08:52 +0000 (0:00:00.033) 0:01:24.947 **** 2026-02-25 13:08:52.098189 | controller | skipping: [instance] 2026-02-25 13:08:52.630581 | controller | 2026-02-25 13:08:52.630625 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2026-02-25 13:08:52.630633 | controller | Wednesday 25 February 2026 13:08:52 +0000 (0:00:00.033) 0:01:24.980 **** 2026-02-25 13:08:52.630644 | controller | changed: [instance] => (item=workload) 2026-02-25 13:08:53.040801 | controller | changed: [instance] => (item=reproducer-inventory) 2026-02-25 13:08:53.040847 | controller | ok: [instance] => (item=volumes) 2026-02-25 13:08:53.040859 | controller | 2026-02-25 13:08:53.040866 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2026-02-25 13:08:53.040882 | controller | Wednesday 25 February 2026 13:08:52 +0000 (0:00:00.531) 0:01:25.511 **** 2026-02-25 13:08:53.040893 | controller | changed: [instance] => (item=workload) 2026-02-25 13:08:53.040918 | controller | changed: [instance] => (item=volumes) 2026-02-25 13:08:53.040926 | controller | 2026-02-25 13:08:53.040949 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2026-02-25 13:08:53.041105 | controller | Wednesday 25 February 2026 13:08:53 +0000 (0:00:00.410) 0:01:25.922 **** 2026-02-25 13:08:53.065829 | controller | skipping: [instance] 2026-02-25 13:08:53.066013 | controller | 2026-02-25 13:08:53.066037 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2026-02-25 13:08:53.066054 | controller | Wednesday 25 February 2026 13:08:53 +0000 (0:00:00.025) 0:01:25.947 **** 2026-02-25 13:08:54.046806 | controller | changed: [instance] => (item=compute) 2026-02-25 13:08:54.046866 | controller | changed: [instance] => (item=controller) 2026-02-25 13:08:54.047369 | controller | changed: [instance] => (item=crc) 2026-02-25 13:08:54.079119 | controller | 2026-02-25 13:08:54.079146 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2026-02-25 13:08:54.079155 | controller | Wednesday 25 February 2026 13:08:54 +0000 (0:00:00.980) 0:01:26.928 **** 2026-02-25 13:08:54.079166 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance 2026-02-25 13:08:54.249361 | controller | 2026-02-25 13:08:54.249393 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] ***************** 2026-02-25 13:08:54.249401 | controller | Wednesday 25 February 2026 13:08:54 +0000 (0:00:00.032) 0:01:26.961 **** 2026-02-25 13:08:54.249412 | controller | ok: [instance] 2026-02-25 13:08:54.249436 | controller | 2026-02-25 13:08:54.249730 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] ************* 2026-02-25 13:08:54.285699 | controller | Wednesday 25 February 2026 13:08:54 +0000 (0:00:00.170) 0:01:27.131 **** 2026-02-25 13:08:54.285726 | controller | skipping: [instance] 2026-02-25 13:08:54.644798 | controller | 2026-02-25 13:08:54.644838 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] *** 2026-02-25 13:08:54.644847 | controller | Wednesday 25 February 2026 13:08:54 +0000 (0:00:00.034) 0:01:27.166 **** 2026-02-25 13:08:54.644859 | controller | changed: [instance] 2026-02-25 13:08:54.664489 | controller | 2026-02-25 13:08:54.664510 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] ********************* 2026-02-25 13:08:54.664518 | controller | Wednesday 25 February 2026 13:08:54 +0000 (0:00:00.359) 0:01:27.526 **** 2026-02-25 13:08:54.664526 | controller | skipping: [instance] 2026-02-25 13:08:54.684138 | controller | 2026-02-25 13:08:54.684155 | controller | TASK [libvirt_manager : Write merged all-group.yml] **************************** 2026-02-25 13:08:54.684162 | controller | Wednesday 25 February 2026 13:08:54 +0000 (0:00:00.020) 0:01:27.546 **** 2026-02-25 13:08:54.684170 | controller | skipping: [instance] 2026-02-25 13:08:54.722356 | controller | 2026-02-25 13:08:54.722381 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2026-02-25 13:08:54.722391 | controller | Wednesday 25 February 2026 13:08:54 +0000 (0:00:00.019) 0:01:27.566 **** 2026-02-25 13:08:54.722402 | controller | skipping: [instance] 2026-02-25 13:08:54.787238 | controller | 2026-02-25 13:08:54.787258 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2026-02-25 13:08:54.787266 | controller | Wednesday 25 February 2026 13:08:54 +0000 (0:00:00.037) 0:01:27.604 **** 2026-02-25 13:08:54.787275 | controller | skipping: [instance] => (item=crc) 2026-02-25 13:08:55.000081 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2026-02-25 13:08:55.000113 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2026-02-25 13:08:55.000126 | controller | 2026-02-25 13:08:55.000133 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-25 13:08:55.000139 | controller | Wednesday 25 February 2026 13:08:54 +0000 (0:00:00.064) 0:01:27.668 **** 2026-02-25 13:08:55.000149 | controller | changed: [instance] 2026-02-25 13:08:55.181012 | controller | 2026-02-25 13:08:55.181044 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-25 13:08:55.181052 | controller | Wednesday 25 February 2026 13:08:54 +0000 (0:00:00.212) 0:01:27.881 **** 2026-02-25 13:08:55.181062 | controller | ok: [instance] 2026-02-25 13:09:24.820862 | controller | 2026-02-25 13:09:24.820905 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-25 13:09:24.820915 | controller | Wednesday 25 February 2026 13:08:55 +0000 (0:00:00.180) 0:01:28.062 **** 2026-02-25 13:09:24.820931 | controller | changed: [instance] 2026-02-25 13:09:25.022860 | controller | 2026-02-25 13:09:25.022906 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-25 13:09:25.022917 | controller | Wednesday 25 February 2026 13:09:24 +0000 (0:00:29.640) 0:01:57.702 **** 2026-02-25 13:09:25.022932 | controller | ok: [instance] 2026-02-25 13:09:25.065732 | controller | 2026-02-25 13:09:25.065752 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-25 13:09:25.065760 | controller | Wednesday 25 February 2026 13:09:25 +0000 (0:00:00.201) 0:01:57.904 **** 2026-02-25 13:09:25.065769 | controller | ok: [instance] => changed=false 2026-02-25 13:09:25.066054 | controller | msg: All assertions passed 2026-02-25 13:09:25.066066 | controller | 2026-02-25 13:09:25.267539 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-25 13:09:25.267582 | controller | Wednesday 25 February 2026 13:09:25 +0000 (0:00:00.043) 0:01:57.947 **** 2026-02-25 13:09:25.267597 | controller | changed: [instance] 2026-02-25 13:09:25.469787 | controller | 2026-02-25 13:09:25.469822 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-25 13:09:25.469830 | controller | Wednesday 25 February 2026 13:09:25 +0000 (0:00:00.201) 0:01:58.149 **** 2026-02-25 13:09:25.469840 | controller | ok: [instance] 2026-02-25 13:09:25.469866 | controller | 2026-02-25 13:09:25.469874 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-25 13:09:25.469977 | controller | Wednesday 25 February 2026 13:09:25 +0000 (0:00:00.202) 0:01:58.351 **** 2026-02-25 13:09:25.668267 | controller | ok: [instance] 2026-02-25 13:09:25.692739 | controller | 2026-02-25 13:09:25.692765 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-25 13:09:25.692774 | controller | Wednesday 25 February 2026 13:09:25 +0000 (0:00:00.198) 0:01:58.549 **** 2026-02-25 13:09:25.692784 | controller | skipping: [instance] 2026-02-25 13:09:25.692823 | controller | 2026-02-25 13:09:25.693177 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-25 13:09:25.888749 | controller | Wednesday 25 February 2026 13:09:25 +0000 (0:00:00.024) 0:01:58.574 **** 2026-02-25 13:09:25.888794 | controller | ok: [instance] 2026-02-25 13:09:25.933260 | controller | 2026-02-25 13:09:25.933291 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-25 13:09:25.933299 | controller | Wednesday 25 February 2026 13:09:25 +0000 (0:00:00.195) 0:01:58.770 **** 2026-02-25 13:09:25.933309 | controller | ok: [instance] => changed=false 2026-02-25 13:09:26.147809 | controller | msg: All assertions passed 2026-02-25 13:09:26.147842 | controller | 2026-02-25 13:09:26.147850 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-25 13:09:26.147857 | controller | Wednesday 25 February 2026 13:09:25 +0000 (0:00:00.044) 0:01:58.814 **** 2026-02-25 13:09:26.147867 | controller | ok: [instance] 2026-02-25 13:09:26.147891 | controller | 2026-02-25 13:09:26.147899 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2026-02-25 13:09:26.148036 | controller | Wednesday 25 February 2026 13:09:26 +0000 (0:00:00.214) 0:01:59.029 **** 2026-02-25 13:09:26.333790 | controller | ok: [instance] 2026-02-25 13:09:26.333842 | controller | 2026-02-25 13:09:26.333852 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2026-02-25 13:09:26.333887 | controller | Wednesday 25 February 2026 13:09:26 +0000 (0:00:00.185) 0:01:59.215 **** 2026-02-25 13:09:26.733547 | controller | changed: [instance] 2026-02-25 13:09:26.905176 | controller | 2026-02-25 13:09:26.905195 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2026-02-25 13:09:26.905203 | controller | Wednesday 25 February 2026 13:09:26 +0000 (0:00:00.399) 0:01:59.615 **** 2026-02-25 13:09:26.905211 | controller | ok: [instance] 2026-02-25 13:09:27.080212 | controller | 2026-02-25 13:09:27.080235 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2026-02-25 13:09:27.080244 | controller | Wednesday 25 February 2026 13:09:26 +0000 (0:00:00.171) 0:01:59.787 **** 2026-02-25 13:09:27.080256 | controller | ok: [instance] 2026-02-25 13:09:27.460650 | controller | 2026-02-25 13:09:27.460697 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2026-02-25 13:09:27.460710 | controller | Wednesday 25 February 2026 13:09:27 +0000 (0:00:00.174) 0:01:59.962 **** 2026-02-25 13:09:27.460721 | controller | changed: [instance] 2026-02-25 13:09:27.482817 | controller | 2026-02-25 13:09:27.482850 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2026-02-25 13:09:27.482863 | controller | Wednesday 25 February 2026 13:09:27 +0000 (0:00:00.380) 0:02:00.342 **** 2026-02-25 13:09:27.482879 | controller | ok: [instance] 2026-02-25 13:09:27.482979 | controller | 2026-02-25 13:09:27.482995 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2026-02-25 13:09:27.483005 | controller | Wednesday 25 February 2026 13:09:27 +0000 (0:00:00.022) 0:02:00.364 **** 2026-02-25 13:09:27.708108 | controller | ok: [instance] 2026-02-25 13:09:28.166800 | controller | 2026-02-25 13:09:28.166839 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2026-02-25 13:09:28.166849 | controller | Wednesday 25 February 2026 13:09:27 +0000 (0:00:00.225) 0:02:00.589 **** 2026-02-25 13:09:28.166862 | controller | ok: [instance] 2026-02-25 13:09:28.166884 | controller | 2026-02-25 13:09:28.166892 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2026-02-25 13:09:28.166901 | controller | Wednesday 25 February 2026 13:09:28 +0000 (0:00:00.458) 0:02:01.048 **** 2026-02-25 13:09:28.286717 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-25 13:09:28.538833 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-25 13:09:28.538874 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-25 13:09:28.538883 | controller | 2026-02-25 13:09:28.538889 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2026-02-25 13:09:28.538895 | controller | Wednesday 25 February 2026 13:09:28 +0000 (0:00:00.119) 0:02:01.167 **** 2026-02-25 13:09:28.538915 | controller | changed: [instance] 2026-02-25 13:09:28.538949 | controller | 2026-02-25 13:09:28.538959 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2026-02-25 13:09:28.765363 | controller | Wednesday 25 February 2026 13:09:28 +0000 (0:00:00.252) 0:02:01.420 **** 2026-02-25 13:09:28.765425 | controller | changed: [instance] 2026-02-25 13:09:29.063530 | controller | 2026-02-25 13:09:29.063567 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2026-02-25 13:09:29.063575 | controller | Wednesday 25 February 2026 13:09:28 +0000 (0:00:00.226) 0:02:01.647 **** 2026-02-25 13:09:29.063587 | controller | changed: [instance] 2026-02-25 13:09:29.094307 | controller | 2026-02-25 13:09:29.094339 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2026-02-25 13:09:29.094349 | controller | Wednesday 25 February 2026 13:09:29 +0000 (0:00:00.297) 0:02:01.945 **** 2026-02-25 13:09:29.094365 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-25 13:09:29.142354 | controller | 2026-02-25 13:09:29.142382 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-25 13:09:29.142391 | controller | Wednesday 25 February 2026 13:09:29 +0000 (0:00:00.031) 0:02:01.976 **** 2026-02-25 13:09:29.142403 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-25 13:09:29.382600 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-25 13:09:29.382638 | controller | 2026-02-25 13:09:29.382647 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 13:09:29.382653 | controller | Wednesday 25 February 2026 13:09:29 +0000 (0:00:00.047) 0:02:02.024 **** 2026-02-25 13:09:29.382682 | controller | ok: [instance] 2026-02-25 13:09:29.428823 | controller | 2026-02-25 13:09:29.428844 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 13:09:29.428851 | controller | Wednesday 25 February 2026 13:09:29 +0000 (0:00:00.240) 0:02:02.264 **** 2026-02-25 13:09:29.428860 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 13:09:29.652613 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 13:09:29.652651 | controller | 2026-02-25 13:09:29.652660 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 13:09:29.652690 | controller | Wednesday 25 February 2026 13:09:29 +0000 (0:00:00.046) 0:02:02.310 **** 2026-02-25 13:09:29.652705 | controller | ok: [instance] 2026-02-25 13:09:29.652731 | controller | 2026-02-25 13:09:29.652839 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 13:09:29.652851 | controller | Wednesday 25 February 2026 13:09:29 +0000 (0:00:00.224) 0:02:02.534 **** 2026-02-25 13:09:29.846217 | controller | ok: [instance] 2026-02-25 13:09:29.846264 | controller | 2026-02-25 13:09:29.846370 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2026-02-25 13:09:29.846491 | controller | Wednesday 25 February 2026 13:09:29 +0000 (0:00:00.193) 0:02:02.728 **** 2026-02-25 13:09:30.136878 | controller | changed: [instance] 2026-02-25 13:09:30.137004 | controller | 2026-02-25 13:09:30.137031 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 13:09:30.137042 | controller | Wednesday 25 February 2026 13:09:30 +0000 (0:00:00.290) 0:02:03.018 **** 2026-02-25 13:09:30.366792 | controller | ok: [instance] 2026-02-25 13:09:30.366829 | controller | 2026-02-25 13:09:30.366839 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 13:09:30.366849 | controller | Wednesday 25 February 2026 13:09:30 +0000 (0:00:00.229) 0:02:03.248 **** 2026-02-25 13:09:30.413165 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 13:09:30.643316 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 13:09:30.643345 | controller | 2026-02-25 13:09:30.643354 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 13:09:30.643362 | controller | Wednesday 25 February 2026 13:09:30 +0000 (0:00:00.046) 0:02:03.294 **** 2026-02-25 13:09:30.643373 | controller | ok: [instance] 2026-02-25 13:09:30.843303 | controller | 2026-02-25 13:09:30.843324 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 13:09:30.843331 | controller | Wednesday 25 February 2026 13:09:30 +0000 (0:00:00.230) 0:02:03.524 **** 2026-02-25 13:09:30.843340 | controller | ok: [instance] 2026-02-25 13:09:31.126129 | controller | 2026-02-25 13:09:31.126168 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2026-02-25 13:09:31.126176 | controller | Wednesday 25 February 2026 13:09:30 +0000 (0:00:00.200) 0:02:03.725 **** 2026-02-25 13:09:31.126185 | controller | changed: [instance] 2026-02-25 13:09:31.149586 | controller | 2026-02-25 13:09:31.149609 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2026-02-25 13:09:31.149618 | controller | Wednesday 25 February 2026 13:09:31 +0000 (0:00:00.282) 0:02:04.008 **** 2026-02-25 13:09:31.149628 | controller | skipping: [instance] 2026-02-25 13:09:31.179874 | controller | 2026-02-25 13:09:31.179925 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2026-02-25 13:09:31.179939 | controller | Wednesday 25 February 2026 13:09:31 +0000 (0:00:00.023) 0:02:04.031 **** 2026-02-25 13:09:31.179956 | controller | skipping: [instance] 2026-02-25 13:09:31.180007 | controller | 2026-02-25 13:09:31.180027 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2026-02-25 13:09:31.180038 | controller | Wednesday 25 February 2026 13:09:31 +0000 (0:00:00.030) 0:02:04.061 **** 2026-02-25 13:09:31.207769 | controller | skipping: [instance] 2026-02-25 13:09:31.207990 | controller | 2026-02-25 13:09:31.208016 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2026-02-25 13:09:31.233406 | controller | Wednesday 25 February 2026 13:09:31 +0000 (0:00:00.028) 0:02:04.089 **** 2026-02-25 13:09:31.233432 | controller | skipping: [instance] 2026-02-25 13:09:31.443313 | controller | 2026-02-25 13:09:31.443339 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-25 13:09:31.443350 | controller | Wednesday 25 February 2026 13:09:31 +0000 (0:00:00.025) 0:02:04.115 **** 2026-02-25 13:09:31.443359 | controller | changed: [instance] 2026-02-25 13:09:31.480568 | controller | 2026-02-25 13:09:31.480585 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-25 13:09:31.480592 | controller | Wednesday 25 February 2026 13:09:31 +0000 (0:00:00.210) 0:02:04.325 **** 2026-02-25 13:09:31.480599 | controller | ok: [instance] 2026-02-25 13:09:31.533860 | controller | 2026-02-25 13:09:31.533899 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-25 13:09:31.533912 | controller | Wednesday 25 February 2026 13:09:31 +0000 (0:00:00.037) 0:02:04.362 **** 2026-02-25 13:09:31.533929 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-25 13:09:31.739097 | controller | 2026-02-25 13:09:31.739129 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-25 13:09:31.739137 | controller | Wednesday 25 February 2026 13:09:31 +0000 (0:00:00.053) 0:02:04.415 **** 2026-02-25 13:09:31.739146 | controller | ok: [instance] 2026-02-25 13:09:31.804658 | controller | 2026-02-25 13:09:31.804703 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-25 13:09:31.804712 | controller | Wednesday 25 February 2026 13:09:31 +0000 (0:00:00.205) 0:02:04.620 **** 2026-02-25 13:09:31.804723 | controller | ok: [instance] 2026-02-25 13:09:31.852830 | controller | 2026-02-25 13:09:31.852871 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-25 13:09:31.852882 | controller | Wednesday 25 February 2026 13:09:31 +0000 (0:00:00.065) 0:02:04.686 **** 2026-02-25 13:09:31.852895 | controller | ok: [instance] 2026-02-25 13:09:31.853069 | controller | 2026-02-25 13:09:31.853094 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-25 13:09:31.898415 | controller | Wednesday 25 February 2026 13:09:31 +0000 (0:00:00.048) 0:02:04.734 **** 2026-02-25 13:09:31.898439 | controller | skipping: [instance] 2026-02-25 13:09:31.941237 | controller | 2026-02-25 13:09:31.941258 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-25 13:09:31.941266 | controller | Wednesday 25 February 2026 13:09:31 +0000 (0:00:00.045) 0:02:04.780 **** 2026-02-25 13:09:31.941276 | controller | skipping: [instance] 2026-02-25 13:09:31.941426 | controller | 2026-02-25 13:09:31.941578 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-25 13:09:31.941761 | controller | Wednesday 25 February 2026 13:09:31 +0000 (0:00:00.043) 0:02:04.823 **** 2026-02-25 13:09:32.001403 | controller | 2026-02-25 13:09:32.001597 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-25 13:09:32.001783 | controller | Wednesday 25 February 2026 13:09:31 +0000 (0:00:00.060) 0:02:04.883 **** 2026-02-25 13:09:32.393681 | controller | ok: [instance] => (item=artifacts) 2026-02-25 13:09:33.568472 | controller | ok: [instance] => (item=logs) 2026-02-25 13:09:33.568501 | controller | 2026-02-25 13:09:33.568509 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-25 13:09:33.568519 | controller | Wednesday 25 February 2026 13:09:32 +0000 (0:00:00.391) 0:02:05.275 **** 2026-02-25 13:09:33.568528 | controller | ok: [instance] 2026-02-25 13:09:33.779342 | controller | 2026-02-25 13:09:33.779371 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-25 13:09:33.779379 | controller | Wednesday 25 February 2026 13:09:33 +0000 (0:00:01.174) 0:02:06.450 **** 2026-02-25 13:09:33.779390 | controller | changed: [instance] 2026-02-25 13:09:34.154634 | controller | 2026-02-25 13:09:34.154664 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-25 13:09:34.154691 | controller | Wednesday 25 February 2026 13:09:33 +0000 (0:00:00.210) 0:02:06.661 **** 2026-02-25 13:09:34.154702 | controller | changed: [instance] 2026-02-25 13:09:34.521605 | controller | 2026-02-25 13:09:34.521633 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-25 13:09:34.521641 | controller | Wednesday 25 February 2026 13:09:34 +0000 (0:00:00.375) 0:02:07.036 **** 2026-02-25 13:09:34.521650 | controller | changed: [instance] 2026-02-25 13:09:34.567779 | controller | 2026-02-25 13:09:34.567808 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-25 13:09:34.567817 | controller | Wednesday 25 February 2026 13:09:34 +0000 (0:00:00.367) 0:02:07.403 **** 2026-02-25 13:09:34.567828 | controller | skipping: [instance] 2026-02-25 13:09:34.767846 | controller | 2026-02-25 13:09:34.767897 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-25 13:09:34.767911 | controller | Wednesday 25 February 2026 13:09:34 +0000 (0:00:00.046) 0:02:07.449 **** 2026-02-25 13:09:34.767935 | controller | ok: [instance] 2026-02-25 13:09:34.767992 | controller | 2026-02-25 13:09:34.768020 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-25 13:09:34.810621 | controller | Wednesday 25 February 2026 13:09:34 +0000 (0:00:00.200) 0:02:07.649 **** 2026-02-25 13:09:34.810657 | controller | skipping: [instance] 2026-02-25 13:09:35.046350 | controller | 2026-02-25 13:09:35.046375 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-25 13:09:35.046383 | controller | Wednesday 25 February 2026 13:09:34 +0000 (0:00:00.042) 0:02:07.692 **** 2026-02-25 13:09:35.046392 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2026-02-25 13:09:35.322960 | controller | changed: [instance] 2026-02-25 13:09:35.322991 | controller | 2026-02-25 13:09:35.322998 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-25 13:09:35.323005 | controller | Wednesday 25 February 2026 13:09:35 +0000 (0:00:00.235) 0:02:07.928 **** 2026-02-25 13:09:35.323015 | controller | changed: [instance] 2026-02-25 13:09:35.323038 | controller | 2026-02-25 13:09:35.323046 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-25 13:09:35.323137 | controller | Wednesday 25 February 2026 13:09:35 +0000 (0:00:00.276) 0:02:08.204 **** 2026-02-25 13:09:35.370220 | controller | skipping: [instance] 2026-02-25 13:09:35.398444 | controller | 2026-02-25 13:09:35.398464 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2026-02-25 13:09:35.398472 | controller | Wednesday 25 February 2026 13:09:35 +0000 (0:00:00.047) 0:02:08.252 **** 2026-02-25 13:09:35.398480 | controller | skipping: [instance] 2026-02-25 13:09:35.640763 | controller | 2026-02-25 13:09:35.640782 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2026-02-25 13:09:35.640790 | controller | Wednesday 25 February 2026 13:09:35 +0000 (0:00:00.028) 0:02:08.280 **** 2026-02-25 13:09:35.640798 | controller | changed: [instance] 2026-02-25 13:09:35.640820 | controller | 2026-02-25 13:09:35.640827 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2026-02-25 13:09:35.640949 | controller | Wednesday 25 February 2026 13:09:35 +0000 (0:00:00.242) 0:02:08.522 **** 2026-02-25 13:09:35.858777 | controller | changed: [instance] 2026-02-25 13:09:35.858841 | controller | 2026-02-25 13:09:35.858853 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2026-02-25 13:09:35.858873 | controller | Wednesday 25 February 2026 13:09:35 +0000 (0:00:00.218) 0:02:08.740 **** 2026-02-25 13:09:36.146321 | controller | changed: [instance] 2026-02-25 13:09:36.177539 | controller | 2026-02-25 13:09:36.177558 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2026-02-25 13:09:36.177566 | controller | Wednesday 25 February 2026 13:09:36 +0000 (0:00:00.287) 0:02:09.028 **** 2026-02-25 13:09:36.177574 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-25 13:09:36.223823 | controller | 2026-02-25 13:09:36.223855 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-25 13:09:36.223864 | controller | Wednesday 25 February 2026 13:09:36 +0000 (0:00:00.031) 0:02:09.059 **** 2026-02-25 13:09:36.223874 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-25 13:09:36.459840 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-25 13:09:36.459883 | controller | 2026-02-25 13:09:36.459897 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 13:09:36.459908 | controller | Wednesday 25 February 2026 13:09:36 +0000 (0:00:00.046) 0:02:09.105 **** 2026-02-25 13:09:36.459926 | controller | ok: [instance] 2026-02-25 13:09:36.509381 | controller | 2026-02-25 13:09:36.509406 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 13:09:36.509414 | controller | Wednesday 25 February 2026 13:09:36 +0000 (0:00:00.236) 0:02:09.341 **** 2026-02-25 13:09:36.509423 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 13:09:36.741216 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 13:09:36.741236 | controller | 2026-02-25 13:09:36.741243 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 13:09:36.741249 | controller | Wednesday 25 February 2026 13:09:36 +0000 (0:00:00.049) 0:02:09.390 **** 2026-02-25 13:09:36.741258 | controller | ok: [instance] 2026-02-25 13:09:36.949747 | controller | 2026-02-25 13:09:36.949780 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 13:09:36.949789 | controller | Wednesday 25 February 2026 13:09:36 +0000 (0:00:00.232) 0:02:09.623 **** 2026-02-25 13:09:36.949800 | controller | ok: [instance] 2026-02-25 13:09:37.232780 | controller | 2026-02-25 13:09:37.232826 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2026-02-25 13:09:37.232838 | controller | Wednesday 25 February 2026 13:09:36 +0000 (0:00:00.208) 0:02:09.831 **** 2026-02-25 13:09:37.232859 | controller | changed: [instance] 2026-02-25 13:09:37.232906 | controller | 2026-02-25 13:09:37.232918 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 13:09:37.460227 | controller | Wednesday 25 February 2026 13:09:37 +0000 (0:00:00.283) 0:02:10.114 **** 2026-02-25 13:09:37.460255 | controller | ok: [instance] 2026-02-25 13:09:37.504623 | controller | 2026-02-25 13:09:37.504644 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 13:09:37.504653 | controller | Wednesday 25 February 2026 13:09:37 +0000 (0:00:00.227) 0:02:10.342 **** 2026-02-25 13:09:37.504663 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 13:09:37.733781 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 13:09:37.733819 | controller | 2026-02-25 13:09:37.733829 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 13:09:37.733836 | controller | Wednesday 25 February 2026 13:09:37 +0000 (0:00:00.044) 0:02:10.386 **** 2026-02-25 13:09:37.733848 | controller | ok: [instance] 2026-02-25 13:09:37.733855 | controller | 2026-02-25 13:09:37.733864 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 13:09:37.937416 | controller | Wednesday 25 February 2026 13:09:37 +0000 (0:00:00.229) 0:02:10.615 **** 2026-02-25 13:09:37.937447 | controller | ok: [instance] 2026-02-25 13:09:38.218493 | controller | 2026-02-25 13:09:38.218528 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2026-02-25 13:09:38.218536 | controller | Wednesday 25 February 2026 13:09:37 +0000 (0:00:00.203) 0:02:10.819 **** 2026-02-25 13:09:38.218549 | controller | changed: [instance] 2026-02-25 13:09:38.241297 | controller | 2026-02-25 13:09:38.241326 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2026-02-25 13:09:38.241335 | controller | Wednesday 25 February 2026 13:09:38 +0000 (0:00:00.280) 0:02:11.099 **** 2026-02-25 13:09:38.241347 | controller | skipping: [instance] 2026-02-25 13:09:38.270835 | controller | 2026-02-25 13:09:38.270881 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2026-02-25 13:09:38.270895 | controller | Wednesday 25 February 2026 13:09:38 +0000 (0:00:00.023) 0:02:11.123 **** 2026-02-25 13:09:38.270912 | controller | skipping: [instance] 2026-02-25 13:09:38.270952 | controller | 2026-02-25 13:09:38.270967 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2026-02-25 13:09:38.271074 | controller | Wednesday 25 February 2026 13:09:38 +0000 (0:00:00.029) 0:02:11.153 **** 2026-02-25 13:09:38.300011 | controller | skipping: [instance] 2026-02-25 13:09:38.328374 | controller | 2026-02-25 13:09:38.328406 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2026-02-25 13:09:38.328415 | controller | Wednesday 25 February 2026 13:09:38 +0000 (0:00:00.028) 0:02:11.181 **** 2026-02-25 13:09:38.328425 | controller | skipping: [instance] 2026-02-25 13:09:38.328609 | controller | 2026-02-25 13:09:38.328631 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-25 13:09:39.562636 | controller | Wednesday 25 February 2026 13:09:38 +0000 (0:00:00.028) 0:02:11.210 **** 2026-02-25 13:09:39.562678 | controller | changed: [instance] 2026-02-25 13:09:39.600659 | controller | 2026-02-25 13:09:39.600701 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-25 13:09:39.600710 | controller | Wednesday 25 February 2026 13:09:39 +0000 (0:00:01.234) 0:02:12.444 **** 2026-02-25 13:09:39.600721 | controller | ok: [instance] 2026-02-25 13:09:39.651628 | controller | 2026-02-25 13:09:39.651650 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-25 13:09:39.651658 | controller | Wednesday 25 February 2026 13:09:39 +0000 (0:00:00.038) 0:02:12.482 **** 2026-02-25 13:09:39.651687 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-25 13:09:39.842011 | controller | 2026-02-25 13:09:39.842033 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-25 13:09:39.842040 | controller | Wednesday 25 February 2026 13:09:39 +0000 (0:00:00.050) 0:02:12.533 **** 2026-02-25 13:09:39.842049 | controller | ok: [instance] 2026-02-25 13:09:39.902488 | controller | 2026-02-25 13:09:39.902512 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-25 13:09:39.902521 | controller | Wednesday 25 February 2026 13:09:39 +0000 (0:00:00.190) 0:02:12.724 **** 2026-02-25 13:09:39.902530 | controller | ok: [instance] 2026-02-25 13:09:39.947747 | controller | 2026-02-25 13:09:39.947775 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-25 13:09:39.947783 | controller | Wednesday 25 February 2026 13:09:39 +0000 (0:00:00.060) 0:02:12.784 **** 2026-02-25 13:09:39.947792 | controller | ok: [instance] 2026-02-25 13:09:39.947815 | controller | 2026-02-25 13:09:39.947823 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-25 13:09:39.947920 | controller | Wednesday 25 February 2026 13:09:39 +0000 (0:00:00.045) 0:02:12.829 **** 2026-02-25 13:09:39.991778 | controller | skipping: [instance] 2026-02-25 13:09:39.991983 | controller | 2026-02-25 13:09:39.992010 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-25 13:09:40.035695 | controller | Wednesday 25 February 2026 13:09:39 +0000 (0:00:00.043) 0:02:12.873 **** 2026-02-25 13:09:40.035731 | controller | skipping: [instance] 2026-02-25 13:09:40.173382 | controller | 2026-02-25 13:09:40.173412 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-25 13:09:40.173425 | controller | Wednesday 25 February 2026 13:09:40 +0000 (0:00:00.043) 0:02:12.917 **** 2026-02-25 13:09:40.173439 | controller | 2026-02-25 13:09:40.568607 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-25 13:09:40.568627 | controller | Wednesday 25 February 2026 13:09:40 +0000 (0:00:00.137) 0:02:13.055 **** 2026-02-25 13:09:40.568637 | controller | ok: [instance] => (item=artifacts) 2026-02-25 13:09:41.739811 | controller | ok: [instance] => (item=logs) 2026-02-25 13:09:41.739864 | controller | 2026-02-25 13:09:41.739878 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-25 13:09:41.739889 | controller | Wednesday 25 February 2026 13:09:40 +0000 (0:00:00.395) 0:02:13.450 **** 2026-02-25 13:09:41.739906 | controller | ok: [instance] 2026-02-25 13:09:41.739937 | controller | 2026-02-25 13:09:41.739950 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-25 13:09:41.949415 | controller | Wednesday 25 February 2026 13:09:41 +0000 (0:00:01.171) 0:02:14.621 **** 2026-02-25 13:09:41.949455 | controller | changed: [instance] 2026-02-25 13:09:41.949513 | controller | 2026-02-25 13:09:41.949529 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-25 13:09:41.949617 | controller | Wednesday 25 February 2026 13:09:41 +0000 (0:00:00.209) 0:02:14.831 **** 2026-02-25 13:09:42.310045 | controller | changed: [instance] 2026-02-25 13:09:42.310123 | controller | 2026-02-25 13:09:42.310215 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-25 13:09:42.310369 | controller | Wednesday 25 February 2026 13:09:42 +0000 (0:00:00.360) 0:02:15.192 **** 2026-02-25 13:09:42.680594 | controller | changed: [instance] 2026-02-25 13:09:42.728384 | controller | 2026-02-25 13:09:42.728405 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-25 13:09:42.728413 | controller | Wednesday 25 February 2026 13:09:42 +0000 (0:00:00.370) 0:02:15.562 **** 2026-02-25 13:09:42.728424 | controller | skipping: [instance] 2026-02-25 13:09:42.927751 | controller | 2026-02-25 13:09:42.927788 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-25 13:09:42.927802 | controller | Wednesday 25 February 2026 13:09:42 +0000 (0:00:00.048) 0:02:15.610 **** 2026-02-25 13:09:42.927813 | controller | ok: [instance] 2026-02-25 13:09:42.973299 | controller | 2026-02-25 13:09:42.973318 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-25 13:09:42.973326 | controller | Wednesday 25 February 2026 13:09:42 +0000 (0:00:00.199) 0:02:15.809 **** 2026-02-25 13:09:42.973336 | controller | skipping: [instance] 2026-02-25 13:09:43.207558 | controller | 2026-02-25 13:09:43.207578 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-25 13:09:43.207585 | controller | Wednesday 25 February 2026 13:09:42 +0000 (0:00:00.045) 0:02:15.855 **** 2026-02-25 13:09:43.207594 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2026-02-25 13:09:43.477148 | controller | changed: [instance] 2026-02-25 13:09:43.477171 | controller | 2026-02-25 13:09:43.477178 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-25 13:09:43.477184 | controller | Wednesday 25 February 2026 13:09:43 +0000 (0:00:00.234) 0:02:16.089 **** 2026-02-25 13:09:43.477193 | controller | changed: [instance] 2026-02-25 13:09:43.523754 | controller | 2026-02-25 13:09:43.523776 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-25 13:09:43.523785 | controller | Wednesday 25 February 2026 13:09:43 +0000 (0:00:00.269) 0:02:16.359 **** 2026-02-25 13:09:43.523795 | controller | skipping: [instance] 2026-02-25 13:09:43.523821 | controller | 2026-02-25 13:09:43.524054 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2026-02-25 13:09:43.554307 | controller | Wednesday 25 February 2026 13:09:43 +0000 (0:00:00.046) 0:02:16.405 **** 2026-02-25 13:09:43.554330 | controller | skipping: [instance] 2026-02-25 13:09:43.793861 | controller | 2026-02-25 13:09:43.793908 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2026-02-25 13:09:43.793928 | controller | Wednesday 25 February 2026 13:09:43 +0000 (0:00:00.030) 0:02:16.436 **** 2026-02-25 13:09:43.793946 | controller | changed: [instance] 2026-02-25 13:09:44.019209 | controller | 2026-02-25 13:09:44.019257 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2026-02-25 13:09:44.019282 | controller | Wednesday 25 February 2026 13:09:43 +0000 (0:00:00.239) 0:02:16.675 **** 2026-02-25 13:09:44.019294 | controller | changed: [instance] 2026-02-25 13:09:44.312308 | controller | 2026-02-25 13:09:44.312342 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2026-02-25 13:09:44.312351 | controller | Wednesday 25 February 2026 13:09:44 +0000 (0:00:00.225) 0:02:16.900 **** 2026-02-25 13:09:44.312361 | controller | changed: [instance] 2026-02-25 13:09:44.341267 | controller | 2026-02-25 13:09:44.341295 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2026-02-25 13:09:44.341303 | controller | Wednesday 25 February 2026 13:09:44 +0000 (0:00:00.293) 0:02:17.194 **** 2026-02-25 13:09:44.341314 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-25 13:09:44.383853 | controller | 2026-02-25 13:09:44.383892 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-25 13:09:44.383903 | controller | Wednesday 25 February 2026 13:09:44 +0000 (0:00:00.029) 0:02:17.223 **** 2026-02-25 13:09:44.383917 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-25 13:09:44.383950 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-25 13:09:44.383961 | controller | 2026-02-25 13:09:44.384155 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 13:09:44.608488 | controller | Wednesday 25 February 2026 13:09:44 +0000 (0:00:00.042) 0:02:17.265 **** 2026-02-25 13:09:44.608529 | controller | ok: [instance] 2026-02-25 13:09:44.652843 | controller | 2026-02-25 13:09:44.652880 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 13:09:44.652894 | controller | Wednesday 25 February 2026 13:09:44 +0000 (0:00:00.223) 0:02:17.489 **** 2026-02-25 13:09:44.652910 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 13:09:44.652952 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 13:09:44.652966 | controller | 2026-02-25 13:09:44.653003 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 13:09:44.653104 | controller | Wednesday 25 February 2026 13:09:44 +0000 (0:00:00.045) 0:02:17.535 **** 2026-02-25 13:09:44.882700 | controller | ok: [instance] 2026-02-25 13:09:45.076249 | controller | 2026-02-25 13:09:45.076293 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 13:09:45.076301 | controller | Wednesday 25 February 2026 13:09:44 +0000 (0:00:00.229) 0:02:17.764 **** 2026-02-25 13:09:45.076310 | controller | ok: [instance] 2026-02-25 13:09:45.351566 | controller | 2026-02-25 13:09:45.351594 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2026-02-25 13:09:45.351602 | controller | Wednesday 25 February 2026 13:09:45 +0000 (0:00:00.193) 0:02:17.958 **** 2026-02-25 13:09:45.351612 | controller | changed: [instance] 2026-02-25 13:09:45.574621 | controller | 2026-02-25 13:09:45.574649 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-25 13:09:45.574657 | controller | Wednesday 25 February 2026 13:09:45 +0000 (0:00:00.274) 0:02:18.233 **** 2026-02-25 13:09:45.574704 | controller | ok: [instance] 2026-02-25 13:09:45.618419 | controller | 2026-02-25 13:09:45.618437 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-25 13:09:45.618443 | controller | Wednesday 25 February 2026 13:09:45 +0000 (0:00:00.223) 0:02:18.456 **** 2026-02-25 13:09:45.618451 | controller | ok: [instance] => (item=cifmw-public) 2026-02-25 13:09:45.841210 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-25 13:09:45.841234 | controller | 2026-02-25 13:09:45.841242 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-25 13:09:45.841249 | controller | Wednesday 25 February 2026 13:09:45 +0000 (0:00:00.043) 0:02:18.500 **** 2026-02-25 13:09:45.841274 | controller | ok: [instance] 2026-02-25 13:09:46.050249 | controller | 2026-02-25 13:09:46.050295 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-25 13:09:46.050303 | controller | Wednesday 25 February 2026 13:09:45 +0000 (0:00:00.222) 0:02:18.723 **** 2026-02-25 13:09:46.050313 | controller | ok: [instance] 2026-02-25 13:09:47.335745 | controller | 2026-02-25 13:09:47.335774 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2026-02-25 13:09:47.335782 | controller | Wednesday 25 February 2026 13:09:46 +0000 (0:00:00.208) 0:02:18.931 **** 2026-02-25 13:09:47.335792 | controller | changed: [instance] 2026-02-25 13:09:47.336042 | controller | 2026-02-25 13:09:47.357862 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2026-02-25 13:09:47.357903 | controller | Wednesday 25 February 2026 13:09:47 +0000 (0:00:01.285) 0:02:20.217 **** 2026-02-25 13:09:47.357920 | controller | skipping: [instance] 2026-02-25 13:09:47.385840 | controller | 2026-02-25 13:09:47.385873 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2026-02-25 13:09:47.385893 | controller | Wednesday 25 February 2026 13:09:47 +0000 (0:00:00.022) 0:02:20.239 **** 2026-02-25 13:09:47.385909 | controller | skipping: [instance] 2026-02-25 13:09:47.385952 | controller | 2026-02-25 13:09:47.385967 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2026-02-25 13:09:47.386049 | controller | Wednesday 25 February 2026 13:09:47 +0000 (0:00:00.028) 0:02:20.267 **** 2026-02-25 13:09:47.415247 | controller | skipping: [instance] 2026-02-25 13:09:47.442800 | controller | 2026-02-25 13:09:47.442831 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2026-02-25 13:09:47.442841 | controller | Wednesday 25 February 2026 13:09:47 +0000 (0:00:00.029) 0:02:20.297 **** 2026-02-25 13:09:47.442851 | controller | skipping: [instance] 2026-02-25 13:09:47.657349 | controller | 2026-02-25 13:09:47.657378 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-25 13:09:47.657386 | controller | Wednesday 25 February 2026 13:09:47 +0000 (0:00:00.027) 0:02:20.324 **** 2026-02-25 13:09:47.657396 | controller | changed: [instance] 2026-02-25 13:09:47.695343 | controller | 2026-02-25 13:09:47.695362 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-25 13:09:47.695369 | controller | Wednesday 25 February 2026 13:09:47 +0000 (0:00:00.214) 0:02:20.539 **** 2026-02-25 13:09:47.695377 | controller | ok: [instance] 2026-02-25 13:09:47.722210 | controller | 2026-02-25 13:09:47.722228 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-25 13:09:47.722235 | controller | Wednesday 25 February 2026 13:09:47 +0000 (0:00:00.038) 0:02:20.577 **** 2026-02-25 13:09:47.722243 | controller | skipping: [instance] 2026-02-25 13:09:47.748803 | controller | 2026-02-25 13:09:47.748838 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-25 13:09:47.748847 | controller | Wednesday 25 February 2026 13:09:47 +0000 (0:00:00.026) 0:02:20.604 **** 2026-02-25 13:09:47.748859 | controller | skipping: [instance] 2026-02-25 13:09:47.794606 | controller | 2026-02-25 13:09:47.794629 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-25 13:09:47.794637 | controller | Wednesday 25 February 2026 13:09:47 +0000 (0:00:00.026) 0:02:20.630 **** 2026-02-25 13:09:47.794646 | controller | skipping: [instance] 2026-02-25 13:09:47.823101 | controller | 2026-02-25 13:09:47.823123 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2026-02-25 13:09:47.823132 | controller | Wednesday 25 February 2026 13:09:47 +0000 (0:00:00.045) 0:02:20.676 **** 2026-02-25 13:09:47.823142 | controller | skipping: [instance] 2026-02-25 13:09:47.884095 | controller | 2026-02-25 13:09:47.884116 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2026-02-25 13:09:47.884124 | controller | Wednesday 25 February 2026 13:09:47 +0000 (0:00:00.028) 0:02:20.705 **** 2026-02-25 13:09:47.884135 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2026-02-25 13:09:48.124118 | controller | 2026-02-25 13:09:48.124156 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2026-02-25 13:09:48.124171 | controller | Wednesday 25 February 2026 13:09:47 +0000 (0:00:00.060) 0:02:20.765 **** 2026-02-25 13:09:48.124182 | controller | ok: [instance] => (item=crc) 2026-02-25 13:09:48.124323 | controller | 2026-02-25 13:09:48.124447 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2026-02-25 13:09:48.124574 | controller | Wednesday 25 February 2026 13:09:48 +0000 (0:00:00.240) 0:02:21.006 **** 2026-02-25 13:09:50.195498 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-25 13:09:50.195691 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-25 13:09:50.195834 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-25 13:09:50.195948 | controller | 2026-02-25 13:09:50.196064 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-25 13:09:50.196180 | controller | Wednesday 25 February 2026 13:09:50 +0000 (0:00:02.071) 0:02:23.077 **** 2026-02-25 13:09:51.059806 | controller | changed: [instance] 2026-02-25 13:09:51.059855 | controller | 2026-02-25 13:09:51.059889 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-25 13:09:51.060002 | controller | Wednesday 25 February 2026 13:09:51 +0000 (0:00:00.864) 0:02:23.941 **** 2026-02-25 13:09:51.873157 | controller | changed: [instance] 2026-02-25 13:09:52.697228 | controller | 2026-02-25 13:09:52.697259 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-25 13:09:52.697267 | controller | Wednesday 25 February 2026 13:09:51 +0000 (0:00:00.812) 0:02:24.754 **** 2026-02-25 13:09:52.697276 | controller | changed: [instance] 2026-02-25 13:09:53.384298 | controller | 2026-02-25 13:09:53.384338 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2026-02-25 13:09:53.384351 | controller | Wednesday 25 February 2026 13:09:52 +0000 (0:00:00.824) 0:02:25.578 **** 2026-02-25 13:09:53.384361 | controller | changed: [instance] => (item=compute-0.utility) 2026-02-25 13:10:16.353444 | controller | changed: [instance] => (item=controller-0.utility) 2026-02-25 13:10:16.353483 | controller | changed: [instance] => (item=crc-0.utility) 2026-02-25 13:10:16.353491 | controller | 2026-02-25 13:10:16.353496 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2026-02-25 13:10:16.353502 | controller | Wednesday 25 February 2026 13:09:53 +0000 (0:00:00.686) 0:02:26.265 **** 2026-02-25 13:10:16.353512 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2026-02-25 13:10:16.353538 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2026-02-25 13:10:16.353586 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2026-02-25 13:10:16.353593 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2026-02-25 13:10:16.353881 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2026-02-25 13:10:16.354230 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2026-02-25 13:10:16.354239 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left). 2026-02-25 13:10:16.354248 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j482933010990.24773', 'results_file': '/home/zuul/.ansible_async/j482933010990.24773', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2026-02-25 13:10:16.354469 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j707940108255.24790', 'results_file': '/home/zuul/.ansible_async/j707940108255.24790', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2026-02-25 13:10:16.354484 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j591090092150.24806', 'results_file': '/home/zuul/.ansible_async/j591090092150.24806', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2026-02-25 13:10:16.354495 | controller | 2026-02-25 13:10:16.354504 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2026-02-25 13:10:16.464588 | controller | Wednesday 25 February 2026 13:10:16 +0000 (0:00:22.969) 0:02:49.235 **** 2026-02-25 13:10:16.464645 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-25 13:10:16.464657 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-25 13:10:16.464796 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-25 13:10:16.464894 | controller | 2026-02-25 13:10:16.464986 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-25 13:10:16.465067 | controller | Wednesday 25 February 2026 13:10:16 +0000 (0:00:00.111) 0:02:49.346 **** 2026-02-25 13:10:16.491235 | controller | skipping: [instance] 2026-02-25 13:10:16.535290 | controller | 2026-02-25 13:10:16.535312 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2026-02-25 13:10:16.535320 | controller | Wednesday 25 February 2026 13:10:16 +0000 (0:00:00.026) 0:02:49.373 **** 2026-02-25 13:10:16.535330 | controller | 2026-02-25 13:10:16.626261 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-25 13:10:16.626283 | controller | Wednesday 25 February 2026 13:10:16 +0000 (0:00:00.044) 0:02:49.417 **** 2026-02-25 13:10:16.626300 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-25 13:10:16.869882 | controller | 2026-02-25 13:10:16.869919 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-25 13:10:16.869927 | controller | Wednesday 25 February 2026 13:10:16 +0000 (0:00:00.090) 0:02:49.508 **** 2026-02-25 13:10:16.869937 | controller | changed: [instance] 2026-02-25 13:10:17.102955 | controller | 2026-02-25 13:10:17.103005 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-25 13:10:17.103014 | controller | Wednesday 25 February 2026 13:10:16 +0000 (0:00:00.243) 0:02:49.751 **** 2026-02-25 13:10:17.103029 | controller | changed: [instance] 2026-02-25 13:10:17.526362 | controller | 2026-02-25 13:10:17.526421 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2026-02-25 13:10:17.526431 | controller | Wednesday 25 February 2026 13:10:17 +0000 (0:00:00.233) 0:02:49.984 **** 2026-02-25 13:10:17.526457 | controller | changed: [instance] 2026-02-25 13:10:17.564848 | controller | 2026-02-25 13:10:17.564884 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2026-02-25 13:10:17.564893 | controller | Wednesday 25 February 2026 13:10:17 +0000 (0:00:00.422) 0:02:50.407 **** 2026-02-25 13:10:17.564906 | controller | skipping: [instance] 2026-02-25 13:10:17.565071 | controller | 2026-02-25 13:10:17.605894 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-25 13:10:17.605928 | controller | Wednesday 25 February 2026 13:10:17 +0000 (0:00:00.039) 0:02:50.446 **** 2026-02-25 13:10:17.605942 | controller | skipping: [instance] 2026-02-25 13:10:17.605986 | controller | 2026-02-25 13:10:17.606086 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2026-02-25 13:10:17.606177 | controller | Wednesday 25 February 2026 13:10:17 +0000 (0:00:00.041) 0:02:50.487 **** 2026-02-25 13:10:17.655079 | controller | skipping: [instance] 2026-02-25 13:10:17.655160 | controller | 2026-02-25 13:10:17.655293 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2026-02-25 13:10:17.655391 | controller | Wednesday 25 February 2026 13:10:17 +0000 (0:00:00.049) 0:02:50.537 **** 2026-02-25 13:10:17.701847 | controller | skipping: [instance] 2026-02-25 13:10:17.701926 | controller | 2026-02-25 13:10:17.702014 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-25 13:10:17.702103 | controller | Wednesday 25 February 2026 13:10:17 +0000 (0:00:00.046) 0:02:50.584 **** 2026-02-25 13:10:17.726977 | controller | skipping: [instance] 2026-02-25 13:10:17.727058 | controller | 2026-02-25 13:10:17.727150 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2026-02-25 13:10:17.727235 | controller | Wednesday 25 February 2026 13:10:17 +0000 (0:00:00.025) 0:02:50.609 **** 2026-02-25 13:10:17.763148 | controller | 2026-02-25 13:10:17.763260 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-25 13:10:17.763362 | controller | Wednesday 25 February 2026 13:10:17 +0000 (0:00:00.036) 0:02:50.645 **** 2026-02-25 13:10:17.840174 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-25 13:10:17.840208 | controller | 2026-02-25 13:10:17.840333 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-25 13:10:17.840418 | controller | Wednesday 25 February 2026 13:10:17 +0000 (0:00:00.076) 0:02:50.722 **** 2026-02-25 13:10:18.094818 | controller | ok: [instance] 2026-02-25 13:10:18.094867 | controller | 2026-02-25 13:10:18.094960 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-25 13:10:18.095051 | controller | Wednesday 25 February 2026 13:10:18 +0000 (0:00:00.254) 0:02:50.976 **** 2026-02-25 13:10:18.314921 | controller | ok: [instance] 2026-02-25 13:10:18.314966 | controller | 2026-02-25 13:10:18.315057 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2026-02-25 13:10:18.315145 | controller | Wednesday 25 February 2026 13:10:18 +0000 (0:00:00.220) 0:02:51.196 **** 2026-02-25 13:10:18.750020 | controller | changed: [instance] 2026-02-25 13:10:18.750082 | controller | 2026-02-25 13:10:18.750157 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2026-02-25 13:10:18.750255 | controller | Wednesday 25 February 2026 13:10:18 +0000 (0:00:00.435) 0:02:51.631 **** 2026-02-25 13:10:18.787064 | controller | skipping: [instance] 2026-02-25 13:10:18.787147 | controller | 2026-02-25 13:10:18.787261 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-25 13:10:18.787366 | controller | Wednesday 25 February 2026 13:10:18 +0000 (0:00:00.035) 0:02:51.667 **** 2026-02-25 13:10:18.824623 | controller | skipping: [instance] 2026-02-25 13:10:18.824727 | controller | 2026-02-25 13:10:18.824838 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2026-02-25 13:10:18.824929 | controller | Wednesday 25 February 2026 13:10:18 +0000 (0:00:00.038) 0:02:51.706 **** 2026-02-25 13:10:20.520130 | controller | changed: [instance -> controller-0.instance] 2026-02-25 13:10:20.520208 | controller | 2026-02-25 13:10:20.520276 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2026-02-25 13:10:20.520382 | controller | Wednesday 25 February 2026 13:10:20 +0000 (0:00:01.695) 0:02:53.402 **** 2026-02-25 13:10:21.669649 | controller | changed: [instance -> controller-0.instance] 2026-02-25 13:10:21.715398 | controller | 2026-02-25 13:10:21.715437 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-25 13:10:21.715445 | controller | Wednesday 25 February 2026 13:10:21 +0000 (0:00:01.148) 0:02:54.550 **** 2026-02-25 13:10:21.715457 | controller | 2026-02-25 13:10:21.940886 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-25 13:10:21.940936 | controller | Wednesday 25 February 2026 13:10:21 +0000 (0:00:00.046) 0:02:54.597 **** 2026-02-25 13:10:21.940952 | controller | ok: [instance] 2026-02-25 13:10:21.967611 | controller | 2026-02-25 13:10:21.967644 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-25 13:10:21.967654 | controller | Wednesday 25 February 2026 13:10:21 +0000 (0:00:00.225) 0:02:54.822 **** 2026-02-25 13:10:21.967691 | controller | ok: [instance] 2026-02-25 13:10:21.998261 | controller | 2026-02-25 13:10:21.998291 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-25 13:10:21.998300 | controller | Wednesday 25 February 2026 13:10:21 +0000 (0:00:00.027) 0:02:54.849 **** 2026-02-25 13:10:21.998313 | controller | skipping: [instance] 2026-02-25 13:10:22.043936 | controller | 2026-02-25 13:10:22.043957 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2026-02-25 13:10:22.043964 | controller | Wednesday 25 February 2026 13:10:21 +0000 (0:00:00.030) 0:02:54.880 **** 2026-02-25 13:10:22.043973 | controller | 2026-02-25 13:10:22.132737 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-25 13:10:22.132770 | controller | Wednesday 25 February 2026 13:10:22 +0000 (0:00:00.045) 0:02:54.925 **** 2026-02-25 13:10:22.132788 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2026-02-25 13:10:22.374630 | controller | 2026-02-25 13:10:22.374693 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-25 13:10:22.374704 | controller | Wednesday 25 February 2026 13:10:22 +0000 (0:00:00.088) 0:02:55.014 **** 2026-02-25 13:10:22.374716 | controller | ok: [instance] 2026-02-25 13:10:22.374750 | controller | 2026-02-25 13:10:22.374811 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-25 13:10:22.374902 | controller | Wednesday 25 February 2026 13:10:22 +0000 (0:00:00.242) 0:02:55.256 **** 2026-02-25 13:10:22.628697 | controller | ok: [instance] 2026-02-25 13:10:22.628756 | controller | 2026-02-25 13:10:22.628834 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2026-02-25 13:10:22.628927 | controller | Wednesday 25 February 2026 13:10:22 +0000 (0:00:00.253) 0:02:55.510 **** 2026-02-25 13:10:23.141146 | controller | changed: [instance] 2026-02-25 13:10:23.141198 | controller | 2026-02-25 13:10:23.141324 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2026-02-25 13:10:23.141408 | controller | Wednesday 25 February 2026 13:10:23 +0000 (0:00:00.512) 0:02:56.023 **** 2026-02-25 13:10:23.982639 | controller | changed: [instance] 2026-02-25 13:10:23.983298 | controller | 2026-02-25 13:10:23.983429 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-25 13:10:23.983524 | controller | Wednesday 25 February 2026 13:10:23 +0000 (0:00:00.841) 0:02:56.864 **** 2026-02-25 13:10:24.016042 | controller | skipping: [instance] 2026-02-25 13:10:24.016103 | controller | 2026-02-25 13:10:24.016205 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2026-02-25 13:10:24.016317 | controller | Wednesday 25 February 2026 13:10:24 +0000 (0:00:00.033) 0:02:56.898 **** 2026-02-25 13:10:24.067964 | controller | skipping: [instance] 2026-02-25 13:10:24.068040 | controller | 2026-02-25 13:10:24.068142 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2026-02-25 13:10:24.068248 | controller | Wednesday 25 February 2026 13:10:24 +0000 (0:00:00.052) 0:02:56.950 **** 2026-02-25 13:10:24.117766 | controller | skipping: [instance] 2026-02-25 13:10:24.117870 | controller | 2026-02-25 13:10:24.117961 | controller | TASK [Create VBMC entity] ****************************************************** 2026-02-25 13:10:24.118053 | controller | Wednesday 25 February 2026 13:10:24 +0000 (0:00:00.049) 0:02:57.000 **** 2026-02-25 13:10:24.169861 | controller | skipping: [instance] => (item=compute-0) 2026-02-25 13:10:24.170445 | controller | skipping: [instance] => (item=controller-0) 2026-02-25 13:10:24.462814 | controller | skipping: [instance] => (item=crc-0) 2026-02-25 13:10:24.462844 | controller | skipping: [instance] 2026-02-25 13:10:24.462853 | controller | 2026-02-25 13:10:24.462859 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2026-02-25 13:10:24.462865 | controller | Wednesday 25 February 2026 13:10:24 +0000 (0:00:00.052) 0:02:57.052 **** 2026-02-25 13:10:24.462875 | controller | ok: [instance] 2026-02-25 13:10:24.871577 | controller | 2026-02-25 13:10:24.871609 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2026-02-25 13:10:24.871617 | controller | Wednesday 25 February 2026 13:10:24 +0000 (0:00:00.292) 0:02:57.344 **** 2026-02-25 13:10:24.871627 | controller | changed: [instance] 2026-02-25 13:10:24.916846 | controller | 2026-02-25 13:10:24.916873 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2026-02-25 13:10:24.916881 | controller | Wednesday 25 February 2026 13:10:24 +0000 (0:00:00.408) 0:02:57.753 **** 2026-02-25 13:10:24.916891 | controller | skipping: [instance] 2026-02-25 13:10:24.966233 | controller | 2026-02-25 13:10:24.966258 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2026-02-25 13:10:24.966266 | controller | Wednesday 25 February 2026 13:10:24 +0000 (0:00:00.042) 0:02:57.795 **** 2026-02-25 13:10:24.966274 | controller | skipping: [instance] 2026-02-25 13:10:25.011056 | controller | 2026-02-25 13:10:25.011078 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2026-02-25 13:10:25.011085 | controller | Wednesday 25 February 2026 13:10:24 +0000 (0:00:00.052) 0:02:57.848 **** 2026-02-25 13:10:25.011094 | controller | skipping: [instance] 2026-02-25 13:10:25.904928 | controller | 2026-02-25 13:10:25.904957 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2026-02-25 13:10:25.904964 | controller | Wednesday 25 February 2026 13:10:25 +0000 (0:00:00.044) 0:02:57.892 **** 2026-02-25 13:10:25.904973 | controller | changed: [instance] 2026-02-25 13:10:26.755234 | controller | 2026-02-25 13:10:26.755264 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2026-02-25 13:10:26.755271 | controller | Wednesday 25 February 2026 13:10:25 +0000 (0:00:00.893) 0:02:58.786 **** 2026-02-25 13:10:26.755281 | controller | changed: [instance] 2026-02-25 13:10:26.814299 | controller | 2026-02-25 13:10:26.814323 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2026-02-25 13:10:26.814331 | controller | Wednesday 25 February 2026 13:10:26 +0000 (0:00:00.850) 0:02:59.636 **** 2026-02-25 13:10:26.814340 | controller | skipping: [instance] 2026-02-25 13:10:26.885685 | controller | 2026-02-25 13:10:26.885707 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2026-02-25 13:10:26.885715 | controller | Wednesday 25 February 2026 13:10:26 +0000 (0:00:00.058) 0:02:59.695 **** 2026-02-25 13:10:26.885724 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2026-02-25 13:10:26.946739 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2026-02-25 13:10:26.946760 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2026-02-25 13:10:26.946767 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2026-02-25 13:10:26.946773 | controller | 2026-02-25 13:10:26.946778 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2026-02-25 13:10:26.946784 | controller | Wednesday 25 February 2026 13:10:26 +0000 (0:00:00.071) 0:02:59.767 **** 2026-02-25 13:10:26.946798 | controller | skipping: [instance] 2026-02-25 13:10:26.990522 | controller | 2026-02-25 13:10:26.990541 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2026-02-25 13:10:26.990548 | controller | Wednesday 25 February 2026 13:10:26 +0000 (0:00:00.061) 0:02:59.828 **** 2026-02-25 13:10:26.990562 | controller | skipping: [instance] 2026-02-25 13:10:27.033611 | controller | 2026-02-25 13:10:27.033629 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2026-02-25 13:10:27.033635 | controller | Wednesday 25 February 2026 13:10:26 +0000 (0:00:00.043) 0:02:59.872 **** 2026-02-25 13:10:27.033643 | controller | skipping: [instance] 2026-02-25 13:10:27.080275 | controller | 2026-02-25 13:10:27.080292 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2026-02-25 13:10:27.080299 | controller | Wednesday 25 February 2026 13:10:27 +0000 (0:00:00.043) 0:02:59.915 **** 2026-02-25 13:10:27.080307 | controller | skipping: [instance] 2026-02-25 13:10:27.080429 | controller | 2026-02-25 13:10:27.080570 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2026-02-25 13:10:27.080715 | controller | Wednesday 25 February 2026 13:10:27 +0000 (0:00:00.046) 0:02:59.962 **** 2026-02-25 13:10:27.731364 | controller | changed: [instance] 2026-02-25 13:10:27.731478 | controller | 2026-02-25 13:10:27.731530 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2026-02-25 13:10:27.731650 | controller | Wednesday 25 February 2026 13:10:27 +0000 (0:00:00.650) 0:03:00.613 **** 2026-02-25 13:10:27.771511 | controller | skipping: [instance] 2026-02-25 13:10:27.771709 | controller | 2026-02-25 13:10:27.771847 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2026-02-25 13:10:27.771972 | controller | Wednesday 25 February 2026 13:10:27 +0000 (0:00:00.039) 0:03:00.653 **** 2026-02-25 13:10:27.812861 | controller | skipping: [instance] 2026-02-25 13:10:27.855953 | controller | 2026-02-25 13:10:27.855990 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2026-02-25 13:10:27.855998 | controller | Wednesday 25 February 2026 13:10:27 +0000 (0:00:00.041) 0:03:00.694 **** 2026-02-25 13:10:27.856008 | controller | skipping: [instance] 2026-02-25 13:10:27.856027 | controller | 2026-02-25 13:10:27.856065 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-25 13:10:27.856173 | controller | Wednesday 25 February 2026 13:10:27 +0000 (0:00:00.043) 0:03:00.738 **** 2026-02-25 13:10:27.899993 | controller | skipping: [instance] 2026-02-25 13:10:27.938280 | controller | 2026-02-25 13:10:27.938317 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-25 13:10:27.938325 | controller | Wednesday 25 February 2026 13:10:27 +0000 (0:00:00.043) 0:03:00.781 **** 2026-02-25 13:10:27.938336 | controller | skipping: [instance] 2026-02-25 13:10:27.974695 | controller | 2026-02-25 13:10:27.974731 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-25 13:10:27.974739 | controller | Wednesday 25 February 2026 13:10:27 +0000 (0:00:00.038) 0:03:00.819 **** 2026-02-25 13:10:27.974750 | controller | skipping: [instance] 2026-02-25 13:10:28.010150 | controller | 2026-02-25 13:10:28.010183 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-25 13:10:28.010192 | controller | Wednesday 25 February 2026 13:10:27 +0000 (0:00:00.036) 0:03:00.856 **** 2026-02-25 13:10:28.010203 | controller | skipping: [instance] 2026-02-25 13:10:28.010228 | controller | 2026-02-25 13:10:28.010236 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-25 13:10:28.010383 | controller | Wednesday 25 February 2026 13:10:28 +0000 (0:00:00.035) 0:03:00.891 **** 2026-02-25 13:10:28.043135 | controller | skipping: [instance] 2026-02-25 13:10:28.075639 | controller | 2026-02-25 13:10:28.075688 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-25 13:10:28.075700 | controller | Wednesday 25 February 2026 13:10:28 +0000 (0:00:00.032) 0:03:00.924 **** 2026-02-25 13:10:28.075711 | controller | skipping: [instance] 2026-02-25 13:10:28.119154 | controller | 2026-02-25 13:10:28.119177 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-25 13:10:28.119185 | controller | Wednesday 25 February 2026 13:10:28 +0000 (0:00:00.032) 0:03:00.957 **** 2026-02-25 13:10:28.119195 | controller | skipping: [instance] 2026-02-25 13:10:28.152832 | controller | 2026-02-25 13:10:28.152856 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2026-02-25 13:10:28.152872 | controller | Wednesday 25 February 2026 13:10:28 +0000 (0:00:00.043) 0:03:01.000 **** 2026-02-25 13:10:28.152882 | controller | skipping: [instance] 2026-02-25 13:10:28.313133 | controller | 2026-02-25 13:10:28.313166 | controller | TASK [reproducer : Configure Controller node] ********************************** 2026-02-25 13:10:28.313178 | controller | Wednesday 25 February 2026 13:10:28 +0000 (0:00:00.033) 0:03:01.034 **** 2026-02-25 13:10:28.313189 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2026-02-25 13:10:29.577708 | controller | 2026-02-25 13:10:29.577742 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-25 13:10:29.577750 | controller | Wednesday 25 February 2026 13:10:28 +0000 (0:00:00.160) 0:03:01.194 **** 2026-02-25 13:10:29.577761 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-25 13:10:29.605752 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-25 13:10:29.605787 | controller | 2026-02-25 13:10:29.605797 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-25 13:10:29.605805 | controller | Wednesday 25 February 2026 13:10:29 +0000 (0:00:01.264) 0:03:02.459 **** 2026-02-25 13:10:29.605817 | controller | skipping: [instance] 2026-02-25 13:10:30.234284 | controller | 2026-02-25 13:10:30.234317 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-25 13:10:30.234325 | controller | Wednesday 25 February 2026 13:10:29 +0000 (0:00:00.028) 0:03:02.487 **** 2026-02-25 13:10:30.234336 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:10:30.281191 | controller | 2026-02-25 13:10:30.281215 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-25 13:10:30.281222 | controller | Wednesday 25 February 2026 13:10:30 +0000 (0:00:00.628) 0:03:03.115 **** 2026-02-25 13:10:30.281232 | controller | skipping: [instance] 2026-02-25 13:10:30.327368 | controller | 2026-02-25 13:10:30.327389 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-25 13:10:30.327397 | controller | Wednesday 25 February 2026 13:10:30 +0000 (0:00:00.047) 0:03:03.162 **** 2026-02-25 13:10:30.327406 | controller | skipping: [instance] 2026-02-25 13:10:30.373814 | controller | 2026-02-25 13:10:30.373835 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-25 13:10:30.373844 | controller | Wednesday 25 February 2026 13:10:30 +0000 (0:00:00.046) 0:03:03.209 **** 2026-02-25 13:10:30.373854 | controller | skipping: [instance] 2026-02-25 13:10:30.374040 | controller | 2026-02-25 13:10:30.374061 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-25 13:10:30.425004 | controller | Wednesday 25 February 2026 13:10:30 +0000 (0:00:00.046) 0:03:03.255 **** 2026-02-25 13:10:30.425051 | controller | skipping: [instance] 2026-02-25 13:10:30.467133 | controller | 2026-02-25 13:10:30.467150 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2026-02-25 13:10:30.467157 | controller | Wednesday 25 February 2026 13:10:30 +0000 (0:00:00.050) 0:03:03.306 **** 2026-02-25 13:10:30.467166 | controller | skipping: [instance] 2026-02-25 13:10:30.516426 | controller | 2026-02-25 13:10:30.516447 | controller | TASK [reproducer : Install repos] ********************************************** 2026-02-25 13:10:30.516456 | controller | Wednesday 25 February 2026 13:10:30 +0000 (0:00:00.042) 0:03:03.348 **** 2026-02-25 13:10:30.516465 | controller | skipping: [instance] 2026-02-25 13:10:30.516629 | controller | 2026-02-25 13:10:30.516799 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2026-02-25 13:10:30.516925 | controller | Wednesday 25 February 2026 13:10:30 +0000 (0:00:00.049) 0:03:03.398 **** 2026-02-25 13:10:30.573793 | controller | skipping: [instance] 2026-02-25 13:10:30.573955 | controller | 2026-02-25 13:10:30.574113 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2026-02-25 13:10:30.574257 | controller | Wednesday 25 February 2026 13:10:30 +0000 (0:00:00.052) 0:03:03.451 **** 2026-02-25 13:10:30.613176 | controller | skipping: [instance] 2026-02-25 13:10:30.613345 | controller | 2026-02-25 13:10:30.613496 | controller | TASK [reproducer : Install some tools] ***************************************** 2026-02-25 13:10:30.613655 | controller | Wednesday 25 February 2026 13:10:30 +0000 (0:00:00.043) 0:03:03.495 **** 2026-02-25 13:10:31.660029 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:10:32.802631 | controller | 2026-02-25 13:10:32.802661 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2026-02-25 13:10:32.802687 | controller | Wednesday 25 February 2026 13:10:31 +0000 (0:00:01.046) 0:03:04.541 **** 2026-02-25 13:10:32.802698 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:10:33.491569 | controller | 2026-02-25 13:10:33.491600 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2026-02-25 13:10:33.491608 | controller | Wednesday 25 February 2026 13:10:32 +0000 (0:00:01.142) 0:03:05.684 **** 2026-02-25 13:10:33.491618 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:10:34.476285 | controller | 2026-02-25 13:10:34.476345 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2026-02-25 13:10:34.476354 | controller | Wednesday 25 February 2026 13:10:33 +0000 (0:00:00.688) 0:03:06.373 **** 2026-02-25 13:10:34.476376 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:10:35.680134 | controller | 2026-02-25 13:10:35.680167 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2026-02-25 13:10:35.680175 | controller | Wednesday 25 February 2026 13:10:34 +0000 (0:00:00.984) 0:03:07.357 **** 2026-02-25 13:10:35.680186 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-25 13:10:36.426775 | controller | skipping: [instance] => (item=compute-0) 2026-02-25 13:10:36.426806 | controller | skipping: [instance] => (item=controller-0) 2026-02-25 13:10:36.426813 | controller | skipping: [instance] => (item=crc-0) 2026-02-25 13:10:36.426819 | controller | 2026-02-25 13:10:36.426833 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2026-02-25 13:10:36.426840 | controller | Wednesday 25 February 2026 13:10:35 +0000 (0:00:01.203) 0:03:08.561 **** 2026-02-25 13:10:36.426850 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-25 13:10:38.258521 | controller | skipping: [instance] => (item=compute-0) 2026-02-25 13:10:38.258564 | controller | skipping: [instance] => (item=controller-0) 2026-02-25 13:10:38.258572 | controller | skipping: [instance] => (item=crc-0) 2026-02-25 13:10:38.258577 | controller | 2026-02-25 13:10:38.258582 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2026-02-25 13:10:38.258588 | controller | Wednesday 25 February 2026 13:10:36 +0000 (0:00:00.746) 0:03:09.308 **** 2026-02-25 13:10:38.258597 | controller | skipping: [instance] => (item=instance) 2026-02-25 13:10:38.969417 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2026-02-25 13:10:38.969449 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-25 13:10:38.969457 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2026-02-25 13:10:38.969462 | controller | 2026-02-25 13:10:38.969467 | controller | TASK [reproducer : Create kube directory] ************************************** 2026-02-25 13:10:38.969473 | controller | Wednesday 25 February 2026 13:10:38 +0000 (0:00:01.828) 0:03:11.136 **** 2026-02-25 13:10:38.969482 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:10:40.114419 | controller | 2026-02-25 13:10:40.114454 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2026-02-25 13:10:40.114464 | controller | Wednesday 25 February 2026 13:10:38 +0000 (0:00:00.714) 0:03:11.851 **** 2026-02-25 13:10:40.114476 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:10:41.199120 | controller | 2026-02-25 13:10:41.199155 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2026-02-25 13:10:41.199162 | controller | Wednesday 25 February 2026 13:10:40 +0000 (0:00:01.144) 0:03:12.995 **** 2026-02-25 13:10:41.199172 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:10:41.243581 | controller | 2026-02-25 13:10:41.243610 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2026-02-25 13:10:41.243620 | controller | Wednesday 25 February 2026 13:10:41 +0000 (0:00:01.084) 0:03:14.080 **** 2026-02-25 13:10:41.243632 | controller | skipping: [instance] 2026-02-25 13:10:41.871931 | controller | 2026-02-25 13:10:41.871965 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2026-02-25 13:10:41.871973 | controller | Wednesday 25 February 2026 13:10:41 +0000 (0:00:00.044) 0:03:14.125 **** 2026-02-25 13:10:41.871983 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:10:42.519640 | controller | 2026-02-25 13:10:42.519688 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2026-02-25 13:10:42.519699 | controller | Wednesday 25 February 2026 13:10:41 +0000 (0:00:00.628) 0:03:14.753 **** 2026-02-25 13:10:42.519709 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:10:42.574158 | controller | 2026-02-25 13:10:42.574189 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2026-02-25 13:10:42.574200 | controller | Wednesday 25 February 2026 13:10:42 +0000 (0:00:00.642) 0:03:15.396 **** 2026-02-25 13:10:42.574212 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:10:42.645657 | controller | 2026-02-25 13:10:42.645693 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2026-02-25 13:10:42.645701 | controller | Wednesday 25 February 2026 13:10:42 +0000 (0:00:00.059) 0:03:15.455 **** 2026-02-25 13:10:42.645710 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2026-02-25 13:10:42.712740 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2026-02-25 13:10:42.712767 | controller | 2026-02-25 13:10:42.712776 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-25 13:10:42.712784 | controller | Wednesday 25 February 2026 13:10:42 +0000 (0:00:00.071) 0:03:15.527 **** 2026-02-25 13:10:42.712797 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 13:10:42.713002 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2026-02-25 13:10:42.713176 | controller | 2026-02-25 13:10:42.713353 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-25 13:10:42.713539 | controller | Wednesday 25 February 2026 13:10:42 +0000 (0:00:00.067) 0:03:15.594 **** 2026-02-25 13:10:42.773754 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 13:10:42.773893 | controller | _secret_file: '' 2026-02-25 13:10:42.774046 | controller | 2026-02-25 13:10:42.774221 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-25 13:10:42.774393 | controller | Wednesday 25 February 2026 13:10:42 +0000 (0:00:00.061) 0:03:15.656 **** 2026-02-25 13:10:42.835789 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 13:10:42.836015 | controller | _secret_content: my-default-location-place 2026-02-25 13:10:42.836156 | controller | 2026-02-25 13:10:42.836288 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-25 13:10:42.836422 | controller | Wednesday 25 February 2026 13:10:42 +0000 (0:00:00.061) 0:03:15.717 **** 2026-02-25 13:10:42.898155 | controller | skipping: [instance] 2026-02-25 13:10:42.898302 | controller | 2026-02-25 13:10:42.898458 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-25 13:10:42.898603 | controller | Wednesday 25 February 2026 13:10:42 +0000 (0:00:00.062) 0:03:15.780 **** 2026-02-25 13:10:42.963498 | controller | skipping: [instance] 2026-02-25 13:10:42.963711 | controller | 2026-02-25 13:10:42.963862 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-25 13:10:42.963993 | controller | Wednesday 25 February 2026 13:10:42 +0000 (0:00:00.063) 0:03:15.845 **** 2026-02-25 13:10:43.029186 | controller | skipping: [instance] 2026-02-25 13:10:43.029377 | controller | 2026-02-25 13:10:43.029525 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-25 13:10:43.029688 | controller | Wednesday 25 February 2026 13:10:43 +0000 (0:00:00.065) 0:03:15.911 **** 2026-02-25 13:10:44.279452 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:10:44.279657 | controller | 2026-02-25 13:10:44.279819 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-25 13:10:44.279946 | controller | Wednesday 25 February 2026 13:10:44 +0000 (0:00:01.244) 0:03:17.155 **** 2026-02-25 13:10:44.345934 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 13:10:44.346160 | controller | _secret_dest: /home/zuul/ipmi-things 2026-02-25 13:10:44.346311 | controller | 2026-02-25 13:10:44.346464 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-25 13:10:44.346605 | controller | Wednesday 25 February 2026 13:10:44 +0000 (0:00:00.071) 0:03:17.227 **** 2026-02-25 13:10:44.393447 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 13:10:44.393608 | controller | _secret_file: /tmp/ipmi-things 2026-02-25 13:10:44.393754 | controller | 2026-02-25 13:10:44.393881 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-25 13:10:44.393999 | controller | Wednesday 25 February 2026 13:10:44 +0000 (0:00:00.047) 0:03:17.275 **** 2026-02-25 13:10:44.451347 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-25 13:10:44.451540 | controller | _secret_content: '' 2026-02-25 13:10:44.451720 | controller | 2026-02-25 13:10:44.451886 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-25 13:10:44.452022 | controller | Wednesday 25 February 2026 13:10:44 +0000 (0:00:00.057) 0:03:17.333 **** 2026-02-25 13:10:44.508511 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2026-02-25 13:10:44.508687 | controller | msg: All assertions passed 2026-02-25 13:10:44.508820 | controller | 2026-02-25 13:10:44.508946 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-25 13:10:44.509066 | controller | Wednesday 25 February 2026 13:10:44 +0000 (0:00:00.057) 0:03:17.390 **** 2026-02-25 13:10:45.145618 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:10:46.152318 | controller | 2026-02-25 13:10:46.152385 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-25 13:10:46.152395 | controller | Wednesday 25 February 2026 13:10:45 +0000 (0:00:00.635) 0:03:18.026 **** 2026-02-25 13:10:46.152410 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:10:46.224893 | controller | 2026-02-25 13:10:46.224954 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-25 13:10:46.224963 | controller | Wednesday 25 February 2026 13:10:46 +0000 (0:00:01.006) 0:03:19.032 **** 2026-02-25 13:10:46.224977 | controller | skipping: [instance] 2026-02-25 13:10:46.908599 | controller | 2026-02-25 13:10:46.908658 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2026-02-25 13:10:46.908682 | controller | Wednesday 25 February 2026 13:10:46 +0000 (0:00:00.069) 0:03:19.102 **** 2026-02-25 13:10:46.908699 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:10:47.582960 | controller | 2026-02-25 13:10:47.583018 | controller | TASK [reproducer : Check if async file is still available] ********************* 2026-02-25 13:10:47.583026 | controller | Wednesday 25 February 2026 13:10:46 +0000 (0:00:00.686) 0:03:19.789 **** 2026-02-25 13:10:47.583040 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:27.523148 | controller | 2026-02-25 13:11:27.523201 | controller | TASK [reproducer : Check package install status] ******************************* 2026-02-25 13:11:27.523210 | controller | Wednesday 25 February 2026 13:10:47 +0000 (0:00:00.674) 0:03:20.463 **** 2026-02-25 13:11:27.523222 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2026-02-25 13:11:27.523433 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2026-02-25 13:11:27.523590 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2026-02-25 13:11:27.523758 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2026-02-25 13:11:27.523899 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2026-02-25 13:11:27.524035 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2026-02-25 13:11:27.524163 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2026-02-25 13:11:27.524289 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:27.524407 | controller | 2026-02-25 13:11:27.524551 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2026-02-25 13:11:27.524705 | controller | Wednesday 25 February 2026 13:11:27 +0000 (0:00:39.932) 0:04:00.396 **** 2026-02-25 13:11:28.200941 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:30.776195 | controller | 2026-02-25 13:11:30.776253 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2026-02-25 13:11:30.776261 | controller | Wednesday 25 February 2026 13:11:28 +0000 (0:00:00.685) 0:04:01.082 **** 2026-02-25 13:11:30.776274 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:30.834133 | controller | 2026-02-25 13:11:30.834183 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2026-02-25 13:11:30.834192 | controller | Wednesday 25 February 2026 13:11:30 +0000 (0:00:02.574) 0:04:03.657 **** 2026-02-25 13:11:30.834207 | controller | skipping: [instance] 2026-02-25 13:11:30.888888 | controller | 2026-02-25 13:11:30.888932 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2026-02-25 13:11:30.888940 | controller | Wednesday 25 February 2026 13:11:30 +0000 (0:00:00.058) 0:04:03.715 **** 2026-02-25 13:11:30.888953 | controller | skipping: [instance] 2026-02-25 13:11:31.559451 | controller | 2026-02-25 13:11:31.559509 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2026-02-25 13:11:31.559519 | controller | Wednesday 25 February 2026 13:11:30 +0000 (0:00:00.054) 0:04:03.770 **** 2026-02-25 13:11:31.559533 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:32.136952 | controller | 2026-02-25 13:11:32.136995 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2026-02-25 13:11:32.137003 | controller | Wednesday 25 February 2026 13:11:31 +0000 (0:00:00.670) 0:04:04.440 **** 2026-02-25 13:11:32.137016 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:32.480131 | controller | 2026-02-25 13:11:32.480191 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2026-02-25 13:11:32.480201 | controller | Wednesday 25 February 2026 13:11:32 +0000 (0:00:00.577) 0:04:05.018 **** 2026-02-25 13:11:32.480215 | controller | changed: [instance] 2026-02-25 13:11:33.205617 | controller | 2026-02-25 13:11:33.205697 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2026-02-25 13:11:33.205710 | controller | Wednesday 25 February 2026 13:11:32 +0000 (0:00:00.342) 0:04:05.361 **** 2026-02-25 13:11:33.205724 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:34.353161 | controller | 2026-02-25 13:11:34.353222 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2026-02-25 13:11:34.353231 | controller | Wednesday 25 February 2026 13:11:33 +0000 (0:00:00.725) 0:04:06.086 **** 2026-02-25 13:11:34.353244 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:34.458395 | controller | 2026-02-25 13:11:34.458427 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-25 13:11:34.458434 | controller | Wednesday 25 February 2026 13:11:34 +0000 (0:00:01.148) 0:04:07.234 **** 2026-02-25 13:11:34.458446 | controller | skipping: [instance] 2026-02-25 13:11:34.504618 | controller | 2026-02-25 13:11:34.504688 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-25 13:11:34.504705 | controller | Wednesday 25 February 2026 13:11:34 +0000 (0:00:00.105) 0:04:07.340 **** 2026-02-25 13:11:34.504719 | controller | skipping: [instance] 2026-02-25 13:11:34.542044 | controller | 2026-02-25 13:11:34.542073 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-25 13:11:34.542082 | controller | Wednesday 25 February 2026 13:11:34 +0000 (0:00:00.045) 0:04:07.386 **** 2026-02-25 13:11:34.542094 | controller | skipping: [instance] 2026-02-25 13:11:34.597608 | controller | 2026-02-25 13:11:34.597650 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2026-02-25 13:11:34.597659 | controller | Wednesday 25 February 2026 13:11:34 +0000 (0:00:00.037) 0:04:07.423 **** 2026-02-25 13:11:34.597685 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:34.597710 | controller | 2026-02-25 13:11:34.597783 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2026-02-25 13:11:34.597877 | controller | Wednesday 25 February 2026 13:11:34 +0000 (0:00:00.055) 0:04:07.479 **** 2026-02-25 13:11:34.637329 | controller | skipping: [instance] 2026-02-25 13:11:34.637399 | controller | 2026-02-25 13:11:34.637495 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2026-02-25 13:11:34.637582 | controller | Wednesday 25 February 2026 13:11:34 +0000 (0:00:00.039) 0:04:07.519 **** 2026-02-25 13:11:34.677846 | controller | skipping: [instance] 2026-02-25 13:11:34.677912 | controller | 2026-02-25 13:11:34.678007 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2026-02-25 13:11:34.678098 | controller | Wednesday 25 February 2026 13:11:34 +0000 (0:00:00.040) 0:04:07.560 **** 2026-02-25 13:11:34.716418 | controller | skipping: [instance] 2026-02-25 13:11:34.716505 | controller | 2026-02-25 13:11:34.716519 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2026-02-25 13:11:35.327234 | controller | Wednesday 25 February 2026 13:11:34 +0000 (0:00:00.038) 0:04:07.598 **** 2026-02-25 13:11:35.327325 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:35.327348 | controller | 2026-02-25 13:11:35.327426 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2026-02-25 13:11:35.327437 | controller | Wednesday 25 February 2026 13:11:35 +0000 (0:00:00.610) 0:04:08.209 **** 2026-02-25 13:11:35.434937 | controller | skipping: [instance] => (item=secret) 2026-02-25 13:11:35.434993 | controller | skipping: [instance] => (item=configmap) 2026-02-25 13:11:35.435086 | controller | skipping: [instance] => (item=pod) 2026-02-25 13:11:35.435170 | controller | skipping: [instance] => (item=service) 2026-02-25 13:11:35.435837 | controller | skipping: [instance] => (item=route) 2026-02-25 13:11:36.543228 | controller | skipping: [instance] 2026-02-25 13:11:36.543288 | controller | 2026-02-25 13:11:36.543298 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2026-02-25 13:11:36.543306 | controller | Wednesday 25 February 2026 13:11:35 +0000 (0:00:00.107) 0:04:08.317 **** 2026-02-25 13:11:36.543320 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:37.686556 | controller | 2026-02-25 13:11:37.686611 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2026-02-25 13:11:37.686620 | controller | Wednesday 25 February 2026 13:11:36 +0000 (0:00:01.107) 0:04:09.424 **** 2026-02-25 13:11:37.686633 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:37.730425 | controller | 2026-02-25 13:11:37.730442 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2026-02-25 13:11:37.730449 | controller | Wednesday 25 February 2026 13:11:37 +0000 (0:00:01.143) 0:04:10.567 **** 2026-02-25 13:11:37.730458 | controller | skipping: [instance] 2026-02-25 13:11:37.770083 | controller | 2026-02-25 13:11:37.770101 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2026-02-25 13:11:37.770110 | controller | Wednesday 25 February 2026 13:11:37 +0000 (0:00:00.044) 0:04:10.612 **** 2026-02-25 13:11:37.770119 | controller | skipping: [instance] 2026-02-25 13:11:37.842247 | controller | 2026-02-25 13:11:37.842273 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2026-02-25 13:11:37.842280 | controller | Wednesday 25 February 2026 13:11:37 +0000 (0:00:00.039) 0:04:10.652 **** 2026-02-25 13:11:37.842289 | controller | skipping: [instance] => (item=secret) 2026-02-25 13:11:37.879687 | controller | skipping: [instance] => (item=configmap) 2026-02-25 13:11:37.879706 | controller | skipping: [instance] => (item=service) 2026-02-25 13:11:37.879713 | controller | skipping: [instance] => (item=route) 2026-02-25 13:11:37.879719 | controller | skipping: [instance] 2026-02-25 13:11:37.879724 | controller | 2026-02-25 13:11:37.879730 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2026-02-25 13:11:37.879735 | controller | Wednesday 25 February 2026 13:11:37 +0000 (0:00:00.071) 0:04:10.723 **** 2026-02-25 13:11:37.879743 | controller | skipping: [instance] 2026-02-25 13:11:39.680246 | controller | 2026-02-25 13:11:39.680306 | controller | TASK [podman : Ensure podman is installed] ************************************* 2026-02-25 13:11:39.680315 | controller | Wednesday 25 February 2026 13:11:37 +0000 (0:00:00.037) 0:04:10.761 **** 2026-02-25 13:11:39.680329 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:40.641632 | controller | 2026-02-25 13:11:40.641698 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2026-02-25 13:11:40.641710 | controller | Wednesday 25 February 2026 13:11:39 +0000 (0:00:01.799) 0:04:12.561 **** 2026-02-25 13:11:40.641722 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:40.689108 | controller | 2026-02-25 13:11:40.689132 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2026-02-25 13:11:40.689141 | controller | Wednesday 25 February 2026 13:11:40 +0000 (0:00:00.961) 0:04:13.523 **** 2026-02-25 13:11:40.689154 | controller | skipping: [instance] 2026-02-25 13:11:40.733700 | controller | 2026-02-25 13:11:40.733719 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2026-02-25 13:11:40.733727 | controller | Wednesday 25 February 2026 13:11:40 +0000 (0:00:00.047) 0:04:13.570 **** 2026-02-25 13:11:40.733735 | controller | skipping: [instance] 2026-02-25 13:11:40.782864 | controller | 2026-02-25 13:11:40.782883 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2026-02-25 13:11:40.782891 | controller | Wednesday 25 February 2026 13:11:40 +0000 (0:00:00.044) 0:04:13.615 **** 2026-02-25 13:11:40.782900 | controller | skipping: [instance] 2026-02-25 13:11:52.368838 | controller | 2026-02-25 13:11:52.368900 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2026-02-25 13:11:52.368910 | controller | Wednesday 25 February 2026 13:11:40 +0000 (0:00:00.048) 0:04:13.664 **** 2026-02-25 13:11:52.368923 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:52.368947 | controller | 2026-02-25 13:11:52.368957 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2026-02-25 13:11:54.111188 | controller | Wednesday 25 February 2026 13:11:52 +0000 (0:00:11.585) 0:04:25.250 **** 2026-02-25 13:11:54.111260 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:55.368402 | controller | 2026-02-25 13:11:55.368461 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-25 13:11:55.368476 | controller | Wednesday 25 February 2026 13:11:54 +0000 (0:00:01.742) 0:04:26.992 **** 2026-02-25 13:11:55.368490 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-25 13:11:55.405919 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-25 13:11:55.405953 | controller | 2026-02-25 13:11:55.405960 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2026-02-25 13:11:55.405966 | controller | Wednesday 25 February 2026 13:11:55 +0000 (0:00:01.257) 0:04:28.249 **** 2026-02-25 13:11:55.405977 | controller | skipping: [instance] 2026-02-25 13:11:56.043397 | controller | 2026-02-25 13:11:56.043442 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2026-02-25 13:11:56.043451 | controller | Wednesday 25 February 2026 13:11:55 +0000 (0:00:00.038) 0:04:28.287 **** 2026-02-25 13:11:56.043463 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:56.090986 | controller | 2026-02-25 13:11:56.091011 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2026-02-25 13:11:56.091018 | controller | Wednesday 25 February 2026 13:11:56 +0000 (0:00:00.636) 0:04:28.924 **** 2026-02-25 13:11:56.091029 | controller | skipping: [instance] 2026-02-25 13:11:56.142093 | controller | 2026-02-25 13:11:56.142119 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2026-02-25 13:11:56.142136 | controller | Wednesday 25 February 2026 13:11:56 +0000 (0:00:00.048) 0:04:28.972 **** 2026-02-25 13:11:56.142146 | controller | skipping: [instance] 2026-02-25 13:11:56.192942 | controller | 2026-02-25 13:11:56.192961 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-25 13:11:56.192970 | controller | Wednesday 25 February 2026 13:11:56 +0000 (0:00:00.051) 0:04:29.023 **** 2026-02-25 13:11:56.192980 | controller | skipping: [instance] 2026-02-25 13:11:56.234855 | controller | 2026-02-25 13:11:56.234925 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-25 13:11:56.234934 | controller | Wednesday 25 February 2026 13:11:56 +0000 (0:00:00.050) 0:04:29.074 **** 2026-02-25 13:11:56.234949 | controller | skipping: [instance] 2026-02-25 13:11:56.381462 | controller | 2026-02-25 13:11:56.381498 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2026-02-25 13:11:56.381507 | controller | Wednesday 25 February 2026 13:11:56 +0000 (0:00:00.040) 0:04:29.115 **** 2026-02-25 13:11:56.381518 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'}) 2026-02-25 13:11:57.572547 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'}) 2026-02-25 13:11:57.572606 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'}) 2026-02-25 13:11:57.572615 | controller | 2026-02-25 13:11:57.572622 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2026-02-25 13:11:57.572630 | controller | Wednesday 25 February 2026 13:11:56 +0000 (0:00:00.147) 0:04:29.263 **** 2026-02-25 13:11:57.572643 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:57.622345 | controller | 2026-02-25 13:11:57.622391 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2026-02-25 13:11:57.622400 | controller | Wednesday 25 February 2026 13:11:57 +0000 (0:00:01.183) 0:04:30.446 **** 2026-02-25 13:11:57.622414 | controller | skipping: [instance] 2026-02-25 13:11:57.769193 | controller | 2026-02-25 13:11:57.769245 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2026-02-25 13:11:57.769254 | controller | Wednesday 25 February 2026 13:11:57 +0000 (0:00:00.057) 0:04:30.503 **** 2026-02-25 13:11:57.769268 | controller | 2026-02-25 13:11:57.769555 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2026-02-25 13:11:57.836606 | controller | Wednesday 25 February 2026 13:11:57 +0000 (0:00:00.146) 0:04:30.649 **** 2026-02-25 13:11:57.836638 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:11:57.891034 | controller | 2026-02-25 13:11:57.891053 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-25 13:11:57.891062 | controller | Wednesday 25 February 2026 13:11:57 +0000 (0:00:00.068) 0:04:30.718 **** 2026-02-25 13:11:57.891071 | controller | skipping: [instance] 2026-02-25 13:11:57.937407 | controller | 2026-02-25 13:11:57.937426 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-25 13:11:57.937434 | controller | Wednesday 25 February 2026 13:11:57 +0000 (0:00:00.054) 0:04:30.772 **** 2026-02-25 13:11:57.937443 | controller | skipping: [instance] 2026-02-25 13:11:59.290812 | controller | 2026-02-25 13:11:59.290871 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2026-02-25 13:11:59.290889 | controller | Wednesday 25 February 2026 13:11:57 +0000 (0:00:00.046) 0:04:30.819 **** 2026-02-25 13:11:59.290901 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:06.739327 | controller | 2026-02-25 13:12:06.739389 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2026-02-25 13:12:06.739398 | controller | Wednesday 25 February 2026 13:11:59 +0000 (0:00:01.352) 0:04:32.171 **** 2026-02-25 13:12:06.739411 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1) 2026-02-25 13:12:06.902393 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b) 2026-02-25 13:12:06.902431 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282) 2026-02-25 13:12:06.902438 | controller | 2026-02-25 13:12:06.902445 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2026-02-25 13:12:06.902451 | controller | Wednesday 25 February 2026 13:12:06 +0000 (0:00:07.446) 0:04:39.618 **** 2026-02-25 13:12:06.902463 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2026-02-25 13:12:07.185243 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2026-02-25 13:12:07.185294 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2026-02-25 13:12:07.185303 | controller | 2026-02-25 13:12:07.185319 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2026-02-25 13:12:07.185324 | controller | Wednesday 25 February 2026 13:12:06 +0000 (0:00:00.165) 0:04:39.783 **** 2026-02-25 13:12:07.185338 | controller | ok: [instance -> localhost] 2026-02-25 13:12:09.197212 | controller | 2026-02-25 13:12:09.197277 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2026-02-25 13:12:09.197286 | controller | Wednesday 25 February 2026 13:12:07 +0000 (0:00:00.282) 0:04:40.066 **** 2026-02-25 13:12:09.197299 | controller | changed: [instance -> localhost] => (item=controller-0) 2026-02-25 13:12:09.892621 | controller | 2026-02-25 13:12:09.892704 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2026-02-25 13:12:09.892716 | controller | Wednesday 25 February 2026 13:12:09 +0000 (0:00:02.010) 0:04:42.076 **** 2026-02-25 13:12:09.892730 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:10.686282 | controller | 2026-02-25 13:12:10.686345 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2026-02-25 13:12:10.686355 | controller | Wednesday 25 February 2026 13:12:09 +0000 (0:00:00.696) 0:04:42.773 **** 2026-02-25 13:12:10.686369 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:11.877776 | controller | 2026-02-25 13:12:11.877839 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2026-02-25 13:12:11.877856 | controller | Wednesday 25 February 2026 13:12:10 +0000 (0:00:00.786) 0:04:43.560 **** 2026-02-25 13:12:11.877871 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:11.878096 | controller | 2026-02-25 13:12:11.878112 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2026-02-25 13:12:12.639624 | controller | Wednesday 25 February 2026 13:12:11 +0000 (0:00:01.190) 0:04:44.750 **** 2026-02-25 13:12:12.639707 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:13.791703 | controller | 2026-02-25 13:12:13.791758 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2026-02-25 13:12:13.791767 | controller | Wednesday 25 February 2026 13:12:12 +0000 (0:00:00.770) 0:04:45.520 **** 2026-02-25 13:12:13.791781 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:14.470798 | controller | 2026-02-25 13:12:14.470866 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2026-02-25 13:12:14.470876 | controller | Wednesday 25 February 2026 13:12:13 +0000 (0:00:01.146) 0:04:46.666 **** 2026-02-25 13:12:14.470890 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:14.471058 | controller | 2026-02-25 13:12:14.471070 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2026-02-25 13:12:14.471079 | controller | Wednesday 25 February 2026 13:12:14 +0000 (0:00:00.684) 0:04:47.351 **** 2026-02-25 13:12:15.152580 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:16.638086 | controller | 2026-02-25 13:12:16.638140 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2026-02-25 13:12:16.638149 | controller | Wednesday 25 February 2026 13:12:15 +0000 (0:00:00.681) 0:04:48.033 **** 2026-02-25 13:12:16.638162 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-25 13:12:16.683931 | controller | 2026-02-25 13:12:16.683980 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-25 13:12:16.683989 | controller | Wednesday 25 February 2026 13:12:16 +0000 (0:00:01.485) 0:04:49.519 **** 2026-02-25 13:12:16.684002 | controller | skipping: [instance] 2026-02-25 13:12:16.727063 | controller | 2026-02-25 13:12:16.727105 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-25 13:12:16.727115 | controller | Wednesday 25 February 2026 13:12:16 +0000 (0:00:00.046) 0:04:49.565 **** 2026-02-25 13:12:16.727128 | controller | skipping: [instance] 2026-02-25 13:12:16.772733 | controller | 2026-02-25 13:12:16.772759 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-25 13:12:16.772769 | controller | Wednesday 25 February 2026 13:12:16 +0000 (0:00:00.043) 0:04:49.608 **** 2026-02-25 13:12:16.772781 | controller | skipping: [instance] 2026-02-25 13:12:16.773231 | controller | 2026-02-25 13:12:16.816962 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-25 13:12:16.816983 | controller | Wednesday 25 February 2026 13:12:16 +0000 (0:00:00.045) 0:04:49.654 **** 2026-02-25 13:12:16.816994 | controller | skipping: [instance] 2026-02-25 13:12:16.864236 | controller | 2026-02-25 13:12:16.864265 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-25 13:12:16.864273 | controller | Wednesday 25 February 2026 13:12:16 +0000 (0:00:00.043) 0:04:49.698 **** 2026-02-25 13:12:16.864284 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:17.070810 | controller | 2026-02-25 13:12:17.070885 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-25 13:12:17.070904 | controller | Wednesday 25 February 2026 13:12:16 +0000 (0:00:00.047) 0:04:49.746 **** 2026-02-25 13:12:17.070929 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-25 13:12:17.131355 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2026-02-25 13:12:17.131385 | controller | 2026-02-25 13:12:17.131392 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-25 13:12:17.131398 | controller | Wednesday 25 February 2026 13:12:17 +0000 (0:00:00.205) 0:04:49.951 **** 2026-02-25 13:12:17.131408 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2026-02-25 13:12:21.010214 | controller | 2026-02-25 13:12:21.010288 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2026-02-25 13:12:21.010298 | controller | Wednesday 25 February 2026 13:12:17 +0000 (0:00:00.061) 0:04:50.012 **** 2026-02-25 13:12:21.010313 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2026-02-25 13:12:22.163300 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2026-02-25 13:12:22.163359 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-25 13:12:22.163367 | controller | 2026-02-25 13:12:22.163374 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2026-02-25 13:12:22.163381 | controller | Wednesday 25 February 2026 13:12:21 +0000 (0:00:03.878) 0:04:53.891 **** 2026-02-25 13:12:22.163394 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:22.725807 | controller | 2026-02-25 13:12:22.725858 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-25 13:12:22.725877 | controller | Wednesday 25 February 2026 13:12:22 +0000 (0:00:01.153) 0:04:55.044 **** 2026-02-25 13:12:22.725903 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:23.698355 | controller | 2026-02-25 13:12:23.698416 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-25 13:12:23.698425 | controller | Wednesday 25 February 2026 13:12:22 +0000 (0:00:00.561) 0:04:55.606 **** 2026-02-25 13:12:23.698438 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:23.789931 | controller | 2026-02-25 13:12:23.789982 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-25 13:12:23.789991 | controller | Wednesday 25 February 2026 13:12:23 +0000 (0:00:00.973) 0:04:56.579 **** 2026-02-25 13:12:23.790004 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:23.850550 | controller | 2026-02-25 13:12:23.850601 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-25 13:12:23.850610 | controller | Wednesday 25 February 2026 13:12:23 +0000 (0:00:00.091) 0:04:56.671 **** 2026-02-25 13:12:23.850623 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:24.891121 | controller | 2026-02-25 13:12:24.891184 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-25 13:12:24.891193 | controller | Wednesday 25 February 2026 13:12:23 +0000 (0:00:00.060) 0:04:56.732 **** 2026-02-25 13:12:24.891208 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:25.960636 | controller | 2026-02-25 13:12:25.960709 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2026-02-25 13:12:25.960718 | controller | Wednesday 25 February 2026 13:12:24 +0000 (0:00:01.040) 0:04:57.772 **** 2026-02-25 13:12:25.960732 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:32.049767 | controller | 2026-02-25 13:12:32.049814 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2026-02-25 13:12:32.049822 | controller | Wednesday 25 February 2026 13:12:25 +0000 (0:00:01.063) 0:04:58.835 **** 2026-02-25 13:12:32.049834 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2026-02-25 13:12:32.049853 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:32.049860 | controller | 2026-02-25 13:12:32.049865 | controller | TASK [Configure ntp service] *************************************************** 2026-02-25 13:12:32.049872 | controller | Wednesday 25 February 2026 13:12:32 +0000 (0:00:06.088) 0:05:04.924 **** 2026-02-25 13:12:32.280617 | controller | 2026-02-25 13:12:32.280722 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2026-02-25 13:12:32.280767 | controller | Wednesday 25 February 2026 13:12:32 +0000 (0:00:00.238) 0:05:05.162 **** 2026-02-25 13:12:33.341815 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:34.236561 | controller | 2026-02-25 13:12:34.236600 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2026-02-25 13:12:34.236609 | controller | Wednesday 25 February 2026 13:12:33 +0000 (0:00:01.060) 0:05:06.223 **** 2026-02-25 13:12:34.236621 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2026-02-25 13:12:35.127024 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2026-02-25 13:12:35.127061 | controller | 2026-02-25 13:12:35.127070 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2026-02-25 13:12:35.127076 | controller | Wednesday 25 February 2026 13:12:34 +0000 (0:00:00.894) 0:05:07.117 **** 2026-02-25 13:12:35.127087 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:35.750544 | controller | 2026-02-25 13:12:35.750580 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2026-02-25 13:12:35.750588 | controller | Wednesday 25 February 2026 13:12:35 +0000 (0:00:00.890) 0:05:08.008 **** 2026-02-25 13:12:35.750603 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:35.888863 | controller | 2026-02-25 13:12:35.888911 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2026-02-25 13:12:35.888923 | controller | Wednesday 25 February 2026 13:12:35 +0000 (0:00:00.623) 0:05:08.632 **** 2026-02-25 13:12:35.888936 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2026-02-25 13:12:36.332218 | controller | 2026-02-25 13:12:36.332245 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2026-02-25 13:12:36.332252 | controller | Wednesday 25 February 2026 13:12:35 +0000 (0:00:00.138) 0:05:08.770 **** 2026-02-25 13:12:36.332263 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:36.842303 | controller | 2026-02-25 13:12:36.842342 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2026-02-25 13:12:36.842350 | controller | Wednesday 25 February 2026 13:12:36 +0000 (0:00:00.443) 0:05:09.213 **** 2026-02-25 13:12:36.842365 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-25 13:12:37.605352 | controller | 2026-02-25 13:12:37.605391 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2026-02-25 13:12:37.605513 | controller | Wednesday 25 February 2026 13:12:36 +0000 (0:00:00.508) 0:05:09.722 **** 2026-02-25 13:12:37.605524 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-25 13:12:38.200930 | controller | 2026-02-25 13:12:38.200972 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2026-02-25 13:12:38.200980 | controller | Wednesday 25 February 2026 13:12:37 +0000 (0:00:00.756) 0:05:10.478 **** 2026-02-25 13:12:38.200992 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-25 13:12:38.253390 | controller | 2026-02-25 13:12:38.253411 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2026-02-25 13:12:38.253428 | controller | Wednesday 25 February 2026 13:12:38 +0000 (0:00:00.603) 0:05:11.081 **** 2026-02-25 13:12:38.253437 | controller | 2026-02-25 13:12:38.727771 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2026-02-25 13:12:38.727798 | controller | Wednesday 25 February 2026 13:12:38 +0000 (0:00:00.053) 0:05:11.135 **** 2026-02-25 13:12:38.727809 | controller | ok: [instance -> crc-0(crc-0.instance)] 2026-02-25 13:12:39.556634 | controller | 2026-02-25 13:12:39.556689 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2026-02-25 13:12:39.556700 | controller | Wednesday 25 February 2026 13:12:38 +0000 (0:00:00.474) 0:05:11.609 **** 2026-02-25 13:12:39.556711 | controller | changed: [instance -> crc-0(crc-0.instance)] 2026-02-25 13:12:39.594735 | controller | 2026-02-25 13:12:39.594762 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2026-02-25 13:12:39.594772 | controller | Wednesday 25 February 2026 13:12:39 +0000 (0:00:00.827) 0:05:12.437 **** 2026-02-25 13:12:39.594784 | controller | skipping: [instance] 2026-02-25 13:12:39.595252 | controller | 2026-02-25 13:12:39.634389 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2026-02-25 13:12:39.634414 | controller | Wednesday 25 February 2026 13:12:39 +0000 (0:00:00.039) 0:05:12.476 **** 2026-02-25 13:12:39.634427 | controller | skipping: [instance] 2026-02-25 13:12:39.897919 | controller | 2026-02-25 13:12:39.897952 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2026-02-25 13:12:39.897960 | controller | Wednesday 25 February 2026 13:12:39 +0000 (0:00:00.039) 0:05:12.516 **** 2026-02-25 13:12:39.897970 | controller | changed: [instance] 2026-02-25 13:12:39.974338 | controller | 2026-02-25 13:12:39.974357 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2026-02-25 13:12:39.974363 | controller | Wednesday 25 February 2026 13:12:39 +0000 (0:00:00.263) 0:05:12.779 **** 2026-02-25 13:12:39.974371 | controller | skipping: [instance] => (item=) 2026-02-25 13:12:40.011249 | controller | 2026-02-25 13:12:40.011265 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2026-02-25 13:12:40.011272 | controller | Wednesday 25 February 2026 13:12:39 +0000 (0:00:00.076) 0:05:12.856 **** 2026-02-25 13:12:40.011280 | controller | ok: [instance] 2026-02-25 13:12:40.103968 | controller | 2026-02-25 13:12:40.104004 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-25 13:12:40.104012 | controller | Wednesday 25 February 2026 13:12:40 +0000 (0:00:00.037) 0:05:12.893 **** 2026-02-25 13:12:40.104023 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-25 13:12:40.392334 | controller | 2026-02-25 13:12:40.392369 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-25 13:12:40.392377 | controller | Wednesday 25 February 2026 13:12:40 +0000 (0:00:00.091) 0:05:12.985 **** 2026-02-25 13:12:40.392388 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2026-02-25 13:12:40.442833 | controller | 2026-02-25 13:12:40.442860 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2026-02-25 13:12:40.442871 | controller | Wednesday 25 February 2026 13:12:40 +0000 (0:00:00.288) 0:05:13.273 **** 2026-02-25 13:12:40.442881 | controller | 2026-02-25 13:12:40.525193 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-25 13:12:40.525230 | controller | Wednesday 25 February 2026 13:12:40 +0000 (0:00:00.050) 0:05:13.324 **** 2026-02-25 13:12:40.525243 | controller | ok: [instance] 2026-02-25 13:12:40.593730 | controller | 2026-02-25 13:12:40.593752 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-25 13:12:40.593760 | controller | Wednesday 25 February 2026 13:12:40 +0000 (0:00:00.082) 0:05:13.407 **** 2026-02-25 13:12:40.593770 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-25 13:12:40.873217 | controller | 2026-02-25 13:12:40.873247 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-25 13:12:40.873255 | controller | Wednesday 25 February 2026 13:12:40 +0000 (0:00:00.068) 0:05:13.475 **** 2026-02-25 13:12:40.873264 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-25 13:12:40.949932 | controller | 2026-02-25 13:12:40.949951 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-25 13:12:40.949959 | controller | Wednesday 25 February 2026 13:12:40 +0000 (0:00:00.279) 0:05:13.754 **** 2026-02-25 13:12:40.949969 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2026-02-25 13:12:41.436164 | controller | skipping: [instance] 2026-02-25 13:12:41.436198 | controller | 2026-02-25 13:12:41.436206 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2026-02-25 13:12:41.436212 | controller | Wednesday 25 February 2026 13:12:40 +0000 (0:00:00.076) 0:05:13.831 **** 2026-02-25 13:12:41.436223 | controller | changed: [instance] 2026-02-25 13:12:42.188044 | controller | 2026-02-25 13:12:42.188074 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-25 13:12:42.188082 | controller | Wednesday 25 February 2026 13:12:41 +0000 (0:00:00.474) 0:05:14.305 **** 2026-02-25 13:12:42.188088 | controller | 2026-02-25 13:12:42.188093 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2026-02-25 13:12:42.188099 | controller | Wednesday 25 February 2026 13:12:41 +0000 (0:00:00.011) 0:05:14.317 **** 2026-02-25 13:12:42.188108 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:42.622319 | controller | 2026-02-25 13:12:42.622346 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-25 13:12:42.622354 | controller | Wednesday 25 February 2026 13:12:42 +0000 (0:00:00.750) 0:05:15.068 **** 2026-02-25 13:12:42.622363 | controller | changed: [instance] 2026-02-25 13:12:42.803658 | controller | 2026-02-25 13:12:42.803706 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2026-02-25 13:12:42.803714 | controller | Wednesday 25 February 2026 13:12:42 +0000 (0:00:00.435) 0:05:15.503 **** 2026-02-25 13:12:42.803723 | controller | skipping: [instance] => (item=controller-0) 2026-02-25 13:12:44.377389 | controller | skipping: [instance] => (item=crc-0) 2026-02-25 13:12:44.377471 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2026-02-25 13:12:44.377481 | controller | 2026-02-25 13:12:44.377488 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2026-02-25 13:12:44.377495 | controller | Wednesday 25 February 2026 13:12:42 +0000 (0:00:00.181) 0:05:15.685 **** 2026-02-25 13:12:44.377514 | controller | changed: [instance -> compute-0(compute-0.instance)] 2026-02-25 13:12:44.377520 | controller | 2026-02-25 13:12:44.377529 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-25 13:12:44.398561 | controller | Wednesday 25 February 2026 13:12:44 +0000 (0:00:01.573) 0:05:17.259 **** 2026-02-25 13:12:44.398635 | controller | skipping: [instance] 2026-02-25 13:12:44.937295 | controller | 2026-02-25 13:12:44.937353 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-25 13:12:44.937364 | controller | Wednesday 25 February 2026 13:12:44 +0000 (0:00:00.021) 0:05:17.280 **** 2026-02-25 13:12:44.937382 | controller | ok: [instance -> compute-0(compute-0.instance)] 2026-02-25 13:12:44.937517 | controller | 2026-02-25 13:12:44.937550 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-25 13:12:44.937563 | controller | Wednesday 25 February 2026 13:12:44 +0000 (0:00:00.538) 0:05:17.818 **** 2026-02-25 13:12:44.982175 | controller | skipping: [instance] 2026-02-25 13:12:44.982336 | controller | 2026-02-25 13:12:44.982349 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-25 13:12:44.982527 | controller | Wednesday 25 February 2026 13:12:44 +0000 (0:00:00.045) 0:05:17.863 **** 2026-02-25 13:12:45.025814 | controller | skipping: [instance] 2026-02-25 13:12:45.025881 | controller | 2026-02-25 13:12:45.025986 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-25 13:12:45.026069 | controller | Wednesday 25 February 2026 13:12:45 +0000 (0:00:00.043) 0:05:17.907 **** 2026-02-25 13:12:45.066180 | controller | skipping: [instance] 2026-02-25 13:12:45.066252 | controller | 2026-02-25 13:12:45.066343 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-25 13:12:45.066452 | controller | Wednesday 25 February 2026 13:12:45 +0000 (0:00:00.040) 0:05:17.948 **** 2026-02-25 13:12:45.116334 | controller | skipping: [instance] 2026-02-25 13:12:45.116415 | controller | 2026-02-25 13:12:45.116504 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2026-02-25 13:12:45.116592 | controller | Wednesday 25 February 2026 13:12:45 +0000 (0:00:00.050) 0:05:17.998 **** 2026-02-25 13:12:45.158701 | controller | skipping: [instance] 2026-02-25 13:12:45.158772 | controller | 2026-02-25 13:12:45.158864 | controller | TASK [reproducer : Create repositories on computes] **************************** 2026-02-25 13:12:45.158959 | controller | Wednesday 25 February 2026 13:12:45 +0000 (0:00:00.041) 0:05:18.040 **** 2026-02-25 13:12:45.183422 | controller | skipping: [instance] 2026-02-25 13:12:45.183519 | controller | 2026-02-25 13:12:45.183647 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2026-02-25 13:12:45.183811 | controller | Wednesday 25 February 2026 13:12:45 +0000 (0:00:00.024) 0:05:18.065 **** 2026-02-25 13:12:45.214930 | controller | skipping: [instance] 2026-02-25 13:12:45.215016 | controller | 2026-02-25 13:12:45.215123 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2026-02-25 13:12:45.215221 | controller | Wednesday 25 February 2026 13:12:45 +0000 (0:00:00.031) 0:05:18.097 **** 2026-02-25 13:12:45.273539 | controller | ok: [instance] 2026-02-25 13:12:45.273571 | controller | 2026-02-25 13:12:45.273689 | controller | TASK [reproducer : Push local code] ******************************************** 2026-02-25 13:12:45.273798 | controller | Wednesday 25 February 2026 13:12:45 +0000 (0:00:00.058) 0:05:18.155 **** 2026-02-25 13:12:45.378399 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2026-02-25 13:12:45.420493 | controller | 2026-02-25 13:12:45.420514 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2026-02-25 13:12:45.420521 | controller | Wednesday 25 February 2026 13:12:45 +0000 (0:00:00.104) 0:05:18.260 **** 2026-02-25 13:12:45.420531 | controller | skipping: [instance] 2026-02-25 13:12:45.470776 | controller | 2026-02-25 13:12:45.470803 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2026-02-25 13:12:45.470812 | controller | Wednesday 25 February 2026 13:12:45 +0000 (0:00:00.042) 0:05:18.302 **** 2026-02-25 13:12:45.470824 | controller | skipping: [instance] 2026-02-25 13:12:45.470853 | controller | 2026-02-25 13:12:45.470861 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2026-02-25 13:12:45.470869 | controller | Wednesday 25 February 2026 13:12:45 +0000 (0:00:00.049) 0:05:18.352 **** 2026-02-25 13:12:45.517171 | controller | skipping: [instance] 2026-02-25 13:12:45.517299 | controller | 2026-02-25 13:12:45.517434 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2026-02-25 13:12:45.517558 | controller | Wednesday 25 February 2026 13:12:45 +0000 (0:00:00.046) 0:05:18.399 **** 2026-02-25 13:12:45.564090 | controller | skipping: [instance] 2026-02-25 13:12:45.564207 | controller | 2026-02-25 13:12:45.564337 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2026-02-25 13:12:45.564462 | controller | Wednesday 25 February 2026 13:12:45 +0000 (0:00:00.046) 0:05:18.446 **** 2026-02-25 13:12:45.610398 | controller | skipping: [instance] 2026-02-25 13:12:46.122752 | controller | 2026-02-25 13:12:46.122786 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2026-02-25 13:12:46.122794 | controller | Wednesday 25 February 2026 13:12:45 +0000 (0:00:00.045) 0:05:18.491 **** 2026-02-25 13:12:46.122805 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2026-02-25 13:12:46.122856 | controller | 2026-02-25 13:12:46.122865 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2026-02-25 13:12:46.721796 | controller | Wednesday 25 February 2026 13:12:46 +0000 (0:00:00.512) 0:05:19.003 **** 2026-02-25 13:12:46.721846 | controller | ok: [instance -> localhost] => (item=ci-framework) 2026-02-25 13:12:46.774986 | controller | 2026-02-25 13:12:46.775011 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2026-02-25 13:12:46.775021 | controller | Wednesday 25 February 2026 13:12:46 +0000 (0:00:00.599) 0:05:19.603 **** 2026-02-25 13:12:46.775034 | controller | skipping: [instance] => (item=ci-framework) 2026-02-25 13:12:46.860823 | controller | skipping: [instance] 2026-02-25 13:12:46.860879 | controller | 2026-02-25 13:12:46.860891 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2026-02-25 13:12:46.860900 | controller | Wednesday 25 February 2026 13:12:46 +0000 (0:00:00.053) 0:05:19.656 **** 2026-02-25 13:12:46.860931 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2026-02-25 13:12:46.860989 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2026-02-25 13:12:46.861001 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2026-02-25 13:12:46.861331 | controller | 2026-02-25 13:12:47.383488 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2026-02-25 13:12:47.383573 | controller | Wednesday 25 February 2026 13:12:46 +0000 (0:00:00.086) 0:05:19.742 **** 2026-02-25 13:12:47.383593 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:47.383692 | controller | 2026-02-25 13:12:47.421769 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2026-02-25 13:12:47.421836 | controller | Wednesday 25 February 2026 13:12:47 +0000 (0:00:00.522) 0:05:20.264 **** 2026-02-25 13:12:47.421857 | controller | skipping: [instance] 2026-02-25 13:12:47.421933 | controller | 2026-02-25 13:12:47.421948 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2026-02-25 13:12:47.928722 | controller | Wednesday 25 February 2026 13:12:47 +0000 (0:00:00.039) 0:05:20.303 **** 2026-02-25 13:12:47.928759 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:47.967801 | controller | 2026-02-25 13:12:47.967843 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2026-02-25 13:12:47.967851 | controller | Wednesday 25 February 2026 13:12:47 +0000 (0:00:00.506) 0:05:20.810 **** 2026-02-25 13:12:47.967863 | controller | skipping: [instance] 2026-02-25 13:12:47.967893 | controller | 2026-02-25 13:12:47.968130 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2026-02-25 13:12:48.451328 | controller | Wednesday 25 February 2026 13:12:47 +0000 (0:00:00.039) 0:05:20.849 **** 2026-02-25 13:12:48.451401 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:48.451424 | controller | 2026-02-25 13:12:48.451431 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2026-02-25 13:12:48.451438 | controller | Wednesday 25 February 2026 13:12:48 +0000 (0:00:00.482) 0:05:21.332 **** 2026-02-25 13:12:50.786492 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:12:50.786560 | controller | 2026-02-25 13:12:50.786650 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2026-02-25 13:12:50.786663 | controller | Wednesday 25 February 2026 13:12:50 +0000 (0:00:02.335) 0:05:23.668 **** 2026-02-25 13:13:10.803998 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:10.804322 | controller | 2026-02-25 13:13:11.943600 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2026-02-25 13:13:11.943637 | controller | Wednesday 25 February 2026 13:13:10 +0000 (0:00:20.017) 0:05:43.685 **** 2026-02-25 13:13:11.943657 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:12.059829 | controller | 2026-02-25 13:13:12.059927 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2026-02-25 13:13:12.059938 | controller | Wednesday 25 February 2026 13:13:11 +0000 (0:00:01.139) 0:05:44.824 **** 2026-02-25 13:13:12.059962 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2026-02-25 13:13:12.060023 | controller | 2026-02-25 13:13:12.060037 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2026-02-25 13:13:12.573907 | controller | Wednesday 25 February 2026 13:13:12 +0000 (0:00:00.116) 0:05:44.941 **** 2026-02-25 13:13:12.573993 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:12.621431 | controller | 2026-02-25 13:13:12.621514 | controller | TASK [reproducer : Rotate log if present] ************************************** 2026-02-25 13:13:12.621525 | controller | Wednesday 25 February 2026 13:13:12 +0000 (0:00:00.513) 0:05:45.454 **** 2026-02-25 13:13:12.621549 | controller | skipping: [instance] 2026-02-25 13:13:12.621583 | controller | 2026-02-25 13:13:12.621589 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2026-02-25 13:13:12.621598 | controller | Wednesday 25 February 2026 13:13:12 +0000 (0:00:00.048) 0:05:45.503 **** 2026-02-25 13:13:12.673580 | controller | skipping: [instance] 2026-02-25 13:13:12.673645 | controller | 2026-02-25 13:13:12.673773 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2026-02-25 13:13:12.673869 | controller | Wednesday 25 February 2026 13:13:12 +0000 (0:00:00.051) 0:05:45.554 **** 2026-02-25 13:13:12.784573 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:12.784633 | controller | 2026-02-25 13:13:12.784786 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-25 13:13:12.784902 | controller | Wednesday 25 February 2026 13:13:12 +0000 (0:00:00.111) 0:05:45.666 **** 2026-02-25 13:13:13.331613 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:13.331722 | controller | 2026-02-25 13:13:13.331810 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-25 13:13:13.331821 | controller | Wednesday 25 February 2026 13:13:13 +0000 (0:00:00.546) 0:05:46.212 **** 2026-02-25 13:13:13.380358 | controller | skipping: [instance] 2026-02-25 13:13:13.380421 | controller | 2026-02-25 13:13:13.380523 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-25 13:13:13.380617 | controller | Wednesday 25 February 2026 13:13:13 +0000 (0:00:00.049) 0:05:46.262 **** 2026-02-25 13:13:13.431619 | controller | skipping: [instance] 2026-02-25 13:13:13.431990 | controller | 2026-02-25 13:13:13.432080 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-25 13:13:13.432176 | controller | Wednesday 25 February 2026 13:13:13 +0000 (0:00:00.051) 0:05:46.313 **** 2026-02-25 13:13:13.480462 | controller | skipping: [instance] 2026-02-25 13:13:13.480509 | controller | 2026-02-25 13:13:13.480700 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-25 13:13:13.480739 | controller | Wednesday 25 February 2026 13:13:13 +0000 (0:00:00.048) 0:05:46.362 **** 2026-02-25 13:13:13.540241 | controller | skipping: [instance] 2026-02-25 13:13:13.540398 | controller | 2026-02-25 13:13:13.540546 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-25 13:13:13.540573 | controller | Wednesday 25 February 2026 13:13:13 +0000 (0:00:00.059) 0:05:46.422 **** 2026-02-25 13:13:15.013501 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 13:13:15.013602 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 13:13:15.013635 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 13:13:15.013647 | controller | changed: [instance -> controller-0] 2026-02-25 13:13:15.014000 | controller | 2026-02-25 13:13:16.084859 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-25 13:13:16.084924 | controller | Wednesday 25 February 2026 13:13:15 +0000 (0:00:01.472) 0:05:47.894 **** 2026-02-25 13:13:16.084939 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:16.085156 | controller | 2026-02-25 13:13:17.436262 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-25 13:13:17.436305 | controller | Wednesday 25 February 2026 13:13:16 +0000 (0:00:01.071) 0:05:48.966 **** 2026-02-25 13:13:17.436321 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:25.302343 | controller | 2026-02-25 13:13:25.302428 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-25 13:13:25.302437 | controller | Wednesday 25 February 2026 13:13:17 +0000 (0:00:01.351) 0:05:50.317 **** 2026-02-25 13:13:25.302456 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:26.301393 | controller | 2026-02-25 13:13:26.301444 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-25 13:13:26.301452 | controller | Wednesday 25 February 2026 13:13:25 +0000 (0:00:07.864) 0:05:58.181 **** 2026-02-25 13:13:26.301466 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:26.301485 | controller | 2026-02-25 13:13:26.301494 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-25 13:13:26.348304 | controller | Wednesday 25 February 2026 13:13:26 +0000 (0:00:01.000) 0:05:59.182 **** 2026-02-25 13:13:26.348333 | controller | skipping: [instance] 2026-02-25 13:13:26.348370 | controller | 2026-02-25 13:13:26.348487 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-25 13:13:26.348526 | controller | Wednesday 25 February 2026 13:13:26 +0000 (0:00:00.047) 0:05:59.230 **** 2026-02-25 13:13:27.526232 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:27.526289 | controller | 2026-02-25 13:13:27.526468 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-25 13:13:27.587279 | controller | Wednesday 25 February 2026 13:13:27 +0000 (0:00:01.177) 0:06:00.407 **** 2026-02-25 13:13:27.587310 | controller | skipping: [instance] 2026-02-25 13:13:27.642884 | controller | 2026-02-25 13:13:27.642930 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-25 13:13:27.642939 | controller | Wednesday 25 February 2026 13:13:27 +0000 (0:00:00.061) 0:06:00.469 **** 2026-02-25 13:13:27.642951 | controller | skipping: [instance] 2026-02-25 13:13:27.643066 | controller | 2026-02-25 13:13:27.643075 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-25 13:13:27.643083 | controller | Wednesday 25 February 2026 13:13:27 +0000 (0:00:00.055) 0:06:00.525 **** 2026-02-25 13:13:27.703454 | controller | skipping: [instance] 2026-02-25 13:13:27.703545 | controller | 2026-02-25 13:13:27.703660 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-25 13:13:27.703803 | controller | Wednesday 25 February 2026 13:13:27 +0000 (0:00:00.060) 0:06:00.585 **** 2026-02-25 13:13:28.655834 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:28.655903 | controller | 2026-02-25 13:13:28.656018 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-25 13:13:28.656114 | controller | Wednesday 25 February 2026 13:13:28 +0000 (0:00:00.952) 0:06:01.537 **** 2026-02-25 13:13:29.610630 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:29.610692 | controller | 2026-02-25 13:13:29.610793 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-25 13:13:29.610893 | controller | Wednesday 25 February 2026 13:13:29 +0000 (0:00:00.954) 0:06:02.492 **** 2026-02-25 13:13:29.659643 | controller | skipping: [instance] 2026-02-25 13:13:29.703813 | controller | 2026-02-25 13:13:29.703858 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-25 13:13:29.703868 | controller | Wednesday 25 February 2026 13:13:29 +0000 (0:00:00.049) 0:06:02.541 **** 2026-02-25 13:13:29.703881 | controller | skipping: [instance] 2026-02-25 13:13:29.703915 | controller | 2026-02-25 13:13:29.703925 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-25 13:13:29.703995 | controller | Wednesday 25 February 2026 13:13:29 +0000 (0:00:00.044) 0:06:02.585 **** 2026-02-25 13:13:29.748656 | controller | skipping: [instance] 2026-02-25 13:13:29.748733 | controller | 2026-02-25 13:13:29.748744 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-25 13:13:29.748756 | controller | Wednesday 25 February 2026 13:13:29 +0000 (0:00:00.044) 0:06:02.630 **** 2026-02-25 13:13:29.811966 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:29.855637 | controller | 2026-02-25 13:13:29.855685 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-25 13:13:29.855702 | controller | Wednesday 25 February 2026 13:13:29 +0000 (0:00:00.062) 0:06:02.693 **** 2026-02-25 13:13:29.855716 | controller | skipping: [instance] 2026-02-25 13:13:29.900462 | controller | 2026-02-25 13:13:29.900481 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-25 13:13:29.900488 | controller | Wednesday 25 February 2026 13:13:29 +0000 (0:00:00.043) 0:06:02.737 **** 2026-02-25 13:13:29.900497 | controller | skipping: [instance] 2026-02-25 13:13:29.900703 | controller | 2026-02-25 13:13:29.900729 | controller | TASK [Download the RPM] ******************************************************** 2026-02-25 13:13:29.946573 | controller | Wednesday 25 February 2026 13:13:29 +0000 (0:00:00.045) 0:06:02.782 **** 2026-02-25 13:13:29.946603 | controller | skipping: [instance] 2026-02-25 13:13:29.991533 | controller | 2026-02-25 13:13:29.991551 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-25 13:13:29.991558 | controller | Wednesday 25 February 2026 13:13:29 +0000 (0:00:00.045) 0:06:02.828 **** 2026-02-25 13:13:29.991567 | controller | skipping: [instance] 2026-02-25 13:13:29.991851 | controller | 2026-02-25 13:13:29.991913 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-25 13:13:29.991926 | controller | Wednesday 25 February 2026 13:13:29 +0000 (0:00:00.045) 0:06:02.873 **** 2026-02-25 13:13:30.035721 | controller | skipping: [instance] 2026-02-25 13:13:30.035779 | controller | 2026-02-25 13:13:30.035790 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-25 13:13:30.035867 | controller | Wednesday 25 February 2026 13:13:30 +0000 (0:00:00.044) 0:06:02.917 **** 2026-02-25 13:13:30.080597 | controller | skipping: [instance] 2026-02-25 13:13:30.080727 | controller | 2026-02-25 13:13:30.080857 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-25 13:13:30.081012 | controller | Wednesday 25 February 2026 13:13:30 +0000 (0:00:00.044) 0:06:02.962 **** 2026-02-25 13:13:30.127057 | controller | skipping: [instance] 2026-02-25 13:13:30.127227 | controller | 2026-02-25 13:13:30.127369 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-25 13:13:30.127502 | controller | Wednesday 25 February 2026 13:13:30 +0000 (0:00:00.046) 0:06:03.009 **** 2026-02-25 13:13:30.629777 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:30.630110 | controller | 2026-02-25 13:13:30.630276 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-25 13:13:30.630412 | controller | Wednesday 25 February 2026 13:13:30 +0000 (0:00:00.498) 0:06:03.507 **** 2026-02-25 13:13:30.688138 | controller | skipping: [instance] 2026-02-25 13:13:30.748310 | controller | 2026-02-25 13:13:30.748333 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-25 13:13:30.748342 | controller | Wednesday 25 February 2026 13:13:30 +0000 (0:00:00.062) 0:06:03.569 **** 2026-02-25 13:13:30.748352 | controller | skipping: [instance] 2026-02-25 13:13:30.796087 | controller | 2026-02-25 13:13:30.796106 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-25 13:13:30.796114 | controller | Wednesday 25 February 2026 13:13:30 +0000 (0:00:00.060) 0:06:03.630 **** 2026-02-25 13:13:30.796123 | controller | skipping: [instance] 2026-02-25 13:13:30.851827 | controller | 2026-02-25 13:13:30.851870 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-25 13:13:30.851879 | controller | Wednesday 25 February 2026 13:13:30 +0000 (0:00:00.047) 0:06:03.677 **** 2026-02-25 13:13:30.851903 | controller | skipping: [instance] 2026-02-25 13:13:30.907011 | controller | 2026-02-25 13:13:30.907035 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-25 13:13:30.907043 | controller | Wednesday 25 February 2026 13:13:30 +0000 (0:00:00.055) 0:06:03.733 **** 2026-02-25 13:13:30.907052 | controller | skipping: [instance] 2026-02-25 13:13:30.965582 | controller | 2026-02-25 13:13:30.965606 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-25 13:13:30.965616 | controller | Wednesday 25 February 2026 13:13:30 +0000 (0:00:00.055) 0:06:03.788 **** 2026-02-25 13:13:30.965627 | controller | skipping: [instance] 2026-02-25 13:13:31.021092 | controller | 2026-02-25 13:13:31.021110 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-25 13:13:31.021118 | controller | Wednesday 25 February 2026 13:13:30 +0000 (0:00:00.058) 0:06:03.847 **** 2026-02-25 13:13:31.021126 | controller | skipping: [instance] 2026-02-25 13:13:31.075753 | controller | 2026-02-25 13:13:31.075790 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-25 13:13:31.075800 | controller | Wednesday 25 February 2026 13:13:31 +0000 (0:00:00.055) 0:06:03.902 **** 2026-02-25 13:13:31.075823 | controller | skipping: [instance] 2026-02-25 13:13:31.075935 | controller | 2026-02-25 13:13:31.076037 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-25 13:13:31.076061 | controller | Wednesday 25 February 2026 13:13:31 +0000 (0:00:00.054) 0:06:03.957 **** 2026-02-25 13:13:31.733855 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:31.733941 | controller | 2026-02-25 13:13:31.733951 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-25 13:13:31.734105 | controller | Wednesday 25 February 2026 13:13:31 +0000 (0:00:00.657) 0:06:04.615 **** 2026-02-25 13:13:32.845313 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 13:13:33.591791 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 13:13:33.591828 | controller | changed: [instance -> controller-0] 2026-02-25 13:13:33.591836 | controller | 2026-02-25 13:13:33.591843 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-25 13:13:33.591849 | controller | Wednesday 25 February 2026 13:13:32 +0000 (0:00:01.108) 0:06:05.723 **** 2026-02-25 13:13:33.591860 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:33.591866 | controller | 2026-02-25 13:13:33.591871 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-25 13:13:33.591879 | controller | Wednesday 25 February 2026 13:13:33 +0000 (0:00:00.749) 0:06:06.473 **** 2026-02-25 13:13:34.153301 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:34.153363 | controller | 2026-02-25 13:13:34.153396 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-25 13:13:34.153485 | controller | Wednesday 25 February 2026 13:13:34 +0000 (0:00:00.561) 0:06:07.034 **** 2026-02-25 13:13:34.229527 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 13:13:34.229591 | controller | ok: [instance -> controller-0] 2026-02-25 13:13:34.229604 | controller | 2026-02-25 13:13:34.229615 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-25 13:13:34.229767 | controller | Wednesday 25 February 2026 13:13:34 +0000 (0:00:00.076) 0:06:07.110 **** 2026-02-25 13:13:34.279876 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:13:34.279969 | controller | 2026-02-25 13:13:34.280106 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-25 13:13:34.280213 | controller | Wednesday 25 February 2026 13:13:34 +0000 (0:00:00.050) 0:06:07.161 **** 2026-02-25 13:14:04.251639 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:04.251697 | controller | 2026-02-25 13:14:04.251822 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-25 13:14:04.251918 | controller | Wednesday 25 February 2026 13:14:04 +0000 (0:00:29.971) 0:06:37.133 **** 2026-02-25 13:14:04.713922 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:04.713964 | controller | 2026-02-25 13:14:04.714166 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-25 13:14:04.714347 | controller | Wednesday 25 February 2026 13:14:04 +0000 (0:00:00.462) 0:06:37.595 **** 2026-02-25 13:14:05.189509 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:05.189569 | controller | 2026-02-25 13:14:05.189685 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-25 13:14:05.189779 | controller | Wednesday 25 February 2026 13:14:05 +0000 (0:00:00.475) 0:06:38.071 **** 2026-02-25 13:14:11.229684 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:11.229754 | controller | 2026-02-25 13:14:11.229862 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-25 13:14:11.229973 | controller | Wednesday 25 February 2026 13:14:11 +0000 (0:00:06.040) 0:06:44.111 **** 2026-02-25 13:14:11.287796 | controller | skipping: [instance] 2026-02-25 13:14:11.287878 | controller | 2026-02-25 13:14:11.287983 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-25 13:14:11.288074 | controller | Wednesday 25 February 2026 13:14:11 +0000 (0:00:00.058) 0:06:44.169 **** 2026-02-25 13:14:11.902575 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:11.902621 | controller | 2026-02-25 13:14:11.902737 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-25 13:14:11.902851 | controller | Wednesday 25 February 2026 13:14:11 +0000 (0:00:00.614) 0:06:44.784 **** 2026-02-25 13:14:12.367769 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:12.367826 | controller | 2026-02-25 13:14:12.367912 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-25 13:14:12.368010 | controller | Wednesday 25 February 2026 13:14:12 +0000 (0:00:00.465) 0:06:45.249 **** 2026-02-25 13:14:12.409560 | controller | skipping: [instance] 2026-02-25 13:14:12.409652 | controller | 2026-02-25 13:14:12.409825 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-25 13:14:12.409967 | controller | Wednesday 25 February 2026 13:14:12 +0000 (0:00:00.041) 0:06:45.291 **** 2026-02-25 13:14:12.453596 | controller | skipping: [instance] 2026-02-25 13:14:12.453692 | controller | 2026-02-25 13:14:12.453802 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-25 13:14:12.453905 | controller | Wednesday 25 February 2026 13:14:12 +0000 (0:00:00.044) 0:06:45.335 **** 2026-02-25 13:14:12.497394 | controller | skipping: [instance] 2026-02-25 13:14:12.497572 | controller | 2026-02-25 13:14:12.497805 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-25 13:14:12.497823 | controller | Wednesday 25 February 2026 13:14:12 +0000 (0:00:00.043) 0:06:45.379 **** 2026-02-25 13:14:12.539605 | controller | skipping: [instance] 2026-02-25 13:14:12.539756 | controller | 2026-02-25 13:14:12.539854 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-25 13:14:12.539957 | controller | Wednesday 25 February 2026 13:14:12 +0000 (0:00:00.041) 0:06:45.421 **** 2026-02-25 13:14:12.580311 | controller | skipping: [instance] 2026-02-25 13:14:12.580417 | controller | 2026-02-25 13:14:12.580632 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-25 13:14:12.580718 | controller | Wednesday 25 February 2026 13:14:12 +0000 (0:00:00.040) 0:06:45.462 **** 2026-02-25 13:14:12.618792 | controller | skipping: [instance] 2026-02-25 13:14:12.618906 | controller | 2026-02-25 13:14:12.619038 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-25 13:14:12.619222 | controller | Wednesday 25 February 2026 13:14:12 +0000 (0:00:00.038) 0:06:45.500 **** 2026-02-25 13:14:15.157567 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 13:14:15.157637 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 13:14:15.157764 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 13:14:15.157850 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 13:14:15.157987 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 13:14:15.158064 | controller | changed: [instance -> controller-0] 2026-02-25 13:14:15.158158 | controller | 2026-02-25 13:14:15.158258 | controller | TASK [Prepare install_yamls make targets] ************************************** 2026-02-25 13:14:15.158346 | controller | Wednesday 25 February 2026 13:14:15 +0000 (0:00:02.538) 0:06:48.039 **** 2026-02-25 13:14:15.321638 | controller | 2026-02-25 13:14:15.321778 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2026-02-25 13:14:15.321939 | controller | Wednesday 25 February 2026 13:14:15 +0000 (0:00:00.164) 0:06:48.203 **** 2026-02-25 13:14:16.793005 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 13:14:16.793053 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 13:14:16.793182 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 13:14:16.793277 | controller | changed: [instance -> controller-0] 2026-02-25 13:14:16.793364 | controller | 2026-02-25 13:14:16.793638 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2026-02-25 13:14:16.793775 | controller | Wednesday 25 February 2026 13:14:16 +0000 (0:00:01.471) 0:06:49.674 **** 2026-02-25 13:14:16.859279 | controller | 2026-02-25 13:14:16.859391 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2026-02-25 13:14:16.859506 | controller | Wednesday 25 February 2026 13:14:16 +0000 (0:00:00.066) 0:06:49.741 **** 2026-02-25 13:14:16.900981 | controller | skipping: [instance] 2026-02-25 13:14:16.901040 | controller | 2026-02-25 13:14:16.901153 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2026-02-25 13:14:16.901243 | controller | Wednesday 25 February 2026 13:14:16 +0000 (0:00:00.041) 0:06:49.783 **** 2026-02-25 13:14:16.951048 | controller | skipping: [instance] 2026-02-25 13:14:16.951173 | controller | 2026-02-25 13:14:16.951268 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2026-02-25 13:14:16.951371 | controller | Wednesday 25 February 2026 13:14:16 +0000 (0:00:00.049) 0:06:49.833 **** 2026-02-25 13:14:17.017014 | controller | 2026-02-25 13:14:17.017095 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-25 13:14:17.017195 | controller | Wednesday 25 February 2026 13:14:17 +0000 (0:00:00.066) 0:06:49.899 **** 2026-02-25 13:14:17.058937 | controller | skipping: [instance] 2026-02-25 13:14:17.059041 | controller | 2026-02-25 13:14:17.059137 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-25 13:14:17.059243 | controller | Wednesday 25 February 2026 13:14:17 +0000 (0:00:00.041) 0:06:49.941 **** 2026-02-25 13:14:17.103517 | controller | skipping: [instance] 2026-02-25 13:14:17.103585 | controller | 2026-02-25 13:14:17.103678 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-25 13:14:17.103789 | controller | Wednesday 25 February 2026 13:14:17 +0000 (0:00:00.044) 0:06:49.985 **** 2026-02-25 13:14:17.146219 | controller | skipping: [instance] 2026-02-25 13:14:17.146285 | controller | 2026-02-25 13:14:17.146377 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2026-02-25 13:14:17.146468 | controller | Wednesday 25 February 2026 13:14:17 +0000 (0:00:00.042) 0:06:50.028 **** 2026-02-25 13:14:17.194790 | controller | skipping: [instance] 2026-02-25 13:14:17.194852 | controller | 2026-02-25 13:14:17.194963 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2026-02-25 13:14:17.195054 | controller | Wednesday 25 February 2026 13:14:17 +0000 (0:00:00.048) 0:06:50.076 **** 2026-02-25 13:14:17.296343 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2026-02-25 13:14:17.296489 | controller | ok: [instance -> controller-0] 2026-02-25 13:14:17.296607 | controller | 2026-02-25 13:14:17.296762 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2026-02-25 13:14:17.296883 | controller | Wednesday 25 February 2026 13:14:17 +0000 (0:00:00.101) 0:06:50.178 **** 2026-02-25 13:14:17.362968 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:17.363041 | controller | 2026-02-25 13:14:17.363161 | controller | TASK [install_yamls : Get environment structure] ******************************* 2026-02-25 13:14:17.363261 | controller | Wednesday 25 February 2026 13:14:17 +0000 (0:00:00.066) 0:06:50.244 **** 2026-02-25 13:14:18.297643 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:18.297767 | controller | 2026-02-25 13:14:18.297986 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2026-02-25 13:14:18.339339 | controller | Wednesday 25 February 2026 13:14:18 +0000 (0:00:00.934) 0:06:51.179 **** 2026-02-25 13:14:18.339398 | controller | skipping: [instance] 2026-02-25 13:14:18.339427 | controller | 2026-02-25 13:14:18.339459 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2026-02-25 13:14:18.339495 | controller | Wednesday 25 February 2026 13:14:18 +0000 (0:00:00.041) 0:06:51.221 **** 2026-02-25 13:14:18.391883 | controller | skipping: [instance] 2026-02-25 13:14:18.392003 | controller | 2026-02-25 13:14:18.392020 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2026-02-25 13:14:18.392171 | controller | Wednesday 25 February 2026 13:14:18 +0000 (0:00:00.052) 0:06:51.273 **** 2026-02-25 13:14:18.432144 | controller | skipping: [instance] 2026-02-25 13:14:18.432234 | controller | 2026-02-25 13:14:18.432314 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2026-02-25 13:14:18.432410 | controller | Wednesday 25 February 2026 13:14:18 +0000 (0:00:00.040) 0:06:51.314 **** 2026-02-25 13:14:18.489297 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:18.489366 | controller | 2026-02-25 13:14:18.489465 | controller | TASK [install_yamls : Show the env structure] ********************************** 2026-02-25 13:14:18.489558 | controller | Wednesday 25 February 2026 13:14:18 +0000 (0:00:00.056) 0:06:51.371 **** 2026-02-25 13:14:18.536641 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:18.536778 | controller | 2026-02-25 13:14:18.536914 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2026-02-25 13:14:18.537043 | controller | Wednesday 25 February 2026 13:14:18 +0000 (0:00:00.047) 0:06:51.418 **** 2026-02-25 13:14:18.593575 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:18.593643 | controller | 2026-02-25 13:14:18.593759 | controller | TASK [install_yamls : Generate make targets] *********************************** 2026-02-25 13:14:18.593856 | controller | Wednesday 25 February 2026 13:14:18 +0000 (0:00:00.056) 0:06:51.475 **** 2026-02-25 13:14:19.242532 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:19.242574 | controller | 2026-02-25 13:14:19.242709 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2026-02-25 13:14:19.242821 | controller | Wednesday 25 February 2026 13:14:19 +0000 (0:00:00.648) 0:06:52.124 **** 2026-02-25 13:14:19.288245 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:19.288351 | controller | 2026-02-25 13:14:19.288484 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2026-02-25 13:14:19.288608 | controller | Wednesday 25 February 2026 13:14:19 +0000 (0:00:00.045) 0:06:52.170 **** 2026-02-25 13:14:20.199609 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:20.199660 | controller | 2026-02-25 13:14:20.199787 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2026-02-25 13:14:20.199875 | controller | Wednesday 25 February 2026 13:14:20 +0000 (0:00:00.911) 0:06:53.081 **** 2026-02-25 13:14:20.245549 | controller | skipping: [instance] 2026-02-25 13:14:20.245651 | controller | 2026-02-25 13:14:20.245808 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-25 13:14:20.245942 | controller | Wednesday 25 February 2026 13:14:20 +0000 (0:00:00.046) 0:06:53.127 **** 2026-02-25 13:14:20.963126 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:20.963183 | controller | 2026-02-25 13:14:20.963264 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-25 13:14:20.963519 | controller | Wednesday 25 February 2026 13:14:20 +0000 (0:00:00.716) 0:06:53.844 **** 2026-02-25 13:14:21.030798 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:21.030833 | controller | 2026-02-25 13:14:21.030843 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2026-02-25 13:14:21.030854 | controller | Wednesday 25 February 2026 13:14:21 +0000 (0:00:00.067) 0:06:53.912 **** 2026-02-25 13:14:22.131411 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:22.131472 | controller | 2026-02-25 13:14:22.131547 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2026-02-25 13:14:22.131626 | controller | Wednesday 25 February 2026 13:14:22 +0000 (0:00:01.100) 0:06:55.013 **** 2026-02-25 13:14:22.672236 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-25 13:14:22.672303 | controller | 2026-02-25 13:14:22.672380 | controller | TASK [Configure CRC network if needed] ***************************************** 2026-02-25 13:14:22.672483 | controller | Wednesday 25 February 2026 13:14:22 +0000 (0:00:00.540) 0:06:55.553 **** 2026-02-25 13:14:22.910453 | controller | 2026-02-25 13:14:22.910500 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2026-02-25 13:14:22.910616 | controller | Wednesday 25 February 2026 13:14:22 +0000 (0:00:00.238) 0:06:55.791 **** 2026-02-25 13:14:24.064210 | controller | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-25 13:14:24.066110 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false 2026-02-25 13:14:24.066209 | controller | module_stderr: |- 2026-02-25 13:14:24.066303 | controller | Shared connection to controller-0.utility closed. 2026-02-25 13:14:24.066397 | controller | module_stdout: |- 2026-02-25 13:14:24.066563 | controller | Traceback (most recent call last): 2026-02-25 13:14:24.066676 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 700, in urlopen 2026-02-25 13:14:24.066690 | controller | httplib_response = self._make_request( 2026-02-25 13:14:24.066844 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 383, in _make_request 2026-02-25 13:14:24.066971 | controller | self._validate_conn(conn) 2026-02-25 13:14:24.067035 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1015, in _validate_conn 2026-02-25 13:14:24.067049 | controller | conn.connect() 2026-02-25 13:14:24.067141 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connection.py", line 411, in connect 2026-02-25 13:14:24.067218 | controller | self.sock = ssl_wrap_socket( 2026-02-25 13:14:24.067297 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 449, in ssl_wrap_socket 2026-02-25 13:14:24.067392 | controller | ssl_sock = _ssl_wrap_socket_impl( 2026-02-25 13:14:24.067478 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/ssl_.py", line 493, in _ssl_wrap_socket_impl 2026-02-25 13:14:24.067565 | controller | return ssl_context.wrap_socket(sock, server_hostname=server_hostname) 2026-02-25 13:14:24.067652 | controller | File "/usr/lib64/python3.9/ssl.py", line 501, in wrap_socket 2026-02-25 13:14:24.067754 | controller | return self.sslsocket_class._create( 2026-02-25 13:14:24.067847 | controller | File "/usr/lib64/python3.9/ssl.py", line 1076, in _create 2026-02-25 13:14:24.067965 | controller | self.do_handshake() 2026-02-25 13:14:24.068052 | controller | File "/usr/lib64/python3.9/ssl.py", line 1345, in do_handshake 2026-02-25 13:14:24.068121 | controller | self._sslobj.do_handshake() 2026-02-25 13:14:24.068222 | controller | ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147) 2026-02-25 13:14:24.068303 | controller | 2026-02-25 13:14:24.068398 | controller | During handling of the above exception, another exception occurred: 2026-02-25 13:14:24.068483 | controller | 2026-02-25 13:14:24.068595 | controller | Traceback (most recent call last): 2026-02-25 13:14:24.068715 | controller | File "/tmp/ansible-tmp-1772025262.9494963-28588-265507149613909/AnsiballZ_k8s_info.py", line 107, in 2026-02-25 13:14:24.068806 | controller | _ansiballz_main() 2026-02-25 13:14:24.068905 | controller | File "/tmp/ansible-tmp-1772025262.9494963-28588-265507149613909/AnsiballZ_k8s_info.py", line 99, in _ansiballz_main 2026-02-25 13:14:24.069008 | controller | invoke_module(zipped_mod, temp_path, ANSIBALLZ_PARAMS) 2026-02-25 13:14:24.069026 | controller | File "/tmp/ansible-tmp-1772025262.9494963-28588-265507149613909/AnsiballZ_k8s_info.py", line 47, in invoke_module 2026-02-25 13:14:24.069114 | controller | runpy.run_module(mod_name='ansible_collections.kubernetes.core.plugins.modules.k8s_info', init_globals=dict(_module_fqn='ansible_collections.kubernetes.core.plugins.modules.k8s_info', _modlib_path=modlib_path), 2026-02-25 13:14:24.069199 | controller | File "/usr/lib64/python3.9/runpy.py", line 225, in run_module 2026-02-25 13:14:24.069282 | controller | return _run_module_code(code, init_globals, run_name, mod_spec) 2026-02-25 13:14:24.069362 | controller | File "/usr/lib64/python3.9/runpy.py", line 97, in _run_module_code 2026-02-25 13:14:24.069442 | controller | _run_code(code, mod_globals, init_globals, 2026-02-25 13:14:24.069526 | controller | File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-25 13:14:24.069608 | controller | exec(code, run_globals) 2026-02-25 13:14:24.069704 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload__x92rebb/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 229, in 2026-02-25 13:14:24.069802 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload__x92rebb/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/modules/k8s_info.py", line 221, in main 2026-02-25 13:14:24.069904 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload__x92rebb/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 352, in get_api_client 2026-02-25 13:14:24.069987 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload__x92rebb/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 246, in wrapper 2026-02-25 13:14:24.070058 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload__x92rebb/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/k8s/client.py", line 259, in create_api_client 2026-02-25 13:14:24.070228 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 84, in __init__ 2026-02-25 13:14:24.070399 | controller | self.__discoverer = discoverer(self, cache_file) 2026-02-25 13:14:24.070407 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload__x92rebb/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 190, in __init__ 2026-02-25 13:14:24.070530 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload__x92rebb/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 45, in __init__ 2026-02-25 13:14:24.070538 | controller | File "/tmp/ansible_kubernetes.core.k8s_info_payload__x92rebb/ansible_kubernetes.core.k8s_info_payload.zip/ansible_collections/kubernetes/core/plugins/module_utils/client/discovery.py", line 92, in __init_cache 2026-02-25 13:14:24.070643 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/discovery.py", line 146, in _load_server_info 2026-02-25 13:14:24.070650 | controller | 'kubernetes': self.client.request('get', '/version', serializer=just_json) 2026-02-25 13:14:24.070753 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 55, in inner 2026-02-25 13:14:24.070803 | controller | resp = func(self, *args, **kwargs) 2026-02-25 13:14:24.070876 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/dynamic/client.py", line 277, in request 2026-02-25 13:14:24.070965 | controller | api_response = self.client.call_api( 2026-02-25 13:14:24.071038 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 348, in call_api 2026-02-25 13:14:24.071116 | controller | return self.__call_api(resource_path, method, 2026-02-25 13:14:24.071208 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 180, in __call_api 2026-02-25 13:14:24.071287 | controller | response_data = self.request( 2026-02-25 13:14:24.071372 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/api_client.py", line 373, in request 2026-02-25 13:14:24.071447 | controller | return self.rest_client.GET(url, 2026-02-25 13:14:24.071529 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 244, in GET 2026-02-25 13:14:24.071607 | controller | return self.request("GET", url, 2026-02-25 13:14:24.071698 | controller | File "/home/zuul/.local/lib/python3.9/site-packages/kubernetes/client/rest.py", line 217, in request 2026-02-25 13:14:24.071982 | controller | r = self.pool_manager.request(method, url, 2026-02-25 13:14:24.072046 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 74, in request 2026-02-25 13:14:24.072203 | controller | return self.request_encode_url( 2026-02-25 13:14:24.072249 | controller | File "/usr/lib/python3.9/site-packages/urllib3/request.py", line 96, in request_encode_url 2026-02-25 13:14:24.072330 | controller | return self.urlopen(method, url, **extra_kw) 2026-02-25 13:14:24.072388 | controller | File "/usr/lib/python3.9/site-packages/urllib3/poolmanager.py", line 376, in urlopen 2026-02-25 13:14:24.072461 | controller | response = conn.urlopen(method, u.request_uri, **kw) 2026-02-25 13:14:24.072540 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-25 13:14:24.072619 | controller | return self.urlopen( 2026-02-25 13:14:24.072713 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-25 13:14:24.072793 | controller | return self.urlopen( 2026-02-25 13:14:24.072873 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 784, in urlopen 2026-02-25 13:14:24.073174 | controller | return self.urlopen( 2026-02-25 13:14:24.073192 | controller | File "/usr/lib/python3.9/site-packages/urllib3/connectionpool.py", line 756, in urlopen 2026-02-25 13:14:24.073281 | controller | retries = retries.increment( 2026-02-25 13:14:24.073361 | controller | File "/usr/lib/python3.9/site-packages/urllib3/util/retry.py", line 576, in increment 2026-02-25 13:14:24.073512 | controller | raise MaxRetryError(_pool, url, error or ResponseError(cause)) 2026-02-25 13:14:24.073603 | controller | urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.crc.testing', port=6443): Max retries exceeded with url: /version (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1147)'))) 2026-02-25 13:14:24.073690 | controller | msg: |- 2026-02-25 13:14:24.073787 | controller | MODULE FAILURE 2026-02-25 13:14:24.073868 | controller | See stdout/stderr for the exact error 2026-02-25 13:14:24.073958 | controller | rc: 1 2026-02-25 13:14:24.076183 | controller | 2026-02-25 13:14:24.076266 | controller | TASK [Create dnsmasq dir] ****************************************************** 2026-02-25 13:14:24.076351 | controller | Wednesday 25 February 2026 13:14:24 +0000 (0:00:01.166) 0:06:56.958 **** 2026-02-25 13:14:24.317962 | controller | changed: [instance] 2026-02-25 13:14:24.318002 | controller | 2026-02-25 13:14:24.318104 | controller | TASK [Get journalctl in a file] ************************************************ 2026-02-25 13:14:24.318197 | controller | Wednesday 25 February 2026 13:14:24 +0000 (0:00:00.241) 0:06:57.199 **** 2026-02-25 13:14:24.551264 | controller | changed: [instance] 2026-02-25 13:14:24.551331 | controller | 2026-02-25 13:14:24.551418 | controller | TASK [Dump journalctl output] ************************************************** 2026-02-25 13:14:24.551506 | controller | Wednesday 25 February 2026 13:14:24 +0000 (0:00:00.233) 0:06:57.433 **** 2026-02-25 13:14:24.977385 | controller | changed: [instance] 2026-02-25 13:14:24.977430 | controller | 2026-02-25 13:14:24.977514 | controller | TASK [Copy all dnsmasq config] ************************************************* 2026-02-25 13:14:24.977599 | controller | Wednesday 25 February 2026 13:14:24 +0000 (0:00:00.426) 0:06:57.859 **** 2026-02-25 13:14:25.527920 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-25 13:14:25.527977 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2026-02-25 13:14:25.528288 | controller | 2026-02-25 13:14:25.736866 | controller | TASK [Create log directory] **************************************************** 2026-02-25 13:14:25.736905 | controller | Wednesday 25 February 2026 13:14:25 +0000 (0:00:00.550) 0:06:58.409 **** 2026-02-25 13:14:25.736919 | controller | changed: [instance] 2026-02-25 13:14:26.685861 | controller | 2026-02-25 13:14:26.685917 | controller | TASK [Sync logs from controller-0] ********************************************* 2026-02-25 13:14:26.685926 | controller | Wednesday 25 February 2026 13:14:25 +0000 (0:00:00.208) 0:06:58.618 **** 2026-02-25 13:14:26.685939 | controller | changed: [instance] 2026-02-25 13:14:26.686010 | controller | 2026-02-25 13:14:26.686018 | controller | PLAY RECAP ********************************************************************* 2026-02-25 13:14:26.686024 | controller | instance : ok=541 changed=208 unreachable=0 failed=1 skipped=229 rescued=0 ignored=0 2026-02-25 13:14:26.686029 | controller | 2026-02-25 13:14:26.686034 | controller | Wednesday 25 February 2026 13:14:26 +0000 (0:00:00.946) 0:06:59.564 **** 2026-02-25 13:14:26.686039 | controller | =============================================================================== 2026-02-25 13:14:26.686044 | controller | reproducer : Check package install status ------------------------------ 39.93s 2026-02-25 13:14:26.686049 | controller | ci_setup : Install needed packages ------------------------------------- 29.97s 2026-02-25 13:14:26.686054 | controller | libvirt_manager : Download base image ---------------------------------- 29.64s 2026-02-25 13:14:26.686059 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 22.97s 2026-02-25 13:14:26.686064 | controller | reproducer : Install collections on controller-0 ----------------------- 20.02s 2026-02-25 13:14:26.686072 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 11.59s 2026-02-25 13:14:26.686092 | controller | libvirt_manager : Install packages required for using KVM --------------- 8.34s 2026-02-25 13:14:26.686213 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.86s 2026-02-25 13:14:26.686335 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 7.45s 2026-02-25 13:14:26.686376 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.09s 2026-02-25 13:14:26.686510 | controller | ci_setup : Install openshift client ------------------------------------- 6.04s 2026-02-25 13:14:26.686656 | controller | ci_nmstate : Install required packages on localhost --------------------- 4.72s 2026-02-25 13:14:26.686690 | controller | networking_mapper : Gather the facts ------------------------------------ 3.88s 2026-02-25 13:14:26.687028 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.63s 2026-02-25 13:14:26.687139 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.13s 2026-02-25 13:14:26.687153 | controller | sushy_emulator : Install required packages ------------------------------ 2.57s 2026-02-25 13:14:26.687159 | controller | ci_setup : Manage directories ------------------------------------------- 2.54s 2026-02-25 13:14:26.687167 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.34s 2026-02-25 13:14:26.687254 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.14s 2026-02-25 13:14:26.687268 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s 2026-02-25 13:14:26.815339 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml'] 2026-02-25 13:14:26.815741 | controller | WARNING An error occurred during the test sequence action: 'converge'. Cleaning up. 2026-02-25 13:14:26.824107 | controller | INFO Running crc_layout > cleanup 2026-02-25 13:14:26.824503 | controller | WARNING Skipping, cleanup playbook not configured. 2026-02-25 13:14:26.832770 | controller | INFO Running crc_layout > destroy 2026-02-25 13:14:26.833036 | controller | WARNING Skipping, instances are delegated. 2026-02-25 13:14:26.833323 | controller | INFO Pruning extra files from scenario ephemeral directory 2026-02-25 13:14:26.834749 | controller | INFO Writing /tmp/report.html report. 2026-02-25 13:14:27.192598 | [controller] Waiting on logger 2026-02-25 13:14:32.380112 | [controller] Waiting on logger 2026-02-25 13:14:42.812036 | [controller] Waiting on logger 2026-02-25 13:14:52.192596 | [controller] Waiting on logger 2026-02-25 13:14:56.946162 | [Zuul] Log Stream did not terminate 2026-02-25 13:14:56.946491 | controller | ERROR 2026-02-25 13:14:56.946602 | controller | { 2026-02-25 13:14:56.946654 | controller | "delta": "0:08:35.046779", 2026-02-25 13:14:56.946682 | controller | "end": "2026-02-25 13:14:26.901461", 2026-02-25 13:14:56.946704 | controller | "msg": "non-zero return code", 2026-02-25 13:14:56.946726 | controller | "rc": 1, 2026-02-25 13:14:56.946747 | controller | "start": "2026-02-25 13:05:51.854682" 2026-02-25 13:14:56.946766 | controller | } failure 2026-02-25 13:14:56.997618 | 2026-02-25 13:14:56.997722 | PLAY RECAP 2026-02-25 13:14:56.997768 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0 2026-02-25 13:14:56.997790 | 2026-02-25 13:14:57.056864 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-25 13:14:57.057577 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-25 13:14:57.563548 | 2026-02-25 13:14:57.563684 | PLAY [Run ci/playbooks/collect-logs.yml] 2026-02-25 13:14:57.582551 | 2026-02-25 13:14:57.582619 | TASK [Filter out host if needed] 2026-02-25 13:14:57.590738 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2026-02-25 13:14:57.594998 | 2026-02-25 13:14:57.595066 | TASK [Ensure file is present] 2026-02-25 13:14:58.011494 | controller | ok 2026-02-25 13:14:58.016892 | 2026-02-25 13:14:58.016959 | TASK [Manage molecule report file] 2026-02-25 13:14:58.040790 | [controller] Waiting on logger 2026-02-25 13:15:07.388089 | [controller] Waiting on logger 2026-02-25 13:15:17.819936 | [controller] Waiting on logger 2026-02-25 13:15:27.200883 | [controller] Waiting on logger 2026-02-25 13:15:28.441400 | [Zuul] Log Stream did not terminate 2026-02-25 13:15:28.441607 | controller | changed 2026-02-25 13:15:28.446809 | 2026-02-25 13:15:28.446876 | TASK [Check if we get ci-framework-data basedir] 2026-02-25 13:15:28.738705 | controller | ok 2026-02-25 13:15:28.743379 | 2026-02-25 13:15:28.743446 | TASK [Create ci-framework-data log directory for zuul] 2026-02-25 13:15:29.116649 | controller | changed 2026-02-25 13:15:29.121702 | 2026-02-25 13:15:29.121766 | TASK [Copy ci-framework interesting files] 2026-02-25 13:15:32.219952 | [controller] Waiting on logger 2026-02-25 13:15:42.652033 | [controller] Waiting on logger 2026-02-25 13:15:53.083775 | [controller] Waiting on logger 2026-02-25 13:15:59.473201 | [Zuul] Log Stream did not terminate 2026-02-25 13:15:59.473461 | controller | changed 2026-02-25 13:15:59.478377 | 2026-02-25 13:15:59.478440 | TASK [Get SELinux listing] 2026-02-25 13:15:59.499377 | [controller] Waiting on logger 2026-02-25 13:16:09.916074 | [controller] Waiting on logger 2026-02-25 13:16:19.296520 | [controller] Waiting on logger 2026-02-25 13:16:29.691802 | [controller] Waiting on logger 2026-02-25 13:16:29.788551 | [Zuul] Log Stream did not terminate 2026-02-25 13:16:29.788871 | controller | changed 2026-02-25 13:16:29.795458 | 2026-02-25 13:16:29.795526 | TASK [Generate log index] 2026-02-25 13:16:30.988751 | controller | changed 2026-02-25 13:16:30.993607 | 2026-02-25 13:16:30.993680 | TASK [Get some env related data] 2026-02-25 13:16:36.019909 | controller | changed 2026-02-25 13:16:36.025275 | 2026-02-25 13:16:36.025362 | TASK [Generate list of logs to collect in home directory] 2026-02-25 13:16:36.385769 | controller | ok: All paths examined 2026-02-25 13:16:36.391043 | 2026-02-25 13:16:36.391102 | LOOP [Copy logs from home directory] 2026-02-25 13:16:37.009555 | controller | changed: 2026-02-25 13:16:37.009784 | controller | { 2026-02-25 13:16:37.009814 | controller | "atime": 1743544925.4788878, 2026-02-25 13:16:37.009834 | controller | "ctime": 1743545329.1409318, 2026-02-25 13:16:37.009849 | controller | "dev": 64513, 2026-02-25 13:16:37.009865 | controller | "gid": 1000, 2026-02-25 13:16:37.009880 | controller | "gr_name": "zuul", 2026-02-25 13:16:37.009894 | controller | "inode": 4518807, 2026-02-25 13:16:37.009907 | controller | "isblk": false, 2026-02-25 13:16:37.009922 | controller | "ischr": false, 2026-02-25 13:16:37.009936 | controller | "isdir": false, 2026-02-25 13:16:37.009949 | controller | "isfifo": false, 2026-02-25 13:16:37.009963 | controller | "isgid": false, 2026-02-25 13:16:37.009977 | controller | "islnk": false, 2026-02-25 13:16:37.009992 | controller | "isreg": true, 2026-02-25 13:16:37.010005 | controller | "issock": false, 2026-02-25 13:16:37.010020 | controller | "isuid": false, 2026-02-25 13:16:37.010036 | controller | "mode": "0644", 2026-02-25 13:16:37.010050 | controller | "mtime": 1743545329.1409318, 2026-02-25 13:16:37.010063 | controller | "nlink": 1, 2026-02-25 13:16:37.010077 | controller | "path": "/home/zuul/crc-setup.log", 2026-02-25 13:16:37.010089 | controller | "pw_name": "zuul", 2026-02-25 13:16:37.010102 | controller | "rgrp": true, 2026-02-25 13:16:37.010115 | controller | "roth": true, 2026-02-25 13:16:37.010128 | controller | "rusr": true, 2026-02-25 13:16:37.010141 | controller | "size": 4108, 2026-02-25 13:16:37.010154 | controller | "uid": 1000, 2026-02-25 13:16:37.010168 | controller | "wgrp": false, 2026-02-25 13:16:37.010183 | controller | "woth": false, 2026-02-25 13:16:37.010196 | controller | "wusr": true, 2026-02-25 13:16:37.010209 | controller | "xgrp": false, 2026-02-25 13:16:37.010222 | controller | "xoth": false, 2026-02-25 13:16:37.010235 | controller | "xusr": false 2026-02-25 13:16:37.010249 | controller | } 2026-02-25 13:16:37.642334 | controller | changed: 2026-02-25 13:16:37.642589 | controller | { 2026-02-25 13:16:37.642641 | controller | "atime": 1743545331.0429637, 2026-02-25 13:16:37.642665 | controller | "ctime": 1743545842.0111232, 2026-02-25 13:16:37.642684 | controller | "dev": 64513, 2026-02-25 13:16:37.642702 | controller | "gid": 1000, 2026-02-25 13:16:37.642719 | controller | "gr_name": "zuul", 2026-02-25 13:16:37.642734 | controller | "inode": 4194437, 2026-02-25 13:16:37.642749 | controller | "isblk": false, 2026-02-25 13:16:37.642763 | controller | "ischr": false, 2026-02-25 13:16:37.642783 | controller | "isdir": false, 2026-02-25 13:16:37.642798 | controller | "isfifo": false, 2026-02-25 13:16:37.642811 | controller | "isgid": false, 2026-02-25 13:16:37.642823 | controller | "islnk": false, 2026-02-25 13:16:37.642837 | controller | "isreg": true, 2026-02-25 13:16:37.642851 | controller | "issock": false, 2026-02-25 13:16:37.642865 | controller | "isuid": false, 2026-02-25 13:16:37.642879 | controller | "mode": "0644", 2026-02-25 13:16:37.642892 | controller | "mtime": 1743545842.0111232, 2026-02-25 13:16:37.642906 | controller | "nlink": 1, 2026-02-25 13:16:37.642920 | controller | "path": "/home/zuul/crc-start.log", 2026-02-25 13:16:37.642933 | controller | "pw_name": "zuul", 2026-02-25 13:16:37.642946 | controller | "rgrp": true, 2026-02-25 13:16:37.642959 | controller | "roth": true, 2026-02-25 13:16:37.642971 | controller | "rusr": true, 2026-02-25 13:16:37.642983 | controller | "size": 4023, 2026-02-25 13:16:37.642996 | controller | "uid": 1000, 2026-02-25 13:16:37.643008 | controller | "wgrp": false, 2026-02-25 13:16:37.643020 | controller | "woth": false, 2026-02-25 13:16:37.643032 | controller | "wusr": true, 2026-02-25 13:16:37.643044 | controller | "xgrp": false, 2026-02-25 13:16:37.643056 | controller | "xoth": false, 2026-02-25 13:16:37.643068 | controller | "xusr": false 2026-02-25 13:16:37.643080 | controller | } 2026-02-25 13:16:38.206446 | controller | changed: 2026-02-25 13:16:38.206538 | controller | { 2026-02-25 13:16:38.206564 | controller | "atime": 1772024733.8263218, 2026-02-25 13:16:38.206584 | controller | "ctime": 1772024749.546414, 2026-02-25 13:16:38.206601 | controller | "dev": 64513, 2026-02-25 13:16:38.206618 | controller | "gid": 1000, 2026-02-25 13:16:38.206655 | controller | "gr_name": "zuul", 2026-02-25 13:16:38.206671 | controller | "inode": 4686299, 2026-02-25 13:16:38.206685 | controller | "isblk": false, 2026-02-25 13:16:38.206700 | controller | "ischr": false, 2026-02-25 13:16:38.206714 | controller | "isdir": false, 2026-02-25 13:16:38.206728 | controller | "isfifo": false, 2026-02-25 13:16:38.206744 | controller | "isgid": false, 2026-02-25 13:16:38.206758 | controller | "islnk": false, 2026-02-25 13:16:38.206771 | controller | "isreg": true, 2026-02-25 13:16:38.206784 | controller | "issock": false, 2026-02-25 13:16:38.206797 | controller | "isuid": false, 2026-02-25 13:16:38.206810 | controller | "mode": "0644", 2026-02-25 13:16:38.206823 | controller | "mtime": 1772024749.546414, 2026-02-25 13:16:38.206836 | controller | "nlink": 1, 2026-02-25 13:16:38.206849 | controller | "path": "/home/zuul/ansible.log", 2026-02-25 13:16:38.206864 | controller | "pw_name": "zuul", 2026-02-25 13:16:38.206878 | controller | "rgrp": true, 2026-02-25 13:16:38.206892 | controller | "roth": true, 2026-02-25 13:16:38.206905 | controller | "rusr": true, 2026-02-25 13:16:38.206918 | controller | "size": 6749, 2026-02-25 13:16:38.206931 | controller | "uid": 1000, 2026-02-25 13:16:38.206945 | controller | "wgrp": false, 2026-02-25 13:16:38.206959 | controller | "woth": false, 2026-02-25 13:16:38.206973 | controller | "wusr": true, 2026-02-25 13:16:38.206986 | controller | "xgrp": false, 2026-02-25 13:16:38.207000 | controller | "xoth": false, 2026-02-25 13:16:38.207013 | controller | "xusr": false 2026-02-25 13:16:38.207026 | controller | } 2026-02-25 13:16:38.217194 | 2026-02-25 13:16:38.217315 | TASK [Copy crio stats log file] 2026-02-25 13:16:38.230816 | controller | skipping: Conditional result was False 2026-02-25 13:16:38.235866 | 2026-02-25 13:16:38.235931 | TASK [Get SELinux related data] 2026-02-25 13:16:38.256449 | [controller] Waiting on logger 2026-02-25 13:16:48.699932 | [controller] Waiting on logger 2026-02-25 13:16:59.131737 | [controller] Waiting on logger 2026-02-25 13:17:08.475791 | [controller] Waiting on logger 2026-02-25 13:17:08.546924 | [Zuul] Log Stream did not terminate 2026-02-25 13:17:08.547203 | controller | ERROR 2026-02-25 13:17:08.547383 | controller | { 2026-02-25 13:17:08.547443 | controller | "delta": "0:00:00.010176", 2026-02-25 13:17:08.547478 | controller | "end": "2026-02-25 13:16:38.513662", 2026-02-25 13:17:08.547507 | controller | "msg": "non-zero return code", 2026-02-25 13:17:08.547533 | controller | "rc": 1, 2026-02-25 13:17:08.547558 | controller | "start": "2026-02-25 13:16:38.503486" 2026-02-25 13:17:08.547582 | controller | } 2026-02-25 13:17:08.547632 | controller | ERROR: Ignoring Errors 2026-02-25 13:17:08.552333 | 2026-02-25 13:17:08.552394 | TASK [Create system configuration directory] 2026-02-25 13:17:08.834388 | controller | changed 2026-02-25 13:17:08.838979 | 2026-02-25 13:17:08.839041 | TASK [Get some of the system configurations] 2026-02-25 13:17:11.932439 | [controller] Waiting on logger 2026-02-25 13:17:22.363770 | [controller] Waiting on logger 2026-02-25 13:17:32.795906 | [controller] Waiting on logger 2026-02-25 13:17:39.179648 | [Zuul] Log Stream did not terminate 2026-02-25 13:17:39.179841 | controller | changed 2026-02-25 13:17:39.184519 | 2026-02-25 13:17:39.184577 | TASK [Copy generated documentation if available] 2026-02-25 13:17:39.198177 | controller | skipping: Conditional result was False 2026-02-25 13:17:39.203714 | 2026-02-25 13:17:39.203777 | TASK [Copy generated AsciiDoc documentation if available] 2026-02-25 13:17:39.216803 | controller | skipping: Conditional result was False 2026-02-25 13:17:39.221934 | 2026-02-25 13:17:39.221996 | TASK [Compress logs bigger than 2MB] 2026-02-25 13:17:39.245053 | [controller] Waiting on logger 2026-02-25 13:17:49.627763 | [controller] Waiting on logger 2026-02-25 13:18:00.059810 | [controller] Waiting on logger 2026-02-25 13:18:09.403891 | [controller] Waiting on logger 2026-02-25 13:18:09.513490 | [Zuul] Log Stream did not terminate 2026-02-25 13:18:09.513682 | controller | changed 2026-02-25 13:18:09.518413 | 2026-02-25 13:18:09.518472 | TASK [Copy files from workspace on node] 2026-02-25 13:18:09.536004 | controller | ok 2026-02-25 13:18:09.557175 | 2026-02-25 13:18:09.557241 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-25 13:18:09.570525 | controller | skipping: Conditional result was False 2026-02-25 13:18:09.576133 | 2026-02-25 13:18:09.576198 | TASK [fetch-output : Set log path for single node] 2026-02-25 13:18:09.603998 | controller | ok 2026-02-25 13:18:09.608836 | 2026-02-25 13:18:09.608902 | LOOP [fetch-output : Ensure local output dirs] 2026-02-25 13:18:09.797654 | controller -> localhost | ok: "/var/lib/zuul/builds/2e99f4167fff487691e9cb99720f2061/work/logs" 2026-02-25 13:18:09.797897 | controller -> localhost | changed: All items complete 2026-02-25 13:18:09.797926 | 2026-02-25 13:18:09.965659 | controller -> localhost | changed: "/var/lib/zuul/builds/2e99f4167fff487691e9cb99720f2061/work/artifacts" 2026-02-25 13:18:10.136459 | controller -> localhost | changed: "/var/lib/zuul/builds/2e99f4167fff487691e9cb99720f2061/work/docs" 2026-02-25 13:18:10.145408 | 2026-02-25 13:18:10.145501 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-25 13:18:10.777362 | controller | changed: 2026-02-25 13:18:10.777563 | controller | .d..t...... ./ 2026-02-25 13:18:10.777593 | controller | >f+++++++++ README.html 2026-02-25 13:18:10.777625 | controller | >f+++++++++ ansible-execution.log 2026-02-25 13:18:10.777647 | controller | >f+++++++++ ansible.log 2026-02-25 13:18:10.777665 | controller | >f+++++++++ crc-setup.log 2026-02-25 13:18:10.777682 | controller | >f+++++++++ crc-start.log 2026-02-25 13:18:10.777697 | controller | >f+++++++++ dmesg.log 2026-02-25 13:18:10.777713 | controller | >f+++++++++ installed-pkgs.log 2026-02-25 13:18:10.777728 | controller | >f+++++++++ python.log 2026-02-25 13:18:10.777743 | controller | >f+++++++++ registries.conf 2026-02-25 13:18:10.777757 | controller | >f+++++++++ report.html 2026-02-25 13:18:10.777772 | controller | >f+++++++++ selinux-denials.log 2026-02-25 13:18:10.777786 | controller | >f+++++++++ selinux-listing.log 2026-02-25 13:18:10.777800 | controller | cd+++++++++ ci-framework-data/ 2026-02-25 13:18:10.777818 | controller | cd+++++++++ ci-framework-data/artifacts/ 2026-02-25 13:18:10.777834 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2026-02-25 13:18:10.777849 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2026-02-25 13:18:10.777864 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2026-02-25 13:18:10.777879 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2026-02-25 13:18:10.777894 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2026-02-25 13:18:10.777908 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2026-02-25 13:18:10.777922 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2026-02-25 13:18:10.777936 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2026-02-25 13:18:10.777949 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2026-02-25 13:18:10.777962 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2026-02-25 13:18:10.777975 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2026-02-25 13:18:10.777989 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2026-02-25 13:18:10.778002 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2026-02-25 13:18:10.778015 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:75:6f:61 2026-02-25 13:18:10.778030 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:31:96:0d 2026-02-25 13:18:10.778044 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:b0:92:be 2026-02-25 13:18:10.778058 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:b5:ae:13 2026-02-25 13:18:10.778071 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:22:4e:61 2026-02-25 13:18:10.778084 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:80:af:27 2026-02-25 13:18:10.778098 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2026-02-25 13:18:10.778112 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2026-02-25 13:18:10.778125 | controller | cd+++++++++ ci-framework-data/logs/ 2026-02-25 13:18:10.778138 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2026-02-25 13:18:10.778151 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2026-02-25 13:18:10.778165 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2026-02-25 13:18:10.778179 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2026-02-25 13:18:10.778192 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2026-02-25 13:18:10.778206 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2026-02-25 13:18:10.778223 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2026-02-25 13:18:10.778238 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2026-02-25 13:18:10.778253 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2026-02-25 13:18:10.778267 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2026-02-25 13:18:10.778280 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2026-02-25 13:18:10.778318 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2026-02-25 13:18:10.778345 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2026-02-25 13:18:10.778370 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2026-02-25 13:18:10.778390 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2026-02-25 13:18:10.778406 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2026-02-25 13:18:10.778421 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2026-02-25 13:18:10.778436 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2026-02-25 13:18:10.778450 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2026-02-25 13:18:10.778549 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2026-02-25 13:18:10.778580 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2026-02-25 13:18:10.778600 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2026-02-25 13:18:10.778632 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2026-02-25 13:18:10.778650 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2026-02-25 13:18:10.778666 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2026-02-25 13:18:10.778683 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2026-02-25 13:18:10.778699 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2026-02-25 13:18:10.778715 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2026-02-25 13:18:10.778730 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2026-02-25 13:18:10.778745 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2026-02-25 13:18:10.778759 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2026-02-25 13:18:10.778773 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2026-02-25 13:18:10.778787 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2026-02-25 13:18:10.778801 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2026-02-25 13:18:10.778815 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2026-02-25 13:18:10.778830 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2026-02-25 13:18:10.778844 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2026-02-25 13:18:10.778858 | controller | cd+++++++++ registries.conf.d/ 2026-02-25 13:18:10.778872 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2026-02-25 13:18:10.778886 | controller | cd+++++++++ system-config/ 2026-02-25 13:18:10.778900 | controller | cd+++++++++ system-config/libvirt/ 2026-02-25 13:18:10.778914 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2026-02-25 13:18:10.778927 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2026-02-25 13:18:10.778940 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2026-02-25 13:18:10.778953 | controller | >f+++++++++ system-config/libvirt/network.conf 2026-02-25 13:18:10.778970 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2026-02-25 13:18:10.778986 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2026-02-25 13:18:10.779000 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2026-02-25 13:18:10.779014 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2026-02-25 13:18:10.779027 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2026-02-25 13:18:10.779041 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2026-02-25 13:18:10.779056 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2026-02-25 13:18:10.779070 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2026-02-25 13:18:10.779084 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2026-02-25 13:18:10.779098 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2026-02-25 13:18:10.779208 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2026-02-25 13:18:10.779238 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2026-02-25 13:18:11.215364 | controller | changed: .d..t...... ./ 2026-02-25 13:18:11.665769 | controller | changed: .d..t...... ./ 2026-02-25 13:18:11.681803 | 2026-02-25 13:18:11.681869 | TASK [Return artifact to Zuul] 2026-02-25 13:18:11.709342 | controller | ok 2026-02-25 13:18:11.727067 | 2026-02-25 13:18:11.727129 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2026-02-25 13:18:11.727223 | 2026-02-25 13:18:11.727250 | PLAY RECAP 2026-02-25 13:18:11.727284 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2026-02-25 13:18:11.727326 | 2026-02-25 13:18:11.798675 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-25 13:18:11.799372 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-25 13:18:12.281697 | 2026-02-25 13:18:12.281797 | PLAY [all] 2026-02-25 13:18:12.298782 | 2026-02-25 13:18:12.298850 | TASK [include_role : fetch-output] 2026-02-25 13:18:12.326802 | controller | ok 2026-02-25 13:18:12.341986 | 2026-02-25 13:18:12.342060 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-25 13:18:12.375603 | controller | skipping: Conditional result was False 2026-02-25 13:18:12.380874 | 2026-02-25 13:18:12.380946 | TASK [fetch-output : Set log path for single node] 2026-02-25 13:18:12.408324 | controller | ok 2026-02-25 13:18:12.413129 | 2026-02-25 13:18:12.413199 | LOOP [fetch-output : Ensure local output dirs] 2026-02-25 13:18:12.715740 | controller -> localhost | ok: "/var/lib/zuul/builds/2e99f4167fff487691e9cb99720f2061/work/logs" 2026-02-25 13:18:12.897007 | controller -> localhost | ok: "/var/lib/zuul/builds/2e99f4167fff487691e9cb99720f2061/work/artifacts" 2026-02-25 13:18:13.075386 | controller -> localhost | ok: "/var/lib/zuul/builds/2e99f4167fff487691e9cb99720f2061/work/docs" 2026-02-25 13:18:13.091759 | 2026-02-25 13:18:13.091880 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-25 13:18:13.692327 | controller | ok 2026-02-25 13:18:13.692585 | controller | ok: All items complete 2026-02-25 13:18:13.692624 | 2026-02-25 13:18:14.161000 | controller | ok 2026-02-25 13:18:14.607761 | controller | ok 2026-02-25 13:18:14.626715 | 2026-02-25 13:18:14.626784 | TASK [include_role : fetch-output-openshift] 2026-02-25 13:18:14.640103 | controller | skipping: Conditional result was False 2026-02-25 13:18:14.645530 | 2026-02-25 13:18:14.645597 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-02-25 13:18:14.973130 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006296 2026-02-25 13:18:15.153727 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006027 2026-02-25 13:18:15.179617 | 2026-02-25 13:18:15.179683 | PLAY [all] 2026-02-25 13:18:15.193062 | 2026-02-25 13:18:15.193128 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-02-25 13:18:15.688102 | controller | changed 2026-02-25 13:18:15.709224 | 2026-02-25 13:18:15.709318 | PLAY RECAP 2026-02-25 13:18:15.709373 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-02-25 13:18:15.709398 | 2026-02-25 13:18:15.777192 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-25 13:18:15.777886 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2026-02-25 13:18:16.308692 | 2026-02-25 13:18:16.308798 | PLAY [localhost] 2026-02-25 13:18:16.326031 | 2026-02-25 13:18:16.326116 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-02-25 13:18:16.617188 | localhost | changed 2026-02-25 13:18:16.621840 | 2026-02-25 13:18:16.621932 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-02-25 13:18:16.639939 | localhost | ok 2026-02-25 13:18:16.647888 | 2026-02-25 13:18:16.647958 | TASK [add-fileserver : Create SSH private key tempfile] 2026-02-25 13:18:16.927973 | localhost | changed 2026-02-25 13:18:16.934066 | 2026-02-25 13:18:16.934152 | TASK [add-fileserver : Create SSH private key from secret] 2026-02-25 13:18:17.457575 | localhost | changed 2026-02-25 13:18:17.462491 | 2026-02-25 13:18:17.462572 | TASK [add-fileserver : Add fileserver ssh key] 2026-02-25 13:18:17.774770 | localhost | Identity added: /var/lib/zuul/builds/2e99f4167fff487691e9cb99720f2061/work/tmp/ansible.3crmd281 (/var/lib/zuul/builds/2e99f4167fff487691e9cb99720f2061/work/tmp/ansible.3crmd281) 2026-02-25 13:18:17.774967 | localhost | ok: Runtime: 0:00:00.006036 2026-02-25 13:18:17.779245 | 2026-02-25 13:18:17.779328 | TASK [add-fileserver : Remove SSH private key from disk] 2026-02-25 13:18:17.988438 | localhost | ok: Runtime: 0:00:00.004065 2026-02-25 13:18:17.992954 | 2026-02-25 13:18:17.993025 | TASK [add-fileserver : Add fileserver to inventory] 2026-02-25 13:18:18.040278 | localhost | changed 2026-02-25 13:18:18.045090 | 2026-02-25 13:18:18.045155 | TASK [add-fileserver : Add fileserver server to known hosts] 2026-02-25 13:18:18.345939 | localhost | changed 2026-02-25 13:18:18.364623 | 2026-02-25 13:18:18.364687 | PLAY [localhost] 2026-02-25 13:18:18.375444 | 2026-02-25 13:18:18.375506 | TASK [Generate bulk log download script] 2026-02-25 13:18:18.392845 | localhost | ok 2026-02-25 13:18:18.403615 | 2026-02-25 13:18:18.403684 | TASK [local-log-download : Check API endpoint is defined] 2026-02-25 13:18:18.431236 | localhost | ok: All assertions passed 2026-02-25 13:18:18.435442 | 2026-02-25 13:18:18.435510 | TASK [local-log-download : Create download script] 2026-02-25 13:18:18.762689 | localhost -> localhost | changed 2026-02-25 13:18:18.770917 | 2026-02-25 13:18:18.770981 | TASK [Register quick-download link] 2026-02-25 13:18:18.787586 | localhost | ok 2026-02-25 13:18:18.819772 | 2026-02-25 13:18:18.819841 | PLAY [logserver.rdoproject.org] 2026-02-25 13:18:18.829004 | 2026-02-25 13:18:18.829064 | TASK [Set zuul-log-path fact] 2026-02-25 13:18:18.844207 | logserver.rdoproject.org | ok 2026-02-25 13:18:18.852536 | 2026-02-25 13:18:18.852602 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-25 13:18:18.868443 | logserver.rdoproject.org | ok 2026-02-25 13:18:18.873492 | 2026-02-25 13:18:18.873559 | TASK [upload-logs : Create log directories] 2026-02-25 13:18:20.588666 | logserver.rdoproject.org | changed 2026-02-25 13:18:20.591676 | 2026-02-25 13:18:20.591737 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-02-25 13:18:20.806928 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.005727 2026-02-25 13:18:20.811290 | 2026-02-25 13:18:20.811370 | TASK [upload-logs : Upload logs to log server] 2026-02-25 13:18:22.389061 | logserver.rdoproject.org | Output suppressed because no_log was given 2026-02-25 13:18:22.391838 | 2026-02-25 13:18:22.391900 | LOOP [upload-logs : Compress console log and json output] 2026-02-25 13:18:22.428368 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-25 13:18:22.436494 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-25 13:18:22.448583 | 2026-02-25 13:18:22.448879 | LOOP [upload-logs : Upload compressed console log and json output] 2026-02-25 13:18:22.481966 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-25 13:18:22.482174 | 2026-02-25 13:18:22.485345 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-25 13:18:22.496347 | 2026-02-25 13:18:22.496431 | LOOP [upload-logs : Upload console log and json output]