2026-02-24 18:11:37.822251 | Job console starting... 2026-02-24 18:11:38.023442 | Updating repositories 2026-02-24 18:11:38.742219 | Preparing job workspace 2026-02-24 18:11:45.425414 | Running Ansible setup... 2026-02-24 18:11:48.991824 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-24 18:11:49.477144 | 2026-02-24 18:11:49.477237 | PLAY [localhost] 2026-02-24 18:11:49.485345 | 2026-02-24 18:11:49.485412 | TASK [Gathering Facts] 2026-02-24 18:11:50.240966 | localhost | ok 2026-02-24 18:11:50.253032 | 2026-02-24 18:11:50.253103 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-02-24 18:11:50.560429 | localhost -> localhost | changed 2026-02-24 18:11:50.565280 | 2026-02-24 18:11:50.565347 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-02-24 18:11:51.186012 | localhost -> localhost | changed 2026-02-24 18:11:51.193640 | 2026-02-24 18:11:51.193718 | TASK [Setup log path fact] 2026-02-24 18:11:51.211051 | localhost | ok 2026-02-24 18:11:51.221172 | 2026-02-24 18:11:51.221241 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-24 18:11:51.248675 | localhost | ok 2026-02-24 18:11:51.255313 | 2026-02-24 18:11:51.255379 | TASK [emit-job-header : Print job information] 2026-02-24 18:11:51.282555 | # Job Information 2026-02-24 18:11:51.282661 | Ansible Version: 2.15.12 2026-02-24 18:11:51.282688 | Job: cifmw-molecule-reproducer 2026-02-24 18:11:51.282709 | Pipeline: github-check 2026-02-24 18:11:51.282727 | Executor: ibm-bm3-ze.softwarefactory-project.io 2026-02-24 18:11:51.282743 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3678 2026-02-24 18:11:51.282760 | Log URL (when completed): https://logserver.rdoproject.org/7d7/rdoproject.org/7d7ce5832b2b46e49370e247d5e931c7/ 2026-02-24 18:11:51.282777 | Event ID: 212d9ac0-11ac-11f1-8230-ebdb7e3205b1 2026-02-24 18:11:51.286148 | 2026-02-24 18:11:51.286207 | LOOP [emit-job-header : Print node information] 2026-02-24 18:11:51.365826 | localhost | ok: 2026-02-24 18:11:51.366009 | localhost | # Node Information 2026-02-24 18:11:51.366038 | localhost | Inventory Hostname: controller 2026-02-24 18:11:51.366061 | localhost | Hostname: np0005628538 2026-02-24 18:11:51.366079 | localhost | Username: zuul 2026-02-24 18:11:51.366097 | localhost | Distro: CentOS 9 2026-02-24 18:11:51.366113 | localhost | Provider: ibm-bm3-nodepool 2026-02-24 18:11:51.366127 | localhost | Region: regionOne 2026-02-24 18:11:51.366141 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2026-02-24 18:11:51.366156 | localhost | Product Name: OpenStack Compute 2026-02-24 18:11:51.366171 | localhost | Interface IP: 192.168.25.82 2026-02-24 18:11:51.387609 | 2026-02-24 18:11:51.387676 | PLAY [all] 2026-02-24 18:11:51.393692 | 2026-02-24 18:11:51.393750 | TASK [Gather network facts] 2026-02-24 18:11:51.839944 | controller | ok 2026-02-24 18:11:51.853343 | 2026-02-24 18:11:51.853405 | TASK [include_role : start-zuul-console] 2026-02-24 18:11:51.871409 | controller | ok 2026-02-24 18:11:51.881804 | 2026-02-24 18:11:51.881863 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-02-24 18:11:52.244293 | controller | ok 2026-02-24 18:11:52.252258 | 2026-02-24 18:11:52.252335 | TASK [include_role : add-build-sshkey] 2026-02-24 18:11:52.270046 | controller | ok 2026-02-24 18:11:52.281552 | 2026-02-24 18:11:52.281614 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-02-24 18:11:52.457514 | controller -> localhost | ok 2026-02-24 18:11:52.462620 | 2026-02-24 18:11:52.462686 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-02-24 18:11:52.480555 | controller | ok 2026-02-24 18:11:52.491557 | controller | included: /var/lib/zuul/builds/7d7ce5832b2b46e49370e247d5e931c7/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-02-24 18:11:52.496618 | 2026-02-24 18:11:52.496675 | TASK [add-build-sshkey : Create Temp SSH key] 2026-02-24 18:11:53.036108 | controller -> localhost | Generating public/private rsa key pair. 2026-02-24 18:11:53.036305 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/7d7ce5832b2b46e49370e247d5e931c7/work/7d7ce5832b2b46e49370e247d5e931c7_id_rsa. 2026-02-24 18:11:53.036341 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/7d7ce5832b2b46e49370e247d5e931c7/work/7d7ce5832b2b46e49370e247d5e931c7_id_rsa.pub. 2026-02-24 18:11:53.036363 | controller -> localhost | The key fingerprint is: 2026-02-24 18:11:53.036383 | controller -> localhost | SHA256:dcqsuDNENQeZ+TrqqDuzuqzGi3Dr2r6/fOTw6IKlZ88 zuul-build-sshkey 2026-02-24 18:11:53.036401 | controller -> localhost | The key's randomart image is: 2026-02-24 18:11:53.036417 | controller -> localhost | +---[RSA 3072]----+ 2026-02-24 18:11:53.036433 | controller -> localhost | | .= | 2026-02-24 18:11:53.036449 | controller -> localhost | | * . | 2026-02-24 18:11:53.036464 | controller -> localhost | | . +. . | 2026-02-24 18:11:53.036480 | controller -> localhost | | . +.o | 2026-02-24 18:11:53.036495 | controller -> localhost | | . S.+ | 2026-02-24 18:11:53.036509 | controller -> localhost | | . . o.o. | 2026-02-24 18:11:53.036523 | controller -> localhost | |o+. B.... | 2026-02-24 18:11:53.036538 | controller -> localhost | |*=*+..B. | 2026-02-24 18:11:53.036552 | controller -> localhost | |O@@%E+oo | 2026-02-24 18:11:53.036566 | controller -> localhost | +----[SHA256]-----+ 2026-02-24 18:11:53.036610 | controller -> localhost | ok: Runtime: 0:00:00.244490 2026-02-24 18:11:53.041638 | 2026-02-24 18:11:53.041701 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-02-24 18:11:53.060011 | controller | ok 2026-02-24 18:11:53.069035 | controller | included: /var/lib/zuul/builds/7d7ce5832b2b46e49370e247d5e931c7/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-02-24 18:11:53.076563 | 2026-02-24 18:11:53.076625 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-02-24 18:11:53.090671 | controller | skipping: Conditional result was False 2026-02-24 18:11:53.095341 | 2026-02-24 18:11:53.095401 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-02-24 18:11:53.550049 | controller | changed 2026-02-24 18:11:53.554923 | 2026-02-24 18:11:53.554993 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-02-24 18:11:53.817800 | controller | ok 2026-02-24 18:11:53.822593 | 2026-02-24 18:11:53.822658 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-02-24 18:11:54.968555 | controller | changed 2026-02-24 18:11:54.973124 | 2026-02-24 18:11:54.973185 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-02-24 18:11:56.142797 | controller | changed 2026-02-24 18:11:56.147531 | 2026-02-24 18:11:56.147594 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-02-24 18:11:56.161541 | controller | skipping: Conditional result was False 2026-02-24 18:11:56.166837 | 2026-02-24 18:11:56.166901 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-02-24 18:11:56.454373 | controller -> localhost | changed 2026-02-24 18:11:56.463030 | 2026-02-24 18:11:56.463092 | TASK [add-build-sshkey : Add back temp key] 2026-02-24 18:11:56.668888 | controller -> localhost | Identity added: /var/lib/zuul/builds/7d7ce5832b2b46e49370e247d5e931c7/work/7d7ce5832b2b46e49370e247d5e931c7_id_rsa (zuul-build-sshkey) 2026-02-24 18:11:56.669073 | controller -> localhost | ok: Runtime: 0:00:00.006763 2026-02-24 18:11:56.674334 | 2026-02-24 18:11:56.674394 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-02-24 18:11:57.038864 | controller | ok 2026-02-24 18:11:57.043039 | 2026-02-24 18:11:57.043101 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-02-24 18:11:57.067663 | controller | skipping: Conditional result was False 2026-02-24 18:11:57.076158 | 2026-02-24 18:11:57.076216 | TASK [include_role : validate-host] 2026-02-24 18:11:57.093528 | controller | ok 2026-02-24 18:11:57.111227 | 2026-02-24 18:11:57.111321 | TASK [validate-host : Define zuul_info_dir fact] 2026-02-24 18:11:57.138763 | controller | ok 2026-02-24 18:11:57.143085 | 2026-02-24 18:11:57.143148 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-02-24 18:11:57.328499 | controller -> localhost | ok 2026-02-24 18:11:57.333691 | 2026-02-24 18:11:57.333745 | TASK [validate-host : Collect information about the host] 2026-02-24 18:11:58.048651 | controller | ok 2026-02-24 18:11:58.055687 | 2026-02-24 18:11:58.055744 | TASK [validate-host : Sanitize hostname] 2026-02-24 18:11:58.094100 | controller | ok 2026-02-24 18:11:58.098605 | 2026-02-24 18:11:58.098663 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-02-24 18:11:58.436690 | controller -> localhost | changed 2026-02-24 18:11:58.441733 | 2026-02-24 18:11:58.441791 | TASK [validate-host : Collect information about zuul worker] 2026-02-24 18:11:58.836150 | controller | ok 2026-02-24 18:11:58.840660 | 2026-02-24 18:11:58.840730 | TASK [validate-host : Write out all zuul information for each host] 2026-02-24 18:11:59.208942 | controller -> localhost | changed 2026-02-24 18:11:59.218208 | 2026-02-24 18:11:59.218282 | TASK [include_role : prepare-workspace-openshift] 2026-02-24 18:11:59.232139 | controller | skipping: Conditional result was False 2026-02-24 18:11:59.236950 | 2026-02-24 18:11:59.237018 | TASK [include_role : remove-zuul-sshkey] 2026-02-24 18:11:59.250441 | controller | skipping: Conditional result was False 2026-02-24 18:11:59.255209 | 2026-02-24 18:11:59.255291 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-02-24 18:11:59.511819 | controller | ok: "logs" 2026-02-24 18:11:59.512481 | controller | ok: All items complete 2026-02-24 18:11:59.512524 | 2026-02-24 18:11:59.744553 | controller | ok: "artifacts" 2026-02-24 18:11:59.975079 | controller | ok: "docs" 2026-02-24 18:11:59.984729 | 2026-02-24 18:11:59.984904 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-02-24 18:12:00.272190 | controller | changed: "logs" 2026-02-24 18:12:00.515199 | controller | changed: "artifacts" 2026-02-24 18:12:00.754447 | controller | changed: "docs" 2026-02-24 18:12:00.782609 | 2026-02-24 18:12:00.782721 | PLAY RECAP 2026-02-24 18:12:00.782771 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-24 18:12:00.782797 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-24 18:12:00.782814 | 2026-02-24 18:12:00.883162 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-24 18:12:00.883832 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-24 18:12:01.388487 | 2026-02-24 18:12:01.388665 | PLAY [all] 2026-02-24 18:12:01.406741 | 2026-02-24 18:12:01.406810 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-24 18:12:01.456115 | controller | ok 2026-02-24 18:12:01.460564 | 2026-02-24 18:12:01.460635 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-24 18:12:01.917213 | controller | changed 2026-02-24 18:12:01.923030 | 2026-02-24 18:12:01.923105 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-24 18:12:03.323411 | controller | changed 2026-02-24 18:12:03.333174 | 2026-02-24 18:12:03.333244 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2026-02-24 18:12:03.804709 | controller | changed: 2026-02-24 18:12:03.804929 | controller | { 2026-02-24 18:12:03.804972 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2026-02-24 18:12:03.805005 | controller | } 2026-02-24 18:12:04.095522 | controller | changed: 2026-02-24 18:12:04.095701 | controller | { 2026-02-24 18:12:04.095733 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2026-02-24 18:12:04.095756 | controller | } 2026-02-24 18:12:04.391039 | controller | changed: 2026-02-24 18:12:04.391108 | controller | { 2026-02-24 18:12:04.391132 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2026-02-24 18:12:04.391151 | controller | } 2026-02-24 18:12:04.689790 | controller | changed: 2026-02-24 18:12:04.689851 | controller | { 2026-02-24 18:12:04.689877 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2026-02-24 18:12:04.689897 | controller | } 2026-02-24 18:12:04.986710 | controller | changed: 2026-02-24 18:12:04.986769 | controller | { 2026-02-24 18:12:04.986793 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2026-02-24 18:12:04.986811 | controller | } 2026-02-24 18:12:05.279401 | controller | changed: 2026-02-24 18:12:05.279459 | controller | { 2026-02-24 18:12:05.279484 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2026-02-24 18:12:05.279504 | controller | } 2026-02-24 18:12:05.567550 | controller | changed: 2026-02-24 18:12:05.567601 | controller | { 2026-02-24 18:12:05.567626 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2026-02-24 18:12:05.567645 | controller | } 2026-02-24 18:12:05.867040 | controller | changed: 2026-02-24 18:12:05.867188 | controller | { 2026-02-24 18:12:05.867216 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2026-02-24 18:12:05.867237 | controller | } 2026-02-24 18:12:06.158476 | controller | changed: 2026-02-24 18:12:06.158555 | controller | { 2026-02-24 18:12:06.158580 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2026-02-24 18:12:06.158598 | controller | } 2026-02-24 18:12:06.478346 | controller | changed: 2026-02-24 18:12:06.478437 | controller | { 2026-02-24 18:12:06.478462 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2026-02-24 18:12:06.478481 | controller | } 2026-02-24 18:12:06.736478 | controller | changed: 2026-02-24 18:12:06.736540 | controller | { 2026-02-24 18:12:06.736563 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2026-02-24 18:12:06.736580 | controller | } 2026-02-24 18:12:07.028999 | controller | changed: 2026-02-24 18:12:07.029053 | controller | { 2026-02-24 18:12:07.029079 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2026-02-24 18:12:07.029097 | controller | } 2026-02-24 18:12:07.319216 | controller | changed: 2026-02-24 18:12:07.319285 | controller | { 2026-02-24 18:12:07.319315 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com" 2026-02-24 18:12:07.319335 | controller | } 2026-02-24 18:12:07.619244 | controller | changed: 2026-02-24 18:12:07.619331 | controller | { 2026-02-24 18:12:07.619357 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2026-02-24 18:12:07.619375 | controller | } 2026-02-24 18:12:07.914608 | controller | changed: 2026-02-24 18:12:07.914662 | controller | { 2026-02-24 18:12:07.914685 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2026-02-24 18:12:07.914703 | controller | } 2026-02-24 18:12:08.220144 | controller | changed: 2026-02-24 18:12:08.220197 | controller | { 2026-02-24 18:12:08.220221 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2026-02-24 18:12:08.220238 | controller | } 2026-02-24 18:12:08.512679 | controller | changed: 2026-02-24 18:12:08.512737 | controller | { 2026-02-24 18:12:08.512762 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2026-02-24 18:12:08.512781 | controller | } 2026-02-24 18:12:08.804543 | controller | changed: 2026-02-24 18:12:08.804614 | controller | { 2026-02-24 18:12:08.804648 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2026-02-24 18:12:08.804693 | controller | } 2026-02-24 18:12:09.102309 | controller | changed: 2026-02-24 18:12:09.102361 | controller | { 2026-02-24 18:12:09.102384 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2026-02-24 18:12:09.102401 | controller | } 2026-02-24 18:12:09.398859 | controller | changed: 2026-02-24 18:12:09.398912 | controller | { 2026-02-24 18:12:09.398936 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2026-02-24 18:12:09.398964 | controller | } 2026-02-24 18:12:09.699020 | controller | changed: 2026-02-24 18:12:09.699078 | controller | { 2026-02-24 18:12:09.699102 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2026-02-24 18:12:09.699121 | controller | } 2026-02-24 18:12:09.995524 | controller | changed: 2026-02-24 18:12:09.995579 | controller | { 2026-02-24 18:12:09.995602 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2026-02-24 18:12:09.995620 | controller | } 2026-02-24 18:12:10.298702 | controller | changed: 2026-02-24 18:12:10.298750 | controller | { 2026-02-24 18:12:10.298773 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2026-02-24 18:12:10.298792 | controller | } 2026-02-24 18:12:10.581340 | controller | changed: 2026-02-24 18:12:10.581439 | controller | { 2026-02-24 18:12:10.581464 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2026-02-24 18:12:10.581483 | controller | } 2026-02-24 18:12:10.878731 | controller | changed: 2026-02-24 18:12:10.878871 | controller | { 2026-02-24 18:12:10.878899 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2026-02-24 18:12:10.878921 | controller | } 2026-02-24 18:12:11.172573 | controller | changed: 2026-02-24 18:12:11.172714 | controller | { 2026-02-24 18:12:11.172743 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2026-02-24 18:12:11.172763 | controller | } 2026-02-24 18:12:11.191852 | 2026-02-24 18:12:11.192000 | TASK [Set timezone to UTC] 2026-02-24 18:12:11.716823 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2026-02-24 18:12:11.721569 | 2026-02-24 18:12:11.721635 | TASK [Create nodepool directory] 2026-02-24 18:12:12.025934 | controller | changed 2026-02-24 18:12:12.031548 | 2026-02-24 18:12:12.031616 | TASK [Create nodepool sub_nodes file] 2026-02-24 18:12:13.095327 | controller | changed 2026-02-24 18:12:13.100180 | 2026-02-24 18:12:13.100248 | TASK [Create nodepool sub_nodes_private file] 2026-02-24 18:12:14.123565 | controller | changed 2026-02-24 18:12:14.128473 | 2026-02-24 18:12:14.128535 | LOOP [Populate nodepool sub_nodes file] 2026-02-24 18:12:14.157792 | 2026-02-24 18:12:14.157915 | LOOP [Populate nodepool sub_nodes_private file] 2026-02-24 18:12:14.186590 | 2026-02-24 18:12:14.186719 | TASK [Create nodepool primary file] 2026-02-24 18:12:14.210177 | controller | skipping: Conditional result was False 2026-02-24 18:12:14.215704 | 2026-02-24 18:12:14.215776 | TASK [Create nodepool node_private for this node] 2026-02-24 18:12:15.282661 | controller | changed 2026-02-24 18:12:15.288113 | 2026-02-24 18:12:15.288174 | LOOP [Copy ssh keys to nodepool directory] 2026-02-24 18:12:15.679087 | controller | ok: Item: id_rsa Runtime: 0:00:00.006059 2026-02-24 18:12:15.679487 | 2026-02-24 18:12:15.911098 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.005970 2026-02-24 18:12:15.918096 | 2026-02-24 18:12:15.918317 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2026-02-24 18:12:16.977841 | controller | changed 2026-02-24 18:12:16.983060 | 2026-02-24 18:12:16.983125 | TASK [Validate sudoers config after edits] 2026-02-24 18:12:17.274965 | controller | /etc/sudoers: parsed OK 2026-02-24 18:12:17.275012 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2026-02-24 18:12:17.275022 | controller | /etc/sudoers.d/zuul: parsed OK 2026-02-24 18:12:17.275028 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2026-02-24 18:12:17.508750 | controller | ok: Runtime: 0:00:00.006611 2026-02-24 18:12:17.514400 | 2026-02-24 18:12:17.514464 | TASK [Show the environment passed in to job shell scripts] 2026-02-24 18:12:17.790353 | controller | SHELL=/bin/bash 2026-02-24 18:12:17.790461 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2026-02-24 18:12:17.790475 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2026-02-24 18:12:17.790482 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/78/3678/2434a201b9d11793db57a091ab062e6a97d89961 2026-02-24 18:12:17.790488 | controller | PWD=/home/zuul 2026-02-24 18:12:17.790493 | controller | ZUUL_PIPELINE=github-check 2026-02-24 18:12:17.790499 | controller | LOGNAME=zuul 2026-02-24 18:12:17.790505 | controller | XDG_SESSION_TYPE=tty 2026-02-24 18:12:17.790510 | controller | _=/usr/bin/env 2026-02-24 18:12:17.790514 | controller | MOTD_SHOWN=pam 2026-02-24 18:12:17.790519 | controller | HOME=/home/zuul 2026-02-24 18:12:17.790524 | controller | LANG=en_US.UTF-8 2026-02-24 18:12:17.790529 | controller | SSH_CONNECTION=192.168.25.12 41952 192.168.25.82 22 2026-02-24 18:12:17.790535 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2026-02-24 18:12:17.790544 | controller | ZUUL_CHANGE_IDS=3678,2434a201b9d11793db57a091ab062e6a97d89961 2026-02-24 18:12:17.790550 | controller | WORKSPACE=/home/zuul/workspace 2026-02-24 18:12:17.790556 | controller | XDG_SESSION_CLASS=user 2026-02-24 18:12:17.790562 | controller | SELINUX_ROLE_REQUESTED= 2026-02-24 18:12:17.790567 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2026-02-24 18:12:17.790572 | controller | USER=zuul 2026-02-24 18:12:17.790578 | controller | ZUUL_VOTING=True 2026-02-24 18:12:17.790583 | controller | BUILD_TIMEOUT=5400000 2026-02-24 18:12:17.790588 | controller | SELINUX_USE_CURRENT_RANGE= 2026-02-24 18:12:17.790593 | controller | SHLVL=1 2026-02-24 18:12:17.790598 | controller | ZUUL_PATCHSET=2434a201b9d11793db57a091ab062e6a97d89961 2026-02-24 18:12:17.790604 | controller | XDG_SESSION_ID=1 2026-02-24 18:12:17.790609 | controller | ZUUL_BRANCH=main 2026-02-24 18:12:17.790613 | controller | XDG_RUNTIME_DIR=/run/user/1000 2026-02-24 18:12:17.790618 | controller | SSH_CLIENT=192.168.25.12 41952 22 2026-02-24 18:12:17.790625 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2026-02-24 18:12:17.790631 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2026-02-24 18:12:17.790636 | controller | which_declare=declare -f 2026-02-24 18:12:17.790643 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2026-02-24 18:12:17.790649 | controller | SELINUX_LEVEL_REQUESTED= 2026-02-24 18:12:17.790654 | controller | ZUUL_CHANGE=3678 2026-02-24 18:12:17.790659 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2026-02-24 18:12:17.790664 | controller | ZUUL_UUID=7d7ce5832b2b46e49370e247d5e931c7 2026-02-24 18:12:17.790669 | controller | BASH_FUNC_which%%=() { ( alias; 2026-02-24 18:12:17.790674 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2026-02-24 18:12:17.790679 | controller | } 2026-02-24 18:12:18.040482 | controller | ok: Runtime: 0:00:00.006454 2026-02-24 18:12:18.045704 | 2026-02-24 18:12:18.045764 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2026-02-24 18:12:18.070011 | controller | skipping: Conditional result was False 2026-02-24 18:12:18.075715 | 2026-02-24 18:12:18.075782 | TASK [Symlink /home/zuul-worker/workspace] 2026-02-24 18:12:18.634970 | controller | skipping: Conditional result was False 2026-02-24 18:12:18.640999 | 2026-02-24 18:12:18.641070 | TASK [Ensure legacy workspace directory] 2026-02-24 18:12:18.934222 | controller | changed 2026-02-24 18:12:18.960391 | 2026-02-24 18:12:18.960457 | PLAY RECAP 2026-02-24 18:12:18.960503 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-24 18:12:18.960525 | 2026-02-24 18:12:19.028554 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-24 18:12:19.029294 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-24 18:12:19.528567 | 2026-02-24 18:12:19.528718 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2026-02-24 18:12:19.548761 | 2026-02-24 18:12:19.548840 | TASK [Create zuul-output directory] 2026-02-24 18:12:19.936512 | controller | changed 2026-02-24 18:12:19.941468 | 2026-02-24 18:12:19.941546 | TASK [Slurp Zuul inventory test] 2026-02-24 18:12:20.201822 | controller -> localhost | ok 2026-02-24 18:12:20.207703 | 2026-02-24 18:12:20.207774 | TASK [Save zuul inventory] 2026-02-24 18:12:21.508895 | controller | changed 2026-02-24 18:12:21.514234 | 2026-02-24 18:12:21.514328 | TASK [Save zuul vars without the change_message] 2026-02-24 18:12:22.650283 | controller | changed 2026-02-24 18:12:22.668635 | 2026-02-24 18:12:22.668690 | PLAY RECAP 2026-02-24 18:12:22.668736 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-24 18:12:22.668758 | 2026-02-24 18:12:22.752083 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-24 18:12:22.752803 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-24 18:12:23.279836 | 2026-02-24 18:12:23.279961 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2026-02-24 18:12:23.299555 | 2026-02-24 18:12:23.299626 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2026-02-24 18:12:23.319290 | controller | ok 2026-02-24 18:12:23.335814 | 2026-02-24 18:12:23.335893 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-24 18:12:23.360252 | controller | skipping: Conditional result was False 2026-02-24 18:12:23.365875 | 2026-02-24 18:12:23.365949 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-24 18:12:23.780720 | controller | ok 2026-02-24 18:12:23.786244 | 2026-02-24 18:12:23.786351 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-24 18:12:24.813664 | controller | ok 2026-02-24 18:12:24.822856 | 2026-02-24 18:12:24.822921 | TASK [Prepare workspace] 2026-02-24 18:12:24.841773 | controller | ok 2026-02-24 18:12:24.858493 | 2026-02-24 18:12:24.858565 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-02-24 18:12:25.285549 | controller | ok 2026-02-24 18:12:25.291425 | 2026-02-24 18:12:25.291496 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-02-24 18:12:27.857600 | controller | Output suppressed because no_log was given 2026-02-24 18:12:27.866632 | 2026-02-24 18:12:27.866733 | LOOP [Create zuul-output directory] 2026-02-24 18:12:28.150249 | controller | changed: "/home/zuul/ci-framework-data/logs" 2026-02-24 18:12:28.383638 | controller | ok: "/home/zuul/zuul-output/logs" 2026-02-24 18:12:28.397334 | 2026-02-24 18:12:28.397526 | TASK [Install required packages] 2026-02-24 18:12:53.138278 | controller | ok: Nothing to do 2026-02-24 18:12:53.143906 | 2026-02-24 18:12:53.143983 | TASK [Install venv] 2026-02-24 18:13:50.369945 | controller | changed 2026-02-24 18:13:50.394196 | 2026-02-24 18:13:50.394259 | PLAY RECAP 2026-02-24 18:13:50.394327 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-02-24 18:13:50.394354 | 2026-02-24 18:13:50.467327 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-24 18:13:50.468131 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-24 18:13:50.970750 | 2026-02-24 18:13:50.970851 | PLAY [Run ci/playbooks/molecule-test.yml] 2026-02-24 18:13:50.990918 | 2026-02-24 18:13:50.990994 | TASK [Gather required facts] 2026-02-24 18:13:51.527674 | controller | ok 2026-02-24 18:13:51.532870 | 2026-02-24 18:13:51.532945 | TASK [Load environment var if instructed to] 2026-02-24 18:13:51.556334 | controller | skipping: Conditional result was False 2026-02-24 18:13:51.561508 | 2026-02-24 18:13:51.561572 | TASK [Ensure group_vars dir exists] 2026-02-24 18:13:51.924468 | controller | ok 2026-02-24 18:13:51.929259 | 2026-02-24 18:13:51.929341 | TASK [Print related variables] 2026-02-24 18:13:51.957690 | controller | ok: 2026-02-24 18:13:51.957792 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2026-02-24 18:13:51.957819 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2026-02-24 18:13:51.962515 | 2026-02-24 18:13:51.962600 | TASK [Run molecule] 2026-02-24 18:13:52.948655 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2026-02-24 18:13:53.200959 | controller | INFO Performing prerun with role_name_check=0... 2026-02-24 18:14:10.288617 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 18:14:10.288999 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 18:14:10.289423 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 18:14:10.289836 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 18:14:10.290264 | controller | WARNING Another version of 'cifmw.general' 1.0.0+2434a201 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+2434a201 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 18:14:10.290698 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 18:14:10.291085 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 18:14:10.291475 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 18:14:10.291869 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 18:14:10.292251 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 18:14:10.292668 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 18:14:10.293045 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 18:14:10.293449 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 18:14:10.293854 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 18:14:10.294240 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 18:14:10.303570 | controller | INFO Running crc_layout > prepare 2026-02-24 18:14:10.968540 | controller | 2026-02-24 18:14:10.968630 | controller | PLAY [Prepare] ***************************************************************** 2026-02-24 18:14:10.968711 | controller | 2026-02-24 18:14:10.968805 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-24 18:14:10.968901 | controller | Tuesday 24 February 2026 18:14:10 +0000 (0:00:00.018) 0:00:00.018 ****** 2026-02-24 18:14:11.804032 | controller | ok: [instance] 2026-02-24 18:14:11.804158 | controller | 2026-02-24 18:14:11.804181 | controller | TASK [Create custom basedir] *************************************************** 2026-02-24 18:14:11.804236 | controller | Tuesday 24 February 2026 18:14:11 +0000 (0:00:00.836) 0:00:00.854 ****** 2026-02-24 18:14:12.117965 | controller | changed: [instance] 2026-02-24 18:14:12.118005 | controller | 2026-02-24 18:14:12.118103 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2026-02-24 18:14:12.118201 | controller | Tuesday 24 February 2026 18:14:12 +0000 (0:00:00.314) 0:00:01.168 ****** 2026-02-24 18:14:12.141252 | controller | skipping: [instance] 2026-02-24 18:14:12.141400 | controller | 2026-02-24 18:14:12.141537 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2026-02-24 18:14:12.141648 | controller | Tuesday 24 February 2026 18:14:12 +0000 (0:00:00.023) 0:00:01.192 ****** 2026-02-24 18:14:12.190415 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2026-02-24 18:14:12.190599 | controller | 2026-02-24 18:14:12.190751 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2026-02-24 18:14:12.190852 | controller | Tuesday 24 February 2026 18:14:12 +0000 (0:00:00.048) 0:00:01.241 ****** 2026-02-24 18:14:12.486190 | controller | ok: [instance] 2026-02-24 18:14:12.486253 | controller | 2026-02-24 18:14:12.486378 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2026-02-24 18:14:12.486483 | controller | Tuesday 24 February 2026 18:14:12 +0000 (0:00:00.295) 0:00:01.536 ****** 2026-02-24 18:14:12.701049 | controller | ok: [instance] 2026-02-24 18:14:12.701114 | controller | 2026-02-24 18:14:12.701218 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2026-02-24 18:14:12.701413 | controller | Tuesday 24 February 2026 18:14:12 +0000 (0:00:00.214) 0:00:01.751 ****** 2026-02-24 18:14:13.378469 | controller | ok: [instance] => (item=ubi-9-appstream) 2026-02-24 18:14:13.378565 | controller | ok: [instance] => (item=ubi-9-baseos) 2026-02-24 18:14:13.378668 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2026-02-24 18:14:13.378777 | controller | 2026-02-24 18:14:13.378866 | controller | TASK [Deploy repo-setup] ******************************************************* 2026-02-24 18:14:13.378966 | controller | Tuesday 24 February 2026 18:14:13 +0000 (0:00:00.677) 0:00:02.429 ****** 2026-02-24 18:14:13.439296 | controller | 2026-02-24 18:14:13.439381 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-24 18:14:13.439500 | controller | Tuesday 24 February 2026 18:14:13 +0000 (0:00:00.061) 0:00:02.490 ****** 2026-02-24 18:14:13.960139 | controller | changed: [instance] => (item=tmp) 2026-02-24 18:14:13.960203 | controller | changed: [instance] => (item=artifacts/repositories) 2026-02-24 18:14:13.960326 | controller | changed: [instance] => (item=venv/repo_setup) 2026-02-24 18:14:13.960428 | controller | 2026-02-24 18:14:13.960552 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-24 18:14:13.961300 | controller | Tuesday 24 February 2026 18:14:13 +0000 (0:00:00.520) 0:00:03.010 ****** 2026-02-24 18:14:14.809671 | controller | ok: [instance] 2026-02-24 18:14:14.809720 | controller | 2026-02-24 18:14:14.809956 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-24 18:14:15.872198 | controller | Tuesday 24 February 2026 18:14:14 +0000 (0:00:00.849) 0:00:03.860 ****** 2026-02-24 18:14:15.872233 | controller | changed: [instance] 2026-02-24 18:14:23.384405 | controller | 2026-02-24 18:14:23.384481 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-24 18:14:23.384493 | controller | Tuesday 24 February 2026 18:14:15 +0000 (0:00:01.062) 0:00:04.922 ****** 2026-02-24 18:14:23.384507 | controller | changed: [instance] 2026-02-24 18:14:23.384531 | controller | 2026-02-24 18:14:23.384539 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-24 18:14:23.384549 | controller | Tuesday 24 February 2026 18:14:23 +0000 (0:00:07.512) 0:00:12.434 ****** 2026-02-24 18:14:24.076168 | controller | changed: [instance] 2026-02-24 18:14:24.099853 | controller | 2026-02-24 18:14:24.099898 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-24 18:14:24.099911 | controller | Tuesday 24 February 2026 18:14:24 +0000 (0:00:00.691) 0:00:13.126 ****** 2026-02-24 18:14:24.099926 | controller | skipping: [instance] 2026-02-24 18:14:24.947221 | controller | 2026-02-24 18:14:24.947257 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-24 18:14:24.947318 | controller | Tuesday 24 February 2026 18:14:24 +0000 (0:00:00.023) 0:00:13.150 ****** 2026-02-24 18:14:24.947334 | controller | changed: [instance] 2026-02-24 18:14:24.984723 | controller | 2026-02-24 18:14:24.984746 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-24 18:14:24.984755 | controller | Tuesday 24 February 2026 18:14:24 +0000 (0:00:00.847) 0:00:13.997 ****** 2026-02-24 18:14:24.984765 | controller | skipping: [instance] 2026-02-24 18:14:25.021021 | controller | 2026-02-24 18:14:25.021038 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-24 18:14:25.021045 | controller | Tuesday 24 February 2026 18:14:24 +0000 (0:00:00.037) 0:00:14.035 ****** 2026-02-24 18:14:25.021053 | controller | skipping: [instance] 2026-02-24 18:14:25.055997 | controller | 2026-02-24 18:14:25.056016 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-24 18:14:25.056024 | controller | Tuesday 24 February 2026 18:14:25 +0000 (0:00:00.036) 0:00:14.071 ****** 2026-02-24 18:14:25.056032 | controller | skipping: [instance] 2026-02-24 18:14:25.603865 | controller | 2026-02-24 18:14:25.603901 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-24 18:14:25.603911 | controller | Tuesday 24 February 2026 18:14:25 +0000 (0:00:00.035) 0:00:14.106 ****** 2026-02-24 18:14:25.603923 | controller | changed: [instance] 2026-02-24 18:14:26.029091 | controller | 2026-02-24 18:14:26.029121 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-24 18:14:26.029128 | controller | Tuesday 24 February 2026 18:14:25 +0000 (0:00:00.547) 0:00:14.654 ****** 2026-02-24 18:14:26.029137 | controller | changed: [instance] 2026-02-24 18:14:26.061021 | controller | 2026-02-24 18:14:26.061043 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-24 18:14:26.061052 | controller | Tuesday 24 February 2026 18:14:26 +0000 (0:00:00.425) 0:00:15.079 ****** 2026-02-24 18:14:26.061062 | controller | skipping: [instance] 2026-02-24 18:14:26.089317 | controller | 2026-02-24 18:14:26.089335 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-24 18:14:26.089341 | controller | Tuesday 24 February 2026 18:14:26 +0000 (0:00:00.031) 0:00:15.111 ****** 2026-02-24 18:14:26.089354 | controller | skipping: [instance] 2026-02-24 18:14:26.089471 | controller | 2026-02-24 18:14:26.089490 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-24 18:14:26.089507 | controller | Tuesday 24 February 2026 18:14:26 +0000 (0:00:00.028) 0:00:15.140 ****** 2026-02-24 18:14:26.117196 | controller | skipping: [instance] 2026-02-24 18:14:26.153745 | controller | 2026-02-24 18:14:26.153763 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-24 18:14:26.153771 | controller | Tuesday 24 February 2026 18:14:26 +0000 (0:00:00.027) 0:00:15.168 ****** 2026-02-24 18:14:26.153779 | controller | ok: [instance] 2026-02-24 18:14:26.180898 | controller | 2026-02-24 18:14:26.180917 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-24 18:14:26.180924 | controller | Tuesday 24 February 2026 18:14:26 +0000 (0:00:00.036) 0:00:15.204 ****** 2026-02-24 18:14:26.180939 | controller | skipping: [instance] 2026-02-24 18:14:26.207370 | controller | 2026-02-24 18:14:26.207423 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-24 18:14:26.207434 | controller | Tuesday 24 February 2026 18:14:26 +0000 (0:00:00.026) 0:00:15.231 ****** 2026-02-24 18:14:26.207462 | controller | skipping: [instance] 2026-02-24 18:14:26.207514 | controller | 2026-02-24 18:14:26.207526 | controller | TASK [Download the RPM] ******************************************************** 2026-02-24 18:14:26.207537 | controller | Tuesday 24 February 2026 18:14:26 +0000 (0:00:00.026) 0:00:15.258 ****** 2026-02-24 18:14:26.233658 | controller | skipping: [instance] 2026-02-24 18:14:26.233786 | controller | 2026-02-24 18:14:26.233908 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-24 18:14:26.234029 | controller | Tuesday 24 February 2026 18:14:26 +0000 (0:00:00.026) 0:00:15.284 ****** 2026-02-24 18:14:26.260630 | controller | skipping: [instance] 2026-02-24 18:14:26.260785 | controller | 2026-02-24 18:14:26.260931 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-24 18:14:26.261070 | controller | Tuesday 24 February 2026 18:14:26 +0000 (0:00:00.026) 0:00:15.311 ****** 2026-02-24 18:14:26.288344 | controller | skipping: [instance] 2026-02-24 18:14:26.288517 | controller | 2026-02-24 18:14:26.288643 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-24 18:14:26.288756 | controller | Tuesday 24 February 2026 18:14:26 +0000 (0:00:00.027) 0:00:15.339 ****** 2026-02-24 18:14:26.319101 | controller | skipping: [instance] 2026-02-24 18:14:26.319250 | controller | 2026-02-24 18:14:26.319412 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-24 18:14:26.319545 | controller | Tuesday 24 February 2026 18:14:26 +0000 (0:00:00.030) 0:00:15.370 ****** 2026-02-24 18:14:26.345639 | controller | skipping: [instance] 2026-02-24 18:14:26.345793 | controller | 2026-02-24 18:14:26.345937 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-24 18:14:26.346075 | controller | Tuesday 24 February 2026 18:14:26 +0000 (0:00:00.026) 0:00:15.396 ****** 2026-02-24 18:14:26.532389 | controller | ok: [instance] 2026-02-24 18:14:26.532441 | controller | 2026-02-24 18:14:26.532470 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-24 18:14:26.532554 | controller | Tuesday 24 February 2026 18:14:26 +0000 (0:00:00.186) 0:00:15.583 ****** 2026-02-24 18:14:26.739364 | controller | changed: [instance] 2026-02-24 18:14:26.739755 | controller | 2026-02-24 18:14:26.966956 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-24 18:14:26.966989 | controller | Tuesday 24 February 2026 18:14:26 +0000 (0:00:00.207) 0:00:15.790 ****** 2026-02-24 18:14:26.967003 | controller | changed: [instance] 2026-02-24 18:14:26.988797 | controller | 2026-02-24 18:14:26.988815 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-24 18:14:26.988822 | controller | Tuesday 24 February 2026 18:14:26 +0000 (0:00:00.227) 0:00:16.017 ****** 2026-02-24 18:14:26.988832 | controller | skipping: [instance] 2026-02-24 18:14:27.011783 | controller | 2026-02-24 18:14:27.011799 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-24 18:14:27.011806 | controller | Tuesday 24 February 2026 18:14:26 +0000 (0:00:00.022) 0:00:16.039 ****** 2026-02-24 18:14:27.011815 | controller | skipping: [instance] 2026-02-24 18:14:27.033995 | controller | 2026-02-24 18:14:27.034015 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-24 18:14:27.034023 | controller | Tuesday 24 February 2026 18:14:27 +0000 (0:00:00.023) 0:00:16.062 ****** 2026-02-24 18:14:27.034041 | controller | skipping: [instance] 2026-02-24 18:14:27.055853 | controller | 2026-02-24 18:14:27.055869 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-24 18:14:27.055877 | controller | Tuesday 24 February 2026 18:14:27 +0000 (0:00:00.022) 0:00:16.084 ****** 2026-02-24 18:14:27.055886 | controller | skipping: [instance] 2026-02-24 18:14:27.077332 | controller | 2026-02-24 18:14:27.077350 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-24 18:14:27.077364 | controller | Tuesday 24 February 2026 18:14:27 +0000 (0:00:00.021) 0:00:16.106 ****** 2026-02-24 18:14:27.077374 | controller | skipping: [instance] 2026-02-24 18:14:27.077575 | controller | 2026-02-24 18:14:27.077591 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-24 18:14:27.099117 | controller | Tuesday 24 February 2026 18:14:27 +0000 (0:00:00.021) 0:00:16.128 ****** 2026-02-24 18:14:27.099139 | controller | skipping: [instance] 2026-02-24 18:14:27.116235 | controller | 2026-02-24 18:14:27.116253 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-24 18:14:27.116261 | controller | Tuesday 24 February 2026 18:14:27 +0000 (0:00:00.021) 0:00:16.149 ****** 2026-02-24 18:14:27.116300 | controller | skipping: [instance] 2026-02-24 18:14:27.116487 | controller | 2026-02-24 18:14:27.116673 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-24 18:14:27.116839 | controller | Tuesday 24 February 2026 18:14:27 +0000 (0:00:00.017) 0:00:16.167 ****** 2026-02-24 18:14:27.145173 | controller | skipping: [instance] 2026-02-24 18:14:27.145369 | controller | 2026-02-24 18:14:27.145567 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-24 18:14:27.145745 | controller | Tuesday 24 February 2026 18:14:27 +0000 (0:00:00.028) 0:00:16.196 ****** 2026-02-24 18:14:27.162477 | controller | skipping: [instance] 2026-02-24 18:14:27.162647 | controller | 2026-02-24 18:14:27.162811 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-24 18:14:27.162971 | controller | Tuesday 24 February 2026 18:14:27 +0000 (0:00:00.017) 0:00:16.213 ****** 2026-02-24 18:14:27.183017 | controller | skipping: [instance] 2026-02-24 18:14:27.183181 | controller | 2026-02-24 18:14:27.183375 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2026-02-24 18:14:27.183561 | controller | Tuesday 24 February 2026 18:14:27 +0000 (0:00:00.020) 0:00:16.234 ****** 2026-02-24 18:14:27.213689 | controller | skipping: [instance] 2026-02-24 18:14:27.213853 | controller | 2026-02-24 18:14:27.214008 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2026-02-24 18:14:27.214148 | controller | Tuesday 24 February 2026 18:14:27 +0000 (0:00:00.030) 0:00:16.264 ****** 2026-02-24 18:14:27.242701 | controller | skipping: [instance] 2026-02-24 18:14:27.242878 | controller | 2026-02-24 18:14:27.243043 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2026-02-24 18:14:27.243188 | controller | Tuesday 24 February 2026 18:14:27 +0000 (0:00:00.028) 0:00:16.293 ****** 2026-02-24 18:14:27.273500 | controller | skipping: [instance] 2026-02-24 18:14:27.273665 | controller | 2026-02-24 18:14:27.273827 | controller | TASK [test_deps : Install additional packages] ********************************* 2026-02-24 18:14:27.273996 | controller | Tuesday 24 February 2026 18:14:27 +0000 (0:00:00.030) 0:00:16.324 ****** 2026-02-24 18:14:27.302577 | controller | skipping: [instance] 2026-02-24 18:14:27.302757 | controller | 2026-02-24 18:14:27.302927 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2026-02-24 18:14:27.303092 | controller | Tuesday 24 February 2026 18:14:27 +0000 (0:00:00.029) 0:00:16.353 ****** 2026-02-24 18:15:08.218665 | controller | ok: [instance] 2026-02-24 18:15:09.368113 | controller | 2026-02-24 18:15:09.368136 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2026-02-24 18:15:09.368144 | controller | Tuesday 24 February 2026 18:15:08 +0000 (0:00:40.911) 0:00:57.264 ****** 2026-02-24 18:15:09.368153 | controller | ok: [instance] 2026-02-24 18:15:09.400435 | controller | 2026-02-24 18:15:09.400477 | controller | TASK [test_deps : Install extra packages] ************************************** 2026-02-24 18:15:09.400500 | controller | Tuesday 24 February 2026 18:15:09 +0000 (0:00:01.153) 0:00:58.418 ****** 2026-02-24 18:15:09.400513 | controller | skipping: [instance] 2026-02-24 18:15:09.400534 | controller | 2026-02-24 18:15:09.400541 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-24 18:15:09.400550 | controller | Tuesday 24 February 2026 18:15:09 +0000 (0:00:00.032) 0:00:58.451 ****** 2026-02-24 18:15:09.441533 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2026-02-24 18:15:09.441616 | controller | 2026-02-24 18:15:09.441710 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-24 18:15:09.441810 | controller | Tuesday 24 February 2026 18:15:09 +0000 (0:00:00.041) 0:00:58.492 ****** 2026-02-24 18:15:09.461357 | controller | ok: [instance] => 2026-02-24 18:15:09.461465 | controller | cifmw_ci_setup_packages: 2026-02-24 18:15:09.461575 | controller | - bash-completion 2026-02-24 18:15:09.462403 | controller | - ca-certificates 2026-02-24 18:15:09.462430 | controller | - git-core 2026-02-24 18:15:09.462438 | controller | - make 2026-02-24 18:15:09.462444 | controller | - tar 2026-02-24 18:15:09.462450 | controller | - tmux 2026-02-24 18:15:09.462456 | controller | - python3-pip 2026-02-24 18:15:09.462461 | controller | 2026-02-24 18:15:09.462467 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-24 18:15:09.462481 | controller | Tuesday 24 February 2026 18:15:09 +0000 (0:00:00.019) 0:00:58.512 ****** 2026-02-24 18:15:15.813529 | controller | changed: [instance] 2026-02-24 18:15:15.813585 | controller | 2026-02-24 18:15:15.813691 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-24 18:15:15.813787 | controller | Tuesday 24 February 2026 18:15:15 +0000 (0:00:06.351) 0:01:04.864 ****** 2026-02-24 18:15:16.385845 | controller | ok: [instance] 2026-02-24 18:15:16.580795 | controller | 2026-02-24 18:15:16.580825 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-24 18:15:16.580833 | controller | Tuesday 24 February 2026 18:15:16 +0000 (0:00:00.571) 0:01:05.436 ****** 2026-02-24 18:15:16.580843 | controller | changed: [instance] 2026-02-24 18:15:22.624185 | controller | 2026-02-24 18:15:22.624216 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-24 18:15:22.624224 | controller | Tuesday 24 February 2026 18:15:16 +0000 (0:00:00.194) 0:01:05.631 ****** 2026-02-24 18:15:22.624235 | controller | changed: [instance] 2026-02-24 18:15:22.660856 | controller | 2026-02-24 18:15:22.660895 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-24 18:15:22.660905 | controller | Tuesday 24 February 2026 18:15:22 +0000 (0:00:06.043) 0:01:11.674 ****** 2026-02-24 18:15:22.660917 | controller | ok: [instance] 2026-02-24 18:15:22.926721 | controller | 2026-02-24 18:15:22.926743 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-24 18:15:22.926751 | controller | Tuesday 24 February 2026 18:15:22 +0000 (0:00:00.036) 0:01:11.711 ****** 2026-02-24 18:15:22.926760 | controller | changed: [instance] 2026-02-24 18:15:23.190041 | controller | 2026-02-24 18:15:23.190071 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-24 18:15:23.190080 | controller | Tuesday 24 February 2026 18:15:22 +0000 (0:00:00.266) 0:01:11.977 ****** 2026-02-24 18:15:23.190090 | controller | changed: [instance] 2026-02-24 18:15:23.207374 | controller | 2026-02-24 18:15:23.207416 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-24 18:15:23.207424 | controller | Tuesday 24 February 2026 18:15:23 +0000 (0:00:00.263) 0:01:12.240 ****** 2026-02-24 18:15:23.207436 | controller | skipping: [instance] 2026-02-24 18:15:23.224939 | controller | 2026-02-24 18:15:23.224963 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-24 18:15:23.224973 | controller | Tuesday 24 February 2026 18:15:23 +0000 (0:00:00.017) 0:01:12.258 ****** 2026-02-24 18:15:23.224985 | controller | skipping: [instance] 2026-02-24 18:15:23.241434 | controller | 2026-02-24 18:15:23.241479 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-24 18:15:23.241489 | controller | Tuesday 24 February 2026 18:15:23 +0000 (0:00:00.017) 0:01:12.275 ****** 2026-02-24 18:15:23.241504 | controller | skipping: [instance] 2026-02-24 18:15:23.257122 | controller | 2026-02-24 18:15:23.257147 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-24 18:15:23.257157 | controller | Tuesday 24 February 2026 18:15:23 +0000 (0:00:00.016) 0:01:12.292 ****** 2026-02-24 18:15:23.257168 | controller | skipping: [instance] 2026-02-24 18:15:23.273187 | controller | 2026-02-24 18:15:23.273206 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-24 18:15:23.273225 | controller | Tuesday 24 February 2026 18:15:23 +0000 (0:00:00.015) 0:01:12.308 ****** 2026-02-24 18:15:23.273236 | controller | skipping: [instance] 2026-02-24 18:15:23.294486 | controller | 2026-02-24 18:15:23.294531 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-24 18:15:23.294544 | controller | Tuesday 24 February 2026 18:15:23 +0000 (0:00:00.016) 0:01:12.324 ****** 2026-02-24 18:15:23.294560 | controller | skipping: [instance] 2026-02-24 18:15:23.294601 | controller | 2026-02-24 18:15:23.294615 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-24 18:15:23.294651 | controller | Tuesday 24 February 2026 18:15:23 +0000 (0:00:00.021) 0:01:12.345 ****** 2026-02-24 18:15:24.219326 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2026-02-24 18:15:24.540397 | controller | changed: [instance] => (item=/opt/basedir/logs) 2026-02-24 18:15:24.540424 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2026-02-24 18:15:24.540431 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2026-02-24 18:15:24.540437 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2026-02-24 18:15:24.540443 | controller | 2026-02-24 18:15:24.540448 | controller | TASK [Create secret file] ****************************************************** 2026-02-24 18:15:24.540454 | controller | Tuesday 24 February 2026 18:15:24 +0000 (0:00:00.924) 0:01:13.269 ****** 2026-02-24 18:15:24.540463 | controller | changed: [instance] 2026-02-24 18:15:24.540486 | controller | 2026-02-24 18:15:24.540499 | controller | PLAY RECAP ********************************************************************* 2026-02-24 18:15:24.542522 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2026-02-24 18:15:24.592116 | controller | 2026-02-24 18:15:24.592141 | controller | Tuesday 24 February 2026 18:15:24 +0000 (0:00:00.321) 0:01:13.590 ****** 2026-02-24 18:15:24.592158 | controller | =============================================================================== 2026-02-24 18:15:24.592164 | controller | test_deps : Install selinux python libs -------------------------------- 40.91s 2026-02-24 18:15:24.592169 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.51s 2026-02-24 18:15:24.592174 | controller | ci_setup : Install needed packages -------------------------------------- 6.35s 2026-02-24 18:15:24.592178 | controller | ci_setup : Install openshift client ------------------------------------- 6.04s 2026-02-24 18:15:24.592183 | controller | test_deps : Install python yaml libs ------------------------------------ 1.15s 2026-02-24 18:15:24.592188 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.06s 2026-02-24 18:15:24.592193 | controller | ci_setup : Manage directories ------------------------------------------- 0.92s 2026-02-24 18:15:24.592198 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.85s 2026-02-24 18:15:24.592202 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.85s 2026-02-24 18:15:24.592207 | controller | Gathering Facts --------------------------------------------------------- 0.84s 2026-02-24 18:15:24.592212 | controller | repo_setup : Install repo-setup package --------------------------------- 0.69s 2026-02-24 18:15:24.592217 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.68s 2026-02-24 18:15:24.592222 | controller | ci_setup : Gather version of openshift client --------------------------- 0.57s 2026-02-24 18:15:24.592226 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.55s 2026-02-24 18:15:24.592231 | controller | repo_setup : Ensure directories are present ----------------------------- 0.52s 2026-02-24 18:15:24.592236 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.43s 2026-02-24 18:15:24.592241 | controller | Create secret file ------------------------------------------------------ 0.32s 2026-02-24 18:15:24.592245 | controller | Create custom basedir --------------------------------------------------- 0.31s 2026-02-24 18:15:24.592250 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.30s 2026-02-24 18:15:24.592259 | controller | ci_setup : Create completion file --------------------------------------- 0.27s 2026-02-24 18:15:24.592347 | controller | INFO Running crc_layout > converge 2026-02-24 18:15:25.154787 | controller | 2026-02-24 18:15:25.154866 | controller | PLAY [Converge] **************************************************************** 2026-02-24 18:15:25.154992 | controller | 2026-02-24 18:15:25.155104 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-24 18:15:25.155219 | controller | Tuesday 24 February 2026 18:15:25 +0000 (0:00:00.025) 0:00:00.025 ****** 2026-02-24 18:15:25.933475 | controller | ok: [instance] 2026-02-24 18:15:25.933620 | controller | 2026-02-24 18:15:25.933655 | controller | TASK [Load networking definition from scenario file] *************************** 2026-02-24 18:15:25.933671 | controller | Tuesday 24 February 2026 18:15:25 +0000 (0:00:00.778) 0:00:00.804 ****** 2026-02-24 18:15:25.956437 | controller | ok: [instance] 2026-02-24 18:15:25.956753 | controller | 2026-02-24 18:15:25.956789 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-24 18:15:27.789441 | controller | Tuesday 24 February 2026 18:15:25 +0000 (0:00:00.023) 0:00:00.827 ****** 2026-02-24 18:15:27.789484 | controller | changed: [instance] 2026-02-24 18:15:27.815020 | controller | 2026-02-24 18:15:27.815054 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-24 18:15:27.815062 | controller | Tuesday 24 February 2026 18:15:27 +0000 (0:00:01.832) 0:00:02.660 ****** 2026-02-24 18:15:27.815072 | controller | ok: [instance] 2026-02-24 18:15:27.836881 | controller | 2026-02-24 18:15:27.836903 | controller | TASK [reproducer : Load CI job environment] ************************************ 2026-02-24 18:15:27.836912 | controller | Tuesday 24 February 2026 18:15:27 +0000 (0:00:00.025) 0:00:02.686 ****** 2026-02-24 18:15:27.836930 | controller | skipping: [instance] 2026-02-24 18:15:27.898501 | controller | 2026-02-24 18:15:27.898540 | controller | TASK [Build final libvirt layout] ********************************************** 2026-02-24 18:15:27.898555 | controller | Tuesday 24 February 2026 18:15:27 +0000 (0:00:00.021) 0:00:02.708 ****** 2026-02-24 18:15:27.898571 | controller | 2026-02-24 18:15:27.974577 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2026-02-24 18:15:27.974628 | controller | Tuesday 24 February 2026 18:15:27 +0000 (0:00:00.061) 0:00:02.769 ****** 2026-02-24 18:15:27.974649 | controller | ok: [instance] 2026-02-24 18:15:28.037435 | controller | 2026-02-24 18:15:28.037461 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2026-02-24 18:15:28.037469 | controller | Tuesday 24 February 2026 18:15:27 +0000 (0:00:00.075) 0:00:02.845 ****** 2026-02-24 18:15:28.037479 | controller | skipping: [instance] 2026-02-24 18:15:28.062098 | controller | 2026-02-24 18:15:28.062130 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2026-02-24 18:15:28.062144 | controller | Tuesday 24 February 2026 18:15:28 +0000 (0:00:00.062) 0:00:02.908 ****** 2026-02-24 18:15:28.062160 | controller | ok: [instance] 2026-02-24 18:15:28.062468 | controller | 2026-02-24 18:15:28.062731 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2026-02-24 18:15:28.062972 | controller | Tuesday 24 February 2026 18:15:28 +0000 (0:00:00.025) 0:00:02.933 ****** 2026-02-24 18:15:28.085557 | controller | ok: [instance] => changed=false 2026-02-24 18:15:28.085835 | controller | msg: All assertions passed 2026-02-24 18:15:28.086063 | controller | 2026-02-24 18:15:28.086291 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2026-02-24 18:15:28.086454 | controller | Tuesday 24 February 2026 18:15:28 +0000 (0:00:00.023) 0:00:02.957 ****** 2026-02-24 18:15:28.128655 | controller | ok: [instance] 2026-02-24 18:15:28.128917 | controller | 2026-02-24 18:15:28.129165 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2026-02-24 18:15:28.129340 | controller | Tuesday 24 February 2026 18:15:28 +0000 (0:00:00.043) 0:00:03.000 ****** 2026-02-24 18:15:28.557426 | controller | ok: [instance] => (item=artifacts) 2026-02-24 18:15:28.634238 | controller | ok: [instance] => (item=logs) 2026-02-24 18:15:28.634261 | controller | 2026-02-24 18:15:28.634290 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2026-02-24 18:15:28.634306 | controller | Tuesday 24 February 2026 18:15:28 +0000 (0:00:00.428) 0:00:03.428 ****** 2026-02-24 18:15:28.634315 | controller | 2026-02-24 18:15:28.815443 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2026-02-24 18:15:28.815476 | controller | Tuesday 24 February 2026 18:15:28 +0000 (0:00:00.076) 0:00:03.505 ****** 2026-02-24 18:15:28.815490 | controller | ok: [instance] 2026-02-24 18:15:28.815514 | controller | 2026-02-24 18:15:28.815522 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2026-02-24 18:15:28.815532 | controller | Tuesday 24 February 2026 18:15:28 +0000 (0:00:00.181) 0:00:03.686 ****** 2026-02-24 18:15:29.063373 | controller | changed: [instance] 2026-02-24 18:15:29.063498 | controller | 2026-02-24 18:15:29.063531 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2026-02-24 18:15:29.063549 | controller | Tuesday 24 February 2026 18:15:29 +0000 (0:00:00.247) 0:00:03.934 ****** 2026-02-24 18:15:29.339750 | controller | ok: [instance] 2026-02-24 18:15:29.368409 | controller | 2026-02-24 18:15:29.368445 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2026-02-24 18:15:29.368455 | controller | Tuesday 24 February 2026 18:15:29 +0000 (0:00:00.276) 0:00:04.211 ****** 2026-02-24 18:15:29.368468 | controller | skipping: [instance] 2026-02-24 18:15:29.385798 | controller | 2026-02-24 18:15:29.385818 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2026-02-24 18:15:29.385826 | controller | Tuesday 24 February 2026 18:15:29 +0000 (0:00:00.028) 0:00:04.239 ****** 2026-02-24 18:15:29.385835 | controller | skipping: [instance] 2026-02-24 18:15:29.406037 | controller | 2026-02-24 18:15:29.406055 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2026-02-24 18:15:29.406063 | controller | Tuesday 24 February 2026 18:15:29 +0000 (0:00:00.017) 0:00:04.257 ****** 2026-02-24 18:15:29.406071 | controller | ok: [instance] 2026-02-24 18:15:29.432898 | controller | 2026-02-24 18:15:29.432916 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2026-02-24 18:15:29.432923 | controller | Tuesday 24 February 2026 18:15:29 +0000 (0:00:00.020) 0:00:04.277 ****** 2026-02-24 18:15:29.432932 | controller | skipping: [instance] 2026-02-24 18:15:41.425155 | controller | 2026-02-24 18:15:41.425192 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2026-02-24 18:15:41.425207 | controller | Tuesday 24 February 2026 18:15:29 +0000 (0:00:00.026) 0:00:04.304 ****** 2026-02-24 18:15:41.425217 | controller | changed: [instance] 2026-02-24 18:15:41.425374 | controller | 2026-02-24 18:15:41.425438 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2026-02-24 18:15:41.425451 | controller | Tuesday 24 February 2026 18:15:41 +0000 (0:00:11.992) 0:00:16.296 ****** 2026-02-24 18:15:41.631196 | controller | changed: [instance] 2026-02-24 18:15:41.631426 | controller | 2026-02-24 18:15:41.631460 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2026-02-24 18:15:42.115786 | controller | Tuesday 24 February 2026 18:15:41 +0000 (0:00:00.206) 0:00:16.502 ****** 2026-02-24 18:15:42.115822 | controller | changed: [instance] 2026-02-24 18:15:42.691066 | controller | 2026-02-24 18:15:42.691097 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2026-02-24 18:15:42.691104 | controller | Tuesday 24 February 2026 18:15:42 +0000 (0:00:00.484) 0:00:16.986 ****** 2026-02-24 18:15:42.691114 | controller | changed: [instance] 2026-02-24 18:15:42.883423 | controller | 2026-02-24 18:15:42.883456 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2026-02-24 18:15:42.883464 | controller | Tuesday 24 February 2026 18:15:42 +0000 (0:00:00.575) 0:00:17.562 ****** 2026-02-24 18:15:42.883474 | controller | ok: [instance] 2026-02-24 18:15:42.883683 | controller | 2026-02-24 18:15:42.883718 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2026-02-24 18:15:43.527429 | controller | Tuesday 24 February 2026 18:15:42 +0000 (0:00:00.192) 0:00:17.754 ****** 2026-02-24 18:15:43.527470 | controller | ok: [instance] 2026-02-24 18:15:43.527503 | controller | 2026-02-24 18:15:43.527514 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2026-02-24 18:15:43.527613 | controller | Tuesday 24 February 2026 18:15:43 +0000 (0:00:00.643) 0:00:18.398 ****** 2026-02-24 18:15:44.321507 | controller | changed: [instance] 2026-02-24 18:15:44.409496 | controller | 2026-02-24 18:15:44.409562 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2026-02-24 18:15:44.409576 | controller | Tuesday 24 February 2026 18:15:44 +0000 (0:00:00.793) 0:00:19.192 ****** 2026-02-24 18:15:44.409595 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2026-02-24 18:15:44.409638 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2026-02-24 18:15:44.409649 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2026-02-24 18:15:44.409658 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2026-02-24 18:15:44.409670 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2026-02-24 18:15:44.410183 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2026-02-24 18:15:44.410216 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2026-02-24 18:15:44.749590 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2026-02-24 18:15:44.749618 | controller | 2026-02-24 18:15:44.749627 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2026-02-24 18:15:44.749633 | controller | Tuesday 24 February 2026 18:15:44 +0000 (0:00:00.088) 0:00:19.280 ****** 2026-02-24 18:15:44.749642 | controller | ok: [instance] 2026-02-24 18:15:45.067394 | controller | 2026-02-24 18:15:45.067442 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2026-02-24 18:15:45.067451 | controller | Tuesday 24 February 2026 18:15:44 +0000 (0:00:00.340) 0:00:19.621 ****** 2026-02-24 18:15:45.067463 | controller | ok: [instance] 2026-02-24 18:15:45.067492 | controller | 2026-02-24 18:15:45.067500 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2026-02-24 18:15:45.380048 | controller | Tuesday 24 February 2026 18:15:45 +0000 (0:00:00.317) 0:00:19.938 ****** 2026-02-24 18:15:45.380076 | controller | ok: [instance] 2026-02-24 18:15:45.380111 | controller | 2026-02-24 18:15:45.380229 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2026-02-24 18:15:45.380446 | controller | Tuesday 24 February 2026 18:15:45 +0000 (0:00:00.313) 0:00:20.251 ****** 2026-02-24 18:15:45.697403 | controller | ok: [instance] 2026-02-24 18:15:45.697461 | controller | 2026-02-24 18:15:45.697625 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2026-02-24 18:15:46.013914 | controller | Tuesday 24 February 2026 18:15:45 +0000 (0:00:00.316) 0:00:20.568 ****** 2026-02-24 18:15:46.013956 | controller | ok: [instance] 2026-02-24 18:15:46.332539 | controller | 2026-02-24 18:15:46.332628 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2026-02-24 18:15:46.332638 | controller | Tuesday 24 February 2026 18:15:46 +0000 (0:00:00.316) 0:00:20.884 ****** 2026-02-24 18:15:46.332657 | controller | ok: [instance] 2026-02-24 18:15:46.646752 | controller | 2026-02-24 18:15:46.646785 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2026-02-24 18:15:46.646795 | controller | Tuesday 24 February 2026 18:15:46 +0000 (0:00:00.318) 0:00:21.203 ****** 2026-02-24 18:15:46.646807 | controller | ok: [instance] 2026-02-24 18:15:46.961765 | controller | 2026-02-24 18:15:46.961795 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2026-02-24 18:15:46.961803 | controller | Tuesday 24 February 2026 18:15:46 +0000 (0:00:00.314) 0:00:21.517 ****** 2026-02-24 18:15:46.961826 | controller | ok: [instance] 2026-02-24 18:15:47.276394 | controller | 2026-02-24 18:15:47.276429 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2026-02-24 18:15:47.276438 | controller | Tuesday 24 February 2026 18:15:46 +0000 (0:00:00.315) 0:00:21.833 ****** 2026-02-24 18:15:47.276449 | controller | ok: [instance] 2026-02-24 18:15:47.590370 | controller | 2026-02-24 18:15:47.590400 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2026-02-24 18:15:47.590408 | controller | Tuesday 24 February 2026 18:15:47 +0000 (0:00:00.314) 0:00:22.147 ****** 2026-02-24 18:15:47.590418 | controller | ok: [instance] 2026-02-24 18:15:47.895998 | controller | 2026-02-24 18:15:47.896037 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2026-02-24 18:15:47.896048 | controller | Tuesday 24 February 2026 18:15:47 +0000 (0:00:00.314) 0:00:22.461 ****** 2026-02-24 18:15:47.896061 | controller | ok: [instance] 2026-02-24 18:15:48.205454 | controller | 2026-02-24 18:15:48.205476 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2026-02-24 18:15:48.205483 | controller | Tuesday 24 February 2026 18:15:47 +0000 (0:00:00.305) 0:00:22.767 ****** 2026-02-24 18:15:48.205493 | controller | ok: [instance] 2026-02-24 18:15:48.506944 | controller | 2026-02-24 18:15:48.506964 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2026-02-24 18:15:48.506971 | controller | Tuesday 24 February 2026 18:15:48 +0000 (0:00:00.309) 0:00:23.076 ****** 2026-02-24 18:15:48.506981 | controller | ok: [instance] 2026-02-24 18:15:48.816794 | controller | 2026-02-24 18:15:48.816813 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2026-02-24 18:15:48.816821 | controller | Tuesday 24 February 2026 18:15:48 +0000 (0:00:00.301) 0:00:23.378 ****** 2026-02-24 18:15:48.816830 | controller | ok: [instance] 2026-02-24 18:15:49.119178 | controller | 2026-02-24 18:15:49.119197 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2026-02-24 18:15:49.119205 | controller | Tuesday 24 February 2026 18:15:48 +0000 (0:00:00.309) 0:00:23.688 ****** 2026-02-24 18:15:49.119214 | controller | ok: [instance] 2026-02-24 18:15:49.427917 | controller | 2026-02-24 18:15:49.427936 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2026-02-24 18:15:49.427944 | controller | Tuesday 24 February 2026 18:15:49 +0000 (0:00:00.302) 0:00:23.990 ****** 2026-02-24 18:15:49.427953 | controller | ok: [instance] 2026-02-24 18:15:49.732108 | controller | 2026-02-24 18:15:49.732141 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2026-02-24 18:15:49.732150 | controller | Tuesday 24 February 2026 18:15:49 +0000 (0:00:00.308) 0:00:24.299 ****** 2026-02-24 18:15:49.732160 | controller | ok: [instance] 2026-02-24 18:15:50.032723 | controller | 2026-02-24 18:15:50.032750 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2026-02-24 18:15:50.032758 | controller | Tuesday 24 February 2026 18:15:49 +0000 (0:00:00.304) 0:00:24.603 ****** 2026-02-24 18:15:50.032768 | controller | ok: [instance] 2026-02-24 18:15:50.340098 | controller | 2026-02-24 18:15:50.340118 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2026-02-24 18:15:50.340125 | controller | Tuesday 24 February 2026 18:15:50 +0000 (0:00:00.300) 0:00:24.904 ****** 2026-02-24 18:15:50.340135 | controller | ok: [instance] 2026-02-24 18:15:50.642290 | controller | 2026-02-24 18:15:50.642310 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2026-02-24 18:15:50.642326 | controller | Tuesday 24 February 2026 18:15:50 +0000 (0:00:00.307) 0:00:25.211 ****** 2026-02-24 18:15:50.642335 | controller | ok: [instance] 2026-02-24 18:15:50.943372 | controller | 2026-02-24 18:15:50.943402 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2026-02-24 18:15:50.943410 | controller | Tuesday 24 February 2026 18:15:50 +0000 (0:00:00.301) 0:00:25.513 ****** 2026-02-24 18:15:50.943420 | controller | ok: [instance] 2026-02-24 18:15:50.943471 | controller | 2026-02-24 18:15:50.943482 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2026-02-24 18:15:50.943570 | controller | Tuesday 24 February 2026 18:15:50 +0000 (0:00:00.301) 0:00:25.815 ****** 2026-02-24 18:15:51.250750 | controller | ok: [instance] 2026-02-24 18:15:51.556760 | controller | 2026-02-24 18:15:51.556789 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2026-02-24 18:15:51.556797 | controller | Tuesday 24 February 2026 18:15:51 +0000 (0:00:00.307) 0:00:26.122 ****** 2026-02-24 18:15:51.556807 | controller | ok: [instance] 2026-02-24 18:15:51.862055 | controller | 2026-02-24 18:15:51.862076 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2026-02-24 18:15:51.862089 | controller | Tuesday 24 February 2026 18:15:51 +0000 (0:00:00.305) 0:00:26.428 ****** 2026-02-24 18:15:51.862100 | controller | ok: [instance] 2026-02-24 18:15:51.882229 | controller | 2026-02-24 18:15:51.882246 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2026-02-24 18:15:51.882252 | controller | Tuesday 24 February 2026 18:15:51 +0000 (0:00:00.305) 0:00:26.733 ****** 2026-02-24 18:15:51.882260 | controller | skipping: [instance] 2026-02-24 18:15:52.148699 | controller | 2026-02-24 18:15:52.148718 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2026-02-24 18:15:52.148725 | controller | Tuesday 24 February 2026 18:15:51 +0000 (0:00:00.019) 0:00:26.753 ****** 2026-02-24 18:15:52.148734 | controller | ok: [instance] 2026-02-24 18:15:52.512788 | controller | 2026-02-24 18:15:52.512816 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2026-02-24 18:15:52.512824 | controller | Tuesday 24 February 2026 18:15:52 +0000 (0:00:00.266) 0:00:27.020 ****** 2026-02-24 18:15:52.512833 | controller | ok: [instance] 2026-02-24 18:15:52.856846 | controller | 2026-02-24 18:15:52.856873 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2026-02-24 18:15:52.856881 | controller | Tuesday 24 February 2026 18:15:52 +0000 (0:00:00.363) 0:00:27.383 ****** 2026-02-24 18:15:52.856891 | controller | changed: [instance] 2026-02-24 18:15:53.162911 | controller | 2026-02-24 18:15:53.162933 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2026-02-24 18:15:53.162941 | controller | Tuesday 24 February 2026 18:15:52 +0000 (0:00:00.344) 0:00:27.727 ****** 2026-02-24 18:15:53.162950 | controller | [WARNING]: Reset is not implemented for this connection 2026-02-24 18:15:53.173543 | controller | changed: [instance] 2026-02-24 18:15:53.173635 | controller | 2026-02-24 18:15:53.173654 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2026-02-24 18:15:53.173693 | controller | Tuesday 24 February 2026 18:15:53 +0000 (0:00:00.300) 0:00:28.028 ****** 2026-02-24 18:15:53.173708 | controller | 2026-02-24 18:15:53.173938 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2026-02-24 18:15:53.252935 | controller | Tuesday 24 February 2026 18:15:53 +0000 (0:00:00.016) 0:00:28.044 ****** 2026-02-24 18:15:53.252962 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2026-02-24 18:15:53.333480 | controller | 2026-02-24 18:15:53.333501 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2026-02-24 18:15:53.333508 | controller | Tuesday 24 February 2026 18:15:53 +0000 (0:00:00.079) 0:00:28.124 ****** 2026-02-24 18:15:53.333518 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2026-02-24 18:15:53.390506 | controller | 2026-02-24 18:15:53.390576 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-02-24 18:15:53.390588 | controller | Tuesday 24 February 2026 18:15:53 +0000 (0:00:00.080) 0:00:28.204 ****** 2026-02-24 18:15:53.390607 | controller | ok: [instance] => (item=compute) 2026-02-24 18:15:53.390617 | controller | ok: [instance] => (item=controller) 2026-02-24 18:15:53.390626 | controller | ok: [instance] => (item=crc) 2026-02-24 18:15:53.390633 | controller | 2026-02-24 18:15:53.390644 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-02-24 18:15:53.436404 | controller | Tuesday 24 February 2026 18:15:53 +0000 (0:00:00.056) 0:00:28.261 ****** 2026-02-24 18:15:53.436427 | controller | ok: [instance] 2026-02-24 18:15:53.479355 | controller | 2026-02-24 18:15:53.479379 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-02-24 18:15:53.479402 | controller | Tuesday 24 February 2026 18:15:53 +0000 (0:00:00.046) 0:00:28.307 ****** 2026-02-24 18:15:53.479414 | controller | ok: [instance] => changed=false 2026-02-24 18:15:53.479721 | controller | msg: All assertions passed 2026-02-24 18:15:53.479758 | controller | 2026-02-24 18:15:53.525153 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2026-02-24 18:15:53.525172 | controller | Tuesday 24 February 2026 18:15:53 +0000 (0:00:00.043) 0:00:28.350 ****** 2026-02-24 18:15:53.525183 | controller | 2026-02-24 18:15:53.525360 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2026-02-24 18:15:53.525507 | controller | Tuesday 24 February 2026 18:15:53 +0000 (0:00:00.046) 0:00:28.396 ****** 2026-02-24 18:15:53.604124 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.49', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2026-02-24 18:15:53.604281 | controller | ok: [instance] => (item={}) 2026-02-24 18:15:53.604426 | controller | 2026-02-24 18:15:53.604554 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2026-02-24 18:15:53.604676 | controller | Tuesday 24 February 2026 18:15:53 +0000 (0:00:00.078) 0:00:28.475 ****** 2026-02-24 18:15:53.623428 | controller | skipping: [instance] 2026-02-24 18:15:53.623488 | controller | 2026-02-24 18:15:53.623727 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2026-02-24 18:15:53.623838 | controller | Tuesday 24 February 2026 18:15:53 +0000 (0:00:00.019) 0:00:28.495 ****** 2026-02-24 18:15:53.845424 | controller | ok: [instance] 2026-02-24 18:15:53.845491 | controller | 2026-02-24 18:15:53.845501 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2026-02-24 18:15:53.845511 | controller | Tuesday 24 February 2026 18:15:53 +0000 (0:00:00.221) 0:00:28.716 ****** 2026-02-24 18:15:54.180042 | controller | changed: [instance] 2026-02-24 18:15:54.904299 | controller | 2026-02-24 18:15:54.904357 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2026-02-24 18:15:54.904367 | controller | Tuesday 24 February 2026 18:15:54 +0000 (0:00:00.334) 0:00:29.051 ****** 2026-02-24 18:15:54.904380 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2026-02-24 18:15:54.931261 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2026-02-24 18:15:54.931308 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2026-02-24 18:15:54.931330 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2026-02-24 18:15:54.931338 | controller | 2026-02-24 18:15:54.931346 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2026-02-24 18:15:54.931353 | controller | Tuesday 24 February 2026 18:15:54 +0000 (0:00:00.723) 0:00:29.775 ****** 2026-02-24 18:15:54.931365 | controller | skipping: [instance] 2026-02-24 18:15:55.296383 | controller | 2026-02-24 18:15:55.296426 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2026-02-24 18:15:55.296437 | controller | Tuesday 24 February 2026 18:15:54 +0000 (0:00:00.027) 0:00:29.802 ****** 2026-02-24 18:15:55.296451 | controller | changed: [instance] 2026-02-24 18:15:55.296482 | controller | 2026-02-24 18:15:55.296494 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2026-02-24 18:15:55.296522 | controller | Tuesday 24 February 2026 18:15:55 +0000 (0:00:00.356) 0:00:30.159 ****** 2026-02-24 18:15:55.296806 | controller | 2026-02-24 18:15:55.720488 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 18:15:55.720532 | controller | Tuesday 24 February 2026 18:15:55 +0000 (0:00:00.008) 0:00:30.167 ****** 2026-02-24 18:15:55.720552 | controller | changed: [instance] 2026-02-24 18:15:55.720580 | controller | 2026-02-24 18:15:55.720589 | controller | TASK [Ensure no default networks exists] *************************************** 2026-02-24 18:15:55.720717 | controller | Tuesday 24 February 2026 18:15:55 +0000 (0:00:00.424) 0:00:30.591 ****** 2026-02-24 18:15:55.797091 | controller | 2026-02-24 18:15:56.943191 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2026-02-24 18:15:56.943243 | controller | Tuesday 24 February 2026 18:15:55 +0000 (0:00:00.076) 0:00:30.668 ****** 2026-02-24 18:15:56.943257 | controller | ok: [instance] 2026-02-24 18:15:57.174205 | controller | 2026-02-24 18:15:57.174232 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2026-02-24 18:15:57.174240 | controller | Tuesday 24 February 2026 18:15:56 +0000 (0:00:01.145) 0:00:31.814 ****** 2026-02-24 18:15:57.174250 | controller | ok: [instance] 2026-02-24 18:15:57.665388 | controller | 2026-02-24 18:15:57.665435 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2026-02-24 18:15:57.665446 | controller | Tuesday 24 February 2026 18:15:57 +0000 (0:00:00.231) 0:00:32.045 ****** 2026-02-24 18:15:57.665460 | controller | ok: [instance] 2026-02-24 18:15:57.891355 | controller | 2026-02-24 18:15:57.891388 | controller | TASK [libvirt_manager : Removing default] ************************************** 2026-02-24 18:15:57.891397 | controller | Tuesday 24 February 2026 18:15:57 +0000 (0:00:00.491) 0:00:32.536 ****** 2026-02-24 18:15:57.891410 | controller | ok: [instance] 2026-02-24 18:15:57.891681 | controller | 2026-02-24 18:15:59.061401 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2026-02-24 18:15:59.061448 | controller | Tuesday 24 February 2026 18:15:57 +0000 (0:00:00.226) 0:00:32.763 ****** 2026-02-24 18:15:59.061463 | controller | ok: [instance] 2026-02-24 18:15:59.364401 | controller | 2026-02-24 18:15:59.364429 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2026-02-24 18:15:59.364438 | controller | Tuesday 24 February 2026 18:15:59 +0000 (0:00:01.169) 0:00:33.932 ****** 2026-02-24 18:15:59.364450 | controller | ok: [instance] 2026-02-24 18:15:59.364481 | controller | 2026-02-24 18:15:59.364491 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2026-02-24 18:15:59.364517 | controller | Tuesday 24 February 2026 18:15:59 +0000 (0:00:00.303) 0:00:34.235 ****** 2026-02-24 18:15:59.667962 | controller | changed: [instance] 2026-02-24 18:15:59.668022 | controller | 2026-02-24 18:15:59.668299 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2026-02-24 18:15:59.975406 | controller | Tuesday 24 February 2026 18:15:59 +0000 (0:00:00.303) 0:00:34.539 ****** 2026-02-24 18:15:59.975442 | controller | changed: [instance] 2026-02-24 18:15:59.975476 | controller | 2026-02-24 18:15:59.975689 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2026-02-24 18:16:00.525287 | controller | Tuesday 24 February 2026 18:15:59 +0000 (0:00:00.307) 0:00:34.846 ****** 2026-02-24 18:16:00.525340 | controller | changed: [instance] => (item=arptables) 2026-02-24 18:16:00.833818 | controller | changed: [instance] => (item=iptables) 2026-02-24 18:16:00.833855 | controller | changed: [instance] => (item=ip6tables) 2026-02-24 18:16:00.833863 | controller | 2026-02-24 18:16:00.833869 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2026-02-24 18:16:00.833875 | controller | Tuesday 24 February 2026 18:16:00 +0000 (0:00:00.549) 0:00:35.396 ****** 2026-02-24 18:16:00.833886 | controller | ok: [instance] 2026-02-24 18:16:00.942496 | controller | 2026-02-24 18:16:00.942536 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2026-02-24 18:16:00.942546 | controller | Tuesday 24 February 2026 18:16:00 +0000 (0:00:00.308) 0:00:35.704 ****** 2026-02-24 18:16:00.942558 | controller | ok: [instance] 2026-02-24 18:16:00.983181 | controller | 2026-02-24 18:16:00.983227 | controller | TASK [Ensure the required network configurations are applied] ****************** 2026-02-24 18:16:00.983239 | controller | Tuesday 24 February 2026 18:16:00 +0000 (0:00:00.108) 0:00:35.813 ****** 2026-02-24 18:16:00.983256 | controller | 2026-02-24 18:16:01.005450 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2026-02-24 18:16:01.005510 | controller | Tuesday 24 February 2026 18:16:00 +0000 (0:00:00.040) 0:00:35.854 ****** 2026-02-24 18:16:01.005532 | controller | skipping: [instance] 2026-02-24 18:16:01.005579 | controller | 2026-02-24 18:16:01.005594 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2026-02-24 18:16:01.028405 | controller | Tuesday 24 February 2026 18:16:01 +0000 (0:00:00.022) 0:00:35.877 ****** 2026-02-24 18:16:01.028444 | controller | skipping: [instance] 2026-02-24 18:16:01.028457 | controller | 2026-02-24 18:16:01.028468 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 18:16:01.028481 | controller | Tuesday 24 February 2026 18:16:01 +0000 (0:00:00.022) 0:00:35.899 ****** 2026-02-24 18:16:01.050826 | controller | skipping: [instance] 2026-02-24 18:16:01.078221 | controller | 2026-02-24 18:16:01.078245 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2026-02-24 18:16:01.078253 | controller | Tuesday 24 February 2026 18:16:01 +0000 (0:00:00.022) 0:00:35.922 ****** 2026-02-24 18:16:01.078262 | controller | skipping: [instance] 2026-02-24 18:16:01.116324 | controller | 2026-02-24 18:16:01.116354 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2026-02-24 18:16:01.116365 | controller | Tuesday 24 February 2026 18:16:01 +0000 (0:00:00.027) 0:00:35.949 ****** 2026-02-24 18:16:01.116378 | controller | ok: [instance] 2026-02-24 18:16:01.116533 | controller | 2026-02-24 18:16:01.116663 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2026-02-24 18:16:01.116774 | controller | Tuesday 24 February 2026 18:16:01 +0000 (0:00:00.038) 0:00:35.987 ****** 2026-02-24 18:16:01.148628 | controller | skipping: [instance] 2026-02-24 18:16:01.148776 | controller | 2026-02-24 18:16:01.148920 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2026-02-24 18:16:01.149055 | controller | Tuesday 24 February 2026 18:16:01 +0000 (0:00:00.032) 0:00:36.020 ****** 2026-02-24 18:16:01.170591 | controller | skipping: [instance] 2026-02-24 18:16:01.170738 | controller | 2026-02-24 18:16:01.170875 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2026-02-24 18:16:01.171005 | controller | Tuesday 24 February 2026 18:16:01 +0000 (0:00:00.021) 0:00:36.042 ****** 2026-02-24 18:16:01.226339 | controller | ok: [instance] 2026-02-24 18:16:01.226606 | controller | 2026-02-24 18:16:01.226785 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2026-02-24 18:16:01.226872 | controller | Tuesday 24 February 2026 18:16:01 +0000 (0:00:00.055) 0:00:36.097 ****** 2026-02-24 18:16:01.249410 | controller | skipping: [instance] 2026-02-24 18:16:01.249654 | controller | 2026-02-24 18:16:01.249837 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2026-02-24 18:16:01.249908 | controller | Tuesday 24 February 2026 18:16:01 +0000 (0:00:00.023) 0:00:36.120 ****** 2026-02-24 18:16:01.298458 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2026-02-24 18:16:01.298701 | controller | 2026-02-24 18:16:01.298907 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-24 18:16:01.299013 | controller | Tuesday 24 February 2026 18:16:01 +0000 (0:00:00.048) 0:00:36.169 ****** 2026-02-24 18:16:01.624849 | controller | ok: [instance -> localhost] 2026-02-24 18:16:08.782968 | controller | 2026-02-24 18:16:08.782999 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2026-02-24 18:16:08.783007 | controller | Tuesday 24 February 2026 18:16:01 +0000 (0:00:00.326) 0:00:36.496 ****** 2026-02-24 18:16:08.783017 | controller | changed: [instance -> localhost] 2026-02-24 18:16:08.973045 | controller | 2026-02-24 18:16:08.973067 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-24 18:16:08.973075 | controller | Tuesday 24 February 2026 18:16:08 +0000 (0:00:07.157) 0:00:43.654 ****** 2026-02-24 18:16:08.973085 | controller | changed: [instance] 2026-02-24 18:16:09.306962 | controller | 2026-02-24 18:16:09.306982 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2026-02-24 18:16:09.306990 | controller | Tuesday 24 February 2026 18:16:08 +0000 (0:00:00.190) 0:00:43.844 ****** 2026-02-24 18:16:09.307006 | controller | changed: [instance] 2026-02-24 18:16:10.901254 | controller | 2026-02-24 18:16:10.901306 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2026-02-24 18:16:10.901315 | controller | Tuesday 24 February 2026 18:16:09 +0000 (0:00:00.333) 0:00:44.178 ****** 2026-02-24 18:16:10.901324 | controller | changed: [instance -> localhost] 2026-02-24 18:16:11.241700 | controller | 2026-02-24 18:16:11.241719 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2026-02-24 18:16:11.241726 | controller | Tuesday 24 February 2026 18:16:10 +0000 (0:00:01.594) 0:00:45.772 ****** 2026-02-24 18:16:11.241735 | controller | changed: [instance] 2026-02-24 18:16:11.271350 | controller | 2026-02-24 18:16:11.271374 | controller | TASK [reproducer : Select right domain] **************************************** 2026-02-24 18:16:11.271381 | controller | Tuesday 24 February 2026 18:16:11 +0000 (0:00:00.340) 0:00:46.113 ****** 2026-02-24 18:16:11.271390 | controller | ok: [instance] 2026-02-24 18:16:11.389936 | controller | 2026-02-24 18:16:11.389955 | controller | TASK [Create the virtual networks] ********************************************* 2026-02-24 18:16:11.389962 | controller | Tuesday 24 February 2026 18:16:11 +0000 (0:00:00.029) 0:00:46.142 ****** 2026-02-24 18:16:11.389971 | controller | 2026-02-24 18:16:11.409022 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2026-02-24 18:16:11.409039 | controller | Tuesday 24 February 2026 18:16:11 +0000 (0:00:00.118) 0:00:46.261 ****** 2026-02-24 18:16:11.409050 | controller | ok: [instance] 2026-02-24 18:16:11.589382 | controller | 2026-02-24 18:16:11.589418 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2026-02-24 18:16:11.589426 | controller | Tuesday 24 February 2026 18:16:11 +0000 (0:00:00.018) 0:00:46.280 ****** 2026-02-24 18:16:11.589437 | controller | ok: [instance] 2026-02-24 18:16:11.643703 | controller | 2026-02-24 18:16:11.643722 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2026-02-24 18:16:11.643729 | controller | Tuesday 24 February 2026 18:16:11 +0000 (0:00:00.180) 0:00:46.460 ****** 2026-02-24 18:16:11.643738 | controller | skipping: [instance] 2026-02-24 18:16:11.671347 | controller | 2026-02-24 18:16:11.671378 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2026-02-24 18:16:11.671386 | controller | Tuesday 24 February 2026 18:16:11 +0000 (0:00:00.054) 0:00:46.515 ****** 2026-02-24 18:16:11.671395 | controller | skipping: [instance] 2026-02-24 18:16:11.671508 | controller | 2026-02-24 18:16:11.671525 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2026-02-24 18:16:11.671535 | controller | Tuesday 24 February 2026 18:16:11 +0000 (0:00:00.027) 0:00:46.542 ****** 2026-02-24 18:16:11.722111 | controller | ok: [instance] 2026-02-24 18:16:11.842892 | controller | 2026-02-24 18:16:11.842926 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2026-02-24 18:16:11.842939 | controller | Tuesday 24 February 2026 18:16:11 +0000 (0:00:00.050) 0:00:46.593 ****** 2026-02-24 18:16:11.842954 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 18:16:11.877056 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 18:16:11.877086 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 18:16:11.877098 | controller | 2026-02-24 18:16:11.877107 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2026-02-24 18:16:11.877116 | controller | Tuesday 24 February 2026 18:16:11 +0000 (0:00:00.120) 0:00:46.713 ****** 2026-02-24 18:16:11.877130 | controller | skipping: [instance] 2026-02-24 18:16:11.877408 | controller | 2026-02-24 18:16:11.877650 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2026-02-24 18:16:11.877869 | controller | Tuesday 24 February 2026 18:16:11 +0000 (0:00:00.035) 0:00:46.748 ****** 2026-02-24 18:16:12.207216 | controller | changed: [instance] 2026-02-24 18:16:12.298449 | controller | 2026-02-24 18:16:12.298515 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2026-02-24 18:16:12.298528 | controller | Tuesday 24 February 2026 18:16:12 +0000 (0:00:00.329) 0:00:47.078 ****** 2026-02-24 18:16:12.298556 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes) 2026-02-24 18:16:12.298602 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers) 2026-02-24 18:16:12.298616 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps) 2026-02-24 18:16:12.298652 | controller | 2026-02-24 18:16:12.298952 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 18:16:12.352146 | controller | Tuesday 24 February 2026 18:16:12 +0000 (0:00:00.091) 0:00:47.169 ****** 2026-02-24 18:16:12.352173 | controller | changed: [instance] 2026-02-24 18:16:12.632304 | controller | 2026-02-24 18:16:12.632325 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 18:16:12.632333 | controller | Tuesday 24 February 2026 18:16:12 +0000 (0:00:00.053) 0:00:47.223 ****** 2026-02-24 18:16:12.632342 | controller | changed: [instance] 2026-02-24 18:16:12.840252 | controller | 2026-02-24 18:16:12.840368 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 18:16:12.840381 | controller | Tuesday 24 February 2026 18:16:12 +0000 (0:00:00.279) 0:00:47.503 ****** 2026-02-24 18:16:12.840390 | controller | changed: [instance] 2026-02-24 18:16:12.897402 | controller | 2026-02-24 18:16:12.897443 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 18:16:12.897454 | controller | Tuesday 24 February 2026 18:16:12 +0000 (0:00:00.208) 0:00:47.711 ****** 2026-02-24 18:16:12.897468 | controller | changed: [instance] 2026-02-24 18:16:12.897729 | controller | 2026-02-24 18:16:12.897760 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 18:16:13.097420 | controller | Tuesday 24 February 2026 18:16:12 +0000 (0:00:00.056) 0:00:47.768 ****** 2026-02-24 18:16:13.097467 | controller | changed: [instance] 2026-02-24 18:16:13.097507 | controller | 2026-02-24 18:16:13.097732 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 18:16:13.305398 | controller | Tuesday 24 February 2026 18:16:13 +0000 (0:00:00.200) 0:00:47.968 ****** 2026-02-24 18:16:13.305442 | controller | changed: [instance] 2026-02-24 18:16:13.358509 | controller | 2026-02-24 18:16:13.358544 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 18:16:13.358554 | controller | Tuesday 24 February 2026 18:16:13 +0000 (0:00:00.207) 0:00:48.176 ****** 2026-02-24 18:16:13.358566 | controller | changed: [instance] 2026-02-24 18:16:13.358612 | controller | 2026-02-24 18:16:13.358621 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 18:16:13.358631 | controller | Tuesday 24 February 2026 18:16:13 +0000 (0:00:00.052) 0:00:48.229 ****** 2026-02-24 18:16:13.552756 | controller | changed: [instance] 2026-02-24 18:16:13.760559 | controller | 2026-02-24 18:16:13.760578 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 18:16:13.760585 | controller | Tuesday 24 February 2026 18:16:13 +0000 (0:00:00.194) 0:00:48.424 ****** 2026-02-24 18:16:13.760594 | controller | changed: [instance] 2026-02-24 18:16:13.954771 | controller | 2026-02-24 18:16:13.954790 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ******************** 2026-02-24 18:16:13.954798 | controller | Tuesday 24 February 2026 18:16:13 +0000 (0:00:00.207) 0:00:48.631 ****** 2026-02-24 18:16:13.954807 | controller | ok: [instance] 2026-02-24 18:16:14.446386 | controller | 2026-02-24 18:16:14.446417 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ****************** 2026-02-24 18:16:14.446425 | controller | Tuesday 24 February 2026 18:16:13 +0000 (0:00:00.194) 0:00:48.825 ****** 2026-02-24 18:16:14.446435 | controller | changed: [instance] 2026-02-24 18:16:14.446459 | controller | 2026-02-24 18:16:14.446467 | controller | TASK [libvirt_manager : Remove ini file after conversion] ********************** 2026-02-24 18:16:14.446596 | controller | Tuesday 24 February 2026 18:16:14 +0000 (0:00:00.491) 0:00:49.317 ****** 2026-02-24 18:16:14.624387 | controller | changed: [instance] 2026-02-24 18:16:14.624651 | controller | 2026-02-24 18:16:14.624682 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-24 18:16:14.648340 | controller | Tuesday 24 February 2026 18:16:14 +0000 (0:00:00.178) 0:00:49.495 ****** 2026-02-24 18:16:14.648367 | controller | skipping: [instance] 2026-02-24 18:16:14.648395 | controller | 2026-02-24 18:16:14.648405 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 18:16:14.648554 | controller | Tuesday 24 February 2026 18:16:14 +0000 (0:00:00.023) 0:00:49.519 ****** 2026-02-24 18:16:14.672389 | controller | skipping: [instance] 2026-02-24 18:16:14.672585 | controller | 2026-02-24 18:16:14.672607 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-24 18:16:14.696644 | controller | Tuesday 24 February 2026 18:16:14 +0000 (0:00:00.024) 0:00:49.544 ****** 2026-02-24 18:16:14.696664 | controller | skipping: [instance] 2026-02-24 18:16:14.721377 | controller | 2026-02-24 18:16:14.721427 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-24 18:16:14.721441 | controller | Tuesday 24 February 2026 18:16:14 +0000 (0:00:00.023) 0:00:49.568 ****** 2026-02-24 18:16:14.721458 | controller | skipping: [instance] 2026-02-24 18:16:14.740158 | controller | 2026-02-24 18:16:14.740201 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-24 18:16:14.740215 | controller | Tuesday 24 February 2026 18:16:14 +0000 (0:00:00.024) 0:00:49.592 ****** 2026-02-24 18:16:14.740231 | controller | ok: [instance] 2026-02-24 18:16:14.817145 | controller | 2026-02-24 18:16:14.817179 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-24 18:16:14.817193 | controller | Tuesday 24 February 2026 18:16:14 +0000 (0:00:00.018) 0:00:49.611 ****** 2026-02-24 18:16:14.817211 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-24 18:16:14.833992 | controller | 2026-02-24 18:16:14.834012 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-24 18:16:14.834020 | controller | Tuesday 24 February 2026 18:16:14 +0000 (0:00:00.076) 0:00:49.688 ****** 2026-02-24 18:16:14.834030 | controller | skipping: [instance] 2026-02-24 18:16:14.834185 | controller | 2026-02-24 18:16:14.834386 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-24 18:16:14.834524 | controller | Tuesday 24 February 2026 18:16:14 +0000 (0:00:00.017) 0:00:49.705 ****** 2026-02-24 18:16:15.029688 | controller | changed: [instance] 2026-02-24 18:16:15.417396 | controller | 2026-02-24 18:16:15.417441 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-24 18:16:15.417452 | controller | Tuesday 24 February 2026 18:16:15 +0000 (0:00:00.195) 0:00:49.901 ****** 2026-02-24 18:16:15.417464 | controller | changed: [instance] 2026-02-24 18:16:15.417488 | controller | 2026-02-24 18:16:15.417564 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-24 18:16:15.417671 | controller | Tuesday 24 February 2026 18:16:15 +0000 (0:00:00.387) 0:00:50.288 ****** 2026-02-24 18:16:15.478008 | controller | ok: [instance] 2026-02-24 18:16:15.507756 | controller | 2026-02-24 18:16:15.507772 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-24 18:16:15.507780 | controller | Tuesday 24 February 2026 18:16:15 +0000 (0:00:00.060) 0:00:50.349 ****** 2026-02-24 18:16:15.507788 | controller | ok: [instance] 2026-02-24 18:16:15.881647 | controller | 2026-02-24 18:16:15.881666 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-24 18:16:15.881674 | controller | Tuesday 24 February 2026 18:16:15 +0000 (0:00:00.030) 0:00:50.379 ****** 2026-02-24 18:16:15.881683 | controller | changed: [instance] 2026-02-24 18:16:15.966119 | controller | 2026-02-24 18:16:15.966138 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2026-02-24 18:16:15.966146 | controller | Tuesday 24 February 2026 18:16:15 +0000 (0:00:00.373) 0:00:50.753 ****** 2026-02-24 18:16:15.966155 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2026-02-24 18:16:16.015822 | controller | 2026-02-24 18:16:16.015839 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2026-02-24 18:16:16.015846 | controller | Tuesday 24 February 2026 18:16:15 +0000 (0:00:00.084) 0:00:50.837 ****** 2026-02-24 18:16:16.015854 | controller | ok: [instance] => (item=public) 2026-02-24 18:16:16.444918 | controller | ok: [instance] => (item=osp_trunk) 2026-02-24 18:16:16.444938 | controller | 2026-02-24 18:16:16.444946 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2026-02-24 18:16:16.444952 | controller | Tuesday 24 February 2026 18:16:16 +0000 (0:00:00.049) 0:00:50.887 ****** 2026-02-24 18:16:16.444960 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 18:16:16.995379 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:16:16.995409 | controller | 2026-02-24 18:16:16.995417 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2026-02-24 18:16:16.995423 | controller | Tuesday 24 February 2026 18:16:16 +0000 (0:00:00.429) 0:00:51.316 ****** 2026-02-24 18:16:16.995433 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:16:17.417403 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:16:17.417448 | controller | 2026-02-24 18:16:17.417459 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2026-02-24 18:16:17.417467 | controller | Tuesday 24 February 2026 18:16:16 +0000 (0:00:00.550) 0:00:51.866 ****** 2026-02-24 18:16:17.417480 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:16:17.837427 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:16:17.837470 | controller | 2026-02-24 18:16:17.837481 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2026-02-24 18:16:17.837489 | controller | Tuesday 24 February 2026 18:16:17 +0000 (0:00:00.422) 0:00:52.288 ****** 2026-02-24 18:16:17.837511 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 18:16:17.837551 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:16:17.837563 | controller | 2026-02-24 18:16:17.837752 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2026-02-24 18:16:17.897080 | controller | Tuesday 24 February 2026 18:16:17 +0000 (0:00:00.420) 0:00:52.708 ****** 2026-02-24 18:16:17.897122 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2026-02-24 18:16:18.080084 | controller | 2026-02-24 18:16:18.080113 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2026-02-24 18:16:18.080121 | controller | Tuesday 24 February 2026 18:16:17 +0000 (0:00:00.059) 0:00:52.768 ****** 2026-02-24 18:16:18.080131 | controller | ok: [instance] 2026-02-24 18:16:18.448025 | controller | 2026-02-24 18:16:18.448053 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2026-02-24 18:16:18.448061 | controller | Tuesday 24 February 2026 18:16:18 +0000 (0:00:00.183) 0:00:52.951 ****** 2026-02-24 18:16:18.448071 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:16:18.514842 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:16:18.514873 | controller | 2026-02-24 18:16:18.514882 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2026-02-24 18:16:18.514890 | controller | Tuesday 24 February 2026 18:16:18 +0000 (0:00:00.367) 0:00:53.319 ****** 2026-02-24 18:16:18.514902 | controller | 2026-02-24 18:16:18.548817 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-24 18:16:18.548841 | controller | Tuesday 24 February 2026 18:16:18 +0000 (0:00:00.066) 0:00:53.386 ****** 2026-02-24 18:16:18.548852 | controller | skipping: [instance] 2026-02-24 18:16:19.755210 | controller | 2026-02-24 18:16:19.755242 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2026-02-24 18:16:19.755250 | controller | Tuesday 24 February 2026 18:16:18 +0000 (0:00:00.034) 0:00:53.420 ****** 2026-02-24 18:16:19.755260 | controller | ok: [instance] 2026-02-24 18:16:19.946837 | controller | 2026-02-24 18:16:19.946872 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-24 18:16:19.946880 | controller | Tuesday 24 February 2026 18:16:19 +0000 (0:00:01.206) 0:00:54.626 ****** 2026-02-24 18:16:19.946891 | controller | ok: [instance] 2026-02-24 18:16:20.303058 | controller | 2026-02-24 18:16:20.303087 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2026-02-24 18:16:20.303096 | controller | Tuesday 24 February 2026 18:16:19 +0000 (0:00:00.191) 0:00:54.818 ****** 2026-02-24 18:16:20.303105 | controller | changed: [instance] 2026-02-24 18:16:21.948401 | controller | 2026-02-24 18:16:21.948432 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2026-02-24 18:16:21.948440 | controller | Tuesday 24 February 2026 18:16:20 +0000 (0:00:00.356) 0:00:55.174 ****** 2026-02-24 18:16:21.948450 | controller | changed: [instance] 2026-02-24 18:16:22.291388 | controller | 2026-02-24 18:16:22.291429 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2026-02-24 18:16:22.291440 | controller | Tuesday 24 February 2026 18:16:21 +0000 (0:00:01.645) 0:00:56.819 ****** 2026-02-24 18:16:22.291453 | controller | changed: [instance] 2026-02-24 18:16:22.291485 | controller | 2026-02-24 18:16:22.291497 | controller | TASK [Create extra network configuration] ************************************** 2026-02-24 18:16:22.291606 | controller | Tuesday 24 February 2026 18:16:22 +0000 (0:00:00.343) 0:00:57.162 ****** 2026-02-24 18:16:22.324831 | controller | skipping: [instance] 2026-02-24 18:16:22.352944 | controller | 2026-02-24 18:16:22.352963 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2026-02-24 18:16:22.352970 | controller | Tuesday 24 February 2026 18:16:22 +0000 (0:00:00.033) 0:00:57.196 ****** 2026-02-24 18:16:22.352979 | controller | skipping: [instance] 2026-02-24 18:16:22.804196 | controller | 2026-02-24 18:16:22.804229 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2026-02-24 18:16:22.804237 | controller | Tuesday 24 February 2026 18:16:22 +0000 (0:00:00.028) 0:00:57.224 ****** 2026-02-24 18:16:22.804247 | controller | ok: [instance] 2026-02-24 18:16:22.942994 | controller | 2026-02-24 18:16:22.943022 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2026-02-24 18:16:22.943029 | controller | Tuesday 24 February 2026 18:16:22 +0000 (0:00:00.451) 0:00:57.675 ****** 2026-02-24 18:16:22.943039 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:16:24.136802 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:16:24.136834 | controller | 2026-02-24 18:16:24.136842 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2026-02-24 18:16:24.136848 | controller | Tuesday 24 February 2026 18:16:22 +0000 (0:00:00.138) 0:00:57.814 ****** 2026-02-24 18:16:24.136858 | controller | ok: [instance] 2026-02-24 18:16:27.802501 | controller | 2026-02-24 18:16:27.802557 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2026-02-24 18:16:27.802582 | controller | Tuesday 24 February 2026 18:16:24 +0000 (0:00:01.193) 0:00:59.007 ****** 2026-02-24 18:16:27.802602 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2026-02-24 18:16:27.802645 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2026-02-24 18:16:27.802656 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2026-02-24 18:16:27.802669 | controller | 2026-02-24 18:16:27.802706 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2026-02-24 18:16:27.802879 | controller | Tuesday 24 February 2026 18:16:27 +0000 (0:00:03.665) 0:01:02.673 ****** 2026-02-24 18:16:28.033712 | controller | changed: [instance] 2026-02-24 18:16:28.405498 | controller | 2026-02-24 18:16:28.405559 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2026-02-24 18:16:28.405574 | controller | Tuesday 24 February 2026 18:16:28 +0000 (0:00:00.231) 0:01:02.904 ****** 2026-02-24 18:16:28.405592 | controller | changed: [instance] 2026-02-24 18:16:28.405621 | controller | 2026-02-24 18:16:28.405632 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2026-02-24 18:16:28.405644 | controller | Tuesday 24 February 2026 18:16:28 +0000 (0:00:00.371) 0:01:03.276 ****** 2026-02-24 18:16:28.802420 | controller | changed: [instance] 2026-02-24 18:16:28.802487 | controller | 2026-02-24 18:16:28.802502 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2026-02-24 18:16:28.802611 | controller | Tuesday 24 February 2026 18:16:28 +0000 (0:00:00.396) 0:01:03.673 ****** 2026-02-24 18:16:28.835446 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2026-02-24 18:16:28.835514 | controller | 2026-02-24 18:16:28.835850 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2026-02-24 18:16:29.238249 | controller | Tuesday 24 February 2026 18:16:28 +0000 (0:00:00.032) 0:01:03.706 ****** 2026-02-24 18:16:29.238330 | controller | changed: [instance] 2026-02-24 18:16:29.259537 | controller | 2026-02-24 18:16:29.259615 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2026-02-24 18:16:29.259631 | controller | Tuesday 24 February 2026 18:16:29 +0000 (0:00:00.402) 0:01:04.109 ****** 2026-02-24 18:16:29.259653 | controller | skipping: [instance] 2026-02-24 18:16:29.294478 | controller | 2026-02-24 18:16:29.294514 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2026-02-24 18:16:29.294527 | controller | Tuesday 24 February 2026 18:16:29 +0000 (0:00:00.021) 0:01:04.130 ****** 2026-02-24 18:16:29.294544 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2026-02-24 18:16:29.678023 | controller | 2026-02-24 18:16:29.678069 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2026-02-24 18:16:29.678078 | controller | Tuesday 24 February 2026 18:16:29 +0000 (0:00:00.034) 0:01:04.165 ****** 2026-02-24 18:16:29.678093 | controller | changed: [instance] 2026-02-24 18:16:29.678247 | controller | 2026-02-24 18:16:29.678514 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2026-02-24 18:16:29.678616 | controller | Tuesday 24 February 2026 18:16:29 +0000 (0:00:00.384) 0:01:04.549 ****** 2026-02-24 18:16:29.699250 | controller | skipping: [instance] 2026-02-24 18:16:29.699553 | controller | 2026-02-24 18:16:29.699725 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2026-02-24 18:16:29.699997 | controller | Tuesday 24 February 2026 18:16:29 +0000 (0:00:00.021) 0:01:04.570 ****** 2026-02-24 18:16:29.916793 | controller | ok: [instance] => (item=127.0.0.2) 2026-02-24 18:16:30.614259 | controller | 2026-02-24 18:16:30.614324 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2026-02-24 18:16:30.614333 | controller | Tuesday 24 February 2026 18:16:29 +0000 (0:00:00.217) 0:01:04.788 ****** 2026-02-24 18:16:30.614345 | controller | changed: [instance] 2026-02-24 18:16:30.640037 | controller | 2026-02-24 18:16:30.640071 | controller | TASK [dnsmasq : Stop service] ************************************************** 2026-02-24 18:16:30.640085 | controller | Tuesday 24 February 2026 18:16:30 +0000 (0:00:00.696) 0:01:05.484 ****** 2026-02-24 18:16:30.640101 | controller | skipping: [instance] 2026-02-24 18:16:30.666053 | controller | 2026-02-24 18:16:30.666086 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2026-02-24 18:16:30.666099 | controller | Tuesday 24 February 2026 18:16:30 +0000 (0:00:00.025) 0:01:05.511 ****** 2026-02-24 18:16:30.666115 | controller | skipping: [instance] 2026-02-24 18:16:30.697863 | controller | 2026-02-24 18:16:30.697881 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2026-02-24 18:16:30.697888 | controller | Tuesday 24 February 2026 18:16:30 +0000 (0:00:00.025) 0:01:05.536 ****** 2026-02-24 18:16:30.697896 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-24 18:16:30.814200 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2026-02-24 18:16:30.814234 | controller | skipping: [instance] 2026-02-24 18:16:30.814247 | controller | 2026-02-24 18:16:30.814258 | controller | TASK [Create dnsmasq networks] ************************************************* 2026-02-24 18:16:30.814312 | controller | Tuesday 24 February 2026 18:16:30 +0000 (0:00:00.032) 0:01:05.568 ****** 2026-02-24 18:16:30.814348 | controller | 2026-02-24 18:16:30.845651 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-24 18:16:30.845685 | controller | Tuesday 24 February 2026 18:16:30 +0000 (0:00:00.116) 0:01:05.685 ****** 2026-02-24 18:16:30.845703 | controller | ok: [instance] => changed=false 2026-02-24 18:16:30.845846 | controller | msg: All assertions passed 2026-02-24 18:16:30.845963 | controller | 2026-02-24 18:16:30.846088 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-24 18:16:30.846217 | controller | Tuesday 24 February 2026 18:16:30 +0000 (0:00:00.031) 0:01:05.717 ****** 2026-02-24 18:16:30.885596 | controller | ok: [instance] => changed=false 2026-02-24 18:16:30.885836 | controller | msg: All assertions passed 2026-02-24 18:16:30.885954 | controller | 2026-02-24 18:16:30.886076 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-24 18:16:30.886193 | controller | Tuesday 24 February 2026 18:16:30 +0000 (0:00:00.039) 0:01:05.757 ****** 2026-02-24 18:16:31.341956 | controller | changed: [instance] 2026-02-24 18:16:31.369442 | controller | 2026-02-24 18:16:31.369486 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-24 18:16:31.369496 | controller | Tuesday 24 February 2026 18:16:31 +0000 (0:00:00.456) 0:01:06.213 ****** 2026-02-24 18:16:31.369508 | controller | skipping: [instance] 2026-02-24 18:16:31.398463 | controller | 2026-02-24 18:16:31.398524 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-24 18:16:31.398536 | controller | Tuesday 24 February 2026 18:16:31 +0000 (0:00:00.027) 0:01:06.240 ****** 2026-02-24 18:16:31.398551 | controller | skipping: [instance] 2026-02-24 18:16:31.398593 | controller | 2026-02-24 18:16:31.398605 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-24 18:16:31.398729 | controller | Tuesday 24 February 2026 18:16:31 +0000 (0:00:00.028) 0:01:06.269 ****** 2026-02-24 18:16:31.428443 | controller | ok: [instance] => changed=false 2026-02-24 18:16:31.428506 | controller | msg: All assertions passed 2026-02-24 18:16:31.428944 | controller | 2026-02-24 18:16:31.465916 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-24 18:16:31.465957 | controller | Tuesday 24 February 2026 18:16:31 +0000 (0:00:00.030) 0:01:06.299 ****** 2026-02-24 18:16:31.465972 | controller | ok: [instance] => changed=false 2026-02-24 18:16:31.466094 | controller | msg: All assertions passed 2026-02-24 18:16:31.466114 | controller | 2026-02-24 18:16:31.466122 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-24 18:16:31.466131 | controller | Tuesday 24 February 2026 18:16:31 +0000 (0:00:00.037) 0:01:06.337 ****** 2026-02-24 18:16:31.910221 | controller | changed: [instance] 2026-02-24 18:16:31.932387 | controller | 2026-02-24 18:16:31.932409 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-24 18:16:31.932417 | controller | Tuesday 24 February 2026 18:16:31 +0000 (0:00:00.444) 0:01:06.781 ****** 2026-02-24 18:16:31.932427 | controller | skipping: [instance] 2026-02-24 18:16:31.958401 | controller | 2026-02-24 18:16:31.958450 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-24 18:16:31.958461 | controller | Tuesday 24 February 2026 18:16:31 +0000 (0:00:00.022) 0:01:06.803 ****** 2026-02-24 18:16:31.958474 | controller | skipping: [instance] 2026-02-24 18:16:31.991472 | controller | 2026-02-24 18:16:31.991547 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2026-02-24 18:16:31.991563 | controller | Tuesday 24 February 2026 18:16:31 +0000 (0:00:00.026) 0:01:06.829 ****** 2026-02-24 18:16:31.991585 | controller | skipping: [instance] 2026-02-24 18:16:32.523431 | controller | 2026-02-24 18:16:32.523484 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2026-02-24 18:16:32.523492 | controller | Tuesday 24 February 2026 18:16:31 +0000 (0:00:00.032) 0:01:06.862 ****** 2026-02-24 18:16:32.523504 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 18:16:32.569048 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:16:32.569081 | controller | 2026-02-24 18:16:32.569090 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 18:16:32.569096 | controller | Tuesday 24 February 2026 18:16:32 +0000 (0:00:00.531) 0:01:07.394 ****** 2026-02-24 18:16:32.569108 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2026-02-24 18:16:32.927488 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2026-02-24 18:16:32.927520 | controller | 2026-02-24 18:16:32.927528 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 18:16:32.927534 | controller | Tuesday 24 February 2026 18:16:32 +0000 (0:00:00.045) 0:01:07.440 ****** 2026-02-24 18:16:32.927544 | controller | ok: [instance] 2026-02-24 18:16:32.964085 | controller | 2026-02-24 18:16:32.964103 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-24 18:16:32.964111 | controller | Tuesday 24 February 2026 18:16:32 +0000 (0:00:00.358) 0:01:07.798 ****** 2026-02-24 18:16:32.964120 | controller | ok: [instance] 2026-02-24 18:16:33.183208 | controller | 2026-02-24 18:16:33.183241 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 18:16:33.183256 | controller | Tuesday 24 February 2026 18:16:32 +0000 (0:00:00.036) 0:01:07.835 ****** 2026-02-24 18:16:33.183289 | controller | ok: [instance] 2026-02-24 18:16:33.230158 | controller | 2026-02-24 18:16:33.230178 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-24 18:16:33.230185 | controller | Tuesday 24 February 2026 18:16:33 +0000 (0:00:00.218) 0:01:08.054 ****** 2026-02-24 18:16:33.230195 | controller | ok: [instance] 2026-02-24 18:16:33.584149 | controller | 2026-02-24 18:16:33.584182 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2026-02-24 18:16:33.584190 | controller | Tuesday 24 February 2026 18:16:33 +0000 (0:00:00.047) 0:01:08.101 ****** 2026-02-24 18:16:33.584200 | controller | changed: [instance] 2026-02-24 18:16:33.930236 | controller | 2026-02-24 18:16:33.930265 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2026-02-24 18:16:33.930312 | controller | Tuesday 24 February 2026 18:16:33 +0000 (0:00:00.353) 0:01:08.455 ****** 2026-02-24 18:16:33.930325 | controller | changed: [instance] 2026-02-24 18:16:34.274369 | controller | 2026-02-24 18:16:34.274418 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2026-02-24 18:16:34.274429 | controller | Tuesday 24 February 2026 18:16:33 +0000 (0:00:00.346) 0:01:08.801 ****** 2026-02-24 18:16:34.274443 | controller | changed: [instance] 2026-02-24 18:16:34.367182 | controller | 2026-02-24 18:16:34.367215 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2026-02-24 18:16:34.367225 | controller | Tuesday 24 February 2026 18:16:34 +0000 (0:00:00.343) 0:01:09.145 ****** 2026-02-24 18:16:34.367236 | controller | ok: [instance] 2026-02-24 18:16:34.714841 | controller | 2026-02-24 18:16:34.714875 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2026-02-24 18:16:34.714883 | controller | Tuesday 24 February 2026 18:16:34 +0000 (0:00:00.092) 0:01:09.238 ****** 2026-02-24 18:16:34.714894 | controller | changed: [instance] 2026-02-24 18:16:34.739415 | controller | 2026-02-24 18:16:34.739446 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-24 18:16:34.739458 | controller | Tuesday 24 February 2026 18:16:34 +0000 (0:00:00.347) 0:01:09.586 ****** 2026-02-24 18:16:34.739472 | controller | skipping: [instance] 2026-02-24 18:16:34.739543 | controller | 2026-02-24 18:16:34.739568 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 18:16:34.739584 | controller | Tuesday 24 February 2026 18:16:34 +0000 (0:00:00.024) 0:01:09.610 ****** 2026-02-24 18:16:34.762039 | controller | skipping: [instance] 2026-02-24 18:16:34.786872 | controller | 2026-02-24 18:16:34.786890 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-24 18:16:34.786898 | controller | Tuesday 24 February 2026 18:16:34 +0000 (0:00:00.022) 0:01:09.633 ****** 2026-02-24 18:16:34.786906 | controller | skipping: [instance] 2026-02-24 18:16:34.812226 | controller | 2026-02-24 18:16:34.812249 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-24 18:16:34.812258 | controller | Tuesday 24 February 2026 18:16:34 +0000 (0:00:00.024) 0:01:09.658 ****** 2026-02-24 18:16:34.812309 | controller | skipping: [instance] 2026-02-24 18:16:34.812490 | controller | 2026-02-24 18:16:34.812662 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-24 18:16:34.812822 | controller | Tuesday 24 February 2026 18:16:34 +0000 (0:00:00.025) 0:01:09.684 ****** 2026-02-24 18:16:34.831371 | controller | ok: [instance] 2026-02-24 18:16:34.831539 | controller | 2026-02-24 18:16:34.831711 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-24 18:16:34.831874 | controller | Tuesday 24 February 2026 18:16:34 +0000 (0:00:00.019) 0:01:09.703 ****** 2026-02-24 18:16:34.921571 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-24 18:16:34.921786 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-24 18:16:34.921947 | controller | 2026-02-24 18:16:34.922107 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-24 18:16:34.922305 | controller | Tuesday 24 February 2026 18:16:34 +0000 (0:00:00.089) 0:01:09.793 ****** 2026-02-24 18:16:34.939834 | controller | skipping: [instance] 2026-02-24 18:16:34.939989 | controller | 2026-02-24 18:16:34.940125 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-24 18:16:34.940255 | controller | Tuesday 24 February 2026 18:16:34 +0000 (0:00:00.018) 0:01:09.811 ****** 2026-02-24 18:16:35.154322 | controller | ok: [instance] 2026-02-24 18:16:35.154523 | controller | 2026-02-24 18:16:35.154693 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-24 18:16:35.154843 | controller | Tuesday 24 February 2026 18:16:35 +0000 (0:00:00.214) 0:01:10.025 ****** 2026-02-24 18:16:35.590844 | controller | changed: [instance] 2026-02-24 18:16:35.662338 | controller | 2026-02-24 18:16:35.662370 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-24 18:16:35.662379 | controller | Tuesday 24 February 2026 18:16:35 +0000 (0:00:00.435) 0:01:10.461 ****** 2026-02-24 18:16:35.662390 | controller | ok: [instance] 2026-02-24 18:16:35.697683 | controller | 2026-02-24 18:16:35.697707 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-24 18:16:35.697716 | controller | Tuesday 24 February 2026 18:16:35 +0000 (0:00:00.071) 0:01:10.533 ****** 2026-02-24 18:16:35.697727 | controller | ok: [instance] 2026-02-24 18:16:36.155761 | controller | 2026-02-24 18:16:36.155792 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-24 18:16:36.155800 | controller | Tuesday 24 February 2026 18:16:35 +0000 (0:00:00.035) 0:01:10.568 ****** 2026-02-24 18:16:36.155811 | controller | changed: [instance] 2026-02-24 18:16:36.189749 | controller | 2026-02-24 18:16:36.189773 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2026-02-24 18:16:36.189780 | controller | Tuesday 24 February 2026 18:16:36 +0000 (0:00:00.457) 0:01:11.026 ****** 2026-02-24 18:16:36.189790 | controller | ok: [instance] 2026-02-24 18:16:36.218013 | controller | 2026-02-24 18:16:36.218029 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2026-02-24 18:16:36.218035 | controller | Tuesday 24 February 2026 18:16:36 +0000 (0:00:00.034) 0:01:11.061 ****** 2026-02-24 18:16:36.218043 | controller | ok: [instance] 2026-02-24 18:16:36.242475 | controller | 2026-02-24 18:16:36.242512 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2026-02-24 18:16:36.242525 | controller | Tuesday 24 February 2026 18:16:36 +0000 (0:00:00.028) 0:01:11.089 ****** 2026-02-24 18:16:36.242541 | controller | ok: [instance] 2026-02-24 18:16:36.325850 | controller | 2026-02-24 18:16:36.325921 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2026-02-24 18:16:36.325943 | controller | Tuesday 24 February 2026 18:16:36 +0000 (0:00:00.024) 0:01:11.113 ****** 2026-02-24 18:16:36.325961 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2026-02-24 18:16:36.325994 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2026-02-24 18:16:36.326103 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2026-02-24 18:16:36.326119 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2026-02-24 18:16:36.326202 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2026-02-24 18:16:36.326314 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2026-02-24 18:16:36.326410 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2026-02-24 18:16:36.326501 | controller | 2026-02-24 18:16:36.326594 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 18:16:36.326690 | controller | Tuesday 24 February 2026 18:16:36 +0000 (0:00:00.083) 0:01:11.197 ****** 2026-02-24 18:16:36.550540 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2026-02-24 18:16:36.550612 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2026-02-24 18:16:36.550722 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2026-02-24 18:16:36.550782 | controller | 2026-02-24 18:16:36.550895 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 18:16:36.550963 | controller | Tuesday 24 February 2026 18:16:36 +0000 (0:00:00.224) 0:01:11.421 ****** 2026-02-24 18:16:36.643706 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2026-02-24 18:16:36.643881 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2026-02-24 18:16:36.644055 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2026-02-24 18:16:36.644221 | controller | skipping: [instance] 2026-02-24 18:16:36.644432 | controller | 2026-02-24 18:16:36.644602 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 18:16:36.644733 | controller | Tuesday 24 February 2026 18:16:36 +0000 (0:00:00.093) 0:01:11.515 ****** 2026-02-24 18:16:36.730119 | controller | skipping: [instance] => (item=compute-0 - storage) 2026-02-24 18:16:36.730210 | controller | skipping: [instance] => (item=controller-0 - storage) 2026-02-24 18:16:36.730341 | controller | skipping: [instance] => (item=crc-0 - storage) 2026-02-24 18:16:36.730460 | controller | skipping: [instance] 2026-02-24 18:16:36.730539 | controller | 2026-02-24 18:16:36.730686 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 18:16:36.730777 | controller | Tuesday 24 February 2026 18:16:36 +0000 (0:00:00.086) 0:01:11.601 ****** 2026-02-24 18:16:36.816164 | controller | skipping: [instance] => (item=compute-0 - tenant) 2026-02-24 18:16:36.816384 | controller | skipping: [instance] => (item=controller-0 - tenant) 2026-02-24 18:16:36.816575 | controller | skipping: [instance] => (item=crc-0 - tenant) 2026-02-24 18:16:36.816749 | controller | skipping: [instance] 2026-02-24 18:16:36.816905 | controller | 2026-02-24 18:16:36.817041 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 18:16:36.817131 | controller | Tuesday 24 February 2026 18:16:36 +0000 (0:00:00.085) 0:01:11.687 ****** 2026-02-24 18:16:36.900716 | controller | skipping: [instance] => (item=compute-0 - external) 2026-02-24 18:16:36.900837 | controller | skipping: [instance] => (item=controller-0 - external) 2026-02-24 18:16:36.901067 | controller | skipping: [instance] => (item=crc-0 - external) 2026-02-24 18:16:36.901163 | controller | skipping: [instance] 2026-02-24 18:16:36.901326 | controller | 2026-02-24 18:16:36.901394 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 18:16:36.901497 | controller | Tuesday 24 February 2026 18:16:36 +0000 (0:00:00.084) 0:01:11.772 ****** 2026-02-24 18:16:36.986568 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2026-02-24 18:16:36.986635 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2026-02-24 18:16:36.986771 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2026-02-24 18:16:36.986892 | controller | skipping: [instance] 2026-02-24 18:16:36.986977 | controller | 2026-02-24 18:16:36.987110 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 18:16:36.987207 | controller | Tuesday 24 February 2026 18:16:36 +0000 (0:00:00.085) 0:01:11.858 ****** 2026-02-24 18:16:37.124549 | controller | ok: [instance] => (item=compute-0 - public) 2026-02-24 18:16:37.124679 | controller | ok: [instance] => (item=controller-0 - public) 2026-02-24 18:16:37.124907 | controller | ok: [instance] => (item=crc-0 - public) 2026-02-24 18:16:37.124970 | controller | 2026-02-24 18:16:37.125062 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2026-02-24 18:16:37.125147 | controller | Tuesday 24 February 2026 18:16:37 +0000 (0:00:00.137) 0:01:11.995 ****** 2026-02-24 18:16:37.240849 | controller | 2026-02-24 18:16:37.240999 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2026-02-24 18:16:37.241045 | controller | Tuesday 24 February 2026 18:16:37 +0000 (0:00:00.116) 0:01:12.112 ****** 2026-02-24 18:16:37.296428 | controller | ok: [instance] 2026-02-24 18:16:37.296480 | controller | 2026-02-24 18:16:37.296501 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2026-02-24 18:16:37.296513 | controller | Tuesday 24 February 2026 18:16:37 +0000 (0:00:00.055) 0:01:12.167 ****** 2026-02-24 18:16:37.399323 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:b7:6a:e8', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-24 18:16:37.455184 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:a1:86:47', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-24 18:16:37.455217 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:7e:f0:16', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-24 18:16:37.455227 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:7c:58:a0', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-24 18:16:37.455233 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:16:ec:f3', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-24 18:16:37.455238 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:17:7f:81', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-24 18:16:37.455244 | controller | 2026-02-24 18:16:37.455249 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2026-02-24 18:16:37.455254 | controller | Tuesday 24 February 2026 18:16:37 +0000 (0:00:00.102) 0:01:12.270 ****** 2026-02-24 18:16:37.455279 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2026-02-24 18:16:37.654093 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2026-02-24 18:16:37.654114 | controller | 2026-02-24 18:16:37.654121 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-24 18:16:37.654126 | controller | Tuesday 24 February 2026 18:16:37 +0000 (0:00:00.055) 0:01:12.326 ****** 2026-02-24 18:16:37.654134 | controller | ok: [instance] 2026-02-24 18:16:37.680448 | controller | 2026-02-24 18:16:37.680500 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-24 18:16:37.680512 | controller | Tuesday 24 February 2026 18:16:37 +0000 (0:00:00.199) 0:01:12.525 ****** 2026-02-24 18:16:37.680528 | controller | ok: [instance] 2026-02-24 18:16:37.867450 | controller | 2026-02-24 18:16:37.867500 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-24 18:16:37.867510 | controller | Tuesday 24 February 2026 18:16:37 +0000 (0:00:00.026) 0:01:12.551 ****** 2026-02-24 18:16:37.867525 | controller | ok: [instance] 2026-02-24 18:16:37.867554 | controller | 2026-02-24 18:16:37.867564 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-24 18:16:37.867676 | controller | Tuesday 24 February 2026 18:16:37 +0000 (0:00:00.186) 0:01:12.738 ****** 2026-02-24 18:16:37.893425 | controller | ok: [instance] 2026-02-24 18:16:37.893498 | controller | 2026-02-24 18:16:37.893525 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2026-02-24 18:16:37.893541 | controller | Tuesday 24 February 2026 18:16:37 +0000 (0:00:00.025) 0:01:12.764 ****** 2026-02-24 18:16:37.915098 | controller | ok: [instance] 2026-02-24 18:16:38.097454 | controller | 2026-02-24 18:16:38.097475 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2026-02-24 18:16:38.097484 | controller | Tuesday 24 February 2026 18:16:37 +0000 (0:00:00.021) 0:01:12.786 ****** 2026-02-24 18:16:38.097499 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:b7:6a:e8', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-24 18:16:38.097526 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:a1:86:47', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-24 18:16:38.097533 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:7e:f0:16', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-24 18:16:38.097543 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:7c:58:a0', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-24 18:16:38.097929 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:16:ec:f3', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-24 18:16:38.141431 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:17:7f:81', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-24 18:16:38.141476 | controller | 2026-02-24 18:16:38.141486 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2026-02-24 18:16:38.141494 | controller | Tuesday 24 February 2026 18:16:38 +0000 (0:00:00.182) 0:01:12.968 ****** 2026-02-24 18:16:38.141508 | controller | ok: [instance] 2026-02-24 18:16:38.141546 | controller | 2026-02-24 18:16:38.141557 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2026-02-24 18:16:40.215436 | controller | Tuesday 24 February 2026 18:16:38 +0000 (0:00:00.044) 0:01:13.012 ****** 2026-02-24 18:16:40.215497 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:b7:6a:e8', 'entry': 'set:compute,52:54:00:b7:6a:e8,192.168.140.100,compute-0', 'state': 'present'}) 2026-02-24 18:16:40.239847 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:a1:86:47', 'entry': 'set:controller,52:54:01:a1:86:47,192.168.140.9,controller-0', 'state': 'present'}) 2026-02-24 18:16:40.239879 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:7e:f0:16', 'entry': 'set:ocp,52:54:02:7e:f0:16,192.168.140.10,crc-0', 'state': 'present'}) 2026-02-24 18:16:40.239886 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:7c:58:a0', 'entry': 'set:compute,52:54:00:7c:58:a0,192.168.101.100,compute-0', 'state': 'present'}) 2026-02-24 18:16:40.239891 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:16:ec:f3', 'entry': 'set:controller,52:54:01:16:ec:f3,192.168.101.9,controller-0', 'state': 'present'}) 2026-02-24 18:16:40.239897 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:17:7f:81', 'entry': 'set:ocp,52:54:02:17:7f:81,192.168.101.10,crc-0', 'state': 'present'}) 2026-02-24 18:16:40.239902 | controller | 2026-02-24 18:16:40.239908 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2026-02-24 18:16:40.239921 | controller | Tuesday 24 February 2026 18:16:40 +0000 (0:00:02.072) 0:01:15.085 ****** 2026-02-24 18:16:40.239930 | controller | skipping: [instance] 2026-02-24 18:16:40.452423 | controller | 2026-02-24 18:16:40.452463 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2026-02-24 18:16:40.452477 | controller | Tuesday 24 February 2026 18:16:40 +0000 (0:00:00.025) 0:01:15.111 ****** 2026-02-24 18:16:40.452493 | controller | ok: [instance] => (item=compute-0) 2026-02-24 18:16:40.577998 | controller | ok: [instance] => (item=controller-0) 2026-02-24 18:16:40.578037 | controller | ok: [instance] => (item=crc-0) 2026-02-24 18:16:40.578051 | controller | 2026-02-24 18:16:40.578062 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2026-02-24 18:16:40.578073 | controller | Tuesday 24 February 2026 18:16:40 +0000 (0:00:00.212) 0:01:15.323 ****** 2026-02-24 18:16:40.578089 | controller | 2026-02-24 18:16:40.619646 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-24 18:16:40.619663 | controller | Tuesday 24 February 2026 18:16:40 +0000 (0:00:00.125) 0:01:15.449 ****** 2026-02-24 18:16:40.619672 | controller | ok: [instance] 2026-02-24 18:16:40.818330 | controller | 2026-02-24 18:16:40.818356 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 18:16:40.818363 | controller | Tuesday 24 February 2026 18:16:40 +0000 (0:00:00.042) 0:01:15.491 ****** 2026-02-24 18:16:40.818379 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 18:16:40.819543 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 18:16:40.819558 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 18:16:40.819565 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 18:16:40.819570 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 18:16:40.819576 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 18:16:40.819588 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 18:16:43.918388 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:16:43.918420 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:16:43.918428 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 18:16:43.918435 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 18:16:43.918440 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 18:16:43.918446 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 18:16:43.918452 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 18:16:43.918458 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 18:16:43.918469 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 18:16:43.918475 | controller | 2026-02-24 18:16:43.918484 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 18:16:43.918490 | controller | Tuesday 24 February 2026 18:16:40 +0000 (0:00:00.198) 0:01:15.689 ****** 2026-02-24 18:16:43.918500 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 18:16:43.918524 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 18:16:43.918532 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 18:16:43.918538 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 18:16:43.918543 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 18:16:43.918549 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 18:16:43.918554 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 18:16:43.918560 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:16:43.918565 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:16:43.918572 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 18:16:43.918594 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 18:16:43.919338 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 18:16:44.318421 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 18:16:44.318458 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 18:16:44.318470 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 18:16:44.318479 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 18:16:44.318489 | controller | 2026-02-24 18:16:44.318499 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-24 18:16:44.318509 | controller | Tuesday 24 February 2026 18:16:43 +0000 (0:00:03.099) 0:01:18.788 ****** 2026-02-24 18:16:44.318523 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 18:16:44.318565 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 18:16:44.318583 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 18:16:44.318593 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 18:16:44.318602 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 18:16:44.318611 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 18:16:44.318620 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 18:16:44.318633 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:16:44.318665 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:16:44.318678 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 18:16:44.318712 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 18:16:44.319444 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 18:16:44.339792 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 18:16:44.339818 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 18:16:44.339827 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 18:16:44.339836 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 18:16:44.339849 | controller | 2026-02-24 18:16:44.339856 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2026-02-24 18:16:44.339864 | controller | Tuesday 24 February 2026 18:16:44 +0000 (0:00:00.400) 0:01:19.189 ****** 2026-02-24 18:16:44.339875 | controller | ok: [instance] 2026-02-24 18:16:44.382406 | controller | 2026-02-24 18:16:44.382443 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2026-02-24 18:16:44.382454 | controller | Tuesday 24 February 2026 18:16:44 +0000 (0:00:00.021) 0:01:19.211 ****** 2026-02-24 18:16:44.382468 | controller | skipping: [instance] => (item=compute) 2026-02-24 18:16:44.415816 | controller | skipping: [instance] => (item=controller) 2026-02-24 18:16:44.415849 | controller | skipping: [instance] => (item=crc) 2026-02-24 18:16:44.415857 | controller | skipping: [instance] 2026-02-24 18:16:44.415863 | controller | 2026-02-24 18:16:44.415869 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2026-02-24 18:16:44.415875 | controller | Tuesday 24 February 2026 18:16:44 +0000 (0:00:00.042) 0:01:19.253 ****** 2026-02-24 18:16:44.415885 | controller | skipping: [instance] 2026-02-24 18:16:44.791391 | controller | 2026-02-24 18:16:44.791427 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2026-02-24 18:16:44.791437 | controller | Tuesday 24 February 2026 18:16:44 +0000 (0:00:00.033) 0:01:19.286 ****** 2026-02-24 18:16:44.791453 | controller | changed: [instance] 2026-02-24 18:16:44.791491 | controller | 2026-02-24 18:16:44.791500 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2026-02-24 18:16:44.791508 | controller | Tuesday 24 February 2026 18:16:44 +0000 (0:00:00.364) 0:01:19.651 ****** 2026-02-24 18:16:44.791515 | controller | 2026-02-24 18:16:44.791525 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-24 18:16:45.419769 | controller | Tuesday 24 February 2026 18:16:44 +0000 (0:00:00.010) 0:01:19.662 ****** 2026-02-24 18:16:45.419806 | controller | changed: [instance] 2026-02-24 18:16:45.773351 | controller | 2026-02-24 18:16:45.773385 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-24 18:16:45.773394 | controller | Tuesday 24 February 2026 18:16:45 +0000 (0:00:00.628) 0:01:20.290 ****** 2026-02-24 18:16:45.773405 | controller | changed: [instance] 2026-02-24 18:16:46.115372 | controller | 2026-02-24 18:16:46.115408 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2026-02-24 18:16:46.115419 | controller | Tuesday 24 February 2026 18:16:45 +0000 (0:00:00.353) 0:01:20.644 ****** 2026-02-24 18:16:46.115432 | controller | changed: [instance] 2026-02-24 18:16:46.115460 | controller | 2026-02-24 18:16:46.115470 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2026-02-24 18:16:46.115537 | controller | Tuesday 24 February 2026 18:16:46 +0000 (0:00:00.342) 0:01:20.986 ****** 2026-02-24 18:16:46.474279 | controller | changed: [instance] 2026-02-24 18:16:46.844228 | controller | 2026-02-24 18:16:46.844285 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2026-02-24 18:16:46.844297 | controller | Tuesday 24 February 2026 18:16:46 +0000 (0:00:00.358) 0:01:21.345 ****** 2026-02-24 18:16:46.844307 | controller | changed: [instance] 2026-02-24 18:16:46.878391 | controller | 2026-02-24 18:16:46.878433 | controller | TASK [Build utility records dataset] ******************************************* 2026-02-24 18:16:46.878443 | controller | Tuesday 24 February 2026 18:16:46 +0000 (0:00:00.369) 0:01:21.715 ****** 2026-02-24 18:16:46.878457 | controller | 2026-02-24 18:16:46.969346 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-24 18:16:46.969381 | controller | Tuesday 24 February 2026 18:16:46 +0000 (0:00:00.034) 0:01:21.749 ****** 2026-02-24 18:16:46.969395 | controller | ok: [instance] 2026-02-24 18:16:46.969427 | controller | 2026-02-24 18:16:46.969438 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 18:16:46.969533 | controller | Tuesday 24 February 2026 18:16:46 +0000 (0:00:00.091) 0:01:21.841 ****** 2026-02-24 18:16:47.065228 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 18:16:47.522300 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:16:47.522336 | controller | 2026-02-24 18:16:47.522344 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 18:16:47.522351 | controller | Tuesday 24 February 2026 18:16:47 +0000 (0:00:00.095) 0:01:21.936 ****** 2026-02-24 18:16:47.522366 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 18:16:47.814416 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:16:47.814454 | controller | 2026-02-24 18:16:47.814465 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-24 18:16:47.814474 | controller | Tuesday 24 February 2026 18:16:47 +0000 (0:00:00.456) 0:01:22.393 ****** 2026-02-24 18:16:47.814487 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 18:16:47.814515 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:16:47.814532 | controller | 2026-02-24 18:16:47.814540 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-24 18:16:47.814547 | controller | Tuesday 24 February 2026 18:16:47 +0000 (0:00:00.281) 0:01:22.674 ****** 2026-02-24 18:16:47.814554 | controller | 2026-02-24 18:16:47.814564 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 18:16:48.251941 | controller | Tuesday 24 February 2026 18:16:47 +0000 (0:00:00.010) 0:01:22.685 ****** 2026-02-24 18:16:48.251977 | controller | changed: [instance] 2026-02-24 18:16:48.608298 | controller | 2026-02-24 18:16:48.608328 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-24 18:16:48.608336 | controller | Tuesday 24 February 2026 18:16:48 +0000 (0:00:00.437) 0:01:23.123 ****** 2026-02-24 18:16:48.608346 | controller | changed: [instance] 2026-02-24 18:16:48.640934 | controller | 2026-02-24 18:16:48.640960 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2026-02-24 18:16:48.640968 | controller | Tuesday 24 February 2026 18:16:48 +0000 (0:00:00.356) 0:01:23.479 ****** 2026-02-24 18:16:48.640977 | controller | skipping: [instance] 2026-02-24 18:16:48.717964 | controller | 2026-02-24 18:16:48.717993 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2026-02-24 18:16:48.718003 | controller | Tuesday 24 February 2026 18:16:48 +0000 (0:00:00.032) 0:01:23.512 ****** 2026-02-24 18:16:48.718015 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2026-02-24 18:16:48.904340 | controller | 2026-02-24 18:16:48.904370 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2026-02-24 18:16:48.904378 | controller | Tuesday 24 February 2026 18:16:48 +0000 (0:00:00.076) 0:01:23.589 ****** 2026-02-24 18:16:48.904388 | controller | ok: [instance] 2026-02-24 18:16:48.904413 | controller | 2026-02-24 18:16:48.904619 | controller | TASK [Deploy CRC if needed] **************************************************** 2026-02-24 18:16:48.923152 | controller | Tuesday 24 February 2026 18:16:48 +0000 (0:00:00.186) 0:01:23.775 ****** 2026-02-24 18:16:48.923184 | controller | skipping: [instance] 2026-02-24 18:16:49.270345 | controller | 2026-02-24 18:16:49.270379 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2026-02-24 18:16:49.270387 | controller | Tuesday 24 February 2026 18:16:48 +0000 (0:00:00.018) 0:01:23.794 ****** 2026-02-24 18:16:49.270397 | controller | ok: [instance] 2026-02-24 18:16:49.270422 | controller | 2026-02-24 18:16:49.270430 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2026-02-24 18:16:49.270536 | controller | Tuesday 24 February 2026 18:16:49 +0000 (0:00:00.347) 0:01:24.141 ****** 2026-02-24 18:16:49.501289 | controller | ok: [instance] 2026-02-24 18:16:49.720941 | controller | 2026-02-24 18:16:49.720965 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2026-02-24 18:16:49.720973 | controller | Tuesday 24 February 2026 18:16:49 +0000 (0:00:00.230) 0:01:24.372 ****** 2026-02-24 18:16:49.720982 | controller | ok: [instance] 2026-02-24 18:16:49.939881 | controller | 2026-02-24 18:16:49.939903 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2026-02-24 18:16:49.939911 | controller | Tuesday 24 February 2026 18:16:49 +0000 (0:00:00.219) 0:01:24.592 ****** 2026-02-24 18:16:49.939920 | controller | ok: [instance] 2026-02-24 18:16:50.155991 | controller | 2026-02-24 18:16:50.156013 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2026-02-24 18:16:50.156021 | controller | Tuesday 24 February 2026 18:16:49 +0000 (0:00:00.218) 0:01:24.811 ****** 2026-02-24 18:16:50.156030 | controller | ok: [instance] 2026-02-24 18:16:50.195548 | controller | 2026-02-24 18:16:50.195566 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 18:16:50.195573 | controller | Tuesday 24 February 2026 18:16:50 +0000 (0:00:00.216) 0:01:25.027 ****** 2026-02-24 18:16:50.195582 | controller | 2026-02-24 18:16:50.390424 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-24 18:16:50.390467 | controller | Tuesday 24 February 2026 18:16:50 +0000 (0:00:00.039) 0:01:25.067 ****** 2026-02-24 18:16:50.390482 | controller | ok: [instance] 2026-02-24 18:16:50.413994 | controller | 2026-02-24 18:16:50.414026 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-24 18:16:50.414034 | controller | Tuesday 24 February 2026 18:16:50 +0000 (0:00:00.194) 0:01:25.261 ****** 2026-02-24 18:16:50.414044 | controller | ok: [instance] 2026-02-24 18:16:50.438232 | controller | 2026-02-24 18:16:50.438265 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-24 18:16:50.438297 | controller | Tuesday 24 February 2026 18:16:50 +0000 (0:00:00.023) 0:01:25.285 ****** 2026-02-24 18:16:50.438308 | controller | skipping: [instance] 2026-02-24 18:16:50.710774 | controller | 2026-02-24 18:16:50.710802 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2026-02-24 18:16:50.710809 | controller | Tuesday 24 February 2026 18:16:50 +0000 (0:00:00.024) 0:01:25.309 ****** 2026-02-24 18:16:50.710819 | controller | ok: [instance] 2026-02-24 18:16:50.931229 | controller | 2026-02-24 18:16:50.931260 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2026-02-24 18:16:50.931281 | controller | Tuesday 24 February 2026 18:16:50 +0000 (0:00:00.272) 0:01:25.582 ****** 2026-02-24 18:16:50.931292 | controller | ok: [instance] 2026-02-24 18:16:51.101168 | controller | 2026-02-24 18:16:51.101187 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2026-02-24 18:16:51.101194 | controller | Tuesday 24 February 2026 18:16:50 +0000 (0:00:00.220) 0:01:25.802 ****** 2026-02-24 18:16:51.101203 | controller | ok: [instance] 2026-02-24 18:16:51.185423 | controller | 2026-02-24 18:16:51.185477 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2026-02-24 18:16:51.185486 | controller | Tuesday 24 February 2026 18:16:51 +0000 (0:00:00.169) 0:01:25.972 ****** 2026-02-24 18:16:51.185497 | controller | 2026-02-24 18:16:51.228170 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-24 18:16:51.228191 | controller | Tuesday 24 February 2026 18:16:51 +0000 (0:00:00.084) 0:01:26.056 ****** 2026-02-24 18:16:51.228201 | controller | ok: [instance] => changed=false 2026-02-24 18:16:51.406220 | controller | msg: All assertions passed 2026-02-24 18:16:51.406243 | controller | 2026-02-24 18:16:51.406262 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-24 18:16:51.406284 | controller | Tuesday 24 February 2026 18:16:51 +0000 (0:00:00.042) 0:01:26.099 ****** 2026-02-24 18:16:51.406297 | controller | ok: [instance] 2026-02-24 18:16:51.595018 | controller | 2026-02-24 18:16:51.595040 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-24 18:16:51.595047 | controller | Tuesday 24 February 2026 18:16:51 +0000 (0:00:00.177) 0:01:26.277 ****** 2026-02-24 18:16:51.595056 | controller | ok: [instance] 2026-02-24 18:16:51.619037 | controller | 2026-02-24 18:16:51.619053 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-24 18:16:51.619059 | controller | Tuesday 24 February 2026 18:16:51 +0000 (0:00:00.188) 0:01:26.466 ****** 2026-02-24 18:16:51.619068 | controller | ok: [instance] => changed=false 2026-02-24 18:16:51.799380 | controller | msg: All assertions passed 2026-02-24 18:16:51.799412 | controller | 2026-02-24 18:16:51.799419 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-24 18:16:51.799425 | controller | Tuesday 24 February 2026 18:16:51 +0000 (0:00:00.023) 0:01:26.490 ****** 2026-02-24 18:16:51.799436 | controller | ok: [instance] 2026-02-24 18:16:51.976797 | controller | 2026-02-24 18:16:51.976822 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-24 18:16:51.976830 | controller | Tuesday 24 February 2026 18:16:51 +0000 (0:00:00.180) 0:01:26.670 ****** 2026-02-24 18:16:51.976839 | controller | ok: [instance] 2026-02-24 18:16:52.024015 | controller | 2026-02-24 18:16:52.024039 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-24 18:16:52.024049 | controller | Tuesday 24 February 2026 18:16:51 +0000 (0:00:00.177) 0:01:26.848 ****** 2026-02-24 18:16:52.024061 | controller | ok: [instance] 2026-02-24 18:16:52.402878 | controller | 2026-02-24 18:16:52.402908 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2026-02-24 18:16:52.402917 | controller | Tuesday 24 February 2026 18:16:52 +0000 (0:00:00.047) 0:01:26.895 ****** 2026-02-24 18:16:52.402927 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2026-02-24 18:16:52.422420 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2026-02-24 18:16:52.422457 | controller | 2026-02-24 18:16:52.422466 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2026-02-24 18:16:52.422474 | controller | Tuesday 24 February 2026 18:16:52 +0000 (0:00:00.378) 0:01:27.274 ****** 2026-02-24 18:16:52.422487 | controller | skipping: [instance] 2026-02-24 18:16:52.444732 | controller | 2026-02-24 18:16:52.444752 | controller | TASK [Load the architecture local kustomize patches] *************************** 2026-02-24 18:16:52.444760 | controller | Tuesday 24 February 2026 18:16:52 +0000 (0:00:00.019) 0:01:27.293 ****** 2026-02-24 18:16:52.444769 | controller | skipping: [instance] 2026-02-24 18:16:52.572835 | controller | 2026-02-24 18:16:52.572858 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2026-02-24 18:16:52.572870 | controller | Tuesday 24 February 2026 18:16:52 +0000 (0:00:00.022) 0:01:27.316 ****** 2026-02-24 18:16:52.572879 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2026-02-24 18:16:52.598017 | controller | 2026-02-24 18:16:52.598034 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2026-02-24 18:16:52.598040 | controller | Tuesday 24 February 2026 18:16:52 +0000 (0:00:00.127) 0:01:27.443 ****** 2026-02-24 18:16:52.598049 | controller | skipping: [instance] 2026-02-24 18:16:53.012907 | controller | 2026-02-24 18:16:53.012938 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2026-02-24 18:16:53.012948 | controller | Tuesday 24 February 2026 18:16:52 +0000 (0:00:00.025) 0:01:27.469 ****** 2026-02-24 18:16:53.012960 | controller | changed: [instance] 2026-02-24 18:16:53.013126 | controller | 2026-02-24 18:16:53.013331 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2026-02-24 18:16:53.013502 | controller | Tuesday 24 February 2026 18:16:53 +0000 (0:00:00.415) 0:01:27.884 ****** 2026-02-24 18:16:53.516362 | controller | changed: [instance] 2026-02-24 18:16:53.955264 | controller | 2026-02-24 18:16:53.955311 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2026-02-24 18:16:53.955319 | controller | Tuesday 24 February 2026 18:16:53 +0000 (0:00:00.491) 0:01:28.376 ****** 2026-02-24 18:16:53.955325 | controller | 2026-02-24 18:16:53.955330 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 18:16:53.955336 | controller | Tuesday 24 February 2026 18:16:53 +0000 (0:00:00.011) 0:01:28.387 ****** 2026-02-24 18:16:53.955346 | controller | changed: [instance] 2026-02-24 18:16:53.955375 | controller | 2026-02-24 18:16:53.955384 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-24 18:16:53.955507 | controller | Tuesday 24 February 2026 18:16:53 +0000 (0:00:00.439) 0:01:28.826 ****** 2026-02-24 18:16:54.597670 | controller | changed: [instance] 2026-02-24 18:16:54.628338 | controller | 2026-02-24 18:16:54.628372 | controller | TASK [Deploy virtualbmc] ******************************************************* 2026-02-24 18:16:54.628380 | controller | Tuesday 24 February 2026 18:16:54 +0000 (0:00:00.642) 0:01:29.468 ****** 2026-02-24 18:16:54.628397 | controller | skipping: [instance] 2026-02-24 18:16:54.628513 | controller | 2026-02-24 18:16:54.628822 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2026-02-24 18:16:54.658275 | controller | Tuesday 24 February 2026 18:16:54 +0000 (0:00:00.031) 0:01:29.499 ****** 2026-02-24 18:16:54.658329 | controller | skipping: [instance] 2026-02-24 18:16:55.209468 | controller | 2026-02-24 18:16:55.209502 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2026-02-24 18:16:55.209510 | controller | Tuesday 24 February 2026 18:16:54 +0000 (0:00:00.029) 0:01:29.529 ****** 2026-02-24 18:16:55.209521 | controller | changed: [instance] => (item=workload) 2026-02-24 18:16:55.611105 | controller | changed: [instance] => (item=reproducer-inventory) 2026-02-24 18:16:55.611143 | controller | ok: [instance] => (item=volumes) 2026-02-24 18:16:55.611151 | controller | 2026-02-24 18:16:55.611157 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2026-02-24 18:16:55.611163 | controller | Tuesday 24 February 2026 18:16:55 +0000 (0:00:00.550) 0:01:30.080 ****** 2026-02-24 18:16:55.611173 | controller | changed: [instance] => (item=workload) 2026-02-24 18:16:55.637290 | controller | changed: [instance] => (item=volumes) 2026-02-24 18:16:55.637314 | controller | 2026-02-24 18:16:55.637323 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2026-02-24 18:16:55.637330 | controller | Tuesday 24 February 2026 18:16:55 +0000 (0:00:00.401) 0:01:30.482 ****** 2026-02-24 18:16:55.637342 | controller | skipping: [instance] 2026-02-24 18:16:56.653018 | controller | 2026-02-24 18:16:56.653048 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2026-02-24 18:16:56.653056 | controller | Tuesday 24 February 2026 18:16:55 +0000 (0:00:00.026) 0:01:30.508 ****** 2026-02-24 18:16:56.653067 | controller | changed: [instance] => (item=compute) 2026-02-24 18:16:56.685108 | controller | changed: [instance] => (item=controller) 2026-02-24 18:16:56.685128 | controller | changed: [instance] => (item=crc) 2026-02-24 18:16:56.685137 | controller | 2026-02-24 18:16:56.685145 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2026-02-24 18:16:56.685152 | controller | Tuesday 24 February 2026 18:16:56 +0000 (0:00:01.015) 0:01:31.524 ****** 2026-02-24 18:16:56.685162 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance 2026-02-24 18:16:56.861148 | controller | 2026-02-24 18:16:56.861167 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] ***************** 2026-02-24 18:16:56.861175 | controller | Tuesday 24 February 2026 18:16:56 +0000 (0:00:00.032) 0:01:31.556 ****** 2026-02-24 18:16:56.861183 | controller | ok: [instance] 2026-02-24 18:16:56.880404 | controller | 2026-02-24 18:16:56.880443 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] ************* 2026-02-24 18:16:56.880454 | controller | Tuesday 24 February 2026 18:16:56 +0000 (0:00:00.176) 0:01:31.732 ****** 2026-02-24 18:16:56.880472 | controller | skipping: [instance] 2026-02-24 18:16:56.880506 | controller | 2026-02-24 18:16:56.880517 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] *** 2026-02-24 18:16:56.880718 | controller | Tuesday 24 February 2026 18:16:56 +0000 (0:00:00.019) 0:01:31.751 ****** 2026-02-24 18:16:57.249668 | controller | changed: [instance] 2026-02-24 18:16:57.270388 | controller | 2026-02-24 18:16:57.270413 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] ********************* 2026-02-24 18:16:57.270424 | controller | Tuesday 24 February 2026 18:16:57 +0000 (0:00:00.369) 0:01:32.121 ****** 2026-02-24 18:16:57.270435 | controller | skipping: [instance] 2026-02-24 18:16:57.270518 | controller | 2026-02-24 18:16:57.270543 | controller | TASK [libvirt_manager : Write merged all-group.yml] **************************** 2026-02-24 18:16:57.270559 | controller | Tuesday 24 February 2026 18:16:57 +0000 (0:00:00.020) 0:01:32.141 ****** 2026-02-24 18:16:57.290413 | controller | skipping: [instance] 2026-02-24 18:16:57.290482 | controller | 2026-02-24 18:16:57.290686 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2026-02-24 18:16:57.329778 | controller | Tuesday 24 February 2026 18:16:57 +0000 (0:00:00.020) 0:01:32.162 ****** 2026-02-24 18:16:57.329800 | controller | skipping: [instance] 2026-02-24 18:16:57.395363 | controller | 2026-02-24 18:16:57.395414 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2026-02-24 18:16:57.395425 | controller | Tuesday 24 February 2026 18:16:57 +0000 (0:00:00.039) 0:01:32.201 ****** 2026-02-24 18:16:57.395441 | controller | skipping: [instance] => (item=crc) 2026-02-24 18:16:57.600664 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2026-02-24 18:16:57.600684 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2026-02-24 18:16:57.600697 | controller | 2026-02-24 18:16:57.600704 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-24 18:16:57.600710 | controller | Tuesday 24 February 2026 18:16:57 +0000 (0:00:00.065) 0:01:32.266 ****** 2026-02-24 18:16:57.600719 | controller | changed: [instance] 2026-02-24 18:16:57.782390 | controller | 2026-02-24 18:16:57.782414 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-24 18:16:57.782423 | controller | Tuesday 24 February 2026 18:16:57 +0000 (0:00:00.205) 0:01:32.472 ****** 2026-02-24 18:16:57.782434 | controller | ok: [instance] 2026-02-24 18:16:57.782463 | controller | 2026-02-24 18:16:57.782473 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-24 18:16:57.782571 | controller | Tuesday 24 February 2026 18:16:57 +0000 (0:00:00.181) 0:01:32.653 ****** 2026-02-24 18:17:27.267127 | controller | changed: [instance] 2026-02-24 18:17:27.462399 | controller | 2026-02-24 18:17:27.462439 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-24 18:17:27.462453 | controller | Tuesday 24 February 2026 18:17:27 +0000 (0:00:29.484) 0:02:02.138 ****** 2026-02-24 18:17:27.462465 | controller | ok: [instance] 2026-02-24 18:17:27.462496 | controller | 2026-02-24 18:17:27.462506 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-24 18:17:27.462532 | controller | Tuesday 24 February 2026 18:17:27 +0000 (0:00:00.195) 0:02:02.334 ****** 2026-02-24 18:17:27.504480 | controller | ok: [instance] => changed=false 2026-02-24 18:17:27.504938 | controller | msg: All assertions passed 2026-02-24 18:17:27.708313 | controller | 2026-02-24 18:17:27.708353 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-24 18:17:27.708361 | controller | Tuesday 24 February 2026 18:17:27 +0000 (0:00:00.041) 0:02:02.375 ****** 2026-02-24 18:17:27.708372 | controller | changed: [instance] 2026-02-24 18:17:27.909040 | controller | 2026-02-24 18:17:27.909069 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-24 18:17:27.909079 | controller | Tuesday 24 February 2026 18:17:27 +0000 (0:00:00.203) 0:02:02.579 ****** 2026-02-24 18:17:27.909094 | controller | ok: [instance] 2026-02-24 18:17:28.103423 | controller | 2026-02-24 18:17:28.103468 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-24 18:17:28.103478 | controller | Tuesday 24 February 2026 18:17:27 +0000 (0:00:00.200) 0:02:02.780 ****** 2026-02-24 18:17:28.103493 | controller | ok: [instance] 2026-02-24 18:17:28.103751 | controller | 2026-02-24 18:17:28.103788 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-24 18:17:28.125190 | controller | Tuesday 24 February 2026 18:17:28 +0000 (0:00:00.194) 0:02:02.974 ****** 2026-02-24 18:17:28.125212 | controller | skipping: [instance] 2026-02-24 18:17:28.316394 | controller | 2026-02-24 18:17:28.316427 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-24 18:17:28.316437 | controller | Tuesday 24 February 2026 18:17:28 +0000 (0:00:00.021) 0:02:02.996 ****** 2026-02-24 18:17:28.316449 | controller | ok: [instance] 2026-02-24 18:17:28.357867 | controller | 2026-02-24 18:17:28.357892 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-24 18:17:28.357906 | controller | Tuesday 24 February 2026 18:17:28 +0000 (0:00:00.191) 0:02:03.187 ****** 2026-02-24 18:17:28.357917 | controller | ok: [instance] => changed=false 2026-02-24 18:17:28.566321 | controller | msg: All assertions passed 2026-02-24 18:17:28.566340 | controller | 2026-02-24 18:17:28.566347 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-24 18:17:28.566353 | controller | Tuesday 24 February 2026 18:17:28 +0000 (0:00:00.041) 0:02:03.229 ****** 2026-02-24 18:17:28.566361 | controller | ok: [instance] 2026-02-24 18:17:28.566688 | controller | 2026-02-24 18:17:28.740365 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2026-02-24 18:17:28.740393 | controller | Tuesday 24 February 2026 18:17:28 +0000 (0:00:00.208) 0:02:03.438 ****** 2026-02-24 18:17:28.740405 | controller | ok: [instance] 2026-02-24 18:17:28.740705 | controller | 2026-02-24 18:17:28.740832 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2026-02-24 18:17:28.740877 | controller | Tuesday 24 February 2026 18:17:28 +0000 (0:00:00.173) 0:02:03.611 ****** 2026-02-24 18:17:29.128647 | controller | changed: [instance] 2026-02-24 18:17:29.306655 | controller | 2026-02-24 18:17:29.306674 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2026-02-24 18:17:29.306682 | controller | Tuesday 24 February 2026 18:17:29 +0000 (0:00:00.388) 0:02:04.000 ****** 2026-02-24 18:17:29.306691 | controller | ok: [instance] 2026-02-24 18:17:29.481200 | controller | 2026-02-24 18:17:29.481251 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2026-02-24 18:17:29.481291 | controller | Tuesday 24 February 2026 18:17:29 +0000 (0:00:00.178) 0:02:04.178 ****** 2026-02-24 18:17:29.481314 | controller | ok: [instance] 2026-02-24 18:17:29.859231 | controller | 2026-02-24 18:17:29.859252 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2026-02-24 18:17:29.859260 | controller | Tuesday 24 February 2026 18:17:29 +0000 (0:00:00.174) 0:02:04.352 ****** 2026-02-24 18:17:29.859287 | controller | changed: [instance] 2026-02-24 18:17:29.881395 | controller | 2026-02-24 18:17:29.881444 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2026-02-24 18:17:29.881455 | controller | Tuesday 24 February 2026 18:17:29 +0000 (0:00:00.378) 0:02:04.730 ****** 2026-02-24 18:17:29.881470 | controller | ok: [instance] 2026-02-24 18:17:30.108244 | controller | 2026-02-24 18:17:30.108280 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2026-02-24 18:17:30.108291 | controller | Tuesday 24 February 2026 18:17:29 +0000 (0:00:00.021) 0:02:04.752 ****** 2026-02-24 18:17:30.108301 | controller | ok: [instance] 2026-02-24 18:17:30.583031 | controller | 2026-02-24 18:17:30.583056 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2026-02-24 18:17:30.583064 | controller | Tuesday 24 February 2026 18:17:30 +0000 (0:00:00.226) 0:02:04.979 ****** 2026-02-24 18:17:30.583073 | controller | ok: [instance] 2026-02-24 18:17:30.702462 | controller | 2026-02-24 18:17:30.702503 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2026-02-24 18:17:30.702513 | controller | Tuesday 24 February 2026 18:17:30 +0000 (0:00:00.474) 0:02:05.454 ****** 2026-02-24 18:17:30.702526 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 18:17:30.702560 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 18:17:30.702568 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 18:17:30.702578 | controller | 2026-02-24 18:17:30.702827 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2026-02-24 18:17:30.955134 | controller | Tuesday 24 February 2026 18:17:30 +0000 (0:00:00.119) 0:02:05.573 ****** 2026-02-24 18:17:30.955174 | controller | changed: [instance] 2026-02-24 18:17:31.172083 | controller | 2026-02-24 18:17:31.172107 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2026-02-24 18:17:31.172116 | controller | Tuesday 24 February 2026 18:17:30 +0000 (0:00:00.251) 0:02:05.825 ****** 2026-02-24 18:17:31.172127 | controller | changed: [instance] 2026-02-24 18:17:31.480256 | controller | 2026-02-24 18:17:31.480301 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2026-02-24 18:17:31.480310 | controller | Tuesday 24 February 2026 18:17:31 +0000 (0:00:00.217) 0:02:06.043 ****** 2026-02-24 18:17:31.480321 | controller | changed: [instance] 2026-02-24 18:17:31.508453 | controller | 2026-02-24 18:17:31.508496 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2026-02-24 18:17:31.508509 | controller | Tuesday 24 February 2026 18:17:31 +0000 (0:00:00.308) 0:02:06.351 ****** 2026-02-24 18:17:31.508525 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 18:17:31.508556 | controller | 2026-02-24 18:17:31.508565 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 18:17:31.508662 | controller | Tuesday 24 February 2026 18:17:31 +0000 (0:00:00.028) 0:02:06.379 ****** 2026-02-24 18:17:31.553436 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 18:17:31.553498 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 18:17:31.553519 | controller | 2026-02-24 18:17:31.553533 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 18:17:31.553570 | controller | Tuesday 24 February 2026 18:17:31 +0000 (0:00:00.044) 0:02:06.424 ****** 2026-02-24 18:17:31.784234 | controller | ok: [instance] 2026-02-24 18:17:31.828145 | controller | 2026-02-24 18:17:31.828164 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 18:17:31.828172 | controller | Tuesday 24 February 2026 18:17:31 +0000 (0:00:00.230) 0:02:06.655 ****** 2026-02-24 18:17:31.828180 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:17:32.051152 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:17:32.051170 | controller | 2026-02-24 18:17:32.051178 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 18:17:32.051184 | controller | Tuesday 24 February 2026 18:17:31 +0000 (0:00:00.043) 0:02:06.699 ****** 2026-02-24 18:17:32.051193 | controller | ok: [instance] 2026-02-24 18:17:32.248364 | controller | 2026-02-24 18:17:32.248393 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 18:17:32.248400 | controller | Tuesday 24 February 2026 18:17:32 +0000 (0:00:00.223) 0:02:06.922 ****** 2026-02-24 18:17:32.248410 | controller | ok: [instance] 2026-02-24 18:17:32.248697 | controller | 2026-02-24 18:17:32.531409 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2026-02-24 18:17:32.531449 | controller | Tuesday 24 February 2026 18:17:32 +0000 (0:00:00.197) 0:02:07.120 ****** 2026-02-24 18:17:32.531468 | controller | changed: [instance] 2026-02-24 18:17:32.754007 | controller | 2026-02-24 18:17:32.754030 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 18:17:32.754037 | controller | Tuesday 24 February 2026 18:17:32 +0000 (0:00:00.282) 0:02:07.402 ****** 2026-02-24 18:17:32.754046 | controller | ok: [instance] 2026-02-24 18:17:32.798414 | controller | 2026-02-24 18:17:32.798452 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 18:17:32.798462 | controller | Tuesday 24 February 2026 18:17:32 +0000 (0:00:00.222) 0:02:07.625 ****** 2026-02-24 18:17:32.798475 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:17:32.798508 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:17:32.798516 | controller | 2026-02-24 18:17:32.798525 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 18:17:32.798651 | controller | Tuesday 24 February 2026 18:17:32 +0000 (0:00:00.044) 0:02:07.669 ****** 2026-02-24 18:17:33.026289 | controller | ok: [instance] 2026-02-24 18:17:33.223780 | controller | 2026-02-24 18:17:33.223799 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 18:17:33.223807 | controller | Tuesday 24 February 2026 18:17:33 +0000 (0:00:00.227) 0:02:07.897 ****** 2026-02-24 18:17:33.223816 | controller | ok: [instance] 2026-02-24 18:17:33.540592 | controller | 2026-02-24 18:17:33.540611 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2026-02-24 18:17:33.540619 | controller | Tuesday 24 February 2026 18:17:33 +0000 (0:00:00.197) 0:02:08.095 ****** 2026-02-24 18:17:33.540628 | controller | changed: [instance] 2026-02-24 18:17:33.562244 | controller | 2026-02-24 18:17:33.562262 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2026-02-24 18:17:33.562292 | controller | Tuesday 24 February 2026 18:17:33 +0000 (0:00:00.316) 0:02:08.412 ****** 2026-02-24 18:17:33.562301 | controller | skipping: [instance] 2026-02-24 18:17:33.591405 | controller | 2026-02-24 18:17:33.591442 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2026-02-24 18:17:33.591452 | controller | Tuesday 24 February 2026 18:17:33 +0000 (0:00:00.021) 0:02:08.433 ****** 2026-02-24 18:17:33.591464 | controller | skipping: [instance] 2026-02-24 18:17:33.591498 | controller | 2026-02-24 18:17:33.591713 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2026-02-24 18:17:33.620211 | controller | Tuesday 24 February 2026 18:17:33 +0000 (0:00:00.029) 0:02:08.462 ****** 2026-02-24 18:17:33.620246 | controller | skipping: [instance] 2026-02-24 18:17:33.646718 | controller | 2026-02-24 18:17:33.646735 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2026-02-24 18:17:33.646742 | controller | Tuesday 24 February 2026 18:17:33 +0000 (0:00:00.028) 0:02:08.491 ****** 2026-02-24 18:17:33.646751 | controller | skipping: [instance] 2026-02-24 18:17:33.860782 | controller | 2026-02-24 18:17:33.860802 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 18:17:33.860809 | controller | Tuesday 24 February 2026 18:17:33 +0000 (0:00:00.026) 0:02:08.518 ****** 2026-02-24 18:17:33.860818 | controller | changed: [instance] 2026-02-24 18:17:33.898808 | controller | 2026-02-24 18:17:33.898828 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 18:17:33.898839 | controller | Tuesday 24 February 2026 18:17:33 +0000 (0:00:00.213) 0:02:08.732 ****** 2026-02-24 18:17:33.898847 | controller | ok: [instance] 2026-02-24 18:17:33.985794 | controller | 2026-02-24 18:17:33.985824 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 18:17:33.985831 | controller | Tuesday 24 February 2026 18:17:33 +0000 (0:00:00.038) 0:02:08.770 ****** 2026-02-24 18:17:33.985845 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-24 18:17:34.181764 | controller | 2026-02-24 18:17:34.181785 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-24 18:17:34.181793 | controller | Tuesday 24 February 2026 18:17:33 +0000 (0:00:00.086) 0:02:08.857 ****** 2026-02-24 18:17:34.181803 | controller | ok: [instance] 2026-02-24 18:17:34.244448 | controller | 2026-02-24 18:17:34.244487 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-24 18:17:34.244497 | controller | Tuesday 24 February 2026 18:17:34 +0000 (0:00:00.195) 0:02:09.053 ****** 2026-02-24 18:17:34.244509 | controller | ok: [instance] 2026-02-24 18:17:34.244532 | controller | 2026-02-24 18:17:34.244558 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-24 18:17:34.244706 | controller | Tuesday 24 February 2026 18:17:34 +0000 (0:00:00.062) 0:02:09.116 ****** 2026-02-24 18:17:34.291389 | controller | ok: [instance] 2026-02-24 18:17:34.291458 | controller | 2026-02-24 18:17:34.291638 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-24 18:17:34.336370 | controller | Tuesday 24 February 2026 18:17:34 +0000 (0:00:00.046) 0:02:09.163 ****** 2026-02-24 18:17:34.336404 | controller | skipping: [instance] 2026-02-24 18:17:34.336580 | controller | 2026-02-24 18:17:34.336604 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-24 18:17:34.379852 | controller | Tuesday 24 February 2026 18:17:34 +0000 (0:00:00.044) 0:02:09.207 ****** 2026-02-24 18:17:34.379872 | controller | skipping: [instance] 2026-02-24 18:17:34.440945 | controller | 2026-02-24 18:17:34.440966 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-24 18:17:34.440975 | controller | Tuesday 24 February 2026 18:17:34 +0000 (0:00:00.043) 0:02:09.251 ****** 2026-02-24 18:17:34.440985 | controller | 2026-02-24 18:17:34.841391 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-24 18:17:34.841423 | controller | Tuesday 24 February 2026 18:17:34 +0000 (0:00:00.061) 0:02:09.312 ****** 2026-02-24 18:17:34.841435 | controller | ok: [instance] => (item=artifacts) 2026-02-24 18:17:34.841461 | controller | ok: [instance] => (item=logs) 2026-02-24 18:17:34.841469 | controller | 2026-02-24 18:17:34.841653 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-24 18:17:36.015025 | controller | Tuesday 24 February 2026 18:17:34 +0000 (0:00:00.400) 0:02:09.712 ****** 2026-02-24 18:17:36.015065 | controller | ok: [instance] 2026-02-24 18:17:36.227921 | controller | 2026-02-24 18:17:36.227954 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-24 18:17:36.227964 | controller | Tuesday 24 February 2026 18:17:36 +0000 (0:00:01.173) 0:02:10.886 ****** 2026-02-24 18:17:36.227976 | controller | changed: [instance] 2026-02-24 18:17:36.602409 | controller | 2026-02-24 18:17:36.602444 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-24 18:17:36.602454 | controller | Tuesday 24 February 2026 18:17:36 +0000 (0:00:00.212) 0:02:11.099 ****** 2026-02-24 18:17:36.602466 | controller | changed: [instance] 2026-02-24 18:17:36.602496 | controller | 2026-02-24 18:17:36.602506 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-24 18:17:36.602679 | controller | Tuesday 24 February 2026 18:17:36 +0000 (0:00:00.374) 0:02:11.473 ****** 2026-02-24 18:17:36.977212 | controller | changed: [instance] 2026-02-24 18:17:37.024147 | controller | 2026-02-24 18:17:37.024170 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-24 18:17:37.024178 | controller | Tuesday 24 February 2026 18:17:36 +0000 (0:00:00.374) 0:02:11.848 ****** 2026-02-24 18:17:37.024187 | controller | skipping: [instance] 2026-02-24 18:17:37.224867 | controller | 2026-02-24 18:17:37.224894 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-24 18:17:37.224903 | controller | Tuesday 24 February 2026 18:17:37 +0000 (0:00:00.047) 0:02:11.895 ****** 2026-02-24 18:17:37.224915 | controller | ok: [instance] 2026-02-24 18:17:37.269072 | controller | 2026-02-24 18:17:37.269103 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-24 18:17:37.269115 | controller | Tuesday 24 February 2026 18:17:37 +0000 (0:00:00.200) 0:02:12.096 ****** 2026-02-24 18:17:37.269135 | controller | skipping: [instance] 2026-02-24 18:17:37.509412 | controller | 2026-02-24 18:17:37.509451 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-24 18:17:37.509461 | controller | Tuesday 24 February 2026 18:17:37 +0000 (0:00:00.043) 0:02:12.140 ****** 2026-02-24 18:17:37.509474 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2026-02-24 18:17:37.785640 | controller | changed: [instance] 2026-02-24 18:17:37.785671 | controller | 2026-02-24 18:17:37.785679 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 18:17:37.785685 | controller | Tuesday 24 February 2026 18:17:37 +0000 (0:00:00.240) 0:02:12.380 ****** 2026-02-24 18:17:37.785696 | controller | changed: [instance] 2026-02-24 18:17:37.831481 | controller | 2026-02-24 18:17:37.831523 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 18:17:37.831537 | controller | Tuesday 24 February 2026 18:17:37 +0000 (0:00:00.276) 0:02:12.656 ****** 2026-02-24 18:17:37.831553 | controller | skipping: [instance] 2026-02-24 18:17:37.831597 | controller | 2026-02-24 18:17:37.831612 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2026-02-24 18:17:37.831739 | controller | Tuesday 24 February 2026 18:17:37 +0000 (0:00:00.046) 0:02:12.703 ****** 2026-02-24 18:17:37.859835 | controller | skipping: [instance] 2026-02-24 18:17:38.103042 | controller | 2026-02-24 18:17:38.103070 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2026-02-24 18:17:38.103078 | controller | Tuesday 24 February 2026 18:17:37 +0000 (0:00:00.028) 0:02:12.731 ****** 2026-02-24 18:17:38.103088 | controller | changed: [instance] 2026-02-24 18:17:38.321396 | controller | 2026-02-24 18:17:38.321454 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2026-02-24 18:17:38.321465 | controller | Tuesday 24 February 2026 18:17:38 +0000 (0:00:00.243) 0:02:12.974 ****** 2026-02-24 18:17:38.321480 | controller | changed: [instance] 2026-02-24 18:17:38.608457 | controller | 2026-02-24 18:17:38.608503 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2026-02-24 18:17:38.608516 | controller | Tuesday 24 February 2026 18:17:38 +0000 (0:00:00.218) 0:02:13.192 ****** 2026-02-24 18:17:38.608542 | controller | changed: [instance] 2026-02-24 18:17:38.636067 | controller | 2026-02-24 18:17:38.636100 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2026-02-24 18:17:38.636108 | controller | Tuesday 24 February 2026 18:17:38 +0000 (0:00:00.287) 0:02:13.479 ****** 2026-02-24 18:17:38.636119 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 18:17:38.680129 | controller | 2026-02-24 18:17:38.680149 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 18:17:38.680156 | controller | Tuesday 24 February 2026 18:17:38 +0000 (0:00:00.027) 0:02:13.507 ****** 2026-02-24 18:17:38.680165 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 18:17:38.909071 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 18:17:38.909108 | controller | 2026-02-24 18:17:38.909118 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 18:17:38.909126 | controller | Tuesday 24 February 2026 18:17:38 +0000 (0:00:00.043) 0:02:13.551 ****** 2026-02-24 18:17:38.909138 | controller | ok: [instance] 2026-02-24 18:17:38.953357 | controller | 2026-02-24 18:17:38.953391 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 18:17:38.953400 | controller | Tuesday 24 February 2026 18:17:38 +0000 (0:00:00.228) 0:02:13.780 ****** 2026-02-24 18:17:38.953411 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:17:38.953815 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:17:38.953982 | controller | 2026-02-24 18:17:38.953993 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 18:17:39.180046 | controller | Tuesday 24 February 2026 18:17:38 +0000 (0:00:00.043) 0:02:13.823 ****** 2026-02-24 18:17:39.180074 | controller | ok: [instance] 2026-02-24 18:17:39.381111 | controller | 2026-02-24 18:17:39.381138 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 18:17:39.381148 | controller | Tuesday 24 February 2026 18:17:39 +0000 (0:00:00.227) 0:02:14.051 ****** 2026-02-24 18:17:39.381159 | controller | ok: [instance] 2026-02-24 18:17:39.660388 | controller | 2026-02-24 18:17:39.660431 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2026-02-24 18:17:39.660441 | controller | Tuesday 24 February 2026 18:17:39 +0000 (0:00:00.201) 0:02:14.252 ****** 2026-02-24 18:17:39.660455 | controller | changed: [instance] 2026-02-24 18:17:39.660487 | controller | 2026-02-24 18:17:39.660498 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 18:17:39.660585 | controller | Tuesday 24 February 2026 18:17:39 +0000 (0:00:00.279) 0:02:14.531 ****** 2026-02-24 18:17:39.891000 | controller | ok: [instance] 2026-02-24 18:17:39.935442 | controller | 2026-02-24 18:17:39.935496 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 18:17:39.935512 | controller | Tuesday 24 February 2026 18:17:39 +0000 (0:00:00.230) 0:02:14.762 ****** 2026-02-24 18:17:39.935531 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:17:39.935543 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:17:39.935553 | controller | 2026-02-24 18:17:39.935566 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 18:17:40.168365 | controller | Tuesday 24 February 2026 18:17:39 +0000 (0:00:00.044) 0:02:14.806 ****** 2026-02-24 18:17:40.168405 | controller | ok: [instance] 2026-02-24 18:17:40.367073 | controller | 2026-02-24 18:17:40.367108 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 18:17:40.367116 | controller | Tuesday 24 February 2026 18:17:40 +0000 (0:00:00.232) 0:02:15.039 ****** 2026-02-24 18:17:40.367126 | controller | ok: [instance] 2026-02-24 18:17:40.651356 | controller | 2026-02-24 18:17:40.651388 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2026-02-24 18:17:40.651396 | controller | Tuesday 24 February 2026 18:17:40 +0000 (0:00:00.198) 0:02:15.238 ****** 2026-02-24 18:17:40.651410 | controller | changed: [instance] 2026-02-24 18:17:40.672090 | controller | 2026-02-24 18:17:40.672130 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2026-02-24 18:17:40.672140 | controller | Tuesday 24 February 2026 18:17:40 +0000 (0:00:00.284) 0:02:15.522 ****** 2026-02-24 18:17:40.672153 | controller | skipping: [instance] 2026-02-24 18:17:40.698241 | controller | 2026-02-24 18:17:40.698261 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2026-02-24 18:17:40.698289 | controller | Tuesday 24 February 2026 18:17:40 +0000 (0:00:00.020) 0:02:15.543 ****** 2026-02-24 18:17:40.698301 | controller | skipping: [instance] 2026-02-24 18:17:40.726019 | controller | 2026-02-24 18:17:40.726040 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2026-02-24 18:17:40.726048 | controller | Tuesday 24 February 2026 18:17:40 +0000 (0:00:00.026) 0:02:15.569 ****** 2026-02-24 18:17:40.726058 | controller | skipping: [instance] 2026-02-24 18:17:40.750928 | controller | 2026-02-24 18:17:40.750945 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2026-02-24 18:17:40.750952 | controller | Tuesday 24 February 2026 18:17:40 +0000 (0:00:00.027) 0:02:15.597 ****** 2026-02-24 18:17:40.750960 | controller | skipping: [instance] 2026-02-24 18:17:40.961860 | controller | 2026-02-24 18:17:40.961886 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 18:17:40.961895 | controller | Tuesday 24 February 2026 18:17:40 +0000 (0:00:00.024) 0:02:15.622 ****** 2026-02-24 18:17:40.961906 | controller | changed: [instance] 2026-02-24 18:17:40.995837 | controller | 2026-02-24 18:17:40.995858 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 18:17:40.995867 | controller | Tuesday 24 February 2026 18:17:40 +0000 (0:00:00.210) 0:02:15.833 ****** 2026-02-24 18:17:40.995877 | controller | ok: [instance] 2026-02-24 18:17:41.045764 | controller | 2026-02-24 18:17:41.045784 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 18:17:41.045793 | controller | Tuesday 24 February 2026 18:17:40 +0000 (0:00:00.034) 0:02:15.867 ****** 2026-02-24 18:17:41.045803 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-24 18:17:41.235035 | controller | 2026-02-24 18:17:41.235054 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-24 18:17:41.235062 | controller | Tuesday 24 February 2026 18:17:41 +0000 (0:00:00.049) 0:02:15.917 ****** 2026-02-24 18:17:41.235071 | controller | ok: [instance] 2026-02-24 18:17:41.295956 | controller | 2026-02-24 18:17:41.295974 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-24 18:17:41.295981 | controller | Tuesday 24 February 2026 18:17:41 +0000 (0:00:00.189) 0:02:16.106 ****** 2026-02-24 18:17:41.295989 | controller | ok: [instance] 2026-02-24 18:17:41.339801 | controller | 2026-02-24 18:17:41.339823 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-24 18:17:41.339832 | controller | Tuesday 24 February 2026 18:17:41 +0000 (0:00:00.060) 0:02:16.167 ****** 2026-02-24 18:17:41.339843 | controller | ok: [instance] 2026-02-24 18:17:41.381787 | controller | 2026-02-24 18:17:41.381809 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-24 18:17:41.381817 | controller | Tuesday 24 February 2026 18:17:41 +0000 (0:00:00.043) 0:02:16.211 ****** 2026-02-24 18:17:41.381827 | controller | skipping: [instance] 2026-02-24 18:17:41.426209 | controller | 2026-02-24 18:17:41.426235 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-24 18:17:41.426245 | controller | Tuesday 24 February 2026 18:17:41 +0000 (0:00:00.042) 0:02:16.253 ****** 2026-02-24 18:17:41.426254 | controller | skipping: [instance] 2026-02-24 18:17:41.484176 | controller | 2026-02-24 18:17:41.484196 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-24 18:17:41.484204 | controller | Tuesday 24 February 2026 18:17:41 +0000 (0:00:00.044) 0:02:16.297 ****** 2026-02-24 18:17:41.484223 | controller | 2026-02-24 18:17:41.881872 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-24 18:17:41.881898 | controller | Tuesday 24 February 2026 18:17:41 +0000 (0:00:00.057) 0:02:16.355 ****** 2026-02-24 18:17:41.881910 | controller | ok: [instance] => (item=artifacts) 2026-02-24 18:17:43.051206 | controller | ok: [instance] => (item=logs) 2026-02-24 18:17:43.051250 | controller | 2026-02-24 18:17:43.051259 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-24 18:17:43.051285 | controller | Tuesday 24 February 2026 18:17:41 +0000 (0:00:00.397) 0:02:16.753 ****** 2026-02-24 18:17:43.051302 | controller | ok: [instance] 2026-02-24 18:17:43.261827 | controller | 2026-02-24 18:17:43.261853 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-24 18:17:43.261861 | controller | Tuesday 24 February 2026 18:17:43 +0000 (0:00:01.169) 0:02:17.922 ****** 2026-02-24 18:17:43.261871 | controller | changed: [instance] 2026-02-24 18:17:43.626873 | controller | 2026-02-24 18:17:43.626907 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-24 18:17:43.626917 | controller | Tuesday 24 February 2026 18:17:43 +0000 (0:00:00.210) 0:02:18.133 ****** 2026-02-24 18:17:43.626929 | controller | changed: [instance] 2026-02-24 18:17:44.004426 | controller | 2026-02-24 18:17:44.004464 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-24 18:17:44.004475 | controller | Tuesday 24 February 2026 18:17:43 +0000 (0:00:00.364) 0:02:18.498 ****** 2026-02-24 18:17:44.004487 | controller | changed: [instance] 2026-02-24 18:17:44.004552 | controller | 2026-02-24 18:17:44.004581 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-24 18:17:44.004594 | controller | Tuesday 24 February 2026 18:17:44 +0000 (0:00:00.377) 0:02:18.875 ****** 2026-02-24 18:17:44.051053 | controller | skipping: [instance] 2026-02-24 18:17:44.251956 | controller | 2026-02-24 18:17:44.251979 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-24 18:17:44.251986 | controller | Tuesday 24 February 2026 18:17:44 +0000 (0:00:00.046) 0:02:18.922 ****** 2026-02-24 18:17:44.251995 | controller | ok: [instance] 2026-02-24 18:17:44.294146 | controller | 2026-02-24 18:17:44.294167 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-24 18:17:44.294175 | controller | Tuesday 24 February 2026 18:17:44 +0000 (0:00:00.201) 0:02:19.123 ****** 2026-02-24 18:17:44.294185 | controller | skipping: [instance] 2026-02-24 18:17:44.524615 | controller | 2026-02-24 18:17:44.524644 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-24 18:17:44.524652 | controller | Tuesday 24 February 2026 18:17:44 +0000 (0:00:00.042) 0:02:19.165 ****** 2026-02-24 18:17:44.524662 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2026-02-24 18:17:44.795370 | controller | changed: [instance] 2026-02-24 18:17:44.795406 | controller | 2026-02-24 18:17:44.795416 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 18:17:44.795424 | controller | Tuesday 24 February 2026 18:17:44 +0000 (0:00:00.230) 0:02:19.395 ****** 2026-02-24 18:17:44.795435 | controller | changed: [instance] 2026-02-24 18:17:44.795455 | controller | 2026-02-24 18:17:44.795465 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 18:17:44.795549 | controller | Tuesday 24 February 2026 18:17:44 +0000 (0:00:00.270) 0:02:19.666 ****** 2026-02-24 18:17:44.843695 | controller | skipping: [instance] 2026-02-24 18:17:44.871420 | controller | 2026-02-24 18:17:44.871447 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2026-02-24 18:17:44.871456 | controller | Tuesday 24 February 2026 18:17:44 +0000 (0:00:00.048) 0:02:19.714 ****** 2026-02-24 18:17:44.871467 | controller | skipping: [instance] 2026-02-24 18:17:44.871504 | controller | 2026-02-24 18:17:44.871663 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2026-02-24 18:17:45.122715 | controller | Tuesday 24 February 2026 18:17:44 +0000 (0:00:00.028) 0:02:19.743 ****** 2026-02-24 18:17:45.122751 | controller | changed: [instance] 2026-02-24 18:17:45.341700 | controller | 2026-02-24 18:17:45.341726 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2026-02-24 18:17:45.341746 | controller | Tuesday 24 February 2026 18:17:45 +0000 (0:00:00.250) 0:02:19.993 ****** 2026-02-24 18:17:45.341756 | controller | changed: [instance] 2026-02-24 18:17:45.640446 | controller | 2026-02-24 18:17:45.640479 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2026-02-24 18:17:45.640487 | controller | Tuesday 24 February 2026 18:17:45 +0000 (0:00:00.219) 0:02:20.213 ****** 2026-02-24 18:17:45.640498 | controller | changed: [instance] 2026-02-24 18:17:45.670086 | controller | 2026-02-24 18:17:45.670109 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2026-02-24 18:17:45.670116 | controller | Tuesday 24 February 2026 18:17:45 +0000 (0:00:00.298) 0:02:20.511 ****** 2026-02-24 18:17:45.670125 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 18:17:45.716444 | controller | 2026-02-24 18:17:45.716481 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 18:17:45.716491 | controller | Tuesday 24 February 2026 18:17:45 +0000 (0:00:00.029) 0:02:20.541 ****** 2026-02-24 18:17:45.716504 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 18:17:45.937256 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 18:17:45.937299 | controller | 2026-02-24 18:17:45.937307 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 18:17:45.937314 | controller | Tuesday 24 February 2026 18:17:45 +0000 (0:00:00.045) 0:02:20.587 ****** 2026-02-24 18:17:45.937323 | controller | ok: [instance] 2026-02-24 18:17:45.983111 | controller | 2026-02-24 18:17:45.983135 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 18:17:45.983143 | controller | Tuesday 24 February 2026 18:17:45 +0000 (0:00:00.221) 0:02:20.808 ****** 2026-02-24 18:17:45.983153 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:17:46.211199 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:17:46.211242 | controller | 2026-02-24 18:17:46.211250 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 18:17:46.211256 | controller | Tuesday 24 February 2026 18:17:45 +0000 (0:00:00.045) 0:02:20.854 ****** 2026-02-24 18:17:46.211281 | controller | ok: [instance] 2026-02-24 18:17:46.410143 | controller | 2026-02-24 18:17:46.410167 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 18:17:46.410175 | controller | Tuesday 24 February 2026 18:17:46 +0000 (0:00:00.227) 0:02:21.082 ****** 2026-02-24 18:17:46.410184 | controller | ok: [instance] 2026-02-24 18:17:46.692444 | controller | 2026-02-24 18:17:46.692485 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2026-02-24 18:17:46.692498 | controller | Tuesday 24 February 2026 18:17:46 +0000 (0:00:00.199) 0:02:21.281 ****** 2026-02-24 18:17:46.692515 | controller | changed: [instance] 2026-02-24 18:17:46.920931 | controller | 2026-02-24 18:17:46.920963 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 18:17:46.920971 | controller | Tuesday 24 February 2026 18:17:46 +0000 (0:00:00.281) 0:02:21.563 ****** 2026-02-24 18:17:46.920981 | controller | ok: [instance] 2026-02-24 18:17:46.964062 | controller | 2026-02-24 18:17:46.964092 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 18:17:46.964102 | controller | Tuesday 24 February 2026 18:17:46 +0000 (0:00:00.228) 0:02:21.792 ****** 2026-02-24 18:17:46.964114 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:17:47.192385 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:17:47.192416 | controller | 2026-02-24 18:17:47.192424 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 18:17:47.192431 | controller | Tuesday 24 February 2026 18:17:46 +0000 (0:00:00.043) 0:02:21.835 ****** 2026-02-24 18:17:47.192441 | controller | ok: [instance] 2026-02-24 18:17:47.192471 | controller | 2026-02-24 18:17:47.192479 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 18:17:47.192557 | controller | Tuesday 24 February 2026 18:17:47 +0000 (0:00:00.228) 0:02:22.063 ****** 2026-02-24 18:17:47.395323 | controller | ok: [instance] 2026-02-24 18:17:47.672232 | controller | 2026-02-24 18:17:47.672259 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2026-02-24 18:17:47.672283 | controller | Tuesday 24 February 2026 18:17:47 +0000 (0:00:00.202) 0:02:22.266 ****** 2026-02-24 18:17:47.672296 | controller | changed: [instance] 2026-02-24 18:17:47.695783 | controller | 2026-02-24 18:17:47.695806 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2026-02-24 18:17:47.695815 | controller | Tuesday 24 February 2026 18:17:47 +0000 (0:00:00.276) 0:02:22.543 ****** 2026-02-24 18:17:47.695826 | controller | skipping: [instance] 2026-02-24 18:17:47.725316 | controller | 2026-02-24 18:17:47.725335 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2026-02-24 18:17:47.725342 | controller | Tuesday 24 February 2026 18:17:47 +0000 (0:00:00.023) 0:02:22.567 ****** 2026-02-24 18:17:47.725354 | controller | skipping: [instance] 2026-02-24 18:17:47.725608 | controller | 2026-02-24 18:17:47.725624 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2026-02-24 18:17:47.754395 | controller | Tuesday 24 February 2026 18:17:47 +0000 (0:00:00.029) 0:02:22.596 ****** 2026-02-24 18:17:47.754434 | controller | skipping: [instance] 2026-02-24 18:17:47.754467 | controller | 2026-02-24 18:17:47.754478 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2026-02-24 18:17:47.754591 | controller | Tuesday 24 February 2026 18:17:47 +0000 (0:00:00.029) 0:02:22.626 ****** 2026-02-24 18:17:47.781703 | controller | skipping: [instance] 2026-02-24 18:17:47.992782 | controller | 2026-02-24 18:17:47.992805 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 18:17:47.992813 | controller | Tuesday 24 February 2026 18:17:47 +0000 (0:00:00.026) 0:02:22.653 ****** 2026-02-24 18:17:47.992822 | controller | changed: [instance] 2026-02-24 18:17:48.029429 | controller | 2026-02-24 18:17:48.029464 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 18:17:48.029473 | controller | Tuesday 24 February 2026 18:17:47 +0000 (0:00:00.211) 0:02:22.864 ****** 2026-02-24 18:17:48.029486 | controller | ok: [instance] 2026-02-24 18:17:48.029543 | controller | 2026-02-24 18:17:48.029561 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 18:17:48.029572 | controller | Tuesday 24 February 2026 18:17:48 +0000 (0:00:00.036) 0:02:22.900 ****** 2026-02-24 18:17:48.057075 | controller | skipping: [instance] 2026-02-24 18:17:48.083972 | controller | 2026-02-24 18:17:48.083994 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 18:17:48.084003 | controller | Tuesday 24 February 2026 18:17:48 +0000 (0:00:00.027) 0:02:22.928 ****** 2026-02-24 18:17:48.084014 | controller | skipping: [instance] 2026-02-24 18:17:48.127817 | controller | 2026-02-24 18:17:48.127835 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 18:17:48.127843 | controller | Tuesday 24 February 2026 18:17:48 +0000 (0:00:00.026) 0:02:22.955 ****** 2026-02-24 18:17:48.127851 | controller | skipping: [instance] 2026-02-24 18:17:48.154410 | controller | 2026-02-24 18:17:48.154444 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2026-02-24 18:17:48.154454 | controller | Tuesday 24 February 2026 18:17:48 +0000 (0:00:00.043) 0:02:22.999 ****** 2026-02-24 18:17:48.154466 | controller | skipping: [instance] 2026-02-24 18:17:48.219256 | controller | 2026-02-24 18:17:48.219303 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2026-02-24 18:17:48.219313 | controller | Tuesday 24 February 2026 18:17:48 +0000 (0:00:00.026) 0:02:23.025 ****** 2026-02-24 18:17:48.219324 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2026-02-24 18:17:48.453002 | controller | 2026-02-24 18:17:48.453023 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2026-02-24 18:17:48.453036 | controller | Tuesday 24 February 2026 18:17:48 +0000 (0:00:00.064) 0:02:23.090 ****** 2026-02-24 18:17:48.453045 | controller | ok: [instance] => (item=crc) 2026-02-24 18:17:50.524432 | controller | 2026-02-24 18:17:50.524466 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2026-02-24 18:17:50.524474 | controller | Tuesday 24 February 2026 18:17:48 +0000 (0:00:00.233) 0:02:23.324 ****** 2026-02-24 18:17:50.524484 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 18:17:50.524513 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 18:17:50.524860 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 18:17:51.070381 | controller | 2026-02-24 18:17:51.070423 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 18:17:51.070433 | controller | Tuesday 24 February 2026 18:17:50 +0000 (0:00:02.071) 0:02:25.395 ****** 2026-02-24 18:17:51.070446 | controller | changed: [instance] 2026-02-24 18:17:51.070472 | controller | 2026-02-24 18:17:51.070481 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 18:17:51.070575 | controller | Tuesday 24 February 2026 18:17:51 +0000 (0:00:00.545) 0:02:25.941 ****** 2026-02-24 18:17:51.534906 | controller | changed: [instance] 2026-02-24 18:17:52.027436 | controller | 2026-02-24 18:17:52.027468 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 18:17:52.027476 | controller | Tuesday 24 February 2026 18:17:51 +0000 (0:00:00.464) 0:02:26.406 ****** 2026-02-24 18:17:52.027486 | controller | changed: [instance] 2026-02-24 18:17:52.757204 | controller | 2026-02-24 18:17:52.757245 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2026-02-24 18:17:52.757254 | controller | Tuesday 24 February 2026 18:17:52 +0000 (0:00:00.490) 0:02:26.896 ****** 2026-02-24 18:17:52.757283 | controller | changed: [instance] => (item=compute-0.utility) 2026-02-24 18:18:18.963276 | controller | changed: [instance] => (item=controller-0.utility) 2026-02-24 18:18:18.963325 | controller | changed: [instance] => (item=crc-0.utility) 2026-02-24 18:18:18.963337 | controller | 2026-02-24 18:18:18.963343 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2026-02-24 18:18:18.963356 | controller | Tuesday 24 February 2026 18:17:52 +0000 (0:00:00.727) 0:02:27.623 ****** 2026-02-24 18:18:18.963367 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2026-02-24 18:18:19.093554 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2026-02-24 18:18:19.093581 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2026-02-24 18:18:19.093589 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2026-02-24 18:18:19.093595 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2026-02-24 18:18:19.093600 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2026-02-24 18:18:19.093606 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left). 2026-02-24 18:18:19.093611 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (83 retries left). 2026-02-24 18:18:19.093617 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j676550561681.25220', 'results_file': '/home/zuul/.ansible_async/j676550561681.25220', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2026-02-24 18:18:19.093630 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j435345924793.25237', 'results_file': '/home/zuul/.ansible_async/j435345924793.25237', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2026-02-24 18:18:19.093641 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j575614701499.25253', 'results_file': '/home/zuul/.ansible_async/j575614701499.25253', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2026-02-24 18:18:19.093647 | controller | 2026-02-24 18:18:19.093653 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2026-02-24 18:18:19.093659 | controller | Tuesday 24 February 2026 18:18:18 +0000 (0:00:26.209) 0:02:53.833 ****** 2026-02-24 18:18:19.093669 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 18:18:19.124500 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 18:18:19.124570 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 18:18:19.124578 | controller | 2026-02-24 18:18:19.124586 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 18:18:19.124593 | controller | Tuesday 24 February 2026 18:18:19 +0000 (0:00:00.131) 0:02:53.964 ****** 2026-02-24 18:18:19.124607 | controller | skipping: [instance] 2026-02-24 18:18:19.124628 | controller | 2026-02-24 18:18:19.124635 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2026-02-24 18:18:19.168808 | controller | Tuesday 24 February 2026 18:18:19 +0000 (0:00:00.031) 0:02:53.995 ****** 2026-02-24 18:18:19.168835 | controller | 2026-02-24 18:18:19.168905 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 18:18:19.169016 | controller | Tuesday 24 February 2026 18:18:19 +0000 (0:00:00.044) 0:02:54.040 ****** 2026-02-24 18:18:19.265748 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-24 18:18:19.265805 | controller | 2026-02-24 18:18:19.265897 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 18:18:19.265999 | controller | Tuesday 24 February 2026 18:18:19 +0000 (0:00:00.096) 0:02:54.137 ****** 2026-02-24 18:18:19.518708 | controller | changed: [instance] 2026-02-24 18:18:19.748287 | controller | 2026-02-24 18:18:19.748340 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 18:18:19.748348 | controller | Tuesday 24 February 2026 18:18:19 +0000 (0:00:00.252) 0:02:54.389 ****** 2026-02-24 18:18:19.748367 | controller | changed: [instance] 2026-02-24 18:18:19.748460 | controller | 2026-02-24 18:18:19.748472 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2026-02-24 18:18:19.748592 | controller | Tuesday 24 February 2026 18:18:19 +0000 (0:00:00.229) 0:02:54.618 ****** 2026-02-24 18:18:20.171761 | controller | changed: [instance] 2026-02-24 18:18:20.208646 | controller | 2026-02-24 18:18:20.208685 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2026-02-24 18:18:20.208693 | controller | Tuesday 24 February 2026 18:18:20 +0000 (0:00:00.423) 0:02:55.042 ****** 2026-02-24 18:18:20.208704 | controller | skipping: [instance] 2026-02-24 18:18:20.243529 | controller | 2026-02-24 18:18:20.243546 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 18:18:20.243552 | controller | Tuesday 24 February 2026 18:18:20 +0000 (0:00:00.037) 0:02:55.079 ****** 2026-02-24 18:18:20.243561 | controller | skipping: [instance] 2026-02-24 18:18:20.291034 | controller | 2026-02-24 18:18:20.291052 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2026-02-24 18:18:20.291066 | controller | Tuesday 24 February 2026 18:18:20 +0000 (0:00:00.035) 0:02:55.114 ****** 2026-02-24 18:18:20.291074 | controller | skipping: [instance] 2026-02-24 18:18:20.338646 | controller | 2026-02-24 18:18:20.338665 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2026-02-24 18:18:20.338671 | controller | Tuesday 24 February 2026 18:18:20 +0000 (0:00:00.047) 0:02:55.162 ****** 2026-02-24 18:18:20.338679 | controller | skipping: [instance] 2026-02-24 18:18:20.368938 | controller | 2026-02-24 18:18:20.368984 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 18:18:20.368993 | controller | Tuesday 24 February 2026 18:18:20 +0000 (0:00:00.047) 0:02:55.210 ****** 2026-02-24 18:18:20.369005 | controller | skipping: [instance] 2026-02-24 18:18:20.414781 | controller | 2026-02-24 18:18:20.414812 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2026-02-24 18:18:20.414821 | controller | Tuesday 24 February 2026 18:18:20 +0000 (0:00:00.029) 0:02:55.239 ****** 2026-02-24 18:18:20.414832 | controller | 2026-02-24 18:18:20.503246 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 18:18:20.503319 | controller | Tuesday 24 February 2026 18:18:20 +0000 (0:00:00.046) 0:02:55.286 ****** 2026-02-24 18:18:20.503337 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-24 18:18:20.735340 | controller | 2026-02-24 18:18:20.735385 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 18:18:20.735394 | controller | Tuesday 24 February 2026 18:18:20 +0000 (0:00:00.087) 0:02:55.374 ****** 2026-02-24 18:18:20.735410 | controller | ok: [instance] 2026-02-24 18:18:20.961905 | controller | 2026-02-24 18:18:20.961951 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 18:18:20.961959 | controller | Tuesday 24 February 2026 18:18:20 +0000 (0:00:00.232) 0:02:55.606 ****** 2026-02-24 18:18:20.961971 | controller | ok: [instance] 2026-02-24 18:18:20.962086 | controller | 2026-02-24 18:18:20.962345 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2026-02-24 18:18:21.383868 | controller | Tuesday 24 February 2026 18:18:20 +0000 (0:00:00.226) 0:02:55.833 ****** 2026-02-24 18:18:21.383905 | controller | changed: [instance] 2026-02-24 18:18:21.413731 | controller | 2026-02-24 18:18:21.413762 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2026-02-24 18:18:21.413770 | controller | Tuesday 24 February 2026 18:18:21 +0000 (0:00:00.421) 0:02:56.254 ****** 2026-02-24 18:18:21.413780 | controller | skipping: [instance] 2026-02-24 18:18:21.443392 | controller | 2026-02-24 18:18:21.443423 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 18:18:21.443431 | controller | Tuesday 24 February 2026 18:18:21 +0000 (0:00:00.029) 0:02:56.284 ****** 2026-02-24 18:18:21.443441 | controller | skipping: [instance] 2026-02-24 18:18:23.116419 | controller | 2026-02-24 18:18:23.116454 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2026-02-24 18:18:23.116462 | controller | Tuesday 24 February 2026 18:18:21 +0000 (0:00:00.029) 0:02:56.314 ****** 2026-02-24 18:18:23.116473 | controller | changed: [instance -> controller-0.instance] 2026-02-24 18:18:24.466912 | controller | 2026-02-24 18:18:24.466946 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2026-02-24 18:18:24.466954 | controller | Tuesday 24 February 2026 18:18:23 +0000 (0:00:01.672) 0:02:57.987 ****** 2026-02-24 18:18:24.466965 | controller | changed: [instance -> controller-0.instance] 2026-02-24 18:18:24.517387 | controller | 2026-02-24 18:18:24.517408 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 18:18:24.517417 | controller | Tuesday 24 February 2026 18:18:24 +0000 (0:00:01.350) 0:02:59.337 ****** 2026-02-24 18:18:24.517431 | controller | 2026-02-24 18:18:24.765011 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-24 18:18:24.765038 | controller | Tuesday 24 February 2026 18:18:24 +0000 (0:00:00.050) 0:02:59.388 ****** 2026-02-24 18:18:24.765050 | controller | ok: [instance] 2026-02-24 18:18:24.796393 | controller | 2026-02-24 18:18:24.796413 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-24 18:18:24.796421 | controller | Tuesday 24 February 2026 18:18:24 +0000 (0:00:00.247) 0:02:59.636 ****** 2026-02-24 18:18:24.796430 | controller | ok: [instance] 2026-02-24 18:18:24.830172 | controller | 2026-02-24 18:18:24.830191 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-24 18:18:24.830209 | controller | Tuesday 24 February 2026 18:18:24 +0000 (0:00:00.031) 0:02:59.667 ****** 2026-02-24 18:18:24.830220 | controller | skipping: [instance] 2026-02-24 18:18:24.884105 | controller | 2026-02-24 18:18:24.884124 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2026-02-24 18:18:24.884131 | controller | Tuesday 24 February 2026 18:18:24 +0000 (0:00:00.033) 0:02:59.701 ****** 2026-02-24 18:18:24.884141 | controller | 2026-02-24 18:18:24.987347 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 18:18:24.987372 | controller | Tuesday 24 February 2026 18:18:24 +0000 (0:00:00.053) 0:02:59.755 ****** 2026-02-24 18:18:24.987384 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2026-02-24 18:18:25.238160 | controller | 2026-02-24 18:18:25.238192 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 18:18:25.238211 | controller | Tuesday 24 February 2026 18:18:24 +0000 (0:00:00.102) 0:02:59.858 ****** 2026-02-24 18:18:25.238223 | controller | ok: [instance] 2026-02-24 18:18:25.508303 | controller | 2026-02-24 18:18:25.508334 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 18:18:25.508342 | controller | Tuesday 24 February 2026 18:18:25 +0000 (0:00:00.250) 0:03:00.109 ****** 2026-02-24 18:18:25.508354 | controller | ok: [instance] 2026-02-24 18:18:25.940701 | controller | 2026-02-24 18:18:25.940735 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2026-02-24 18:18:25.940743 | controller | Tuesday 24 February 2026 18:18:25 +0000 (0:00:00.265) 0:03:00.374 ****** 2026-02-24 18:18:25.940752 | controller | changed: [instance] 2026-02-24 18:18:26.869311 | controller | 2026-02-24 18:18:26.869341 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2026-02-24 18:18:26.869354 | controller | Tuesday 24 February 2026 18:18:25 +0000 (0:00:00.437) 0:03:00.811 ****** 2026-02-24 18:18:26.869364 | controller | changed: [instance] 2026-02-24 18:18:26.896648 | controller | 2026-02-24 18:18:26.896665 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 18:18:26.896672 | controller | Tuesday 24 February 2026 18:18:26 +0000 (0:00:00.928) 0:03:01.739 ****** 2026-02-24 18:18:26.896680 | controller | skipping: [instance] 2026-02-24 18:18:26.943134 | controller | 2026-02-24 18:18:26.943151 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2026-02-24 18:18:26.943157 | controller | Tuesday 24 February 2026 18:18:26 +0000 (0:00:00.028) 0:03:01.768 ****** 2026-02-24 18:18:26.943165 | controller | skipping: [instance] 2026-02-24 18:18:27.001700 | controller | 2026-02-24 18:18:27.001719 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2026-02-24 18:18:27.001727 | controller | Tuesday 24 February 2026 18:18:26 +0000 (0:00:00.046) 0:03:01.814 ****** 2026-02-24 18:18:27.001736 | controller | skipping: [instance] 2026-02-24 18:18:27.068482 | controller | 2026-02-24 18:18:27.068505 | controller | TASK [Create VBMC entity] ****************************************************** 2026-02-24 18:18:27.068523 | controller | Tuesday 24 February 2026 18:18:26 +0000 (0:00:00.058) 0:03:01.872 ****** 2026-02-24 18:18:27.068532 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 18:18:27.351468 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 18:18:27.351533 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 18:18:27.351542 | controller | skipping: [instance] 2026-02-24 18:18:27.351549 | controller | 2026-02-24 18:18:27.351556 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2026-02-24 18:18:27.351563 | controller | Tuesday 24 February 2026 18:18:27 +0000 (0:00:00.063) 0:03:01.936 ****** 2026-02-24 18:18:27.351577 | controller | ok: [instance] 2026-02-24 18:18:27.351598 | controller | 2026-02-24 18:18:27.351604 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2026-02-24 18:18:27.351611 | controller | Tuesday 24 February 2026 18:18:27 +0000 (0:00:00.286) 0:03:02.222 ****** 2026-02-24 18:18:27.743239 | controller | changed: [instance] 2026-02-24 18:18:27.743415 | controller | 2026-02-24 18:18:27.743555 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2026-02-24 18:18:27.743685 | controller | Tuesday 24 February 2026 18:18:27 +0000 (0:00:00.392) 0:03:02.614 ****** 2026-02-24 18:18:27.783614 | controller | skipping: [instance] 2026-02-24 18:18:27.783752 | controller | 2026-02-24 18:18:27.783882 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2026-02-24 18:18:27.784017 | controller | Tuesday 24 February 2026 18:18:27 +0000 (0:00:00.040) 0:03:02.655 ****** 2026-02-24 18:18:27.837175 | controller | skipping: [instance] 2026-02-24 18:18:27.837362 | controller | 2026-02-24 18:18:27.837509 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2026-02-24 18:18:27.837648 | controller | Tuesday 24 February 2026 18:18:27 +0000 (0:00:00.053) 0:03:02.708 ****** 2026-02-24 18:18:27.882560 | controller | skipping: [instance] 2026-02-24 18:18:27.882705 | controller | 2026-02-24 18:18:27.882856 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2026-02-24 18:18:27.883000 | controller | Tuesday 24 February 2026 18:18:27 +0000 (0:00:00.042) 0:03:02.751 ****** 2026-02-24 18:18:28.826700 | controller | changed: [instance] 2026-02-24 18:18:28.826863 | controller | 2026-02-24 18:18:28.826996 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2026-02-24 18:18:28.827132 | controller | Tuesday 24 February 2026 18:18:28 +0000 (0:00:00.941) 0:03:03.693 ****** 2026-02-24 18:18:29.761038 | controller | changed: [instance] 2026-02-24 18:18:29.808958 | controller | 2026-02-24 18:18:29.808977 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2026-02-24 18:18:29.808985 | controller | Tuesday 24 February 2026 18:18:29 +0000 (0:00:00.938) 0:03:04.631 ****** 2026-02-24 18:18:29.808994 | controller | skipping: [instance] 2026-02-24 18:18:29.880488 | controller | 2026-02-24 18:18:29.880567 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2026-02-24 18:18:29.880579 | controller | Tuesday 24 February 2026 18:18:29 +0000 (0:00:00.048) 0:03:04.680 ****** 2026-02-24 18:18:29.880598 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2026-02-24 18:18:29.880635 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2026-02-24 18:18:29.880920 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2026-02-24 18:18:29.880947 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2026-02-24 18:18:29.880961 | controller | 2026-02-24 18:18:29.932053 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2026-02-24 18:18:29.932079 | controller | Tuesday 24 February 2026 18:18:29 +0000 (0:00:00.071) 0:03:04.751 ****** 2026-02-24 18:18:29.932093 | controller | skipping: [instance] 2026-02-24 18:18:29.975761 | controller | 2026-02-24 18:18:29.975783 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2026-02-24 18:18:29.975801 | controller | Tuesday 24 February 2026 18:18:29 +0000 (0:00:00.051) 0:03:04.803 ****** 2026-02-24 18:18:29.975819 | controller | skipping: [instance] 2026-02-24 18:18:30.016395 | controller | 2026-02-24 18:18:30.016459 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2026-02-24 18:18:30.016471 | controller | Tuesday 24 February 2026 18:18:29 +0000 (0:00:00.043) 0:03:04.847 ****** 2026-02-24 18:18:30.016488 | controller | skipping: [instance] 2026-02-24 18:18:30.016539 | controller | 2026-02-24 18:18:30.016633 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2026-02-24 18:18:30.016655 | controller | Tuesday 24 February 2026 18:18:30 +0000 (0:00:00.041) 0:03:04.888 ****** 2026-02-24 18:18:30.061415 | controller | skipping: [instance] 2026-02-24 18:18:30.061484 | controller | 2026-02-24 18:18:30.061500 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2026-02-24 18:18:30.061511 | controller | Tuesday 24 February 2026 18:18:30 +0000 (0:00:00.044) 0:03:04.932 ****** 2026-02-24 18:18:30.772787 | controller | changed: [instance] 2026-02-24 18:18:30.813403 | controller | 2026-02-24 18:18:30.813425 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2026-02-24 18:18:30.813433 | controller | Tuesday 24 February 2026 18:18:30 +0000 (0:00:00.710) 0:03:05.643 ****** 2026-02-24 18:18:30.813442 | controller | skipping: [instance] 2026-02-24 18:18:30.813487 | controller | 2026-02-24 18:18:30.813497 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2026-02-24 18:18:30.813614 | controller | Tuesday 24 February 2026 18:18:30 +0000 (0:00:00.041) 0:03:05.684 ****** 2026-02-24 18:18:30.851885 | controller | skipping: [instance] 2026-02-24 18:18:30.852000 | controller | 2026-02-24 18:18:30.852217 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2026-02-24 18:18:30.852388 | controller | Tuesday 24 February 2026 18:18:30 +0000 (0:00:00.038) 0:03:05.723 ****** 2026-02-24 18:18:30.888856 | controller | skipping: [instance] 2026-02-24 18:18:30.888987 | controller | 2026-02-24 18:18:30.889192 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-24 18:18:30.889380 | controller | Tuesday 24 February 2026 18:18:30 +0000 (0:00:00.037) 0:03:05.760 ****** 2026-02-24 18:18:30.933826 | controller | skipping: [instance] 2026-02-24 18:18:30.933955 | controller | 2026-02-24 18:18:30.933972 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-24 18:18:30.934046 | controller | Tuesday 24 February 2026 18:18:30 +0000 (0:00:00.044) 0:03:05.805 ****** 2026-02-24 18:18:30.974970 | controller | skipping: [instance] 2026-02-24 18:18:30.975094 | controller | 2026-02-24 18:18:30.975111 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-24 18:18:30.975181 | controller | Tuesday 24 February 2026 18:18:30 +0000 (0:00:00.041) 0:03:05.846 ****** 2026-02-24 18:18:31.014357 | controller | skipping: [instance] 2026-02-24 18:18:31.014435 | controller | 2026-02-24 18:18:31.014525 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-24 18:18:31.014613 | controller | Tuesday 24 February 2026 18:18:31 +0000 (0:00:00.039) 0:03:05.886 ****** 2026-02-24 18:18:31.057474 | controller | skipping: [instance] 2026-02-24 18:18:31.057520 | controller | 2026-02-24 18:18:31.057627 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-24 18:18:31.057712 | controller | Tuesday 24 February 2026 18:18:31 +0000 (0:00:00.043) 0:03:05.929 ****** 2026-02-24 18:18:31.094983 | controller | skipping: [instance] 2026-02-24 18:18:31.095064 | controller | 2026-02-24 18:18:31.095163 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-24 18:18:31.095295 | controller | Tuesday 24 February 2026 18:18:31 +0000 (0:00:00.037) 0:03:05.966 ****** 2026-02-24 18:18:31.135083 | controller | skipping: [instance] 2026-02-24 18:18:31.135226 | controller | 2026-02-24 18:18:31.135244 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-24 18:18:31.135328 | controller | Tuesday 24 February 2026 18:18:31 +0000 (0:00:00.040) 0:03:06.006 ****** 2026-02-24 18:18:31.190020 | controller | skipping: [instance] 2026-02-24 18:18:31.190087 | controller | 2026-02-24 18:18:31.190364 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2026-02-24 18:18:31.190475 | controller | Tuesday 24 February 2026 18:18:31 +0000 (0:00:00.054) 0:03:06.061 ****** 2026-02-24 18:18:31.230187 | controller | skipping: [instance] 2026-02-24 18:18:31.230321 | controller | 2026-02-24 18:18:31.230481 | controller | TASK [reproducer : Configure Controller node] ********************************** 2026-02-24 18:18:31.230642 | controller | Tuesday 24 February 2026 18:18:31 +0000 (0:00:00.039) 0:03:06.101 ****** 2026-02-24 18:18:31.391188 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2026-02-24 18:18:31.391244 | controller | 2026-02-24 18:18:31.391367 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-24 18:18:31.391458 | controller | Tuesday 24 February 2026 18:18:31 +0000 (0:00:00.161) 0:03:06.262 ****** 2026-02-24 18:18:32.823107 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-24 18:18:32.823255 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-24 18:18:32.823313 | controller | 2026-02-24 18:18:32.823324 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-24 18:18:32.823439 | controller | Tuesday 24 February 2026 18:18:32 +0000 (0:00:01.431) 0:03:07.694 ****** 2026-02-24 18:18:32.849805 | controller | skipping: [instance] 2026-02-24 18:18:32.849885 | controller | 2026-02-24 18:18:32.849897 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-24 18:18:32.850054 | controller | Tuesday 24 February 2026 18:18:32 +0000 (0:00:00.026) 0:03:07.721 ****** 2026-02-24 18:18:33.523166 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:18:33.565440 | controller | 2026-02-24 18:18:33.565488 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-24 18:18:33.565497 | controller | Tuesday 24 February 2026 18:18:33 +0000 (0:00:00.673) 0:03:08.394 ****** 2026-02-24 18:18:33.565510 | controller | skipping: [instance] 2026-02-24 18:18:33.608388 | controller | 2026-02-24 18:18:33.608413 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-24 18:18:33.608423 | controller | Tuesday 24 February 2026 18:18:33 +0000 (0:00:00.042) 0:03:08.436 ****** 2026-02-24 18:18:33.608442 | controller | skipping: [instance] 2026-02-24 18:18:33.608467 | controller | 2026-02-24 18:18:33.608566 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-24 18:18:33.608663 | controller | Tuesday 24 February 2026 18:18:33 +0000 (0:00:00.043) 0:03:08.480 ****** 2026-02-24 18:18:33.653258 | controller | skipping: [instance] 2026-02-24 18:18:33.653333 | controller | 2026-02-24 18:18:33.653512 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-24 18:18:33.653545 | controller | Tuesday 24 February 2026 18:18:33 +0000 (0:00:00.044) 0:03:08.524 ****** 2026-02-24 18:18:33.707066 | controller | skipping: [instance] 2026-02-24 18:18:33.747481 | controller | 2026-02-24 18:18:33.747522 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2026-02-24 18:18:33.747533 | controller | Tuesday 24 February 2026 18:18:33 +0000 (0:00:00.053) 0:03:08.577 ****** 2026-02-24 18:18:33.747547 | controller | skipping: [instance] 2026-02-24 18:18:33.747584 | controller | 2026-02-24 18:18:33.747593 | controller | TASK [reproducer : Install repos] ********************************************** 2026-02-24 18:18:33.747603 | controller | Tuesday 24 February 2026 18:18:33 +0000 (0:00:00.040) 0:03:08.618 ****** 2026-02-24 18:18:33.789577 | controller | skipping: [instance] 2026-02-24 18:18:33.789655 | controller | 2026-02-24 18:18:33.789662 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2026-02-24 18:18:33.789672 | controller | Tuesday 24 February 2026 18:18:33 +0000 (0:00:00.041) 0:03:08.660 ****** 2026-02-24 18:18:33.830099 | controller | skipping: [instance] 2026-02-24 18:18:33.869437 | controller | 2026-02-24 18:18:33.869472 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2026-02-24 18:18:33.869483 | controller | Tuesday 24 February 2026 18:18:33 +0000 (0:00:00.040) 0:03:08.701 ****** 2026-02-24 18:18:33.869504 | controller | skipping: [instance] 2026-02-24 18:18:33.869716 | controller | 2026-02-24 18:18:33.869857 | controller | TASK [reproducer : Install some tools] ***************************************** 2026-02-24 18:18:33.869883 | controller | Tuesday 24 February 2026 18:18:33 +0000 (0:00:00.039) 0:03:08.740 ****** 2026-02-24 18:18:35.090735 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:18:36.386699 | controller | 2026-02-24 18:18:36.386741 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2026-02-24 18:18:36.386750 | controller | Tuesday 24 February 2026 18:18:35 +0000 (0:00:01.220) 0:03:09.961 ****** 2026-02-24 18:18:36.386762 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:18:37.069414 | controller | 2026-02-24 18:18:37.069448 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2026-02-24 18:18:37.069457 | controller | Tuesday 24 February 2026 18:18:36 +0000 (0:00:01.295) 0:03:11.257 ****** 2026-02-24 18:18:37.069468 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:18:38.107513 | controller | 2026-02-24 18:18:38.107612 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2026-02-24 18:18:38.107621 | controller | Tuesday 24 February 2026 18:18:37 +0000 (0:00:00.683) 0:03:11.940 ****** 2026-02-24 18:18:38.107639 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:18:39.435186 | controller | 2026-02-24 18:18:39.435252 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2026-02-24 18:18:39.435283 | controller | Tuesday 24 February 2026 18:18:38 +0000 (0:00:01.037) 0:03:12.977 ****** 2026-02-24 18:18:39.435299 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-24 18:18:40.260249 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 18:18:40.260316 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 18:18:40.260323 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 18:18:40.260338 | controller | 2026-02-24 18:18:40.260345 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2026-02-24 18:18:40.260352 | controller | Tuesday 24 February 2026 18:18:39 +0000 (0:00:01.328) 0:03:14.305 ****** 2026-02-24 18:18:40.260364 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-24 18:18:42.074219 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 18:18:42.074293 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 18:18:42.074304 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 18:18:42.074310 | controller | 2026-02-24 18:18:42.074317 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2026-02-24 18:18:42.074324 | controller | Tuesday 24 February 2026 18:18:40 +0000 (0:00:00.825) 0:03:15.130 ****** 2026-02-24 18:18:42.074336 | controller | skipping: [instance] => (item=instance) 2026-02-24 18:18:42.691534 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2026-02-24 18:18:42.691605 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-24 18:18:42.691613 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2026-02-24 18:18:42.691619 | controller | 2026-02-24 18:18:42.691625 | controller | TASK [reproducer : Create kube directory] ************************************** 2026-02-24 18:18:42.691630 | controller | Tuesday 24 February 2026 18:18:42 +0000 (0:00:01.813) 0:03:16.944 ****** 2026-02-24 18:18:42.691642 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:18:43.731207 | controller | 2026-02-24 18:18:43.732252 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2026-02-24 18:18:43.732288 | controller | Tuesday 24 February 2026 18:18:42 +0000 (0:00:00.617) 0:03:17.561 ****** 2026-02-24 18:18:43.732304 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:18:44.756175 | controller | 2026-02-24 18:18:44.756228 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2026-02-24 18:18:44.756236 | controller | Tuesday 24 February 2026 18:18:43 +0000 (0:00:01.036) 0:03:18.597 ****** 2026-02-24 18:18:44.756254 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:18:44.788204 | controller | 2026-02-24 18:18:44.788222 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2026-02-24 18:18:44.788228 | controller | Tuesday 24 February 2026 18:18:44 +0000 (0:00:01.025) 0:03:19.623 ****** 2026-02-24 18:18:44.788237 | controller | skipping: [instance] 2026-02-24 18:18:45.384045 | controller | 2026-02-24 18:18:45.384119 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2026-02-24 18:18:45.384127 | controller | Tuesday 24 February 2026 18:18:44 +0000 (0:00:00.035) 0:03:19.659 ****** 2026-02-24 18:18:45.384140 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:18:46.058996 | controller | 2026-02-24 18:18:46.059059 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2026-02-24 18:18:46.059068 | controller | Tuesday 24 February 2026 18:18:45 +0000 (0:00:00.593) 0:03:20.252 ****** 2026-02-24 18:18:46.059088 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:18:46.116503 | controller | 2026-02-24 18:18:46.116553 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2026-02-24 18:18:46.116562 | controller | Tuesday 24 February 2026 18:18:46 +0000 (0:00:00.674) 0:03:20.927 ****** 2026-02-24 18:18:46.116575 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:18:46.179999 | controller | 2026-02-24 18:18:46.180016 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2026-02-24 18:18:46.180023 | controller | Tuesday 24 February 2026 18:18:46 +0000 (0:00:00.054) 0:03:20.982 ****** 2026-02-24 18:18:46.180032 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2026-02-24 18:18:46.240252 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2026-02-24 18:18:46.240305 | controller | 2026-02-24 18:18:46.240314 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-24 18:18:46.240321 | controller | Tuesday 24 February 2026 18:18:46 +0000 (0:00:00.068) 0:03:21.051 ****** 2026-02-24 18:18:46.240331 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 18:18:46.318531 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2026-02-24 18:18:46.318548 | controller | 2026-02-24 18:18:46.318555 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-24 18:18:46.318561 | controller | Tuesday 24 February 2026 18:18:46 +0000 (0:00:00.060) 0:03:21.111 ****** 2026-02-24 18:18:46.318569 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 18:18:46.369378 | controller | _secret_file: '' 2026-02-24 18:18:46.369397 | controller | 2026-02-24 18:18:46.369404 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-24 18:18:46.369410 | controller | Tuesday 24 February 2026 18:18:46 +0000 (0:00:00.073) 0:03:21.184 ****** 2026-02-24 18:18:46.369418 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 18:18:46.423627 | controller | _secret_content: my-default-location-place 2026-02-24 18:18:46.423663 | controller | 2026-02-24 18:18:46.423678 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-24 18:18:46.423690 | controller | Tuesday 24 February 2026 18:18:46 +0000 (0:00:00.055) 0:03:21.240 ****** 2026-02-24 18:18:46.423706 | controller | skipping: [instance] 2026-02-24 18:18:46.476315 | controller | 2026-02-24 18:18:46.476338 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-24 18:18:46.476353 | controller | Tuesday 24 February 2026 18:18:46 +0000 (0:00:00.053) 0:03:21.294 ****** 2026-02-24 18:18:46.476363 | controller | skipping: [instance] 2026-02-24 18:18:46.526541 | controller | 2026-02-24 18:18:46.526562 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-24 18:18:46.526577 | controller | Tuesday 24 February 2026 18:18:46 +0000 (0:00:00.052) 0:03:21.347 ****** 2026-02-24 18:18:46.526587 | controller | skipping: [instance] 2026-02-24 18:18:47.700307 | controller | 2026-02-24 18:18:47.700364 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-24 18:18:47.700373 | controller | Tuesday 24 February 2026 18:18:46 +0000 (0:00:00.050) 0:03:21.397 ****** 2026-02-24 18:18:47.700385 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:18:47.768211 | controller | 2026-02-24 18:18:47.768245 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-24 18:18:47.768257 | controller | Tuesday 24 February 2026 18:18:47 +0000 (0:00:01.172) 0:03:22.570 ****** 2026-02-24 18:18:47.768304 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 18:18:47.824872 | controller | _secret_dest: /home/zuul/ipmi-things 2026-02-24 18:18:47.824892 | controller | 2026-02-24 18:18:47.824899 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-24 18:18:47.824905 | controller | Tuesday 24 February 2026 18:18:47 +0000 (0:00:00.068) 0:03:22.639 ****** 2026-02-24 18:18:47.824913 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 18:18:47.880311 | controller | _secret_file: /tmp/ipmi-things 2026-02-24 18:18:47.880329 | controller | 2026-02-24 18:18:47.880336 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-24 18:18:47.880342 | controller | Tuesday 24 February 2026 18:18:47 +0000 (0:00:00.057) 0:03:22.696 ****** 2026-02-24 18:18:47.880350 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 18:18:47.940726 | controller | _secret_content: '' 2026-02-24 18:18:47.940744 | controller | 2026-02-24 18:18:47.940751 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-24 18:18:47.940756 | controller | Tuesday 24 February 2026 18:18:47 +0000 (0:00:00.055) 0:03:22.751 ****** 2026-02-24 18:18:47.940764 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2026-02-24 18:18:48.750354 | controller | msg: All assertions passed 2026-02-24 18:18:48.750411 | controller | 2026-02-24 18:18:48.750419 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-24 18:18:48.750427 | controller | Tuesday 24 February 2026 18:18:47 +0000 (0:00:00.060) 0:03:22.811 ****** 2026-02-24 18:18:48.750440 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:18:50.000322 | controller | 2026-02-24 18:18:50.000383 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-24 18:18:50.000392 | controller | Tuesday 24 February 2026 18:18:48 +0000 (0:00:00.809) 0:03:23.620 ****** 2026-02-24 18:18:50.000406 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:18:50.063978 | controller | 2026-02-24 18:18:50.064018 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-24 18:18:50.064028 | controller | Tuesday 24 February 2026 18:18:49 +0000 (0:00:01.249) 0:03:24.870 ****** 2026-02-24 18:18:50.064042 | controller | skipping: [instance] 2026-02-24 18:18:50.772174 | controller | 2026-02-24 18:18:50.772221 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2026-02-24 18:18:50.772230 | controller | Tuesday 24 February 2026 18:18:50 +0000 (0:00:00.064) 0:03:24.935 ****** 2026-02-24 18:18:50.772241 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:18:51.455844 | controller | 2026-02-24 18:18:51.455881 | controller | TASK [reproducer : Check if async file is still available] ********************* 2026-02-24 18:18:51.455889 | controller | Tuesday 24 February 2026 18:18:50 +0000 (0:00:00.708) 0:03:25.643 ****** 2026-02-24 18:18:51.455900 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:19:36.833041 | controller | 2026-02-24 18:19:36.833105 | controller | TASK [reproducer : Check package install status] ******************************* 2026-02-24 18:19:36.833114 | controller | Tuesday 24 February 2026 18:18:51 +0000 (0:00:00.683) 0:03:26.326 ****** 2026-02-24 18:19:36.833128 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2026-02-24 18:19:37.564776 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2026-02-24 18:19:37.564835 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2026-02-24 18:19:37.564843 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2026-02-24 18:19:37.564849 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2026-02-24 18:19:37.564854 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2026-02-24 18:19:37.564859 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2026-02-24 18:19:37.564874 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2026-02-24 18:19:37.564880 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:19:37.564886 | controller | 2026-02-24 18:19:37.564891 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2026-02-24 18:19:37.564898 | controller | Tuesday 24 February 2026 18:19:36 +0000 (0:00:45.375) 0:04:11.702 ****** 2026-02-24 18:19:37.564910 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:19:40.361987 | controller | 2026-02-24 18:19:40.362048 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2026-02-24 18:19:40.362056 | controller | Tuesday 24 February 2026 18:19:37 +0000 (0:00:00.728) 0:04:12.430 ****** 2026-02-24 18:19:40.362070 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:19:40.362443 | controller | 2026-02-24 18:19:40.362607 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2026-02-24 18:19:40.362742 | controller | Tuesday 24 February 2026 18:19:40 +0000 (0:00:02.801) 0:04:15.231 ****** 2026-02-24 18:19:40.418014 | controller | skipping: [instance] 2026-02-24 18:19:40.418232 | controller | 2026-02-24 18:19:40.418432 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2026-02-24 18:19:40.418561 | controller | Tuesday 24 February 2026 18:19:40 +0000 (0:00:00.057) 0:04:15.289 ****** 2026-02-24 18:19:40.473971 | controller | skipping: [instance] 2026-02-24 18:19:40.474109 | controller | 2026-02-24 18:19:40.474247 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2026-02-24 18:19:40.474391 | controller | Tuesday 24 February 2026 18:19:40 +0000 (0:00:00.056) 0:04:15.345 ****** 2026-02-24 18:19:41.186257 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:19:41.186567 | controller | 2026-02-24 18:19:41.186725 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2026-02-24 18:19:41.186860 | controller | Tuesday 24 February 2026 18:19:41 +0000 (0:00:00.711) 0:04:16.057 ****** 2026-02-24 18:19:41.813199 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:19:41.813402 | controller | 2026-02-24 18:19:41.813546 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2026-02-24 18:19:41.813680 | controller | Tuesday 24 February 2026 18:19:41 +0000 (0:00:00.627) 0:04:16.684 ****** 2026-02-24 18:19:42.121617 | controller | changed: [instance] 2026-02-24 18:19:42.828122 | controller | 2026-02-24 18:19:42.828191 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2026-02-24 18:19:42.828200 | controller | Tuesday 24 February 2026 18:19:42 +0000 (0:00:00.308) 0:04:16.992 ****** 2026-02-24 18:19:42.828213 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:19:43.995408 | controller | 2026-02-24 18:19:43.995467 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2026-02-24 18:19:43.995475 | controller | Tuesday 24 February 2026 18:19:42 +0000 (0:00:00.705) 0:04:17.698 ****** 2026-02-24 18:19:43.995488 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:19:44.038096 | controller | 2026-02-24 18:19:44.038119 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 18:19:44.038127 | controller | Tuesday 24 February 2026 18:19:43 +0000 (0:00:01.167) 0:04:18.866 ****** 2026-02-24 18:19:44.038145 | controller | skipping: [instance] 2026-02-24 18:19:44.080317 | controller | 2026-02-24 18:19:44.080343 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 18:19:44.080352 | controller | Tuesday 24 February 2026 18:19:44 +0000 (0:00:00.042) 0:04:18.909 ****** 2026-02-24 18:19:44.080365 | controller | skipping: [instance] 2026-02-24 18:19:44.183513 | controller | 2026-02-24 18:19:44.183534 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 18:19:44.183542 | controller | Tuesday 24 February 2026 18:19:44 +0000 (0:00:00.042) 0:04:18.951 ****** 2026-02-24 18:19:44.183552 | controller | skipping: [instance] 2026-02-24 18:19:44.239052 | controller | 2026-02-24 18:19:44.239071 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2026-02-24 18:19:44.239078 | controller | Tuesday 24 February 2026 18:19:44 +0000 (0:00:00.103) 0:04:19.054 ****** 2026-02-24 18:19:44.239087 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:19:44.284252 | controller | 2026-02-24 18:19:44.284294 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2026-02-24 18:19:44.284307 | controller | Tuesday 24 February 2026 18:19:44 +0000 (0:00:00.055) 0:04:19.110 ****** 2026-02-24 18:19:44.284318 | controller | skipping: [instance] 2026-02-24 18:19:44.322930 | controller | 2026-02-24 18:19:44.322948 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2026-02-24 18:19:44.322955 | controller | Tuesday 24 February 2026 18:19:44 +0000 (0:00:00.045) 0:04:19.155 ****** 2026-02-24 18:19:44.322963 | controller | skipping: [instance] 2026-02-24 18:19:44.379558 | controller | 2026-02-24 18:19:44.379584 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2026-02-24 18:19:44.379591 | controller | Tuesday 24 February 2026 18:19:44 +0000 (0:00:00.038) 0:04:19.194 ****** 2026-02-24 18:19:44.379600 | controller | skipping: [instance] 2026-02-24 18:19:45.127489 | controller | 2026-02-24 18:19:45.127544 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2026-02-24 18:19:45.127559 | controller | Tuesday 24 February 2026 18:19:44 +0000 (0:00:00.056) 0:04:19.250 ****** 2026-02-24 18:19:45.127572 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:19:45.246947 | controller | 2026-02-24 18:19:45.246986 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2026-02-24 18:19:45.246994 | controller | Tuesday 24 February 2026 18:19:45 +0000 (0:00:00.747) 0:04:19.998 ****** 2026-02-24 18:19:45.247006 | controller | skipping: [instance] => (item=secret) 2026-02-24 18:19:46.389530 | controller | skipping: [instance] => (item=configmap) 2026-02-24 18:19:46.389583 | controller | skipping: [instance] => (item=pod) 2026-02-24 18:19:46.389591 | controller | skipping: [instance] => (item=service) 2026-02-24 18:19:46.389597 | controller | skipping: [instance] => (item=route) 2026-02-24 18:19:46.389603 | controller | skipping: [instance] 2026-02-24 18:19:46.389610 | controller | 2026-02-24 18:19:46.389616 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2026-02-24 18:19:46.389623 | controller | Tuesday 24 February 2026 18:19:45 +0000 (0:00:00.119) 0:04:20.117 ****** 2026-02-24 18:19:46.389635 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:19:47.505989 | controller | 2026-02-24 18:19:47.506041 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2026-02-24 18:19:47.506050 | controller | Tuesday 24 February 2026 18:19:46 +0000 (0:00:01.142) 0:04:21.260 ****** 2026-02-24 18:19:47.506063 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:19:47.552728 | controller | 2026-02-24 18:19:47.552750 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2026-02-24 18:19:47.552758 | controller | Tuesday 24 February 2026 18:19:47 +0000 (0:00:01.116) 0:04:22.376 ****** 2026-02-24 18:19:47.552767 | controller | skipping: [instance] 2026-02-24 18:19:47.597954 | controller | 2026-02-24 18:19:47.597972 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2026-02-24 18:19:47.597986 | controller | Tuesday 24 February 2026 18:19:47 +0000 (0:00:00.047) 0:04:22.424 ****** 2026-02-24 18:19:47.597995 | controller | skipping: [instance] 2026-02-24 18:19:47.683837 | controller | 2026-02-24 18:19:47.683856 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2026-02-24 18:19:47.683863 | controller | Tuesday 24 February 2026 18:19:47 +0000 (0:00:00.045) 0:04:22.469 ****** 2026-02-24 18:19:47.683872 | controller | skipping: [instance] => (item=secret) 2026-02-24 18:19:47.684833 | controller | skipping: [instance] => (item=configmap) 2026-02-24 18:19:47.684977 | controller | skipping: [instance] => (item=service) 2026-02-24 18:19:47.684987 | controller | skipping: [instance] => (item=route) 2026-02-24 18:19:47.684994 | controller | skipping: [instance] 2026-02-24 18:19:47.685000 | controller | 2026-02-24 18:19:47.685005 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2026-02-24 18:19:47.685012 | controller | Tuesday 24 February 2026 18:19:47 +0000 (0:00:00.084) 0:04:22.554 ****** 2026-02-24 18:19:47.739290 | controller | skipping: [instance] 2026-02-24 18:19:49.468950 | controller | 2026-02-24 18:19:49.469002 | controller | TASK [podman : Ensure podman is installed] ************************************* 2026-02-24 18:19:49.469010 | controller | Tuesday 24 February 2026 18:19:47 +0000 (0:00:00.056) 0:04:22.610 ****** 2026-02-24 18:19:49.469022 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:19:50.370188 | controller | 2026-02-24 18:19:50.370247 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2026-02-24 18:19:50.370256 | controller | Tuesday 24 February 2026 18:19:49 +0000 (0:00:01.728) 0:04:24.339 ****** 2026-02-24 18:19:50.370294 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:19:50.430006 | controller | 2026-02-24 18:19:50.430045 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2026-02-24 18:19:50.430054 | controller | Tuesday 24 February 2026 18:19:50 +0000 (0:00:00.899) 0:04:25.238 ****** 2026-02-24 18:19:50.430066 | controller | skipping: [instance] 2026-02-24 18:19:50.430147 | controller | 2026-02-24 18:19:50.430170 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2026-02-24 18:19:50.430180 | controller | Tuesday 24 February 2026 18:19:50 +0000 (0:00:00.062) 0:04:25.300 ****** 2026-02-24 18:19:50.481926 | controller | skipping: [instance] 2026-02-24 18:19:50.537436 | controller | 2026-02-24 18:19:50.537461 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2026-02-24 18:19:50.537470 | controller | Tuesday 24 February 2026 18:19:50 +0000 (0:00:00.051) 0:04:25.352 ****** 2026-02-24 18:19:50.537480 | controller | skipping: [instance] 2026-02-24 18:20:02.252103 | controller | 2026-02-24 18:20:02.252166 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2026-02-24 18:20:02.252176 | controller | Tuesday 24 February 2026 18:19:50 +0000 (0:00:00.055) 0:04:25.408 ****** 2026-02-24 18:20:02.252189 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:20:03.861887 | controller | 2026-02-24 18:20:03.861928 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2026-02-24 18:20:03.861938 | controller | Tuesday 24 February 2026 18:20:02 +0000 (0:00:11.714) 0:04:37.122 ****** 2026-02-24 18:20:03.861949 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:20:05.387353 | controller | 2026-02-24 18:20:05.387396 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-24 18:20:05.387405 | controller | Tuesday 24 February 2026 18:20:03 +0000 (0:00:01.607) 0:04:38.730 ****** 2026-02-24 18:20:05.387423 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-24 18:20:05.434485 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-24 18:20:05.434509 | controller | 2026-02-24 18:20:05.434517 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2026-02-24 18:20:05.434522 | controller | Tuesday 24 February 2026 18:20:05 +0000 (0:00:01.526) 0:04:40.257 ****** 2026-02-24 18:20:05.434531 | controller | skipping: [instance] 2026-02-24 18:20:06.071133 | controller | 2026-02-24 18:20:06.071194 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2026-02-24 18:20:06.071205 | controller | Tuesday 24 February 2026 18:20:05 +0000 (0:00:00.048) 0:04:40.305 ****** 2026-02-24 18:20:06.071219 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:20:06.117962 | controller | 2026-02-24 18:20:06.117995 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2026-02-24 18:20:06.118004 | controller | Tuesday 24 February 2026 18:20:06 +0000 (0:00:00.635) 0:04:40.941 ****** 2026-02-24 18:20:06.118015 | controller | skipping: [instance] 2026-02-24 18:20:06.166245 | controller | 2026-02-24 18:20:06.166299 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2026-02-24 18:20:06.166310 | controller | Tuesday 24 February 2026 18:20:06 +0000 (0:00:00.047) 0:04:40.989 ****** 2026-02-24 18:20:06.166321 | controller | skipping: [instance] 2026-02-24 18:20:06.210328 | controller | 2026-02-24 18:20:06.210355 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-24 18:20:06.210364 | controller | Tuesday 24 February 2026 18:20:06 +0000 (0:00:00.048) 0:04:41.037 ****** 2026-02-24 18:20:06.210374 | controller | skipping: [instance] 2026-02-24 18:20:06.250522 | controller | 2026-02-24 18:20:06.250556 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-24 18:20:06.250564 | controller | Tuesday 24 February 2026 18:20:06 +0000 (0:00:00.044) 0:04:41.081 ****** 2026-02-24 18:20:06.250576 | controller | skipping: [instance] 2026-02-24 18:20:06.378853 | controller | 2026-02-24 18:20:06.378889 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2026-02-24 18:20:06.378898 | controller | Tuesday 24 February 2026 18:20:06 +0000 (0:00:00.040) 0:04:41.121 ****** 2026-02-24 18:20:06.378909 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'}) 2026-02-24 18:20:07.574900 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'}) 2026-02-24 18:20:07.574943 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'}) 2026-02-24 18:20:07.574951 | controller | 2026-02-24 18:20:07.574958 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2026-02-24 18:20:07.574965 | controller | Tuesday 24 February 2026 18:20:06 +0000 (0:00:00.128) 0:04:41.249 ****** 2026-02-24 18:20:07.574976 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:20:07.617966 | controller | 2026-02-24 18:20:07.618001 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2026-02-24 18:20:07.618009 | controller | Tuesday 24 February 2026 18:20:07 +0000 (0:00:01.180) 0:04:42.430 ****** 2026-02-24 18:20:07.618019 | controller | skipping: [instance] 2026-02-24 18:20:07.756214 | controller | 2026-02-24 18:20:07.756256 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2026-02-24 18:20:07.756284 | controller | Tuesday 24 February 2026 18:20:07 +0000 (0:00:00.059) 0:04:42.489 ****** 2026-02-24 18:20:07.756299 | controller | 2026-02-24 18:20:07.813860 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2026-02-24 18:20:07.813892 | controller | Tuesday 24 February 2026 18:20:07 +0000 (0:00:00.138) 0:04:42.627 ****** 2026-02-24 18:20:07.813905 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:20:07.814300 | controller | 2026-02-24 18:20:07.865834 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-24 18:20:07.865855 | controller | Tuesday 24 February 2026 18:20:07 +0000 (0:00:00.057) 0:04:42.685 ****** 2026-02-24 18:20:07.865866 | controller | skipping: [instance] 2026-02-24 18:20:07.910533 | controller | 2026-02-24 18:20:07.910555 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-24 18:20:07.910562 | controller | Tuesday 24 February 2026 18:20:07 +0000 (0:00:00.052) 0:04:42.737 ****** 2026-02-24 18:20:07.910579 | controller | skipping: [instance] 2026-02-24 18:20:08.807356 | controller | 2026-02-24 18:20:08.807396 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2026-02-24 18:20:08.807404 | controller | Tuesday 24 February 2026 18:20:07 +0000 (0:00:00.043) 0:04:42.781 ****** 2026-02-24 18:20:08.807416 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false 2026-02-24 18:20:08.822565 | controller | content: '' 2026-02-24 18:20:08.822585 | controller | elapsed: 0 2026-02-24 18:20:08.822593 | controller | msg: 'Status code was -1 and not [200]: Request failed: ' 2026-02-24 18:20:08.822600 | controller | redirected: false 2026-02-24 18:20:08.822606 | controller | status: -1 2026-02-24 18:20:08.822611 | controller | url: http://sushy.utility:8000/redfish/v1/Managers 2026-02-24 18:20:08.822621 | controller | 2026-02-24 18:20:09.039538 | controller | TASK [Create dnsmasq dir] ****************************************************** 2026-02-24 18:20:09.039664 | controller | Tuesday 24 February 2026 18:20:08 +0000 (0:00:00.912) 0:04:43.694 ****** 2026-02-24 18:20:09.039681 | controller | changed: [instance] 2026-02-24 18:20:09.039794 | controller | 2026-02-24 18:20:09.039805 | controller | TASK [Get journalctl in a file] ************************************************ 2026-02-24 18:20:09.039812 | controller | Tuesday 24 February 2026 18:20:09 +0000 (0:00:00.215) 0:04:43.910 ****** 2026-02-24 18:20:09.317306 | controller | changed: [instance] 2026-02-24 18:20:09.764732 | controller | 2026-02-24 18:20:09.764777 | controller | TASK [Dump journalctl output] ************************************************** 2026-02-24 18:20:09.764786 | controller | Tuesday 24 February 2026 18:20:09 +0000 (0:00:00.278) 0:04:44.188 ****** 2026-02-24 18:20:09.764803 | controller | changed: [instance] 2026-02-24 18:20:10.429194 | controller | 2026-02-24 18:20:10.429236 | controller | TASK [Copy all dnsmasq config] ************************************************* 2026-02-24 18:20:10.429244 | controller | Tuesday 24 February 2026 18:20:09 +0000 (0:00:00.447) 0:04:44.635 ****** 2026-02-24 18:20:10.429255 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-24 18:20:10.662496 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2026-02-24 18:20:10.662534 | controller | 2026-02-24 18:20:10.662542 | controller | TASK [Create log directory] **************************************************** 2026-02-24 18:20:10.662548 | controller | Tuesday 24 February 2026 18:20:10 +0000 (0:00:00.664) 0:04:45.299 ****** 2026-02-24 18:20:10.662558 | controller | changed: [instance] 2026-02-24 18:20:11.689518 | controller | 2026-02-24 18:20:11.689560 | controller | TASK [Sync logs from controller-0] ********************************************* 2026-02-24 18:20:11.689568 | controller | Tuesday 24 February 2026 18:20:10 +0000 (0:00:00.233) 0:04:45.533 ****** 2026-02-24 18:20:11.689579 | controller | changed: [instance] 2026-02-24 18:20:11.821959 | controller | 2026-02-24 18:20:11.822004 | controller | PLAY RECAP ********************************************************************* 2026-02-24 18:20:11.822013 | controller | instance : ok=438 changed=163 unreachable=0 failed=1 skipped=161 rescued=0 ignored=0 2026-02-24 18:20:11.822019 | controller | 2026-02-24 18:20:11.822025 | controller | Tuesday 24 February 2026 18:20:11 +0000 (0:00:01.024) 0:04:46.557 ****** 2026-02-24 18:20:11.822030 | controller | =============================================================================== 2026-02-24 18:20:11.822036 | controller | reproducer : Check package install status ------------------------------ 45.38s 2026-02-24 18:20:11.822041 | controller | libvirt_manager : Download base image ---------------------------------- 29.48s 2026-02-24 18:20:11.822046 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 26.21s 2026-02-24 18:20:11.822052 | controller | libvirt_manager : Install packages required for using KVM -------------- 11.99s 2026-02-24 18:20:11.822057 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 11.71s 2026-02-24 18:20:11.822062 | controller | ci_nmstate : Install required packages on localhost --------------------- 7.16s 2026-02-24 18:20:11.822068 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.67s 2026-02-24 18:20:11.822073 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.10s 2026-02-24 18:20:11.822084 | controller | sushy_emulator : Install required packages ------------------------------ 2.80s 2026-02-24 18:20:11.822089 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.07s 2026-02-24 18:20:11.822095 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s 2026-02-24 18:20:11.822100 | controller | discover_latest_image : Get latest image -------------------------------- 1.83s 2026-02-24 18:20:11.822105 | controller | reproducer : Inject SSH configuration ----------------------------------- 1.81s 2026-02-24 18:20:11.822110 | controller | podman : Ensure podman is installed ------------------------------------- 1.73s 2026-02-24 18:20:11.822116 | controller | libvirt_manager : Inject private key on hosts controller-0 -------------- 1.67s 2026-02-24 18:20:11.822121 | controller | ci_nmstate : Apply the desidered state on instance ---------------------- 1.65s 2026-02-24 18:20:11.822126 | controller | sushy_emulator : Create and start Sushy Emulator container -------------- 1.61s 2026-02-24 18:20:11.822131 | controller | ci_nmstate : Apply the desidered state on localhost --------------------- 1.59s 2026-02-24 18:20:11.822137 | controller | reproducer : Ensure directories exist ----------------------------------- 1.53s 2026-02-24 18:20:11.822142 | controller | reproducer : Ensure directories exist ----------------------------------- 1.43s 2026-02-24 18:20:11.822165 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml'] 2026-02-24 18:20:11.826958 | controller | WARNING An error occurred during the test sequence action: 'converge'. Cleaning up. 2026-02-24 18:20:11.826982 | controller | INFO Running crc_layout > cleanup 2026-02-24 18:20:11.827455 | controller | WARNING Skipping, cleanup playbook not configured. 2026-02-24 18:20:11.835086 | controller | INFO Running crc_layout > destroy 2026-02-24 18:20:11.835438 | controller | WARNING Skipping, instances are delegated. 2026-02-24 18:20:11.835770 | controller | INFO Pruning extra files from scenario ephemeral directory 2026-02-24 18:20:11.837578 | controller | INFO Writing /tmp/report.html report. 2026-02-24 18:20:11.987238 | [controller] Waiting on logger 2026-02-24 18:20:17.141839 | [controller] Waiting on logger 2026-02-24 18:20:27.573909 | [controller] Waiting on logger 2026-02-24 18:20:38.006040 | [controller] Waiting on logger 2026-02-24 18:20:41.942629 | [Zuul] Log Stream did not terminate 2026-02-24 18:20:41.944109 | controller | ERROR 2026-02-24 18:20:41.946245 | controller | { 2026-02-24 18:20:41.946309 | controller | "delta": "0:06:19.564948", 2026-02-24 18:20:41.946333 | controller | "end": "2026-02-24 18:20:11.897603", 2026-02-24 18:20:41.946352 | controller | "msg": "non-zero return code", 2026-02-24 18:20:41.946368 | controller | "rc": 1, 2026-02-24 18:20:41.946385 | controller | "start": "2026-02-24 18:13:52.332655" 2026-02-24 18:20:41.946400 | controller | } failure 2026-02-24 18:20:41.999194 | 2026-02-24 18:20:41.999253 | PLAY RECAP 2026-02-24 18:20:41.999319 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0 2026-02-24 18:20:41.999344 | 2026-02-24 18:20:42.075043 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-24 18:20:42.076382 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-24 18:20:42.634048 | 2026-02-24 18:20:42.634186 | PLAY [Run ci/playbooks/collect-logs.yml] 2026-02-24 18:20:42.654494 | 2026-02-24 18:20:42.654559 | TASK [Filter out host if needed] 2026-02-24 18:20:42.663461 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2026-02-24 18:20:42.667894 | 2026-02-24 18:20:42.667955 | TASK [Ensure file is present] 2026-02-24 18:20:43.096528 | controller | ok 2026-02-24 18:20:43.102371 | 2026-02-24 18:20:43.102442 | TASK [Manage molecule report file] 2026-02-24 18:20:43.121609 | [controller] Waiting on logger 2026-02-24 18:20:52.470007 | [controller] Waiting on logger 2026-02-24 18:21:02.901692 | [controller] Waiting on logger 2026-02-24 18:21:12.246669 | [controller] Waiting on logger 2026-02-24 18:21:13.550205 | [Zuul] Log Stream did not terminate 2026-02-24 18:21:13.550582 | controller | changed 2026-02-24 18:21:13.558550 | 2026-02-24 18:21:13.558614 | TASK [Check if we get ci-framework-data basedir] 2026-02-24 18:21:13.854770 | controller | ok 2026-02-24 18:21:13.859966 | 2026-02-24 18:21:13.860031 | TASK [Create ci-framework-data log directory for zuul] 2026-02-24 18:21:14.275310 | controller | changed 2026-02-24 18:21:14.281127 | 2026-02-24 18:21:14.281193 | TASK [Copy ci-framework interesting files] 2026-02-24 18:21:14.301291 | [controller] Waiting on logger 2026-02-24 18:21:24.726034 | [controller] Waiting on logger 2026-02-24 18:21:34.107331 | [controller] Waiting on logger 2026-02-24 18:21:44.501954 | [controller] Waiting on logger 2026-02-24 18:21:44.608524 | [Zuul] Log Stream did not terminate 2026-02-24 18:21:44.608727 | controller | changed 2026-02-24 18:21:44.620108 | 2026-02-24 18:21:44.620179 | TASK [Get SELinux listing] 2026-02-24 18:21:47.701997 | [controller] Waiting on logger 2026-02-24 18:22:02.229821 | [controller] Waiting on logger 2026-02-24 18:22:12.662704 | [controller] Waiting on logger 2026-02-24 18:22:14.922115 | [Zuul] Log Stream did not terminate 2026-02-24 18:22:14.924932 | controller | changed 2026-02-24 18:22:14.935059 | 2026-02-24 18:22:14.935126 | TASK [Generate log index] 2026-02-24 18:22:16.207718 | controller | changed 2026-02-24 18:22:16.212247 | 2026-02-24 18:22:16.212321 | TASK [Get some env related data] 2026-02-24 18:22:17.269718 | [controller] Waiting on logger 2026-02-24 18:22:26.101886 | [controller] Waiting on logger 2026-02-24 18:22:27.881952 | controller | changed 2026-02-24 18:22:27.890180 | 2026-02-24 18:22:27.890305 | TASK [Generate list of logs to collect in home directory] 2026-02-24 18:22:28.292472 | controller | ok: All paths examined 2026-02-24 18:22:28.297972 | 2026-02-24 18:22:28.298040 | LOOP [Copy logs from home directory] 2026-02-24 18:22:28.976107 | controller | changed: 2026-02-24 18:22:28.976357 | controller | { 2026-02-24 18:22:28.976389 | controller | "atime": 1763989167.9348345, 2026-02-24 18:22:28.976409 | controller | "ctime": 1763990251.6129293, 2026-02-24 18:22:28.976427 | controller | "dev": 64513, 2026-02-24 18:22:28.976443 | controller | "gid": 1000, 2026-02-24 18:22:28.976459 | controller | "gr_name": "zuul", 2026-02-24 18:22:28.976483 | controller | "inode": 5131423, 2026-02-24 18:22:28.976500 | controller | "isblk": false, 2026-02-24 18:22:28.976516 | controller | "ischr": false, 2026-02-24 18:22:28.976531 | controller | "isdir": false, 2026-02-24 18:22:28.976545 | controller | "isfifo": false, 2026-02-24 18:22:28.976559 | controller | "isgid": false, 2026-02-24 18:22:28.976573 | controller | "islnk": false, 2026-02-24 18:22:28.976587 | controller | "isreg": true, 2026-02-24 18:22:28.976603 | controller | "issock": false, 2026-02-24 18:22:28.976618 | controller | "isuid": false, 2026-02-24 18:22:28.976655 | controller | "mode": "0644", 2026-02-24 18:22:28.976674 | controller | "mtime": 1763990251.6129293, 2026-02-24 18:22:28.976690 | controller | "nlink": 1, 2026-02-24 18:22:28.976706 | controller | "path": "/home/zuul/crc-setup.log", 2026-02-24 18:22:28.976720 | controller | "pw_name": "zuul", 2026-02-24 18:22:28.976733 | controller | "rgrp": true, 2026-02-24 18:22:28.976747 | controller | "roth": true, 2026-02-24 18:22:28.976762 | controller | "rusr": true, 2026-02-24 18:22:28.976776 | controller | "size": 4108, 2026-02-24 18:22:28.976790 | controller | "uid": 1000, 2026-02-24 18:22:28.976804 | controller | "wgrp": false, 2026-02-24 18:22:28.976817 | controller | "woth": false, 2026-02-24 18:22:28.976830 | controller | "wusr": true, 2026-02-24 18:22:28.976854 | controller | "xgrp": false, 2026-02-24 18:22:28.976870 | controller | "xoth": false, 2026-02-24 18:22:28.976883 | controller | "xusr": false 2026-02-24 18:22:28.976897 | controller | } 2026-02-24 18:22:29.550187 | controller | changed: 2026-02-24 18:22:29.550352 | controller | { 2026-02-24 18:22:29.550380 | controller | "atime": 1763990253.7119775, 2026-02-24 18:22:29.550400 | controller | "ctime": 1763991032.5164254, 2026-02-24 18:22:29.550417 | controller | "dev": 64513, 2026-02-24 18:22:29.550432 | controller | "gid": 1000, 2026-02-24 18:22:29.550447 | controller | "gr_name": "zuul", 2026-02-24 18:22:29.550462 | controller | "inode": 5131425, 2026-02-24 18:22:29.550479 | controller | "isblk": false, 2026-02-24 18:22:29.550493 | controller | "ischr": false, 2026-02-24 18:22:29.550508 | controller | "isdir": false, 2026-02-24 18:22:29.550521 | controller | "isfifo": false, 2026-02-24 18:22:29.550535 | controller | "isgid": false, 2026-02-24 18:22:29.550548 | controller | "islnk": false, 2026-02-24 18:22:29.550561 | controller | "isreg": true, 2026-02-24 18:22:29.550574 | controller | "issock": false, 2026-02-24 18:22:29.550587 | controller | "isuid": false, 2026-02-24 18:22:29.550600 | controller | "mode": "0644", 2026-02-24 18:22:29.550616 | controller | "mtime": 1763991032.5164254, 2026-02-24 18:22:29.550632 | controller | "nlink": 1, 2026-02-24 18:22:29.550672 | controller | "path": "/home/zuul/crc-start.log", 2026-02-24 18:22:29.550690 | controller | "pw_name": "zuul", 2026-02-24 18:22:29.550704 | controller | "rgrp": true, 2026-02-24 18:22:29.550718 | controller | "roth": true, 2026-02-24 18:22:29.550732 | controller | "rusr": true, 2026-02-24 18:22:29.550745 | controller | "size": 4428, 2026-02-24 18:22:29.550758 | controller | "uid": 1000, 2026-02-24 18:22:29.550772 | controller | "wgrp": false, 2026-02-24 18:22:29.550785 | controller | "woth": false, 2026-02-24 18:22:29.550798 | controller | "wusr": true, 2026-02-24 18:22:29.550812 | controller | "xgrp": false, 2026-02-24 18:22:29.550825 | controller | "xoth": false, 2026-02-24 18:22:29.550838 | controller | "xusr": false 2026-02-24 18:22:29.550851 | controller | } 2026-02-24 18:22:30.185691 | controller | changed: 2026-02-24 18:22:30.185841 | controller | { 2026-02-24 18:22:30.185868 | controller | "atime": 1771956814.0906472, 2026-02-24 18:22:30.185887 | controller | "ctime": 1771956829.9246945, 2026-02-24 18:22:30.185904 | controller | "dev": 64513, 2026-02-24 18:22:30.185920 | controller | "gid": 1000, 2026-02-24 18:22:30.185935 | controller | "gr_name": "zuul", 2026-02-24 18:22:30.185951 | controller | "inode": 5167374, 2026-02-24 18:22:30.185968 | controller | "isblk": false, 2026-02-24 18:22:30.185984 | controller | "ischr": false, 2026-02-24 18:22:30.186002 | controller | "isdir": false, 2026-02-24 18:22:30.186017 | controller | "isfifo": false, 2026-02-24 18:22:30.186031 | controller | "isgid": false, 2026-02-24 18:22:30.186045 | controller | "islnk": false, 2026-02-24 18:22:30.186059 | controller | "isreg": true, 2026-02-24 18:22:30.186073 | controller | "issock": false, 2026-02-24 18:22:30.186087 | controller | "isuid": false, 2026-02-24 18:22:30.186101 | controller | "mode": "0644", 2026-02-24 18:22:30.186114 | controller | "mtime": 1771956829.9246945, 2026-02-24 18:22:30.186128 | controller | "nlink": 1, 2026-02-24 18:22:30.186141 | controller | "path": "/home/zuul/ansible.log", 2026-02-24 18:22:30.186155 | controller | "pw_name": "zuul", 2026-02-24 18:22:30.186168 | controller | "rgrp": true, 2026-02-24 18:22:30.186182 | controller | "roth": true, 2026-02-24 18:22:30.186196 | controller | "rusr": true, 2026-02-24 18:22:30.186210 | controller | "size": 6749, 2026-02-24 18:22:30.186224 | controller | "uid": 1000, 2026-02-24 18:22:30.186238 | controller | "wgrp": false, 2026-02-24 18:22:30.186252 | controller | "woth": false, 2026-02-24 18:22:30.186282 | controller | "wusr": true, 2026-02-24 18:22:30.186306 | controller | "xgrp": false, 2026-02-24 18:22:30.186322 | controller | "xoth": false, 2026-02-24 18:22:30.186337 | controller | "xusr": false 2026-02-24 18:22:30.186351 | controller | } 2026-02-24 18:22:30.198616 | 2026-02-24 18:22:30.198699 | TASK [Copy crio stats log file] 2026-02-24 18:22:30.223931 | controller | skipping: Conditional result was False 2026-02-24 18:22:30.229566 | 2026-02-24 18:22:30.229635 | TASK [Get SELinux related data] 2026-02-24 18:22:30.254318 | [controller] Waiting on logger 2026-02-24 18:22:40.693931 | [controller] Waiting on logger 2026-02-24 18:22:50.074595 | [controller] Waiting on logger 2026-02-24 18:23:00.469971 | [controller] Waiting on logger 2026-02-24 18:23:00.574781 | [Zuul] Log Stream did not terminate 2026-02-24 18:23:00.575102 | controller | ERROR 2026-02-24 18:23:00.575220 | controller | { 2026-02-24 18:23:00.575251 | controller | "delta": "0:00:00.011078", 2026-02-24 18:23:00.575294 | controller | "end": "2026-02-24 18:22:30.549629", 2026-02-24 18:23:00.575316 | controller | "msg": "non-zero return code", 2026-02-24 18:23:00.575333 | controller | "rc": 1, 2026-02-24 18:23:00.575349 | controller | "start": "2026-02-24 18:22:30.538551" 2026-02-24 18:23:00.575364 | controller | } 2026-02-24 18:23:00.575386 | controller | ERROR: Ignoring Errors 2026-02-24 18:23:00.583401 | 2026-02-24 18:23:00.583475 | TASK [Create system configuration directory] 2026-02-24 18:23:00.898003 | controller | changed 2026-02-24 18:23:00.903013 | 2026-02-24 18:23:00.903083 | TASK [Get some of the system configurations] 2026-02-24 18:23:03.990008 | [controller] Waiting on logger 2026-02-24 18:23:15.034710 | [controller] Waiting on logger 2026-02-24 18:23:17.802677 | controller | changed 2026-02-24 18:23:17.810003 | 2026-02-24 18:23:17.810093 | TASK [Copy generated documentation if available] 2026-02-24 18:23:17.835517 | controller | skipping: Conditional result was False 2026-02-24 18:23:17.841203 | 2026-02-24 18:23:17.841289 | TASK [Copy generated AsciiDoc documentation if available] 2026-02-24 18:23:17.855691 | controller | skipping: Conditional result was False 2026-02-24 18:23:17.861235 | 2026-02-24 18:23:17.861308 | TASK [Compress logs bigger than 2MB] 2026-02-24 18:23:22.883914 | controller | changed 2026-02-24 18:23:22.889701 | 2026-02-24 18:23:22.889812 | TASK [Copy files from workspace on node] 2026-02-24 18:23:22.909707 | controller | ok 2026-02-24 18:23:22.931323 | 2026-02-24 18:23:22.931389 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-24 18:23:22.955963 | controller | skipping: Conditional result was False 2026-02-24 18:23:22.961841 | 2026-02-24 18:23:22.961912 | TASK [fetch-output : Set log path for single node] 2026-02-24 18:23:22.992003 | controller | ok 2026-02-24 18:23:22.996975 | 2026-02-24 18:23:22.997042 | LOOP [fetch-output : Ensure local output dirs] 2026-02-24 18:23:23.230258 | controller -> localhost | ok: "/var/lib/zuul/builds/7d7ce5832b2b46e49370e247d5e931c7/work/logs" 2026-02-24 18:23:23.230763 | controller -> localhost | changed: All items complete 2026-02-24 18:23:23.230806 | 2026-02-24 18:23:23.415183 | controller -> localhost | changed: "/var/lib/zuul/builds/7d7ce5832b2b46e49370e247d5e931c7/work/artifacts" 2026-02-24 18:23:23.603733 | controller -> localhost | changed: "/var/lib/zuul/builds/7d7ce5832b2b46e49370e247d5e931c7/work/docs" 2026-02-24 18:23:23.618047 | 2026-02-24 18:23:23.618209 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-24 18:23:24.329493 | controller | changed: 2026-02-24 18:23:24.329814 | controller | .d..t...... ./ 2026-02-24 18:23:24.329848 | controller | >f+++++++++ README.html 2026-02-24 18:23:24.329873 | controller | >f+++++++++ ansible-execution.log 2026-02-24 18:23:24.329895 | controller | >f+++++++++ ansible.log 2026-02-24 18:23:24.329915 | controller | >f+++++++++ crc-setup.log 2026-02-24 18:23:24.329934 | controller | >f+++++++++ crc-start.log 2026-02-24 18:23:24.329952 | controller | >f+++++++++ dmesg.log 2026-02-24 18:23:24.329971 | controller | >f+++++++++ installed-pkgs.log 2026-02-24 18:23:24.329989 | controller | >f+++++++++ python.log 2026-02-24 18:23:24.330007 | controller | >f+++++++++ registries.conf 2026-02-24 18:23:24.330026 | controller | >f+++++++++ report.html 2026-02-24 18:23:24.330042 | controller | >f+++++++++ selinux-denials.log 2026-02-24 18:23:24.330059 | controller | >f+++++++++ selinux-listing.log 2026-02-24 18:23:24.330075 | controller | cd+++++++++ ci-framework-data/ 2026-02-24 18:23:24.330092 | controller | cd+++++++++ ci-framework-data/artifacts/ 2026-02-24 18:23:24.330110 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2026-02-24 18:23:24.330128 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2026-02-24 18:23:24.330145 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2026-02-24 18:23:24.330162 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2026-02-24 18:23:24.330180 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2026-02-24 18:23:24.330198 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2026-02-24 18:23:24.330215 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2026-02-24 18:23:24.330232 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2026-02-24 18:23:24.330249 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2026-02-24 18:23:24.330289 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2026-02-24 18:23:24.330317 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2026-02-24 18:23:24.330336 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:b7:6a:e8 2026-02-24 18:23:24.330355 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:a1:86:47 2026-02-24 18:23:24.330374 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:7e:f0:16 2026-02-24 18:23:24.330393 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:7c:58:a0 2026-02-24 18:23:24.330410 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:16:ec:f3 2026-02-24 18:23:24.330427 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:17:7f:81 2026-02-24 18:23:24.330443 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2026-02-24 18:23:24.330461 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2026-02-24 18:23:24.330478 | controller | cd+++++++++ ci-framework-data/logs/ 2026-02-24 18:23:24.330494 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2026-02-24 18:23:24.330511 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2026-02-24 18:23:24.330527 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2026-02-24 18:23:24.330543 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2026-02-24 18:23:24.330560 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2026-02-24 18:23:24.330577 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2026-02-24 18:23:24.330593 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2026-02-24 18:23:24.330609 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2026-02-24 18:23:24.330626 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2026-02-24 18:23:24.330653 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2026-02-24 18:23:24.330671 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2026-02-24 18:23:24.330687 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2026-02-24 18:23:24.330704 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2026-02-24 18:23:24.330723 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2026-02-24 18:23:24.330741 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2026-02-24 18:23:24.330758 | controller | cd+++++++++ registries.conf.d/ 2026-02-24 18:23:24.330776 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2026-02-24 18:23:24.330793 | controller | cd+++++++++ system-config/ 2026-02-24 18:23:24.330811 | controller | cd+++++++++ system-config/libvirt/ 2026-02-24 18:23:24.330828 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2026-02-24 18:23:24.330845 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2026-02-24 18:23:24.330862 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2026-02-24 18:23:24.330878 | controller | >f+++++++++ system-config/libvirt/network.conf 2026-02-24 18:23:24.330895 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2026-02-24 18:23:24.330912 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2026-02-24 18:23:24.330928 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2026-02-24 18:23:24.330948 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2026-02-24 18:23:24.330966 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2026-02-24 18:23:24.330982 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2026-02-24 18:23:24.330999 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2026-02-24 18:23:24.331015 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2026-02-24 18:23:24.331032 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2026-02-24 18:23:24.331048 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2026-02-24 18:23:24.331065 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2026-02-24 18:23:24.331081 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2026-02-24 18:23:24.845466 | controller | changed: .d..t...... ./ 2026-02-24 18:23:25.340856 | controller | changed: .d..t...... ./ 2026-02-24 18:23:25.362284 | 2026-02-24 18:23:25.362455 | TASK [Return artifact to Zuul] 2026-02-24 18:23:25.394213 | controller | ok 2026-02-24 18:23:25.412922 | 2026-02-24 18:23:25.412978 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2026-02-24 18:23:25.413308 | 2026-02-24 18:23:25.413342 | PLAY RECAP 2026-02-24 18:23:25.413382 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2026-02-24 18:23:25.413402 | 2026-02-24 18:23:25.521589 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-24 18:23:25.522503 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-24 18:23:26.028259 | 2026-02-24 18:23:26.028414 | PLAY [all] 2026-02-24 18:23:26.046999 | 2026-02-24 18:23:26.047069 | TASK [include_role : fetch-output] 2026-02-24 18:23:26.077401 | controller | ok 2026-02-24 18:23:26.093133 | 2026-02-24 18:23:26.093209 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-24 18:23:26.138614 | controller | skipping: Conditional result was False 2026-02-24 18:23:26.144423 | 2026-02-24 18:23:26.144492 | TASK [fetch-output : Set log path for single node] 2026-02-24 18:23:26.184438 | controller | ok 2026-02-24 18:23:26.189083 | 2026-02-24 18:23:26.189153 | LOOP [fetch-output : Ensure local output dirs] 2026-02-24 18:23:26.522600 | controller -> localhost | ok: "/var/lib/zuul/builds/7d7ce5832b2b46e49370e247d5e931c7/work/logs" 2026-02-24 18:23:26.703292 | controller -> localhost | ok: "/var/lib/zuul/builds/7d7ce5832b2b46e49370e247d5e931c7/work/artifacts" 2026-02-24 18:23:26.880408 | controller -> localhost | ok: "/var/lib/zuul/builds/7d7ce5832b2b46e49370e247d5e931c7/work/docs" 2026-02-24 18:23:26.894811 | 2026-02-24 18:23:26.894884 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-24 18:23:27.550469 | controller | ok 2026-02-24 18:23:27.550768 | controller | ok: All items complete 2026-02-24 18:23:27.550804 | 2026-02-24 18:23:28.047103 | controller | ok 2026-02-24 18:23:28.520895 | controller | ok 2026-02-24 18:23:28.535847 | 2026-02-24 18:23:28.536040 | TASK [include_role : fetch-output-openshift] 2026-02-24 18:23:28.552387 | controller | skipping: Conditional result was False 2026-02-24 18:23:28.558971 | 2026-02-24 18:23:28.559040 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-02-24 18:23:28.916355 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.007801 2026-02-24 18:23:29.102461 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.007733 2026-02-24 18:23:29.136598 | 2026-02-24 18:23:29.136763 | PLAY [all] 2026-02-24 18:23:29.149932 | 2026-02-24 18:23:29.150002 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-02-24 18:23:29.682968 | controller | changed 2026-02-24 18:23:29.710021 | 2026-02-24 18:23:29.710098 | PLAY RECAP 2026-02-24 18:23:29.710154 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-02-24 18:23:29.710187 | 2026-02-24 18:23:29.810464 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-24 18:23:29.811201 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2026-02-24 18:23:30.346161 | 2026-02-24 18:23:30.346335 | PLAY [localhost] 2026-02-24 18:23:30.363080 | 2026-02-24 18:23:30.363155 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-02-24 18:23:30.676911 | localhost | changed 2026-02-24 18:23:30.681598 | 2026-02-24 18:23:30.681691 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-02-24 18:23:30.711333 | localhost | ok 2026-02-24 18:23:30.718737 | 2026-02-24 18:23:30.718808 | TASK [add-fileserver : Create SSH private key tempfile] 2026-02-24 18:23:31.031950 | localhost | changed 2026-02-24 18:23:31.038502 | 2026-02-24 18:23:31.038578 | TASK [add-fileserver : Create SSH private key from secret] 2026-02-24 18:23:31.595993 | localhost | changed 2026-02-24 18:23:31.600920 | 2026-02-24 18:23:31.600997 | TASK [add-fileserver : Add fileserver ssh key] 2026-02-24 18:23:31.943482 | localhost | Identity added: /var/lib/zuul/builds/7d7ce5832b2b46e49370e247d5e931c7/work/tmp/ansible.evbpszke (/var/lib/zuul/builds/7d7ce5832b2b46e49370e247d5e931c7/work/tmp/ansible.evbpszke) 2026-02-24 18:23:31.943685 | localhost | ok: Runtime: 0:00:00.007749 2026-02-24 18:23:31.947865 | 2026-02-24 18:23:31.947935 | TASK [add-fileserver : Remove SSH private key from disk] 2026-02-24 18:23:32.158395 | localhost | ok: Runtime: 0:00:00.004057 2026-02-24 18:23:32.162845 | 2026-02-24 18:23:32.162908 | TASK [add-fileserver : Add fileserver to inventory] 2026-02-24 18:23:32.211626 | localhost | changed 2026-02-24 18:23:32.215417 | 2026-02-24 18:23:32.215476 | TASK [add-fileserver : Add fileserver server to known hosts] 2026-02-24 18:23:32.515933 | localhost | changed 2026-02-24 18:23:32.534825 | 2026-02-24 18:23:32.534885 | PLAY [localhost] 2026-02-24 18:23:32.545588 | 2026-02-24 18:23:32.545659 | TASK [Generate bulk log download script] 2026-02-24 18:23:32.564461 | localhost | ok 2026-02-24 18:23:32.575416 | 2026-02-24 18:23:32.575481 | TASK [local-log-download : Check API endpoint is defined] 2026-02-24 18:23:32.602342 | localhost | ok: All assertions passed 2026-02-24 18:23:32.606395 | 2026-02-24 18:23:32.606452 | TASK [local-log-download : Create download script] 2026-02-24 18:23:32.943482 | localhost -> localhost | changed 2026-02-24 18:23:32.952100 | 2026-02-24 18:23:32.952164 | TASK [Register quick-download link] 2026-02-24 18:23:32.979857 | localhost | ok 2026-02-24 18:23:33.022324 | 2026-02-24 18:23:33.022409 | PLAY [logserver.rdoproject.org] 2026-02-24 18:23:33.031240 | 2026-02-24 18:23:33.031318 | TASK [Set zuul-log-path fact] 2026-02-24 18:23:33.048693 | logserver.rdoproject.org | ok 2026-02-24 18:23:33.057295 | 2026-02-24 18:23:33.057360 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-24 18:23:33.083504 | logserver.rdoproject.org | ok 2026-02-24 18:23:33.088796 | 2026-02-24 18:23:33.088860 | TASK [upload-logs : Create log directories] 2026-02-24 18:23:34.813373 | logserver.rdoproject.org | changed 2026-02-24 18:23:34.816750 | 2026-02-24 18:23:34.816816 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-02-24 18:23:35.043872 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.004675 2026-02-24 18:23:35.049429 | 2026-02-24 18:23:35.049496 | TASK [upload-logs : Upload logs to log server] 2026-02-24 18:23:36.675028 | logserver.rdoproject.org | Output suppressed because no_log was given 2026-02-24 18:23:36.677943 | 2026-02-24 18:23:36.678008 | LOOP [upload-logs : Compress console log and json output] 2026-02-24 18:23:36.724709 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 18:23:36.729069 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 18:23:36.740249 | 2026-02-24 18:23:36.740383 | LOOP [upload-logs : Upload compressed console log and json output] 2026-02-24 18:23:36.782862 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 18:23:36.783159 | 2026-02-24 18:23:36.784323 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 18:23:36.789504 | 2026-02-24 18:23:36.789623 | LOOP [upload-logs : Upload console log and json output]