2026-02-24 17:56:43.737456 | Job console starting... 2026-02-24 17:56:43.937215 | Updating repositories 2026-02-24 17:56:44.697382 | Preparing job workspace 2026-02-24 17:56:51.340960 | Running Ansible setup... 2026-02-24 17:56:54.867179 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-24 17:56:55.326809 | 2026-02-24 17:56:55.326915 | PLAY [localhost] 2026-02-24 17:56:55.334463 | 2026-02-24 17:56:55.334528 | TASK [Gathering Facts] 2026-02-24 17:56:56.089853 | localhost | ok 2026-02-24 17:56:56.102022 | 2026-02-24 17:56:56.102097 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-02-24 17:56:56.398589 | localhost -> localhost | changed 2026-02-24 17:56:56.403710 | 2026-02-24 17:56:56.403790 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-02-24 17:56:57.035050 | localhost -> localhost | changed 2026-02-24 17:56:57.042776 | 2026-02-24 17:56:57.042840 | TASK [Setup log path fact] 2026-02-24 17:56:57.059918 | localhost | ok 2026-02-24 17:56:57.071457 | 2026-02-24 17:56:57.071524 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-24 17:56:57.088845 | localhost | ok 2026-02-24 17:56:57.096004 | 2026-02-24 17:56:57.096069 | TASK [emit-job-header : Print job information] 2026-02-24 17:56:57.122794 | # Job Information 2026-02-24 17:56:57.122905 | Ansible Version: 2.15.12 2026-02-24 17:56:57.122934 | Job: cifmw-molecule-reproducer 2026-02-24 17:56:57.122956 | Pipeline: github-check 2026-02-24 17:56:57.122975 | Executor: ibm-bm3-ze.softwarefactory-project.io 2026-02-24 17:56:57.122994 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3678 2026-02-24 17:56:57.123014 | Log URL (when completed): https://logserver.rdoproject.org/d1e/rdoproject.org/d1e06e3806db48cb95366f6005930d4f/ 2026-02-24 17:56:57.123033 | Event ID: 0d99c5d0-11aa-11f1-8bad-4da953fcedfc 2026-02-24 17:56:57.126693 | 2026-02-24 17:56:57.126768 | LOOP [emit-job-header : Print node information] 2026-02-24 17:56:57.208286 | localhost | ok: 2026-02-24 17:56:57.208464 | localhost | # Node Information 2026-02-24 17:56:57.208492 | localhost | Inventory Hostname: controller 2026-02-24 17:56:57.208516 | localhost | Hostname: np0005628487 2026-02-24 17:56:57.208534 | localhost | Username: zuul 2026-02-24 17:56:57.208552 | localhost | Distro: CentOS 9 2026-02-24 17:56:57.208567 | localhost | Provider: ibm-bm3-nodepool 2026-02-24 17:56:57.208583 | localhost | Region: regionOne 2026-02-24 17:56:57.208599 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2026-02-24 17:56:57.208614 | localhost | Product Name: OpenStack Compute 2026-02-24 17:56:57.208627 | localhost | Interface IP: 192.168.25.253 2026-02-24 17:56:57.228196 | 2026-02-24 17:56:57.228260 | PLAY [all] 2026-02-24 17:56:57.233925 | 2026-02-24 17:56:57.233984 | TASK [Gather network facts] 2026-02-24 17:56:57.669200 | controller | ok 2026-02-24 17:56:57.682693 | 2026-02-24 17:56:57.682759 | TASK [include_role : start-zuul-console] 2026-02-24 17:56:57.700765 | controller | ok 2026-02-24 17:56:57.711313 | 2026-02-24 17:56:57.711379 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-02-24 17:56:58.094996 | controller | ok 2026-02-24 17:56:58.103021 | 2026-02-24 17:56:58.103083 | TASK [include_role : add-build-sshkey] 2026-02-24 17:56:58.120937 | controller | ok 2026-02-24 17:56:58.132472 | 2026-02-24 17:56:58.132536 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-02-24 17:56:58.307700 | controller -> localhost | ok 2026-02-24 17:56:58.312552 | 2026-02-24 17:56:58.312610 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-02-24 17:56:58.330961 | controller | ok 2026-02-24 17:56:58.342159 | controller | included: /var/lib/zuul/builds/d1e06e3806db48cb95366f6005930d4f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-02-24 17:56:58.347085 | 2026-02-24 17:56:58.347142 | TASK [add-build-sshkey : Create Temp SSH key] 2026-02-24 17:56:59.079786 | controller -> localhost | Generating public/private rsa key pair. 2026-02-24 17:56:59.079964 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/d1e06e3806db48cb95366f6005930d4f/work/d1e06e3806db48cb95366f6005930d4f_id_rsa. 2026-02-24 17:56:59.079995 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/d1e06e3806db48cb95366f6005930d4f/work/d1e06e3806db48cb95366f6005930d4f_id_rsa.pub. 2026-02-24 17:56:59.080017 | controller -> localhost | The key fingerprint is: 2026-02-24 17:56:59.080037 | controller -> localhost | SHA256:rnQVgzkzFEAhLgj2ULbTniq4PZgVl7WrgvBToDUK490 zuul-build-sshkey 2026-02-24 17:56:59.080056 | controller -> localhost | The key's randomart image is: 2026-02-24 17:56:59.080074 | controller -> localhost | +---[RSA 3072]----+ 2026-02-24 17:56:59.080091 | controller -> localhost | |.o.o..+oo. | 2026-02-24 17:56:59.080109 | controller -> localhost | |o.+.o... o | 2026-02-24 17:56:59.080126 | controller -> localhost | |. .+.+ .* o | 2026-02-24 17:56:59.080143 | controller -> localhost | |o =.= o + o | 2026-02-24 17:56:59.080159 | controller -> localhost | |o=.=.o .S . | 2026-02-24 17:56:59.080176 | controller -> localhost | |=...oE.. . | 2026-02-24 17:56:59.080193 | controller -> localhost | |oB o .. o | 2026-02-24 17:56:59.080211 | controller -> localhost | |+o* .. o | 2026-02-24 17:56:59.080227 | controller -> localhost | |. .+ . | 2026-02-24 17:56:59.080243 | controller -> localhost | +----[SHA256]-----+ 2026-02-24 17:56:59.080298 | controller -> localhost | ok: Runtime: 0:00:00.435432 2026-02-24 17:56:59.085530 | 2026-02-24 17:56:59.085592 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-02-24 17:56:59.103330 | controller | ok 2026-02-24 17:56:59.111831 | controller | included: /var/lib/zuul/builds/d1e06e3806db48cb95366f6005930d4f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-02-24 17:56:59.118867 | 2026-02-24 17:56:59.118926 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-02-24 17:56:59.132138 | controller | skipping: Conditional result was False 2026-02-24 17:56:59.136832 | 2026-02-24 17:56:59.136892 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-02-24 17:56:59.590744 | controller | changed 2026-02-24 17:56:59.595094 | 2026-02-24 17:56:59.595167 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-02-24 17:56:59.867655 | controller | ok 2026-02-24 17:56:59.872341 | 2026-02-24 17:56:59.872404 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-02-24 17:57:01.057181 | controller | changed 2026-02-24 17:57:01.062213 | 2026-02-24 17:57:01.062303 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-02-24 17:57:02.240921 | controller | changed 2026-02-24 17:57:02.245618 | 2026-02-24 17:57:02.245682 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-02-24 17:57:02.259186 | controller | skipping: Conditional result was False 2026-02-24 17:57:02.264612 | 2026-02-24 17:57:02.264678 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-02-24 17:57:02.541404 | controller -> localhost | changed 2026-02-24 17:57:02.550197 | 2026-02-24 17:57:02.550261 | TASK [add-build-sshkey : Add back temp key] 2026-02-24 17:57:02.755998 | controller -> localhost | Identity added: /var/lib/zuul/builds/d1e06e3806db48cb95366f6005930d4f/work/d1e06e3806db48cb95366f6005930d4f_id_rsa (zuul-build-sshkey) 2026-02-24 17:57:02.756177 | controller -> localhost | ok: Runtime: 0:00:00.006781 2026-02-24 17:57:02.761538 | 2026-02-24 17:57:02.761596 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-02-24 17:57:03.115851 | controller | ok 2026-02-24 17:57:03.120242 | 2026-02-24 17:57:03.120329 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-02-24 17:57:03.144461 | controller | skipping: Conditional result was False 2026-02-24 17:57:03.153083 | 2026-02-24 17:57:03.153143 | TASK [include_role : validate-host] 2026-02-24 17:57:03.170776 | controller | ok 2026-02-24 17:57:03.188520 | 2026-02-24 17:57:03.188585 | TASK [validate-host : Define zuul_info_dir fact] 2026-02-24 17:57:03.216872 | controller | ok 2026-02-24 17:57:03.221186 | 2026-02-24 17:57:03.221249 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-02-24 17:57:03.407084 | controller -> localhost | ok 2026-02-24 17:57:03.413512 | 2026-02-24 17:57:03.413576 | TASK [validate-host : Collect information about the host] 2026-02-24 17:57:04.137654 | controller | ok 2026-02-24 17:57:04.145260 | 2026-02-24 17:57:04.145339 | TASK [validate-host : Sanitize hostname] 2026-02-24 17:57:04.184377 | controller | ok 2026-02-24 17:57:04.188819 | 2026-02-24 17:57:04.188883 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-02-24 17:57:04.537858 | controller -> localhost | changed 2026-02-24 17:57:04.542942 | 2026-02-24 17:57:04.543011 | TASK [validate-host : Collect information about zuul worker] 2026-02-24 17:57:04.928248 | controller | ok 2026-02-24 17:57:04.932875 | 2026-02-24 17:57:04.932943 | TASK [validate-host : Write out all zuul information for each host] 2026-02-24 17:57:05.261291 | controller -> localhost | changed 2026-02-24 17:57:05.269995 | 2026-02-24 17:57:05.270057 | TASK [include_role : prepare-workspace-openshift] 2026-02-24 17:57:05.283284 | controller | skipping: Conditional result was False 2026-02-24 17:57:05.287783 | 2026-02-24 17:57:05.287840 | TASK [include_role : remove-zuul-sshkey] 2026-02-24 17:57:05.300812 | controller | skipping: Conditional result was False 2026-02-24 17:57:05.305380 | 2026-02-24 17:57:05.305443 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-02-24 17:57:05.579612 | controller | ok: "logs" 2026-02-24 17:57:05.579884 | controller | ok: All items complete 2026-02-24 17:57:05.579917 | 2026-02-24 17:57:05.841351 | controller | ok: "artifacts" 2026-02-24 17:57:06.087929 | controller | ok: "docs" 2026-02-24 17:57:06.094960 | 2026-02-24 17:57:06.095063 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-02-24 17:57:06.368945 | controller | changed: "logs" 2026-02-24 17:57:06.612204 | controller | changed: "artifacts" 2026-02-24 17:57:06.859151 | controller | changed: "docs" 2026-02-24 17:57:06.883881 | 2026-02-24 17:57:06.883967 | PLAY RECAP 2026-02-24 17:57:06.884013 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-24 17:57:06.884041 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-24 17:57:06.884059 | 2026-02-24 17:57:06.950816 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2026-02-24 17:57:06.951555 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-24 17:57:07.445678 | 2026-02-24 17:57:07.445789 | PLAY [all] 2026-02-24 17:57:07.463322 | 2026-02-24 17:57:07.463396 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-24 17:57:07.511937 | controller | ok 2026-02-24 17:57:07.516339 | 2026-02-24 17:57:07.516414 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-24 17:57:07.911147 | controller | changed 2026-02-24 17:57:07.916373 | 2026-02-24 17:57:07.916447 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-24 17:57:09.238295 | controller | changed 2026-02-24 17:57:09.247621 | 2026-02-24 17:57:09.247692 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2026-02-24 17:57:09.673719 | controller | changed: 2026-02-24 17:57:09.673897 | controller | { 2026-02-24 17:57:09.673929 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2026-02-24 17:57:09.673958 | controller | } 2026-02-24 17:57:09.971984 | controller | changed: 2026-02-24 17:57:09.972076 | controller | { 2026-02-24 17:57:09.972105 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2026-02-24 17:57:09.972127 | controller | } 2026-02-24 17:57:10.286625 | controller | changed: 2026-02-24 17:57:10.286715 | controller | { 2026-02-24 17:57:10.286745 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2026-02-24 17:57:10.286766 | controller | } 2026-02-24 17:57:10.592506 | controller | changed: 2026-02-24 17:57:10.592557 | controller | { 2026-02-24 17:57:10.592590 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2026-02-24 17:57:10.592616 | controller | } 2026-02-24 17:57:10.895995 | controller | changed: 2026-02-24 17:57:10.896055 | controller | { 2026-02-24 17:57:10.896080 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2026-02-24 17:57:10.896100 | controller | } 2026-02-24 17:57:11.197933 | controller | changed: 2026-02-24 17:57:11.197986 | controller | { 2026-02-24 17:57:11.198011 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2026-02-24 17:57:11.198031 | controller | } 2026-02-24 17:57:11.483497 | controller | changed: 2026-02-24 17:57:11.483555 | controller | { 2026-02-24 17:57:11.483580 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2026-02-24 17:57:11.483601 | controller | } 2026-02-24 17:57:11.807008 | controller | changed: 2026-02-24 17:57:11.807063 | controller | { 2026-02-24 17:57:11.807092 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2026-02-24 17:57:11.807114 | controller | } 2026-02-24 17:57:12.116477 | controller | changed: 2026-02-24 17:57:12.116532 | controller | { 2026-02-24 17:57:12.116559 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2026-02-24 17:57:12.116579 | controller | } 2026-02-24 17:57:12.421808 | controller | changed: 2026-02-24 17:57:12.421873 | controller | { 2026-02-24 17:57:12.421898 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2026-02-24 17:57:12.421918 | controller | } 2026-02-24 17:57:12.720803 | controller | changed: 2026-02-24 17:57:12.720895 | controller | { 2026-02-24 17:57:12.720921 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2026-02-24 17:57:12.720940 | controller | } 2026-02-24 17:57:13.013237 | controller | changed: 2026-02-24 17:57:13.013366 | controller | { 2026-02-24 17:57:13.013395 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2026-02-24 17:57:13.013416 | controller | } 2026-02-24 17:57:13.307828 | controller | changed: 2026-02-24 17:57:13.307910 | controller | { 2026-02-24 17:57:13.307937 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com" 2026-02-24 17:57:13.307957 | controller | } 2026-02-24 17:57:13.613964 | controller | changed: 2026-02-24 17:57:13.614018 | controller | { 2026-02-24 17:57:13.614044 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2026-02-24 17:57:13.614063 | controller | } 2026-02-24 17:57:13.920759 | controller | changed: 2026-02-24 17:57:13.920856 | controller | { 2026-02-24 17:57:13.920883 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2026-02-24 17:57:13.920905 | controller | } 2026-02-24 17:57:14.208569 | controller | changed: 2026-02-24 17:57:14.208661 | controller | { 2026-02-24 17:57:14.208686 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2026-02-24 17:57:14.208715 | controller | } 2026-02-24 17:57:14.496263 | controller | changed: 2026-02-24 17:57:14.496353 | controller | { 2026-02-24 17:57:14.496379 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2026-02-24 17:57:14.496400 | controller | } 2026-02-24 17:57:14.819000 | controller | changed: 2026-02-24 17:57:14.819089 | controller | { 2026-02-24 17:57:14.819116 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2026-02-24 17:57:14.819143 | controller | } 2026-02-24 17:57:15.101286 | controller | changed: 2026-02-24 17:57:15.101382 | controller | { 2026-02-24 17:57:15.101408 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2026-02-24 17:57:15.101427 | controller | } 2026-02-24 17:57:15.391972 | controller | changed: 2026-02-24 17:57:15.392028 | controller | { 2026-02-24 17:57:15.392054 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2026-02-24 17:57:15.392074 | controller | } 2026-02-24 17:57:15.683614 | controller | changed: 2026-02-24 17:57:15.683664 | controller | { 2026-02-24 17:57:15.683690 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2026-02-24 17:57:15.683720 | controller | } 2026-02-24 17:57:15.972111 | controller | changed: 2026-02-24 17:57:15.972178 | controller | { 2026-02-24 17:57:15.972204 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2026-02-24 17:57:15.972224 | controller | } 2026-02-24 17:57:16.253042 | controller | changed: 2026-02-24 17:57:16.253096 | controller | { 2026-02-24 17:57:16.253123 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2026-02-24 17:57:16.253143 | controller | } 2026-02-24 17:57:16.540407 | controller | changed: 2026-02-24 17:57:16.540485 | controller | { 2026-02-24 17:57:16.540509 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2026-02-24 17:57:16.540528 | controller | } 2026-02-24 17:57:16.843729 | controller | changed: 2026-02-24 17:57:16.843798 | controller | { 2026-02-24 17:57:16.843823 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2026-02-24 17:57:16.843842 | controller | } 2026-02-24 17:57:17.149277 | controller | changed: 2026-02-24 17:57:17.149343 | controller | { 2026-02-24 17:57:17.149366 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2026-02-24 17:57:17.149383 | controller | } 2026-02-24 17:57:17.164621 | 2026-02-24 17:57:17.164719 | TASK [Set timezone to UTC] 2026-02-24 17:57:17.638667 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2026-02-24 17:57:17.643308 | 2026-02-24 17:57:17.643372 | TASK [Create nodepool directory] 2026-02-24 17:57:17.915526 | controller | changed 2026-02-24 17:57:17.920636 | 2026-02-24 17:57:17.920750 | TASK [Create nodepool sub_nodes file] 2026-02-24 17:57:18.881165 | controller | changed 2026-02-24 17:57:18.885903 | 2026-02-24 17:57:18.885968 | TASK [Create nodepool sub_nodes_private file] 2026-02-24 17:57:19.847410 | controller | changed 2026-02-24 17:57:19.852097 | 2026-02-24 17:57:19.852157 | LOOP [Populate nodepool sub_nodes file] 2026-02-24 17:57:19.880677 | 2026-02-24 17:57:19.880806 | LOOP [Populate nodepool sub_nodes_private file] 2026-02-24 17:57:19.909206 | 2026-02-24 17:57:19.909347 | TASK [Create nodepool primary file] 2026-02-24 17:57:19.932482 | controller | skipping: Conditional result was False 2026-02-24 17:57:19.937360 | 2026-02-24 17:57:19.937429 | TASK [Create nodepool node_private for this node] 2026-02-24 17:57:20.920390 | controller | changed 2026-02-24 17:57:20.925590 | 2026-02-24 17:57:20.925652 | LOOP [Copy ssh keys to nodepool directory] 2026-02-24 17:57:21.296980 | controller | ok: Item: id_rsa Runtime: 0:00:00.005783 2026-02-24 17:57:21.297160 | 2026-02-24 17:57:21.536705 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.004755 2026-02-24 17:57:21.541972 | 2026-02-24 17:57:21.542040 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2026-02-24 17:57:22.595331 | controller | changed 2026-02-24 17:57:22.600102 | 2026-02-24 17:57:22.600166 | TASK [Validate sudoers config after edits] 2026-02-24 17:57:22.886777 | controller | /etc/sudoers: parsed OK 2026-02-24 17:57:22.886873 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2026-02-24 17:57:22.886885 | controller | /etc/sudoers.d/zuul: parsed OK 2026-02-24 17:57:22.886891 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2026-02-24 17:57:23.125471 | controller | ok: Runtime: 0:00:00.006844 2026-02-24 17:57:23.130191 | 2026-02-24 17:57:23.130247 | TASK [Show the environment passed in to job shell scripts] 2026-02-24 17:57:23.400735 | controller | SHELL=/bin/bash 2026-02-24 17:57:23.400772 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2026-02-24 17:57:23.400782 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2026-02-24 17:57:23.400789 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/78/3678/449f48cb301275a75cd2ef0716a1ae30b1bd06f8 2026-02-24 17:57:23.400795 | controller | PWD=/home/zuul 2026-02-24 17:57:23.400800 | controller | ZUUL_PIPELINE=github-check 2026-02-24 17:57:23.400805 | controller | LOGNAME=zuul 2026-02-24 17:57:23.400809 | controller | XDG_SESSION_TYPE=tty 2026-02-24 17:57:23.400814 | controller | _=/usr/bin/env 2026-02-24 17:57:23.400819 | controller | MOTD_SHOWN=pam 2026-02-24 17:57:23.400824 | controller | HOME=/home/zuul 2026-02-24 17:57:23.400849 | controller | LANG=en_US.UTF-8 2026-02-24 17:57:23.400855 | controller | SSH_CONNECTION=192.168.25.12 34040 192.168.25.253 22 2026-02-24 17:57:23.400859 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2026-02-24 17:57:23.400867 | controller | ZUUL_CHANGE_IDS=3678,449f48cb301275a75cd2ef0716a1ae30b1bd06f8 2026-02-24 17:57:23.400872 | controller | WORKSPACE=/home/zuul/workspace 2026-02-24 17:57:23.400877 | controller | XDG_SESSION_CLASS=user 2026-02-24 17:57:23.400882 | controller | SELINUX_ROLE_REQUESTED= 2026-02-24 17:57:23.400886 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2026-02-24 17:57:23.400891 | controller | USER=zuul 2026-02-24 17:57:23.400896 | controller | ZUUL_VOTING=True 2026-02-24 17:57:23.400901 | controller | BUILD_TIMEOUT=5400000 2026-02-24 17:57:23.400906 | controller | SELINUX_USE_CURRENT_RANGE= 2026-02-24 17:57:23.400911 | controller | SHLVL=1 2026-02-24 17:57:23.400915 | controller | ZUUL_PATCHSET=449f48cb301275a75cd2ef0716a1ae30b1bd06f8 2026-02-24 17:57:23.400920 | controller | XDG_SESSION_ID=1 2026-02-24 17:57:23.400925 | controller | ZUUL_BRANCH=main 2026-02-24 17:57:23.400930 | controller | XDG_RUNTIME_DIR=/run/user/1000 2026-02-24 17:57:23.400935 | controller | SSH_CLIENT=192.168.25.12 34040 22 2026-02-24 17:57:23.400941 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2026-02-24 17:57:23.400946 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2026-02-24 17:57:23.400952 | controller | which_declare=declare -f 2026-02-24 17:57:23.400957 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2026-02-24 17:57:23.400961 | controller | SELINUX_LEVEL_REQUESTED= 2026-02-24 17:57:23.400966 | controller | ZUUL_CHANGE=3678 2026-02-24 17:57:23.400971 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2026-02-24 17:57:23.400976 | controller | ZUUL_UUID=d1e06e3806db48cb95366f6005930d4f 2026-02-24 17:57:23.400981 | controller | BASH_FUNC_which%%=() { ( alias; 2026-02-24 17:57:23.400986 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2026-02-24 17:57:23.400990 | controller | } 2026-02-24 17:57:23.656416 | controller | ok: Runtime: 0:00:00.007051 2026-02-24 17:57:23.661127 | 2026-02-24 17:57:23.661183 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2026-02-24 17:57:23.673935 | controller | skipping: Conditional result was False 2026-02-24 17:57:23.678894 | 2026-02-24 17:57:23.678952 | TASK [Symlink /home/zuul-worker/workspace] 2026-02-24 17:57:24.222113 | controller | skipping: Conditional result was False 2026-02-24 17:57:24.227649 | 2026-02-24 17:57:24.227726 | TASK [Ensure legacy workspace directory] 2026-02-24 17:57:24.489751 | controller | changed 2026-02-24 17:57:24.507094 | 2026-02-24 17:57:24.507145 | PLAY RECAP 2026-02-24 17:57:24.507189 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2026-02-24 17:57:24.507212 | 2026-02-24 17:57:24.570667 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2026-02-24 17:57:24.571384 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-24 17:57:25.031459 | 2026-02-24 17:57:25.031541 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2026-02-24 17:57:25.051213 | 2026-02-24 17:57:25.051300 | TASK [Create zuul-output directory] 2026-02-24 17:57:25.424590 | controller | changed 2026-02-24 17:57:25.429402 | 2026-02-24 17:57:25.429473 | TASK [Slurp Zuul inventory test] 2026-02-24 17:57:25.676367 | controller -> localhost | ok 2026-02-24 17:57:25.682091 | 2026-02-24 17:57:25.682156 | TASK [Save zuul inventory] 2026-02-24 17:57:26.960793 | controller | changed 2026-02-24 17:57:26.966114 | 2026-02-24 17:57:26.966180 | TASK [Save zuul vars without the change_message] 2026-02-24 17:57:28.115622 | controller | changed 2026-02-24 17:57:28.133230 | 2026-02-24 17:57:28.133313 | PLAY RECAP 2026-02-24 17:57:28.133360 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-24 17:57:28.133383 | 2026-02-24 17:57:28.195059 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2026-02-24 17:57:28.195803 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-24 17:57:28.700626 | 2026-02-24 17:57:28.700734 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2026-02-24 17:57:28.719924 | 2026-02-24 17:57:28.719988 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2026-02-24 17:57:28.738320 | controller | ok 2026-02-24 17:57:28.754366 | 2026-02-24 17:57:28.754444 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2026-02-24 17:57:28.777885 | controller | skipping: Conditional result was False 2026-02-24 17:57:28.783429 | 2026-02-24 17:57:28.783499 | TASK [mirror-info-fork : Create /etc/ci] 2026-02-24 17:57:29.186847 | controller | ok 2026-02-24 17:57:29.192068 | 2026-02-24 17:57:29.192135 | TASK [mirror-info-fork : Install ci_mirror script] 2026-02-24 17:57:30.226354 | controller | ok 2026-02-24 17:57:30.235871 | 2026-02-24 17:57:30.235933 | TASK [Prepare workspace] 2026-02-24 17:57:30.254027 | controller | ok 2026-02-24 17:57:30.272169 | 2026-02-24 17:57:30.272277 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-02-24 17:57:30.635952 | controller | ok 2026-02-24 17:57:30.641390 | 2026-02-24 17:57:30.641451 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-02-24 17:57:33.053604 | controller | Output suppressed because no_log was given 2026-02-24 17:57:33.062206 | 2026-02-24 17:57:33.062288 | LOOP [Create zuul-output directory] 2026-02-24 17:57:33.329638 | controller | changed: "/home/zuul/ci-framework-data/logs" 2026-02-24 17:57:33.578732 | controller | ok: "/home/zuul/zuul-output/logs" 2026-02-24 17:57:33.589770 | 2026-02-24 17:57:33.589852 | TASK [Install required packages] 2026-02-24 17:57:57.132188 | controller | ok: Nothing to do 2026-02-24 17:57:57.136950 | 2026-02-24 17:57:57.137010 | TASK [Install venv] 2026-02-24 17:58:54.604830 | controller | changed 2026-02-24 17:58:54.628051 | 2026-02-24 17:58:54.628105 | PLAY RECAP 2026-02-24 17:58:54.628146 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-02-24 17:58:54.628167 | 2026-02-24 17:58:54.693481 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2026-02-24 17:58:54.694260 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-24 17:58:55.181636 | 2026-02-24 17:58:55.181743 | PLAY [Run ci/playbooks/molecule-test.yml] 2026-02-24 17:58:55.200403 | 2026-02-24 17:58:55.200474 | TASK [Gather required facts] 2026-02-24 17:58:55.717817 | controller | ok 2026-02-24 17:58:55.722965 | 2026-02-24 17:58:55.723040 | TASK [Load environment var if instructed to] 2026-02-24 17:58:55.747356 | controller | skipping: Conditional result was False 2026-02-24 17:58:55.752480 | 2026-02-24 17:58:55.752543 | TASK [Ensure group_vars dir exists] 2026-02-24 17:58:56.107230 | controller | ok 2026-02-24 17:58:56.112102 | 2026-02-24 17:58:56.112166 | TASK [Print related variables] 2026-02-24 17:58:56.140938 | controller | ok: 2026-02-24 17:58:56.141048 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2026-02-24 17:58:56.141077 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2026-02-24 17:58:56.145675 | 2026-02-24 17:58:56.145741 | TASK [Run molecule] 2026-02-24 17:58:57.118103 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2026-02-24 17:58:57.393134 | controller | INFO Performing prerun with role_name_check=0... 2026-02-24 17:59:14.624739 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 17:59:14.625119 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 17:59:14.625496 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 17:59:14.625916 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 17:59:14.626335 | controller | WARNING Another version of 'cifmw.general' 1.0.0+449f48cb was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+449f48cb (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 17:59:14.626769 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 17:59:14.627164 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 17:59:14.627580 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 17:59:14.627965 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 17:59:14.628340 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 17:59:14.628734 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 17:59:14.629128 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 17:59:14.629524 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 17:59:14.629957 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 17:59:14.630341 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2026-02-24 17:59:14.639302 | controller | INFO Running crc_layout > prepare 2026-02-24 17:59:15.269851 | controller | 2026-02-24 17:59:15.269904 | controller | PLAY [Prepare] ***************************************************************** 2026-02-24 17:59:15.270022 | controller | 2026-02-24 17:59:15.270159 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-24 17:59:15.270251 | controller | Tuesday 24 February 2026 17:59:15 +0000 (0:00:00.018) 0:00:00.018 ****** 2026-02-24 17:59:16.094444 | controller | ok: [instance] 2026-02-24 17:59:16.094549 | controller | 2026-02-24 17:59:16.094700 | controller | TASK [Create custom basedir] *************************************************** 2026-02-24 17:59:16.094799 | controller | Tuesday 24 February 2026 17:59:16 +0000 (0:00:00.825) 0:00:00.843 ****** 2026-02-24 17:59:16.401008 | controller | changed: [instance] 2026-02-24 17:59:16.401110 | controller | 2026-02-24 17:59:16.401223 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2026-02-24 17:59:16.401356 | controller | Tuesday 24 February 2026 17:59:16 +0000 (0:00:00.306) 0:00:01.149 ****** 2026-02-24 17:59:16.419099 | controller | skipping: [instance] 2026-02-24 17:59:16.419153 | controller | 2026-02-24 17:59:16.419248 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2026-02-24 17:59:16.419349 | controller | Tuesday 24 February 2026 17:59:16 +0000 (0:00:00.018) 0:00:01.168 ****** 2026-02-24 17:59:16.460778 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2026-02-24 17:59:16.460883 | controller | 2026-02-24 17:59:16.460976 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2026-02-24 17:59:16.461071 | controller | Tuesday 24 February 2026 17:59:16 +0000 (0:00:00.041) 0:00:01.209 ****** 2026-02-24 17:59:16.737224 | controller | ok: [instance] 2026-02-24 17:59:16.737378 | controller | 2026-02-24 17:59:16.737391 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2026-02-24 17:59:16.737473 | controller | Tuesday 24 February 2026 17:59:16 +0000 (0:00:00.276) 0:00:01.486 ****** 2026-02-24 17:59:16.945199 | controller | ok: [instance] 2026-02-24 17:59:16.945328 | controller | 2026-02-24 17:59:16.945341 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2026-02-24 17:59:17.660262 | controller | Tuesday 24 February 2026 17:59:16 +0000 (0:00:00.207) 0:00:01.694 ****** 2026-02-24 17:59:17.660315 | controller | ok: [instance] => (item=ubi-9-appstream) 2026-02-24 17:59:17.660383 | controller | ok: [instance] => (item=ubi-9-baseos) 2026-02-24 17:59:17.660501 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2026-02-24 17:59:17.660646 | controller | 2026-02-24 17:59:17.660770 | controller | TASK [Deploy repo-setup] ******************************************************* 2026-02-24 17:59:17.660881 | controller | Tuesday 24 February 2026 17:59:17 +0000 (0:00:00.713) 0:00:02.407 ****** 2026-02-24 17:59:17.721920 | controller | 2026-02-24 17:59:17.721959 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2026-02-24 17:59:17.722065 | controller | Tuesday 24 February 2026 17:59:17 +0000 (0:00:00.063) 0:00:02.471 ****** 2026-02-24 17:59:18.239669 | controller | changed: [instance] => (item=tmp) 2026-02-24 17:59:18.239758 | controller | changed: [instance] => (item=artifacts/repositories) 2026-02-24 17:59:18.239889 | controller | changed: [instance] => (item=venv/repo_setup) 2026-02-24 17:59:18.240031 | controller | 2026-02-24 17:59:18.240142 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2026-02-24 17:59:18.240218 | controller | Tuesday 24 February 2026 17:59:18 +0000 (0:00:00.517) 0:00:02.988 ****** 2026-02-24 17:59:19.050413 | controller | ok: [instance] 2026-02-24 17:59:19.050541 | controller | 2026-02-24 17:59:19.050567 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2026-02-24 17:59:20.091458 | controller | Tuesday 24 February 2026 17:59:19 +0000 (0:00:00.811) 0:00:03.799 ****** 2026-02-24 17:59:20.091503 | controller | changed: [instance] 2026-02-24 17:59:27.614407 | controller | 2026-02-24 17:59:27.614481 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2026-02-24 17:59:27.614490 | controller | Tuesday 24 February 2026 17:59:20 +0000 (0:00:01.040) 0:00:04.840 ****** 2026-02-24 17:59:27.614502 | controller | changed: [instance] 2026-02-24 17:59:28.345110 | controller | 2026-02-24 17:59:28.345167 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2026-02-24 17:59:28.345176 | controller | Tuesday 24 February 2026 17:59:27 +0000 (0:00:07.522) 0:00:12.362 ****** 2026-02-24 17:59:28.345190 | controller | changed: [instance] 2026-02-24 17:59:28.368493 | controller | 2026-02-24 17:59:28.368509 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2026-02-24 17:59:28.368538 | controller | Tuesday 24 February 2026 17:59:28 +0000 (0:00:00.730) 0:00:13.093 ****** 2026-02-24 17:59:28.368547 | controller | skipping: [instance] 2026-02-24 17:59:29.177614 | controller | 2026-02-24 17:59:29.177672 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2026-02-24 17:59:29.177683 | controller | Tuesday 24 February 2026 17:59:28 +0000 (0:00:00.024) 0:00:13.117 ****** 2026-02-24 17:59:29.177700 | controller | changed: [instance] 2026-02-24 17:59:29.218894 | controller | 2026-02-24 17:59:29.218924 | controller | TASK [repo_setup : Get component repo] ***************************************** 2026-02-24 17:59:29.218932 | controller | Tuesday 24 February 2026 17:59:29 +0000 (0:00:00.808) 0:00:13.926 ****** 2026-02-24 17:59:29.218941 | controller | skipping: [instance] 2026-02-24 17:59:29.255729 | controller | 2026-02-24 17:59:29.255790 | controller | TASK [repo_setup : Rename component repo] ************************************** 2026-02-24 17:59:29.255805 | controller | Tuesday 24 February 2026 17:59:29 +0000 (0:00:00.041) 0:00:13.967 ****** 2026-02-24 17:59:29.255824 | controller | skipping: [instance] 2026-02-24 17:59:29.256759 | controller | 2026-02-24 17:59:29.293748 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2026-02-24 17:59:29.293810 | controller | Tuesday 24 February 2026 17:59:29 +0000 (0:00:00.037) 0:00:14.004 ****** 2026-02-24 17:59:29.293832 | controller | skipping: [instance] 2026-02-24 17:59:29.293898 | controller | 2026-02-24 17:59:29.293916 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2026-02-24 17:59:29.293963 | controller | Tuesday 24 February 2026 17:59:29 +0000 (0:00:00.037) 0:00:14.042 ****** 2026-02-24 17:59:29.832130 | controller | changed: [instance] 2026-02-24 17:59:30.317079 | controller | 2026-02-24 17:59:30.317103 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2026-02-24 17:59:30.317111 | controller | Tuesday 24 February 2026 17:59:29 +0000 (0:00:00.538) 0:00:14.580 ****** 2026-02-24 17:59:30.317120 | controller | changed: [instance] 2026-02-24 17:59:30.357198 | controller | 2026-02-24 17:59:30.357216 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2026-02-24 17:59:30.357222 | controller | Tuesday 24 February 2026 17:59:30 +0000 (0:00:00.484) 0:00:15.065 ****** 2026-02-24 17:59:30.357231 | controller | skipping: [instance] 2026-02-24 17:59:30.390687 | controller | 2026-02-24 17:59:30.390750 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2026-02-24 17:59:30.390763 | controller | Tuesday 24 February 2026 17:59:30 +0000 (0:00:00.039) 0:00:15.105 ****** 2026-02-24 17:59:30.390784 | controller | skipping: [instance] 2026-02-24 17:59:30.390822 | controller | 2026-02-24 17:59:30.391120 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2026-02-24 17:59:30.426681 | controller | Tuesday 24 February 2026 17:59:30 +0000 (0:00:00.033) 0:00:15.139 ****** 2026-02-24 17:59:30.426732 | controller | skipping: [instance] 2026-02-24 17:59:30.468747 | controller | 2026-02-24 17:59:30.468815 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2026-02-24 17:59:30.468838 | controller | Tuesday 24 February 2026 17:59:30 +0000 (0:00:00.035) 0:00:15.175 ****** 2026-02-24 17:59:30.468856 | controller | ok: [instance] 2026-02-24 17:59:30.468865 | controller | 2026-02-24 17:59:30.468872 | controller | TASK [repo_setup : Create download directory] ********************************** 2026-02-24 17:59:30.468883 | controller | Tuesday 24 February 2026 17:59:30 +0000 (0:00:00.041) 0:00:15.217 ****** 2026-02-24 17:59:30.499619 | controller | skipping: [instance] 2026-02-24 17:59:30.529210 | controller | 2026-02-24 17:59:30.529246 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2026-02-24 17:59:30.529260 | controller | Tuesday 24 February 2026 17:59:30 +0000 (0:00:00.030) 0:00:15.247 ****** 2026-02-24 17:59:30.529276 | controller | skipping: [instance] 2026-02-24 17:59:30.529424 | controller | 2026-02-24 17:59:30.529579 | controller | TASK [Download the RPM] ******************************************************** 2026-02-24 17:59:30.529712 | controller | Tuesday 24 February 2026 17:59:30 +0000 (0:00:00.030) 0:00:15.278 ****** 2026-02-24 17:59:30.563372 | controller | skipping: [instance] 2026-02-24 17:59:30.563532 | controller | 2026-02-24 17:59:30.563688 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2026-02-24 17:59:30.563839 | controller | Tuesday 24 February 2026 17:59:30 +0000 (0:00:00.034) 0:00:15.312 ****** 2026-02-24 17:59:30.638409 | controller | skipping: [instance] 2026-02-24 17:59:30.638723 | controller | 2026-02-24 17:59:30.638877 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2026-02-24 17:59:30.639002 | controller | Tuesday 24 February 2026 17:59:30 +0000 (0:00:00.074) 0:00:15.387 ****** 2026-02-24 17:59:30.669212 | controller | skipping: [instance] 2026-02-24 17:59:30.669479 | controller | 2026-02-24 17:59:30.669680 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2026-02-24 17:59:30.669810 | controller | Tuesday 24 February 2026 17:59:30 +0000 (0:00:00.030) 0:00:15.418 ****** 2026-02-24 17:59:30.699062 | controller | skipping: [instance] 2026-02-24 17:59:30.699331 | controller | 2026-02-24 17:59:30.699632 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2026-02-24 17:59:30.699765 | controller | Tuesday 24 February 2026 17:59:30 +0000 (0:00:00.029) 0:00:15.448 ****** 2026-02-24 17:59:30.725850 | controller | skipping: [instance] 2026-02-24 17:59:30.726125 | controller | 2026-02-24 17:59:30.726382 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2026-02-24 17:59:30.726669 | controller | Tuesday 24 February 2026 17:59:30 +0000 (0:00:00.026) 0:00:15.474 ****** 2026-02-24 17:59:30.925034 | controller | ok: [instance] 2026-02-24 17:59:30.925095 | controller | 2026-02-24 17:59:30.925105 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2026-02-24 17:59:30.925117 | controller | Tuesday 24 February 2026 17:59:30 +0000 (0:00:00.198) 0:00:15.673 ****** 2026-02-24 17:59:31.157447 | controller | changed: [instance] 2026-02-24 17:59:31.397988 | controller | 2026-02-24 17:59:31.398015 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2026-02-24 17:59:31.398023 | controller | Tuesday 24 February 2026 17:59:31 +0000 (0:00:00.232) 0:00:15.906 ****** 2026-02-24 17:59:31.398033 | controller | changed: [instance] 2026-02-24 17:59:31.421882 | controller | 2026-02-24 17:59:31.421901 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2026-02-24 17:59:31.421909 | controller | Tuesday 24 February 2026 17:59:31 +0000 (0:00:00.240) 0:00:16.146 ****** 2026-02-24 17:59:31.421918 | controller | skipping: [instance] 2026-02-24 17:59:31.454677 | controller | 2026-02-24 17:59:31.454730 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2026-02-24 17:59:31.454741 | controller | Tuesday 24 February 2026 17:59:31 +0000 (0:00:00.023) 0:00:16.170 ****** 2026-02-24 17:59:31.454756 | controller | skipping: [instance] 2026-02-24 17:59:31.454810 | controller | 2026-02-24 17:59:31.454824 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2026-02-24 17:59:31.481363 | controller | Tuesday 24 February 2026 17:59:31 +0000 (0:00:00.032) 0:00:16.203 ****** 2026-02-24 17:59:31.481402 | controller | skipping: [instance] 2026-02-24 17:59:31.509275 | controller | 2026-02-24 17:59:31.509293 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2026-02-24 17:59:31.509301 | controller | Tuesday 24 February 2026 17:59:31 +0000 (0:00:00.026) 0:00:16.230 ****** 2026-02-24 17:59:31.509310 | controller | skipping: [instance] 2026-02-24 17:59:31.535264 | controller | 2026-02-24 17:59:31.535281 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2026-02-24 17:59:31.535294 | controller | Tuesday 24 February 2026 17:59:31 +0000 (0:00:00.027) 0:00:16.257 ****** 2026-02-24 17:59:31.535303 | controller | skipping: [instance] 2026-02-24 17:59:31.561289 | controller | 2026-02-24 17:59:31.561322 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] *** 2026-02-24 17:59:31.561336 | controller | Tuesday 24 February 2026 17:59:31 +0000 (0:00:00.025) 0:00:16.283 ****** 2026-02-24 17:59:31.561352 | controller | skipping: [instance] 2026-02-24 17:59:31.561647 | controller | 2026-02-24 17:59:31.561933 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2026-02-24 17:59:31.562191 | controller | Tuesday 24 February 2026 17:59:31 +0000 (0:00:00.026) 0:00:16.310 ****** 2026-02-24 17:59:31.581641 | controller | skipping: [instance] 2026-02-24 17:59:31.581837 | controller | 2026-02-24 17:59:31.582097 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2026-02-24 17:59:31.582301 | controller | Tuesday 24 February 2026 17:59:31 +0000 (0:00:00.020) 0:00:16.330 ****** 2026-02-24 17:59:31.612353 | controller | skipping: [instance] 2026-02-24 17:59:31.612464 | controller | 2026-02-24 17:59:31.612604 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2026-02-24 17:59:31.612760 | controller | Tuesday 24 February 2026 17:59:31 +0000 (0:00:00.030) 0:00:16.361 ****** 2026-02-24 17:59:31.634221 | controller | skipping: [instance] 2026-02-24 17:59:31.634368 | controller | 2026-02-24 17:59:31.634534 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2026-02-24 17:59:31.634627 | controller | Tuesday 24 February 2026 17:59:31 +0000 (0:00:00.021) 0:00:16.383 ****** 2026-02-24 17:59:31.656091 | controller | skipping: [instance] 2026-02-24 17:59:31.656193 | controller | 2026-02-24 17:59:31.656438 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2026-02-24 17:59:31.656541 | controller | Tuesday 24 February 2026 17:59:31 +0000 (0:00:00.021) 0:00:16.405 ****** 2026-02-24 17:59:31.685370 | controller | skipping: [instance] 2026-02-24 17:59:31.685488 | controller | 2026-02-24 17:59:31.685676 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2026-02-24 17:59:31.685798 | controller | Tuesday 24 February 2026 17:59:31 +0000 (0:00:00.029) 0:00:16.434 ****** 2026-02-24 17:59:31.717941 | controller | skipping: [instance] 2026-02-24 17:59:31.718151 | controller | 2026-02-24 17:59:31.718351 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2026-02-24 17:59:31.718543 | controller | Tuesday 24 February 2026 17:59:31 +0000 (0:00:00.032) 0:00:16.467 ****** 2026-02-24 17:59:31.747830 | controller | skipping: [instance] 2026-02-24 17:59:31.747965 | controller | 2026-02-24 17:59:31.748131 | controller | TASK [test_deps : Install additional packages] ********************************* 2026-02-24 17:59:31.748245 | controller | Tuesday 24 February 2026 17:59:31 +0000 (0:00:00.029) 0:00:16.496 ****** 2026-02-24 17:59:31.781310 | controller | skipping: [instance] 2026-02-24 17:59:31.781545 | controller | 2026-02-24 17:59:31.781757 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2026-02-24 17:59:31.781857 | controller | Tuesday 24 February 2026 17:59:31 +0000 (0:00:00.033) 0:00:16.530 ****** 2026-02-24 18:00:23.996135 | controller | ok: [instance] 2026-02-24 18:00:25.263143 | controller | 2026-02-24 18:00:25.263180 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2026-02-24 18:00:25.263188 | controller | Tuesday 24 February 2026 18:00:23 +0000 (0:00:52.214) 0:01:08.744 ****** 2026-02-24 18:00:25.263198 | controller | ok: [instance] 2026-02-24 18:00:25.298647 | controller | 2026-02-24 18:00:25.298689 | controller | TASK [test_deps : Install extra packages] ************************************** 2026-02-24 18:00:25.298700 | controller | Tuesday 24 February 2026 18:00:25 +0000 (0:00:01.266) 0:01:10.011 ****** 2026-02-24 18:00:25.298714 | controller | skipping: [instance] 2026-02-24 18:00:25.346444 | controller | 2026-02-24 18:00:25.346482 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2026-02-24 18:00:25.346490 | controller | Tuesday 24 February 2026 18:00:25 +0000 (0:00:00.035) 0:01:10.047 ****** 2026-02-24 18:00:25.346500 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2026-02-24 18:00:25.371660 | controller | 2026-02-24 18:00:25.371688 | controller | TASK [ci_setup : List packages to install] ************************************* 2026-02-24 18:00:25.371698 | controller | Tuesday 24 February 2026 18:00:25 +0000 (0:00:00.048) 0:01:10.095 ****** 2026-02-24 18:00:25.371709 | controller | ok: [instance] => 2026-02-24 18:00:25.371739 | controller | cifmw_ci_setup_packages: 2026-02-24 18:00:25.371748 | controller | - bash-completion 2026-02-24 18:00:25.371754 | controller | - ca-certificates 2026-02-24 18:00:25.371761 | controller | - git-core 2026-02-24 18:00:25.371768 | controller | - make 2026-02-24 18:00:25.371774 | controller | - tar 2026-02-24 18:00:25.371781 | controller | - tmux 2026-02-24 18:00:25.371788 | controller | - python3-pip 2026-02-24 18:00:25.371794 | controller | 2026-02-24 18:00:25.371803 | controller | TASK [ci_setup : Install needed packages] ************************************** 2026-02-24 18:00:32.677215 | controller | Tuesday 24 February 2026 18:00:25 +0000 (0:00:00.024) 0:01:10.119 ****** 2026-02-24 18:00:32.677258 | controller | changed: [instance] 2026-02-24 18:00:33.322708 | controller | 2026-02-24 18:00:33.322772 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2026-02-24 18:00:33.322782 | controller | Tuesday 24 February 2026 18:00:32 +0000 (0:00:07.305) 0:01:17.425 ****** 2026-02-24 18:00:33.322797 | controller | ok: [instance] 2026-02-24 18:00:33.322827 | controller | 2026-02-24 18:00:33.322835 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2026-02-24 18:00:33.546632 | controller | Tuesday 24 February 2026 18:00:33 +0000 (0:00:00.645) 0:01:18.071 ****** 2026-02-24 18:00:33.546683 | controller | changed: [instance] 2026-02-24 18:00:39.776290 | controller | 2026-02-24 18:00:39.776327 | controller | TASK [ci_setup : Install openshift client] ************************************* 2026-02-24 18:00:39.776335 | controller | Tuesday 24 February 2026 18:00:33 +0000 (0:00:00.224) 0:01:18.295 ****** 2026-02-24 18:00:39.776345 | controller | changed: [instance] 2026-02-24 18:00:39.814067 | controller | 2026-02-24 18:00:39.814091 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2026-02-24 18:00:39.814101 | controller | Tuesday 24 February 2026 18:00:39 +0000 (0:00:06.229) 0:01:24.524 ****** 2026-02-24 18:00:39.814111 | controller | ok: [instance] 2026-02-24 18:00:40.084134 | controller | 2026-02-24 18:00:40.084170 | controller | TASK [ci_setup : Create completion file] *************************************** 2026-02-24 18:00:40.084178 | controller | Tuesday 24 February 2026 18:00:39 +0000 (0:00:00.037) 0:01:24.562 ****** 2026-02-24 18:00:40.084189 | controller | changed: [instance] 2026-02-24 18:00:40.353575 | controller | 2026-02-24 18:00:40.353611 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2026-02-24 18:00:40.353619 | controller | Tuesday 24 February 2026 18:00:40 +0000 (0:00:00.269) 0:01:24.832 ****** 2026-02-24 18:00:40.353630 | controller | changed: [instance] 2026-02-24 18:00:40.370249 | controller | 2026-02-24 18:00:40.370277 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2026-02-24 18:00:40.370289 | controller | Tuesday 24 February 2026 18:00:40 +0000 (0:00:00.269) 0:01:25.102 ****** 2026-02-24 18:00:40.370303 | controller | skipping: [instance] 2026-02-24 18:00:40.386583 | controller | 2026-02-24 18:00:40.386620 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2026-02-24 18:00:40.386633 | controller | Tuesday 24 February 2026 18:00:40 +0000 (0:00:00.016) 0:01:25.119 ****** 2026-02-24 18:00:40.386669 | controller | skipping: [instance] 2026-02-24 18:00:40.403721 | controller | 2026-02-24 18:00:40.403760 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2026-02-24 18:00:40.403769 | controller | Tuesday 24 February 2026 18:00:40 +0000 (0:00:00.016) 0:01:25.135 ****** 2026-02-24 18:00:40.403781 | controller | skipping: [instance] 2026-02-24 18:00:40.403810 | controller | 2026-02-24 18:00:40.403819 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2026-02-24 18:00:40.403855 | controller | Tuesday 24 February 2026 18:00:40 +0000 (0:00:00.017) 0:01:25.152 ****** 2026-02-24 18:00:40.419327 | controller | skipping: [instance] 2026-02-24 18:00:40.434616 | controller | 2026-02-24 18:00:40.434675 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2026-02-24 18:00:40.434696 | controller | Tuesday 24 February 2026 18:00:40 +0000 (0:00:00.015) 0:01:25.168 ****** 2026-02-24 18:00:40.434713 | controller | skipping: [instance] 2026-02-24 18:00:40.434859 | controller | 2026-02-24 18:00:40.434871 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2026-02-24 18:00:40.434882 | controller | Tuesday 24 February 2026 18:00:40 +0000 (0:00:00.015) 0:01:25.183 ****** 2026-02-24 18:00:40.454846 | controller | skipping: [instance] 2026-02-24 18:00:40.454926 | controller | 2026-02-24 18:00:40.455117 | controller | TASK [ci_setup : Manage directories] ******************************************* 2026-02-24 18:00:40.455202 | controller | Tuesday 24 February 2026 18:00:40 +0000 (0:00:00.020) 0:01:25.204 ****** 2026-02-24 18:00:41.397478 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2026-02-24 18:00:41.746647 | controller | changed: [instance] => (item=/opt/basedir/logs) 2026-02-24 18:00:41.746702 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2026-02-24 18:00:41.746712 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2026-02-24 18:00:41.746720 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2026-02-24 18:00:41.746727 | controller | 2026-02-24 18:00:41.746734 | controller | TASK [Create secret file] ****************************************************** 2026-02-24 18:00:41.746742 | controller | Tuesday 24 February 2026 18:00:41 +0000 (0:00:00.941) 0:01:26.145 ****** 2026-02-24 18:00:41.746755 | controller | changed: [instance] 2026-02-24 18:00:41.746788 | controller | 2026-02-24 18:00:41.746797 | controller | PLAY RECAP ********************************************************************* 2026-02-24 18:00:41.746805 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2026-02-24 18:00:41.746812 | controller | 2026-02-24 18:00:41.746818 | controller | Tuesday 24 February 2026 18:00:41 +0000 (0:00:00.348) 0:01:26.494 ****** 2026-02-24 18:00:41.746833 | controller | =============================================================================== 2026-02-24 18:00:41.746840 | controller | test_deps : Install selinux python libs -------------------------------- 52.21s 2026-02-24 18:00:41.746847 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.52s 2026-02-24 18:00:41.746854 | controller | ci_setup : Install needed packages -------------------------------------- 7.31s 2026-02-24 18:00:41.746863 | controller | ci_setup : Install openshift client ------------------------------------- 6.23s 2026-02-24 18:00:41.746890 | controller | test_deps : Install python yaml libs ------------------------------------ 1.27s 2026-02-24 18:00:41.746899 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.04s 2026-02-24 18:00:41.748119 | controller | ci_setup : Manage directories ------------------------------------------- 0.94s 2026-02-24 18:00:41.806262 | controller | Gathering Facts --------------------------------------------------------- 0.83s 2026-02-24 18:00:41.806284 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.81s 2026-02-24 18:00:41.806291 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.81s 2026-02-24 18:00:41.806297 | controller | repo_setup : Install repo-setup package --------------------------------- 0.73s 2026-02-24 18:00:41.806302 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.71s 2026-02-24 18:00:41.806308 | controller | ci_setup : Gather version of openshift client --------------------------- 0.65s 2026-02-24 18:00:41.806313 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.54s 2026-02-24 18:00:41.806318 | controller | repo_setup : Ensure directories are present ----------------------------- 0.52s 2026-02-24 18:00:41.806324 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.48s 2026-02-24 18:00:41.806329 | controller | Create secret file ------------------------------------------------------ 0.35s 2026-02-24 18:00:41.806334 | controller | Create custom basedir --------------------------------------------------- 0.31s 2026-02-24 18:00:41.806339 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.28s 2026-02-24 18:00:41.806351 | controller | ci_setup : Create completion file --------------------------------------- 0.27s 2026-02-24 18:00:41.806360 | controller | INFO Running crc_layout > converge 2026-02-24 18:00:42.380697 | controller | 2026-02-24 18:00:42.380834 | controller | PLAY [Converge] **************************************************************** 2026-02-24 18:00:42.380937 | controller | 2026-02-24 18:00:42.381046 | controller | TASK [Gathering Facts] ********************************************************* 2026-02-24 18:00:42.381153 | controller | Tuesday 24 February 2026 18:00:42 +0000 (0:00:00.024) 0:00:00.024 ****** 2026-02-24 18:00:43.181122 | controller | ok: [instance] 2026-02-24 18:00:43.203483 | controller | 2026-02-24 18:00:43.203504 | controller | TASK [Load networking definition from scenario file] *************************** 2026-02-24 18:00:43.203542 | controller | Tuesday 24 February 2026 18:00:43 +0000 (0:00:00.800) 0:00:00.825 ****** 2026-02-24 18:00:43.203557 | controller | ok: [instance] 2026-02-24 18:00:44.741444 | controller | 2026-02-24 18:00:44.741479 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2026-02-24 18:00:44.741487 | controller | Tuesday 24 February 2026 18:00:43 +0000 (0:00:00.022) 0:00:00.847 ****** 2026-02-24 18:00:44.741498 | controller | changed: [instance] 2026-02-24 18:00:44.770444 | controller | 2026-02-24 18:00:44.770467 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2026-02-24 18:00:44.770476 | controller | Tuesday 24 February 2026 18:00:44 +0000 (0:00:01.537) 0:00:02.385 ****** 2026-02-24 18:00:44.770486 | controller | ok: [instance] 2026-02-24 18:00:44.792371 | controller | 2026-02-24 18:00:44.792391 | controller | TASK [reproducer : Load CI job environment] ************************************ 2026-02-24 18:00:44.792404 | controller | Tuesday 24 February 2026 18:00:44 +0000 (0:00:00.029) 0:00:02.414 ****** 2026-02-24 18:00:44.792415 | controller | skipping: [instance] 2026-02-24 18:00:44.843996 | controller | 2026-02-24 18:00:44.844019 | controller | TASK [Build final libvirt layout] ********************************************** 2026-02-24 18:00:44.844027 | controller | Tuesday 24 February 2026 18:00:44 +0000 (0:00:00.022) 0:00:02.436 ****** 2026-02-24 18:00:44.844037 | controller | 2026-02-24 18:00:44.924260 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2026-02-24 18:00:44.924284 | controller | Tuesday 24 February 2026 18:00:44 +0000 (0:00:00.051) 0:00:02.488 ****** 2026-02-24 18:00:44.924298 | controller | ok: [instance] 2026-02-24 18:00:44.989432 | controller | 2026-02-24 18:00:44.989455 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2026-02-24 18:00:44.989464 | controller | Tuesday 24 February 2026 18:00:44 +0000 (0:00:00.079) 0:00:02.568 ****** 2026-02-24 18:00:44.989475 | controller | skipping: [instance] 2026-02-24 18:00:45.014456 | controller | 2026-02-24 18:00:45.014477 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2026-02-24 18:00:45.014486 | controller | Tuesday 24 February 2026 18:00:44 +0000 (0:00:00.064) 0:00:02.633 ****** 2026-02-24 18:00:45.014496 | controller | ok: [instance] 2026-02-24 18:00:45.014679 | controller | 2026-02-24 18:00:45.014857 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2026-02-24 18:00:45.015010 | controller | Tuesday 24 February 2026 18:00:45 +0000 (0:00:00.025) 0:00:02.659 ****** 2026-02-24 18:00:45.041061 | controller | ok: [instance] => changed=false 2026-02-24 18:00:45.041249 | controller | msg: All assertions passed 2026-02-24 18:00:45.041409 | controller | 2026-02-24 18:00:45.041590 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2026-02-24 18:00:45.041742 | controller | Tuesday 24 February 2026 18:00:45 +0000 (0:00:00.026) 0:00:02.685 ****** 2026-02-24 18:00:45.083374 | controller | ok: [instance] 2026-02-24 18:00:45.083565 | controller | 2026-02-24 18:00:45.083723 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2026-02-24 18:00:45.083855 | controller | Tuesday 24 February 2026 18:00:45 +0000 (0:00:00.042) 0:00:02.728 ****** 2026-02-24 18:00:45.522689 | controller | ok: [instance] => (item=artifacts) 2026-02-24 18:00:45.596108 | controller | ok: [instance] => (item=logs) 2026-02-24 18:00:45.596152 | controller | 2026-02-24 18:00:45.596163 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2026-02-24 18:00:45.596194 | controller | Tuesday 24 February 2026 18:00:45 +0000 (0:00:00.438) 0:00:03.166 ****** 2026-02-24 18:00:45.596208 | controller | 2026-02-24 18:00:45.778288 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2026-02-24 18:00:45.778325 | controller | Tuesday 24 February 2026 18:00:45 +0000 (0:00:00.073) 0:00:03.240 ****** 2026-02-24 18:00:45.778338 | controller | ok: [instance] 2026-02-24 18:00:46.064500 | controller | 2026-02-24 18:00:46.064544 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2026-02-24 18:00:46.064552 | controller | Tuesday 24 February 2026 18:00:45 +0000 (0:00:00.181) 0:00:03.422 ****** 2026-02-24 18:00:46.064563 | controller | changed: [instance] 2026-02-24 18:00:46.348901 | controller | 2026-02-24 18:00:46.348926 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2026-02-24 18:00:46.348934 | controller | Tuesday 24 February 2026 18:00:46 +0000 (0:00:00.286) 0:00:03.708 ****** 2026-02-24 18:00:46.348944 | controller | ok: [instance] 2026-02-24 18:00:46.378130 | controller | 2026-02-24 18:00:46.378149 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2026-02-24 18:00:46.378157 | controller | Tuesday 24 February 2026 18:00:46 +0000 (0:00:00.284) 0:00:03.993 ****** 2026-02-24 18:00:46.378166 | controller | skipping: [instance] 2026-02-24 18:00:46.395615 | controller | 2026-02-24 18:00:46.395638 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2026-02-24 18:00:46.395648 | controller | Tuesday 24 February 2026 18:00:46 +0000 (0:00:00.029) 0:00:04.022 ****** 2026-02-24 18:00:46.395659 | controller | skipping: [instance] 2026-02-24 18:00:46.414956 | controller | 2026-02-24 18:00:46.414980 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2026-02-24 18:00:46.414989 | controller | Tuesday 24 February 2026 18:00:46 +0000 (0:00:00.017) 0:00:04.039 ****** 2026-02-24 18:00:46.414999 | controller | ok: [instance] 2026-02-24 18:00:46.442038 | controller | 2026-02-24 18:00:46.442060 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2026-02-24 18:00:46.442069 | controller | Tuesday 24 February 2026 18:00:46 +0000 (0:00:00.019) 0:00:04.059 ****** 2026-02-24 18:00:46.442080 | controller | skipping: [instance] 2026-02-24 18:00:56.251925 | controller | 2026-02-24 18:00:56.251962 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2026-02-24 18:00:56.251977 | controller | Tuesday 24 February 2026 18:00:46 +0000 (0:00:00.027) 0:00:04.086 ****** 2026-02-24 18:00:56.251989 | controller | changed: [instance] 2026-02-24 18:00:56.465407 | controller | 2026-02-24 18:00:56.465440 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2026-02-24 18:00:56.465448 | controller | Tuesday 24 February 2026 18:00:56 +0000 (0:00:09.809) 0:00:13.895 ****** 2026-02-24 18:00:56.465467 | controller | changed: [instance] 2026-02-24 18:00:56.465488 | controller | 2026-02-24 18:00:56.465789 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2026-02-24 18:00:56.969667 | controller | Tuesday 24 February 2026 18:00:56 +0000 (0:00:00.213) 0:00:14.109 ****** 2026-02-24 18:00:56.969710 | controller | changed: [instance] 2026-02-24 18:00:56.969737 | controller | 2026-02-24 18:00:56.969983 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2026-02-24 18:00:57.560681 | controller | Tuesday 24 February 2026 18:00:56 +0000 (0:00:00.504) 0:00:14.613 ****** 2026-02-24 18:00:57.560730 | controller | changed: [instance] 2026-02-24 18:00:57.560767 | controller | 2026-02-24 18:00:57.560777 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2026-02-24 18:00:57.560910 | controller | Tuesday 24 February 2026 18:00:57 +0000 (0:00:00.590) 0:00:15.204 ****** 2026-02-24 18:00:57.759383 | controller | ok: [instance] 2026-02-24 18:00:58.414293 | controller | 2026-02-24 18:00:58.414319 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2026-02-24 18:00:58.414327 | controller | Tuesday 24 February 2026 18:00:57 +0000 (0:00:00.198) 0:00:15.403 ****** 2026-02-24 18:00:58.414337 | controller | ok: [instance] 2026-02-24 18:00:59.202464 | controller | 2026-02-24 18:00:59.202491 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2026-02-24 18:00:59.202509 | controller | Tuesday 24 February 2026 18:00:58 +0000 (0:00:00.655) 0:00:16.058 ****** 2026-02-24 18:00:59.202545 | controller | changed: [instance] 2026-02-24 18:00:59.287656 | controller | 2026-02-24 18:00:59.287703 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2026-02-24 18:00:59.287715 | controller | Tuesday 24 February 2026 18:00:59 +0000 (0:00:00.788) 0:00:16.846 ****** 2026-02-24 18:00:59.287731 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2026-02-24 18:00:59.607419 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2026-02-24 18:00:59.607446 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2026-02-24 18:00:59.607453 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2026-02-24 18:00:59.607459 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2026-02-24 18:00:59.607465 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2026-02-24 18:00:59.607470 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2026-02-24 18:00:59.607476 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2026-02-24 18:00:59.607482 | controller | 2026-02-24 18:00:59.607488 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2026-02-24 18:00:59.607494 | controller | Tuesday 24 February 2026 18:00:59 +0000 (0:00:00.084) 0:00:16.931 ****** 2026-02-24 18:00:59.607504 | controller | ok: [instance] 2026-02-24 18:00:59.929640 | controller | 2026-02-24 18:00:59.929690 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2026-02-24 18:00:59.929700 | controller | Tuesday 24 February 2026 18:00:59 +0000 (0:00:00.319) 0:00:17.251 ****** 2026-02-24 18:00:59.929714 | controller | ok: [instance] 2026-02-24 18:00:59.929735 | controller | 2026-02-24 18:00:59.929744 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2026-02-24 18:00:59.929775 | controller | Tuesday 24 February 2026 18:00:59 +0000 (0:00:00.322) 0:00:17.574 ****** 2026-02-24 18:01:00.251582 | controller | ok: [instance] 2026-02-24 18:01:00.251637 | controller | 2026-02-24 18:01:00.251725 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2026-02-24 18:01:00.251819 | controller | Tuesday 24 February 2026 18:01:00 +0000 (0:00:00.322) 0:00:17.896 ****** 2026-02-24 18:01:00.588894 | controller | ok: [instance] 2026-02-24 18:01:00.914221 | controller | 2026-02-24 18:01:00.914248 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2026-02-24 18:01:00.914256 | controller | Tuesday 24 February 2026 18:01:00 +0000 (0:00:00.336) 0:00:18.233 ****** 2026-02-24 18:01:00.914266 | controller | ok: [instance] 2026-02-24 18:01:01.235221 | controller | 2026-02-24 18:01:01.235251 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2026-02-24 18:01:01.235260 | controller | Tuesday 24 February 2026 18:01:00 +0000 (0:00:00.325) 0:00:18.558 ****** 2026-02-24 18:01:01.235272 | controller | ok: [instance] 2026-02-24 18:01:01.563407 | controller | 2026-02-24 18:01:01.563444 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2026-02-24 18:01:01.563452 | controller | Tuesday 24 February 2026 18:01:01 +0000 (0:00:00.320) 0:00:18.879 ****** 2026-02-24 18:01:01.563463 | controller | ok: [instance] 2026-02-24 18:01:01.882021 | controller | 2026-02-24 18:01:01.882050 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2026-02-24 18:01:01.882058 | controller | Tuesday 24 February 2026 18:01:01 +0000 (0:00:00.327) 0:00:19.207 ****** 2026-02-24 18:01:01.882079 | controller | ok: [instance] 2026-02-24 18:01:02.204567 | controller | 2026-02-24 18:01:02.204591 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2026-02-24 18:01:02.204598 | controller | Tuesday 24 February 2026 18:01:01 +0000 (0:00:00.319) 0:00:19.526 ****** 2026-02-24 18:01:02.204607 | controller | ok: [instance] 2026-02-24 18:01:02.204874 | controller | 2026-02-24 18:01:02.550700 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2026-02-24 18:01:02.550741 | controller | Tuesday 24 February 2026 18:01:02 +0000 (0:00:00.322) 0:00:19.848 ****** 2026-02-24 18:01:02.550756 | controller | ok: [instance] 2026-02-24 18:01:02.872641 | controller | 2026-02-24 18:01:02.872669 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2026-02-24 18:01:02.872679 | controller | Tuesday 24 February 2026 18:01:02 +0000 (0:00:00.345) 0:00:20.194 ****** 2026-02-24 18:01:02.872691 | controller | ok: [instance] 2026-02-24 18:01:03.213292 | controller | 2026-02-24 18:01:03.213322 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2026-02-24 18:01:03.213330 | controller | Tuesday 24 February 2026 18:01:02 +0000 (0:00:00.322) 0:00:20.516 ****** 2026-02-24 18:01:03.213340 | controller | ok: [instance] 2026-02-24 18:01:03.570625 | controller | 2026-02-24 18:01:03.570671 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2026-02-24 18:01:03.570679 | controller | Tuesday 24 February 2026 18:01:03 +0000 (0:00:00.340) 0:00:20.857 ****** 2026-02-24 18:01:03.570692 | controller | ok: [instance] 2026-02-24 18:01:03.570918 | controller | 2026-02-24 18:01:03.570944 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2026-02-24 18:01:03.898556 | controller | Tuesday 24 February 2026 18:01:03 +0000 (0:00:00.357) 0:00:21.214 ****** 2026-02-24 18:01:03.898580 | controller | ok: [instance] 2026-02-24 18:01:04.231947 | controller | 2026-02-24 18:01:04.231967 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2026-02-24 18:01:04.231986 | controller | Tuesday 24 February 2026 18:01:03 +0000 (0:00:00.327) 0:00:21.542 ****** 2026-02-24 18:01:04.231995 | controller | ok: [instance] 2026-02-24 18:01:04.563049 | controller | 2026-02-24 18:01:04.563068 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2026-02-24 18:01:04.563075 | controller | Tuesday 24 February 2026 18:01:04 +0000 (0:00:00.333) 0:00:21.876 ****** 2026-02-24 18:01:04.563084 | controller | ok: [instance] 2026-02-24 18:01:04.894535 | controller | 2026-02-24 18:01:04.894565 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2026-02-24 18:01:04.894573 | controller | Tuesday 24 February 2026 18:01:04 +0000 (0:00:00.330) 0:00:22.207 ****** 2026-02-24 18:01:04.894582 | controller | ok: [instance] 2026-02-24 18:01:05.219883 | controller | 2026-02-24 18:01:05.219906 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2026-02-24 18:01:05.219914 | controller | Tuesday 24 February 2026 18:01:04 +0000 (0:00:00.331) 0:00:22.538 ****** 2026-02-24 18:01:05.219924 | controller | ok: [instance] 2026-02-24 18:01:05.554475 | controller | 2026-02-24 18:01:05.554495 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2026-02-24 18:01:05.554502 | controller | Tuesday 24 February 2026 18:01:05 +0000 (0:00:00.325) 0:00:22.864 ****** 2026-02-24 18:01:05.554544 | controller | ok: [instance] 2026-02-24 18:01:05.911694 | controller | 2026-02-24 18:01:05.911738 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2026-02-24 18:01:05.911746 | controller | Tuesday 24 February 2026 18:01:05 +0000 (0:00:00.334) 0:00:23.198 ****** 2026-02-24 18:01:05.911758 | controller | ok: [instance] 2026-02-24 18:01:05.911790 | controller | 2026-02-24 18:01:05.911799 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2026-02-24 18:01:05.911825 | controller | Tuesday 24 February 2026 18:01:05 +0000 (0:00:00.356) 0:00:23.555 ****** 2026-02-24 18:01:06.248649 | controller | ok: [instance] 2026-02-24 18:01:06.587150 | controller | 2026-02-24 18:01:06.587193 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2026-02-24 18:01:06.587204 | controller | Tuesday 24 February 2026 18:01:06 +0000 (0:00:00.337) 0:00:23.892 ****** 2026-02-24 18:01:06.587235 | controller | ok: [instance] 2026-02-24 18:01:06.587261 | controller | 2026-02-24 18:01:06.587302 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2026-02-24 18:01:06.587418 | controller | Tuesday 24 February 2026 18:01:06 +0000 (0:00:00.338) 0:00:24.231 ****** 2026-02-24 18:01:06.921921 | controller | ok: [instance] 2026-02-24 18:01:06.921995 | controller | 2026-02-24 18:01:06.922112 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2026-02-24 18:01:06.922299 | controller | Tuesday 24 February 2026 18:01:06 +0000 (0:00:00.334) 0:00:24.566 ****** 2026-02-24 18:01:08.261136 | controller | ok: [instance] 2026-02-24 18:01:08.285639 | controller | 2026-02-24 18:01:08.285695 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2026-02-24 18:01:08.285709 | controller | Tuesday 24 February 2026 18:01:08 +0000 (0:00:01.338) 0:00:25.904 ****** 2026-02-24 18:01:08.285728 | controller | skipping: [instance] 2026-02-24 18:01:08.285783 | controller | 2026-02-24 18:01:08.285885 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2026-02-24 18:01:08.285915 | controller | Tuesday 24 February 2026 18:01:08 +0000 (0:00:00.025) 0:00:25.929 ****** 2026-02-24 18:01:08.580437 | controller | ok: [instance] 2026-02-24 18:01:08.967084 | controller | 2026-02-24 18:01:08.967128 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2026-02-24 18:01:08.967137 | controller | Tuesday 24 February 2026 18:01:08 +0000 (0:00:00.293) 0:00:26.223 ****** 2026-02-24 18:01:08.967149 | controller | ok: [instance] 2026-02-24 18:01:09.279646 | controller | 2026-02-24 18:01:09.279698 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2026-02-24 18:01:09.279708 | controller | Tuesday 24 February 2026 18:01:08 +0000 (0:00:00.386) 0:00:26.610 ****** 2026-02-24 18:01:09.279721 | controller | changed: [instance] 2026-02-24 18:01:09.279746 | controller | 2026-02-24 18:01:09.279757 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2026-02-24 18:01:09.565787 | controller | Tuesday 24 February 2026 18:01:09 +0000 (0:00:00.313) 0:00:26.923 ****** 2026-02-24 18:01:09.565834 | controller | [WARNING]: Reset is not implemented for this connection 2026-02-24 18:01:09.603711 | controller | changed: [instance] 2026-02-24 18:01:09.676411 | controller | 2026-02-24 18:01:09.676429 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2026-02-24 18:01:09.676436 | controller | Tuesday 24 February 2026 18:01:09 +0000 (0:00:00.280) 0:00:27.204 ****** 2026-02-24 18:01:09.676442 | controller | 2026-02-24 18:01:09.676448 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2026-02-24 18:01:09.676453 | controller | Tuesday 24 February 2026 18:01:09 +0000 (0:00:00.043) 0:00:27.247 ****** 2026-02-24 18:01:09.676463 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2026-02-24 18:01:09.719663 | controller | 2026-02-24 18:01:09.719703 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2026-02-24 18:01:09.719713 | controller | Tuesday 24 February 2026 18:01:09 +0000 (0:00:00.073) 0:00:27.320 ****** 2026-02-24 18:01:09.719726 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2026-02-24 18:01:09.719758 | controller | 2026-02-24 18:01:09.719768 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2026-02-24 18:01:09.719867 | controller | Tuesday 24 February 2026 18:01:09 +0000 (0:00:00.043) 0:00:27.364 ****** 2026-02-24 18:01:09.766578 | controller | ok: [instance] => (item=compute) 2026-02-24 18:01:09.766622 | controller | ok: [instance] => (item=controller) 2026-02-24 18:01:09.766636 | controller | ok: [instance] => (item=crc) 2026-02-24 18:01:09.766642 | controller | 2026-02-24 18:01:09.766649 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2026-02-24 18:01:09.766709 | controller | Tuesday 24 February 2026 18:01:09 +0000 (0:00:00.046) 0:00:27.411 ****** 2026-02-24 18:01:09.810342 | controller | ok: [instance] 2026-02-24 18:01:09.852639 | controller | 2026-02-24 18:01:09.852675 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2026-02-24 18:01:09.852693 | controller | Tuesday 24 February 2026 18:01:09 +0000 (0:00:00.043) 0:00:27.454 ****** 2026-02-24 18:01:09.852707 | controller | ok: [instance] => changed=false 2026-02-24 18:01:09.852741 | controller | msg: All assertions passed 2026-02-24 18:01:09.852752 | controller | 2026-02-24 18:01:09.852772 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2026-02-24 18:01:09.852967 | controller | Tuesday 24 February 2026 18:01:09 +0000 (0:00:00.042) 0:00:27.496 ****** 2026-02-24 18:01:09.896546 | controller | 2026-02-24 18:01:09.896649 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2026-02-24 18:01:09.896897 | controller | Tuesday 24 February 2026 18:01:09 +0000 (0:00:00.044) 0:00:27.541 ****** 2026-02-24 18:01:09.974490 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.49', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2026-02-24 18:01:09.974661 | controller | ok: [instance] => (item={}) 2026-02-24 18:01:09.974841 | controller | 2026-02-24 18:01:09.974951 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2026-02-24 18:01:09.975073 | controller | Tuesday 24 February 2026 18:01:09 +0000 (0:00:00.077) 0:00:27.618 ****** 2026-02-24 18:01:09.993266 | controller | skipping: [instance] 2026-02-24 18:01:09.993394 | controller | 2026-02-24 18:01:09.993570 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2026-02-24 18:01:09.993722 | controller | Tuesday 24 February 2026 18:01:09 +0000 (0:00:00.018) 0:00:27.637 ****** 2026-02-24 18:01:10.210606 | controller | ok: [instance] 2026-02-24 18:01:10.210629 | controller | 2026-02-24 18:01:10.210645 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2026-02-24 18:01:10.210656 | controller | Tuesday 24 February 2026 18:01:10 +0000 (0:00:00.216) 0:00:27.854 ****** 2026-02-24 18:01:10.552203 | controller | changed: [instance] 2026-02-24 18:01:11.272631 | controller | 2026-02-24 18:01:11.272669 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2026-02-24 18:01:11.272678 | controller | Tuesday 24 February 2026 18:01:10 +0000 (0:00:00.341) 0:00:28.196 ****** 2026-02-24 18:01:11.272688 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2026-02-24 18:01:11.272714 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2026-02-24 18:01:11.272722 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2026-02-24 18:01:11.273038 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2026-02-24 18:01:11.273058 | controller | 2026-02-24 18:01:11.298950 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2026-02-24 18:01:11.298983 | controller | Tuesday 24 February 2026 18:01:11 +0000 (0:00:00.720) 0:00:28.916 ****** 2026-02-24 18:01:11.298995 | controller | skipping: [instance] 2026-02-24 18:01:11.647664 | controller | 2026-02-24 18:01:11.647706 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2026-02-24 18:01:11.647716 | controller | Tuesday 24 February 2026 18:01:11 +0000 (0:00:00.026) 0:00:28.943 ****** 2026-02-24 18:01:11.647729 | controller | changed: [instance] 2026-02-24 18:01:11.647764 | controller | 2026-02-24 18:01:11.648202 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2026-02-24 18:01:11.648241 | controller | Tuesday 24 February 2026 18:01:11 +0000 (0:00:00.339) 0:00:29.283 ****** 2026-02-24 18:01:12.073403 | controller | 2026-02-24 18:01:12.073437 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 18:01:12.073445 | controller | Tuesday 24 February 2026 18:01:11 +0000 (0:00:00.008) 0:00:29.291 ****** 2026-02-24 18:01:12.073463 | controller | changed: [instance] 2026-02-24 18:01:12.148629 | controller | 2026-02-24 18:01:12.148662 | controller | TASK [Ensure no default networks exists] *************************************** 2026-02-24 18:01:12.148671 | controller | Tuesday 24 February 2026 18:01:12 +0000 (0:00:00.425) 0:00:29.717 ****** 2026-02-24 18:01:12.148682 | controller | 2026-02-24 18:01:13.346262 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2026-02-24 18:01:13.346298 | controller | Tuesday 24 February 2026 18:01:12 +0000 (0:00:00.075) 0:00:29.792 ****** 2026-02-24 18:01:13.346311 | controller | ok: [instance] 2026-02-24 18:01:13.580230 | controller | 2026-02-24 18:01:13.580261 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2026-02-24 18:01:13.580269 | controller | Tuesday 24 February 2026 18:01:13 +0000 (0:00:01.197) 0:00:30.990 ****** 2026-02-24 18:01:13.580280 | controller | ok: [instance] 2026-02-24 18:01:14.135694 | controller | 2026-02-24 18:01:14.135733 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2026-02-24 18:01:14.135741 | controller | Tuesday 24 February 2026 18:01:13 +0000 (0:00:00.234) 0:00:31.224 ****** 2026-02-24 18:01:14.135752 | controller | ok: [instance] 2026-02-24 18:01:14.367588 | controller | 2026-02-24 18:01:14.367634 | controller | TASK [libvirt_manager : Removing default] ************************************** 2026-02-24 18:01:14.367643 | controller | Tuesday 24 February 2026 18:01:14 +0000 (0:00:00.555) 0:00:31.779 ****** 2026-02-24 18:01:14.367657 | controller | ok: [instance] 2026-02-24 18:01:15.531625 | controller | 2026-02-24 18:01:15.531682 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2026-02-24 18:01:15.531693 | controller | Tuesday 24 February 2026 18:01:14 +0000 (0:00:00.231) 0:00:32.011 ****** 2026-02-24 18:01:15.531708 | controller | ok: [instance] 2026-02-24 18:01:15.847138 | controller | 2026-02-24 18:01:15.847175 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2026-02-24 18:01:15.847183 | controller | Tuesday 24 February 2026 18:01:15 +0000 (0:00:01.163) 0:00:33.175 ****** 2026-02-24 18:01:15.847194 | controller | ok: [instance] 2026-02-24 18:01:16.149541 | controller | 2026-02-24 18:01:16.149573 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2026-02-24 18:01:16.149582 | controller | Tuesday 24 February 2026 18:01:15 +0000 (0:00:00.315) 0:00:33.491 ****** 2026-02-24 18:01:16.149592 | controller | changed: [instance] 2026-02-24 18:01:16.440585 | controller | 2026-02-24 18:01:16.440630 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2026-02-24 18:01:16.440639 | controller | Tuesday 24 February 2026 18:01:16 +0000 (0:00:00.302) 0:00:33.793 ****** 2026-02-24 18:01:16.440650 | controller | changed: [instance] 2026-02-24 18:01:17.022672 | controller | 2026-02-24 18:01:17.022716 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2026-02-24 18:01:17.022726 | controller | Tuesday 24 February 2026 18:01:16 +0000 (0:00:00.291) 0:00:34.084 ****** 2026-02-24 18:01:17.022739 | controller | changed: [instance] => (item=arptables) 2026-02-24 18:01:17.338656 | controller | changed: [instance] => (item=iptables) 2026-02-24 18:01:17.338734 | controller | changed: [instance] => (item=ip6tables) 2026-02-24 18:01:17.338749 | controller | 2026-02-24 18:01:17.338760 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2026-02-24 18:01:17.338771 | controller | Tuesday 24 February 2026 18:01:17 +0000 (0:00:00.581) 0:00:34.666 ****** 2026-02-24 18:01:17.338791 | controller | ok: [instance] 2026-02-24 18:01:17.426753 | controller | 2026-02-24 18:01:17.426809 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2026-02-24 18:01:17.426823 | controller | Tuesday 24 February 2026 18:01:17 +0000 (0:00:00.316) 0:00:34.982 ****** 2026-02-24 18:01:17.426842 | controller | ok: [instance] 2026-02-24 18:01:17.426889 | controller | 2026-02-24 18:01:17.426903 | controller | TASK [Ensure the required network configurations are applied] ****************** 2026-02-24 18:01:17.427138 | controller | Tuesday 24 February 2026 18:01:17 +0000 (0:00:00.088) 0:00:35.071 ****** 2026-02-24 18:01:17.468203 | controller | 2026-02-24 18:01:17.493267 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2026-02-24 18:01:17.493294 | controller | Tuesday 24 February 2026 18:01:17 +0000 (0:00:00.041) 0:00:35.112 ****** 2026-02-24 18:01:17.493304 | controller | skipping: [instance] 2026-02-24 18:01:17.515702 | controller | 2026-02-24 18:01:17.515740 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2026-02-24 18:01:17.515749 | controller | Tuesday 24 February 2026 18:01:17 +0000 (0:00:00.024) 0:00:35.137 ****** 2026-02-24 18:01:17.515761 | controller | skipping: [instance] 2026-02-24 18:01:17.515793 | controller | 2026-02-24 18:01:17.515802 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 18:01:17.540675 | controller | Tuesday 24 February 2026 18:01:17 +0000 (0:00:00.022) 0:00:35.160 ****** 2026-02-24 18:01:17.540723 | controller | skipping: [instance] 2026-02-24 18:01:17.566807 | controller | 2026-02-24 18:01:17.566850 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2026-02-24 18:01:17.566865 | controller | Tuesday 24 February 2026 18:01:17 +0000 (0:00:00.024) 0:00:35.184 ****** 2026-02-24 18:01:17.566883 | controller | skipping: [instance] 2026-02-24 18:01:17.567122 | controller | 2026-02-24 18:01:17.567155 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2026-02-24 18:01:17.567176 | controller | Tuesday 24 February 2026 18:01:17 +0000 (0:00:00.026) 0:00:35.211 ****** 2026-02-24 18:01:17.604564 | controller | ok: [instance] 2026-02-24 18:01:17.604822 | controller | 2026-02-24 18:01:17.605088 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2026-02-24 18:01:17.605272 | controller | Tuesday 24 February 2026 18:01:17 +0000 (0:00:00.037) 0:00:35.248 ****** 2026-02-24 18:01:17.639155 | controller | skipping: [instance] 2026-02-24 18:01:17.639263 | controller | 2026-02-24 18:01:17.639465 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2026-02-24 18:01:17.639548 | controller | Tuesday 24 February 2026 18:01:17 +0000 (0:00:00.034) 0:00:35.283 ****** 2026-02-24 18:01:17.662375 | controller | skipping: [instance] 2026-02-24 18:01:17.662620 | controller | 2026-02-24 18:01:17.662872 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2026-02-24 18:01:17.663062 | controller | Tuesday 24 February 2026 18:01:17 +0000 (0:00:00.023) 0:00:35.306 ****** 2026-02-24 18:01:17.722389 | controller | ok: [instance] 2026-02-24 18:01:17.722543 | controller | 2026-02-24 18:01:17.722690 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2026-02-24 18:01:17.722809 | controller | Tuesday 24 February 2026 18:01:17 +0000 (0:00:00.060) 0:00:35.367 ****** 2026-02-24 18:01:17.745265 | controller | skipping: [instance] 2026-02-24 18:01:17.745354 | controller | 2026-02-24 18:01:17.745561 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2026-02-24 18:01:17.745645 | controller | Tuesday 24 February 2026 18:01:17 +0000 (0:00:00.022) 0:00:35.389 ****** 2026-02-24 18:01:17.792426 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2026-02-24 18:01:17.792693 | controller | 2026-02-24 18:01:17.792877 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-24 18:01:17.792980 | controller | Tuesday 24 February 2026 18:01:17 +0000 (0:00:00.046) 0:00:35.436 ****** 2026-02-24 18:01:18.120709 | controller | ok: [instance -> localhost] 2026-02-24 18:01:18.120784 | controller | 2026-02-24 18:01:18.120908 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2026-02-24 18:01:18.121032 | controller | Tuesday 24 February 2026 18:01:18 +0000 (0:00:00.328) 0:00:35.765 ****** 2026-02-24 18:01:23.047636 | controller | changed: [instance -> localhost] 2026-02-24 18:01:23.047785 | controller | 2026-02-24 18:01:23.047822 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-24 18:01:23.047835 | controller | Tuesday 24 February 2026 18:01:23 +0000 (0:00:04.925) 0:00:40.691 ****** 2026-02-24 18:01:23.245360 | controller | changed: [instance] 2026-02-24 18:01:23.582496 | controller | 2026-02-24 18:01:23.582537 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2026-02-24 18:01:23.582548 | controller | Tuesday 24 February 2026 18:01:23 +0000 (0:00:00.198) 0:00:40.889 ****** 2026-02-24 18:01:23.582565 | controller | changed: [instance] 2026-02-24 18:01:25.184993 | controller | 2026-02-24 18:01:25.185027 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2026-02-24 18:01:25.185035 | controller | Tuesday 24 February 2026 18:01:23 +0000 (0:00:00.337) 0:00:41.226 ****** 2026-02-24 18:01:25.185045 | controller | changed: [instance -> localhost] 2026-02-24 18:01:25.532284 | controller | 2026-02-24 18:01:25.532334 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2026-02-24 18:01:25.532348 | controller | Tuesday 24 February 2026 18:01:25 +0000 (0:00:01.602) 0:00:42.828 ****** 2026-02-24 18:01:25.532364 | controller | changed: [instance] 2026-02-24 18:01:25.563272 | controller | 2026-02-24 18:01:25.563295 | controller | TASK [reproducer : Select right domain] **************************************** 2026-02-24 18:01:25.563304 | controller | Tuesday 24 February 2026 18:01:25 +0000 (0:00:00.346) 0:00:43.175 ****** 2026-02-24 18:01:25.563314 | controller | ok: [instance] 2026-02-24 18:01:25.700804 | controller | 2026-02-24 18:01:25.700824 | controller | TASK [Create the virtual networks] ********************************************* 2026-02-24 18:01:25.700831 | controller | Tuesday 24 February 2026 18:01:25 +0000 (0:00:00.031) 0:00:43.207 ****** 2026-02-24 18:01:25.700840 | controller | 2026-02-24 18:01:25.719428 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2026-02-24 18:01:25.719447 | controller | Tuesday 24 February 2026 18:01:25 +0000 (0:00:00.137) 0:00:43.345 ****** 2026-02-24 18:01:25.719457 | controller | ok: [instance] 2026-02-24 18:01:25.901358 | controller | 2026-02-24 18:01:25.901379 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2026-02-24 18:01:25.901387 | controller | Tuesday 24 February 2026 18:01:25 +0000 (0:00:00.018) 0:00:43.363 ****** 2026-02-24 18:01:25.901396 | controller | ok: [instance] 2026-02-24 18:01:25.931270 | controller | 2026-02-24 18:01:25.931289 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2026-02-24 18:01:25.931297 | controller | Tuesday 24 February 2026 18:01:25 +0000 (0:00:00.181) 0:00:43.545 ****** 2026-02-24 18:01:25.931305 | controller | skipping: [instance] 2026-02-24 18:01:25.960454 | controller | 2026-02-24 18:01:25.960477 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2026-02-24 18:01:25.960486 | controller | Tuesday 24 February 2026 18:01:25 +0000 (0:00:00.029) 0:00:43.575 ****** 2026-02-24 18:01:25.960497 | controller | skipping: [instance] 2026-02-24 18:01:26.014144 | controller | 2026-02-24 18:01:26.014178 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2026-02-24 18:01:26.014191 | controller | Tuesday 24 February 2026 18:01:25 +0000 (0:00:00.029) 0:00:43.604 ****** 2026-02-24 18:01:26.014207 | controller | ok: [instance] 2026-02-24 18:01:26.138712 | controller | 2026-02-24 18:01:26.138800 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2026-02-24 18:01:26.138809 | controller | Tuesday 24 February 2026 18:01:26 +0000 (0:00:00.053) 0:00:43.658 ****** 2026-02-24 18:01:26.138822 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 18:01:26.176251 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 18:01:26.176284 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 18:01:26.176294 | controller | 2026-02-24 18:01:26.176302 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2026-02-24 18:01:26.176309 | controller | Tuesday 24 February 2026 18:01:26 +0000 (0:00:00.124) 0:00:43.782 ****** 2026-02-24 18:01:26.176321 | controller | skipping: [instance] 2026-02-24 18:01:26.567423 | controller | 2026-02-24 18:01:26.567460 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2026-02-24 18:01:26.567468 | controller | Tuesday 24 February 2026 18:01:26 +0000 (0:00:00.038) 0:00:43.820 ****** 2026-02-24 18:01:26.567487 | controller | changed: [instance] 2026-02-24 18:01:26.652407 | controller | 2026-02-24 18:01:26.652437 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2026-02-24 18:01:26.652446 | controller | Tuesday 24 February 2026 18:01:26 +0000 (0:00:00.390) 0:00:44.211 ****** 2026-02-24 18:01:26.652466 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes) 2026-02-24 18:01:26.700654 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers) 2026-02-24 18:01:26.700674 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps) 2026-02-24 18:01:26.700683 | controller | 2026-02-24 18:01:26.700690 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 18:01:26.700696 | controller | Tuesday 24 February 2026 18:01:26 +0000 (0:00:00.084) 0:00:44.296 ****** 2026-02-24 18:01:26.700706 | controller | changed: [instance] 2026-02-24 18:01:26.700853 | controller | 2026-02-24 18:01:26.700871 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 18:01:27.004497 | controller | Tuesday 24 February 2026 18:01:26 +0000 (0:00:00.048) 0:00:44.344 ****** 2026-02-24 18:01:27.004548 | controller | changed: [instance] 2026-02-24 18:01:27.220438 | controller | 2026-02-24 18:01:27.220462 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 18:01:27.220469 | controller | Tuesday 24 February 2026 18:01:27 +0000 (0:00:00.303) 0:00:44.648 ****** 2026-02-24 18:01:27.220478 | controller | changed: [instance] 2026-02-24 18:01:27.272479 | controller | 2026-02-24 18:01:27.272502 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 18:01:27.272533 | controller | Tuesday 24 February 2026 18:01:27 +0000 (0:00:00.215) 0:00:44.864 ****** 2026-02-24 18:01:27.272549 | controller | changed: [instance] 2026-02-24 18:01:27.467597 | controller | 2026-02-24 18:01:27.467635 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 18:01:27.467644 | controller | Tuesday 24 February 2026 18:01:27 +0000 (0:00:00.052) 0:00:44.916 ****** 2026-02-24 18:01:27.467654 | controller | changed: [instance] 2026-02-24 18:01:27.467681 | controller | 2026-02-24 18:01:27.467939 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 18:01:27.672856 | controller | Tuesday 24 February 2026 18:01:27 +0000 (0:00:00.195) 0:00:45.111 ****** 2026-02-24 18:01:27.672895 | controller | changed: [instance] 2026-02-24 18:01:27.723218 | controller | 2026-02-24 18:01:27.723239 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2026-02-24 18:01:27.723246 | controller | Tuesday 24 February 2026 18:01:27 +0000 (0:00:00.205) 0:00:45.317 ****** 2026-02-24 18:01:27.723255 | controller | changed: [instance] 2026-02-24 18:01:27.912663 | controller | 2026-02-24 18:01:27.912700 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2026-02-24 18:01:27.912713 | controller | Tuesday 24 February 2026 18:01:27 +0000 (0:00:00.050) 0:00:45.367 ****** 2026-02-24 18:01:27.912729 | controller | changed: [instance] 2026-02-24 18:01:27.912768 | controller | 2026-02-24 18:01:27.912782 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2026-02-24 18:01:27.913004 | controller | Tuesday 24 February 2026 18:01:27 +0000 (0:00:00.189) 0:00:45.556 ****** 2026-02-24 18:01:28.120057 | controller | changed: [instance] 2026-02-24 18:01:28.309327 | controller | 2026-02-24 18:01:28.309366 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ******************** 2026-02-24 18:01:28.309375 | controller | Tuesday 24 February 2026 18:01:28 +0000 (0:00:00.207) 0:00:45.764 ****** 2026-02-24 18:01:28.309387 | controller | ok: [instance] 2026-02-24 18:01:28.798307 | controller | 2026-02-24 18:01:28.798343 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ****************** 2026-02-24 18:01:28.798353 | controller | Tuesday 24 February 2026 18:01:28 +0000 (0:00:00.189) 0:00:45.953 ****** 2026-02-24 18:01:28.798365 | controller | changed: [instance] 2026-02-24 18:01:28.974128 | controller | 2026-02-24 18:01:28.974153 | controller | TASK [libvirt_manager : Remove ini file after conversion] ********************** 2026-02-24 18:01:28.974162 | controller | Tuesday 24 February 2026 18:01:28 +0000 (0:00:00.489) 0:00:46.442 ****** 2026-02-24 18:01:28.974179 | controller | changed: [instance] 2026-02-24 18:01:28.996594 | controller | 2026-02-24 18:01:28.996611 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-24 18:01:28.996618 | controller | Tuesday 24 February 2026 18:01:28 +0000 (0:00:00.175) 0:00:46.618 ****** 2026-02-24 18:01:28.996626 | controller | skipping: [instance] 2026-02-24 18:01:28.996632 | controller | 2026-02-24 18:01:28.996637 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 18:01:28.996643 | controller | Tuesday 24 February 2026 18:01:28 +0000 (0:00:00.022) 0:00:46.640 ****** 2026-02-24 18:01:29.018459 | controller | skipping: [instance] 2026-02-24 18:01:29.018767 | controller | 2026-02-24 18:01:29.018824 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-24 18:01:29.018856 | controller | Tuesday 24 February 2026 18:01:29 +0000 (0:00:00.021) 0:00:46.662 ****** 2026-02-24 18:01:29.041128 | controller | skipping: [instance] 2026-02-24 18:01:29.041217 | controller | 2026-02-24 18:01:29.041367 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-24 18:01:29.041434 | controller | Tuesday 24 February 2026 18:01:29 +0000 (0:00:00.022) 0:00:46.685 ****** 2026-02-24 18:01:29.062294 | controller | skipping: [instance] 2026-02-24 18:01:29.062381 | controller | 2026-02-24 18:01:29.062547 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-24 18:01:29.062629 | controller | Tuesday 24 February 2026 18:01:29 +0000 (0:00:00.021) 0:00:46.706 ****** 2026-02-24 18:01:29.080491 | controller | ok: [instance] 2026-02-24 18:01:29.080604 | controller | 2026-02-24 18:01:29.080770 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-24 18:01:29.080862 | controller | Tuesday 24 February 2026 18:01:29 +0000 (0:00:00.018) 0:00:46.725 ****** 2026-02-24 18:01:29.162081 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-24 18:01:29.162232 | controller | 2026-02-24 18:01:29.162428 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-24 18:01:29.162643 | controller | Tuesday 24 February 2026 18:01:29 +0000 (0:00:00.081) 0:00:46.806 ****** 2026-02-24 18:01:29.180986 | controller | skipping: [instance] 2026-02-24 18:01:29.181151 | controller | 2026-02-24 18:01:29.181276 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-24 18:01:29.181385 | controller | Tuesday 24 February 2026 18:01:29 +0000 (0:00:00.018) 0:00:46.825 ****** 2026-02-24 18:01:29.391584 | controller | changed: [instance] 2026-02-24 18:01:29.391798 | controller | 2026-02-24 18:01:29.391817 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-24 18:01:29.782666 | controller | Tuesday 24 February 2026 18:01:29 +0000 (0:00:00.210) 0:00:47.035 ****** 2026-02-24 18:01:29.782715 | controller | changed: [instance] 2026-02-24 18:01:29.782749 | controller | 2026-02-24 18:01:29.782757 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-24 18:01:29.782766 | controller | Tuesday 24 February 2026 18:01:29 +0000 (0:00:00.390) 0:00:47.426 ****** 2026-02-24 18:01:29.838100 | controller | ok: [instance] 2026-02-24 18:01:29.869015 | controller | 2026-02-24 18:01:29.869038 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-24 18:01:29.869048 | controller | Tuesday 24 February 2026 18:01:29 +0000 (0:00:00.055) 0:00:47.482 ****** 2026-02-24 18:01:29.869058 | controller | ok: [instance] 2026-02-24 18:01:30.247632 | controller | 2026-02-24 18:01:30.247676 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-24 18:01:30.247684 | controller | Tuesday 24 February 2026 18:01:29 +0000 (0:00:00.030) 0:00:47.513 ****** 2026-02-24 18:01:30.247696 | controller | changed: [instance] 2026-02-24 18:01:30.247716 | controller | 2026-02-24 18:01:30.247932 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2026-02-24 18:01:30.330680 | controller | Tuesday 24 February 2026 18:01:30 +0000 (0:00:00.378) 0:00:47.891 ****** 2026-02-24 18:01:30.330733 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2026-02-24 18:01:30.330783 | controller | 2026-02-24 18:01:30.330799 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2026-02-24 18:01:30.330837 | controller | Tuesday 24 February 2026 18:01:30 +0000 (0:00:00.083) 0:00:47.975 ****** 2026-02-24 18:01:30.381273 | controller | ok: [instance] => (item=public) 2026-02-24 18:01:30.837250 | controller | ok: [instance] => (item=osp_trunk) 2026-02-24 18:01:30.837291 | controller | 2026-02-24 18:01:30.837300 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2026-02-24 18:01:30.837307 | controller | Tuesday 24 February 2026 18:01:30 +0000 (0:00:00.050) 0:00:48.025 ****** 2026-02-24 18:01:30.837318 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 18:01:31.404616 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:01:31.404654 | controller | 2026-02-24 18:01:31.404662 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2026-02-24 18:01:31.404669 | controller | Tuesday 24 February 2026 18:01:30 +0000 (0:00:00.455) 0:00:48.481 ****** 2026-02-24 18:01:31.404680 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:01:31.404703 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:01:31.404710 | controller | 2026-02-24 18:01:31.404717 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2026-02-24 18:01:31.404814 | controller | Tuesday 24 February 2026 18:01:31 +0000 (0:00:00.567) 0:00:49.048 ****** 2026-02-24 18:01:31.829676 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:01:32.247382 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:01:32.247420 | controller | 2026-02-24 18:01:32.247428 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2026-02-24 18:01:32.247434 | controller | Tuesday 24 February 2026 18:01:31 +0000 (0:00:00.424) 0:00:49.473 ****** 2026-02-24 18:01:32.247451 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 18:01:32.304441 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:01:32.304461 | controller | 2026-02-24 18:01:32.304468 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2026-02-24 18:01:32.304474 | controller | Tuesday 24 February 2026 18:01:32 +0000 (0:00:00.417) 0:00:49.891 ****** 2026-02-24 18:01:32.304482 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2026-02-24 18:01:32.484332 | controller | 2026-02-24 18:01:32.484363 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2026-02-24 18:01:32.484372 | controller | Tuesday 24 February 2026 18:01:32 +0000 (0:00:00.057) 0:00:49.948 ****** 2026-02-24 18:01:32.484384 | controller | ok: [instance] 2026-02-24 18:01:32.857245 | controller | 2026-02-24 18:01:32.857274 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2026-02-24 18:01:32.857282 | controller | Tuesday 24 February 2026 18:01:32 +0000 (0:00:00.179) 0:00:50.128 ****** 2026-02-24 18:01:32.857291 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:01:32.926673 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:01:32.926735 | controller | 2026-02-24 18:01:32.926750 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2026-02-24 18:01:32.926761 | controller | Tuesday 24 February 2026 18:01:32 +0000 (0:00:00.372) 0:00:50.501 ****** 2026-02-24 18:01:32.926779 | controller | 2026-02-24 18:01:32.963239 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2026-02-24 18:01:32.963279 | controller | Tuesday 24 February 2026 18:01:32 +0000 (0:00:00.069) 0:00:50.571 ****** 2026-02-24 18:01:32.963295 | controller | skipping: [instance] 2026-02-24 18:01:34.155250 | controller | 2026-02-24 18:01:34.155289 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2026-02-24 18:01:34.155297 | controller | Tuesday 24 February 2026 18:01:32 +0000 (0:00:00.036) 0:00:50.607 ****** 2026-02-24 18:01:34.155309 | controller | ok: [instance] 2026-02-24 18:01:34.343712 | controller | 2026-02-24 18:01:34.343757 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2026-02-24 18:01:34.343767 | controller | Tuesday 24 February 2026 18:01:34 +0000 (0:00:01.191) 0:00:51.799 ****** 2026-02-24 18:01:34.343781 | controller | ok: [instance] 2026-02-24 18:01:34.343808 | controller | 2026-02-24 18:01:34.343992 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2026-02-24 18:01:34.344045 | controller | Tuesday 24 February 2026 18:01:34 +0000 (0:00:00.188) 0:00:51.987 ****** 2026-02-24 18:01:34.695648 | controller | changed: [instance] 2026-02-24 18:01:34.695702 | controller | 2026-02-24 18:01:34.695715 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2026-02-24 18:01:34.695790 | controller | Tuesday 24 February 2026 18:01:34 +0000 (0:00:00.351) 0:00:52.339 ****** 2026-02-24 18:01:36.335634 | controller | changed: [instance] 2026-02-24 18:01:36.675127 | controller | 2026-02-24 18:01:36.675167 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2026-02-24 18:01:36.675177 | controller | Tuesday 24 February 2026 18:01:36 +0000 (0:00:01.639) 0:00:53.979 ****** 2026-02-24 18:01:36.675189 | controller | changed: [instance] 2026-02-24 18:01:36.707081 | controller | 2026-02-24 18:01:36.707118 | controller | TASK [Create extra network configuration] ************************************** 2026-02-24 18:01:36.707127 | controller | Tuesday 24 February 2026 18:01:36 +0000 (0:00:00.339) 0:00:54.319 ****** 2026-02-24 18:01:36.707139 | controller | skipping: [instance] 2026-02-24 18:01:36.735555 | controller | 2026-02-24 18:01:36.735576 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2026-02-24 18:01:36.735583 | controller | Tuesday 24 February 2026 18:01:36 +0000 (0:00:00.032) 0:00:54.351 ****** 2026-02-24 18:01:36.735598 | controller | skipping: [instance] 2026-02-24 18:01:37.190580 | controller | 2026-02-24 18:01:37.190613 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2026-02-24 18:01:37.190621 | controller | Tuesday 24 February 2026 18:01:36 +0000 (0:00:00.028) 0:00:54.379 ****** 2026-02-24 18:01:37.190631 | controller | ok: [instance] 2026-02-24 18:01:37.341304 | controller | 2026-02-24 18:01:37.341335 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2026-02-24 18:01:37.341343 | controller | Tuesday 24 February 2026 18:01:37 +0000 (0:00:00.454) 0:00:54.834 ****** 2026-02-24 18:01:37.341353 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:01:38.565546 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:01:38.565585 | controller | 2026-02-24 18:01:38.565594 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2026-02-24 18:01:38.565600 | controller | Tuesday 24 February 2026 18:01:37 +0000 (0:00:00.150) 0:00:54.985 ****** 2026-02-24 18:01:38.565611 | controller | ok: [instance] 2026-02-24 18:01:42.262103 | controller | 2026-02-24 18:01:42.262141 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2026-02-24 18:01:42.262158 | controller | Tuesday 24 February 2026 18:01:38 +0000 (0:00:01.224) 0:00:56.209 ****** 2026-02-24 18:01:42.262169 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2026-02-24 18:01:42.480230 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2026-02-24 18:01:42.480258 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2026-02-24 18:01:42.480269 | controller | 2026-02-24 18:01:42.480276 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2026-02-24 18:01:42.480283 | controller | Tuesday 24 February 2026 18:01:42 +0000 (0:00:03.696) 0:00:59.905 ****** 2026-02-24 18:01:42.480295 | controller | changed: [instance] 2026-02-24 18:01:42.837662 | controller | 2026-02-24 18:01:42.837702 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2026-02-24 18:01:42.837712 | controller | Tuesday 24 February 2026 18:01:42 +0000 (0:00:00.218) 0:01:00.124 ****** 2026-02-24 18:01:42.837725 | controller | changed: [instance] 2026-02-24 18:01:43.228001 | controller | 2026-02-24 18:01:43.228042 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2026-02-24 18:01:43.228051 | controller | Tuesday 24 February 2026 18:01:42 +0000 (0:00:00.357) 0:01:00.481 ****** 2026-02-24 18:01:43.228062 | controller | changed: [instance] 2026-02-24 18:01:43.261505 | controller | 2026-02-24 18:01:43.261559 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2026-02-24 18:01:43.261568 | controller | Tuesday 24 February 2026 18:01:43 +0000 (0:00:00.389) 0:01:00.871 ****** 2026-02-24 18:01:43.261580 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2026-02-24 18:01:43.655172 | controller | 2026-02-24 18:01:43.655209 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2026-02-24 18:01:43.655218 | controller | Tuesday 24 February 2026 18:01:43 +0000 (0:00:00.033) 0:01:00.905 ****** 2026-02-24 18:01:43.655229 | controller | changed: [instance] 2026-02-24 18:01:43.676131 | controller | 2026-02-24 18:01:43.676153 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2026-02-24 18:01:43.676162 | controller | Tuesday 24 February 2026 18:01:43 +0000 (0:00:00.393) 0:01:01.299 ****** 2026-02-24 18:01:43.676173 | controller | skipping: [instance] 2026-02-24 18:01:43.711588 | controller | 2026-02-24 18:01:43.711631 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2026-02-24 18:01:43.711641 | controller | Tuesday 24 February 2026 18:01:43 +0000 (0:00:00.021) 0:01:01.320 ****** 2026-02-24 18:01:43.711654 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2026-02-24 18:01:44.103633 | controller | 2026-02-24 18:01:44.103682 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2026-02-24 18:01:44.103691 | controller | Tuesday 24 February 2026 18:01:43 +0000 (0:00:00.034) 0:01:01.354 ****** 2026-02-24 18:01:44.103702 | controller | changed: [instance] 2026-02-24 18:01:44.103732 | controller | 2026-02-24 18:01:44.103906 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2026-02-24 18:01:44.103947 | controller | Tuesday 24 February 2026 18:01:44 +0000 (0:00:00.393) 0:01:01.747 ****** 2026-02-24 18:01:44.125466 | controller | skipping: [instance] 2026-02-24 18:01:44.343097 | controller | 2026-02-24 18:01:44.343121 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2026-02-24 18:01:44.343130 | controller | Tuesday 24 February 2026 18:01:44 +0000 (0:00:00.021) 0:01:01.769 ****** 2026-02-24 18:01:44.343139 | controller | ok: [instance] => (item=127.0.0.2) 2026-02-24 18:01:45.024529 | controller | 2026-02-24 18:01:45.024565 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2026-02-24 18:01:45.024574 | controller | Tuesday 24 February 2026 18:01:44 +0000 (0:00:00.217) 0:01:01.987 ****** 2026-02-24 18:01:45.024586 | controller | changed: [instance] 2026-02-24 18:01:45.044648 | controller | 2026-02-24 18:01:45.044687 | controller | TASK [dnsmasq : Stop service] ************************************************** 2026-02-24 18:01:45.044698 | controller | Tuesday 24 February 2026 18:01:45 +0000 (0:00:00.681) 0:01:02.668 ****** 2026-02-24 18:01:45.044711 | controller | skipping: [instance] 2026-02-24 18:01:45.044743 | controller | 2026-02-24 18:01:45.044754 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2026-02-24 18:01:45.044900 | controller | Tuesday 24 February 2026 18:01:45 +0000 (0:00:00.020) 0:01:02.689 ****** 2026-02-24 18:01:45.064957 | controller | skipping: [instance] 2026-02-24 18:01:45.095316 | controller | 2026-02-24 18:01:45.095333 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2026-02-24 18:01:45.095341 | controller | Tuesday 24 February 2026 18:01:45 +0000 (0:00:00.020) 0:01:02.709 ****** 2026-02-24 18:01:45.095350 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-24 18:01:45.213206 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2026-02-24 18:01:45.213230 | controller | skipping: [instance] 2026-02-24 18:01:45.213239 | controller | 2026-02-24 18:01:45.213247 | controller | TASK [Create dnsmasq networks] ************************************************* 2026-02-24 18:01:45.213254 | controller | Tuesday 24 February 2026 18:01:45 +0000 (0:00:00.030) 0:01:02.739 ****** 2026-02-24 18:01:45.213272 | controller | 2026-02-24 18:01:45.245397 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-24 18:01:45.245415 | controller | Tuesday 24 February 2026 18:01:45 +0000 (0:00:00.117) 0:01:02.857 ****** 2026-02-24 18:01:45.245426 | controller | ok: [instance] => changed=false 2026-02-24 18:01:45.284239 | controller | msg: All assertions passed 2026-02-24 18:01:45.284258 | controller | 2026-02-24 18:01:45.284266 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-24 18:01:45.284272 | controller | Tuesday 24 February 2026 18:01:45 +0000 (0:00:00.032) 0:01:02.889 ****** 2026-02-24 18:01:45.284280 | controller | ok: [instance] => changed=false 2026-02-24 18:01:45.726173 | controller | msg: All assertions passed 2026-02-24 18:01:45.726208 | controller | 2026-02-24 18:01:45.726217 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-24 18:01:45.726224 | controller | Tuesday 24 February 2026 18:01:45 +0000 (0:00:00.038) 0:01:02.928 ****** 2026-02-24 18:01:45.726234 | controller | changed: [instance] 2026-02-24 18:01:45.747037 | controller | 2026-02-24 18:01:45.747060 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-24 18:01:45.747070 | controller | Tuesday 24 February 2026 18:01:45 +0000 (0:00:00.441) 0:01:03.370 ****** 2026-02-24 18:01:45.747082 | controller | skipping: [instance] 2026-02-24 18:01:45.773615 | controller | 2026-02-24 18:01:45.773658 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-24 18:01:45.773669 | controller | Tuesday 24 February 2026 18:01:45 +0000 (0:00:00.021) 0:01:03.391 ****** 2026-02-24 18:01:45.773684 | controller | skipping: [instance] 2026-02-24 18:01:45.803639 | controller | 2026-02-24 18:01:45.803661 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2026-02-24 18:01:45.803670 | controller | Tuesday 24 February 2026 18:01:45 +0000 (0:00:00.026) 0:01:03.417 ****** 2026-02-24 18:01:45.803680 | controller | ok: [instance] => changed=false 2026-02-24 18:01:45.803709 | controller | msg: All assertions passed 2026-02-24 18:01:45.803716 | controller | 2026-02-24 18:01:45.803725 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2026-02-24 18:01:45.803771 | controller | Tuesday 24 February 2026 18:01:45 +0000 (0:00:00.030) 0:01:03.448 ****** 2026-02-24 18:01:45.840633 | controller | ok: [instance] => changed=false 2026-02-24 18:01:45.840681 | controller | msg: All assertions passed 2026-02-24 18:01:45.840691 | controller | 2026-02-24 18:01:45.840700 | controller | TASK [dnsmasq : Create network] ************************************************ 2026-02-24 18:01:45.840784 | controller | Tuesday 24 February 2026 18:01:45 +0000 (0:00:00.036) 0:01:03.485 ****** 2026-02-24 18:01:46.278388 | controller | changed: [instance] 2026-02-24 18:01:46.298503 | controller | 2026-02-24 18:01:46.298546 | controller | TASK [dnsmasq : Remove network] ************************************************ 2026-02-24 18:01:46.298556 | controller | Tuesday 24 February 2026 18:01:46 +0000 (0:00:00.437) 0:01:03.922 ****** 2026-02-24 18:01:46.298569 | controller | skipping: [instance] 2026-02-24 18:01:46.322978 | controller | 2026-02-24 18:01:46.322998 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2026-02-24 18:01:46.323007 | controller | Tuesday 24 February 2026 18:01:46 +0000 (0:00:00.020) 0:01:03.942 ****** 2026-02-24 18:01:46.323017 | controller | skipping: [instance] 2026-02-24 18:01:46.352688 | controller | 2026-02-24 18:01:46.352729 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2026-02-24 18:01:46.352738 | controller | Tuesday 24 February 2026 18:01:46 +0000 (0:00:00.024) 0:01:03.967 ****** 2026-02-24 18:01:46.352751 | controller | skipping: [instance] 2026-02-24 18:01:46.352782 | controller | 2026-02-24 18:01:46.352791 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2026-02-24 18:01:46.853087 | controller | Tuesday 24 February 2026 18:01:46 +0000 (0:00:00.029) 0:01:03.997 ****** 2026-02-24 18:01:46.853127 | controller | changed: [instance] => (item=cifmw-public) 2026-02-24 18:01:46.891574 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:01:46.891598 | controller | 2026-02-24 18:01:46.891607 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 18:01:46.891613 | controller | Tuesday 24 February 2026 18:01:46 +0000 (0:00:00.499) 0:01:04.497 ****** 2026-02-24 18:01:46.891623 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2026-02-24 18:01:46.891813 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2026-02-24 18:01:46.891825 | controller | 2026-02-24 18:01:46.891834 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 18:01:47.221601 | controller | Tuesday 24 February 2026 18:01:46 +0000 (0:00:00.038) 0:01:04.535 ****** 2026-02-24 18:01:47.221640 | controller | ok: [instance] 2026-02-24 18:01:47.221662 | controller | 2026-02-24 18:01:47.221888 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-24 18:01:47.258117 | controller | Tuesday 24 February 2026 18:01:47 +0000 (0:00:00.330) 0:01:04.865 ****** 2026-02-24 18:01:47.258143 | controller | ok: [instance] 2026-02-24 18:01:47.458598 | controller | 2026-02-24 18:01:47.458633 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2026-02-24 18:01:47.458648 | controller | Tuesday 24 February 2026 18:01:47 +0000 (0:00:00.036) 0:01:04.902 ****** 2026-02-24 18:01:47.458660 | controller | ok: [instance] 2026-02-24 18:01:47.495215 | controller | 2026-02-24 18:01:47.495247 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2026-02-24 18:01:47.495257 | controller | Tuesday 24 February 2026 18:01:47 +0000 (0:00:00.200) 0:01:05.102 ****** 2026-02-24 18:01:47.495270 | controller | ok: [instance] 2026-02-24 18:01:47.827893 | controller | 2026-02-24 18:01:47.827917 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2026-02-24 18:01:47.827925 | controller | Tuesday 24 February 2026 18:01:47 +0000 (0:00:00.036) 0:01:05.139 ****** 2026-02-24 18:01:47.827934 | controller | changed: [instance] 2026-02-24 18:01:48.158680 | controller | 2026-02-24 18:01:48.158724 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2026-02-24 18:01:48.158741 | controller | Tuesday 24 February 2026 18:01:47 +0000 (0:00:00.332) 0:01:05.472 ****** 2026-02-24 18:01:48.158755 | controller | changed: [instance] 2026-02-24 18:01:48.495595 | controller | 2026-02-24 18:01:48.495633 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2026-02-24 18:01:48.495642 | controller | Tuesday 24 February 2026 18:01:48 +0000 (0:00:00.330) 0:01:05.802 ****** 2026-02-24 18:01:48.495653 | controller | changed: [instance] 2026-02-24 18:01:48.496384 | controller | 2026-02-24 18:01:48.496425 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2026-02-24 18:01:48.588394 | controller | Tuesday 24 February 2026 18:01:48 +0000 (0:00:00.336) 0:01:06.139 ****** 2026-02-24 18:01:48.588438 | controller | ok: [instance] 2026-02-24 18:01:48.927856 | controller | 2026-02-24 18:01:48.927896 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2026-02-24 18:01:48.927905 | controller | Tuesday 24 February 2026 18:01:48 +0000 (0:00:00.092) 0:01:06.232 ****** 2026-02-24 18:01:48.927917 | controller | changed: [instance] 2026-02-24 18:01:48.952614 | controller | 2026-02-24 18:01:48.952651 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2026-02-24 18:01:48.952659 | controller | Tuesday 24 February 2026 18:01:48 +0000 (0:00:00.339) 0:01:06.572 ****** 2026-02-24 18:01:48.952670 | controller | skipping: [instance] 2026-02-24 18:01:48.952697 | controller | 2026-02-24 18:01:48.952859 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2026-02-24 18:01:48.977364 | controller | Tuesday 24 February 2026 18:01:48 +0000 (0:00:00.024) 0:01:06.597 ****** 2026-02-24 18:01:48.977403 | controller | skipping: [instance] 2026-02-24 18:01:49.002109 | controller | 2026-02-24 18:01:49.002131 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2026-02-24 18:01:49.002139 | controller | Tuesday 24 February 2026 18:01:48 +0000 (0:00:00.024) 0:01:06.621 ****** 2026-02-24 18:01:49.002149 | controller | skipping: [instance] 2026-02-24 18:01:49.027681 | controller | 2026-02-24 18:01:49.027722 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2026-02-24 18:01:49.027736 | controller | Tuesday 24 February 2026 18:01:49 +0000 (0:00:00.025) 0:01:06.646 ****** 2026-02-24 18:01:49.027753 | controller | skipping: [instance] 2026-02-24 18:01:49.027804 | controller | 2026-02-24 18:01:49.027818 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2026-02-24 18:01:49.046619 | controller | Tuesday 24 February 2026 18:01:49 +0000 (0:00:00.025) 0:01:06.672 ****** 2026-02-24 18:01:49.046653 | controller | ok: [instance] 2026-02-24 18:01:49.149326 | controller | 2026-02-24 18:01:49.149349 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2026-02-24 18:01:49.149358 | controller | Tuesday 24 February 2026 18:01:49 +0000 (0:00:00.018) 0:01:06.690 ****** 2026-02-24 18:01:49.149371 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2026-02-24 18:01:49.169706 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2026-02-24 18:01:49.169731 | controller | 2026-02-24 18:01:49.169740 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2026-02-24 18:01:49.169747 | controller | Tuesday 24 February 2026 18:01:49 +0000 (0:00:00.102) 0:01:06.793 ****** 2026-02-24 18:01:49.169756 | controller | skipping: [instance] 2026-02-24 18:01:49.169920 | controller | 2026-02-24 18:01:49.170060 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2026-02-24 18:01:49.170182 | controller | Tuesday 24 February 2026 18:01:49 +0000 (0:00:00.020) 0:01:06.814 ****** 2026-02-24 18:01:49.383786 | controller | ok: [instance] 2026-02-24 18:01:49.788611 | controller | 2026-02-24 18:01:49.788653 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2026-02-24 18:01:49.788661 | controller | Tuesday 24 February 2026 18:01:49 +0000 (0:00:00.213) 0:01:07.027 ****** 2026-02-24 18:01:49.788679 | controller | changed: [instance] 2026-02-24 18:01:49.855355 | controller | 2026-02-24 18:01:49.855406 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2026-02-24 18:01:49.855414 | controller | Tuesday 24 February 2026 18:01:49 +0000 (0:00:00.404) 0:01:07.432 ****** 2026-02-24 18:01:49.855425 | controller | ok: [instance] 2026-02-24 18:01:49.890652 | controller | 2026-02-24 18:01:49.890690 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2026-02-24 18:01:49.890700 | controller | Tuesday 24 February 2026 18:01:49 +0000 (0:00:00.066) 0:01:07.499 ****** 2026-02-24 18:01:49.890713 | controller | ok: [instance] 2026-02-24 18:01:49.890745 | controller | 2026-02-24 18:01:49.890755 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2026-02-24 18:01:49.890861 | controller | Tuesday 24 February 2026 18:01:49 +0000 (0:00:00.035) 0:01:07.535 ****** 2026-02-24 18:01:50.407676 | controller | changed: [instance] 2026-02-24 18:01:50.441443 | controller | 2026-02-24 18:01:50.441482 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2026-02-24 18:01:50.441490 | controller | Tuesday 24 February 2026 18:01:50 +0000 (0:00:00.516) 0:01:08.051 ****** 2026-02-24 18:01:50.441502 | controller | ok: [instance] 2026-02-24 18:01:50.464020 | controller | 2026-02-24 18:01:50.464043 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2026-02-24 18:01:50.464053 | controller | Tuesday 24 February 2026 18:01:50 +0000 (0:00:00.033) 0:01:08.085 ****** 2026-02-24 18:01:50.464064 | controller | ok: [instance] 2026-02-24 18:01:50.485435 | controller | 2026-02-24 18:01:50.485456 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2026-02-24 18:01:50.485463 | controller | Tuesday 24 February 2026 18:01:50 +0000 (0:00:00.022) 0:01:08.108 ****** 2026-02-24 18:01:50.485471 | controller | ok: [instance] 2026-02-24 18:01:50.561764 | controller | 2026-02-24 18:01:50.561787 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2026-02-24 18:01:50.561804 | controller | Tuesday 24 February 2026 18:01:50 +0000 (0:00:00.021) 0:01:08.129 ****** 2026-02-24 18:01:50.561816 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2026-02-24 18:01:50.561846 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2026-02-24 18:01:50.561854 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2026-02-24 18:01:50.561862 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2026-02-24 18:01:50.561882 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2026-02-24 18:01:50.562283 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2026-02-24 18:01:50.701630 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2026-02-24 18:01:50.701648 | controller | 2026-02-24 18:01:50.701655 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 18:01:50.701661 | controller | Tuesday 24 February 2026 18:01:50 +0000 (0:00:00.075) 0:01:08.205 ****** 2026-02-24 18:01:50.701669 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2026-02-24 18:01:50.701836 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2026-02-24 18:01:50.701854 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2026-02-24 18:01:50.701872 | controller | 2026-02-24 18:01:50.701960 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 18:01:50.702075 | controller | Tuesday 24 February 2026 18:01:50 +0000 (0:00:00.140) 0:01:08.346 ****** 2026-02-24 18:01:50.784759 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2026-02-24 18:01:50.784949 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2026-02-24 18:01:50.785059 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2026-02-24 18:01:50.785213 | controller | skipping: [instance] 2026-02-24 18:01:50.785271 | controller | 2026-02-24 18:01:50.785387 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 18:01:50.785483 | controller | Tuesday 24 February 2026 18:01:50 +0000 (0:00:00.083) 0:01:08.429 ****** 2026-02-24 18:01:50.865025 | controller | skipping: [instance] => (item=compute-0 - storage) 2026-02-24 18:01:50.865119 | controller | skipping: [instance] => (item=controller-0 - storage) 2026-02-24 18:01:50.865268 | controller | skipping: [instance] => (item=crc-0 - storage) 2026-02-24 18:01:50.865361 | controller | skipping: [instance] 2026-02-24 18:01:50.865472 | controller | 2026-02-24 18:01:50.865620 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 18:01:50.865755 | controller | Tuesday 24 February 2026 18:01:50 +0000 (0:00:00.080) 0:01:08.509 ****** 2026-02-24 18:01:50.948116 | controller | skipping: [instance] => (item=compute-0 - tenant) 2026-02-24 18:01:50.948344 | controller | skipping: [instance] => (item=controller-0 - tenant) 2026-02-24 18:01:50.948458 | controller | skipping: [instance] => (item=crc-0 - tenant) 2026-02-24 18:01:50.948881 | controller | skipping: [instance] 2026-02-24 18:01:50.948908 | controller | 2026-02-24 18:01:50.948918 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 18:01:50.948928 | controller | Tuesday 24 February 2026 18:01:50 +0000 (0:00:00.082) 0:01:08.592 ****** 2026-02-24 18:01:51.028682 | controller | skipping: [instance] => (item=compute-0 - external) 2026-02-24 18:01:51.028841 | controller | skipping: [instance] => (item=controller-0 - external) 2026-02-24 18:01:51.028968 | controller | skipping: [instance] => (item=crc-0 - external) 2026-02-24 18:01:51.029085 | controller | skipping: [instance] 2026-02-24 18:01:51.029246 | controller | 2026-02-24 18:01:51.029328 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 18:01:51.029443 | controller | Tuesday 24 February 2026 18:01:51 +0000 (0:00:00.080) 0:01:08.673 ****** 2026-02-24 18:01:51.115553 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2026-02-24 18:01:51.115658 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2026-02-24 18:01:51.115798 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2026-02-24 18:01:51.115911 | controller | skipping: [instance] 2026-02-24 18:01:51.116011 | controller | 2026-02-24 18:01:51.116113 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2026-02-24 18:01:51.116220 | controller | Tuesday 24 February 2026 18:01:51 +0000 (0:00:00.086) 0:01:08.759 ****** 2026-02-24 18:01:51.258072 | controller | ok: [instance] => (item=compute-0 - public) 2026-02-24 18:01:51.258184 | controller | ok: [instance] => (item=controller-0 - public) 2026-02-24 18:01:51.258371 | controller | ok: [instance] => (item=crc-0 - public) 2026-02-24 18:01:51.258435 | controller | 2026-02-24 18:01:51.258696 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2026-02-24 18:01:51.258786 | controller | Tuesday 24 February 2026 18:01:51 +0000 (0:00:00.142) 0:01:08.902 ****** 2026-02-24 18:01:51.368139 | controller | 2026-02-24 18:01:51.368287 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2026-02-24 18:01:51.368402 | controller | Tuesday 24 February 2026 18:01:51 +0000 (0:00:00.110) 0:01:09.012 ****** 2026-02-24 18:01:51.407971 | controller | ok: [instance] 2026-02-24 18:01:51.408098 | controller | 2026-02-24 18:01:51.408235 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2026-02-24 18:01:51.408347 | controller | Tuesday 24 February 2026 18:01:51 +0000 (0:00:00.039) 0:01:09.052 ****** 2026-02-24 18:01:51.507064 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:9f:d9:f3', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-24 18:01:51.507228 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:43:a0:3c', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-24 18:01:51.507328 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:cc:97:ab', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-24 18:01:51.507453 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:ae:47:11', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-24 18:01:51.507574 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:6b:22:d8', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-24 18:01:51.507683 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:1e:f2:bf', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-24 18:01:51.507776 | controller | 2026-02-24 18:01:51.507883 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2026-02-24 18:01:51.507985 | controller | Tuesday 24 February 2026 18:01:51 +0000 (0:00:00.099) 0:01:09.151 ****** 2026-02-24 18:01:51.558834 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2026-02-24 18:01:51.558962 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2026-02-24 18:01:51.559080 | controller | 2026-02-24 18:01:51.559202 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-24 18:01:51.559324 | controller | Tuesday 24 February 2026 18:01:51 +0000 (0:00:00.051) 0:01:09.203 ****** 2026-02-24 18:01:51.745641 | controller | ok: [instance] 2026-02-24 18:01:51.745743 | controller | 2026-02-24 18:01:51.745764 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-24 18:01:51.745777 | controller | Tuesday 24 February 2026 18:01:51 +0000 (0:00:00.186) 0:01:09.389 ****** 2026-02-24 18:01:51.770685 | controller | ok: [instance] 2026-02-24 18:01:51.770752 | controller | 2026-02-24 18:01:51.770766 | controller | TASK [dnsmasq : Check network file status] ************************************* 2026-02-24 18:01:51.770814 | controller | Tuesday 24 February 2026 18:01:51 +0000 (0:00:00.025) 0:01:09.415 ****** 2026-02-24 18:01:51.958500 | controller | ok: [instance] 2026-02-24 18:01:51.983077 | controller | 2026-02-24 18:01:51.983101 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2026-02-24 18:01:51.983111 | controller | Tuesday 24 February 2026 18:01:51 +0000 (0:00:00.187) 0:01:09.602 ****** 2026-02-24 18:01:51.983121 | controller | ok: [instance] 2026-02-24 18:01:52.003331 | controller | 2026-02-24 18:01:52.003350 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2026-02-24 18:01:52.003357 | controller | Tuesday 24 February 2026 18:01:51 +0000 (0:00:00.024) 0:01:09.627 ****** 2026-02-24 18:01:52.003365 | controller | ok: [instance] 2026-02-24 18:01:52.187730 | controller | 2026-02-24 18:01:52.187764 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2026-02-24 18:01:52.187772 | controller | Tuesday 24 February 2026 18:01:52 +0000 (0:00:00.020) 0:01:09.647 ****** 2026-02-24 18:01:52.187783 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:9f:d9:f3', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2026-02-24 18:01:52.225604 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:43:a0:3c', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2026-02-24 18:01:52.225633 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:cc:97:ab', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2026-02-24 18:01:52.225642 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:ae:47:11', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2026-02-24 18:01:52.225648 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:6b:22:d8', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2026-02-24 18:01:52.225654 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:1e:f2:bf', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2026-02-24 18:01:52.225660 | controller | 2026-02-24 18:01:52.225665 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2026-02-24 18:01:52.225671 | controller | Tuesday 24 February 2026 18:01:52 +0000 (0:00:00.183) 0:01:09.831 ****** 2026-02-24 18:01:52.225681 | controller | ok: [instance] 2026-02-24 18:01:52.225703 | controller | 2026-02-24 18:01:52.225709 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2026-02-24 18:01:52.225716 | controller | Tuesday 24 February 2026 18:01:52 +0000 (0:00:00.038) 0:01:09.869 ****** 2026-02-24 18:01:54.322655 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:9f:d9:f3', 'entry': 'set:compute,52:54:00:9f:d9:f3,192.168.140.100,compute-0', 'state': 'present'}) 2026-02-24 18:01:54.322715 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:43:a0:3c', 'entry': 'set:controller,52:54:01:43:a0:3c,192.168.140.9,controller-0', 'state': 'present'}) 2026-02-24 18:01:54.322728 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:cc:97:ab', 'entry': 'set:ocp,52:54:02:cc:97:ab,192.168.140.10,crc-0', 'state': 'present'}) 2026-02-24 18:01:54.323243 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:ae:47:11', 'entry': 'set:compute,52:54:00:ae:47:11,192.168.101.100,compute-0', 'state': 'present'}) 2026-02-24 18:01:54.345723 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:6b:22:d8', 'entry': 'set:controller,52:54:01:6b:22:d8,192.168.101.9,controller-0', 'state': 'present'}) 2026-02-24 18:01:54.345778 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:1e:f2:bf', 'entry': 'set:ocp,52:54:02:1e:f2:bf,192.168.101.10,crc-0', 'state': 'present'}) 2026-02-24 18:01:54.345792 | controller | 2026-02-24 18:01:54.345804 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2026-02-24 18:01:54.345823 | controller | Tuesday 24 February 2026 18:01:54 +0000 (0:00:02.096) 0:01:11.966 ****** 2026-02-24 18:01:54.345840 | controller | skipping: [instance] 2026-02-24 18:01:54.345891 | controller | 2026-02-24 18:01:54.345908 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2026-02-24 18:01:54.552681 | controller | Tuesday 24 February 2026 18:01:54 +0000 (0:00:00.023) 0:01:11.990 ****** 2026-02-24 18:01:54.552723 | controller | ok: [instance] => (item=compute-0) 2026-02-24 18:01:54.552772 | controller | ok: [instance] => (item=controller-0) 2026-02-24 18:01:54.552787 | controller | ok: [instance] => (item=crc-0) 2026-02-24 18:01:54.552825 | controller | 2026-02-24 18:01:54.553102 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2026-02-24 18:01:54.669932 | controller | Tuesday 24 February 2026 18:01:54 +0000 (0:00:00.206) 0:01:12.197 ****** 2026-02-24 18:01:54.669961 | controller | 2026-02-24 18:01:54.711071 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-24 18:01:54.711124 | controller | Tuesday 24 February 2026 18:01:54 +0000 (0:00:00.117) 0:01:12.314 ****** 2026-02-24 18:01:54.711145 | controller | ok: [instance] 2026-02-24 18:01:54.943637 | controller | 2026-02-24 18:01:54.943682 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 18:01:54.943697 | controller | Tuesday 24 February 2026 18:01:54 +0000 (0:00:00.040) 0:01:12.355 ****** 2026-02-24 18:01:54.943725 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 18:01:54.944687 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 18:01:54.944725 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 18:01:54.944732 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 18:01:54.944738 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 18:01:54.944744 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 18:01:54.944749 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 18:01:54.944768 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:01:58.098616 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:01:58.098654 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 18:01:58.098661 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.098667 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.098673 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.098678 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.098685 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.098696 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.098702 | controller | 2026-02-24 18:01:58.098708 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 18:01:58.098713 | controller | Tuesday 24 February 2026 18:01:54 +0000 (0:00:00.232) 0:01:12.587 ****** 2026-02-24 18:01:58.098724 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 18:01:58.098750 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 18:01:58.098760 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 18:01:58.098766 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 18:01:58.098774 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 18:01:58.099656 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 18:01:58.099709 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 18:01:58.099746 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:01:58.099757 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:01:58.099765 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 18:01:58.099773 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.099781 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.099789 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.099797 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.099805 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.099815 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.099840 | controller | 2026-02-24 18:01:58.099857 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-24 18:01:58.099988 | controller | Tuesday 24 February 2026 18:01:58 +0000 (0:00:03.155) 0:01:15.742 ****** 2026-02-24 18:01:58.444633 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 18:01:58.444696 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2026-02-24 18:01:58.444714 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2026-02-24 18:01:58.444722 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2026-02-24 18:01:58.444730 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2026-02-24 18:01:58.444738 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2026-02-24 18:01:58.444745 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2026-02-24 18:01:58.444753 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:01:58.444760 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:01:58.444771 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2026-02-24 18:01:58.444800 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.445429 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.464888 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.464923 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.464937 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.464949 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2026-02-24 18:01:58.464965 | controller | 2026-02-24 18:01:58.464976 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2026-02-24 18:01:58.464986 | controller | Tuesday 24 February 2026 18:01:58 +0000 (0:00:00.345) 0:01:16.088 ****** 2026-02-24 18:01:58.465001 | controller | ok: [instance] 2026-02-24 18:01:58.465250 | controller | 2026-02-24 18:01:58.465500 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2026-02-24 18:01:58.465701 | controller | Tuesday 24 February 2026 18:01:58 +0000 (0:00:00.020) 0:01:16.109 ****** 2026-02-24 18:01:58.507828 | controller | skipping: [instance] => (item=compute) 2026-02-24 18:01:58.508024 | controller | skipping: [instance] => (item=controller) 2026-02-24 18:01:58.508181 | controller | skipping: [instance] => (item=crc) 2026-02-24 18:01:58.508326 | controller | skipping: [instance] 2026-02-24 18:01:58.508463 | controller | 2026-02-24 18:01:58.508638 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2026-02-24 18:01:58.508765 | controller | Tuesday 24 February 2026 18:01:58 +0000 (0:00:00.043) 0:01:16.152 ****** 2026-02-24 18:01:58.540174 | controller | skipping: [instance] 2026-02-24 18:01:58.540425 | controller | 2026-02-24 18:01:58.540687 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2026-02-24 18:01:58.540839 | controller | Tuesday 24 February 2026 18:01:58 +0000 (0:00:00.032) 0:01:16.184 ****** 2026-02-24 18:01:58.906676 | controller | changed: [instance] 2026-02-24 18:01:58.906772 | controller | 2026-02-24 18:01:58.906800 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2026-02-24 18:01:58.906807 | controller | Tuesday 24 February 2026 18:01:58 +0000 (0:00:00.355) 0:01:16.539 ****** 2026-02-24 18:01:58.906813 | controller | 2026-02-24 18:01:58.906818 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-24 18:01:58.906827 | controller | Tuesday 24 February 2026 18:01:58 +0000 (0:00:00.010) 0:01:16.550 ****** 2026-02-24 18:01:59.542617 | controller | changed: [instance] 2026-02-24 18:01:59.542732 | controller | 2026-02-24 18:01:59.542744 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-24 18:01:59.542753 | controller | Tuesday 24 February 2026 18:01:59 +0000 (0:00:00.636) 0:01:17.186 ****** 2026-02-24 18:01:59.900627 | controller | changed: [instance] 2026-02-24 18:01:59.901013 | controller | 2026-02-24 18:01:59.901035 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2026-02-24 18:02:00.265260 | controller | Tuesday 24 February 2026 18:01:59 +0000 (0:00:00.357) 0:01:17.544 ****** 2026-02-24 18:02:00.265296 | controller | changed: [instance] 2026-02-24 18:02:00.618290 | controller | 2026-02-24 18:02:00.618327 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2026-02-24 18:02:00.618337 | controller | Tuesday 24 February 2026 18:02:00 +0000 (0:00:00.364) 0:01:17.909 ****** 2026-02-24 18:02:00.618349 | controller | changed: [instance] 2026-02-24 18:02:00.983307 | controller | 2026-02-24 18:02:00.983343 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2026-02-24 18:02:00.983352 | controller | Tuesday 24 February 2026 18:02:00 +0000 (0:00:00.352) 0:01:18.262 ****** 2026-02-24 18:02:00.983363 | controller | changed: [instance] 2026-02-24 18:02:01.015694 | controller | 2026-02-24 18:02:01.015741 | controller | TASK [Build utility records dataset] ******************************************* 2026-02-24 18:02:01.015751 | controller | Tuesday 24 February 2026 18:02:00 +0000 (0:00:00.365) 0:01:18.627 ****** 2026-02-24 18:02:01.015764 | controller | 2026-02-24 18:02:01.015798 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2026-02-24 18:02:01.015922 | controller | Tuesday 24 February 2026 18:02:01 +0000 (0:00:00.032) 0:01:18.660 ****** 2026-02-24 18:02:01.102312 | controller | ok: [instance] 2026-02-24 18:02:01.205097 | controller | 2026-02-24 18:02:01.205130 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2026-02-24 18:02:01.205138 | controller | Tuesday 24 February 2026 18:02:01 +0000 (0:00:00.086) 0:01:18.746 ****** 2026-02-24 18:02:01.205148 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 18:02:01.662644 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:02:01.662681 | controller | 2026-02-24 18:02:01.662689 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2026-02-24 18:02:01.662696 | controller | Tuesday 24 February 2026 18:02:01 +0000 (0:00:00.102) 0:01:18.849 ****** 2026-02-24 18:02:01.662711 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 18:02:01.662735 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:02:01.662742 | controller | 2026-02-24 18:02:01.662749 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] *** 2026-02-24 18:02:01.662868 | controller | Tuesday 24 February 2026 18:02:01 +0000 (0:00:00.457) 0:01:19.307 ****** 2026-02-24 18:02:01.955643 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2026-02-24 18:02:01.955703 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2026-02-24 18:02:01.955722 | controller | 2026-02-24 18:02:01.955733 | controller | TASK [reproducer : Flush handlers] ********************************************* 2026-02-24 18:02:01.956193 | controller | Tuesday 24 February 2026 18:02:01 +0000 (0:00:00.281) 0:01:19.588 ****** 2026-02-24 18:02:02.405591 | controller | 2026-02-24 18:02:02.405625 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 18:02:02.405633 | controller | Tuesday 24 February 2026 18:02:01 +0000 (0:00:00.010) 0:01:19.599 ****** 2026-02-24 18:02:02.405644 | controller | changed: [instance] 2026-02-24 18:02:02.405858 | controller | 2026-02-24 18:02:02.756463 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2026-02-24 18:02:02.756496 | controller | Tuesday 24 February 2026 18:02:02 +0000 (0:00:00.450) 0:01:20.049 ****** 2026-02-24 18:02:02.756508 | controller | changed: [instance] 2026-02-24 18:02:02.788572 | controller | 2026-02-24 18:02:02.788593 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2026-02-24 18:02:02.788601 | controller | Tuesday 24 February 2026 18:02:02 +0000 (0:00:00.350) 0:01:20.400 ****** 2026-02-24 18:02:02.788610 | controller | skipping: [instance] 2026-02-24 18:02:02.788632 | controller | 2026-02-24 18:02:02.788640 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2026-02-24 18:02:02.788735 | controller | Tuesday 24 February 2026 18:02:02 +0000 (0:00:00.032) 0:01:20.433 ****** 2026-02-24 18:02:02.867317 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2026-02-24 18:02:03.065984 | controller | 2026-02-24 18:02:03.066012 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2026-02-24 18:02:03.066021 | controller | Tuesday 24 February 2026 18:02:02 +0000 (0:00:00.078) 0:01:20.511 ****** 2026-02-24 18:02:03.066030 | controller | ok: [instance] 2026-02-24 18:02:03.087505 | controller | 2026-02-24 18:02:03.087545 | controller | TASK [Deploy CRC if needed] **************************************************** 2026-02-24 18:02:03.087555 | controller | Tuesday 24 February 2026 18:02:03 +0000 (0:00:00.198) 0:01:20.710 ****** 2026-02-24 18:02:03.087564 | controller | skipping: [instance] 2026-02-24 18:02:03.436188 | controller | 2026-02-24 18:02:03.436225 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2026-02-24 18:02:03.436233 | controller | Tuesday 24 February 2026 18:02:03 +0000 (0:00:00.021) 0:01:20.731 ****** 2026-02-24 18:02:03.436244 | controller | ok: [instance] 2026-02-24 18:02:03.675006 | controller | 2026-02-24 18:02:03.675040 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2026-02-24 18:02:03.675048 | controller | Tuesday 24 February 2026 18:02:03 +0000 (0:00:00.348) 0:01:21.080 ****** 2026-02-24 18:02:03.675058 | controller | ok: [instance] 2026-02-24 18:02:03.917333 | controller | 2026-02-24 18:02:03.917372 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2026-02-24 18:02:03.917381 | controller | Tuesday 24 February 2026 18:02:03 +0000 (0:00:00.238) 0:01:21.319 ****** 2026-02-24 18:02:03.917391 | controller | ok: [instance] 2026-02-24 18:02:04.159776 | controller | 2026-02-24 18:02:04.159820 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2026-02-24 18:02:04.159829 | controller | Tuesday 24 February 2026 18:02:03 +0000 (0:00:00.242) 0:01:21.561 ****** 2026-02-24 18:02:04.159847 | controller | ok: [instance] 2026-02-24 18:02:04.411371 | controller | 2026-02-24 18:02:04.411403 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2026-02-24 18:02:04.411411 | controller | Tuesday 24 February 2026 18:02:04 +0000 (0:00:00.241) 0:01:21.803 ****** 2026-02-24 18:02:04.411421 | controller | ok: [instance] 2026-02-24 18:02:04.454653 | controller | 2026-02-24 18:02:04.454691 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 18:02:04.454701 | controller | Tuesday 24 February 2026 18:02:04 +0000 (0:00:00.252) 0:01:22.055 ****** 2026-02-24 18:02:04.454714 | controller | 2026-02-24 18:02:04.655195 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-24 18:02:04.655235 | controller | Tuesday 24 February 2026 18:02:04 +0000 (0:00:00.043) 0:01:22.098 ****** 2026-02-24 18:02:04.655247 | controller | ok: [instance] 2026-02-24 18:02:04.680887 | controller | 2026-02-24 18:02:04.680914 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-24 18:02:04.680922 | controller | Tuesday 24 February 2026 18:02:04 +0000 (0:00:00.200) 0:01:22.299 ****** 2026-02-24 18:02:04.680935 | controller | ok: [instance] 2026-02-24 18:02:04.708959 | controller | 2026-02-24 18:02:04.708976 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-24 18:02:04.708983 | controller | Tuesday 24 February 2026 18:02:04 +0000 (0:00:00.025) 0:01:22.325 ****** 2026-02-24 18:02:04.708992 | controller | skipping: [instance] 2026-02-24 18:02:05.055261 | controller | 2026-02-24 18:02:05.055300 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2026-02-24 18:02:05.055308 | controller | Tuesday 24 February 2026 18:02:04 +0000 (0:00:00.028) 0:01:22.353 ****** 2026-02-24 18:02:05.055318 | controller | ok: [instance] 2026-02-24 18:02:05.290058 | controller | 2026-02-24 18:02:05.290098 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2026-02-24 18:02:05.290107 | controller | Tuesday 24 February 2026 18:02:05 +0000 (0:00:00.345) 0:01:22.699 ****** 2026-02-24 18:02:05.290116 | controller | ok: [instance] 2026-02-24 18:02:05.470650 | controller | 2026-02-24 18:02:05.470692 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2026-02-24 18:02:05.470702 | controller | Tuesday 24 February 2026 18:02:05 +0000 (0:00:00.234) 0:01:22.934 ****** 2026-02-24 18:02:05.470714 | controller | ok: [instance] 2026-02-24 18:02:05.470747 | controller | 2026-02-24 18:02:05.470774 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2026-02-24 18:02:05.470990 | controller | Tuesday 24 February 2026 18:02:05 +0000 (0:00:00.180) 0:01:23.114 ****** 2026-02-24 18:02:05.531715 | controller | 2026-02-24 18:02:05.531777 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-24 18:02:05.531790 | controller | Tuesday 24 February 2026 18:02:05 +0000 (0:00:00.060) 0:01:23.175 ****** 2026-02-24 18:02:05.583374 | controller | ok: [instance] => changed=false 2026-02-24 18:02:05.778006 | controller | msg: All assertions passed 2026-02-24 18:02:05.778035 | controller | 2026-02-24 18:02:05.778045 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-24 18:02:05.778053 | controller | Tuesday 24 February 2026 18:02:05 +0000 (0:00:00.051) 0:01:23.227 ****** 2026-02-24 18:02:05.778063 | controller | ok: [instance] 2026-02-24 18:02:05.976723 | controller | 2026-02-24 18:02:05.976762 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-24 18:02:05.976776 | controller | Tuesday 24 February 2026 18:02:05 +0000 (0:00:00.194) 0:01:23.421 ****** 2026-02-24 18:02:05.976793 | controller | ok: [instance] 2026-02-24 18:02:06.010318 | controller | 2026-02-24 18:02:06.010353 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-24 18:02:06.010362 | controller | Tuesday 24 February 2026 18:02:05 +0000 (0:00:00.198) 0:01:23.620 ****** 2026-02-24 18:02:06.010373 | controller | ok: [instance] => changed=false 2026-02-24 18:02:06.220572 | controller | msg: All assertions passed 2026-02-24 18:02:06.220594 | controller | 2026-02-24 18:02:06.220601 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-24 18:02:06.220607 | controller | Tuesday 24 February 2026 18:02:06 +0000 (0:00:00.033) 0:01:23.654 ****** 2026-02-24 18:02:06.220616 | controller | ok: [instance] 2026-02-24 18:02:06.220639 | controller | 2026-02-24 18:02:06.220646 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-24 18:02:06.220808 | controller | Tuesday 24 February 2026 18:02:06 +0000 (0:00:00.210) 0:01:23.864 ****** 2026-02-24 18:02:06.414613 | controller | ok: [instance] 2026-02-24 18:02:06.414648 | controller | 2026-02-24 18:02:06.414657 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-24 18:02:06.414668 | controller | Tuesday 24 February 2026 18:02:06 +0000 (0:00:00.193) 0:01:24.058 ****** 2026-02-24 18:02:06.470675 | controller | ok: [instance] 2026-02-24 18:02:06.470730 | controller | 2026-02-24 18:02:06.470740 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2026-02-24 18:02:06.470848 | controller | Tuesday 24 February 2026 18:02:06 +0000 (0:00:00.056) 0:01:24.114 ****** 2026-02-24 18:02:06.924654 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2026-02-24 18:02:06.950633 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2026-02-24 18:02:06.950655 | controller | 2026-02-24 18:02:06.950663 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2026-02-24 18:02:06.950671 | controller | Tuesday 24 February 2026 18:02:06 +0000 (0:00:00.453) 0:01:24.568 ****** 2026-02-24 18:02:06.950681 | controller | skipping: [instance] 2026-02-24 18:02:06.950745 | controller | 2026-02-24 18:02:06.950776 | controller | TASK [Load the architecture local kustomize patches] *************************** 2026-02-24 18:02:06.950788 | controller | Tuesday 24 February 2026 18:02:06 +0000 (0:00:00.026) 0:01:24.595 ****** 2026-02-24 18:02:06.985885 | controller | skipping: [instance] 2026-02-24 18:02:07.119237 | controller | 2026-02-24 18:02:07.119264 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2026-02-24 18:02:07.119276 | controller | Tuesday 24 February 2026 18:02:06 +0000 (0:00:00.035) 0:01:24.630 ****** 2026-02-24 18:02:07.119285 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2026-02-24 18:02:07.147722 | controller | 2026-02-24 18:02:07.147797 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2026-02-24 18:02:07.147810 | controller | Tuesday 24 February 2026 18:02:07 +0000 (0:00:00.132) 0:01:24.762 ****** 2026-02-24 18:02:07.147828 | controller | skipping: [instance] 2026-02-24 18:02:07.610028 | controller | 2026-02-24 18:02:07.610069 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2026-02-24 18:02:07.610077 | controller | Tuesday 24 February 2026 18:02:07 +0000 (0:00:00.029) 0:01:24.792 ****** 2026-02-24 18:02:07.610088 | controller | changed: [instance] 2026-02-24 18:02:08.178408 | controller | 2026-02-24 18:02:08.178444 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2026-02-24 18:02:08.178453 | controller | Tuesday 24 February 2026 18:02:07 +0000 (0:00:00.461) 0:01:25.253 ****** 2026-02-24 18:02:08.178463 | controller | changed: [instance] 2026-02-24 18:02:08.630253 | controller | 2026-02-24 18:02:08.630293 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2026-02-24 18:02:08.630301 | controller | Tuesday 24 February 2026 18:02:08 +0000 (0:00:00.557) 0:01:25.810 ****** 2026-02-24 18:02:08.630307 | controller | 2026-02-24 18:02:08.630313 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2026-02-24 18:02:08.630318 | controller | Tuesday 24 February 2026 18:02:08 +0000 (0:00:00.011) 0:01:25.821 ****** 2026-02-24 18:02:08.630328 | controller | changed: [instance] 2026-02-24 18:02:09.313180 | controller | 2026-02-24 18:02:09.313213 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2026-02-24 18:02:09.313221 | controller | Tuesday 24 February 2026 18:02:08 +0000 (0:00:00.452) 0:01:26.274 ****** 2026-02-24 18:02:09.313231 | controller | changed: [instance] 2026-02-24 18:02:09.407211 | controller | 2026-02-24 18:02:09.407247 | controller | TASK [Deploy virtualbmc] ******************************************************* 2026-02-24 18:02:09.407256 | controller | Tuesday 24 February 2026 18:02:09 +0000 (0:00:00.683) 0:01:26.957 ****** 2026-02-24 18:02:09.407266 | controller | skipping: [instance] 2026-02-24 18:02:09.442482 | controller | 2026-02-24 18:02:09.442502 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2026-02-24 18:02:09.442527 | controller | Tuesday 24 February 2026 18:02:09 +0000 (0:00:00.094) 0:01:27.051 ****** 2026-02-24 18:02:09.442541 | controller | skipping: [instance] 2026-02-24 18:02:10.022840 | controller | 2026-02-24 18:02:10.022875 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2026-02-24 18:02:10.022884 | controller | Tuesday 24 February 2026 18:02:09 +0000 (0:00:00.035) 0:01:27.086 ****** 2026-02-24 18:02:10.022895 | controller | changed: [instance] => (item=workload) 2026-02-24 18:02:10.443113 | controller | changed: [instance] => (item=reproducer-inventory) 2026-02-24 18:02:10.443143 | controller | ok: [instance] => (item=volumes) 2026-02-24 18:02:10.443151 | controller | 2026-02-24 18:02:10.443157 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2026-02-24 18:02:10.443163 | controller | Tuesday 24 February 2026 18:02:10 +0000 (0:00:00.579) 0:01:27.666 ****** 2026-02-24 18:02:10.443173 | controller | changed: [instance] => (item=workload) 2026-02-24 18:02:10.476657 | controller | changed: [instance] => (item=volumes) 2026-02-24 18:02:10.476691 | controller | 2026-02-24 18:02:10.476699 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2026-02-24 18:02:10.476705 | controller | Tuesday 24 February 2026 18:02:10 +0000 (0:00:00.420) 0:01:28.087 ****** 2026-02-24 18:02:10.476716 | controller | skipping: [instance] 2026-02-24 18:02:11.539659 | controller | 2026-02-24 18:02:11.539718 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2026-02-24 18:02:11.539726 | controller | Tuesday 24 February 2026 18:02:10 +0000 (0:00:00.033) 0:01:28.120 ****** 2026-02-24 18:02:11.539741 | controller | changed: [instance] => (item=compute) 2026-02-24 18:02:11.577710 | controller | changed: [instance] => (item=controller) 2026-02-24 18:02:11.577774 | controller | changed: [instance] => (item=crc) 2026-02-24 18:02:11.577786 | controller | 2026-02-24 18:02:11.577795 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2026-02-24 18:02:11.577804 | controller | Tuesday 24 February 2026 18:02:11 +0000 (0:00:01.062) 0:01:29.183 ****** 2026-02-24 18:02:11.577821 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance 2026-02-24 18:02:11.788185 | controller | 2026-02-24 18:02:11.788222 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] ***************** 2026-02-24 18:02:11.788231 | controller | Tuesday 24 February 2026 18:02:11 +0000 (0:00:00.038) 0:01:29.221 ****** 2026-02-24 18:02:11.788243 | controller | ok: [instance] 2026-02-24 18:02:11.812653 | controller | 2026-02-24 18:02:11.812690 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] ************* 2026-02-24 18:02:11.812701 | controller | Tuesday 24 February 2026 18:02:11 +0000 (0:00:00.210) 0:01:29.432 ****** 2026-02-24 18:02:11.812722 | controller | skipping: [instance] 2026-02-24 18:02:11.812944 | controller | 2026-02-24 18:02:11.812974 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] *** 2026-02-24 18:02:12.198974 | controller | Tuesday 24 February 2026 18:02:11 +0000 (0:00:00.024) 0:01:29.456 ****** 2026-02-24 18:02:12.199009 | controller | changed: [instance] 2026-02-24 18:02:12.222695 | controller | 2026-02-24 18:02:12.222746 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] ********************* 2026-02-24 18:02:12.222757 | controller | Tuesday 24 February 2026 18:02:12 +0000 (0:00:00.386) 0:01:29.843 ****** 2026-02-24 18:02:12.222773 | controller | skipping: [instance] 2026-02-24 18:02:12.244662 | controller | 2026-02-24 18:02:12.244681 | controller | TASK [libvirt_manager : Write merged all-group.yml] **************************** 2026-02-24 18:02:12.244688 | controller | Tuesday 24 February 2026 18:02:12 +0000 (0:00:00.023) 0:01:29.866 ****** 2026-02-24 18:02:12.244698 | controller | skipping: [instance] 2026-02-24 18:02:12.286215 | controller | 2026-02-24 18:02:12.286252 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2026-02-24 18:02:12.286266 | controller | Tuesday 24 February 2026 18:02:12 +0000 (0:00:00.022) 0:01:29.888 ****** 2026-02-24 18:02:12.286282 | controller | skipping: [instance] 2026-02-24 18:02:12.356248 | controller | 2026-02-24 18:02:12.356268 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2026-02-24 18:02:12.356275 | controller | Tuesday 24 February 2026 18:02:12 +0000 (0:00:00.041) 0:01:29.930 ****** 2026-02-24 18:02:12.356285 | controller | skipping: [instance] => (item=crc) 2026-02-24 18:02:12.578000 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2026-02-24 18:02:12.578020 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2026-02-24 18:02:12.578033 | controller | 2026-02-24 18:02:12.578039 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-24 18:02:12.578044 | controller | Tuesday 24 February 2026 18:02:12 +0000 (0:00:00.069) 0:01:30.000 ****** 2026-02-24 18:02:12.578052 | controller | changed: [instance] 2026-02-24 18:02:12.769680 | controller | 2026-02-24 18:02:12.769730 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-24 18:02:12.769738 | controller | Tuesday 24 February 2026 18:02:12 +0000 (0:00:00.222) 0:01:30.222 ****** 2026-02-24 18:02:12.769751 | controller | ok: [instance] 2026-02-24 18:02:42.412071 | controller | 2026-02-24 18:02:42.412135 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-24 18:02:42.412144 | controller | Tuesday 24 February 2026 18:02:12 +0000 (0:00:00.191) 0:01:30.413 ****** 2026-02-24 18:02:42.412156 | controller | changed: [instance] 2026-02-24 18:02:42.614621 | controller | 2026-02-24 18:02:42.614686 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-24 18:02:42.614699 | controller | Tuesday 24 February 2026 18:02:42 +0000 (0:00:29.641) 0:02:00.055 ****** 2026-02-24 18:02:42.614718 | controller | ok: [instance] 2026-02-24 18:02:42.659654 | controller | 2026-02-24 18:02:42.659686 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-24 18:02:42.659694 | controller | Tuesday 24 February 2026 18:02:42 +0000 (0:00:00.202) 0:02:00.258 ****** 2026-02-24 18:02:42.659706 | controller | ok: [instance] => changed=false 2026-02-24 18:02:42.659740 | controller | msg: All assertions passed 2026-02-24 18:02:42.660029 | controller | 2026-02-24 18:02:42.874141 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-24 18:02:42.874166 | controller | Tuesday 24 February 2026 18:02:42 +0000 (0:00:00.046) 0:02:00.304 ****** 2026-02-24 18:02:42.874177 | controller | changed: [instance] 2026-02-24 18:02:43.081508 | controller | 2026-02-24 18:02:43.081569 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2026-02-24 18:02:43.081576 | controller | Tuesday 24 February 2026 18:02:42 +0000 (0:00:00.213) 0:02:00.517 ****** 2026-02-24 18:02:43.081585 | controller | ok: [instance] 2026-02-24 18:02:43.280216 | controller | 2026-02-24 18:02:43.280238 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2026-02-24 18:02:43.280245 | controller | Tuesday 24 February 2026 18:02:43 +0000 (0:00:00.207) 0:02:00.725 ****** 2026-02-24 18:02:43.280254 | controller | ok: [instance] 2026-02-24 18:02:43.304548 | controller | 2026-02-24 18:02:43.304566 | controller | TASK [libvirt_manager : Download base image] *********************************** 2026-02-24 18:02:43.304573 | controller | Tuesday 24 February 2026 18:02:43 +0000 (0:00:00.198) 0:02:00.924 ****** 2026-02-24 18:02:43.304581 | controller | skipping: [instance] 2026-02-24 18:02:43.509883 | controller | 2026-02-24 18:02:43.509904 | controller | TASK [libvirt_manager : Check image] ******************************************* 2026-02-24 18:02:43.509911 | controller | Tuesday 24 February 2026 18:02:43 +0000 (0:00:00.024) 0:02:00.948 ****** 2026-02-24 18:02:43.509920 | controller | ok: [instance] 2026-02-24 18:02:43.554735 | controller | 2026-02-24 18:02:43.554826 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2026-02-24 18:02:43.554843 | controller | Tuesday 24 February 2026 18:02:43 +0000 (0:00:00.205) 0:02:01.154 ****** 2026-02-24 18:02:43.554871 | controller | ok: [instance] => changed=false 2026-02-24 18:02:43.766620 | controller | msg: All assertions passed 2026-02-24 18:02:43.766659 | controller | 2026-02-24 18:02:43.766668 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2026-02-24 18:02:43.766675 | controller | Tuesday 24 February 2026 18:02:43 +0000 (0:00:00.044) 0:02:01.198 ****** 2026-02-24 18:02:43.766686 | controller | ok: [instance] 2026-02-24 18:02:43.943155 | controller | 2026-02-24 18:02:43.943176 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2026-02-24 18:02:43.943184 | controller | Tuesday 24 February 2026 18:02:43 +0000 (0:00:00.212) 0:02:01.410 ****** 2026-02-24 18:02:43.943192 | controller | ok: [instance] 2026-02-24 18:02:44.366721 | controller | 2026-02-24 18:02:44.366773 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2026-02-24 18:02:44.366804 | controller | Tuesday 24 February 2026 18:02:43 +0000 (0:00:00.176) 0:02:01.587 ****** 2026-02-24 18:02:44.366819 | controller | changed: [instance] 2026-02-24 18:02:44.366856 | controller | 2026-02-24 18:02:44.366866 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2026-02-24 18:02:44.366901 | controller | Tuesday 24 February 2026 18:02:44 +0000 (0:00:00.423) 0:02:02.010 ****** 2026-02-24 18:02:44.549323 | controller | ok: [instance] 2026-02-24 18:02:44.727736 | controller | 2026-02-24 18:02:44.727812 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2026-02-24 18:02:44.727824 | controller | Tuesday 24 February 2026 18:02:44 +0000 (0:00:00.182) 0:02:02.193 ****** 2026-02-24 18:02:44.727838 | controller | ok: [instance] 2026-02-24 18:02:44.727875 | controller | 2026-02-24 18:02:44.727885 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2026-02-24 18:02:44.728041 | controller | Tuesday 24 February 2026 18:02:44 +0000 (0:00:00.178) 0:02:02.371 ****** 2026-02-24 18:02:45.131589 | controller | changed: [instance] 2026-02-24 18:02:45.154151 | controller | 2026-02-24 18:02:45.154170 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2026-02-24 18:02:45.154178 | controller | Tuesday 24 February 2026 18:02:45 +0000 (0:00:00.403) 0:02:02.775 ****** 2026-02-24 18:02:45.154187 | controller | ok: [instance] 2026-02-24 18:02:45.386652 | controller | 2026-02-24 18:02:45.386681 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2026-02-24 18:02:45.386689 | controller | Tuesday 24 February 2026 18:02:45 +0000 (0:00:00.022) 0:02:02.798 ****** 2026-02-24 18:02:45.386699 | controller | ok: [instance] 2026-02-24 18:02:45.867110 | controller | 2026-02-24 18:02:45.867147 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2026-02-24 18:02:45.867156 | controller | Tuesday 24 February 2026 18:02:45 +0000 (0:00:00.232) 0:02:03.030 ****** 2026-02-24 18:02:45.867167 | controller | ok: [instance] 2026-02-24 18:02:45.996761 | controller | 2026-02-24 18:02:45.996830 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2026-02-24 18:02:45.996841 | controller | Tuesday 24 February 2026 18:02:45 +0000 (0:00:00.480) 0:02:03.511 ****** 2026-02-24 18:02:45.996856 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 18:02:45.996866 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 18:02:45.996872 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 18:02:45.996879 | controller | 2026-02-24 18:02:45.996885 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2026-02-24 18:02:45.996895 | controller | Tuesday 24 February 2026 18:02:45 +0000 (0:00:00.129) 0:02:03.640 ****** 2026-02-24 18:02:46.260311 | controller | changed: [instance] 2026-02-24 18:02:46.490867 | controller | 2026-02-24 18:02:46.490923 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2026-02-24 18:02:46.490932 | controller | Tuesday 24 February 2026 18:02:46 +0000 (0:00:00.264) 0:02:03.904 ****** 2026-02-24 18:02:46.490945 | controller | changed: [instance] 2026-02-24 18:02:46.849682 | controller | 2026-02-24 18:02:46.849736 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2026-02-24 18:02:46.849748 | controller | Tuesday 24 February 2026 18:02:46 +0000 (0:00:00.230) 0:02:04.134 ****** 2026-02-24 18:02:46.849763 | controller | changed: [instance] 2026-02-24 18:02:46.849813 | controller | 2026-02-24 18:02:46.849825 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2026-02-24 18:02:46.881728 | controller | Tuesday 24 February 2026 18:02:46 +0000 (0:00:00.359) 0:02:04.493 ****** 2026-02-24 18:02:46.881777 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 18:02:46.927702 | controller | 2026-02-24 18:02:46.927749 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 18:02:46.927760 | controller | Tuesday 24 February 2026 18:02:46 +0000 (0:00:00.031) 0:02:04.525 ****** 2026-02-24 18:02:46.927773 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 18:02:47.166339 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 18:02:47.166390 | controller | 2026-02-24 18:02:47.166404 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 18:02:47.166411 | controller | Tuesday 24 February 2026 18:02:46 +0000 (0:00:00.045) 0:02:04.571 ****** 2026-02-24 18:02:47.166422 | controller | ok: [instance] 2026-02-24 18:02:47.212230 | controller | 2026-02-24 18:02:47.212251 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 18:02:47.212258 | controller | Tuesday 24 February 2026 18:02:47 +0000 (0:00:00.239) 0:02:04.810 ****** 2026-02-24 18:02:47.212268 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:02:47.462250 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:02:47.462281 | controller | 2026-02-24 18:02:47.462289 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 18:02:47.462295 | controller | Tuesday 24 February 2026 18:02:47 +0000 (0:00:00.046) 0:02:04.856 ****** 2026-02-24 18:02:47.462304 | controller | ok: [instance] 2026-02-24 18:02:47.689989 | controller | 2026-02-24 18:02:47.690023 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 18:02:47.690031 | controller | Tuesday 24 February 2026 18:02:47 +0000 (0:00:00.249) 0:02:05.106 ****** 2026-02-24 18:02:47.690042 | controller | ok: [instance] 2026-02-24 18:02:47.993342 | controller | 2026-02-24 18:02:47.993371 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2026-02-24 18:02:47.993379 | controller | Tuesday 24 February 2026 18:02:47 +0000 (0:00:00.227) 0:02:05.334 ****** 2026-02-24 18:02:47.993389 | controller | changed: [instance] 2026-02-24 18:02:48.244080 | controller | 2026-02-24 18:02:48.244133 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 18:02:48.244143 | controller | Tuesday 24 February 2026 18:02:47 +0000 (0:00:00.303) 0:02:05.637 ****** 2026-02-24 18:02:48.244156 | controller | ok: [instance] 2026-02-24 18:02:48.292657 | controller | 2026-02-24 18:02:48.292715 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 18:02:48.292725 | controller | Tuesday 24 February 2026 18:02:48 +0000 (0:00:00.250) 0:02:05.887 ****** 2026-02-24 18:02:48.292739 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:02:48.292773 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:02:48.292791 | controller | 2026-02-24 18:02:48.292799 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 18:02:48.292892 | controller | Tuesday 24 February 2026 18:02:48 +0000 (0:00:00.048) 0:02:05.936 ****** 2026-02-24 18:02:48.538252 | controller | ok: [instance] 2026-02-24 18:02:48.739077 | controller | 2026-02-24 18:02:48.739108 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 18:02:48.739116 | controller | Tuesday 24 February 2026 18:02:48 +0000 (0:00:00.245) 0:02:06.182 ****** 2026-02-24 18:02:48.739127 | controller | ok: [instance] 2026-02-24 18:02:49.037662 | controller | 2026-02-24 18:02:49.037703 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2026-02-24 18:02:49.037712 | controller | Tuesday 24 February 2026 18:02:48 +0000 (0:00:00.200) 0:02:06.383 ****** 2026-02-24 18:02:49.037724 | controller | changed: [instance] 2026-02-24 18:02:49.037731 | controller | 2026-02-24 18:02:49.037737 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2026-02-24 18:02:49.037746 | controller | Tuesday 24 February 2026 18:02:49 +0000 (0:00:00.298) 0:02:06.681 ****** 2026-02-24 18:02:49.060657 | controller | skipping: [instance] 2026-02-24 18:02:49.060734 | controller | 2026-02-24 18:02:49.060746 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2026-02-24 18:02:49.060756 | controller | Tuesday 24 February 2026 18:02:49 +0000 (0:00:00.023) 0:02:06.704 ****** 2026-02-24 18:02:49.091711 | controller | skipping: [instance] 2026-02-24 18:02:49.092099 | controller | 2026-02-24 18:02:49.092165 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2026-02-24 18:02:49.121240 | controller | Tuesday 24 February 2026 18:02:49 +0000 (0:00:00.031) 0:02:06.736 ****** 2026-02-24 18:02:49.121271 | controller | skipping: [instance] 2026-02-24 18:02:49.149137 | controller | 2026-02-24 18:02:49.149165 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2026-02-24 18:02:49.149177 | controller | Tuesday 24 February 2026 18:02:49 +0000 (0:00:00.029) 0:02:06.765 ****** 2026-02-24 18:02:49.149191 | controller | skipping: [instance] 2026-02-24 18:02:49.373561 | controller | 2026-02-24 18:02:49.373584 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 18:02:49.373592 | controller | Tuesday 24 February 2026 18:02:49 +0000 (0:00:00.027) 0:02:06.793 ****** 2026-02-24 18:02:49.373601 | controller | changed: [instance] 2026-02-24 18:02:49.413316 | controller | 2026-02-24 18:02:49.413349 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 18:02:49.413363 | controller | Tuesday 24 February 2026 18:02:49 +0000 (0:00:00.224) 0:02:07.017 ****** 2026-02-24 18:02:49.413372 | controller | ok: [instance] 2026-02-24 18:02:49.466689 | controller | 2026-02-24 18:02:49.466733 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 18:02:49.466744 | controller | Tuesday 24 February 2026 18:02:49 +0000 (0:00:00.039) 0:02:07.057 ****** 2026-02-24 18:02:49.466763 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-24 18:02:49.466812 | controller | 2026-02-24 18:02:49.467196 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-24 18:02:49.664370 | controller | Tuesday 24 February 2026 18:02:49 +0000 (0:00:00.053) 0:02:07.111 ****** 2026-02-24 18:02:49.664417 | controller | ok: [instance] 2026-02-24 18:02:49.728192 | controller | 2026-02-24 18:02:49.728211 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-24 18:02:49.728218 | controller | Tuesday 24 February 2026 18:02:49 +0000 (0:00:00.196) 0:02:07.308 ****** 2026-02-24 18:02:49.728227 | controller | ok: [instance] 2026-02-24 18:02:49.775318 | controller | 2026-02-24 18:02:49.775350 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-24 18:02:49.775363 | controller | Tuesday 24 February 2026 18:02:49 +0000 (0:00:00.064) 0:02:07.372 ****** 2026-02-24 18:02:49.775378 | controller | ok: [instance] 2026-02-24 18:02:49.775649 | controller | 2026-02-24 18:02:49.775916 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-24 18:02:49.776096 | controller | Tuesday 24 February 2026 18:02:49 +0000 (0:00:00.047) 0:02:07.419 ****** 2026-02-24 18:02:49.818487 | controller | skipping: [instance] 2026-02-24 18:02:49.818727 | controller | 2026-02-24 18:02:49.818915 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-24 18:02:49.819072 | controller | Tuesday 24 February 2026 18:02:49 +0000 (0:00:00.043) 0:02:07.463 ****** 2026-02-24 18:02:49.861641 | controller | skipping: [instance] 2026-02-24 18:02:49.861848 | controller | 2026-02-24 18:02:49.862106 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-24 18:02:49.862348 | controller | Tuesday 24 February 2026 18:02:49 +0000 (0:00:00.043) 0:02:07.506 ****** 2026-02-24 18:02:49.922915 | controller | 2026-02-24 18:02:49.923096 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-24 18:02:49.923252 | controller | Tuesday 24 February 2026 18:02:49 +0000 (0:00:00.061) 0:02:07.567 ****** 2026-02-24 18:02:50.330353 | controller | ok: [instance] => (item=artifacts) 2026-02-24 18:02:51.502816 | controller | ok: [instance] => (item=logs) 2026-02-24 18:02:51.502923 | controller | 2026-02-24 18:02:51.502933 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-24 18:02:51.502957 | controller | Tuesday 24 February 2026 18:02:50 +0000 (0:00:00.406) 0:02:07.973 ****** 2026-02-24 18:02:51.502972 | controller | ok: [instance] 2026-02-24 18:02:51.721382 | controller | 2026-02-24 18:02:51.721441 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-24 18:02:51.721453 | controller | Tuesday 24 February 2026 18:02:51 +0000 (0:00:01.171) 0:02:09.145 ****** 2026-02-24 18:02:51.721468 | controller | changed: [instance] 2026-02-24 18:02:51.721714 | controller | 2026-02-24 18:02:51.721829 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-24 18:02:51.721868 | controller | Tuesday 24 February 2026 18:02:51 +0000 (0:00:00.219) 0:02:09.365 ****** 2026-02-24 18:02:52.094566 | controller | changed: [instance] 2026-02-24 18:02:52.473681 | controller | 2026-02-24 18:02:52.473714 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-24 18:02:52.473723 | controller | Tuesday 24 February 2026 18:02:52 +0000 (0:00:00.373) 0:02:09.738 ****** 2026-02-24 18:02:52.473732 | controller | changed: [instance] 2026-02-24 18:02:52.522188 | controller | 2026-02-24 18:02:52.522205 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-24 18:02:52.522213 | controller | Tuesday 24 February 2026 18:02:52 +0000 (0:00:00.379) 0:02:10.117 ****** 2026-02-24 18:02:52.522222 | controller | skipping: [instance] 2026-02-24 18:02:52.728186 | controller | 2026-02-24 18:02:52.728258 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-24 18:02:52.728268 | controller | Tuesday 24 February 2026 18:02:52 +0000 (0:00:00.048) 0:02:10.166 ****** 2026-02-24 18:02:52.728283 | controller | ok: [instance] 2026-02-24 18:02:52.771709 | controller | 2026-02-24 18:02:52.771760 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-24 18:02:52.771771 | controller | Tuesday 24 February 2026 18:02:52 +0000 (0:00:00.205) 0:02:10.371 ****** 2026-02-24 18:02:52.771805 | controller | skipping: [instance] 2026-02-24 18:02:53.002582 | controller | 2026-02-24 18:02:53.002616 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-24 18:02:53.002625 | controller | Tuesday 24 February 2026 18:02:52 +0000 (0:00:00.044) 0:02:10.415 ****** 2026-02-24 18:02:53.002637 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2026-02-24 18:02:53.302818 | controller | changed: [instance] 2026-02-24 18:02:53.302871 | controller | 2026-02-24 18:02:53.302881 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 18:02:53.302890 | controller | Tuesday 24 February 2026 18:02:52 +0000 (0:00:00.230) 0:02:10.646 ****** 2026-02-24 18:02:53.302904 | controller | changed: [instance] 2026-02-24 18:02:53.354638 | controller | 2026-02-24 18:02:53.354679 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 18:02:53.354690 | controller | Tuesday 24 February 2026 18:02:53 +0000 (0:00:00.299) 0:02:10.946 ****** 2026-02-24 18:02:53.354703 | controller | skipping: [instance] 2026-02-24 18:02:53.385594 | controller | 2026-02-24 18:02:53.385616 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2026-02-24 18:02:53.385625 | controller | Tuesday 24 February 2026 18:02:53 +0000 (0:00:00.052) 0:02:10.998 ****** 2026-02-24 18:02:53.385635 | controller | skipping: [instance] 2026-02-24 18:02:53.385664 | controller | 2026-02-24 18:02:53.385673 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2026-02-24 18:02:53.385963 | controller | Tuesday 24 February 2026 18:02:53 +0000 (0:00:00.030) 0:02:11.029 ****** 2026-02-24 18:02:53.638628 | controller | changed: [instance] 2026-02-24 18:02:53.638698 | controller | 2026-02-24 18:02:53.638710 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2026-02-24 18:02:53.638739 | controller | Tuesday 24 February 2026 18:02:53 +0000 (0:00:00.253) 0:02:11.282 ****** 2026-02-24 18:02:53.871663 | controller | changed: [instance] 2026-02-24 18:02:53.871724 | controller | 2026-02-24 18:02:53.871735 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2026-02-24 18:02:53.871893 | controller | Tuesday 24 February 2026 18:02:53 +0000 (0:00:00.232) 0:02:11.515 ****** 2026-02-24 18:02:54.233254 | controller | changed: [instance] 2026-02-24 18:02:54.261497 | controller | 2026-02-24 18:02:54.261547 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2026-02-24 18:02:54.261556 | controller | Tuesday 24 February 2026 18:02:54 +0000 (0:00:00.361) 0:02:11.877 ****** 2026-02-24 18:02:54.261567 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 18:02:54.304493 | controller | 2026-02-24 18:02:54.304529 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 18:02:54.304540 | controller | Tuesday 24 February 2026 18:02:54 +0000 (0:00:00.028) 0:02:11.905 ****** 2026-02-24 18:02:54.304549 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 18:02:54.543344 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 18:02:54.543404 | controller | 2026-02-24 18:02:54.543414 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 18:02:54.543422 | controller | Tuesday 24 February 2026 18:02:54 +0000 (0:00:00.042) 0:02:11.948 ****** 2026-02-24 18:02:54.543436 | controller | ok: [instance] 2026-02-24 18:02:54.598160 | controller | 2026-02-24 18:02:54.598192 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 18:02:54.598200 | controller | Tuesday 24 February 2026 18:02:54 +0000 (0:00:00.237) 0:02:12.186 ****** 2026-02-24 18:02:54.598212 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:02:54.846426 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:02:54.846455 | controller | 2026-02-24 18:02:54.846462 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 18:02:54.846469 | controller | Tuesday 24 February 2026 18:02:54 +0000 (0:00:00.055) 0:02:12.242 ****** 2026-02-24 18:02:54.846479 | controller | ok: [instance] 2026-02-24 18:02:55.067528 | controller | 2026-02-24 18:02:55.067555 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 18:02:55.067564 | controller | Tuesday 24 February 2026 18:02:54 +0000 (0:00:00.248) 0:02:12.490 ****** 2026-02-24 18:02:55.067574 | controller | ok: [instance] 2026-02-24 18:02:55.387937 | controller | 2026-02-24 18:02:55.387966 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2026-02-24 18:02:55.387974 | controller | Tuesday 24 February 2026 18:02:55 +0000 (0:00:00.221) 0:02:12.711 ****** 2026-02-24 18:02:55.387985 | controller | changed: [instance] 2026-02-24 18:02:55.634731 | controller | 2026-02-24 18:02:55.634793 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 18:02:55.634806 | controller | Tuesday 24 February 2026 18:02:55 +0000 (0:00:00.320) 0:02:13.031 ****** 2026-02-24 18:02:55.634827 | controller | ok: [instance] 2026-02-24 18:02:55.634853 | controller | 2026-02-24 18:02:55.634861 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 18:02:55.634872 | controller | Tuesday 24 February 2026 18:02:55 +0000 (0:00:00.246) 0:02:13.278 ****** 2026-02-24 18:02:55.680653 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:02:55.680828 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:02:55.680880 | controller | 2026-02-24 18:02:55.680892 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 18:02:55.680909 | controller | Tuesday 24 February 2026 18:02:55 +0000 (0:00:00.045) 0:02:13.324 ****** 2026-02-24 18:02:55.959499 | controller | ok: [instance] 2026-02-24 18:02:56.175709 | controller | 2026-02-24 18:02:56.175766 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 18:02:56.175788 | controller | Tuesday 24 February 2026 18:02:55 +0000 (0:00:00.279) 0:02:13.603 ****** 2026-02-24 18:02:56.175803 | controller | ok: [instance] 2026-02-24 18:02:56.175839 | controller | 2026-02-24 18:02:56.175850 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2026-02-24 18:02:56.176002 | controller | Tuesday 24 February 2026 18:02:56 +0000 (0:00:00.215) 0:02:13.819 ****** 2026-02-24 18:02:56.482039 | controller | changed: [instance] 2026-02-24 18:02:56.505708 | controller | 2026-02-24 18:02:56.505767 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2026-02-24 18:02:56.505787 | controller | Tuesday 24 February 2026 18:02:56 +0000 (0:00:00.306) 0:02:14.126 ****** 2026-02-24 18:02:56.505802 | controller | skipping: [instance] 2026-02-24 18:02:56.505873 | controller | 2026-02-24 18:02:56.505907 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2026-02-24 18:02:56.536114 | controller | Tuesday 24 February 2026 18:02:56 +0000 (0:00:00.023) 0:02:14.150 ****** 2026-02-24 18:02:56.536151 | controller | skipping: [instance] 2026-02-24 18:02:56.565101 | controller | 2026-02-24 18:02:56.565128 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2026-02-24 18:02:56.565137 | controller | Tuesday 24 February 2026 18:02:56 +0000 (0:00:00.029) 0:02:14.179 ****** 2026-02-24 18:02:56.565147 | controller | skipping: [instance] 2026-02-24 18:02:56.594253 | controller | 2026-02-24 18:02:56.594296 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2026-02-24 18:02:56.594312 | controller | Tuesday 24 February 2026 18:02:56 +0000 (0:00:00.029) 0:02:14.209 ****** 2026-02-24 18:02:56.594331 | controller | skipping: [instance] 2026-02-24 18:02:56.834088 | controller | 2026-02-24 18:02:56.834107 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 18:02:56.834115 | controller | Tuesday 24 February 2026 18:02:56 +0000 (0:00:00.028) 0:02:14.238 ****** 2026-02-24 18:02:56.834123 | controller | changed: [instance] 2026-02-24 18:02:56.873488 | controller | 2026-02-24 18:02:56.873506 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 18:02:56.873535 | controller | Tuesday 24 February 2026 18:02:56 +0000 (0:00:00.240) 0:02:14.478 ****** 2026-02-24 18:02:56.873547 | controller | ok: [instance] 2026-02-24 18:02:56.928579 | controller | 2026-02-24 18:02:56.928614 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 18:02:56.928628 | controller | Tuesday 24 February 2026 18:02:56 +0000 (0:00:00.039) 0:02:14.517 ****** 2026-02-24 18:02:56.928645 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2026-02-24 18:02:57.130567 | controller | 2026-02-24 18:02:57.130587 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2026-02-24 18:02:57.130594 | controller | Tuesday 24 February 2026 18:02:56 +0000 (0:00:00.055) 0:02:14.572 ****** 2026-02-24 18:02:57.130603 | controller | ok: [instance] 2026-02-24 18:02:57.195329 | controller | 2026-02-24 18:02:57.195346 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2026-02-24 18:02:57.195353 | controller | Tuesday 24 February 2026 18:02:57 +0000 (0:00:00.202) 0:02:14.774 ****** 2026-02-24 18:02:57.195362 | controller | ok: [instance] 2026-02-24 18:02:57.243704 | controller | 2026-02-24 18:02:57.243802 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2026-02-24 18:02:57.243819 | controller | Tuesday 24 February 2026 18:02:57 +0000 (0:00:00.064) 0:02:14.839 ****** 2026-02-24 18:02:57.243842 | controller | ok: [instance] 2026-02-24 18:02:57.291692 | controller | 2026-02-24 18:02:57.291732 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2026-02-24 18:02:57.291743 | controller | Tuesday 24 February 2026 18:02:57 +0000 (0:00:00.048) 0:02:14.887 ****** 2026-02-24 18:02:57.291755 | controller | skipping: [instance] 2026-02-24 18:02:57.291800 | controller | 2026-02-24 18:02:57.291811 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2026-02-24 18:02:57.291909 | controller | Tuesday 24 February 2026 18:02:57 +0000 (0:00:00.048) 0:02:14.936 ****** 2026-02-24 18:02:57.337426 | controller | skipping: [instance] 2026-02-24 18:02:57.401786 | controller | 2026-02-24 18:02:57.401831 | controller | TASK [Call the config_drive role] ********************************************** 2026-02-24 18:02:57.401844 | controller | Tuesday 24 February 2026 18:02:57 +0000 (0:00:00.045) 0:02:14.981 ****** 2026-02-24 18:02:57.401857 | controller | 2026-02-24 18:02:57.820497 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2026-02-24 18:02:57.820556 | controller | Tuesday 24 February 2026 18:02:57 +0000 (0:00:00.064) 0:02:15.045 ****** 2026-02-24 18:02:57.820570 | controller | ok: [instance] => (item=artifacts) 2026-02-24 18:02:59.114358 | controller | ok: [instance] => (item=logs) 2026-02-24 18:02:59.114418 | controller | 2026-02-24 18:02:59.114427 | controller | TASK [config_drive : Install required RPM packages] **************************** 2026-02-24 18:02:59.114434 | controller | Tuesday 24 February 2026 18:02:57 +0000 (0:00:00.415) 0:02:15.461 ****** 2026-02-24 18:02:59.114446 | controller | ok: [instance] 2026-02-24 18:02:59.332716 | controller | 2026-02-24 18:02:59.332783 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2026-02-24 18:02:59.332795 | controller | Tuesday 24 February 2026 18:02:59 +0000 (0:00:01.296) 0:02:16.758 ****** 2026-02-24 18:02:59.332810 | controller | changed: [instance] 2026-02-24 18:02:59.332853 | controller | 2026-02-24 18:02:59.332863 | controller | TASK [config_drive : Generate meta-data] *************************************** 2026-02-24 18:02:59.333049 | controller | Tuesday 24 February 2026 18:02:59 +0000 (0:00:00.218) 0:02:16.976 ****** 2026-02-24 18:02:59.725453 | controller | changed: [instance] 2026-02-24 18:03:00.137019 | controller | 2026-02-24 18:03:00.137064 | controller | TASK [config_drive : Generate user-data] *************************************** 2026-02-24 18:03:00.137074 | controller | Tuesday 24 February 2026 18:02:59 +0000 (0:00:00.392) 0:02:17.369 ****** 2026-02-24 18:03:00.137085 | controller | changed: [instance] 2026-02-24 18:03:00.183705 | controller | 2026-02-24 18:03:00.183757 | controller | TASK [config_drive : Generate network-data] ************************************ 2026-02-24 18:03:00.183781 | controller | Tuesday 24 February 2026 18:03:00 +0000 (0:00:00.411) 0:02:17.780 ****** 2026-02-24 18:03:00.183795 | controller | skipping: [instance] 2026-02-24 18:03:00.183829 | controller | 2026-02-24 18:03:00.183839 | controller | TASK [config_drive : Check ISO availability] *********************************** 2026-02-24 18:03:00.183870 | controller | Tuesday 24 February 2026 18:03:00 +0000 (0:00:00.047) 0:02:17.828 ****** 2026-02-24 18:03:00.387185 | controller | ok: [instance] 2026-02-24 18:03:00.430418 | controller | 2026-02-24 18:03:00.430440 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2026-02-24 18:03:00.430450 | controller | Tuesday 24 February 2026 18:03:00 +0000 (0:00:00.203) 0:02:18.031 ****** 2026-02-24 18:03:00.430461 | controller | skipping: [instance] 2026-02-24 18:03:00.669953 | controller | 2026-02-24 18:03:00.669975 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2026-02-24 18:03:00.669982 | controller | Tuesday 24 February 2026 18:03:00 +0000 (0:00:00.043) 0:02:18.074 ****** 2026-02-24 18:03:00.669990 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2026-02-24 18:03:00.969008 | controller | changed: [instance] 2026-02-24 18:03:00.969028 | controller | 2026-02-24 18:03:00.969036 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 18:03:00.969042 | controller | Tuesday 24 February 2026 18:03:00 +0000 (0:00:00.239) 0:02:18.314 ****** 2026-02-24 18:03:00.969050 | controller | changed: [instance] 2026-02-24 18:03:01.024897 | controller | 2026-02-24 18:03:01.024924 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 18:03:01.024932 | controller | Tuesday 24 February 2026 18:03:00 +0000 (0:00:00.299) 0:02:18.613 ****** 2026-02-24 18:03:01.024941 | controller | skipping: [instance] 2026-02-24 18:03:01.059204 | controller | 2026-02-24 18:03:01.059227 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2026-02-24 18:03:01.059237 | controller | Tuesday 24 February 2026 18:03:01 +0000 (0:00:00.055) 0:02:18.669 ****** 2026-02-24 18:03:01.059249 | controller | skipping: [instance] 2026-02-24 18:03:01.324143 | controller | 2026-02-24 18:03:01.324177 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2026-02-24 18:03:01.324185 | controller | Tuesday 24 February 2026 18:03:01 +0000 (0:00:00.034) 0:02:18.703 ****** 2026-02-24 18:03:01.324196 | controller | changed: [instance] 2026-02-24 18:03:01.558006 | controller | 2026-02-24 18:03:01.558060 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2026-02-24 18:03:01.558074 | controller | Tuesday 24 February 2026 18:03:01 +0000 (0:00:00.264) 0:02:18.967 ****** 2026-02-24 18:03:01.558083 | controller | changed: [instance] 2026-02-24 18:03:01.862657 | controller | 2026-02-24 18:03:01.862710 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2026-02-24 18:03:01.862719 | controller | Tuesday 24 February 2026 18:03:01 +0000 (0:00:00.234) 0:02:19.202 ****** 2026-02-24 18:03:01.862732 | controller | changed: [instance] 2026-02-24 18:03:01.862779 | controller | 2026-02-24 18:03:01.862800 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2026-02-24 18:03:01.862978 | controller | Tuesday 24 February 2026 18:03:01 +0000 (0:00:00.304) 0:02:19.506 ****** 2026-02-24 18:03:01.902186 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2026-02-24 18:03:01.953341 | controller | 2026-02-24 18:03:01.953358 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2026-02-24 18:03:01.953365 | controller | Tuesday 24 February 2026 18:03:01 +0000 (0:00:00.037) 0:02:19.544 ****** 2026-02-24 18:03:01.953374 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2026-02-24 18:03:02.231589 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2026-02-24 18:03:02.231648 | controller | 2026-02-24 18:03:02.231658 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 18:03:02.231665 | controller | Tuesday 24 February 2026 18:03:01 +0000 (0:00:00.052) 0:02:19.597 ****** 2026-02-24 18:03:02.231680 | controller | ok: [instance] 2026-02-24 18:03:02.289685 | controller | 2026-02-24 18:03:02.289709 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 18:03:02.289718 | controller | Tuesday 24 February 2026 18:03:02 +0000 (0:00:00.278) 0:02:19.875 ****** 2026-02-24 18:03:02.289729 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:03:02.289961 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:03:02.289974 | controller | 2026-02-24 18:03:02.550705 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 18:03:02.550730 | controller | Tuesday 24 February 2026 18:03:02 +0000 (0:00:00.057) 0:02:19.933 ****** 2026-02-24 18:03:02.550742 | controller | ok: [instance] 2026-02-24 18:03:02.788592 | controller | 2026-02-24 18:03:02.788642 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 18:03:02.788656 | controller | Tuesday 24 February 2026 18:03:02 +0000 (0:00:00.261) 0:02:20.194 ****** 2026-02-24 18:03:02.788675 | controller | ok: [instance] 2026-02-24 18:03:03.115606 | controller | 2026-02-24 18:03:03.115638 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2026-02-24 18:03:03.115646 | controller | Tuesday 24 February 2026 18:03:02 +0000 (0:00:00.237) 0:02:20.432 ****** 2026-02-24 18:03:03.115658 | controller | changed: [instance] 2026-02-24 18:03:03.376967 | controller | 2026-02-24 18:03:03.377000 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2026-02-24 18:03:03.377010 | controller | Tuesday 24 February 2026 18:03:03 +0000 (0:00:00.326) 0:02:20.759 ****** 2026-02-24 18:03:03.377024 | controller | ok: [instance] 2026-02-24 18:03:03.431665 | controller | 2026-02-24 18:03:03.431692 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2026-02-24 18:03:03.431701 | controller | Tuesday 24 February 2026 18:03:03 +0000 (0:00:00.261) 0:02:21.020 ****** 2026-02-24 18:03:03.431712 | controller | ok: [instance] => (item=cifmw-public) 2026-02-24 18:03:03.690603 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2026-02-24 18:03:03.690641 | controller | 2026-02-24 18:03:03.690648 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2026-02-24 18:03:03.690655 | controller | Tuesday 24 February 2026 18:03:03 +0000 (0:00:00.054) 0:02:21.075 ****** 2026-02-24 18:03:03.690665 | controller | ok: [instance] 2026-02-24 18:03:03.690697 | controller | 2026-02-24 18:03:03.690705 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2026-02-24 18:03:03.690857 | controller | Tuesday 24 February 2026 18:03:03 +0000 (0:00:00.259) 0:02:21.334 ****** 2026-02-24 18:03:03.904432 | controller | ok: [instance] 2026-02-24 18:03:04.243347 | controller | 2026-02-24 18:03:04.243406 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2026-02-24 18:03:04.243415 | controller | Tuesday 24 February 2026 18:03:03 +0000 (0:00:00.213) 0:02:21.548 ****** 2026-02-24 18:03:04.243428 | controller | changed: [instance] 2026-02-24 18:03:04.268081 | controller | 2026-02-24 18:03:04.268100 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2026-02-24 18:03:04.268108 | controller | Tuesday 24 February 2026 18:03:04 +0000 (0:00:00.338) 0:02:21.886 ****** 2026-02-24 18:03:04.268116 | controller | skipping: [instance] 2026-02-24 18:03:04.362374 | controller | 2026-02-24 18:03:04.362397 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2026-02-24 18:03:04.362405 | controller | Tuesday 24 February 2026 18:03:04 +0000 (0:00:00.025) 0:02:21.912 ****** 2026-02-24 18:03:04.362423 | controller | skipping: [instance] 2026-02-24 18:03:04.393752 | controller | 2026-02-24 18:03:04.393826 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2026-02-24 18:03:04.393842 | controller | Tuesday 24 February 2026 18:03:04 +0000 (0:00:00.093) 0:02:22.006 ****** 2026-02-24 18:03:04.393861 | controller | skipping: [instance] 2026-02-24 18:03:04.393911 | controller | 2026-02-24 18:03:04.393926 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2026-02-24 18:03:04.394121 | controller | Tuesday 24 February 2026 18:03:04 +0000 (0:00:00.031) 0:02:22.038 ****** 2026-02-24 18:03:04.419976 | controller | skipping: [instance] 2026-02-24 18:03:04.642063 | controller | 2026-02-24 18:03:04.642089 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2026-02-24 18:03:04.642096 | controller | Tuesday 24 February 2026 18:03:04 +0000 (0:00:00.025) 0:02:22.064 ****** 2026-02-24 18:03:04.642105 | controller | changed: [instance] 2026-02-24 18:03:04.681231 | controller | 2026-02-24 18:03:04.681248 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2026-02-24 18:03:04.681255 | controller | Tuesday 24 February 2026 18:03:04 +0000 (0:00:00.222) 0:02:22.286 ****** 2026-02-24 18:03:04.681263 | controller | ok: [instance] 2026-02-24 18:03:04.709548 | controller | 2026-02-24 18:03:04.709566 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2026-02-24 18:03:04.709573 | controller | Tuesday 24 February 2026 18:03:04 +0000 (0:00:00.039) 0:02:22.325 ****** 2026-02-24 18:03:04.709582 | controller | skipping: [instance] 2026-02-24 18:03:04.739531 | controller | 2026-02-24 18:03:04.739551 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2026-02-24 18:03:04.739558 | controller | Tuesday 24 February 2026 18:03:04 +0000 (0:00:00.028) 0:02:22.353 ****** 2026-02-24 18:03:04.739566 | controller | skipping: [instance] 2026-02-24 18:03:04.786684 | controller | 2026-02-24 18:03:04.786736 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2026-02-24 18:03:04.786746 | controller | Tuesday 24 February 2026 18:03:04 +0000 (0:00:00.029) 0:02:22.383 ****** 2026-02-24 18:03:04.786770 | controller | skipping: [instance] 2026-02-24 18:03:04.814616 | controller | 2026-02-24 18:03:04.814640 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2026-02-24 18:03:04.814650 | controller | Tuesday 24 February 2026 18:03:04 +0000 (0:00:00.046) 0:02:22.430 ****** 2026-02-24 18:03:04.814663 | controller | skipping: [instance] 2026-02-24 18:03:04.814699 | controller | 2026-02-24 18:03:04.814710 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2026-02-24 18:03:04.814885 | controller | Tuesday 24 February 2026 18:03:04 +0000 (0:00:00.028) 0:02:22.459 ****** 2026-02-24 18:03:04.879267 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2026-02-24 18:03:04.879450 | controller | 2026-02-24 18:03:04.879630 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2026-02-24 18:03:04.879791 | controller | Tuesday 24 February 2026 18:03:04 +0000 (0:00:00.064) 0:02:22.523 ****** 2026-02-24 18:03:05.145684 | controller | ok: [instance] => (item=crc) 2026-02-24 18:03:05.145774 | controller | 2026-02-24 18:03:05.145787 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2026-02-24 18:03:05.145800 | controller | Tuesday 24 February 2026 18:03:05 +0000 (0:00:00.265) 0:02:22.789 ****** 2026-02-24 18:03:07.218472 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 18:03:07.828181 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 18:03:07.828232 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 18:03:07.828241 | controller | 2026-02-24 18:03:07.828248 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 18:03:07.828254 | controller | Tuesday 24 February 2026 18:03:07 +0000 (0:00:02.072) 0:02:24.861 ****** 2026-02-24 18:03:07.828266 | controller | changed: [instance] 2026-02-24 18:03:08.359610 | controller | 2026-02-24 18:03:08.359666 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 18:03:08.359677 | controller | Tuesday 24 February 2026 18:03:07 +0000 (0:00:00.609) 0:02:25.471 ****** 2026-02-24 18:03:08.359690 | controller | changed: [instance] 2026-02-24 18:03:08.872461 | controller | 2026-02-24 18:03:08.872526 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2026-02-24 18:03:08.872540 | controller | Tuesday 24 February 2026 18:03:08 +0000 (0:00:00.531) 0:02:26.003 ****** 2026-02-24 18:03:08.872552 | controller | changed: [instance] 2026-02-24 18:03:09.642730 | controller | 2026-02-24 18:03:09.642787 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2026-02-24 18:03:09.642796 | controller | Tuesday 24 February 2026 18:03:08 +0000 (0:00:00.512) 0:02:26.515 ****** 2026-02-24 18:03:09.642808 | controller | changed: [instance] => (item=compute-0.utility) 2026-02-24 18:03:35.901411 | controller | changed: [instance] => (item=controller-0.utility) 2026-02-24 18:03:35.901463 | controller | changed: [instance] => (item=crc-0.utility) 2026-02-24 18:03:35.901472 | controller | 2026-02-24 18:03:35.901478 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2026-02-24 18:03:35.901488 | controller | Tuesday 24 February 2026 18:03:09 +0000 (0:00:00.768) 0:02:27.283 ****** 2026-02-24 18:03:35.901499 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2026-02-24 18:03:35.901538 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2026-02-24 18:03:35.901573 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2026-02-24 18:03:35.901693 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2026-02-24 18:03:35.901787 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2026-02-24 18:03:35.901883 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2026-02-24 18:03:35.901963 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left). 2026-02-24 18:03:35.902044 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (83 retries left). 2026-02-24 18:03:35.902139 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j587911715536.25445', 'results_file': '/home/zuul/.ansible_async/j587911715536.25445', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2026-02-24 18:03:35.902229 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j84030732604.25462', 'results_file': '/home/zuul/.ansible_async/j84030732604.25462', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2026-02-24 18:03:35.902321 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j915548772625.25478', 'results_file': '/home/zuul/.ansible_async/j915548772625.25478', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2026-02-24 18:03:35.902398 | controller | 2026-02-24 18:03:35.902484 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2026-02-24 18:03:35.902607 | controller | Tuesday 24 February 2026 18:03:35 +0000 (0:00:26.261) 0:02:53.545 ****** 2026-02-24 18:03:36.027064 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2026-02-24 18:03:36.027152 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2026-02-24 18:03:36.027269 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2026-02-24 18:03:36.027352 | controller | 2026-02-24 18:03:36.027444 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 18:03:36.027560 | controller | Tuesday 24 February 2026 18:03:36 +0000 (0:00:00.125) 0:02:53.671 ****** 2026-02-24 18:03:36.056447 | controller | skipping: [instance] 2026-02-24 18:03:36.056559 | controller | 2026-02-24 18:03:36.056702 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2026-02-24 18:03:36.056808 | controller | Tuesday 24 February 2026 18:03:36 +0000 (0:00:00.029) 0:02:53.701 ****** 2026-02-24 18:03:36.101386 | controller | 2026-02-24 18:03:36.101488 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 18:03:36.101620 | controller | Tuesday 24 February 2026 18:03:36 +0000 (0:00:00.044) 0:02:53.745 ****** 2026-02-24 18:03:36.185625 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-24 18:03:36.185725 | controller | 2026-02-24 18:03:36.185847 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 18:03:36.185950 | controller | Tuesday 24 February 2026 18:03:36 +0000 (0:00:00.083) 0:02:53.829 ****** 2026-02-24 18:03:36.419378 | controller | changed: [instance] 2026-02-24 18:03:36.419437 | controller | 2026-02-24 18:03:36.419567 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 18:03:36.419656 | controller | Tuesday 24 February 2026 18:03:36 +0000 (0:00:00.233) 0:02:54.063 ****** 2026-02-24 18:03:36.657335 | controller | changed: [instance] 2026-02-24 18:03:37.093544 | controller | 2026-02-24 18:03:37.093584 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2026-02-24 18:03:37.093592 | controller | Tuesday 24 February 2026 18:03:36 +0000 (0:00:00.237) 0:02:54.301 ****** 2026-02-24 18:03:37.093609 | controller | changed: [instance] 2026-02-24 18:03:37.124836 | controller | 2026-02-24 18:03:37.124854 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2026-02-24 18:03:37.124861 | controller | Tuesday 24 February 2026 18:03:37 +0000 (0:00:00.436) 0:02:54.737 ****** 2026-02-24 18:03:37.124869 | controller | skipping: [instance] 2026-02-24 18:03:37.154363 | controller | 2026-02-24 18:03:37.154381 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 18:03:37.154388 | controller | Tuesday 24 February 2026 18:03:37 +0000 (0:00:00.031) 0:02:54.769 ****** 2026-02-24 18:03:37.154396 | controller | skipping: [instance] 2026-02-24 18:03:37.202854 | controller | 2026-02-24 18:03:37.202872 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2026-02-24 18:03:37.202887 | controller | Tuesday 24 February 2026 18:03:37 +0000 (0:00:00.029) 0:02:54.798 ****** 2026-02-24 18:03:37.202896 | controller | skipping: [instance] 2026-02-24 18:03:37.259665 | controller | 2026-02-24 18:03:37.259684 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2026-02-24 18:03:37.259691 | controller | Tuesday 24 February 2026 18:03:37 +0000 (0:00:00.048) 0:02:54.847 ****** 2026-02-24 18:03:37.259699 | controller | skipping: [instance] 2026-02-24 18:03:37.292964 | controller | 2026-02-24 18:03:37.292982 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 18:03:37.292990 | controller | Tuesday 24 February 2026 18:03:37 +0000 (0:00:00.056) 0:02:54.903 ****** 2026-02-24 18:03:37.292998 | controller | skipping: [instance] 2026-02-24 18:03:37.345290 | controller | 2026-02-24 18:03:37.345310 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2026-02-24 18:03:37.345318 | controller | Tuesday 24 February 2026 18:03:37 +0000 (0:00:00.033) 0:02:54.937 ****** 2026-02-24 18:03:37.345327 | controller | 2026-02-24 18:03:37.435216 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 18:03:37.435295 | controller | Tuesday 24 February 2026 18:03:37 +0000 (0:00:00.052) 0:02:54.989 ****** 2026-02-24 18:03:37.435314 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2026-02-24 18:03:37.671731 | controller | 2026-02-24 18:03:37.671772 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 18:03:37.671781 | controller | Tuesday 24 February 2026 18:03:37 +0000 (0:00:00.089) 0:02:55.079 ****** 2026-02-24 18:03:37.671796 | controller | ok: [instance] 2026-02-24 18:03:37.904900 | controller | 2026-02-24 18:03:37.904939 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 18:03:37.904947 | controller | Tuesday 24 February 2026 18:03:37 +0000 (0:00:00.236) 0:02:55.315 ****** 2026-02-24 18:03:37.904958 | controller | ok: [instance] 2026-02-24 18:03:38.398178 | controller | 2026-02-24 18:03:38.398216 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2026-02-24 18:03:38.398224 | controller | Tuesday 24 February 2026 18:03:37 +0000 (0:00:00.233) 0:02:55.548 ****** 2026-02-24 18:03:38.398235 | controller | changed: [instance] 2026-02-24 18:03:38.427830 | controller | 2026-02-24 18:03:38.427849 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2026-02-24 18:03:38.427857 | controller | Tuesday 24 February 2026 18:03:38 +0000 (0:00:00.493) 0:02:56.042 ****** 2026-02-24 18:03:38.427865 | controller | skipping: [instance] 2026-02-24 18:03:38.459414 | controller | 2026-02-24 18:03:38.459434 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 18:03:38.459441 | controller | Tuesday 24 February 2026 18:03:38 +0000 (0:00:00.030) 0:02:56.072 ****** 2026-02-24 18:03:38.459450 | controller | skipping: [instance] 2026-02-24 18:03:40.333642 | controller | 2026-02-24 18:03:40.333687 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2026-02-24 18:03:40.333697 | controller | Tuesday 24 February 2026 18:03:38 +0000 (0:00:00.031) 0:02:56.103 ****** 2026-02-24 18:03:40.333721 | controller | changed: [instance -> controller-0.instance] 2026-02-24 18:03:41.492661 | controller | 2026-02-24 18:03:41.492730 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2026-02-24 18:03:41.492740 | controller | Tuesday 24 February 2026 18:03:40 +0000 (0:00:01.873) 0:02:57.977 ****** 2026-02-24 18:03:41.492755 | controller | changed: [instance -> controller-0.instance] 2026-02-24 18:03:41.492778 | controller | 2026-02-24 18:03:41.492858 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2026-02-24 18:03:41.492869 | controller | Tuesday 24 February 2026 18:03:41 +0000 (0:00:01.159) 0:02:59.136 ****** 2026-02-24 18:03:41.546398 | controller | 2026-02-24 18:03:41.546500 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2026-02-24 18:03:41.546628 | controller | Tuesday 24 February 2026 18:03:41 +0000 (0:00:00.053) 0:02:59.190 ****** 2026-02-24 18:03:41.798468 | controller | ok: [instance] 2026-02-24 18:03:41.798588 | controller | 2026-02-24 18:03:41.798725 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2026-02-24 18:03:41.798740 | controller | Tuesday 24 February 2026 18:03:41 +0000 (0:00:00.251) 0:02:59.442 ****** 2026-02-24 18:03:41.838101 | controller | ok: [instance] 2026-02-24 18:03:41.882753 | controller | 2026-02-24 18:03:41.882836 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2026-02-24 18:03:41.882850 | controller | Tuesday 24 February 2026 18:03:41 +0000 (0:00:00.039) 0:02:59.481 ****** 2026-02-24 18:03:41.882866 | controller | skipping: [instance] 2026-02-24 18:03:41.941941 | controller | 2026-02-24 18:03:41.941992 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2026-02-24 18:03:41.942002 | controller | Tuesday 24 February 2026 18:03:41 +0000 (0:00:00.044) 0:02:59.526 ****** 2026-02-24 18:03:41.942014 | controller | 2026-02-24 18:03:42.036342 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2026-02-24 18:03:42.036386 | controller | Tuesday 24 February 2026 18:03:41 +0000 (0:00:00.059) 0:02:59.586 ****** 2026-02-24 18:03:42.036400 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2026-02-24 18:03:42.272635 | controller | 2026-02-24 18:03:42.272690 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2026-02-24 18:03:42.272702 | controller | Tuesday 24 February 2026 18:03:42 +0000 (0:00:00.094) 0:02:59.680 ****** 2026-02-24 18:03:42.272724 | controller | ok: [instance] 2026-02-24 18:03:42.570880 | controller | 2026-02-24 18:03:42.570924 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2026-02-24 18:03:42.570934 | controller | Tuesday 24 February 2026 18:03:42 +0000 (0:00:00.235) 0:02:59.916 ****** 2026-02-24 18:03:42.570948 | controller | ok: [instance] 2026-02-24 18:03:43.034491 | controller | 2026-02-24 18:03:43.034550 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2026-02-24 18:03:43.034559 | controller | Tuesday 24 February 2026 18:03:42 +0000 (0:00:00.298) 0:03:00.214 ****** 2026-02-24 18:03:43.034571 | controller | changed: [instance] 2026-02-24 18:03:44.143796 | controller | 2026-02-24 18:03:44.143836 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2026-02-24 18:03:44.143850 | controller | Tuesday 24 February 2026 18:03:43 +0000 (0:00:00.463) 0:03:00.678 ****** 2026-02-24 18:03:44.143861 | controller | changed: [instance] 2026-02-24 18:03:44.179721 | controller | 2026-02-24 18:03:44.179742 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2026-02-24 18:03:44.179749 | controller | Tuesday 24 February 2026 18:03:44 +0000 (0:00:01.108) 0:03:01.786 ****** 2026-02-24 18:03:44.179758 | controller | skipping: [instance] 2026-02-24 18:03:44.239049 | controller | 2026-02-24 18:03:44.239074 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2026-02-24 18:03:44.239081 | controller | Tuesday 24 February 2026 18:03:44 +0000 (0:00:00.037) 0:03:01.823 ****** 2026-02-24 18:03:44.239092 | controller | skipping: [instance] 2026-02-24 18:03:44.304416 | controller | 2026-02-24 18:03:44.304444 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2026-02-24 18:03:44.304452 | controller | Tuesday 24 February 2026 18:03:44 +0000 (0:00:00.059) 0:03:01.883 ****** 2026-02-24 18:03:44.304461 | controller | skipping: [instance] 2026-02-24 18:03:44.367719 | controller | 2026-02-24 18:03:44.367737 | controller | TASK [Create VBMC entity] ****************************************************** 2026-02-24 18:03:44.367753 | controller | Tuesday 24 February 2026 18:03:44 +0000 (0:00:00.065) 0:03:01.948 ****** 2026-02-24 18:03:44.367761 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 18:03:44.367933 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 18:03:44.368026 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 18:03:44.368210 | controller | skipping: [instance] 2026-02-24 18:03:44.368390 | controller | 2026-02-24 18:03:44.368478 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2026-02-24 18:03:44.368583 | controller | Tuesday 24 February 2026 18:03:44 +0000 (0:00:00.063) 0:03:02.012 ****** 2026-02-24 18:03:44.654234 | controller | ok: [instance] 2026-02-24 18:03:45.062505 | controller | 2026-02-24 18:03:45.062568 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2026-02-24 18:03:45.062577 | controller | Tuesday 24 February 2026 18:03:44 +0000 (0:00:00.285) 0:03:02.297 ****** 2026-02-24 18:03:45.062587 | controller | changed: [instance] 2026-02-24 18:03:45.105840 | controller | 2026-02-24 18:03:45.105869 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2026-02-24 18:03:45.105877 | controller | Tuesday 24 February 2026 18:03:45 +0000 (0:00:00.408) 0:03:02.706 ****** 2026-02-24 18:03:45.105887 | controller | skipping: [instance] 2026-02-24 18:03:45.147328 | controller | 2026-02-24 18:03:45.147352 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2026-02-24 18:03:45.147359 | controller | Tuesday 24 February 2026 18:03:45 +0000 (0:00:00.043) 0:03:02.749 ****** 2026-02-24 18:03:45.147368 | controller | skipping: [instance] 2026-02-24 18:03:45.192784 | controller | 2026-02-24 18:03:45.192810 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2026-02-24 18:03:45.192817 | controller | Tuesday 24 February 2026 18:03:45 +0000 (0:00:00.041) 0:03:02.791 ****** 2026-02-24 18:03:45.192826 | controller | skipping: [instance] 2026-02-24 18:03:46.179642 | controller | 2026-02-24 18:03:46.179707 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2026-02-24 18:03:46.179717 | controller | Tuesday 24 February 2026 18:03:45 +0000 (0:00:00.045) 0:03:02.836 ****** 2026-02-24 18:03:46.179730 | controller | changed: [instance] 2026-02-24 18:03:46.179751 | controller | 2026-02-24 18:03:46.179757 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2026-02-24 18:03:46.179764 | controller | Tuesday 24 February 2026 18:03:46 +0000 (0:00:00.980) 0:03:03.817 ****** 2026-02-24 18:03:46.961689 | controller | changed: [instance] 2026-02-24 18:03:46.961846 | controller | 2026-02-24 18:03:46.961892 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2026-02-24 18:03:47.017076 | controller | Tuesday 24 February 2026 18:03:46 +0000 (0:00:00.788) 0:03:04.605 ****** 2026-02-24 18:03:47.017098 | controller | skipping: [instance] 2026-02-24 18:03:47.091665 | controller | 2026-02-24 18:03:47.091691 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2026-02-24 18:03:47.091712 | controller | Tuesday 24 February 2026 18:03:47 +0000 (0:00:00.055) 0:03:04.660 ****** 2026-02-24 18:03:47.091725 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2026-02-24 18:03:47.142908 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2026-02-24 18:03:47.142928 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2026-02-24 18:03:47.142936 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2026-02-24 18:03:47.142942 | controller | 2026-02-24 18:03:47.142948 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2026-02-24 18:03:47.142954 | controller | Tuesday 24 February 2026 18:03:47 +0000 (0:00:00.074) 0:03:04.735 ****** 2026-02-24 18:03:47.142963 | controller | skipping: [instance] 2026-02-24 18:03:47.187032 | controller | 2026-02-24 18:03:47.187052 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2026-02-24 18:03:47.187066 | controller | Tuesday 24 February 2026 18:03:47 +0000 (0:00:00.051) 0:03:04.787 ****** 2026-02-24 18:03:47.187079 | controller | skipping: [instance] 2026-02-24 18:03:47.230480 | controller | 2026-02-24 18:03:47.230500 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2026-02-24 18:03:47.230525 | controller | Tuesday 24 February 2026 18:03:47 +0000 (0:00:00.044) 0:03:04.831 ****** 2026-02-24 18:03:47.230539 | controller | skipping: [instance] 2026-02-24 18:03:47.274719 | controller | 2026-02-24 18:03:47.274778 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2026-02-24 18:03:47.274787 | controller | Tuesday 24 February 2026 18:03:47 +0000 (0:00:00.043) 0:03:04.874 ****** 2026-02-24 18:03:47.274800 | controller | skipping: [instance] 2026-02-24 18:03:47.274828 | controller | 2026-02-24 18:03:47.274835 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2026-02-24 18:03:47.274842 | controller | Tuesday 24 February 2026 18:03:47 +0000 (0:00:00.044) 0:03:04.918 ****** 2026-02-24 18:03:48.008780 | controller | changed: [instance] 2026-02-24 18:03:48.044498 | controller | 2026-02-24 18:03:48.044556 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2026-02-24 18:03:48.044566 | controller | Tuesday 24 February 2026 18:03:48 +0000 (0:00:00.733) 0:03:05.652 ****** 2026-02-24 18:03:48.044577 | controller | skipping: [instance] 2026-02-24 18:03:48.086094 | controller | 2026-02-24 18:03:48.086116 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2026-02-24 18:03:48.086126 | controller | Tuesday 24 February 2026 18:03:48 +0000 (0:00:00.036) 0:03:05.688 ****** 2026-02-24 18:03:48.086137 | controller | skipping: [instance] 2026-02-24 18:03:48.124758 | controller | 2026-02-24 18:03:48.124811 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2026-02-24 18:03:48.124822 | controller | Tuesday 24 February 2026 18:03:48 +0000 (0:00:00.041) 0:03:05.730 ****** 2026-02-24 18:03:48.124836 | controller | skipping: [instance] 2026-02-24 18:03:48.163118 | controller | 2026-02-24 18:03:48.163139 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2026-02-24 18:03:48.163147 | controller | Tuesday 24 February 2026 18:03:48 +0000 (0:00:00.038) 0:03:05.768 ****** 2026-02-24 18:03:48.163156 | controller | skipping: [instance] 2026-02-24 18:03:48.163326 | controller | 2026-02-24 18:03:48.163588 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2026-02-24 18:03:48.163819 | controller | Tuesday 24 February 2026 18:03:48 +0000 (0:00:00.038) 0:03:05.807 ****** 2026-02-24 18:03:48.201203 | controller | skipping: [instance] 2026-02-24 18:03:48.201308 | controller | 2026-02-24 18:03:48.201425 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2026-02-24 18:03:48.201538 | controller | Tuesday 24 February 2026 18:03:48 +0000 (0:00:00.038) 0:03:05.845 ****** 2026-02-24 18:03:48.238323 | controller | skipping: [instance] 2026-02-24 18:03:48.238468 | controller | 2026-02-24 18:03:48.238644 | controller | TASK [openshift_login : Assert files exist] ************************************ 2026-02-24 18:03:48.238812 | controller | Tuesday 24 February 2026 18:03:48 +0000 (0:00:00.037) 0:03:05.882 ****** 2026-02-24 18:03:48.277534 | controller | skipping: [instance] 2026-02-24 18:03:48.277677 | controller | 2026-02-24 18:03:48.277830 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2026-02-24 18:03:48.277971 | controller | Tuesday 24 February 2026 18:03:48 +0000 (0:00:00.038) 0:03:05.921 ****** 2026-02-24 18:03:48.314141 | controller | skipping: [instance] 2026-02-24 18:03:48.314168 | controller | 2026-02-24 18:03:48.314181 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2026-02-24 18:03:48.314327 | controller | Tuesday 24 February 2026 18:03:48 +0000 (0:00:00.036) 0:03:05.958 ****** 2026-02-24 18:03:48.351130 | controller | skipping: [instance] 2026-02-24 18:03:48.351317 | controller | 2026-02-24 18:03:48.351410 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2026-02-24 18:03:48.351536 | controller | Tuesday 24 February 2026 18:03:48 +0000 (0:00:00.037) 0:03:05.995 ****** 2026-02-24 18:03:48.400693 | controller | skipping: [instance] 2026-02-24 18:03:48.400842 | controller | 2026-02-24 18:03:48.400979 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2026-02-24 18:03:48.401108 | controller | Tuesday 24 February 2026 18:03:48 +0000 (0:00:00.049) 0:03:06.045 ****** 2026-02-24 18:03:48.438468 | controller | skipping: [instance] 2026-02-24 18:03:48.438820 | controller | 2026-02-24 18:03:48.439080 | controller | TASK [reproducer : Configure Controller node] ********************************** 2026-02-24 18:03:48.439324 | controller | Tuesday 24 February 2026 18:03:48 +0000 (0:00:00.037) 0:03:06.082 ****** 2026-02-24 18:03:48.592824 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2026-02-24 18:03:48.593095 | controller | 2026-02-24 18:03:48.593348 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-24 18:03:48.593641 | controller | Tuesday 24 February 2026 18:03:48 +0000 (0:00:00.154) 0:03:06.237 ****** 2026-02-24 18:03:50.049428 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-24 18:03:50.049485 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-24 18:03:50.049494 | controller | 2026-02-24 18:03:50.049502 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2026-02-24 18:03:50.049589 | controller | Tuesday 24 February 2026 18:03:50 +0000 (0:00:01.455) 0:03:07.693 ****** 2026-02-24 18:03:50.074706 | controller | skipping: [instance] 2026-02-24 18:03:50.074946 | controller | 2026-02-24 18:03:50.074973 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2026-02-24 18:03:50.787099 | controller | Tuesday 24 February 2026 18:03:50 +0000 (0:00:00.025) 0:03:07.719 ****** 2026-02-24 18:03:50.787149 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:03:50.831491 | controller | 2026-02-24 18:03:50.831582 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2026-02-24 18:03:50.831598 | controller | Tuesday 24 February 2026 18:03:50 +0000 (0:00:00.711) 0:03:08.430 ****** 2026-02-24 18:03:50.831616 | controller | skipping: [instance] 2026-02-24 18:03:50.872913 | controller | 2026-02-24 18:03:50.872934 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2026-02-24 18:03:50.872941 | controller | Tuesday 24 February 2026 18:03:50 +0000 (0:00:00.044) 0:03:08.474 ****** 2026-02-24 18:03:50.872950 | controller | skipping: [instance] 2026-02-24 18:03:50.917062 | controller | 2026-02-24 18:03:50.917081 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2026-02-24 18:03:50.917089 | controller | Tuesday 24 February 2026 18:03:50 +0000 (0:00:00.041) 0:03:08.516 ****** 2026-02-24 18:03:50.917098 | controller | skipping: [instance] 2026-02-24 18:03:50.965298 | controller | 2026-02-24 18:03:50.965322 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2026-02-24 18:03:50.965329 | controller | Tuesday 24 February 2026 18:03:50 +0000 (0:00:00.044) 0:03:08.561 ****** 2026-02-24 18:03:50.965338 | controller | skipping: [instance] 2026-02-24 18:03:51.005590 | controller | 2026-02-24 18:03:51.005609 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2026-02-24 18:03:51.005617 | controller | Tuesday 24 February 2026 18:03:50 +0000 (0:00:00.048) 0:03:08.609 ****** 2026-02-24 18:03:51.005626 | controller | skipping: [instance] 2026-02-24 18:03:51.044101 | controller | 2026-02-24 18:03:51.044165 | controller | TASK [reproducer : Install repos] ********************************************** 2026-02-24 18:03:51.044175 | controller | Tuesday 24 February 2026 18:03:51 +0000 (0:00:00.040) 0:03:08.649 ****** 2026-02-24 18:03:51.044188 | controller | skipping: [instance] 2026-02-24 18:03:51.044206 | controller | 2026-02-24 18:03:51.044212 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2026-02-24 18:03:51.044219 | controller | Tuesday 24 February 2026 18:03:51 +0000 (0:00:00.038) 0:03:08.688 ****** 2026-02-24 18:03:51.085652 | controller | skipping: [instance] 2026-02-24 18:03:51.085727 | controller | 2026-02-24 18:03:51.085811 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2026-02-24 18:03:51.085921 | controller | Tuesday 24 February 2026 18:03:51 +0000 (0:00:00.041) 0:03:08.730 ****** 2026-02-24 18:03:51.125938 | controller | skipping: [instance] 2026-02-24 18:03:52.347861 | controller | 2026-02-24 18:03:52.347910 | controller | TASK [reproducer : Install some tools] ***************************************** 2026-02-24 18:03:52.347919 | controller | Tuesday 24 February 2026 18:03:51 +0000 (0:00:00.039) 0:03:08.770 ****** 2026-02-24 18:03:52.347932 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:03:53.510206 | controller | 2026-02-24 18:03:53.510256 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2026-02-24 18:03:53.510265 | controller | Tuesday 24 February 2026 18:03:52 +0000 (0:00:01.221) 0:03:09.991 ****** 2026-02-24 18:03:53.510276 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:03:54.163058 | controller | 2026-02-24 18:03:54.163103 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2026-02-24 18:03:54.163112 | controller | Tuesday 24 February 2026 18:03:53 +0000 (0:00:01.162) 0:03:11.153 ****** 2026-02-24 18:03:54.163123 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:03:55.315273 | controller | 2026-02-24 18:03:55.315319 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2026-02-24 18:03:55.315328 | controller | Tuesday 24 February 2026 18:03:54 +0000 (0:00:00.651) 0:03:11.805 ****** 2026-02-24 18:03:55.315339 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:03:56.492956 | controller | 2026-02-24 18:03:56.493000 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2026-02-24 18:03:56.493013 | controller | Tuesday 24 February 2026 18:03:55 +0000 (0:00:01.152) 0:03:12.958 ****** 2026-02-24 18:03:56.493025 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-24 18:03:57.274991 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 18:03:57.275048 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 18:03:57.275057 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 18:03:57.275074 | controller | 2026-02-24 18:03:57.275081 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2026-02-24 18:03:57.275088 | controller | Tuesday 24 February 2026 18:03:56 +0000 (0:00:01.177) 0:03:14.136 ****** 2026-02-24 18:03:57.275102 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2026-02-24 18:03:59.385484 | controller | skipping: [instance] => (item=compute-0) 2026-02-24 18:03:59.385545 | controller | skipping: [instance] => (item=controller-0) 2026-02-24 18:03:59.385553 | controller | skipping: [instance] => (item=crc-0) 2026-02-24 18:03:59.385559 | controller | 2026-02-24 18:03:59.385564 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2026-02-24 18:03:59.385571 | controller | Tuesday 24 February 2026 18:03:57 +0000 (0:00:00.779) 0:03:14.915 ****** 2026-02-24 18:03:59.385581 | controller | skipping: [instance] => (item=instance) 2026-02-24 18:04:00.049854 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2026-02-24 18:04:00.049905 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2026-02-24 18:04:00.049913 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2026-02-24 18:04:00.049919 | controller | 2026-02-24 18:04:00.049925 | controller | TASK [reproducer : Create kube directory] ************************************** 2026-02-24 18:04:00.049931 | controller | Tuesday 24 February 2026 18:03:59 +0000 (0:00:02.112) 0:03:17.028 ****** 2026-02-24 18:04:00.049941 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:00.049961 | controller | 2026-02-24 18:04:00.050025 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2026-02-24 18:04:00.050127 | controller | Tuesday 24 February 2026 18:04:00 +0000 (0:00:00.665) 0:03:17.693 ****** 2026-02-24 18:04:01.122621 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:02.200306 | controller | 2026-02-24 18:04:02.200374 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2026-02-24 18:04:02.200383 | controller | Tuesday 24 February 2026 18:04:01 +0000 (0:00:01.072) 0:03:18.766 ****** 2026-02-24 18:04:02.200405 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:02.200612 | controller | 2026-02-24 18:04:02.200783 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2026-02-24 18:04:02.200930 | controller | Tuesday 24 February 2026 18:04:02 +0000 (0:00:01.077) 0:03:19.844 ****** 2026-02-24 18:04:02.244024 | controller | skipping: [instance] 2026-02-24 18:04:02.244165 | controller | 2026-02-24 18:04:02.244298 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2026-02-24 18:04:02.244425 | controller | Tuesday 24 February 2026 18:04:02 +0000 (0:00:00.044) 0:03:19.888 ****** 2026-02-24 18:04:02.905100 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:02.905337 | controller | 2026-02-24 18:04:02.905532 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2026-02-24 18:04:02.905706 | controller | Tuesday 24 February 2026 18:04:02 +0000 (0:00:00.660) 0:03:20.549 ****** 2026-02-24 18:04:03.534090 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:03.534300 | controller | 2026-02-24 18:04:03.534448 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2026-02-24 18:04:03.534609 | controller | Tuesday 24 February 2026 18:04:03 +0000 (0:00:00.628) 0:03:21.178 ****** 2026-02-24 18:04:03.582579 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:03.582801 | controller | 2026-02-24 18:04:03.582985 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2026-02-24 18:04:03.583153 | controller | Tuesday 24 February 2026 18:04:03 +0000 (0:00:00.048) 0:03:21.226 ****** 2026-02-24 18:04:03.658079 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2026-02-24 18:04:03.658277 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2026-02-24 18:04:03.658444 | controller | 2026-02-24 18:04:03.658632 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-24 18:04:03.658800 | controller | Tuesday 24 February 2026 18:04:03 +0000 (0:00:00.075) 0:03:21.302 ****** 2026-02-24 18:04:03.716096 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 18:04:03.716307 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2026-02-24 18:04:03.716470 | controller | 2026-02-24 18:04:03.716665 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-24 18:04:03.716828 | controller | Tuesday 24 February 2026 18:04:03 +0000 (0:00:00.057) 0:03:21.360 ****** 2026-02-24 18:04:03.776410 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 18:04:03.776649 | controller | _secret_file: '' 2026-02-24 18:04:03.776811 | controller | 2026-02-24 18:04:03.776966 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-24 18:04:03.777100 | controller | Tuesday 24 February 2026 18:04:03 +0000 (0:00:00.060) 0:03:21.420 ****** 2026-02-24 18:04:03.837568 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 18:04:03.837737 | controller | _secret_content: my-default-location-place 2026-02-24 18:04:03.837861 | controller | 2026-02-24 18:04:03.837991 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-24 18:04:03.838115 | controller | Tuesday 24 February 2026 18:04:03 +0000 (0:00:00.061) 0:03:21.481 ****** 2026-02-24 18:04:03.888368 | controller | skipping: [instance] 2026-02-24 18:04:03.888508 | controller | 2026-02-24 18:04:03.888670 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-24 18:04:03.888816 | controller | Tuesday 24 February 2026 18:04:03 +0000 (0:00:00.051) 0:03:21.532 ****** 2026-02-24 18:04:03.939397 | controller | skipping: [instance] 2026-02-24 18:04:03.939563 | controller | 2026-02-24 18:04:03.939710 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-24 18:04:03.939846 | controller | Tuesday 24 February 2026 18:04:03 +0000 (0:00:00.050) 0:03:21.583 ****** 2026-02-24 18:04:03.998666 | controller | skipping: [instance] 2026-02-24 18:04:03.998875 | controller | 2026-02-24 18:04:03.999021 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-24 18:04:03.999153 | controller | Tuesday 24 February 2026 18:04:03 +0000 (0:00:00.058) 0:03:21.642 ****** 2026-02-24 18:04:05.026249 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:05.026495 | controller | 2026-02-24 18:04:05.026685 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2026-02-24 18:04:05.026856 | controller | Tuesday 24 February 2026 18:04:05 +0000 (0:00:01.027) 0:03:22.669 ****** 2026-02-24 18:04:05.088939 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 18:04:05.089091 | controller | _secret_dest: /home/zuul/ipmi-things 2026-02-24 18:04:05.089227 | controller | 2026-02-24 18:04:05.089362 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2026-02-24 18:04:05.089492 | controller | Tuesday 24 February 2026 18:04:05 +0000 (0:00:00.063) 0:03:22.733 ****** 2026-02-24 18:04:05.142153 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 18:04:05.142359 | controller | _secret_file: /tmp/ipmi-things 2026-02-24 18:04:05.142535 | controller | 2026-02-24 18:04:05.142687 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2026-02-24 18:04:05.142826 | controller | Tuesday 24 February 2026 18:04:05 +0000 (0:00:00.053) 0:03:22.786 ****** 2026-02-24 18:04:05.195036 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2026-02-24 18:04:05.195182 | controller | _secret_content: '' 2026-02-24 18:04:05.195302 | controller | 2026-02-24 18:04:05.195426 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2026-02-24 18:04:05.195576 | controller | Tuesday 24 February 2026 18:04:05 +0000 (0:00:00.053) 0:03:22.839 ****** 2026-02-24 18:04:05.258913 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2026-02-24 18:04:05.259053 | controller | msg: All assertions passed 2026-02-24 18:04:05.259170 | controller | 2026-02-24 18:04:05.259293 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2026-02-24 18:04:05.259440 | controller | Tuesday 24 February 2026 18:04:05 +0000 (0:00:00.063) 0:03:22.903 ****** 2026-02-24 18:04:05.919731 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:07.057629 | controller | 2026-02-24 18:04:07.057690 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2026-02-24 18:04:07.057698 | controller | Tuesday 24 February 2026 18:04:05 +0000 (0:00:00.659) 0:03:23.563 ****** 2026-02-24 18:04:07.057710 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:07.125099 | controller | 2026-02-24 18:04:07.125125 | controller | TASK [manage_secrets : Create file from content] ******************************* 2026-02-24 18:04:07.125133 | controller | Tuesday 24 February 2026 18:04:07 +0000 (0:00:01.137) 0:03:24.700 ****** 2026-02-24 18:04:07.125142 | controller | skipping: [instance] 2026-02-24 18:04:08.113166 | controller | 2026-02-24 18:04:08.113220 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2026-02-24 18:04:08.113229 | controller | Tuesday 24 February 2026 18:04:07 +0000 (0:00:00.068) 0:03:24.769 ****** 2026-02-24 18:04:08.113241 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:08.782390 | controller | 2026-02-24 18:04:08.782448 | controller | TASK [reproducer : Check if async file is still available] ********************* 2026-02-24 18:04:08.782456 | controller | Tuesday 24 February 2026 18:04:08 +0000 (0:00:00.987) 0:03:25.756 ****** 2026-02-24 18:04:08.782468 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:48.455439 | controller | 2026-02-24 18:04:48.455572 | controller | TASK [reproducer : Check package install status] ******************************* 2026-02-24 18:04:48.455585 | controller | Tuesday 24 February 2026 18:04:08 +0000 (0:00:00.669) 0:03:26.425 ****** 2026-02-24 18:04:48.455600 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2026-02-24 18:04:49.254451 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2026-02-24 18:04:49.254507 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2026-02-24 18:04:49.254535 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2026-02-24 18:04:49.254541 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2026-02-24 18:04:49.254546 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2026-02-24 18:04:49.254551 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2026-02-24 18:04:49.254557 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:49.254568 | controller | 2026-02-24 18:04:49.254574 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2026-02-24 18:04:49.254580 | controller | Tuesday 24 February 2026 18:04:48 +0000 (0:00:39.670) 0:04:06.096 ****** 2026-02-24 18:04:49.254591 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:52.346847 | controller | 2026-02-24 18:04:52.346900 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2026-02-24 18:04:52.346908 | controller | Tuesday 24 February 2026 18:04:49 +0000 (0:00:00.801) 0:04:06.897 ****** 2026-02-24 18:04:52.346920 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:52.397812 | controller | 2026-02-24 18:04:52.397851 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2026-02-24 18:04:52.397860 | controller | Tuesday 24 February 2026 18:04:52 +0000 (0:00:03.091) 0:04:09.989 ****** 2026-02-24 18:04:52.397871 | controller | skipping: [instance] 2026-02-24 18:04:52.446466 | controller | 2026-02-24 18:04:52.446495 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2026-02-24 18:04:52.446504 | controller | Tuesday 24 February 2026 18:04:52 +0000 (0:00:00.052) 0:04:10.042 ****** 2026-02-24 18:04:52.446533 | controller | skipping: [instance] 2026-02-24 18:04:53.267466 | controller | 2026-02-24 18:04:53.267528 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2026-02-24 18:04:53.267541 | controller | Tuesday 24 February 2026 18:04:52 +0000 (0:00:00.048) 0:04:10.090 ****** 2026-02-24 18:04:53.267553 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:53.911081 | controller | 2026-02-24 18:04:53.911137 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2026-02-24 18:04:53.911146 | controller | Tuesday 24 February 2026 18:04:53 +0000 (0:00:00.820) 0:04:10.911 ****** 2026-02-24 18:04:53.911159 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:54.248717 | controller | 2026-02-24 18:04:54.248760 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2026-02-24 18:04:54.248769 | controller | Tuesday 24 February 2026 18:04:53 +0000 (0:00:00.639) 0:04:11.550 ****** 2026-02-24 18:04:54.248780 | controller | changed: [instance] 2026-02-24 18:04:54.897935 | controller | 2026-02-24 18:04:54.897978 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2026-02-24 18:04:54.897987 | controller | Tuesday 24 February 2026 18:04:54 +0000 (0:00:00.341) 0:04:11.892 ****** 2026-02-24 18:04:54.897998 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:56.082128 | controller | 2026-02-24 18:04:56.082171 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2026-02-24 18:04:56.082180 | controller | Tuesday 24 February 2026 18:04:54 +0000 (0:00:00.649) 0:04:12.541 ****** 2026-02-24 18:04:56.082191 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:56.136224 | controller | 2026-02-24 18:04:56.136260 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 18:04:56.136270 | controller | Tuesday 24 February 2026 18:04:56 +0000 (0:00:01.184) 0:04:13.725 ****** 2026-02-24 18:04:56.136281 | controller | skipping: [instance] 2026-02-24 18:04:56.190683 | controller | 2026-02-24 18:04:56.190717 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 18:04:56.190725 | controller | Tuesday 24 February 2026 18:04:56 +0000 (0:00:00.054) 0:04:13.780 ****** 2026-02-24 18:04:56.190736 | controller | skipping: [instance] 2026-02-24 18:04:56.238234 | controller | 2026-02-24 18:04:56.238265 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2026-02-24 18:04:56.238273 | controller | Tuesday 24 February 2026 18:04:56 +0000 (0:00:00.054) 0:04:13.834 ****** 2026-02-24 18:04:56.238284 | controller | skipping: [instance] 2026-02-24 18:04:56.300549 | controller | 2026-02-24 18:04:56.300578 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2026-02-24 18:04:56.300587 | controller | Tuesday 24 February 2026 18:04:56 +0000 (0:00:00.047) 0:04:13.882 ****** 2026-02-24 18:04:56.300596 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:56.346399 | controller | 2026-02-24 18:04:56.346423 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2026-02-24 18:04:56.346432 | controller | Tuesday 24 February 2026 18:04:56 +0000 (0:00:00.062) 0:04:13.944 ****** 2026-02-24 18:04:56.346441 | controller | skipping: [instance] 2026-02-24 18:04:56.392180 | controller | 2026-02-24 18:04:56.392205 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2026-02-24 18:04:56.392214 | controller | Tuesday 24 February 2026 18:04:56 +0000 (0:00:00.045) 0:04:13.990 ****** 2026-02-24 18:04:56.392223 | controller | skipping: [instance] 2026-02-24 18:04:56.436747 | controller | 2026-02-24 18:04:56.436768 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2026-02-24 18:04:56.436776 | controller | Tuesday 24 February 2026 18:04:56 +0000 (0:00:00.045) 0:04:14.036 ****** 2026-02-24 18:04:56.436785 | controller | skipping: [instance] 2026-02-24 18:04:57.125768 | controller | 2026-02-24 18:04:57.125811 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2026-02-24 18:04:57.125820 | controller | Tuesday 24 February 2026 18:04:56 +0000 (0:00:00.044) 0:04:14.081 ****** 2026-02-24 18:04:57.125836 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:57.240889 | controller | 2026-02-24 18:04:57.240933 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2026-02-24 18:04:57.240942 | controller | Tuesday 24 February 2026 18:04:57 +0000 (0:00:00.688) 0:04:14.769 ****** 2026-02-24 18:04:57.240953 | controller | skipping: [instance] => (item=secret) 2026-02-24 18:04:58.529976 | controller | skipping: [instance] => (item=configmap) 2026-02-24 18:04:58.530016 | controller | skipping: [instance] => (item=pod) 2026-02-24 18:04:58.530024 | controller | skipping: [instance] => (item=service) 2026-02-24 18:04:58.530029 | controller | skipping: [instance] => (item=route) 2026-02-24 18:04:58.530035 | controller | skipping: [instance] 2026-02-24 18:04:58.530041 | controller | 2026-02-24 18:04:58.530047 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2026-02-24 18:04:58.530054 | controller | Tuesday 24 February 2026 18:04:57 +0000 (0:00:00.114) 0:04:14.883 ****** 2026-02-24 18:04:58.530064 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:59.681408 | controller | 2026-02-24 18:04:59.681445 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2026-02-24 18:04:59.681453 | controller | Tuesday 24 February 2026 18:04:58 +0000 (0:00:01.289) 0:04:16.173 ****** 2026-02-24 18:04:59.681463 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:04:59.729873 | controller | 2026-02-24 18:04:59.729914 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2026-02-24 18:04:59.729923 | controller | Tuesday 24 February 2026 18:04:59 +0000 (0:00:01.151) 0:04:17.325 ****** 2026-02-24 18:04:59.729934 | controller | skipping: [instance] 2026-02-24 18:04:59.777956 | controller | 2026-02-24 18:04:59.777993 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2026-02-24 18:04:59.778002 | controller | Tuesday 24 February 2026 18:04:59 +0000 (0:00:00.048) 0:04:17.373 ****** 2026-02-24 18:04:59.778021 | controller | skipping: [instance] 2026-02-24 18:04:59.861960 | controller | 2026-02-24 18:04:59.861985 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2026-02-24 18:04:59.861993 | controller | Tuesday 24 February 2026 18:04:59 +0000 (0:00:00.048) 0:04:17.422 ****** 2026-02-24 18:04:59.862003 | controller | skipping: [instance] => (item=secret) 2026-02-24 18:04:59.907046 | controller | skipping: [instance] => (item=configmap) 2026-02-24 18:04:59.907074 | controller | skipping: [instance] => (item=service) 2026-02-24 18:04:59.907081 | controller | skipping: [instance] => (item=route) 2026-02-24 18:04:59.907087 | controller | skipping: [instance] 2026-02-24 18:04:59.907093 | controller | 2026-02-24 18:04:59.907099 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2026-02-24 18:04:59.907104 | controller | Tuesday 24 February 2026 18:04:59 +0000 (0:00:00.083) 0:04:17.505 ****** 2026-02-24 18:04:59.907114 | controller | skipping: [instance] 2026-02-24 18:05:01.712061 | controller | 2026-02-24 18:05:01.712099 | controller | TASK [podman : Ensure podman is installed] ************************************* 2026-02-24 18:05:01.712107 | controller | Tuesday 24 February 2026 18:04:59 +0000 (0:00:00.045) 0:04:17.551 ****** 2026-02-24 18:05:01.712118 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:05:02.676149 | controller | 2026-02-24 18:05:02.676190 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2026-02-24 18:05:02.676199 | controller | Tuesday 24 February 2026 18:05:01 +0000 (0:00:01.804) 0:04:19.355 ****** 2026-02-24 18:05:02.676209 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:05:02.733160 | controller | 2026-02-24 18:05:02.733191 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2026-02-24 18:05:02.733199 | controller | Tuesday 24 February 2026 18:05:02 +0000 (0:00:00.964) 0:04:20.319 ****** 2026-02-24 18:05:02.733209 | controller | skipping: [instance] 2026-02-24 18:05:02.783327 | controller | 2026-02-24 18:05:02.783358 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2026-02-24 18:05:02.783367 | controller | Tuesday 24 February 2026 18:05:02 +0000 (0:00:00.057) 0:04:20.377 ****** 2026-02-24 18:05:02.783377 | controller | skipping: [instance] 2026-02-24 18:05:02.835714 | controller | 2026-02-24 18:05:02.835736 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2026-02-24 18:05:02.835744 | controller | Tuesday 24 February 2026 18:05:02 +0000 (0:00:00.050) 0:04:20.427 ****** 2026-02-24 18:05:02.835753 | controller | skipping: [instance] 2026-02-24 18:05:14.693137 | controller | 2026-02-24 18:05:14.693188 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2026-02-24 18:05:14.693199 | controller | Tuesday 24 February 2026 18:05:02 +0000 (0:00:00.052) 0:04:20.479 ****** 2026-02-24 18:05:14.693224 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:05:14.693243 | controller | 2026-02-24 18:05:14.693250 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2026-02-24 18:05:14.693257 | controller | Tuesday 24 February 2026 18:05:14 +0000 (0:00:11.856) 0:04:32.336 ****** 2026-02-24 18:05:16.327790 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:05:16.327878 | controller | 2026-02-24 18:05:16.327886 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2026-02-24 18:05:16.327896 | controller | Tuesday 24 February 2026 18:05:16 +0000 (0:00:01.634) 0:04:33.971 ****** 2026-02-24 18:05:17.829984 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2026-02-24 18:05:17.876178 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2026-02-24 18:05:17.876210 | controller | 2026-02-24 18:05:17.876219 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2026-02-24 18:05:17.876232 | controller | Tuesday 24 February 2026 18:05:17 +0000 (0:00:01.501) 0:04:35.473 ****** 2026-02-24 18:05:17.876242 | controller | skipping: [instance] 2026-02-24 18:05:18.573601 | controller | 2026-02-24 18:05:18.573669 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2026-02-24 18:05:18.573678 | controller | Tuesday 24 February 2026 18:05:17 +0000 (0:00:00.046) 0:04:35.520 ****** 2026-02-24 18:05:18.573698 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:05:18.627912 | controller | 2026-02-24 18:05:18.627960 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2026-02-24 18:05:18.627969 | controller | Tuesday 24 February 2026 18:05:18 +0000 (0:00:00.696) 0:04:36.217 ****** 2026-02-24 18:05:18.627981 | controller | skipping: [instance] 2026-02-24 18:05:18.681668 | controller | 2026-02-24 18:05:18.681717 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2026-02-24 18:05:18.681726 | controller | Tuesday 24 February 2026 18:05:18 +0000 (0:00:00.054) 0:04:36.271 ****** 2026-02-24 18:05:18.681738 | controller | skipping: [instance] 2026-02-24 18:05:18.736154 | controller | 2026-02-24 18:05:18.736195 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-24 18:05:18.736204 | controller | Tuesday 24 February 2026 18:05:18 +0000 (0:00:00.053) 0:04:36.325 ****** 2026-02-24 18:05:18.736214 | controller | skipping: [instance] 2026-02-24 18:05:18.778943 | controller | 2026-02-24 18:05:18.778970 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2026-02-24 18:05:18.778978 | controller | Tuesday 24 February 2026 18:05:18 +0000 (0:00:00.050) 0:04:36.376 ****** 2026-02-24 18:05:18.778988 | controller | skipping: [instance] 2026-02-24 18:05:18.916590 | controller | 2026-02-24 18:05:18.916651 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2026-02-24 18:05:18.916660 | controller | Tuesday 24 February 2026 18:05:18 +0000 (0:00:00.046) 0:04:36.423 ****** 2026-02-24 18:05:18.916672 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'}) 2026-02-24 18:05:20.215875 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'}) 2026-02-24 18:05:20.215946 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'}) 2026-02-24 18:05:20.215955 | controller | 2026-02-24 18:05:20.215961 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2026-02-24 18:05:20.215968 | controller | Tuesday 24 February 2026 18:05:18 +0000 (0:00:00.136) 0:04:36.560 ****** 2026-02-24 18:05:20.215981 | controller | changed: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:05:20.268572 | controller | 2026-02-24 18:05:20.268619 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2026-02-24 18:05:20.268627 | controller | Tuesday 24 February 2026 18:05:20 +0000 (0:00:01.299) 0:04:37.859 ****** 2026-02-24 18:05:20.268648 | controller | skipping: [instance] 2026-02-24 18:05:20.411448 | controller | 2026-02-24 18:05:20.411506 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2026-02-24 18:05:20.411533 | controller | Tuesday 24 February 2026 18:05:20 +0000 (0:00:00.053) 0:04:37.912 ****** 2026-02-24 18:05:20.411548 | controller | 2026-02-24 18:05:20.469680 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2026-02-24 18:05:20.469719 | controller | Tuesday 24 February 2026 18:05:20 +0000 (0:00:00.142) 0:04:38.055 ****** 2026-02-24 18:05:20.469733 | controller | ok: [instance -> controller-0(controller-0.instance)] 2026-02-24 18:05:20.533454 | controller | 2026-02-24 18:05:20.533506 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-24 18:05:20.533535 | controller | Tuesday 24 February 2026 18:05:20 +0000 (0:00:00.058) 0:04:38.113 ****** 2026-02-24 18:05:20.533549 | controller | skipping: [instance] 2026-02-24 18:05:20.582935 | controller | 2026-02-24 18:05:20.582982 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2026-02-24 18:05:20.582990 | controller | Tuesday 24 February 2026 18:05:20 +0000 (0:00:00.063) 0:04:38.177 ****** 2026-02-24 18:05:20.583004 | controller | skipping: [instance] 2026-02-24 18:05:21.560071 | controller | 2026-02-24 18:05:21.560132 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2026-02-24 18:05:21.560140 | controller | Tuesday 24 February 2026 18:05:20 +0000 (0:00:00.049) 0:04:38.226 ****** 2026-02-24 18:05:21.560153 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false 2026-02-24 18:05:21.570044 | controller | content: '' 2026-02-24 18:05:21.570063 | controller | elapsed: 0 2026-02-24 18:05:21.570071 | controller | msg: 'Status code was -1 and not [200]: Request failed: ' 2026-02-24 18:05:21.570078 | controller | redirected: false 2026-02-24 18:05:21.570084 | controller | status: -1 2026-02-24 18:05:21.570090 | controller | url: http://sushy.utility:8000/redfish/v1/Managers 2026-02-24 18:05:21.570099 | controller | 2026-02-24 18:05:21.801237 | controller | TASK [Create dnsmasq dir] ****************************************************** 2026-02-24 18:05:21.801261 | controller | Tuesday 24 February 2026 18:05:21 +0000 (0:00:00.987) 0:04:39.213 ****** 2026-02-24 18:05:21.801274 | controller | changed: [instance] 2026-02-24 18:05:22.099804 | controller | 2026-02-24 18:05:22.099860 | controller | TASK [Get journalctl in a file] ************************************************ 2026-02-24 18:05:22.099870 | controller | Tuesday 24 February 2026 18:05:21 +0000 (0:00:00.229) 0:04:39.443 ****** 2026-02-24 18:05:22.099883 | controller | changed: [instance] 2026-02-24 18:05:22.592774 | controller | 2026-02-24 18:05:22.592832 | controller | TASK [Dump journalctl output] ************************************************** 2026-02-24 18:05:22.592841 | controller | Tuesday 24 February 2026 18:05:22 +0000 (0:00:00.299) 0:04:39.742 ****** 2026-02-24 18:05:22.592854 | controller | changed: [instance] 2026-02-24 18:05:23.342063 | controller | 2026-02-24 18:05:23.342122 | controller | TASK [Copy all dnsmasq config] ************************************************* 2026-02-24 18:05:23.342137 | controller | Tuesday 24 February 2026 18:05:22 +0000 (0:00:00.493) 0:04:40.236 ****** 2026-02-24 18:05:23.342151 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2026-02-24 18:05:23.574027 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2026-02-24 18:05:23.574078 | controller | 2026-02-24 18:05:23.574086 | controller | TASK [Create log directory] **************************************************** 2026-02-24 18:05:23.574093 | controller | Tuesday 24 February 2026 18:05:23 +0000 (0:00:00.749) 0:04:40.985 ****** 2026-02-24 18:05:23.574105 | controller | changed: [instance] 2026-02-24 18:05:24.682999 | controller | 2026-02-24 18:05:24.683057 | controller | TASK [Sync logs from controller-0] ********************************************* 2026-02-24 18:05:24.683065 | controller | Tuesday 24 February 2026 18:05:23 +0000 (0:00:00.232) 0:04:41.217 ****** 2026-02-24 18:05:24.683078 | controller | changed: [instance] 2026-02-24 18:05:24.854913 | controller | 2026-02-24 18:05:24.854955 | controller | PLAY RECAP ********************************************************************* 2026-02-24 18:05:24.854965 | controller | instance : ok=438 changed=163 unreachable=0 failed=1 skipped=161 rescued=0 ignored=0 2026-02-24 18:05:24.854971 | controller | 2026-02-24 18:05:24.854976 | controller | Tuesday 24 February 2026 18:05:24 +0000 (0:00:01.104) 0:04:42.321 ****** 2026-02-24 18:05:24.854981 | controller | =============================================================================== 2026-02-24 18:05:24.854986 | controller | reproducer : Check package install status ------------------------------ 39.67s 2026-02-24 18:05:24.854991 | controller | libvirt_manager : Download base image ---------------------------------- 29.64s 2026-02-24 18:05:24.854996 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 26.26s 2026-02-24 18:05:24.855001 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 11.86s 2026-02-24 18:05:24.855006 | controller | libvirt_manager : Install packages required for using KVM --------------- 9.81s 2026-02-24 18:05:24.855011 | controller | ci_nmstate : Install required packages on localhost --------------------- 4.93s 2026-02-24 18:05:24.855016 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.70s 2026-02-24 18:05:24.855020 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.16s 2026-02-24 18:05:24.855025 | controller | sushy_emulator : Install required packages ------------------------------ 3.09s 2026-02-24 18:05:24.855036 | controller | reproducer : Inject SSH configuration ----------------------------------- 2.11s 2026-02-24 18:05:24.855040 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.10s 2026-02-24 18:05:24.855045 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s 2026-02-24 18:05:24.855050 | controller | libvirt_manager : Inject private key on hosts controller-0 -------------- 1.87s 2026-02-24 18:05:24.855055 | controller | podman : Ensure podman is installed ------------------------------------- 1.80s 2026-02-24 18:05:24.855060 | controller | ci_nmstate : Apply the desidered state on instance ---------------------- 1.64s 2026-02-24 18:05:24.855064 | controller | sushy_emulator : Create and start Sushy Emulator container -------------- 1.63s 2026-02-24 18:05:24.855069 | controller | ci_nmstate : Apply the desidered state on localhost --------------------- 1.60s 2026-02-24 18:05:24.855074 | controller | discover_latest_image : Get latest image -------------------------------- 1.54s 2026-02-24 18:05:24.855079 | controller | reproducer : Ensure directories exist ----------------------------------- 1.50s 2026-02-24 18:05:24.855084 | controller | reproducer : Ensure directories exist ----------------------------------- 1.46s 2026-02-24 18:05:24.855095 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml'] 2026-02-24 18:05:24.855547 | controller | WARNING An error occurred during the test sequence action: 'converge'. Cleaning up. 2026-02-24 18:05:24.864939 | controller | INFO Running crc_layout > cleanup 2026-02-24 18:05:24.865391 | controller | WARNING Skipping, cleanup playbook not configured. 2026-02-24 18:05:24.872876 | controller | INFO Running crc_layout > destroy 2026-02-24 18:05:24.873224 | controller | WARNING Skipping, instances are delegated. 2026-02-24 18:05:24.873585 | controller | INFO Pruning extra files from scenario ephemeral directory 2026-02-24 18:05:24.875237 | controller | INFO Writing /tmp/report.html report. 2026-02-24 18:05:25.181103 | [controller] Waiting on logger 2026-02-24 18:05:30.358116 | [controller] Waiting on logger 2026-02-24 18:05:40.790506 | [controller] Waiting on logger 2026-02-24 18:05:51.221937 | [controller] Waiting on logger 2026-02-24 18:05:54.991062 | [Zuul] Log Stream did not terminate 2026-02-24 18:05:54.991389 | controller | ERROR 2026-02-24 18:05:54.991544 | controller | { 2026-02-24 18:05:54.991603 | controller | "delta": "0:06:28.449524", 2026-02-24 18:05:54.991638 | controller | "end": "2026-02-24 18:05:24.953567", 2026-02-24 18:05:54.991669 | controller | "msg": "non-zero return code", 2026-02-24 18:05:54.991697 | controller | "rc": 1, 2026-02-24 18:05:54.991726 | controller | "start": "2026-02-24 17:58:56.504043" 2026-02-24 18:05:54.991753 | controller | } failure 2026-02-24 18:05:55.037418 | 2026-02-24 18:05:55.037469 | PLAY RECAP 2026-02-24 18:05:55.037510 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0 2026-02-24 18:05:55.037532 | 2026-02-24 18:05:55.096139 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2026-02-24 18:05:55.096885 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-24 18:05:55.592610 | 2026-02-24 18:05:55.592702 | PLAY [Run ci/playbooks/collect-logs.yml] 2026-02-24 18:05:55.611890 | 2026-02-24 18:05:55.611960 | TASK [Filter out host if needed] 2026-02-24 18:05:55.619926 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2026-02-24 18:05:55.624064 | 2026-02-24 18:05:55.624125 | TASK [Ensure file is present] 2026-02-24 18:05:56.038904 | controller | ok 2026-02-24 18:05:56.044434 | 2026-02-24 18:05:56.044500 | TASK [Manage molecule report file] 2026-02-24 18:05:56.064658 | [controller] Waiting on logger 2026-02-24 18:06:05.365836 | [controller] Waiting on logger 2026-02-24 18:06:15.797887 | [controller] Waiting on logger 2026-02-24 18:06:26.229903 | [controller] Waiting on logger 2026-02-24 18:06:26.447232 | [Zuul] Log Stream did not terminate 2026-02-24 18:06:26.447455 | controller | changed 2026-02-24 18:06:26.452118 | 2026-02-24 18:06:26.452174 | TASK [Check if we get ci-framework-data basedir] 2026-02-24 18:06:26.765901 | controller | ok 2026-02-24 18:06:26.771025 | 2026-02-24 18:06:26.771085 | TASK [Create ci-framework-data log directory for zuul] 2026-02-24 18:06:27.164235 | controller | changed 2026-02-24 18:06:27.170046 | 2026-02-24 18:06:27.170109 | TASK [Copy ci-framework interesting files] 2026-02-24 18:06:27.190093 | [controller] Waiting on logger 2026-02-24 18:06:39.670350 | [controller] Waiting on logger 2026-02-24 18:06:50.102311 | [controller] Waiting on logger 2026-02-24 18:06:57.533050 | [Zuul] Log Stream did not terminate 2026-02-24 18:06:57.533450 | controller | changed 2026-02-24 18:06:57.538726 | 2026-02-24 18:06:57.538786 | TASK [Get SELinux listing] 2026-02-24 18:06:57.557580 | [controller] Waiting on logger 2026-02-24 18:07:00.533852 | [controller] Waiting on logger 2026-02-24 18:07:02.666738 | controller | changed 2026-02-24 18:07:02.672540 | 2026-02-24 18:07:02.672620 | TASK [Generate log index] 2026-02-24 18:07:04.002188 | controller | changed 2026-02-24 18:07:04.007186 | 2026-02-24 18:07:04.007255 | TASK [Get some env related data] 2026-02-24 18:07:05.077967 | [controller] Waiting on logger 2026-02-24 18:07:15.752651 | controller | changed 2026-02-24 18:07:15.757975 | 2026-02-24 18:07:15.758038 | TASK [Generate list of logs to collect in home directory] 2026-02-24 18:07:16.118305 | controller | ok: All paths examined 2026-02-24 18:07:16.123359 | 2026-02-24 18:07:16.123418 | LOOP [Copy logs from home directory] 2026-02-24 18:07:16.149634 | [controller] Waiting on logger 2026-02-24 18:07:16.772186 | controller | changed: 2026-02-24 18:07:16.772259 | controller | { 2026-02-24 18:07:16.772306 | controller | "atime": 1763989167.9348345, 2026-02-24 18:07:16.772328 | controller | "ctime": 1763990251.6129293, 2026-02-24 18:07:16.772345 | controller | "dev": 64513, 2026-02-24 18:07:16.772362 | controller | "gid": 1000, 2026-02-24 18:07:16.772377 | controller | "gr_name": "zuul", 2026-02-24 18:07:16.772391 | controller | "inode": 5131423, 2026-02-24 18:07:16.772406 | controller | "isblk": false, 2026-02-24 18:07:16.772420 | controller | "ischr": false, 2026-02-24 18:07:16.772440 | controller | "isdir": false, 2026-02-24 18:07:16.772456 | controller | "isfifo": false, 2026-02-24 18:07:16.772471 | controller | "isgid": false, 2026-02-24 18:07:16.772485 | controller | "islnk": false, 2026-02-24 18:07:16.772498 | controller | "isreg": true, 2026-02-24 18:07:16.772512 | controller | "issock": false, 2026-02-24 18:07:16.772526 | controller | "isuid": false, 2026-02-24 18:07:16.772539 | controller | "mode": "0644", 2026-02-24 18:07:16.772555 | controller | "mtime": 1763990251.6129293, 2026-02-24 18:07:16.772570 | controller | "nlink": 1, 2026-02-24 18:07:16.772584 | controller | "path": "/home/zuul/crc-setup.log", 2026-02-24 18:07:16.772598 | controller | "pw_name": "zuul", 2026-02-24 18:07:16.772612 | controller | "rgrp": true, 2026-02-24 18:07:16.772625 | controller | "roth": true, 2026-02-24 18:07:16.772639 | controller | "rusr": true, 2026-02-24 18:07:16.772652 | controller | "size": 4108, 2026-02-24 18:07:16.772666 | controller | "uid": 1000, 2026-02-24 18:07:16.772680 | controller | "wgrp": false, 2026-02-24 18:07:16.772693 | controller | "woth": false, 2026-02-24 18:07:16.772707 | controller | "wusr": true, 2026-02-24 18:07:16.772720 | controller | "xgrp": false, 2026-02-24 18:07:16.772734 | controller | "xoth": false, 2026-02-24 18:07:16.772747 | controller | "xusr": false 2026-02-24 18:07:16.772760 | controller | } 2026-02-24 18:07:17.472731 | controller | changed: 2026-02-24 18:07:17.472800 | controller | { 2026-02-24 18:07:17.472827 | controller | "atime": 1763990253.7119775, 2026-02-24 18:07:17.472847 | controller | "ctime": 1763991032.5164254, 2026-02-24 18:07:17.472865 | controller | "dev": 64513, 2026-02-24 18:07:17.472882 | controller | "gid": 1000, 2026-02-24 18:07:17.472899 | controller | "gr_name": "zuul", 2026-02-24 18:07:17.472915 | controller | "inode": 5131425, 2026-02-24 18:07:17.472929 | controller | "isblk": false, 2026-02-24 18:07:17.472944 | controller | "ischr": false, 2026-02-24 18:07:17.472958 | controller | "isdir": false, 2026-02-24 18:07:17.472973 | controller | "isfifo": false, 2026-02-24 18:07:17.472988 | controller | "isgid": false, 2026-02-24 18:07:17.473002 | controller | "islnk": false, 2026-02-24 18:07:17.473016 | controller | "isreg": true, 2026-02-24 18:07:17.473030 | controller | "issock": false, 2026-02-24 18:07:17.473044 | controller | "isuid": false, 2026-02-24 18:07:17.473057 | controller | "mode": "0644", 2026-02-24 18:07:17.473072 | controller | "mtime": 1763991032.5164254, 2026-02-24 18:07:17.473089 | controller | "nlink": 1, 2026-02-24 18:07:17.473104 | controller | "path": "/home/zuul/crc-start.log", 2026-02-24 18:07:17.473120 | controller | "pw_name": "zuul", 2026-02-24 18:07:17.473136 | controller | "rgrp": true, 2026-02-24 18:07:17.473150 | controller | "roth": true, 2026-02-24 18:07:17.473164 | controller | "rusr": true, 2026-02-24 18:07:17.473183 | controller | "size": 4428, 2026-02-24 18:07:17.473200 | controller | "uid": 1000, 2026-02-24 18:07:17.473215 | controller | "wgrp": false, 2026-02-24 18:07:17.473241 | controller | "woth": false, 2026-02-24 18:07:17.473257 | controller | "wusr": true, 2026-02-24 18:07:17.473294 | controller | "xgrp": false, 2026-02-24 18:07:17.473314 | controller | "xoth": false, 2026-02-24 18:07:17.473329 | controller | "xusr": false 2026-02-24 18:07:17.473344 | controller | } 2026-02-24 18:07:18.115060 | controller | changed: 2026-02-24 18:07:18.115145 | controller | { 2026-02-24 18:07:18.115172 | controller | "atime": 1771955918.145685, 2026-02-24 18:07:18.115192 | controller | "ctime": 1771955934.1715198, 2026-02-24 18:07:18.115210 | controller | "dev": 64513, 2026-02-24 18:07:18.115239 | controller | "gid": 1000, 2026-02-24 18:07:18.115257 | controller | "gr_name": "zuul", 2026-02-24 18:07:18.115295 | controller | "inode": 4958989, 2026-02-24 18:07:18.115314 | controller | "isblk": false, 2026-02-24 18:07:18.115332 | controller | "ischr": false, 2026-02-24 18:07:18.115348 | controller | "isdir": false, 2026-02-24 18:07:18.115364 | controller | "isfifo": false, 2026-02-24 18:07:18.115379 | controller | "isgid": false, 2026-02-24 18:07:18.115396 | controller | "islnk": false, 2026-02-24 18:07:18.115411 | controller | "isreg": true, 2026-02-24 18:07:18.115425 | controller | "issock": false, 2026-02-24 18:07:18.115440 | controller | "isuid": false, 2026-02-24 18:07:18.115453 | controller | "mode": "0644", 2026-02-24 18:07:18.115467 | controller | "mtime": 1771955934.1715198, 2026-02-24 18:07:18.115481 | controller | "nlink": 1, 2026-02-24 18:07:18.115496 | controller | "path": "/home/zuul/ansible.log", 2026-02-24 18:07:18.115510 | controller | "pw_name": "zuul", 2026-02-24 18:07:18.115524 | controller | "rgrp": true, 2026-02-24 18:07:18.115540 | controller | "roth": true, 2026-02-24 18:07:18.115555 | controller | "rusr": true, 2026-02-24 18:07:18.115568 | controller | "size": 6749, 2026-02-24 18:07:18.115582 | controller | "uid": 1000, 2026-02-24 18:07:18.115596 | controller | "wgrp": false, 2026-02-24 18:07:18.115610 | controller | "woth": false, 2026-02-24 18:07:18.115624 | controller | "wusr": true, 2026-02-24 18:07:18.115637 | controller | "xgrp": false, 2026-02-24 18:07:18.115651 | controller | "xoth": false, 2026-02-24 18:07:18.115665 | controller | "xusr": false 2026-02-24 18:07:18.115678 | controller | } 2026-02-24 18:07:18.130603 | 2026-02-24 18:07:18.130706 | TASK [Copy crio stats log file] 2026-02-24 18:07:18.144715 | controller | skipping: Conditional result was False 2026-02-24 18:07:18.150158 | 2026-02-24 18:07:18.150251 | TASK [Get SELinux related data] 2026-02-24 18:07:19.221736 | [controller] Waiting on logger 2026-02-24 18:07:29.653837 | [controller] Waiting on logger 2026-02-24 18:07:40.085980 | [controller] Waiting on logger 2026-02-24 18:07:48.493511 | [Zuul] Log Stream did not terminate 2026-02-24 18:07:48.493697 | controller | ERROR 2026-02-24 18:07:48.493783 | controller | { 2026-02-24 18:07:48.493810 | controller | "delta": "0:00:00.010844", 2026-02-24 18:07:48.493830 | controller | "end": "2026-02-24 18:07:18.467854", 2026-02-24 18:07:48.493848 | controller | "msg": "non-zero return code", 2026-02-24 18:07:48.493864 | controller | "rc": 1, 2026-02-24 18:07:48.493879 | controller | "start": "2026-02-24 18:07:18.457010" 2026-02-24 18:07:48.493894 | controller | } 2026-02-24 18:07:48.493912 | controller | ERROR: Ignoring Errors 2026-02-24 18:07:48.498790 | 2026-02-24 18:07:48.498847 | TASK [Create system configuration directory] 2026-02-24 18:07:48.790041 | controller | changed 2026-02-24 18:07:48.794722 | 2026-02-24 18:07:48.794783 | TASK [Get some of the system configurations] 2026-02-24 18:07:49.429955 | [controller] Waiting on logger 2026-02-24 18:07:53.820506 | controller | changed 2026-02-24 18:07:53.825435 | 2026-02-24 18:07:53.825499 | TASK [Copy generated documentation if available] 2026-02-24 18:07:53.838579 | controller | skipping: Conditional result was False 2026-02-24 18:07:53.843649 | 2026-02-24 18:07:53.843710 | TASK [Copy generated AsciiDoc documentation if available] 2026-02-24 18:07:53.856161 | controller | skipping: Conditional result was False 2026-02-24 18:07:53.861156 | 2026-02-24 18:07:53.861226 | TASK [Compress logs bigger than 2MB] 2026-02-24 18:07:53.883566 | [controller] Waiting on logger 2026-02-24 18:08:06.326040 | [controller] Waiting on logger 2026-02-24 18:08:16.757997 | [controller] Waiting on logger 2026-02-24 18:08:24.171521 | [Zuul] Log Stream did not terminate 2026-02-24 18:08:24.171810 | controller | changed 2026-02-24 18:08:24.177393 | 2026-02-24 18:08:24.177454 | TASK [Copy files from workspace on node] 2026-02-24 18:08:24.195570 | controller | ok 2026-02-24 18:08:24.217245 | 2026-02-24 18:08:24.217329 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-24 18:08:24.240789 | controller | skipping: Conditional result was False 2026-02-24 18:08:24.246950 | 2026-02-24 18:08:24.247018 | TASK [fetch-output : Set log path for single node] 2026-02-24 18:08:24.276841 | controller | ok 2026-02-24 18:08:24.281799 | 2026-02-24 18:08:24.281864 | LOOP [fetch-output : Ensure local output dirs] 2026-02-24 18:08:24.498055 | controller -> localhost | ok: "/var/lib/zuul/builds/d1e06e3806db48cb95366f6005930d4f/work/logs" 2026-02-24 18:08:24.498388 | controller -> localhost | changed: All items complete 2026-02-24 18:08:24.498422 | 2026-02-24 18:08:24.673429 | controller -> localhost | changed: "/var/lib/zuul/builds/d1e06e3806db48cb95366f6005930d4f/work/artifacts" 2026-02-24 18:08:24.849429 | controller -> localhost | changed: "/var/lib/zuul/builds/d1e06e3806db48cb95366f6005930d4f/work/docs" 2026-02-24 18:08:24.865695 | 2026-02-24 18:08:24.865799 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-24 18:08:25.604209 | controller | changed: 2026-02-24 18:08:25.604501 | controller | .d..t...... ./ 2026-02-24 18:08:25.604534 | controller | >f+++++++++ README.html 2026-02-24 18:08:25.604558 | controller | >f+++++++++ ansible-execution.log 2026-02-24 18:08:25.604579 | controller | >f+++++++++ ansible.log 2026-02-24 18:08:25.604599 | controller | >f+++++++++ crc-setup.log 2026-02-24 18:08:25.604618 | controller | >f+++++++++ crc-start.log 2026-02-24 18:08:25.604635 | controller | >f+++++++++ dmesg.log 2026-02-24 18:08:25.604653 | controller | >f+++++++++ installed-pkgs.log 2026-02-24 18:08:25.604671 | controller | >f+++++++++ python.log 2026-02-24 18:08:25.604689 | controller | >f+++++++++ registries.conf 2026-02-24 18:08:25.604706 | controller | >f+++++++++ report.html 2026-02-24 18:08:25.604723 | controller | >f+++++++++ selinux-denials.log 2026-02-24 18:08:25.604739 | controller | >f+++++++++ selinux-listing.log 2026-02-24 18:08:25.604755 | controller | cd+++++++++ ci-framework-data/ 2026-02-24 18:08:25.604771 | controller | cd+++++++++ ci-framework-data/artifacts/ 2026-02-24 18:08:25.604787 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2026-02-24 18:08:25.604804 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2026-02-24 18:08:25.604820 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2026-02-24 18:08:25.604836 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2026-02-24 18:08:25.604852 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2026-02-24 18:08:25.604868 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2026-02-24 18:08:25.604884 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2026-02-24 18:08:25.604902 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2026-02-24 18:08:25.604919 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2026-02-24 18:08:25.604935 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2026-02-24 18:08:25.604952 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2026-02-24 18:08:25.604974 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:9f:d9:f3 2026-02-24 18:08:25.604993 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:43:a0:3c 2026-02-24 18:08:25.605010 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:cc:97:ab 2026-02-24 18:08:25.605027 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:ae:47:11 2026-02-24 18:08:25.605043 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:6b:22:d8 2026-02-24 18:08:25.605058 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:1e:f2:bf 2026-02-24 18:08:25.605075 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2026-02-24 18:08:25.605091 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2026-02-24 18:08:25.605107 | controller | cd+++++++++ ci-framework-data/logs/ 2026-02-24 18:08:25.605123 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2026-02-24 18:08:25.605138 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2026-02-24 18:08:25.605154 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2026-02-24 18:08:25.605184 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2026-02-24 18:08:25.605202 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2026-02-24 18:08:25.605220 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2026-02-24 18:08:25.605237 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2026-02-24 18:08:25.605254 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2026-02-24 18:08:25.605306 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2026-02-24 18:08:25.605329 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2026-02-24 18:08:25.605347 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2026-02-24 18:08:25.605365 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2026-02-24 18:08:25.605381 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2026-02-24 18:08:25.605398 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2026-02-24 18:08:25.605417 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2026-02-24 18:08:25.605435 | controller | cd+++++++++ registries.conf.d/ 2026-02-24 18:08:25.605452 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2026-02-24 18:08:25.605469 | controller | cd+++++++++ system-config/ 2026-02-24 18:08:25.605486 | controller | cd+++++++++ system-config/libvirt/ 2026-02-24 18:08:25.605502 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2026-02-24 18:08:25.605518 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2026-02-24 18:08:25.605534 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2026-02-24 18:08:25.605550 | controller | >f+++++++++ system-config/libvirt/network.conf 2026-02-24 18:08:25.605566 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2026-02-24 18:08:25.605582 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2026-02-24 18:08:25.605598 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2026-02-24 18:08:25.605614 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2026-02-24 18:08:25.605630 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2026-02-24 18:08:25.605649 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2026-02-24 18:08:25.605667 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2026-02-24 18:08:25.605683 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2026-02-24 18:08:25.605699 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2026-02-24 18:08:25.605715 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2026-02-24 18:08:25.605731 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2026-02-24 18:08:25.605746 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2026-02-24 18:08:26.086828 | controller | changed: .d..t...... ./ 2026-02-24 18:08:26.577962 | controller | changed: .d..t...... ./ 2026-02-24 18:08:26.596696 | 2026-02-24 18:08:26.596801 | TASK [Return artifact to Zuul] 2026-02-24 18:08:26.638437 | controller | ok 2026-02-24 18:08:26.657232 | 2026-02-24 18:08:26.657309 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2026-02-24 18:08:26.657423 | 2026-02-24 18:08:26.657450 | PLAY RECAP 2026-02-24 18:08:26.657490 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2026-02-24 18:08:26.657510 | 2026-02-24 18:08:26.755303 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2026-02-24 18:08:26.756371 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-24 18:08:27.318757 | 2026-02-24 18:08:27.318908 | PLAY [all] 2026-02-24 18:08:27.336530 | 2026-02-24 18:08:27.336597 | TASK [include_role : fetch-output] 2026-02-24 18:08:27.368280 | controller | ok 2026-02-24 18:08:27.385249 | 2026-02-24 18:08:27.385347 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-24 18:08:27.431661 | controller | skipping: Conditional result was False 2026-02-24 18:08:27.437241 | 2026-02-24 18:08:27.437334 | TASK [fetch-output : Set log path for single node] 2026-02-24 18:08:27.466974 | controller | ok 2026-02-24 18:08:27.471842 | 2026-02-24 18:08:27.471911 | LOOP [fetch-output : Ensure local output dirs] 2026-02-24 18:08:27.804093 | controller -> localhost | ok: "/var/lib/zuul/builds/d1e06e3806db48cb95366f6005930d4f/work/logs" 2026-02-24 18:08:27.989099 | controller -> localhost | ok: "/var/lib/zuul/builds/d1e06e3806db48cb95366f6005930d4f/work/artifacts" 2026-02-24 18:08:28.174366 | controller -> localhost | ok: "/var/lib/zuul/builds/d1e06e3806db48cb95366f6005930d4f/work/docs" 2026-02-24 18:08:28.188638 | 2026-02-24 18:08:28.188833 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-24 18:08:28.864790 | controller | ok 2026-02-24 18:08:28.865118 | controller | ok: All items complete 2026-02-24 18:08:28.865148 | 2026-02-24 18:08:29.356620 | controller | ok 2026-02-24 18:08:29.848492 | controller | ok 2026-02-24 18:08:29.868712 | 2026-02-24 18:08:29.868878 | TASK [include_role : fetch-output-openshift] 2026-02-24 18:08:29.886309 | controller | skipping: Conditional result was False 2026-02-24 18:08:29.893104 | 2026-02-24 18:08:29.893200 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-02-24 18:08:30.244312 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.007466 2026-02-24 18:08:30.431795 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.009025 2026-02-24 18:08:30.460009 | 2026-02-24 18:08:30.460146 | PLAY [all] 2026-02-24 18:08:30.473726 | 2026-02-24 18:08:30.473793 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-02-24 18:08:31.016389 | controller | changed 2026-02-24 18:08:31.037193 | 2026-02-24 18:08:31.037513 | PLAY RECAP 2026-02-24 18:08:31.037581 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2026-02-24 18:08:31.037606 | 2026-02-24 18:08:31.156221 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2026-02-24 18:08:31.157394 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2026-02-24 18:08:31.720818 | 2026-02-24 18:08:31.720985 | PLAY [localhost] 2026-02-24 18:08:31.737672 | 2026-02-24 18:08:31.737755 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-02-24 18:08:32.051960 | localhost | changed 2026-02-24 18:08:32.056506 | 2026-02-24 18:08:32.056587 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-02-24 18:08:32.090991 | localhost | ok 2026-02-24 18:08:32.099469 | 2026-02-24 18:08:32.099539 | TASK [add-fileserver : Create SSH private key tempfile] 2026-02-24 18:08:32.403646 | localhost | changed 2026-02-24 18:08:32.409667 | 2026-02-24 18:08:32.409744 | TASK [add-fileserver : Create SSH private key from secret] 2026-02-24 18:08:32.966504 | localhost | changed 2026-02-24 18:08:32.971509 | 2026-02-24 18:08:32.971581 | TASK [add-fileserver : Add fileserver ssh key] 2026-02-24 18:08:33.293180 | localhost | Identity added: /var/lib/zuul/builds/d1e06e3806db48cb95366f6005930d4f/work/tmp/ansible.rdc6f909 (/var/lib/zuul/builds/d1e06e3806db48cb95366f6005930d4f/work/tmp/ansible.rdc6f909) 2026-02-24 18:08:33.293396 | localhost | ok: Runtime: 0:00:00.006973 2026-02-24 18:08:33.297613 | 2026-02-24 18:08:33.297685 | TASK [add-fileserver : Remove SSH private key from disk] 2026-02-24 18:08:33.507723 | localhost | ok: Runtime: 0:00:00.004082 2026-02-24 18:08:33.512309 | 2026-02-24 18:08:33.512378 | TASK [add-fileserver : Add fileserver to inventory] 2026-02-24 18:08:33.560325 | localhost | changed 2026-02-24 18:08:33.566016 | 2026-02-24 18:08:33.566129 | TASK [add-fileserver : Add fileserver server to known hosts] 2026-02-24 18:08:33.876650 | localhost | changed 2026-02-24 18:08:33.895789 | 2026-02-24 18:08:33.895861 | PLAY [localhost] 2026-02-24 18:08:33.906869 | 2026-02-24 18:08:33.906944 | TASK [Generate bulk log download script] 2026-02-24 18:08:33.924875 | localhost | ok 2026-02-24 18:08:33.936117 | 2026-02-24 18:08:33.936196 | TASK [local-log-download : Check API endpoint is defined] 2026-02-24 18:08:33.963135 | localhost | ok: All assertions passed 2026-02-24 18:08:33.967589 | 2026-02-24 18:08:33.967655 | TASK [local-log-download : Create download script] 2026-02-24 18:08:34.295187 | localhost -> localhost | changed 2026-02-24 18:08:34.303722 | 2026-02-24 18:08:34.303790 | TASK [Register quick-download link] 2026-02-24 18:08:34.320356 | localhost | ok 2026-02-24 18:08:34.352111 | 2026-02-24 18:08:34.352207 | PLAY [logserver.rdoproject.org] 2026-02-24 18:08:34.361135 | 2026-02-24 18:08:34.361204 | TASK [Set zuul-log-path fact] 2026-02-24 18:08:34.377338 | logserver.rdoproject.org | ok 2026-02-24 18:08:34.386096 | 2026-02-24 18:08:34.386171 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-24 18:08:34.412110 | logserver.rdoproject.org | ok 2026-02-24 18:08:34.417541 | 2026-02-24 18:08:34.417605 | TASK [upload-logs : Create log directories] 2026-02-24 18:08:36.246044 | logserver.rdoproject.org | changed 2026-02-24 18:08:36.248990 | 2026-02-24 18:08:36.249053 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-02-24 18:08:36.465193 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.004405 2026-02-24 18:08:36.469676 | 2026-02-24 18:08:36.469742 | TASK [upload-logs : Upload logs to log server] 2026-02-24 18:08:37.995813 | logserver.rdoproject.org | Output suppressed because no_log was given 2026-02-24 18:08:37.998366 | 2026-02-24 18:08:37.998428 | LOOP [upload-logs : Compress console log and json output] 2026-02-24 18:08:38.033330 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 18:08:38.040621 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 18:08:38.045940 | 2026-02-24 18:08:38.046007 | LOOP [upload-logs : Upload compressed console log and json output] 2026-02-24 18:08:38.077245 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 18:08:38.077485 | 2026-02-24 18:08:38.080232 | logserver.rdoproject.org | skipping: Conditional result was False 2026-02-24 18:08:38.092580 | 2026-02-24 18:08:38.092645 | LOOP [upload-logs : Upload console log and json output]