2025-12-04 13:39:37.639214 | Job console starting... 2025-12-04 13:39:37.849894 | Updating repositories 2025-12-04 13:39:38.566801 | Preparing job workspace 2025-12-04 13:39:45.865366 | Running Ansible setup... 2025-12-04 13:39:49.539726 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-12-04 13:39:50.049303 | 2025-12-04 13:39:50.049403 | PLAY [localhost] 2025-12-04 13:39:50.057843 | 2025-12-04 13:39:50.057933 | TASK [Gathering Facts] 2025-12-04 13:39:50.895096 | localhost | ok 2025-12-04 13:39:50.909578 | 2025-12-04 13:39:50.909724 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2025-12-04 13:39:51.230297 | localhost -> localhost | changed 2025-12-04 13:39:51.235555 | 2025-12-04 13:39:51.235621 | TASK [log-inventory : Copy ansible inventory to logs dir] 2025-12-04 13:39:51.918199 | localhost -> localhost | changed 2025-12-04 13:39:51.926425 | 2025-12-04 13:39:51.926509 | TASK [Setup log path fact] 2025-12-04 13:39:51.943319 | localhost | ok 2025-12-04 13:39:51.954237 | 2025-12-04 13:39:51.954307 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-12-04 13:39:51.981021 | localhost | ok 2025-12-04 13:39:51.988638 | 2025-12-04 13:39:51.988706 | TASK [emit-job-header : Print job information] 2025-12-04 13:39:52.015602 | # Job Information 2025-12-04 13:39:52.015711 | Ansible Version: 2.15.12 2025-12-04 13:39:52.015742 | Job: cifmw-molecule-reproducer 2025-12-04 13:39:52.015765 | Pipeline: github-check 2025-12-04 13:39:52.015785 | Executor: ibm-bm4-ze.softwarefactory-project.io 2025-12-04 13:39:52.015804 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3530 2025-12-04 13:39:52.015826 | Log URL (when completed): https://logserver.rdoproject.org/e88/rdoproject.org/e88577a964ae4ccc9a1175c8e14d229c/ 2025-12-04 13:39:52.015845 | Event ID: 75160b30-d116-11f0-9f66-4df63df6e1a7 2025-12-04 13:39:52.019252 | 2025-12-04 13:39:52.019319 | LOOP [emit-job-header : Print node information] 2025-12-04 13:39:52.112903 | localhost | ok: 2025-12-04 13:39:52.113063 | localhost | # Node Information 2025-12-04 13:39:52.113094 | localhost | Inventory Hostname: controller 2025-12-04 13:39:52.113121 | localhost | Hostname: np0005545669 2025-12-04 13:39:52.113144 | localhost | Username: zuul 2025-12-04 13:39:52.113166 | localhost | Distro: CentOS 9 2025-12-04 13:39:52.113185 | localhost | Provider: ibm-bm4-nodepool 2025-12-04 13:39:52.113204 | localhost | Region: regionOne 2025-12-04 13:39:52.113222 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2025-12-04 13:39:52.113240 | localhost | Product Name: OpenStack Compute 2025-12-04 13:39:52.113259 | localhost | Interface IP: 192.168.26.67 2025-12-04 13:39:52.133613 | 2025-12-04 13:39:52.133666 | PLAY [all] 2025-12-04 13:39:52.139212 | 2025-12-04 13:39:52.139269 | TASK [Gather network facts] 2025-12-04 13:39:52.563835 | controller | ok 2025-12-04 13:39:52.577723 | 2025-12-04 13:39:52.577786 | TASK [include_role : start-zuul-console] 2025-12-04 13:39:52.596139 | controller | ok 2025-12-04 13:39:52.607034 | 2025-12-04 13:39:52.607096 | TASK [start-zuul-console : Start zuul_console daemon.] 2025-12-04 13:39:52.990113 | controller | ok 2025-12-04 13:39:52.998368 | 2025-12-04 13:39:52.998443 | TASK [include_role : add-build-sshkey] 2025-12-04 13:39:53.015715 | controller | ok 2025-12-04 13:39:53.027947 | 2025-12-04 13:39:53.028012 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2025-12-04 13:39:53.223879 | controller -> localhost | ok 2025-12-04 13:39:53.229223 | 2025-12-04 13:39:53.229287 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2025-12-04 13:39:53.248123 | controller | ok 2025-12-04 13:39:53.260627 | controller | included: /var/lib/zuul/builds/e88577a964ae4ccc9a1175c8e14d229c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2025-12-04 13:39:53.266466 | 2025-12-04 13:39:53.266533 | TASK [add-build-sshkey : Create Temp SSH key] 2025-12-04 13:39:53.669686 | controller -> localhost | Generating public/private rsa key pair. 2025-12-04 13:39:53.669877 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/e88577a964ae4ccc9a1175c8e14d229c/work/e88577a964ae4ccc9a1175c8e14d229c_id_rsa. 2025-12-04 13:39:53.669946 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/e88577a964ae4ccc9a1175c8e14d229c/work/e88577a964ae4ccc9a1175c8e14d229c_id_rsa.pub. 2025-12-04 13:39:53.669979 | controller -> localhost | The key fingerprint is: 2025-12-04 13:39:53.670003 | controller -> localhost | SHA256:RxdGfM1ZEXb/Xl+3WwNx0PlXfuv+EWw1Wmh3U155xuI zuul-build-sshkey 2025-12-04 13:39:53.670025 | controller -> localhost | The key's randomart image is: 2025-12-04 13:39:53.670045 | controller -> localhost | +---[RSA 3072]----+ 2025-12-04 13:39:53.670065 | controller -> localhost | | o+..B%| 2025-12-04 13:39:53.670084 | controller -> localhost | | ...**%| 2025-12-04 13:39:53.670103 | controller -> localhost | | . .* XO| 2025-12-04 13:39:53.670122 | controller -> localhost | | . .. E @| 2025-12-04 13:39:53.670141 | controller -> localhost | | S . o +O| 2025-12-04 13:39:53.670159 | controller -> localhost | | . ooB| 2025-12-04 13:39:53.670177 | controller -> localhost | | .++| 2025-12-04 13:39:53.670199 | controller -> localhost | | .=| 2025-12-04 13:39:53.670218 | controller -> localhost | | .oo| 2025-12-04 13:39:53.670237 | controller -> localhost | +----[SHA256]-----+ 2025-12-04 13:39:53.670281 | controller -> localhost | ok: Runtime: 0:00:00.056678 2025-12-04 13:39:53.680573 | 2025-12-04 13:39:53.680637 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2025-12-04 13:39:53.702952 | controller | ok 2025-12-04 13:39:53.715444 | controller | included: /var/lib/zuul/builds/e88577a964ae4ccc9a1175c8e14d229c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2025-12-04 13:39:53.723708 | 2025-12-04 13:39:53.723793 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2025-12-04 13:39:53.737796 | controller | skipping: Conditional result was False 2025-12-04 13:39:53.744061 | 2025-12-04 13:39:53.744152 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2025-12-04 13:39:54.211242 | controller | changed 2025-12-04 13:39:54.216193 | 2025-12-04 13:39:54.216285 | TASK [add-build-sshkey : Make sure user has a .ssh] 2025-12-04 13:39:54.492222 | controller | ok 2025-12-04 13:39:54.496944 | 2025-12-04 13:39:54.497009 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2025-12-04 13:39:55.699606 | controller | changed 2025-12-04 13:39:55.704620 | 2025-12-04 13:39:55.704685 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2025-12-04 13:39:56.865753 | controller | changed 2025-12-04 13:39:56.871309 | 2025-12-04 13:39:56.871386 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2025-12-04 13:39:56.884341 | controller | skipping: Conditional result was False 2025-12-04 13:39:56.889580 | 2025-12-04 13:39:56.889644 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2025-12-04 13:39:57.186232 | controller -> localhost | changed 2025-12-04 13:39:57.195019 | 2025-12-04 13:39:57.195082 | TASK [add-build-sshkey : Add back temp key] 2025-12-04 13:39:57.420808 | controller -> localhost | Identity added: /var/lib/zuul/builds/e88577a964ae4ccc9a1175c8e14d229c/work/e88577a964ae4ccc9a1175c8e14d229c_id_rsa (zuul-build-sshkey) 2025-12-04 13:39:57.421001 | controller -> localhost | ok: Runtime: 0:00:00.006353 2025-12-04 13:39:57.426307 | 2025-12-04 13:39:57.426371 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2025-12-04 13:39:57.800130 | controller | ok 2025-12-04 13:39:57.804613 | 2025-12-04 13:39:57.804674 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2025-12-04 13:39:57.828090 | controller | skipping: Conditional result was False 2025-12-04 13:39:57.836952 | 2025-12-04 13:39:57.837017 | TASK [include_role : validate-host] 2025-12-04 13:39:57.854241 | controller | ok 2025-12-04 13:39:57.872458 | 2025-12-04 13:39:57.872524 | TASK [validate-host : Define zuul_info_dir fact] 2025-12-04 13:39:57.900417 | controller | ok 2025-12-04 13:39:57.904732 | 2025-12-04 13:39:57.904794 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2025-12-04 13:39:58.111485 | controller -> localhost | ok 2025-12-04 13:39:58.117305 | 2025-12-04 13:39:58.117373 | TASK [validate-host : Collect information about the host] 2025-12-04 13:39:58.844042 | controller | ok 2025-12-04 13:39:58.851839 | 2025-12-04 13:39:58.851901 | TASK [validate-host : Sanitize hostname] 2025-12-04 13:39:58.899773 | controller | ok 2025-12-04 13:39:58.904198 | 2025-12-04 13:39:58.904263 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2025-12-04 13:39:59.271453 | controller -> localhost | changed 2025-12-04 13:39:59.276552 | 2025-12-04 13:39:59.276619 | TASK [validate-host : Collect information about zuul worker] 2025-12-04 13:39:59.690173 | controller | ok 2025-12-04 13:39:59.694952 | 2025-12-04 13:39:59.695046 | TASK [validate-host : Write out all zuul information for each host] 2025-12-04 13:40:00.072857 | controller -> localhost | changed 2025-12-04 13:40:00.082281 | 2025-12-04 13:40:00.082355 | TASK [include_role : prepare-workspace-openshift] 2025-12-04 13:40:00.107069 | controller | skipping: Conditional result was False 2025-12-04 13:40:00.111865 | 2025-12-04 13:40:00.111962 | TASK [include_role : remove-zuul-sshkey] 2025-12-04 13:40:00.125665 | controller | skipping: Conditional result was False 2025-12-04 13:40:00.130846 | 2025-12-04 13:40:00.130931 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2025-12-04 13:40:00.409944 | controller | ok: "logs" 2025-12-04 13:40:00.410173 | controller | ok: All items complete 2025-12-04 13:40:00.410206 | 2025-12-04 13:40:00.666361 | controller | ok: "artifacts" 2025-12-04 13:40:00.915327 | controller | ok: "docs" 2025-12-04 13:40:00.923618 | 2025-12-04 13:40:00.923701 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2025-12-04 13:40:01.199284 | controller | changed: "logs" 2025-12-04 13:40:01.447699 | controller | changed: "artifacts" 2025-12-04 13:40:01.712221 | controller | changed: "docs" 2025-12-04 13:40:01.742062 | 2025-12-04 13:40:01.742153 | PLAY RECAP 2025-12-04 13:40:01.742203 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-12-04 13:40:01.742232 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-12-04 13:40:01.742252 | 2025-12-04 13:40:01.852824 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-12-04 13:40:01.853613 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-12-04 13:40:02.421397 | 2025-12-04 13:40:02.421504 | PLAY [all] 2025-12-04 13:40:02.440747 | 2025-12-04 13:40:02.440822 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-12-04 13:40:02.488243 | controller | ok 2025-12-04 13:40:02.493081 | 2025-12-04 13:40:02.493159 | TASK [mirror-info-fork : Create /etc/ci] 2025-12-04 13:40:02.896869 | controller | changed 2025-12-04 13:40:02.903576 | 2025-12-04 13:40:02.903660 | TASK [mirror-info-fork : Install ci_mirror script] 2025-12-04 13:40:04.267262 | controller | changed 2025-12-04 13:40:04.278858 | 2025-12-04 13:40:04.278976 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2025-12-04 13:40:04.732510 | controller | changed: 2025-12-04 13:40:04.732669 | controller | { 2025-12-04 13:40:04.732703 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2025-12-04 13:40:04.732733 | controller | } 2025-12-04 13:40:05.056820 | controller | changed: 2025-12-04 13:40:05.057078 | controller | { 2025-12-04 13:40:05.057186 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2025-12-04 13:40:05.057215 | controller | } 2025-12-04 13:40:05.358611 | controller | changed: 2025-12-04 13:40:05.358700 | controller | { 2025-12-04 13:40:05.358727 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2025-12-04 13:40:05.358749 | controller | } 2025-12-04 13:40:05.662540 | controller | changed: 2025-12-04 13:40:05.662621 | controller | { 2025-12-04 13:40:05.662651 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2025-12-04 13:40:05.662779 | controller | } 2025-12-04 13:40:05.955265 | controller | changed: 2025-12-04 13:40:05.955329 | controller | { 2025-12-04 13:40:05.955357 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2025-12-04 13:40:05.955380 | controller | } 2025-12-04 13:40:06.247679 | controller | changed: 2025-12-04 13:40:06.247767 | controller | { 2025-12-04 13:40:06.247797 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2025-12-04 13:40:06.247820 | controller | } 2025-12-04 13:40:06.547558 | controller | changed: 2025-12-04 13:40:06.547627 | controller | { 2025-12-04 13:40:06.547722 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2025-12-04 13:40:06.547752 | controller | } 2025-12-04 13:40:06.847563 | controller | changed: 2025-12-04 13:40:06.847610 | controller | { 2025-12-04 13:40:06.847635 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2025-12-04 13:40:06.847653 | controller | } 2025-12-04 13:40:07.142777 | controller | changed: 2025-12-04 13:40:07.142871 | controller | { 2025-12-04 13:40:07.142901 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2025-12-04 13:40:07.142946 | controller | } 2025-12-04 13:40:07.444072 | controller | changed: 2025-12-04 13:40:07.444267 | controller | { 2025-12-04 13:40:07.444422 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2025-12-04 13:40:07.444457 | controller | } 2025-12-04 13:40:07.723156 | controller | changed: 2025-12-04 13:40:07.723349 | controller | { 2025-12-04 13:40:07.723390 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2025-12-04 13:40:07.723425 | controller | } 2025-12-04 13:40:08.003813 | controller | changed: 2025-12-04 13:40:08.003932 | controller | { 2025-12-04 13:40:08.003969 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2025-12-04 13:40:08.003993 | controller | } 2025-12-04 13:40:08.302303 | controller | changed: 2025-12-04 13:40:08.302396 | controller | { 2025-12-04 13:40:08.302441 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGpU/BepK3qX0NRf5Np+dOBDqzQEefhNrw2DCZaH3uWW rebtoor@monolith" 2025-12-04 13:40:08.302465 | controller | } 2025-12-04 13:40:08.602367 | controller | changed: 2025-12-04 13:40:08.602473 | controller | { 2025-12-04 13:40:08.602501 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2025-12-04 13:40:08.602521 | controller | } 2025-12-04 13:40:08.895202 | controller | changed: 2025-12-04 13:40:08.895263 | controller | { 2025-12-04 13:40:08.895288 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2025-12-04 13:40:08.895309 | controller | } 2025-12-04 13:40:09.192327 | controller | changed: 2025-12-04 13:40:09.192379 | controller | { 2025-12-04 13:40:09.192406 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2025-12-04 13:40:09.192440 | controller | } 2025-12-04 13:40:09.487006 | controller | changed: 2025-12-04 13:40:09.487058 | controller | { 2025-12-04 13:40:09.487083 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2025-12-04 13:40:09.487103 | controller | } 2025-12-04 13:40:09.782401 | controller | changed: 2025-12-04 13:40:09.782574 | controller | { 2025-12-04 13:40:09.782612 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2025-12-04 13:40:09.782645 | controller | } 2025-12-04 13:40:10.081328 | controller | changed: 2025-12-04 13:40:10.081430 | controller | { 2025-12-04 13:40:10.081462 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2025-12-04 13:40:10.081485 | controller | } 2025-12-04 13:40:10.382145 | controller | changed: 2025-12-04 13:40:10.382243 | controller | { 2025-12-04 13:40:10.382271 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2025-12-04 13:40:10.382293 | controller | } 2025-12-04 13:40:10.679074 | controller | changed: 2025-12-04 13:40:10.679159 | controller | { 2025-12-04 13:40:10.679185 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2025-12-04 13:40:10.679206 | controller | } 2025-12-04 13:40:10.977523 | controller | changed: 2025-12-04 13:40:10.977645 | controller | { 2025-12-04 13:40:10.977676 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2025-12-04 13:40:10.977739 | controller | } 2025-12-04 13:40:11.273520 | controller | changed: 2025-12-04 13:40:11.273595 | controller | { 2025-12-04 13:40:11.273623 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2025-12-04 13:40:11.273646 | controller | } 2025-12-04 13:40:11.569721 | controller | changed: 2025-12-04 13:40:11.569776 | controller | { 2025-12-04 13:40:11.569802 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2025-12-04 13:40:11.569822 | controller | } 2025-12-04 13:40:11.873932 | controller | changed: 2025-12-04 13:40:11.874069 | controller | { 2025-12-04 13:40:11.874101 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2025-12-04 13:40:11.874124 | controller | } 2025-12-04 13:40:12.171128 | controller | changed: 2025-12-04 13:40:12.171221 | controller | { 2025-12-04 13:40:12.171249 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2025-12-04 13:40:12.171273 | controller | } 2025-12-04 13:40:12.194292 | 2025-12-04 13:40:12.194357 | TASK [Set timezone to UTC] 2025-12-04 13:40:12.690260 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2025-12-04 13:40:12.695215 | 2025-12-04 13:40:12.695278 | TASK [Create nodepool directory] 2025-12-04 13:40:12.978102 | controller | changed 2025-12-04 13:40:12.983347 | 2025-12-04 13:40:12.983425 | TASK [Create nodepool sub_nodes file] 2025-12-04 13:40:13.993109 | controller | changed 2025-12-04 13:40:13.997611 | 2025-12-04 13:40:13.997670 | TASK [Create nodepool sub_nodes_private file] 2025-12-04 13:40:15.019086 | controller | changed 2025-12-04 13:40:15.024070 | 2025-12-04 13:40:15.024133 | LOOP [Populate nodepool sub_nodes file] 2025-12-04 13:40:15.052869 | 2025-12-04 13:40:15.053007 | LOOP [Populate nodepool sub_nodes_private file] 2025-12-04 13:40:15.081329 | 2025-12-04 13:40:15.081505 | TASK [Create nodepool primary file] 2025-12-04 13:40:15.104509 | controller | skipping: Conditional result was False 2025-12-04 13:40:15.109778 | 2025-12-04 13:40:15.109855 | TASK [Create nodepool node_private for this node] 2025-12-04 13:40:16.205553 | controller | changed 2025-12-04 13:40:16.210645 | 2025-12-04 13:40:16.210699 | LOOP [Copy ssh keys to nodepool directory] 2025-12-04 13:40:16.592483 | controller | ok: Item: id_rsa Runtime: 0:00:00.004118 2025-12-04 13:40:16.592631 | 2025-12-04 13:40:16.833388 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.005940 2025-12-04 13:40:16.840139 | 2025-12-04 13:40:16.840256 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2025-12-04 13:40:17.951996 | controller | changed 2025-12-04 13:40:17.956790 | 2025-12-04 13:40:17.956852 | TASK [Validate sudoers config after edits] 2025-12-04 13:40:18.247023 | controller | /etc/sudoers: parsed OK 2025-12-04 13:40:18.247076 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2025-12-04 13:40:18.247085 | controller | /etc/sudoers.d/zuul: parsed OK 2025-12-04 13:40:18.247092 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2025-12-04 13:40:18.483258 | controller | ok: Runtime: 0:00:00.006057 2025-12-04 13:40:18.488710 | 2025-12-04 13:40:18.488771 | TASK [Show the environment passed in to job shell scripts] 2025-12-04 13:40:18.752888 | controller | SHELL=/bin/bash 2025-12-04 13:40:18.752938 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2025-12-04 13:40:18.752948 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2025-12-04 13:40:18.753013 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/30/3530/31a8502f126f76a87815c73bdaaf80e32fb869ec 2025-12-04 13:40:18.753028 | controller | PWD=/home/zuul 2025-12-04 13:40:18.753034 | controller | ZUUL_PIPELINE=github-check 2025-12-04 13:40:18.753039 | controller | LOGNAME=zuul 2025-12-04 13:40:18.753044 | controller | XDG_SESSION_TYPE=tty 2025-12-04 13:40:18.753049 | controller | _=/usr/bin/env 2025-12-04 13:40:18.753053 | controller | MOTD_SHOWN=pam 2025-12-04 13:40:18.753058 | controller | HOME=/home/zuul 2025-12-04 13:40:18.753063 | controller | LANG=en_US.UTF-8 2025-12-04 13:40:18.753068 | controller | SSH_CONNECTION=192.168.26.12 59952 192.168.26.67 22 2025-12-04 13:40:18.753073 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2025-12-04 13:40:18.753082 | controller | ZUUL_CHANGE_IDS=3530,31a8502f126f76a87815c73bdaaf80e32fb869ec 2025-12-04 13:40:18.753087 | controller | WORKSPACE=/home/zuul/workspace 2025-12-04 13:40:18.753092 | controller | XDG_SESSION_CLASS=user 2025-12-04 13:40:18.753097 | controller | SELINUX_ROLE_REQUESTED= 2025-12-04 13:40:18.753102 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2025-12-04 13:40:18.753107 | controller | USER=zuul 2025-12-04 13:40:18.753112 | controller | ZUUL_VOTING=True 2025-12-04 13:40:18.753117 | controller | BUILD_TIMEOUT=5400000 2025-12-04 13:40:18.753121 | controller | SELINUX_USE_CURRENT_RANGE= 2025-12-04 13:40:18.753126 | controller | SHLVL=1 2025-12-04 13:40:18.753131 | controller | ZUUL_PATCHSET=31a8502f126f76a87815c73bdaaf80e32fb869ec 2025-12-04 13:40:18.753136 | controller | XDG_SESSION_ID=1 2025-12-04 13:40:18.753140 | controller | ZUUL_BRANCH=main 2025-12-04 13:40:18.753145 | controller | XDG_RUNTIME_DIR=/run/user/1000 2025-12-04 13:40:18.753150 | controller | SSH_CLIENT=192.168.26.12 59952 22 2025-12-04 13:40:18.753155 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2025-12-04 13:40:18.753160 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2025-12-04 13:40:18.753165 | controller | which_declare=declare -f 2025-12-04 13:40:18.753171 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2025-12-04 13:40:18.753176 | controller | SELINUX_LEVEL_REQUESTED= 2025-12-04 13:40:18.753181 | controller | ZUUL_CHANGE=3530 2025-12-04 13:40:18.753186 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2025-12-04 13:40:18.753191 | controller | ZUUL_UUID=e88577a964ae4ccc9a1175c8e14d229c 2025-12-04 13:40:18.753195 | controller | BASH_FUNC_which%%=() { ( alias; 2025-12-04 13:40:18.753200 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2025-12-04 13:40:18.753205 | controller | } 2025-12-04 13:40:19.015260 | controller | ok: Runtime: 0:00:00.006943 2025-12-04 13:40:19.020210 | 2025-12-04 13:40:19.020267 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2025-12-04 13:40:19.033574 | controller | skipping: Conditional result was False 2025-12-04 13:40:19.038865 | 2025-12-04 13:40:19.038948 | TASK [Symlink /home/zuul-worker/workspace] 2025-12-04 13:40:19.580255 | controller | skipping: Conditional result was False 2025-12-04 13:40:19.585574 | 2025-12-04 13:40:19.585636 | TASK [Ensure legacy workspace directory] 2025-12-04 13:40:19.836659 | controller | changed 2025-12-04 13:40:19.854393 | 2025-12-04 13:40:19.854458 | PLAY RECAP 2025-12-04 13:40:19.854503 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-12-04 13:40:19.854525 | 2025-12-04 13:40:19.920578 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-12-04 13:40:19.921232 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-12-04 13:40:20.376360 | 2025-12-04 13:40:20.376471 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2025-12-04 13:40:20.396537 | 2025-12-04 13:40:20.396608 | TASK [Create zuul-output directory] 2025-12-04 13:40:20.770059 | controller | changed 2025-12-04 13:40:20.774483 | 2025-12-04 13:40:20.774550 | TASK [Slurp Zuul inventory test] 2025-12-04 13:40:21.041112 | controller -> localhost | ok 2025-12-04 13:40:21.046639 | 2025-12-04 13:40:21.046701 | TASK [Save zuul inventory] 2025-12-04 13:40:22.204163 | controller | changed 2025-12-04 13:40:22.208938 | 2025-12-04 13:40:22.209000 | TASK [Save zuul vars without the change_message] 2025-12-04 13:40:23.222115 | controller | changed 2025-12-04 13:40:23.239061 | 2025-12-04 13:40:23.239111 | PLAY RECAP 2025-12-04 13:40:23.239150 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-12-04 13:40:23.239171 | 2025-12-04 13:40:23.299245 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-12-04 13:40:23.299942 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-12-04 13:40:23.806326 | 2025-12-04 13:40:23.806449 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2025-12-04 13:40:23.824936 | 2025-12-04 13:40:23.825005 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2025-12-04 13:40:23.843114 | controller | ok 2025-12-04 13:40:23.859525 | 2025-12-04 13:40:23.859612 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-12-04 13:40:23.882615 | controller | skipping: Conditional result was False 2025-12-04 13:40:23.888176 | 2025-12-04 13:40:23.888247 | TASK [mirror-info-fork : Create /etc/ci] 2025-12-04 13:40:24.261388 | controller | ok 2025-12-04 13:40:24.266835 | 2025-12-04 13:40:24.266937 | TASK [mirror-info-fork : Install ci_mirror script] 2025-12-04 13:40:25.271155 | controller | ok 2025-12-04 13:40:25.280418 | 2025-12-04 13:40:25.280490 | TASK [Prepare workspace] 2025-12-04 13:40:25.298366 | controller | ok 2025-12-04 13:40:25.313595 | 2025-12-04 13:40:25.313851 | TASK [prepare-workspace : Start zuul_console daemon.] 2025-12-04 13:40:25.677583 | controller | ok 2025-12-04 13:40:25.683245 | 2025-12-04 13:40:25.683308 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2025-12-04 13:40:28.003868 | controller | Output suppressed because no_log was given 2025-12-04 13:40:28.012660 | 2025-12-04 13:40:28.012721 | LOOP [Create zuul-output directory] 2025-12-04 13:40:28.266586 | controller | changed: "/home/zuul/ci-framework-data/logs" 2025-12-04 13:40:28.507232 | controller | ok: "/home/zuul/zuul-output/logs" 2025-12-04 13:40:28.516851 | 2025-12-04 13:40:28.516942 | TASK [Install required packages] 2025-12-04 13:41:04.537369 | controller | ok: Nothing to do 2025-12-04 13:41:04.542413 | 2025-12-04 13:41:04.542477 | TASK [Install venv] 2025-12-04 13:42:01.444419 | controller | changed 2025-12-04 13:42:01.469646 | 2025-12-04 13:42:01.469714 | PLAY RECAP 2025-12-04 13:42:01.469767 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-12-04 13:42:01.469798 | 2025-12-04 13:42:01.541833 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-12-04 13:42:01.542695 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-12-04 13:42:02.054722 | 2025-12-04 13:42:02.054827 | PLAY [Run ci/playbooks/molecule-test.yml] 2025-12-04 13:42:02.075395 | 2025-12-04 13:42:02.075467 | TASK [Gather required facts] 2025-12-04 13:42:02.624296 | controller | ok 2025-12-04 13:42:02.629618 | 2025-12-04 13:42:02.629698 | TASK [Load environment var if instructed to] 2025-12-04 13:42:02.659943 | controller | skipping: Conditional result was False 2025-12-04 13:42:02.665507 | 2025-12-04 13:42:02.665574 | TASK [Ensure group_vars dir exists] 2025-12-04 13:42:03.030642 | controller | ok 2025-12-04 13:42:03.035773 | 2025-12-04 13:42:03.035843 | TASK [Print related variables] 2025-12-04 13:42:03.065124 | controller | ok: 2025-12-04 13:42:03.065240 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2025-12-04 13:42:03.065271 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2025-12-04 13:42:03.069978 | 2025-12-04 13:42:03.070042 | TASK [Run molecule] 2025-12-04 13:42:04.050659 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2025-12-04 13:42:04.319854 | controller | INFO Performing prerun with role_name_check=0... 2025-12-04 13:42:20.330216 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 13:42:20.330640 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 13:42:20.331117 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 13:42:20.331560 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 13:42:20.332054 | controller | WARNING Another version of 'cifmw.general' 1.0.0+31a8502f was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+31a8502f (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 13:42:20.332506 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 13:42:20.332942 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 13:42:20.333398 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 13:42:20.333858 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 13:42:20.334311 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 13:42:20.334740 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 13:42:20.335210 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 13:42:20.335648 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 13:42:20.336103 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 13:42:20.336545 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-04 13:42:20.345678 | controller | INFO Running crc_layout > prepare 2025-12-04 13:42:21.023491 | controller | 2025-12-04 13:42:21.023569 | controller | PLAY [Prepare] ***************************************************************** 2025-12-04 13:42:21.023721 | controller | 2025-12-04 13:42:21.023880 | controller | TASK [Gathering Facts] ********************************************************* 2025-12-04 13:42:21.023997 | controller | Thursday 04 December 2025 13:42:21 +0000 (0:00:00.019) 0:00:00.019 ***** 2025-12-04 13:42:21.887034 | controller | ok: [instance] 2025-12-04 13:42:21.887094 | controller | 2025-12-04 13:42:21.887240 | controller | TASK [Create custom basedir] *************************************************** 2025-12-04 13:42:21.887319 | controller | Thursday 04 December 2025 13:42:21 +0000 (0:00:00.864) 0:00:00.884 ***** 2025-12-04 13:42:22.208532 | controller | changed: [instance] 2025-12-04 13:42:22.208623 | controller | 2025-12-04 13:42:22.208728 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2025-12-04 13:42:22.208839 | controller | Thursday 04 December 2025 13:42:22 +0000 (0:00:00.321) 0:00:01.205 ***** 2025-12-04 13:42:22.227839 | controller | skipping: [instance] 2025-12-04 13:42:22.227986 | controller | 2025-12-04 13:42:22.228138 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2025-12-04 13:42:22.228246 | controller | Thursday 04 December 2025 13:42:22 +0000 (0:00:00.019) 0:00:01.225 ***** 2025-12-04 13:42:22.270665 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2025-12-04 13:42:22.270798 | controller | 2025-12-04 13:42:22.270927 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2025-12-04 13:42:22.271085 | controller | Thursday 04 December 2025 13:42:22 +0000 (0:00:00.042) 0:00:01.268 ***** 2025-12-04 13:42:22.557229 | controller | ok: [instance] 2025-12-04 13:42:22.557328 | controller | 2025-12-04 13:42:22.557440 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2025-12-04 13:42:22.557548 | controller | Thursday 04 December 2025 13:42:22 +0000 (0:00:00.286) 0:00:01.554 ***** 2025-12-04 13:42:22.794824 | controller | ok: [instance] 2025-12-04 13:42:22.794892 | controller | 2025-12-04 13:42:22.795010 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2025-12-04 13:42:22.795121 | controller | Thursday 04 December 2025 13:42:22 +0000 (0:00:00.237) 0:00:01.792 ***** 2025-12-04 13:42:23.485362 | controller | ok: [instance] => (item=ubi-9-appstream) 2025-12-04 13:42:23.485438 | controller | ok: [instance] => (item=ubi-9-baseos) 2025-12-04 13:42:23.485586 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2025-12-04 13:42:23.485666 | controller | 2025-12-04 13:42:23.485782 | controller | TASK [Deploy repo-setup] ******************************************************* 2025-12-04 13:42:23.485880 | controller | Thursday 04 December 2025 13:42:23 +0000 (0:00:00.690) 0:00:02.482 ***** 2025-12-04 13:42:23.547122 | controller | 2025-12-04 13:42:23.547221 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-12-04 13:42:23.547390 | controller | Thursday 04 December 2025 13:42:23 +0000 (0:00:00.061) 0:00:02.544 ***** 2025-12-04 13:42:24.083611 | controller | changed: [instance] => (item=tmp) 2025-12-04 13:42:24.083706 | controller | changed: [instance] => (item=artifacts/repositories) 2025-12-04 13:42:24.083834 | controller | changed: [instance] => (item=venv/repo_setup) 2025-12-04 13:42:24.083931 | controller | 2025-12-04 13:42:24.084058 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-12-04 13:42:24.084158 | controller | Thursday 04 December 2025 13:42:24 +0000 (0:00:00.536) 0:00:03.080 ***** 2025-12-04 13:42:24.870871 | controller | ok: [instance] 2025-12-04 13:42:24.870929 | controller | 2025-12-04 13:42:24.871168 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-12-04 13:42:25.899447 | controller | Thursday 04 December 2025 13:42:24 +0000 (0:00:00.787) 0:00:03.868 ***** 2025-12-04 13:42:25.899482 | controller | changed: [instance] 2025-12-04 13:42:33.491039 | controller | 2025-12-04 13:42:33.491076 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-12-04 13:42:33.491084 | controller | Thursday 04 December 2025 13:42:25 +0000 (0:00:01.028) 0:00:04.896 ***** 2025-12-04 13:42:33.491094 | controller | changed: [instance] 2025-12-04 13:42:33.491306 | controller | 2025-12-04 13:42:33.491319 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-12-04 13:42:34.244681 | controller | Thursday 04 December 2025 13:42:33 +0000 (0:00:07.591) 0:00:12.488 ***** 2025-12-04 13:42:34.244732 | controller | changed: [instance] 2025-12-04 13:42:34.268491 | controller | 2025-12-04 13:42:34.268507 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-12-04 13:42:34.268514 | controller | Thursday 04 December 2025 13:42:34 +0000 (0:00:00.753) 0:00:13.241 ***** 2025-12-04 13:42:34.268523 | controller | skipping: [instance] 2025-12-04 13:42:35.083492 | controller | 2025-12-04 13:42:35.083521 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-12-04 13:42:35.083529 | controller | Thursday 04 December 2025 13:42:34 +0000 (0:00:00.024) 0:00:13.265 ***** 2025-12-04 13:42:35.083539 | controller | changed: [instance] 2025-12-04 13:42:35.131075 | controller | 2025-12-04 13:42:35.131096 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-12-04 13:42:35.131104 | controller | Thursday 04 December 2025 13:42:35 +0000 (0:00:00.814) 0:00:14.080 ***** 2025-12-04 13:42:35.131113 | controller | skipping: [instance] 2025-12-04 13:42:35.131311 | controller | 2025-12-04 13:42:35.131329 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-12-04 13:42:35.172142 | controller | Thursday 04 December 2025 13:42:35 +0000 (0:00:00.047) 0:00:14.127 ***** 2025-12-04 13:42:35.172183 | controller | skipping: [instance] 2025-12-04 13:42:35.172394 | controller | 2025-12-04 13:42:35.172418 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-12-04 13:42:35.215678 | controller | Thursday 04 December 2025 13:42:35 +0000 (0:00:00.041) 0:00:14.169 ***** 2025-12-04 13:42:35.215719 | controller | skipping: [instance] 2025-12-04 13:42:35.755655 | controller | 2025-12-04 13:42:35.755688 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-12-04 13:42:35.755696 | controller | Thursday 04 December 2025 13:42:35 +0000 (0:00:00.043) 0:00:14.212 ***** 2025-12-04 13:42:35.755719 | controller | changed: [instance] 2025-12-04 13:42:36.216820 | controller | 2025-12-04 13:42:36.216850 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-12-04 13:42:36.216858 | controller | Thursday 04 December 2025 13:42:35 +0000 (0:00:00.539) 0:00:14.752 ***** 2025-12-04 13:42:36.216868 | controller | changed: [instance] 2025-12-04 13:42:36.256102 | controller | 2025-12-04 13:42:36.256133 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-12-04 13:42:36.256145 | controller | Thursday 04 December 2025 13:42:36 +0000 (0:00:00.461) 0:00:15.213 ***** 2025-12-04 13:42:36.256160 | controller | skipping: [instance] 2025-12-04 13:42:36.256390 | controller | 2025-12-04 13:42:36.256413 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-12-04 13:42:36.289469 | controller | Thursday 04 December 2025 13:42:36 +0000 (0:00:00.039) 0:00:15.253 ***** 2025-12-04 13:42:36.289498 | controller | skipping: [instance] 2025-12-04 13:42:36.318733 | controller | 2025-12-04 13:42:36.318755 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-12-04 13:42:36.318765 | controller | Thursday 04 December 2025 13:42:36 +0000 (0:00:00.033) 0:00:15.286 ***** 2025-12-04 13:42:36.318776 | controller | skipping: [instance] 2025-12-04 13:42:36.398619 | controller | 2025-12-04 13:42:36.398641 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-12-04 13:42:36.398650 | controller | Thursday 04 December 2025 13:42:36 +0000 (0:00:00.029) 0:00:15.315 ***** 2025-12-04 13:42:36.398661 | controller | ok: [instance] 2025-12-04 13:42:36.428568 | controller | 2025-12-04 13:42:36.428588 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-12-04 13:42:36.428596 | controller | Thursday 04 December 2025 13:42:36 +0000 (0:00:00.079) 0:00:15.395 ***** 2025-12-04 13:42:36.428614 | controller | skipping: [instance] 2025-12-04 13:42:36.455981 | controller | 2025-12-04 13:42:36.456005 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-12-04 13:42:36.456014 | controller | Thursday 04 December 2025 13:42:36 +0000 (0:00:00.029) 0:00:15.425 ***** 2025-12-04 13:42:36.456025 | controller | skipping: [instance] 2025-12-04 13:42:36.456181 | controller | 2025-12-04 13:42:36.456324 | controller | TASK [Download the RPM] ******************************************************** 2025-12-04 13:42:36.456460 | controller | Thursday 04 December 2025 13:42:36 +0000 (0:00:00.027) 0:00:15.453 ***** 2025-12-04 13:42:36.492333 | controller | skipping: [instance] 2025-12-04 13:42:36.492584 | controller | 2025-12-04 13:42:36.492838 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-12-04 13:42:36.493108 | controller | Thursday 04 December 2025 13:42:36 +0000 (0:00:00.036) 0:00:15.489 ***** 2025-12-04 13:42:36.521870 | controller | skipping: [instance] 2025-12-04 13:42:36.522085 | controller | 2025-12-04 13:42:36.522250 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-12-04 13:42:36.522387 | controller | Thursday 04 December 2025 13:42:36 +0000 (0:00:00.029) 0:00:15.519 ***** 2025-12-04 13:42:36.549648 | controller | skipping: [instance] 2025-12-04 13:42:36.549849 | controller | 2025-12-04 13:42:36.550054 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-12-04 13:42:36.550232 | controller | Thursday 04 December 2025 13:42:36 +0000 (0:00:00.027) 0:00:15.547 ***** 2025-12-04 13:42:36.579820 | controller | skipping: [instance] 2025-12-04 13:42:36.580060 | controller | 2025-12-04 13:42:36.580251 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-12-04 13:42:36.580402 | controller | Thursday 04 December 2025 13:42:36 +0000 (0:00:00.029) 0:00:15.577 ***** 2025-12-04 13:42:36.607171 | controller | skipping: [instance] 2025-12-04 13:42:36.607349 | controller | 2025-12-04 13:42:36.607494 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-12-04 13:42:36.607631 | controller | Thursday 04 December 2025 13:42:36 +0000 (0:00:00.027) 0:00:15.604 ***** 2025-12-04 13:42:36.815042 | controller | ok: [instance] 2025-12-04 13:42:37.028806 | controller | 2025-12-04 13:42:37.028839 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-12-04 13:42:37.028847 | controller | Thursday 04 December 2025 13:42:36 +0000 (0:00:00.207) 0:00:15.812 ***** 2025-12-04 13:42:37.028858 | controller | changed: [instance] 2025-12-04 13:42:37.259044 | controller | 2025-12-04 13:42:37.259080 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-12-04 13:42:37.259089 | controller | Thursday 04 December 2025 13:42:37 +0000 (0:00:00.213) 0:00:16.025 ***** 2025-12-04 13:42:37.259099 | controller | changed: [instance] 2025-12-04 13:42:37.259127 | controller | 2025-12-04 13:42:37.259369 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-12-04 13:42:37.281532 | controller | Thursday 04 December 2025 13:42:37 +0000 (0:00:00.230) 0:00:16.256 ***** 2025-12-04 13:42:37.281557 | controller | skipping: [instance] 2025-12-04 13:42:37.304089 | controller | 2025-12-04 13:42:37.304113 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-12-04 13:42:37.304122 | controller | Thursday 04 December 2025 13:42:37 +0000 (0:00:00.022) 0:00:16.278 ***** 2025-12-04 13:42:37.304139 | controller | skipping: [instance] 2025-12-04 13:42:37.304235 | controller | 2025-12-04 13:42:37.304252 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-12-04 13:42:37.304264 | controller | Thursday 04 December 2025 13:42:37 +0000 (0:00:00.022) 0:00:16.301 ***** 2025-12-04 13:42:37.327742 | controller | skipping: [instance] 2025-12-04 13:42:37.350053 | controller | 2025-12-04 13:42:37.350081 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-12-04 13:42:37.350091 | controller | Thursday 04 December 2025 13:42:37 +0000 (0:00:00.023) 0:00:16.325 ***** 2025-12-04 13:42:37.350103 | controller | skipping: [instance] 2025-12-04 13:42:37.350137 | controller | 2025-12-04 13:42:37.350147 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-12-04 13:42:37.350190 | controller | Thursday 04 December 2025 13:42:37 +0000 (0:00:00.022) 0:00:16.347 ***** 2025-12-04 13:42:37.372683 | controller | skipping: [instance] 2025-12-04 13:42:37.393619 | controller | 2025-12-04 13:42:37.393641 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-12-04 13:42:37.393650 | controller | Thursday 04 December 2025 13:42:37 +0000 (0:00:00.022) 0:00:16.369 ***** 2025-12-04 13:42:37.393665 | controller | skipping: [instance] 2025-12-04 13:42:37.393846 | controller | 2025-12-04 13:42:37.394010 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-12-04 13:42:37.394156 | controller | Thursday 04 December 2025 13:42:37 +0000 (0:00:00.021) 0:00:16.391 ***** 2025-12-04 13:42:37.411418 | controller | skipping: [instance] 2025-12-04 13:42:37.411601 | controller | 2025-12-04 13:42:37.411798 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-12-04 13:42:37.411950 | controller | Thursday 04 December 2025 13:42:37 +0000 (0:00:00.017) 0:00:16.409 ***** 2025-12-04 13:42:37.442896 | controller | skipping: [instance] 2025-12-04 13:42:37.443110 | controller | 2025-12-04 13:42:37.443292 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-12-04 13:42:37.443470 | controller | Thursday 04 December 2025 13:42:37 +0000 (0:00:00.031) 0:00:16.440 ***** 2025-12-04 13:42:37.460499 | controller | skipping: [instance] 2025-12-04 13:42:37.460683 | controller | 2025-12-04 13:42:37.460872 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-12-04 13:42:37.461054 | controller | Thursday 04 December 2025 13:42:37 +0000 (0:00:00.017) 0:00:16.458 ***** 2025-12-04 13:42:37.482489 | controller | skipping: [instance] 2025-12-04 13:42:37.482674 | controller | 2025-12-04 13:42:37.482866 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2025-12-04 13:42:37.483061 | controller | Thursday 04 December 2025 13:42:37 +0000 (0:00:00.021) 0:00:16.480 ***** 2025-12-04 13:42:37.513213 | controller | skipping: [instance] 2025-12-04 13:42:37.513364 | controller | 2025-12-04 13:42:37.513508 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2025-12-04 13:42:37.513646 | controller | Thursday 04 December 2025 13:42:37 +0000 (0:00:00.030) 0:00:16.510 ***** 2025-12-04 13:42:37.545190 | controller | skipping: [instance] 2025-12-04 13:42:37.545376 | controller | 2025-12-04 13:42:37.545560 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2025-12-04 13:42:37.545743 | controller | Thursday 04 December 2025 13:42:37 +0000 (0:00:00.031) 0:00:16.542 ***** 2025-12-04 13:42:37.588016 | controller | skipping: [instance] 2025-12-04 13:42:37.588203 | controller | 2025-12-04 13:42:37.588376 | controller | TASK [test_deps : Install additional packages] ********************************* 2025-12-04 13:42:37.588540 | controller | Thursday 04 December 2025 13:42:37 +0000 (0:00:00.042) 0:00:16.585 ***** 2025-12-04 13:42:37.620499 | controller | skipping: [instance] 2025-12-04 13:42:37.620686 | controller | 2025-12-04 13:42:37.620875 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2025-12-04 13:42:37.621103 | controller | Thursday 04 December 2025 13:42:37 +0000 (0:00:00.032) 0:00:16.618 ***** 2025-12-04 13:43:34.613095 | controller | ok: [instance] 2025-12-04 13:43:35.788553 | controller | 2025-12-04 13:43:35.788579 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2025-12-04 13:43:35.788587 | controller | Thursday 04 December 2025 13:43:34 +0000 (0:00:56.991) 0:01:13.610 ***** 2025-12-04 13:43:35.788597 | controller | ok: [instance] 2025-12-04 13:43:35.821076 | controller | 2025-12-04 13:43:35.821102 | controller | TASK [test_deps : Install extra packages] ************************************** 2025-12-04 13:43:35.821112 | controller | Thursday 04 December 2025 13:43:35 +0000 (0:00:01.175) 0:01:14.785 ***** 2025-12-04 13:43:35.821131 | controller | skipping: [instance] 2025-12-04 13:43:35.863035 | controller | 2025-12-04 13:43:35.863076 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-12-04 13:43:35.863085 | controller | Thursday 04 December 2025 13:43:35 +0000 (0:00:00.032) 0:01:14.818 ***** 2025-12-04 13:43:35.863095 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2025-12-04 13:43:35.863128 | controller | 2025-12-04 13:43:35.863137 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-12-04 13:43:35.863292 | controller | Thursday 04 December 2025 13:43:35 +0000 (0:00:00.042) 0:01:14.860 ***** 2025-12-04 13:43:35.882074 | controller | ok: [instance] => 2025-12-04 13:43:35.883072 | controller | cifmw_ci_setup_packages: 2025-12-04 13:43:35.883097 | controller | - bash-completion 2025-12-04 13:43:43.538351 | controller | - ca-certificates 2025-12-04 13:43:43.538385 | controller | - git-core 2025-12-04 13:43:43.538393 | controller | - make 2025-12-04 13:43:43.538399 | controller | - tar 2025-12-04 13:43:43.538404 | controller | - tmux 2025-12-04 13:43:43.538409 | controller | - python3-pip 2025-12-04 13:43:43.538415 | controller | 2025-12-04 13:43:43.538421 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-12-04 13:43:43.538427 | controller | Thursday 04 December 2025 13:43:35 +0000 (0:00:00.019) 0:01:14.879 ***** 2025-12-04 13:43:43.538437 | controller | changed: [instance] 2025-12-04 13:43:43.538537 | controller | 2025-12-04 13:43:43.538586 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-12-04 13:43:43.538597 | controller | Thursday 04 December 2025 13:43:43 +0000 (0:00:07.656) 0:01:22.535 ***** 2025-12-04 13:43:44.125002 | controller | ok: [instance] 2025-12-04 13:43:44.125082 | controller | 2025-12-04 13:43:44.125330 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-12-04 13:43:44.326953 | controller | Thursday 04 December 2025 13:43:44 +0000 (0:00:00.586) 0:01:23.122 ***** 2025-12-04 13:43:44.327006 | controller | changed: [instance] 2025-12-04 13:43:44.327052 | controller | 2025-12-04 13:43:44.327261 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-12-04 13:43:44.327310 | controller | Thursday 04 December 2025 13:43:44 +0000 (0:00:00.201) 0:01:23.324 ***** 2025-12-04 13:43:50.355892 | controller | changed: [instance] 2025-12-04 13:43:50.392760 | controller | 2025-12-04 13:43:50.392782 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-12-04 13:43:50.392792 | controller | Thursday 04 December 2025 13:43:50 +0000 (0:00:06.026) 0:01:29.350 ***** 2025-12-04 13:43:50.392802 | controller | ok: [instance] 2025-12-04 13:43:50.656745 | controller | 2025-12-04 13:43:50.656792 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-12-04 13:43:50.656802 | controller | Thursday 04 December 2025 13:43:50 +0000 (0:00:00.039) 0:01:29.390 ***** 2025-12-04 13:43:50.656814 | controller | changed: [instance] 2025-12-04 13:43:50.930644 | controller | 2025-12-04 13:43:50.930713 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-12-04 13:43:50.930722 | controller | Thursday 04 December 2025 13:43:50 +0000 (0:00:00.263) 0:01:29.653 ***** 2025-12-04 13:43:50.930735 | controller | changed: [instance] 2025-12-04 13:43:50.947780 | controller | 2025-12-04 13:43:50.947806 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-12-04 13:43:50.947821 | controller | Thursday 04 December 2025 13:43:50 +0000 (0:00:00.273) 0:01:29.927 ***** 2025-12-04 13:43:50.947833 | controller | skipping: [instance] 2025-12-04 13:43:50.948021 | controller | 2025-12-04 13:43:50.948038 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-12-04 13:43:50.948049 | controller | Thursday 04 December 2025 13:43:50 +0000 (0:00:00.017) 0:01:29.944 ***** 2025-12-04 13:43:50.963924 | controller | skipping: [instance] 2025-12-04 13:43:50.979591 | controller | 2025-12-04 13:43:50.979609 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-12-04 13:43:50.979617 | controller | Thursday 04 December 2025 13:43:50 +0000 (0:00:00.015) 0:01:29.960 ***** 2025-12-04 13:43:50.979626 | controller | skipping: [instance] 2025-12-04 13:43:50.994976 | controller | 2025-12-04 13:43:50.994999 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-12-04 13:43:50.995008 | controller | Thursday 04 December 2025 13:43:50 +0000 (0:00:00.016) 0:01:29.976 ***** 2025-12-04 13:43:50.995018 | controller | skipping: [instance] 2025-12-04 13:43:51.011224 | controller | 2025-12-04 13:43:51.011288 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-12-04 13:43:51.011313 | controller | Thursday 04 December 2025 13:43:50 +0000 (0:00:00.015) 0:01:29.992 ***** 2025-12-04 13:43:51.011334 | controller | skipping: [instance] 2025-12-04 13:43:51.011371 | controller | 2025-12-04 13:43:51.011381 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-12-04 13:43:51.011394 | controller | Thursday 04 December 2025 13:43:51 +0000 (0:00:00.016) 0:01:30.008 ***** 2025-12-04 13:43:51.031832 | controller | skipping: [instance] 2025-12-04 13:43:51.031980 | controller | 2025-12-04 13:43:51.032155 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-12-04 13:43:51.032266 | controller | Thursday 04 December 2025 13:43:51 +0000 (0:00:00.020) 0:01:30.029 ***** 2025-12-04 13:43:52.054995 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2025-12-04 13:43:52.398138 | controller | changed: [instance] => (item=/opt/basedir/logs) 2025-12-04 13:43:52.398184 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2025-12-04 13:43:52.398194 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2025-12-04 13:43:52.398202 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2025-12-04 13:43:52.398210 | controller | 2025-12-04 13:43:52.398217 | controller | TASK [Create secret file] ****************************************************** 2025-12-04 13:43:52.398225 | controller | Thursday 04 December 2025 13:43:52 +0000 (0:00:01.021) 0:01:31.050 ***** 2025-12-04 13:43:52.398246 | controller | changed: [instance] 2025-12-04 13:43:52.398283 | controller | 2025-12-04 13:43:52.398292 | controller | PLAY RECAP ********************************************************************* 2025-12-04 13:43:52.398300 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2025-12-04 13:43:52.398308 | controller | 2025-12-04 13:43:52.398315 | controller | Thursday 04 December 2025 13:43:52 +0000 (0:00:00.343) 0:01:31.394 ***** 2025-12-04 13:43:52.398322 | controller | =============================================================================== 2025-12-04 13:43:52.398329 | controller | test_deps : Install selinux python libs -------------------------------- 56.99s 2025-12-04 13:43:52.398336 | controller | ci_setup : Install needed packages -------------------------------------- 7.66s 2025-12-04 13:43:52.398343 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.59s 2025-12-04 13:43:52.398352 | controller | ci_setup : Install openshift client ------------------------------------- 6.03s 2025-12-04 13:43:52.398382 | controller | test_deps : Install python yaml libs ------------------------------------ 1.18s 2025-12-04 13:43:52.398392 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.03s 2025-12-04 13:43:52.399059 | controller | ci_setup : Manage directories ------------------------------------------- 1.02s 2025-12-04 13:43:52.399657 | controller | Gathering Facts --------------------------------------------------------- 0.86s 2025-12-04 13:43:52.399724 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.81s 2025-12-04 13:43:52.399732 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.79s 2025-12-04 13:43:52.399738 | controller | repo_setup : Install repo-setup package --------------------------------- 0.75s 2025-12-04 13:43:52.399743 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.69s 2025-12-04 13:43:52.399748 | controller | ci_setup : Gather version of openshift client --------------------------- 0.59s 2025-12-04 13:43:52.399753 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.54s 2025-12-04 13:43:52.399767 | controller | repo_setup : Ensure directories are present ----------------------------- 0.54s 2025-12-04 13:43:52.460407 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.46s 2025-12-04 13:43:52.460451 | controller | Create secret file ------------------------------------------------------ 0.34s 2025-12-04 13:43:52.460459 | controller | Create custom basedir --------------------------------------------------- 0.32s 2025-12-04 13:43:52.460465 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.29s 2025-12-04 13:43:52.460478 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.27s 2025-12-04 13:43:52.460491 | controller | INFO Running crc_layout > converge 2025-12-04 13:43:53.045227 | controller | 2025-12-04 13:43:53.045497 | controller | PLAY [Converge] **************************************************************** 2025-12-04 13:43:53.045640 | controller | 2025-12-04 13:43:53.045769 | controller | TASK [Gathering Facts] ********************************************************* 2025-12-04 13:43:53.045897 | controller | Thursday 04 December 2025 13:43:53 +0000 (0:00:00.026) 0:00:00.026 ***** 2025-12-04 13:43:53.892891 | controller | ok: [instance] 2025-12-04 13:43:53.916204 | controller | 2025-12-04 13:43:53.916260 | controller | TASK [Load networking definition from scenario file] *************************** 2025-12-04 13:43:53.916271 | controller | Thursday 04 December 2025 13:43:53 +0000 (0:00:00.847) 0:00:00.874 ***** 2025-12-04 13:43:53.916286 | controller | ok: [instance] 2025-12-04 13:43:55.717084 | controller | 2025-12-04 13:43:55.717116 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-12-04 13:43:55.717124 | controller | Thursday 04 December 2025 13:43:53 +0000 (0:00:00.024) 0:00:00.898 ***** 2025-12-04 13:43:55.717135 | controller | changed: [instance] 2025-12-04 13:43:55.717165 | controller | 2025-12-04 13:43:55.717421 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-12-04 13:43:55.745159 | controller | Thursday 04 December 2025 13:43:55 +0000 (0:00:01.800) 0:00:02.699 ***** 2025-12-04 13:43:55.745219 | controller | ok: [instance] 2025-12-04 13:43:55.745259 | controller | 2025-12-04 13:43:55.745426 | controller | TASK [reproducer : Load CI job environment] ************************************ 2025-12-04 13:43:55.745472 | controller | Thursday 04 December 2025 13:43:55 +0000 (0:00:00.028) 0:00:02.728 ***** 2025-12-04 13:43:55.767422 | controller | skipping: [instance] 2025-12-04 13:43:55.817896 | controller | 2025-12-04 13:43:55.817925 | controller | TASK [Build final libvirt layout] ********************************************** 2025-12-04 13:43:55.817934 | controller | Thursday 04 December 2025 13:43:55 +0000 (0:00:00.022) 0:00:02.750 ***** 2025-12-04 13:43:55.817945 | controller | 2025-12-04 13:43:55.899016 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2025-12-04 13:43:55.899040 | controller | Thursday 04 December 2025 13:43:55 +0000 (0:00:00.050) 0:00:02.800 ***** 2025-12-04 13:43:55.899051 | controller | ok: [instance] 2025-12-04 13:43:55.959218 | controller | 2025-12-04 13:43:55.959246 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2025-12-04 13:43:55.959255 | controller | Thursday 04 December 2025 13:43:55 +0000 (0:00:00.080) 0:00:02.881 ***** 2025-12-04 13:43:55.959267 | controller | skipping: [instance] 2025-12-04 13:43:55.959430 | controller | 2025-12-04 13:43:55.959607 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2025-12-04 13:43:55.959752 | controller | Thursday 04 December 2025 13:43:55 +0000 (0:00:00.060) 0:00:02.942 ***** 2025-12-04 13:43:55.985378 | controller | ok: [instance] 2025-12-04 13:43:55.985569 | controller | 2025-12-04 13:43:55.985759 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2025-12-04 13:43:55.985888 | controller | Thursday 04 December 2025 13:43:55 +0000 (0:00:00.026) 0:00:02.968 ***** 2025-12-04 13:43:56.009728 | controller | ok: [instance] => changed=false 2025-12-04 13:43:56.009918 | controller | msg: All assertions passed 2025-12-04 13:43:56.010084 | controller | 2025-12-04 13:43:56.010231 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2025-12-04 13:43:56.010369 | controller | Thursday 04 December 2025 13:43:56 +0000 (0:00:00.024) 0:00:02.992 ***** 2025-12-04 13:43:56.054826 | controller | ok: [instance] 2025-12-04 13:43:56.055027 | controller | 2025-12-04 13:43:56.055200 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2025-12-04 13:43:56.055371 | controller | Thursday 04 December 2025 13:43:56 +0000 (0:00:00.044) 0:00:03.037 ***** 2025-12-04 13:43:56.539700 | controller | ok: [instance] => (item=artifacts) 2025-12-04 13:43:56.615068 | controller | ok: [instance] => (item=logs) 2025-12-04 13:43:56.615103 | controller | 2025-12-04 13:43:56.615111 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2025-12-04 13:43:56.615129 | controller | Thursday 04 December 2025 13:43:56 +0000 (0:00:00.483) 0:00:03.521 ***** 2025-12-04 13:43:56.615140 | controller | 2025-12-04 13:43:56.815068 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2025-12-04 13:43:56.815115 | controller | Thursday 04 December 2025 13:43:56 +0000 (0:00:00.076) 0:00:03.597 ***** 2025-12-04 13:43:56.815129 | controller | ok: [instance] 2025-12-04 13:43:57.103755 | controller | 2025-12-04 13:43:57.103781 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2025-12-04 13:43:57.103789 | controller | Thursday 04 December 2025 13:43:56 +0000 (0:00:00.199) 0:00:03.797 ***** 2025-12-04 13:43:57.103799 | controller | changed: [instance] 2025-12-04 13:43:57.395606 | controller | 2025-12-04 13:43:57.395630 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2025-12-04 13:43:57.395638 | controller | Thursday 04 December 2025 13:43:57 +0000 (0:00:00.289) 0:00:04.086 ***** 2025-12-04 13:43:57.395648 | controller | ok: [instance] 2025-12-04 13:43:57.427133 | controller | 2025-12-04 13:43:57.427195 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2025-12-04 13:43:57.427207 | controller | Thursday 04 December 2025 13:43:57 +0000 (0:00:00.291) 0:00:04.378 ***** 2025-12-04 13:43:57.427224 | controller | skipping: [instance] 2025-12-04 13:43:57.445671 | controller | 2025-12-04 13:43:57.445698 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2025-12-04 13:43:57.445706 | controller | Thursday 04 December 2025 13:43:57 +0000 (0:00:00.031) 0:00:04.409 ***** 2025-12-04 13:43:57.445715 | controller | skipping: [instance] 2025-12-04 13:43:57.468175 | controller | 2025-12-04 13:43:57.468227 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2025-12-04 13:43:57.468242 | controller | Thursday 04 December 2025 13:43:57 +0000 (0:00:00.018) 0:00:04.428 ***** 2025-12-04 13:43:57.468260 | controller | ok: [instance] 2025-12-04 13:43:57.468328 | controller | 2025-12-04 13:43:57.468361 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2025-12-04 13:43:57.497445 | controller | Thursday 04 December 2025 13:43:57 +0000 (0:00:00.022) 0:00:04.450 ***** 2025-12-04 13:43:57.497468 | controller | skipping: [instance] 2025-12-04 13:44:11.330046 | controller | 2025-12-04 13:44:11.330076 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2025-12-04 13:44:11.330084 | controller | Thursday 04 December 2025 13:43:57 +0000 (0:00:00.029) 0:00:04.480 ***** 2025-12-04 13:44:11.330095 | controller | changed: [instance] 2025-12-04 13:44:11.540978 | controller | 2025-12-04 13:44:11.541009 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2025-12-04 13:44:11.541018 | controller | Thursday 04 December 2025 13:44:11 +0000 (0:00:13.832) 0:00:18.312 ***** 2025-12-04 13:44:11.541028 | controller | changed: [instance] 2025-12-04 13:44:12.040663 | controller | 2025-12-04 13:44:12.040693 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2025-12-04 13:44:12.040701 | controller | Thursday 04 December 2025 13:44:11 +0000 (0:00:00.210) 0:00:18.523 ***** 2025-12-04 13:44:12.040711 | controller | changed: [instance] 2025-12-04 13:44:12.616667 | controller | 2025-12-04 13:44:12.616695 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2025-12-04 13:44:12.616703 | controller | Thursday 04 December 2025 13:44:12 +0000 (0:00:00.499) 0:00:19.023 ***** 2025-12-04 13:44:12.616713 | controller | changed: [instance] 2025-12-04 13:44:12.829036 | controller | 2025-12-04 13:44:12.829067 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2025-12-04 13:44:12.829075 | controller | Thursday 04 December 2025 13:44:12 +0000 (0:00:00.576) 0:00:19.599 ***** 2025-12-04 13:44:12.829085 | controller | ok: [instance] 2025-12-04 13:44:12.829110 | controller | 2025-12-04 13:44:12.829118 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2025-12-04 13:44:12.829270 | controller | Thursday 04 December 2025 13:44:12 +0000 (0:00:00.212) 0:00:19.811 ***** 2025-12-04 13:44:13.467969 | controller | ok: [instance] 2025-12-04 13:44:14.348760 | controller | 2025-12-04 13:44:14.348792 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2025-12-04 13:44:14.348807 | controller | Thursday 04 December 2025 13:44:13 +0000 (0:00:00.638) 0:00:20.450 ***** 2025-12-04 13:44:14.348818 | controller | changed: [instance] 2025-12-04 13:44:14.434110 | controller | 2025-12-04 13:44:14.434149 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2025-12-04 13:44:14.434159 | controller | Thursday 04 December 2025 13:44:14 +0000 (0:00:00.880) 0:00:21.331 ***** 2025-12-04 13:44:14.434172 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2025-12-04 13:44:14.434203 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2025-12-04 13:44:14.434211 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2025-12-04 13:44:14.434218 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2025-12-04 13:44:14.434227 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2025-12-04 13:44:14.434819 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2025-12-04 13:44:14.747114 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2025-12-04 13:44:14.747161 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2025-12-04 13:44:14.747174 | controller | 2025-12-04 13:44:14.747186 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2025-12-04 13:44:14.747196 | controller | Thursday 04 December 2025 13:44:14 +0000 (0:00:00.085) 0:00:21.416 ***** 2025-12-04 13:44:14.747213 | controller | ok: [instance] 2025-12-04 13:44:15.062607 | controller | 2025-12-04 13:44:15.062638 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2025-12-04 13:44:15.062646 | controller | Thursday 04 December 2025 13:44:14 +0000 (0:00:00.313) 0:00:21.730 ***** 2025-12-04 13:44:15.062656 | controller | ok: [instance] 2025-12-04 13:44:15.381086 | controller | 2025-12-04 13:44:15.381116 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2025-12-04 13:44:15.381124 | controller | Thursday 04 December 2025 13:44:15 +0000 (0:00:00.315) 0:00:22.045 ***** 2025-12-04 13:44:15.381134 | controller | ok: [instance] 2025-12-04 13:44:15.381325 | controller | 2025-12-04 13:44:15.381346 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2025-12-04 13:44:15.699548 | controller | Thursday 04 December 2025 13:44:15 +0000 (0:00:00.318) 0:00:22.363 ***** 2025-12-04 13:44:15.699584 | controller | ok: [instance] 2025-12-04 13:44:16.015092 | controller | 2025-12-04 13:44:16.015125 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2025-12-04 13:44:16.015135 | controller | Thursday 04 December 2025 13:44:15 +0000 (0:00:00.318) 0:00:22.682 ***** 2025-12-04 13:44:16.015147 | controller | ok: [instance] 2025-12-04 13:44:16.329673 | controller | 2025-12-04 13:44:16.329705 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2025-12-04 13:44:16.329714 | controller | Thursday 04 December 2025 13:44:16 +0000 (0:00:00.315) 0:00:22.997 ***** 2025-12-04 13:44:16.329724 | controller | ok: [instance] 2025-12-04 13:44:16.641041 | controller | 2025-12-04 13:44:16.641070 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2025-12-04 13:44:16.641078 | controller | Thursday 04 December 2025 13:44:16 +0000 (0:00:00.314) 0:00:23.312 ***** 2025-12-04 13:44:16.641089 | controller | ok: [instance] 2025-12-04 13:44:16.641172 | controller | 2025-12-04 13:44:16.641203 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2025-12-04 13:44:16.641225 | controller | Thursday 04 December 2025 13:44:16 +0000 (0:00:00.311) 0:00:23.623 ***** 2025-12-04 13:44:16.955890 | controller | ok: [instance] 2025-12-04 13:44:17.263722 | controller | 2025-12-04 13:44:17.263752 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2025-12-04 13:44:17.263760 | controller | Thursday 04 December 2025 13:44:16 +0000 (0:00:00.314) 0:00:23.938 ***** 2025-12-04 13:44:17.263770 | controller | ok: [instance] 2025-12-04 13:44:17.576041 | controller | 2025-12-04 13:44:17.576078 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2025-12-04 13:44:17.576088 | controller | Thursday 04 December 2025 13:44:17 +0000 (0:00:00.307) 0:00:24.246 ***** 2025-12-04 13:44:17.576101 | controller | ok: [instance] 2025-12-04 13:44:17.576170 | controller | 2025-12-04 13:44:17.576181 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2025-12-04 13:44:17.576191 | controller | Thursday 04 December 2025 13:44:17 +0000 (0:00:00.312) 0:00:24.558 ***** 2025-12-04 13:44:17.886664 | controller | ok: [instance] 2025-12-04 13:44:18.209084 | controller | 2025-12-04 13:44:18.209117 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2025-12-04 13:44:18.209127 | controller | Thursday 04 December 2025 13:44:17 +0000 (0:00:00.310) 0:00:24.869 ***** 2025-12-04 13:44:18.209139 | controller | ok: [instance] 2025-12-04 13:44:18.209172 | controller | 2025-12-04 13:44:18.209398 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2025-12-04 13:44:18.521518 | controller | Thursday 04 December 2025 13:44:18 +0000 (0:00:00.322) 0:00:25.192 ***** 2025-12-04 13:44:18.521553 | controller | ok: [instance] 2025-12-04 13:44:18.830699 | controller | 2025-12-04 13:44:18.830732 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2025-12-04 13:44:18.830741 | controller | Thursday 04 December 2025 13:44:18 +0000 (0:00:00.312) 0:00:25.504 ***** 2025-12-04 13:44:18.830751 | controller | ok: [instance] 2025-12-04 13:44:19.137708 | controller | 2025-12-04 13:44:19.137738 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2025-12-04 13:44:19.137746 | controller | Thursday 04 December 2025 13:44:18 +0000 (0:00:00.309) 0:00:25.813 ***** 2025-12-04 13:44:19.137755 | controller | ok: [instance] 2025-12-04 13:44:19.440761 | controller | 2025-12-04 13:44:19.440792 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2025-12-04 13:44:19.440800 | controller | Thursday 04 December 2025 13:44:19 +0000 (0:00:00.307) 0:00:26.120 ***** 2025-12-04 13:44:19.440811 | controller | ok: [instance] 2025-12-04 13:44:19.748032 | controller | 2025-12-04 13:44:19.748066 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2025-12-04 13:44:19.748075 | controller | Thursday 04 December 2025 13:44:19 +0000 (0:00:00.302) 0:00:26.423 ***** 2025-12-04 13:44:19.748086 | controller | ok: [instance] 2025-12-04 13:44:19.748108 | controller | 2025-12-04 13:44:19.748116 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2025-12-04 13:44:19.748212 | controller | Thursday 04 December 2025 13:44:19 +0000 (0:00:00.307) 0:00:26.730 ***** 2025-12-04 13:44:20.052951 | controller | ok: [instance] 2025-12-04 13:44:20.357732 | controller | 2025-12-04 13:44:20.357761 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2025-12-04 13:44:20.357769 | controller | Thursday 04 December 2025 13:44:20 +0000 (0:00:00.304) 0:00:27.035 ***** 2025-12-04 13:44:20.357779 | controller | ok: [instance] 2025-12-04 13:44:20.666364 | controller | 2025-12-04 13:44:20.666391 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2025-12-04 13:44:20.666398 | controller | Thursday 04 December 2025 13:44:20 +0000 (0:00:00.304) 0:00:27.340 ***** 2025-12-04 13:44:20.666409 | controller | ok: [instance] 2025-12-04 13:44:20.973057 | controller | 2025-12-04 13:44:20.973087 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2025-12-04 13:44:20.973095 | controller | Thursday 04 December 2025 13:44:20 +0000 (0:00:00.308) 0:00:27.649 ***** 2025-12-04 13:44:20.973106 | controller | ok: [instance] 2025-12-04 13:44:20.973183 | controller | 2025-12-04 13:44:20.973209 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2025-12-04 13:44:20.973221 | controller | Thursday 04 December 2025 13:44:20 +0000 (0:00:00.306) 0:00:27.955 ***** 2025-12-04 13:44:21.284035 | controller | ok: [instance] 2025-12-04 13:44:21.596726 | controller | 2025-12-04 13:44:21.596762 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2025-12-04 13:44:21.596779 | controller | Thursday 04 December 2025 13:44:21 +0000 (0:00:00.310) 0:00:28.266 ***** 2025-12-04 13:44:21.596793 | controller | ok: [instance] 2025-12-04 13:44:21.901009 | controller | 2025-12-04 13:44:21.901041 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2025-12-04 13:44:21.901049 | controller | Thursday 04 December 2025 13:44:21 +0000 (0:00:00.312) 0:00:28.579 ***** 2025-12-04 13:44:21.901060 | controller | ok: [instance] 2025-12-04 13:44:21.921059 | controller | 2025-12-04 13:44:21.921077 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2025-12-04 13:44:21.921085 | controller | Thursday 04 December 2025 13:44:21 +0000 (0:00:00.304) 0:00:28.883 ***** 2025-12-04 13:44:21.921094 | controller | skipping: [instance] 2025-12-04 13:44:22.185635 | controller | 2025-12-04 13:44:22.185664 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2025-12-04 13:44:22.185672 | controller | Thursday 04 December 2025 13:44:21 +0000 (0:00:00.020) 0:00:28.903 ***** 2025-12-04 13:44:22.185682 | controller | ok: [instance] 2025-12-04 13:44:22.537717 | controller | 2025-12-04 13:44:22.537751 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2025-12-04 13:44:22.537761 | controller | Thursday 04 December 2025 13:44:22 +0000 (0:00:00.264) 0:00:29.168 ***** 2025-12-04 13:44:22.537774 | controller | ok: [instance] 2025-12-04 13:44:22.835842 | controller | 2025-12-04 13:44:22.835871 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2025-12-04 13:44:22.835879 | controller | Thursday 04 December 2025 13:44:22 +0000 (0:00:00.351) 0:00:29.520 ***** 2025-12-04 13:44:22.835889 | controller | changed: [instance] 2025-12-04 13:44:23.086913 | controller | 2025-12-04 13:44:23.086938 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2025-12-04 13:44:23.086946 | controller | Thursday 04 December 2025 13:44:22 +0000 (0:00:00.298) 0:00:29.818 ***** 2025-12-04 13:44:23.086971 | controller | [WARNING]: Reset is not implemented for this connection 2025-12-04 13:44:23.098050 | controller | changed: [instance] 2025-12-04 13:44:23.166733 | controller | 2025-12-04 13:44:23.166754 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2025-12-04 13:44:23.166763 | controller | Thursday 04 December 2025 13:44:23 +0000 (0:00:00.245) 0:00:30.064 ***** 2025-12-04 13:44:23.166770 | controller | 2025-12-04 13:44:23.166776 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2025-12-04 13:44:23.166782 | controller | Thursday 04 December 2025 13:44:23 +0000 (0:00:00.015) 0:00:30.079 ***** 2025-12-04 13:44:23.166792 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2025-12-04 13:44:23.166953 | controller | 2025-12-04 13:44:23.167142 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2025-12-04 13:44:23.167274 | controller | Thursday 04 December 2025 13:44:23 +0000 (0:00:00.070) 0:00:30.149 ***** 2025-12-04 13:44:23.208643 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2025-12-04 13:44:23.208832 | controller | 2025-12-04 13:44:23.209033 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 13:44:23.209197 | controller | Thursday 04 December 2025 13:44:23 +0000 (0:00:00.041) 0:00:30.191 ***** 2025-12-04 13:44:23.255173 | controller | ok: [instance] => (item=compute) 2025-12-04 13:44:23.255371 | controller | ok: [instance] => (item=controller) 2025-12-04 13:44:23.255571 | controller | ok: [instance] => (item=crc) 2025-12-04 13:44:23.255739 | controller | 2025-12-04 13:44:23.255907 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 13:44:23.256108 | controller | Thursday 04 December 2025 13:44:23 +0000 (0:00:00.046) 0:00:30.238 ***** 2025-12-04 13:44:23.295283 | controller | ok: [instance] 2025-12-04 13:44:23.295424 | controller | 2025-12-04 13:44:23.295567 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-04 13:44:23.295704 | controller | Thursday 04 December 2025 13:44:23 +0000 (0:00:00.040) 0:00:30.278 ***** 2025-12-04 13:44:23.333399 | controller | ok: [instance] => changed=false 2025-12-04 13:44:23.333562 | controller | msg: All assertions passed 2025-12-04 13:44:23.333687 | controller | 2025-12-04 13:44:23.333815 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2025-12-04 13:44:23.333936 | controller | Thursday 04 December 2025 13:44:23 +0000 (0:00:00.037) 0:00:30.316 ***** 2025-12-04 13:44:23.374780 | controller | 2025-12-04 13:44:23.374943 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2025-12-04 13:44:23.375098 | controller | Thursday 04 December 2025 13:44:23 +0000 (0:00:00.041) 0:00:30.358 ***** 2025-12-04 13:44:23.443734 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2025-12-04 13:44:23.443915 | controller | ok: [instance] => (item={}) 2025-12-04 13:44:23.444092 | controller | 2025-12-04 13:44:23.444245 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2025-12-04 13:44:23.444369 | controller | Thursday 04 December 2025 13:44:23 +0000 (0:00:00.068) 0:00:30.426 ***** 2025-12-04 13:44:23.460385 | controller | skipping: [instance] 2025-12-04 13:44:23.460538 | controller | 2025-12-04 13:44:23.460672 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2025-12-04 13:44:23.460799 | controller | Thursday 04 December 2025 13:44:23 +0000 (0:00:00.016) 0:00:30.443 ***** 2025-12-04 13:44:23.671085 | controller | ok: [instance] 2025-12-04 13:44:23.671114 | controller | 2025-12-04 13:44:23.671122 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2025-12-04 13:44:23.671131 | controller | Thursday 04 December 2025 13:44:23 +0000 (0:00:00.210) 0:00:30.653 ***** 2025-12-04 13:44:23.995123 | controller | changed: [instance] 2025-12-04 13:44:24.729056 | controller | 2025-12-04 13:44:24.729089 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2025-12-04 13:44:24.729098 | controller | Thursday 04 December 2025 13:44:23 +0000 (0:00:00.323) 0:00:30.977 ***** 2025-12-04 13:44:24.729111 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2025-12-04 13:44:24.729139 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2025-12-04 13:44:24.729146 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2025-12-04 13:44:24.729153 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2025-12-04 13:44:24.729159 | controller | 2025-12-04 13:44:24.729168 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2025-12-04 13:44:24.729186 | controller | Thursday 04 December 2025 13:44:24 +0000 (0:00:00.733) 0:00:31.711 ***** 2025-12-04 13:44:24.753901 | controller | skipping: [instance] 2025-12-04 13:44:25.112781 | controller | 2025-12-04 13:44:25.112810 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2025-12-04 13:44:25.112818 | controller | Thursday 04 December 2025 13:44:24 +0000 (0:00:00.025) 0:00:31.736 ***** 2025-12-04 13:44:25.112828 | controller | changed: [instance] 2025-12-04 13:44:26.532603 | controller | 2025-12-04 13:44:26.532635 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2025-12-04 13:44:26.532644 | controller | Thursday 04 December 2025 13:44:25 +0000 (0:00:00.350) 0:00:32.086 ***** 2025-12-04 13:44:26.532649 | controller | 2025-12-04 13:44:26.532655 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-04 13:44:26.532660 | controller | Thursday 04 December 2025 13:44:25 +0000 (0:00:00.008) 0:00:32.095 ***** 2025-12-04 13:44:26.532678 | controller | changed: [instance] 2025-12-04 13:44:26.532699 | controller | 2025-12-04 13:44:26.532706 | controller | TASK [Ensure no default networks exists] *************************************** 2025-12-04 13:44:26.607119 | controller | Thursday 04 December 2025 13:44:26 +0000 (0:00:01.420) 0:00:33.515 ***** 2025-12-04 13:44:26.607156 | controller | 2025-12-04 13:44:26.607204 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2025-12-04 13:44:26.607323 | controller | Thursday 04 December 2025 13:44:26 +0000 (0:00:00.074) 0:00:33.590 ***** 2025-12-04 13:44:27.757651 | controller | ok: [instance] 2025-12-04 13:44:27.989134 | controller | 2025-12-04 13:44:27.989179 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2025-12-04 13:44:27.989192 | controller | Thursday 04 December 2025 13:44:27 +0000 (0:00:01.150) 0:00:34.740 ***** 2025-12-04 13:44:27.989210 | controller | ok: [instance] 2025-12-04 13:44:27.989302 | controller | 2025-12-04 13:44:27.989324 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2025-12-04 13:44:27.989335 | controller | Thursday 04 December 2025 13:44:27 +0000 (0:00:00.231) 0:00:34.971 ***** 2025-12-04 13:44:28.484012 | controller | ok: [instance] 2025-12-04 13:44:28.705403 | controller | 2025-12-04 13:44:28.705434 | controller | TASK [libvirt_manager : Removing default] ************************************** 2025-12-04 13:44:28.705442 | controller | Thursday 04 December 2025 13:44:28 +0000 (0:00:00.494) 0:00:35.466 ***** 2025-12-04 13:44:28.705452 | controller | ok: [instance] 2025-12-04 13:44:29.832625 | controller | 2025-12-04 13:44:29.832659 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2025-12-04 13:44:29.832667 | controller | Thursday 04 December 2025 13:44:28 +0000 (0:00:00.221) 0:00:35.688 ***** 2025-12-04 13:44:29.832678 | controller | ok: [instance] 2025-12-04 13:44:30.136773 | controller | 2025-12-04 13:44:30.136802 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2025-12-04 13:44:30.136810 | controller | Thursday 04 December 2025 13:44:29 +0000 (0:00:01.127) 0:00:36.815 ***** 2025-12-04 13:44:30.136826 | controller | ok: [instance] 2025-12-04 13:44:30.431462 | controller | 2025-12-04 13:44:30.431503 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2025-12-04 13:44:30.431512 | controller | Thursday 04 December 2025 13:44:30 +0000 (0:00:00.304) 0:00:37.119 ***** 2025-12-04 13:44:30.431522 | controller | changed: [instance] 2025-12-04 13:44:30.724746 | controller | 2025-12-04 13:44:30.724785 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2025-12-04 13:44:30.724794 | controller | Thursday 04 December 2025 13:44:30 +0000 (0:00:00.294) 0:00:37.414 ***** 2025-12-04 13:44:30.724804 | controller | changed: [instance] 2025-12-04 13:44:31.285943 | controller | 2025-12-04 13:44:31.285989 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2025-12-04 13:44:31.285998 | controller | Thursday 04 December 2025 13:44:30 +0000 (0:00:00.293) 0:00:37.707 ***** 2025-12-04 13:44:31.286008 | controller | changed: [instance] => (item=arptables) 2025-12-04 13:44:31.591026 | controller | changed: [instance] => (item=iptables) 2025-12-04 13:44:31.591056 | controller | changed: [instance] => (item=ip6tables) 2025-12-04 13:44:31.591064 | controller | 2025-12-04 13:44:31.591070 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2025-12-04 13:44:31.591076 | controller | Thursday 04 December 2025 13:44:31 +0000 (0:00:00.560) 0:00:38.268 ***** 2025-12-04 13:44:31.591086 | controller | ok: [instance] 2025-12-04 13:44:31.676897 | controller | 2025-12-04 13:44:31.676917 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2025-12-04 13:44:31.676926 | controller | Thursday 04 December 2025 13:44:31 +0000 (0:00:00.305) 0:00:38.573 ***** 2025-12-04 13:44:31.676937 | controller | ok: [instance] 2025-12-04 13:44:31.720277 | controller | 2025-12-04 13:44:31.720323 | controller | TASK [Ensure the required network configurations are applied] ****************** 2025-12-04 13:44:31.720337 | controller | Thursday 04 December 2025 13:44:31 +0000 (0:00:00.086) 0:00:38.659 ***** 2025-12-04 13:44:31.720354 | controller | 2025-12-04 13:44:31.720383 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2025-12-04 13:44:31.720409 | controller | Thursday 04 December 2025 13:44:31 +0000 (0:00:00.043) 0:00:38.703 ***** 2025-12-04 13:44:31.742080 | controller | skipping: [instance] 2025-12-04 13:44:31.764070 | controller | 2025-12-04 13:44:31.764094 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2025-12-04 13:44:31.764104 | controller | Thursday 04 December 2025 13:44:31 +0000 (0:00:00.021) 0:00:38.724 ***** 2025-12-04 13:44:31.764115 | controller | skipping: [instance] 2025-12-04 13:44:31.787062 | controller | 2025-12-04 13:44:31.787085 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-04 13:44:31.787095 | controller | Thursday 04 December 2025 13:44:31 +0000 (0:00:00.021) 0:00:38.746 ***** 2025-12-04 13:44:31.787106 | controller | skipping: [instance] 2025-12-04 13:44:31.787165 | controller | 2025-12-04 13:44:31.787188 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2025-12-04 13:44:31.787200 | controller | Thursday 04 December 2025 13:44:31 +0000 (0:00:00.023) 0:00:38.770 ***** 2025-12-04 13:44:31.813607 | controller | skipping: [instance] 2025-12-04 13:44:31.850724 | controller | 2025-12-04 13:44:31.850746 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2025-12-04 13:44:31.850756 | controller | Thursday 04 December 2025 13:44:31 +0000 (0:00:00.026) 0:00:38.796 ***** 2025-12-04 13:44:31.850766 | controller | ok: [instance] 2025-12-04 13:44:31.850947 | controller | 2025-12-04 13:44:31.851171 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2025-12-04 13:44:31.851355 | controller | Thursday 04 December 2025 13:44:31 +0000 (0:00:00.037) 0:00:38.833 ***** 2025-12-04 13:44:31.882521 | controller | skipping: [instance] 2025-12-04 13:44:31.882693 | controller | 2025-12-04 13:44:31.882852 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2025-12-04 13:44:31.883048 | controller | Thursday 04 December 2025 13:44:31 +0000 (0:00:00.031) 0:00:38.865 ***** 2025-12-04 13:44:31.906882 | controller | skipping: [instance] 2025-12-04 13:44:31.907078 | controller | 2025-12-04 13:44:31.907255 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2025-12-04 13:44:31.907423 | controller | Thursday 04 December 2025 13:44:31 +0000 (0:00:00.024) 0:00:38.890 ***** 2025-12-04 13:44:31.959729 | controller | ok: [instance] 2025-12-04 13:44:31.959916 | controller | 2025-12-04 13:44:31.960120 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2025-12-04 13:44:31.960294 | controller | Thursday 04 December 2025 13:44:31 +0000 (0:00:00.052) 0:00:38.942 ***** 2025-12-04 13:44:31.982317 | controller | skipping: [instance] 2025-12-04 13:44:31.982585 | controller | 2025-12-04 13:44:31.982827 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2025-12-04 13:44:31.982981 | controller | Thursday 04 December 2025 13:44:31 +0000 (0:00:00.022) 0:00:38.965 ***** 2025-12-04 13:44:32.026919 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2025-12-04 13:44:32.027116 | controller | 2025-12-04 13:44:32.027281 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-12-04 13:44:32.027434 | controller | Thursday 04 December 2025 13:44:32 +0000 (0:00:00.044) 0:00:39.010 ***** 2025-12-04 13:44:32.344050 | controller | ok: [instance -> localhost] 2025-12-04 13:44:32.344373 | controller | 2025-12-04 13:44:37.118085 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2025-12-04 13:44:37.118124 | controller | Thursday 04 December 2025 13:44:32 +0000 (0:00:00.316) 0:00:39.326 ***** 2025-12-04 13:44:37.118140 | controller | changed: [instance -> localhost] 2025-12-04 13:44:37.315079 | controller | 2025-12-04 13:44:37.315114 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-12-04 13:44:37.315125 | controller | Thursday 04 December 2025 13:44:37 +0000 (0:00:04.773) 0:00:44.100 ***** 2025-12-04 13:44:37.315137 | controller | changed: [instance] 2025-12-04 13:44:37.647449 | controller | 2025-12-04 13:44:37.647490 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2025-12-04 13:44:37.647499 | controller | Thursday 04 December 2025 13:44:37 +0000 (0:00:00.197) 0:00:44.297 ***** 2025-12-04 13:44:37.647517 | controller | changed: [instance] 2025-12-04 13:44:39.246658 | controller | 2025-12-04 13:44:39.246693 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2025-12-04 13:44:39.246700 | controller | Thursday 04 December 2025 13:44:37 +0000 (0:00:00.332) 0:00:44.629 ***** 2025-12-04 13:44:39.246711 | controller | changed: [instance -> localhost] 2025-12-04 13:44:39.608123 | controller | 2025-12-04 13:44:39.608168 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2025-12-04 13:44:39.608183 | controller | Thursday 04 December 2025 13:44:39 +0000 (0:00:01.598) 0:00:46.228 ***** 2025-12-04 13:44:39.608201 | controller | changed: [instance] 2025-12-04 13:44:39.608246 | controller | 2025-12-04 13:44:39.608261 | controller | TASK [reproducer : Select right domain] **************************************** 2025-12-04 13:44:39.639074 | controller | Thursday 04 December 2025 13:44:39 +0000 (0:00:00.361) 0:00:46.590 ***** 2025-12-04 13:44:39.639107 | controller | ok: [instance] 2025-12-04 13:44:39.639215 | controller | 2025-12-04 13:44:39.639246 | controller | TASK [Create the virtual networks] ********************************************* 2025-12-04 13:44:39.639258 | controller | Thursday 04 December 2025 13:44:39 +0000 (0:00:00.031) 0:00:46.621 ***** 2025-12-04 13:44:39.750822 | controller | 2025-12-04 13:44:39.770061 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2025-12-04 13:44:39.770086 | controller | Thursday 04 December 2025 13:44:39 +0000 (0:00:00.111) 0:00:46.733 ***** 2025-12-04 13:44:39.770100 | controller | ok: [instance] 2025-12-04 13:44:39.770174 | controller | 2025-12-04 13:44:39.770195 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2025-12-04 13:44:39.770207 | controller | Thursday 04 December 2025 13:44:39 +0000 (0:00:00.019) 0:00:46.752 ***** 2025-12-04 13:44:39.961058 | controller | ok: [instance] 2025-12-04 13:44:39.961103 | controller | 2025-12-04 13:44:39.961112 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2025-12-04 13:44:39.961120 | controller | Thursday 04 December 2025 13:44:39 +0000 (0:00:00.190) 0:00:46.943 ***** 2025-12-04 13:44:39.989918 | controller | skipping: [instance] 2025-12-04 13:44:40.018730 | controller | 2025-12-04 13:44:40.018752 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2025-12-04 13:44:40.018762 | controller | Thursday 04 December 2025 13:44:39 +0000 (0:00:00.028) 0:00:46.972 ***** 2025-12-04 13:44:40.018773 | controller | skipping: [instance] 2025-12-04 13:44:40.073616 | controller | 2025-12-04 13:44:40.073635 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2025-12-04 13:44:40.073642 | controller | Thursday 04 December 2025 13:44:40 +0000 (0:00:00.028) 0:00:47.001 ***** 2025-12-04 13:44:40.073651 | controller | ok: [instance] 2025-12-04 13:44:40.196062 | controller | 2025-12-04 13:44:40.196102 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2025-12-04 13:44:40.196113 | controller | Thursday 04 December 2025 13:44:40 +0000 (0:00:00.055) 0:00:47.056 ***** 2025-12-04 13:44:40.196128 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-04 13:44:40.228854 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-04 13:44:40.228882 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-04 13:44:40.228892 | controller | 2025-12-04 13:44:40.228899 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2025-12-04 13:44:40.228906 | controller | Thursday 04 December 2025 13:44:40 +0000 (0:00:00.122) 0:00:47.178 ***** 2025-12-04 13:44:40.228925 | controller | skipping: [instance] 2025-12-04 13:44:40.560829 | controller | 2025-12-04 13:44:40.560857 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2025-12-04 13:44:40.560865 | controller | Thursday 04 December 2025 13:44:40 +0000 (0:00:00.033) 0:00:47.211 ***** 2025-12-04 13:44:40.560874 | controller | changed: [instance] 2025-12-04 13:44:40.674098 | controller | 2025-12-04 13:44:40.674136 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2025-12-04 13:44:40.674146 | controller | Thursday 04 December 2025 13:44:40 +0000 (0:00:00.331) 0:00:47.543 ***** 2025-12-04 13:44:40.674169 | controller | changed: [instance] => (item=Adding compute-0 to computes) 2025-12-04 13:44:40.674204 | controller | changed: [instance] => (item=Adding controller-0 to controllers) 2025-12-04 13:44:40.674214 | controller | changed: [instance] => (item=Adding crc-0 to ocps) 2025-12-04 13:44:40.674226 | controller | 2025-12-04 13:44:40.674400 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-04 13:44:40.699076 | controller | Thursday 04 December 2025 13:44:40 +0000 (0:00:00.112) 0:00:47.656 ***** 2025-12-04 13:44:40.699112 | controller | skipping: [instance] 2025-12-04 13:44:40.699147 | controller | 2025-12-04 13:44:40.699156 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-04 13:44:40.699165 | controller | Thursday 04 December 2025 13:44:40 +0000 (0:00:00.025) 0:00:47.681 ***** 2025-12-04 13:44:40.724073 | controller | skipping: [instance] 2025-12-04 13:44:40.747473 | controller | 2025-12-04 13:44:40.747496 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-04 13:44:40.747504 | controller | Thursday 04 December 2025 13:44:40 +0000 (0:00:00.024) 0:00:47.706 ***** 2025-12-04 13:44:40.747513 | controller | skipping: [instance] 2025-12-04 13:44:40.770724 | controller | 2025-12-04 13:44:40.770746 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-04 13:44:40.770756 | controller | Thursday 04 December 2025 13:44:40 +0000 (0:00:00.023) 0:00:47.730 ***** 2025-12-04 13:44:40.770766 | controller | skipping: [instance] 2025-12-04 13:44:40.770940 | controller | 2025-12-04 13:44:40.771149 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-04 13:44:40.771324 | controller | Thursday 04 December 2025 13:44:40 +0000 (0:00:00.023) 0:00:47.753 ***** 2025-12-04 13:44:40.789620 | controller | ok: [instance] 2025-12-04 13:44:40.789807 | controller | 2025-12-04 13:44:40.790026 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-04 13:44:40.790207 | controller | Thursday 04 December 2025 13:44:40 +0000 (0:00:00.018) 0:00:47.772 ***** 2025-12-04 13:44:40.864126 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-12-04 13:44:40.864279 | controller | 2025-12-04 13:44:40.864619 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-04 13:44:40.864721 | controller | Thursday 04 December 2025 13:44:40 +0000 (0:00:00.074) 0:00:47.846 ***** 2025-12-04 13:44:40.882607 | controller | skipping: [instance] 2025-12-04 13:44:40.882696 | controller | 2025-12-04 13:44:40.882717 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-04 13:44:40.882927 | controller | Thursday 04 December 2025 13:44:40 +0000 (0:00:00.018) 0:00:47.865 ***** 2025-12-04 13:44:41.086018 | controller | changed: [instance] 2025-12-04 13:44:41.480169 | controller | 2025-12-04 13:44:41.480219 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-04 13:44:41.480233 | controller | Thursday 04 December 2025 13:44:41 +0000 (0:00:00.203) 0:00:48.068 ***** 2025-12-04 13:44:41.480251 | controller | changed: [instance] 2025-12-04 13:44:41.480281 | controller | 2025-12-04 13:44:41.480295 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-04 13:44:41.537425 | controller | Thursday 04 December 2025 13:44:41 +0000 (0:00:00.394) 0:00:48.462 ***** 2025-12-04 13:44:41.537486 | controller | ok: [instance] 2025-12-04 13:44:41.537524 | controller | 2025-12-04 13:44:41.537562 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-04 13:44:41.537688 | controller | Thursday 04 December 2025 13:44:41 +0000 (0:00:00.057) 0:00:48.520 ***** 2025-12-04 13:44:41.567066 | controller | ok: [instance] 2025-12-04 13:44:41.567232 | controller | 2025-12-04 13:44:41.567269 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-04 13:44:41.567304 | controller | Thursday 04 December 2025 13:44:41 +0000 (0:00:00.029) 0:00:48.550 ***** 2025-12-04 13:44:41.942094 | controller | changed: [instance] 2025-12-04 13:44:41.942170 | controller | 2025-12-04 13:44:41.942280 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2025-12-04 13:44:41.942426 | controller | Thursday 04 December 2025 13:44:41 +0000 (0:00:00.375) 0:00:48.925 ***** 2025-12-04 13:44:42.017855 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2025-12-04 13:44:42.065916 | controller | 2025-12-04 13:44:42.065934 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2025-12-04 13:44:42.065946 | controller | Thursday 04 December 2025 13:44:42 +0000 (0:00:00.075) 0:00:49.000 ***** 2025-12-04 13:44:42.065955 | controller | ok: [instance] => (item=public) 2025-12-04 13:44:42.494488 | controller | ok: [instance] => (item=osp_trunk) 2025-12-04 13:44:42.494513 | controller | 2025-12-04 13:44:42.494521 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2025-12-04 13:44:42.494527 | controller | Thursday 04 December 2025 13:44:42 +0000 (0:00:00.047) 0:00:49.048 ***** 2025-12-04 13:44:42.494536 | controller | changed: [instance] => (item=cifmw-public) 2025-12-04 13:44:43.068659 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-04 13:44:43.068688 | controller | 2025-12-04 13:44:43.068696 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2025-12-04 13:44:43.068702 | controller | Thursday 04 December 2025 13:44:42 +0000 (0:00:00.428) 0:00:49.477 ***** 2025-12-04 13:44:43.068712 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 13:44:43.500113 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 13:44:43.500162 | controller | 2025-12-04 13:44:43.500172 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2025-12-04 13:44:43.500179 | controller | Thursday 04 December 2025 13:44:43 +0000 (0:00:00.574) 0:00:50.051 ***** 2025-12-04 13:44:43.500191 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 13:44:43.500210 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 13:44:43.500219 | controller | 2025-12-04 13:44:43.500244 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2025-12-04 13:44:43.500378 | controller | Thursday 04 December 2025 13:44:43 +0000 (0:00:00.431) 0:00:50.483 ***** 2025-12-04 13:44:43.920052 | controller | changed: [instance] => (item=cifmw-public) 2025-12-04 13:44:43.976147 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-04 13:44:43.976192 | controller | 2025-12-04 13:44:43.976203 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2025-12-04 13:44:43.976212 | controller | Thursday 04 December 2025 13:44:43 +0000 (0:00:00.419) 0:00:50.902 ***** 2025-12-04 13:44:43.976226 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2025-12-04 13:44:43.976263 | controller | 2025-12-04 13:44:43.976588 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2025-12-04 13:44:44.156108 | controller | Thursday 04 December 2025 13:44:43 +0000 (0:00:00.056) 0:00:50.958 ***** 2025-12-04 13:44:44.156147 | controller | ok: [instance] 2025-12-04 13:44:44.156202 | controller | 2025-12-04 13:44:44.156233 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2025-12-04 13:44:44.156252 | controller | Thursday 04 December 2025 13:44:44 +0000 (0:00:00.179) 0:00:51.138 ***** 2025-12-04 13:44:44.539707 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 13:44:44.609086 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 13:44:44.609120 | controller | 2025-12-04 13:44:44.609130 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2025-12-04 13:44:44.609137 | controller | Thursday 04 December 2025 13:44:44 +0000 (0:00:00.383) 0:00:51.522 ***** 2025-12-04 13:44:44.609149 | controller | 2025-12-04 13:44:44.609429 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-12-04 13:44:44.644088 | controller | Thursday 04 December 2025 13:44:44 +0000 (0:00:00.069) 0:00:51.592 ***** 2025-12-04 13:44:44.644121 | controller | skipping: [instance] 2025-12-04 13:44:44.644148 | controller | 2025-12-04 13:44:44.644536 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2025-12-04 13:44:45.865080 | controller | Thursday 04 December 2025 13:44:44 +0000 (0:00:00.034) 0:00:51.626 ***** 2025-12-04 13:44:45.865122 | controller | ok: [instance] 2025-12-04 13:44:45.865152 | controller | 2025-12-04 13:44:45.865159 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-12-04 13:44:45.865166 | controller | Thursday 04 December 2025 13:44:45 +0000 (0:00:01.220) 0:00:52.847 ***** 2025-12-04 13:44:46.082583 | controller | ok: [instance] 2025-12-04 13:44:46.492591 | controller | 2025-12-04 13:44:46.492621 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2025-12-04 13:44:46.492629 | controller | Thursday 04 December 2025 13:44:46 +0000 (0:00:00.217) 0:00:53.065 ***** 2025-12-04 13:44:46.492639 | controller | changed: [instance] 2025-12-04 13:44:48.150672 | controller | 2025-12-04 13:44:48.150704 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2025-12-04 13:44:48.150712 | controller | Thursday 04 December 2025 13:44:46 +0000 (0:00:00.410) 0:00:53.475 ***** 2025-12-04 13:44:48.150723 | controller | changed: [instance] 2025-12-04 13:44:48.502079 | controller | 2025-12-04 13:44:48.502114 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2025-12-04 13:44:48.502122 | controller | Thursday 04 December 2025 13:44:48 +0000 (0:00:01.658) 0:00:55.133 ***** 2025-12-04 13:44:48.502134 | controller | changed: [instance] 2025-12-04 13:44:48.502160 | controller | 2025-12-04 13:44:48.502168 | controller | TASK [Create extra network configuration] ************************************** 2025-12-04 13:44:48.502288 | controller | Thursday 04 December 2025 13:44:48 +0000 (0:00:00.351) 0:00:55.485 ***** 2025-12-04 13:44:48.535731 | controller | skipping: [instance] 2025-12-04 13:44:48.535817 | controller | 2025-12-04 13:44:48.535832 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2025-12-04 13:44:48.535911 | controller | Thursday 04 December 2025 13:44:48 +0000 (0:00:00.033) 0:00:55.518 ***** 2025-12-04 13:44:48.565106 | controller | skipping: [instance] 2025-12-04 13:44:48.565169 | controller | 2025-12-04 13:44:48.565186 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2025-12-04 13:44:48.565287 | controller | Thursday 04 December 2025 13:44:48 +0000 (0:00:00.029) 0:00:55.548 ***** 2025-12-04 13:44:49.004107 | controller | ok: [instance] 2025-12-04 13:44:49.004160 | controller | 2025-12-04 13:44:49.004170 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2025-12-04 13:44:49.004180 | controller | Thursday 04 December 2025 13:44:49 +0000 (0:00:00.438) 0:00:55.986 ***** 2025-12-04 13:44:49.150007 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 13:44:50.296417 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 13:44:50.296449 | controller | 2025-12-04 13:44:50.296471 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2025-12-04 13:44:50.296478 | controller | Thursday 04 December 2025 13:44:49 +0000 (0:00:00.145) 0:00:56.132 ***** 2025-12-04 13:44:50.296488 | controller | ok: [instance] 2025-12-04 13:44:53.948048 | controller | 2025-12-04 13:44:53.948082 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2025-12-04 13:44:53.948091 | controller | Thursday 04 December 2025 13:44:50 +0000 (0:00:01.146) 0:00:57.278 ***** 2025-12-04 13:44:53.948102 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2025-12-04 13:44:53.948127 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2025-12-04 13:44:53.948582 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2025-12-04 13:44:54.169588 | controller | 2025-12-04 13:44:54.169617 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2025-12-04 13:44:54.169626 | controller | Thursday 04 December 2025 13:44:53 +0000 (0:00:03.651) 0:01:00.930 ***** 2025-12-04 13:44:54.169636 | controller | changed: [instance] 2025-12-04 13:44:54.528393 | controller | 2025-12-04 13:44:54.528424 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2025-12-04 13:44:54.528433 | controller | Thursday 04 December 2025 13:44:54 +0000 (0:00:00.221) 0:01:01.152 ***** 2025-12-04 13:44:54.528444 | controller | changed: [instance] 2025-12-04 13:44:54.918639 | controller | 2025-12-04 13:44:54.918665 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2025-12-04 13:44:54.918673 | controller | Thursday 04 December 2025 13:44:54 +0000 (0:00:00.358) 0:01:01.511 ***** 2025-12-04 13:44:54.918683 | controller | changed: [instance] 2025-12-04 13:44:54.951419 | controller | 2025-12-04 13:44:54.951444 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2025-12-04 13:44:54.951463 | controller | Thursday 04 December 2025 13:44:54 +0000 (0:00:00.390) 0:01:01.901 ***** 2025-12-04 13:44:54.951473 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2025-12-04 13:44:55.361756 | controller | 2025-12-04 13:44:55.361778 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2025-12-04 13:44:55.361786 | controller | Thursday 04 December 2025 13:44:54 +0000 (0:00:00.032) 0:01:01.934 ***** 2025-12-04 13:44:55.361796 | controller | changed: [instance] 2025-12-04 13:44:55.381761 | controller | 2025-12-04 13:44:55.381778 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2025-12-04 13:44:55.381785 | controller | Thursday 04 December 2025 13:44:55 +0000 (0:00:00.410) 0:01:02.344 ***** 2025-12-04 13:44:55.381793 | controller | skipping: [instance] 2025-12-04 13:44:55.415079 | controller | 2025-12-04 13:44:55.415132 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2025-12-04 13:44:55.415144 | controller | Thursday 04 December 2025 13:44:55 +0000 (0:00:00.020) 0:01:02.364 ***** 2025-12-04 13:44:55.415159 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2025-12-04 13:44:55.784630 | controller | 2025-12-04 13:44:55.784658 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2025-12-04 13:44:55.784667 | controller | Thursday 04 December 2025 13:44:55 +0000 (0:00:00.032) 0:01:02.397 ***** 2025-12-04 13:44:55.784677 | controller | changed: [instance] 2025-12-04 13:44:55.804438 | controller | 2025-12-04 13:44:55.804477 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2025-12-04 13:44:55.804487 | controller | Thursday 04 December 2025 13:44:55 +0000 (0:00:00.369) 0:01:02.767 ***** 2025-12-04 13:44:55.804497 | controller | skipping: [instance] 2025-12-04 13:44:56.014049 | controller | 2025-12-04 13:44:56.014081 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2025-12-04 13:44:56.014090 | controller | Thursday 04 December 2025 13:44:55 +0000 (0:00:00.019) 0:01:02.787 ***** 2025-12-04 13:44:56.014102 | controller | ok: [instance] => (item=127.0.0.2) 2025-12-04 13:44:56.014127 | controller | 2025-12-04 13:44:56.014135 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2025-12-04 13:44:56.014264 | controller | Thursday 04 December 2025 13:44:56 +0000 (0:00:00.209) 0:01:02.997 ***** 2025-12-04 13:44:56.692002 | controller | changed: [instance] 2025-12-04 13:44:56.712423 | controller | 2025-12-04 13:44:56.712444 | controller | TASK [dnsmasq : Stop service] ************************************************** 2025-12-04 13:44:56.712468 | controller | Thursday 04 December 2025 13:44:56 +0000 (0:00:00.677) 0:01:03.674 ***** 2025-12-04 13:44:56.712480 | controller | skipping: [instance] 2025-12-04 13:44:56.732463 | controller | 2025-12-04 13:44:56.732485 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2025-12-04 13:44:56.732495 | controller | Thursday 04 December 2025 13:44:56 +0000 (0:00:00.020) 0:01:03.695 ***** 2025-12-04 13:44:56.732506 | controller | skipping: [instance] 2025-12-04 13:44:56.762898 | controller | 2025-12-04 13:44:56.762915 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2025-12-04 13:44:56.762921 | controller | Thursday 04 December 2025 13:44:56 +0000 (0:00:00.019) 0:01:03.715 ***** 2025-12-04 13:44:56.762930 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-12-04 13:44:56.878015 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2025-12-04 13:44:56.878034 | controller | skipping: [instance] 2025-12-04 13:44:56.878041 | controller | 2025-12-04 13:44:56.878047 | controller | TASK [Create dnsmasq networks] ************************************************* 2025-12-04 13:44:56.878052 | controller | Thursday 04 December 2025 13:44:56 +0000 (0:00:00.030) 0:01:03.745 ***** 2025-12-04 13:44:56.878060 | controller | 2025-12-04 13:44:56.907186 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-12-04 13:44:56.907239 | controller | Thursday 04 December 2025 13:44:56 +0000 (0:00:00.115) 0:01:03.860 ***** 2025-12-04 13:44:56.907262 | controller | ok: [instance] => changed=false 2025-12-04 13:44:56.907304 | controller | msg: All assertions passed 2025-12-04 13:44:56.907316 | controller | 2025-12-04 13:44:56.907327 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-12-04 13:44:56.907340 | controller | Thursday 04 December 2025 13:44:56 +0000 (0:00:00.029) 0:01:03.889 ***** 2025-12-04 13:44:56.944154 | controller | ok: [instance] => changed=false 2025-12-04 13:44:56.944381 | controller | msg: All assertions passed 2025-12-04 13:44:56.944589 | controller | 2025-12-04 13:44:56.944785 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-12-04 13:44:56.944986 | controller | Thursday 04 December 2025 13:44:56 +0000 (0:00:00.037) 0:01:03.927 ***** 2025-12-04 13:44:57.381575 | controller | changed: [instance] 2025-12-04 13:44:57.402681 | controller | 2025-12-04 13:44:57.402704 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-12-04 13:44:57.402719 | controller | Thursday 04 December 2025 13:44:57 +0000 (0:00:00.437) 0:01:04.364 ***** 2025-12-04 13:44:57.402732 | controller | skipping: [instance] 2025-12-04 13:44:57.428847 | controller | 2025-12-04 13:44:57.428872 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-12-04 13:44:57.428881 | controller | Thursday 04 December 2025 13:44:57 +0000 (0:00:00.021) 0:01:04.385 ***** 2025-12-04 13:44:57.428893 | controller | skipping: [instance] 2025-12-04 13:44:57.459830 | controller | 2025-12-04 13:44:57.459851 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-12-04 13:44:57.459859 | controller | Thursday 04 December 2025 13:44:57 +0000 (0:00:00.026) 0:01:04.411 ***** 2025-12-04 13:44:57.459877 | controller | ok: [instance] => changed=false 2025-12-04 13:44:57.497073 | controller | msg: All assertions passed 2025-12-04 13:44:57.497096 | controller | 2025-12-04 13:44:57.497104 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-12-04 13:44:57.497110 | controller | Thursday 04 December 2025 13:44:57 +0000 (0:00:00.031) 0:01:04.442 ***** 2025-12-04 13:44:57.497119 | controller | ok: [instance] => changed=false 2025-12-04 13:44:57.497152 | controller | msg: All assertions passed 2025-12-04 13:44:57.497159 | controller | 2025-12-04 13:44:57.497166 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-12-04 13:44:57.497226 | controller | Thursday 04 December 2025 13:44:57 +0000 (0:00:00.037) 0:01:04.479 ***** 2025-12-04 13:44:57.936492 | controller | changed: [instance] 2025-12-04 13:44:57.956042 | controller | 2025-12-04 13:44:57.956063 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-12-04 13:44:57.956071 | controller | Thursday 04 December 2025 13:44:57 +0000 (0:00:00.439) 0:01:04.919 ***** 2025-12-04 13:44:57.956080 | controller | skipping: [instance] 2025-12-04 13:44:57.956241 | controller | 2025-12-04 13:44:57.956251 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-12-04 13:44:57.956381 | controller | Thursday 04 December 2025 13:44:57 +0000 (0:00:00.020) 0:01:04.939 ***** 2025-12-04 13:44:57.982913 | controller | skipping: [instance] 2025-12-04 13:44:57.983067 | controller | 2025-12-04 13:44:57.983195 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2025-12-04 13:44:57.983317 | controller | Thursday 04 December 2025 13:44:57 +0000 (0:00:00.026) 0:01:04.966 ***** 2025-12-04 13:44:58.015299 | controller | skipping: [instance] 2025-12-04 13:44:58.015399 | controller | 2025-12-04 13:44:58.015536 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2025-12-04 13:44:58.015658 | controller | Thursday 04 December 2025 13:44:58 +0000 (0:00:00.032) 0:01:04.998 ***** 2025-12-04 13:44:58.513304 | controller | changed: [instance] => (item=cifmw-public) 2025-12-04 13:44:58.513690 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-04 13:44:58.553476 | controller | 2025-12-04 13:44:58.553499 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-04 13:44:58.553507 | controller | Thursday 04 December 2025 13:44:58 +0000 (0:00:00.492) 0:01:05.491 ***** 2025-12-04 13:44:58.553517 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2025-12-04 13:44:58.885586 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2025-12-04 13:44:58.885616 | controller | 2025-12-04 13:44:58.885625 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-04 13:44:58.885631 | controller | Thursday 04 December 2025 13:44:58 +0000 (0:00:00.045) 0:01:05.536 ***** 2025-12-04 13:44:58.885641 | controller | ok: [instance] 2025-12-04 13:44:58.922386 | controller | 2025-12-04 13:44:58.922409 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-12-04 13:44:58.922418 | controller | Thursday 04 December 2025 13:44:58 +0000 (0:00:00.332) 0:01:05.868 ***** 2025-12-04 13:44:58.922428 | controller | ok: [instance] 2025-12-04 13:44:59.127855 | controller | 2025-12-04 13:44:59.127888 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-04 13:44:59.127899 | controller | Thursday 04 December 2025 13:44:58 +0000 (0:00:00.037) 0:01:05.905 ***** 2025-12-04 13:44:59.127912 | controller | ok: [instance] 2025-12-04 13:44:59.162575 | controller | 2025-12-04 13:44:59.162598 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-12-04 13:44:59.162607 | controller | Thursday 04 December 2025 13:44:59 +0000 (0:00:00.205) 0:01:06.110 ***** 2025-12-04 13:44:59.162619 | controller | ok: [instance] 2025-12-04 13:44:59.509059 | controller | 2025-12-04 13:44:59.509092 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2025-12-04 13:44:59.509100 | controller | Thursday 04 December 2025 13:44:59 +0000 (0:00:00.034) 0:01:06.145 ***** 2025-12-04 13:44:59.509116 | controller | changed: [instance] 2025-12-04 13:44:59.849096 | controller | 2025-12-04 13:44:59.849130 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2025-12-04 13:44:59.849141 | controller | Thursday 04 December 2025 13:44:59 +0000 (0:00:00.345) 0:01:06.490 ***** 2025-12-04 13:44:59.849153 | controller | changed: [instance] 2025-12-04 13:44:59.849184 | controller | 2025-12-04 13:44:59.849194 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2025-12-04 13:44:59.849221 | controller | Thursday 04 December 2025 13:44:59 +0000 (0:00:00.341) 0:01:06.832 ***** 2025-12-04 13:45:00.188108 | controller | changed: [instance] 2025-12-04 13:45:00.281913 | controller | 2025-12-04 13:45:00.281939 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2025-12-04 13:45:00.281947 | controller | Thursday 04 December 2025 13:45:00 +0000 (0:00:00.338) 0:01:07.170 ***** 2025-12-04 13:45:00.281973 | controller | ok: [instance] 2025-12-04 13:45:00.627847 | controller | 2025-12-04 13:45:00.627880 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2025-12-04 13:45:00.627891 | controller | Thursday 04 December 2025 13:45:00 +0000 (0:00:00.094) 0:01:07.264 ***** 2025-12-04 13:45:00.627904 | controller | changed: [instance] 2025-12-04 13:45:00.652813 | controller | 2025-12-04 13:45:00.652832 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-04 13:45:00.652841 | controller | Thursday 04 December 2025 13:45:00 +0000 (0:00:00.345) 0:01:07.610 ***** 2025-12-04 13:45:00.652851 | controller | skipping: [instance] 2025-12-04 13:45:00.678418 | controller | 2025-12-04 13:45:00.678434 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-04 13:45:00.678441 | controller | Thursday 04 December 2025 13:45:00 +0000 (0:00:00.025) 0:01:07.635 ***** 2025-12-04 13:45:00.678460 | controller | skipping: [instance] 2025-12-04 13:45:00.704358 | controller | 2025-12-04 13:45:00.704374 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-04 13:45:00.704381 | controller | Thursday 04 December 2025 13:45:00 +0000 (0:00:00.025) 0:01:07.661 ***** 2025-12-04 13:45:00.704389 | controller | skipping: [instance] 2025-12-04 13:45:00.730169 | controller | 2025-12-04 13:45:00.730209 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-04 13:45:00.730220 | controller | Thursday 04 December 2025 13:45:00 +0000 (0:00:00.025) 0:01:07.687 ***** 2025-12-04 13:45:00.730233 | controller | skipping: [instance] 2025-12-04 13:45:00.751390 | controller | 2025-12-04 13:45:00.751410 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-04 13:45:00.751423 | controller | Thursday 04 December 2025 13:45:00 +0000 (0:00:00.025) 0:01:07.712 ***** 2025-12-04 13:45:00.751433 | controller | ok: [instance] 2025-12-04 13:45:00.841670 | controller | 2025-12-04 13:45:00.841689 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-04 13:45:00.841697 | controller | Thursday 04 December 2025 13:45:00 +0000 (0:00:00.021) 0:01:07.734 ***** 2025-12-04 13:45:00.841708 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-12-04 13:45:00.860980 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-12-04 13:45:00.861006 | controller | 2025-12-04 13:45:00.861016 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-04 13:45:00.861024 | controller | Thursday 04 December 2025 13:45:00 +0000 (0:00:00.090) 0:01:07.824 ***** 2025-12-04 13:45:00.861035 | controller | skipping: [instance] 2025-12-04 13:45:00.861230 | controller | 2025-12-04 13:45:00.861422 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-04 13:45:00.861575 | controller | Thursday 04 December 2025 13:45:00 +0000 (0:00:00.019) 0:01:07.844 ***** 2025-12-04 13:45:01.068910 | controller | ok: [instance] 2025-12-04 13:45:01.468094 | controller | 2025-12-04 13:45:01.468133 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-04 13:45:01.468144 | controller | Thursday 04 December 2025 13:45:01 +0000 (0:00:00.207) 0:01:08.051 ***** 2025-12-04 13:45:01.468157 | controller | changed: [instance] 2025-12-04 13:45:01.532712 | controller | 2025-12-04 13:45:01.532737 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-04 13:45:01.532745 | controller | Thursday 04 December 2025 13:45:01 +0000 (0:00:00.399) 0:01:08.451 ***** 2025-12-04 13:45:01.532754 | controller | ok: [instance] 2025-12-04 13:45:01.565927 | controller | 2025-12-04 13:45:01.565945 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-04 13:45:01.565952 | controller | Thursday 04 December 2025 13:45:01 +0000 (0:00:00.064) 0:01:08.515 ***** 2025-12-04 13:45:01.565978 | controller | ok: [instance] 2025-12-04 13:45:01.975042 | controller | 2025-12-04 13:45:01.975077 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-04 13:45:01.975090 | controller | Thursday 04 December 2025 13:45:01 +0000 (0:00:00.032) 0:01:08.548 ***** 2025-12-04 13:45:01.975106 | controller | changed: [instance] 2025-12-04 13:45:01.975541 | controller | 2025-12-04 13:45:01.975576 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2025-12-04 13:45:02.005113 | controller | Thursday 04 December 2025 13:45:01 +0000 (0:00:00.409) 0:01:08.957 ***** 2025-12-04 13:45:02.005169 | controller | ok: [instance] 2025-12-04 13:45:02.024730 | controller | 2025-12-04 13:45:02.024752 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2025-12-04 13:45:02.024760 | controller | Thursday 04 December 2025 13:45:02 +0000 (0:00:00.030) 0:01:08.987 ***** 2025-12-04 13:45:02.024769 | controller | ok: [instance] 2025-12-04 13:45:02.073890 | controller | 2025-12-04 13:45:02.073907 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2025-12-04 13:45:02.073914 | controller | Thursday 04 December 2025 13:45:02 +0000 (0:00:00.019) 0:01:09.007 ***** 2025-12-04 13:45:02.073923 | controller | ok: [instance] 2025-12-04 13:45:02.148136 | controller | 2025-12-04 13:45:02.148178 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2025-12-04 13:45:02.148189 | controller | Thursday 04 December 2025 13:45:02 +0000 (0:00:00.049) 0:01:09.056 ***** 2025-12-04 13:45:02.148204 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2025-12-04 13:45:02.148236 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2025-12-04 13:45:02.148991 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2025-12-04 13:45:02.149018 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2025-12-04 13:45:02.289117 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2025-12-04 13:45:02.289141 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2025-12-04 13:45:02.289149 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2025-12-04 13:45:02.289155 | controller | 2025-12-04 13:45:02.289161 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 13:45:02.289167 | controller | Thursday 04 December 2025 13:45:02 +0000 (0:00:00.074) 0:01:09.131 ***** 2025-12-04 13:45:02.289176 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2025-12-04 13:45:02.372080 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2025-12-04 13:45:02.372104 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2025-12-04 13:45:02.372113 | controller | 2025-12-04 13:45:02.372121 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 13:45:02.372127 | controller | Thursday 04 December 2025 13:45:02 +0000 (0:00:00.140) 0:01:09.271 ***** 2025-12-04 13:45:02.372138 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2025-12-04 13:45:02.372169 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2025-12-04 13:45:02.372179 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2025-12-04 13:45:02.372578 | controller | skipping: [instance] 2025-12-04 13:45:02.454116 | controller | 2025-12-04 13:45:02.454140 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 13:45:02.454149 | controller | Thursday 04 December 2025 13:45:02 +0000 (0:00:00.083) 0:01:09.355 ***** 2025-12-04 13:45:02.454160 | controller | skipping: [instance] => (item=compute-0 - storage) 2025-12-04 13:45:02.454189 | controller | skipping: [instance] => (item=controller-0 - storage) 2025-12-04 13:45:02.454197 | controller | skipping: [instance] => (item=crc-0 - storage) 2025-12-04 13:45:02.454203 | controller | skipping: [instance] 2025-12-04 13:45:02.454211 | controller | 2025-12-04 13:45:02.454372 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 13:45:02.534130 | controller | Thursday 04 December 2025 13:45:02 +0000 (0:00:00.081) 0:01:09.437 ***** 2025-12-04 13:45:02.534164 | controller | skipping: [instance] => (item=compute-0 - tenant) 2025-12-04 13:45:02.534233 | controller | skipping: [instance] => (item=controller-0 - tenant) 2025-12-04 13:45:02.534245 | controller | skipping: [instance] => (item=crc-0 - tenant) 2025-12-04 13:45:02.534252 | controller | skipping: [instance] 2025-12-04 13:45:02.534258 | controller | 2025-12-04 13:45:02.534267 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 13:45:02.534387 | controller | Thursday 04 December 2025 13:45:02 +0000 (0:00:00.079) 0:01:09.516 ***** 2025-12-04 13:45:02.611003 | controller | skipping: [instance] => (item=compute-0 - external) 2025-12-04 13:45:02.611099 | controller | skipping: [instance] => (item=controller-0 - external) 2025-12-04 13:45:02.611254 | controller | skipping: [instance] => (item=crc-0 - external) 2025-12-04 13:45:02.611339 | controller | skipping: [instance] 2025-12-04 13:45:02.611454 | controller | 2025-12-04 13:45:02.611562 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 13:45:02.611684 | controller | Thursday 04 December 2025 13:45:02 +0000 (0:00:00.077) 0:01:09.594 ***** 2025-12-04 13:45:02.690879 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2025-12-04 13:45:02.691164 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2025-12-04 13:45:02.691192 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2025-12-04 13:45:02.691207 | controller | skipping: [instance] 2025-12-04 13:45:02.691344 | controller | 2025-12-04 13:45:02.691440 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-04 13:45:02.691604 | controller | Thursday 04 December 2025 13:45:02 +0000 (0:00:00.079) 0:01:09.673 ***** 2025-12-04 13:45:02.829504 | controller | ok: [instance] => (item=compute-0 - public) 2025-12-04 13:45:02.829670 | controller | ok: [instance] => (item=controller-0 - public) 2025-12-04 13:45:02.829784 | controller | ok: [instance] => (item=crc-0 - public) 2025-12-04 13:45:02.829931 | controller | 2025-12-04 13:45:02.830060 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2025-12-04 13:45:02.830195 | controller | Thursday 04 December 2025 13:45:02 +0000 (0:00:00.139) 0:01:09.812 ***** 2025-12-04 13:45:02.944435 | controller | 2025-12-04 13:45:02.944637 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2025-12-04 13:45:02.944770 | controller | Thursday 04 December 2025 13:45:02 +0000 (0:00:00.114) 0:01:09.927 ***** 2025-12-04 13:45:02.982548 | controller | ok: [instance] 2025-12-04 13:45:02.982681 | controller | 2025-12-04 13:45:02.982859 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2025-12-04 13:45:02.982976 | controller | Thursday 04 December 2025 13:45:02 +0000 (0:00:00.038) 0:01:09.965 ***** 2025-12-04 13:45:03.082004 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:a3:cb:98', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-12-04 13:45:03.082270 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:18:b7:34', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-12-04 13:45:03.082353 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:bf:0a:45', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-12-04 13:45:03.082529 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:58:86:ae', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-12-04 13:45:03.082687 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:ab:09:fe', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-12-04 13:45:03.082830 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:43:b8:f7', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-12-04 13:45:03.082930 | controller | 2025-12-04 13:45:03.083066 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2025-12-04 13:45:03.083190 | controller | Thursday 04 December 2025 13:45:03 +0000 (0:00:00.099) 0:01:10.065 ***** 2025-12-04 13:45:03.133087 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2025-12-04 13:45:03.133260 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2025-12-04 13:45:03.133397 | controller | 2025-12-04 13:45:03.133554 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-12-04 13:45:03.133695 | controller | Thursday 04 December 2025 13:45:03 +0000 (0:00:00.051) 0:01:10.116 ***** 2025-12-04 13:45:03.312611 | controller | ok: [instance] 2025-12-04 13:45:03.335120 | controller | 2025-12-04 13:45:03.335141 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-12-04 13:45:03.335155 | controller | Thursday 04 December 2025 13:45:03 +0000 (0:00:00.178) 0:01:10.295 ***** 2025-12-04 13:45:03.335164 | controller | ok: [instance] 2025-12-04 13:45:03.520837 | controller | 2025-12-04 13:45:03.520870 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-12-04 13:45:03.520879 | controller | Thursday 04 December 2025 13:45:03 +0000 (0:00:00.023) 0:01:10.318 ***** 2025-12-04 13:45:03.520890 | controller | ok: [instance] 2025-12-04 13:45:03.544683 | controller | 2025-12-04 13:45:03.544706 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-12-04 13:45:03.544714 | controller | Thursday 04 December 2025 13:45:03 +0000 (0:00:00.185) 0:01:10.503 ***** 2025-12-04 13:45:03.544724 | controller | ok: [instance] 2025-12-04 13:45:03.564954 | controller | 2025-12-04 13:45:03.564999 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2025-12-04 13:45:03.565008 | controller | Thursday 04 December 2025 13:45:03 +0000 (0:00:00.024) 0:01:10.527 ***** 2025-12-04 13:45:03.565019 | controller | ok: [instance] 2025-12-04 13:45:03.743164 | controller | 2025-12-04 13:45:03.743206 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2025-12-04 13:45:03.743224 | controller | Thursday 04 December 2025 13:45:03 +0000 (0:00:00.020) 0:01:10.547 ***** 2025-12-04 13:45:03.743237 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:a3:cb:98', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-12-04 13:45:03.743271 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:18:b7:34', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-12-04 13:45:03.743278 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:bf:0a:45', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-12-04 13:45:03.743285 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:58:86:ae', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-12-04 13:45:03.743295 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:ab:09:fe', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-12-04 13:45:03.743662 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:43:b8:f7', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-12-04 13:45:03.780130 | controller | 2025-12-04 13:45:03.780156 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2025-12-04 13:45:03.780166 | controller | Thursday 04 December 2025 13:45:03 +0000 (0:00:00.177) 0:01:10.725 ***** 2025-12-04 13:45:03.780177 | controller | ok: [instance] 2025-12-04 13:45:05.814054 | controller | 2025-12-04 13:45:05.814089 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2025-12-04 13:45:05.814100 | controller | Thursday 04 December 2025 13:45:03 +0000 (0:00:00.037) 0:01:10.762 ***** 2025-12-04 13:45:05.814114 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:a3:cb:98', 'entry': 'set:compute,52:54:00:a3:cb:98,192.168.140.100,compute-0', 'state': 'present'}) 2025-12-04 13:45:05.814158 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:18:b7:34', 'entry': 'set:controller,52:54:01:18:b7:34,192.168.140.9,controller-0', 'state': 'present'}) 2025-12-04 13:45:05.814167 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:bf:0a:45', 'entry': 'set:ocp,52:54:02:bf:0a:45,192.168.140.10,crc-0', 'state': 'present'}) 2025-12-04 13:45:05.814175 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:58:86:ae', 'entry': 'set:compute,52:54:00:58:86:ae,192.168.101.100,compute-0', 'state': 'present'}) 2025-12-04 13:45:05.814182 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:ab:09:fe', 'entry': 'set:controller,52:54:01:ab:09:fe,192.168.101.9,controller-0', 'state': 'present'}) 2025-12-04 13:45:05.814190 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:43:b8:f7', 'entry': 'set:ocp,52:54:02:43:b8:f7,192.168.101.10,crc-0', 'state': 'present'}) 2025-12-04 13:45:05.814201 | controller | 2025-12-04 13:45:05.814211 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2025-12-04 13:45:05.839016 | controller | Thursday 04 December 2025 13:45:05 +0000 (0:00:02.033) 0:01:12.796 ***** 2025-12-04 13:45:05.839054 | controller | skipping: [instance] 2025-12-04 13:45:06.053774 | controller | 2025-12-04 13:45:06.053793 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2025-12-04 13:45:06.053801 | controller | Thursday 04 December 2025 13:45:05 +0000 (0:00:00.025) 0:01:12.821 ***** 2025-12-04 13:45:06.053810 | controller | ok: [instance] => (item=compute-0) 2025-12-04 13:45:06.168209 | controller | ok: [instance] => (item=controller-0) 2025-12-04 13:45:06.168243 | controller | ok: [instance] => (item=crc-0) 2025-12-04 13:45:06.168257 | controller | 2025-12-04 13:45:06.168267 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2025-12-04 13:45:06.168277 | controller | Thursday 04 December 2025 13:45:06 +0000 (0:00:00.214) 0:01:13.036 ***** 2025-12-04 13:45:06.168291 | controller | 2025-12-04 13:45:06.208591 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-04 13:45:06.208610 | controller | Thursday 04 December 2025 13:45:06 +0000 (0:00:00.114) 0:01:13.150 ***** 2025-12-04 13:45:06.208621 | controller | ok: [instance] 2025-12-04 13:45:06.405031 | controller | 2025-12-04 13:45:06.405048 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-04 13:45:06.405055 | controller | Thursday 04 December 2025 13:45:06 +0000 (0:00:00.040) 0:01:13.191 ***** 2025-12-04 13:45:06.405064 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-04 13:45:06.405209 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-04 13:45:06.405341 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-12-04 13:45:06.405483 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-12-04 13:45:06.405613 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-12-04 13:45:06.405745 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-12-04 13:45:06.405867 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-12-04 13:45:06.406023 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 13:45:06.406166 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 13:45:06.406300 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-12-04 13:45:06.406423 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-04 13:45:06.406555 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-04 13:45:06.406675 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-12-04 13:45:06.406794 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-12-04 13:45:06.406925 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-12-04 13:45:06.407069 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-12-04 13:45:06.407187 | controller | 2025-12-04 13:45:06.407303 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-04 13:45:06.407420 | controller | Thursday 04 December 2025 13:45:06 +0000 (0:00:00.197) 0:01:13.388 ***** 2025-12-04 13:45:09.620170 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-04 13:45:09.620254 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-04 13:45:09.620264 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-12-04 13:45:09.620271 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-12-04 13:45:09.620277 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-12-04 13:45:09.620286 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-12-04 13:45:09.621061 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-12-04 13:45:09.621097 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 13:45:09.621114 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 13:45:09.621141 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-12-04 13:45:09.621149 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-04 13:45:09.621155 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-04 13:45:09.621160 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-12-04 13:45:09.621166 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-12-04 13:45:09.621171 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-12-04 13:45:09.621176 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-12-04 13:45:09.621184 | controller | 2025-12-04 13:45:09.621334 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2025-12-04 13:45:09.642007 | controller | Thursday 04 December 2025 13:45:09 +0000 (0:00:03.214) 0:01:16.602 ***** 2025-12-04 13:45:09.642027 | controller | ok: [instance] 2025-12-04 13:45:09.642356 | controller | 2025-12-04 13:45:09.686103 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2025-12-04 13:45:09.686148 | controller | Thursday 04 December 2025 13:45:09 +0000 (0:00:00.022) 0:01:16.625 ***** 2025-12-04 13:45:09.686164 | controller | skipping: [instance] => (item=compute) 2025-12-04 13:45:09.686210 | controller | skipping: [instance] => (item=controller) 2025-12-04 13:45:09.686635 | controller | skipping: [instance] => (item=crc) 2025-12-04 13:45:09.716648 | controller | skipping: [instance] 2025-12-04 13:45:09.716681 | controller | 2025-12-04 13:45:09.716695 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2025-12-04 13:45:09.716706 | controller | Thursday 04 December 2025 13:45:09 +0000 (0:00:00.043) 0:01:16.668 ***** 2025-12-04 13:45:09.716721 | controller | skipping: [instance] 2025-12-04 13:45:09.717008 | controller | 2025-12-04 13:45:09.717279 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2025-12-04 13:45:09.717420 | controller | Thursday 04 December 2025 13:45:09 +0000 (0:00:00.030) 0:01:16.699 ***** 2025-12-04 13:45:10.097099 | controller | changed: [instance] 2025-12-04 13:45:10.097184 | controller | 2025-12-04 13:45:10.097196 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2025-12-04 13:45:10.097207 | controller | Thursday 04 December 2025 13:45:10 +0000 (0:00:00.369) 0:01:17.069 ***** 2025-12-04 13:45:10.097391 | controller | 2025-12-04 13:45:10.097416 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-12-04 13:45:10.901420 | controller | Thursday 04 December 2025 13:45:10 +0000 (0:00:00.010) 0:01:17.079 ***** 2025-12-04 13:45:10.901467 | controller | changed: [instance] 2025-12-04 13:45:11.263058 | controller | 2025-12-04 13:45:11.263091 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-04 13:45:11.263101 | controller | Thursday 04 December 2025 13:45:10 +0000 (0:00:00.804) 0:01:17.884 ***** 2025-12-04 13:45:11.263113 | controller | changed: [instance] 2025-12-04 13:45:11.263144 | controller | 2025-12-04 13:45:11.263303 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2025-12-04 13:45:11.606113 | controller | Thursday 04 December 2025 13:45:11 +0000 (0:00:00.362) 0:01:18.246 ***** 2025-12-04 13:45:11.606152 | controller | changed: [instance] 2025-12-04 13:45:11.606375 | controller | 2025-12-04 13:45:11.606408 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2025-12-04 13:45:11.955071 | controller | Thursday 04 December 2025 13:45:11 +0000 (0:00:00.342) 0:01:18.589 ***** 2025-12-04 13:45:11.955112 | controller | changed: [instance] 2025-12-04 13:45:12.323942 | controller | 2025-12-04 13:45:12.323986 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2025-12-04 13:45:12.323995 | controller | Thursday 04 December 2025 13:45:11 +0000 (0:00:00.348) 0:01:18.937 ***** 2025-12-04 13:45:12.324011 | controller | changed: [instance] 2025-12-04 13:45:12.354875 | controller | 2025-12-04 13:45:12.354894 | controller | TASK [Build utility records dataset] ******************************************* 2025-12-04 13:45:12.354901 | controller | Thursday 04 December 2025 13:45:12 +0000 (0:00:00.368) 0:01:19.306 ***** 2025-12-04 13:45:12.354910 | controller | 2025-12-04 13:45:12.441602 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-04 13:45:12.441622 | controller | Thursday 04 December 2025 13:45:12 +0000 (0:00:00.031) 0:01:19.338 ***** 2025-12-04 13:45:12.441634 | controller | ok: [instance] 2025-12-04 13:45:12.534071 | controller | 2025-12-04 13:45:12.534102 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-04 13:45:12.534110 | controller | Thursday 04 December 2025 13:45:12 +0000 (0:00:00.086) 0:01:19.424 ***** 2025-12-04 13:45:12.534120 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-12-04 13:45:13.010139 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 13:45:13.010180 | controller | 2025-12-04 13:45:13.010193 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-04 13:45:13.010203 | controller | Thursday 04 December 2025 13:45:12 +0000 (0:00:00.092) 0:01:19.516 ***** 2025-12-04 13:45:13.010226 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-12-04 13:45:13.010267 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-04 13:45:13.010277 | controller | 2025-12-04 13:45:13.010286 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-12-04 13:45:13.010298 | controller | Thursday 04 December 2025 13:45:12 +0000 (0:00:00.465) 0:01:19.982 ***** 2025-12-04 13:45:13.010332 | controller | 2025-12-04 13:45:13.010584 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-04 13:45:13.463101 | controller | Thursday 04 December 2025 13:45:13 +0000 (0:00:00.010) 0:01:19.992 ***** 2025-12-04 13:45:13.463136 | controller | changed: [instance] 2025-12-04 13:45:13.808844 | controller | 2025-12-04 13:45:13.808869 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-04 13:45:13.808877 | controller | Thursday 04 December 2025 13:45:13 +0000 (0:00:00.452) 0:01:20.445 ***** 2025-12-04 13:45:13.808887 | controller | changed: [instance] 2025-12-04 13:45:13.840486 | controller | 2025-12-04 13:45:13.840510 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2025-12-04 13:45:13.840517 | controller | Thursday 04 December 2025 13:45:13 +0000 (0:00:00.345) 0:01:20.791 ***** 2025-12-04 13:45:13.840525 | controller | skipping: [instance] 2025-12-04 13:45:13.913083 | controller | 2025-12-04 13:45:13.913117 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2025-12-04 13:45:13.913126 | controller | Thursday 04 December 2025 13:45:13 +0000 (0:00:00.031) 0:01:20.823 ***** 2025-12-04 13:45:13.913138 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2025-12-04 13:45:13.913243 | controller | 2025-12-04 13:45:13.913261 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2025-12-04 13:45:13.913271 | controller | Thursday 04 December 2025 13:45:13 +0000 (0:00:00.072) 0:01:20.895 ***** 2025-12-04 13:45:14.097025 | controller | ok: [instance] 2025-12-04 13:45:14.097332 | controller | 2025-12-04 13:45:14.118112 | controller | TASK [Deploy CRC if needed] **************************************************** 2025-12-04 13:45:14.118150 | controller | Thursday 04 December 2025 13:45:14 +0000 (0:00:00.184) 0:01:21.080 ***** 2025-12-04 13:45:14.118165 | controller | skipping: [instance] 2025-12-04 13:45:14.466375 | controller | 2025-12-04 13:45:14.466408 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2025-12-04 13:45:14.466416 | controller | Thursday 04 December 2025 13:45:14 +0000 (0:00:00.020) 0:01:21.100 ***** 2025-12-04 13:45:14.466426 | controller | ok: [instance] 2025-12-04 13:45:14.690727 | controller | 2025-12-04 13:45:14.690756 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2025-12-04 13:45:14.690764 | controller | Thursday 04 December 2025 13:45:14 +0000 (0:00:00.348) 0:01:21.448 ***** 2025-12-04 13:45:14.690774 | controller | ok: [instance] 2025-12-04 13:45:14.904830 | controller | 2025-12-04 13:45:14.904857 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2025-12-04 13:45:14.904865 | controller | Thursday 04 December 2025 13:45:14 +0000 (0:00:00.224) 0:01:21.673 ***** 2025-12-04 13:45:14.904875 | controller | ok: [instance] 2025-12-04 13:45:15.128308 | controller | 2025-12-04 13:45:15.128333 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2025-12-04 13:45:15.128341 | controller | Thursday 04 December 2025 13:45:14 +0000 (0:00:00.214) 0:01:21.887 ***** 2025-12-04 13:45:15.128350 | controller | ok: [instance] 2025-12-04 13:45:15.346725 | controller | 2025-12-04 13:45:15.346755 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2025-12-04 13:45:15.346770 | controller | Thursday 04 December 2025 13:45:15 +0000 (0:00:00.223) 0:01:22.111 ***** 2025-12-04 13:45:15.346781 | controller | ok: [instance] 2025-12-04 13:45:15.385945 | controller | 2025-12-04 13:45:15.385982 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-04 13:45:15.385998 | controller | Thursday 04 December 2025 13:45:15 +0000 (0:00:00.218) 0:01:22.329 ***** 2025-12-04 13:45:15.386008 | controller | 2025-12-04 13:45:15.582760 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-12-04 13:45:15.582785 | controller | Thursday 04 December 2025 13:45:15 +0000 (0:00:00.039) 0:01:22.368 ***** 2025-12-04 13:45:15.582796 | controller | ok: [instance] 2025-12-04 13:45:15.604676 | controller | 2025-12-04 13:45:15.604698 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-12-04 13:45:15.604707 | controller | Thursday 04 December 2025 13:45:15 +0000 (0:00:00.196) 0:01:22.565 ***** 2025-12-04 13:45:15.604718 | controller | ok: [instance] 2025-12-04 13:45:15.627874 | controller | 2025-12-04 13:45:15.627894 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-12-04 13:45:15.627901 | controller | Thursday 04 December 2025 13:45:15 +0000 (0:00:00.021) 0:01:22.587 ***** 2025-12-04 13:45:15.627911 | controller | skipping: [instance] 2025-12-04 13:45:15.916037 | controller | 2025-12-04 13:45:15.916081 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2025-12-04 13:45:15.916089 | controller | Thursday 04 December 2025 13:45:15 +0000 (0:00:00.023) 0:01:22.610 ***** 2025-12-04 13:45:15.916101 | controller | ok: [instance] 2025-12-04 13:45:15.916186 | controller | 2025-12-04 13:45:15.916415 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2025-12-04 13:45:16.157116 | controller | Thursday 04 December 2025 13:45:15 +0000 (0:00:00.287) 0:01:22.898 ***** 2025-12-04 13:45:16.157154 | controller | ok: [instance] 2025-12-04 13:45:16.157386 | controller | 2025-12-04 13:45:16.157411 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2025-12-04 13:45:16.329891 | controller | Thursday 04 December 2025 13:45:16 +0000 (0:00:00.241) 0:01:23.140 ***** 2025-12-04 13:45:16.329929 | controller | ok: [instance] 2025-12-04 13:45:16.387007 | controller | 2025-12-04 13:45:16.387042 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2025-12-04 13:45:16.387050 | controller | Thursday 04 December 2025 13:45:16 +0000 (0:00:00.172) 0:01:23.312 ***** 2025-12-04 13:45:16.387061 | controller | 2025-12-04 13:45:16.431745 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-12-04 13:45:16.431773 | controller | Thursday 04 December 2025 13:45:16 +0000 (0:00:00.057) 0:01:23.369 ***** 2025-12-04 13:45:16.431787 | controller | ok: [instance] => changed=false 2025-12-04 13:45:16.613759 | controller | msg: All assertions passed 2025-12-04 13:45:16.613791 | controller | 2025-12-04 13:45:16.613799 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-12-04 13:45:16.613805 | controller | Thursday 04 December 2025 13:45:16 +0000 (0:00:00.044) 0:01:23.414 ***** 2025-12-04 13:45:16.613815 | controller | ok: [instance] 2025-12-04 13:45:16.807585 | controller | 2025-12-04 13:45:16.807616 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-12-04 13:45:16.807624 | controller | Thursday 04 December 2025 13:45:16 +0000 (0:00:00.181) 0:01:23.596 ***** 2025-12-04 13:45:16.807634 | controller | ok: [instance] 2025-12-04 13:45:16.832728 | controller | 2025-12-04 13:45:16.832751 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-12-04 13:45:16.832759 | controller | Thursday 04 December 2025 13:45:16 +0000 (0:00:00.193) 0:01:23.790 ***** 2025-12-04 13:45:16.832769 | controller | ok: [instance] => changed=false 2025-12-04 13:45:17.016390 | controller | msg: All assertions passed 2025-12-04 13:45:17.016420 | controller | 2025-12-04 13:45:17.016441 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-12-04 13:45:17.016449 | controller | Thursday 04 December 2025 13:45:16 +0000 (0:00:00.025) 0:01:23.815 ***** 2025-12-04 13:45:17.016459 | controller | ok: [instance] 2025-12-04 13:45:17.194084 | controller | 2025-12-04 13:45:17.194123 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-12-04 13:45:17.194131 | controller | Thursday 04 December 2025 13:45:17 +0000 (0:00:00.183) 0:01:23.999 ***** 2025-12-04 13:45:17.194142 | controller | ok: [instance] 2025-12-04 13:45:17.194176 | controller | 2025-12-04 13:45:17.194185 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-12-04 13:45:17.194277 | controller | Thursday 04 December 2025 13:45:17 +0000 (0:00:00.177) 0:01:24.177 ***** 2025-12-04 13:45:17.243770 | controller | ok: [instance] 2025-12-04 13:45:17.617533 | controller | 2025-12-04 13:45:17.617563 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2025-12-04 13:45:17.617571 | controller | Thursday 04 December 2025 13:45:17 +0000 (0:00:00.049) 0:01:24.226 ***** 2025-12-04 13:45:17.617582 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2025-12-04 13:45:17.637356 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2025-12-04 13:45:17.637380 | controller | 2025-12-04 13:45:17.637389 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2025-12-04 13:45:17.637396 | controller | Thursday 04 December 2025 13:45:17 +0000 (0:00:00.373) 0:01:24.600 ***** 2025-12-04 13:45:17.637407 | controller | skipping: [instance] 2025-12-04 13:45:17.662082 | controller | 2025-12-04 13:45:17.662119 | controller | TASK [Load the architecture local kustomize patches] *************************** 2025-12-04 13:45:17.662128 | controller | Thursday 04 December 2025 13:45:17 +0000 (0:00:00.020) 0:01:24.620 ***** 2025-12-04 13:45:17.662140 | controller | skipping: [instance] 2025-12-04 13:45:17.662169 | controller | 2025-12-04 13:45:17.662450 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2025-12-04 13:45:17.786689 | controller | Thursday 04 December 2025 13:45:17 +0000 (0:00:00.024) 0:01:24.645 ***** 2025-12-04 13:45:17.786720 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2025-12-04 13:45:17.811065 | controller | 2025-12-04 13:45:17.811087 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2025-12-04 13:45:17.811097 | controller | Thursday 04 December 2025 13:45:17 +0000 (0:00:00.124) 0:01:24.769 ***** 2025-12-04 13:45:17.811107 | controller | skipping: [instance] 2025-12-04 13:45:17.811133 | controller | 2025-12-04 13:45:17.811142 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2025-12-04 13:45:17.811267 | controller | Thursday 04 December 2025 13:45:17 +0000 (0:00:00.024) 0:01:24.794 ***** 2025-12-04 13:45:18.195762 | controller | changed: [instance] 2025-12-04 13:45:18.692077 | controller | 2025-12-04 13:45:18.692109 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2025-12-04 13:45:18.692119 | controller | Thursday 04 December 2025 13:45:18 +0000 (0:00:00.384) 0:01:25.178 ***** 2025-12-04 13:45:18.692132 | controller | changed: [instance] 2025-12-04 13:45:18.692161 | controller | 2025-12-04 13:45:18.692168 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2025-12-04 13:45:18.692177 | controller | Thursday 04 December 2025 13:45:18 +0000 (0:00:00.485) 0:01:25.663 ***** 2025-12-04 13:45:18.692467 | controller | 2025-12-04 13:45:19.119298 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-04 13:45:19.119338 | controller | Thursday 04 December 2025 13:45:18 +0000 (0:00:00.010) 0:01:25.674 ***** 2025-12-04 13:45:19.119351 | controller | changed: [instance] 2025-12-04 13:45:19.119369 | controller | 2025-12-04 13:45:19.119376 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-12-04 13:45:19.119492 | controller | Thursday 04 December 2025 13:45:19 +0000 (0:00:00.427) 0:01:26.102 ***** 2025-12-04 13:45:19.938788 | controller | changed: [instance] 2025-12-04 13:45:19.938839 | controller | 2025-12-04 13:45:19.938847 | controller | TASK [Deploy virtualbmc] ******************************************************* 2025-12-04 13:45:19.938856 | controller | Thursday 04 December 2025 13:45:19 +0000 (0:00:00.819) 0:01:26.921 ***** 2025-12-04 13:45:19.971658 | controller | skipping: [instance] 2025-12-04 13:45:19.971695 | controller | 2025-12-04 13:45:19.971706 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2025-12-04 13:45:19.971716 | controller | Thursday 04 December 2025 13:45:19 +0000 (0:00:00.032) 0:01:26.954 ***** 2025-12-04 13:45:20.004079 | controller | skipping: [instance] 2025-12-04 13:45:20.004158 | controller | 2025-12-04 13:45:20.004184 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2025-12-04 13:45:20.004198 | controller | Thursday 04 December 2025 13:45:20 +0000 (0:00:00.032) 0:01:26.986 ***** 2025-12-04 13:45:20.560061 | controller | changed: [instance] => (item=workload) 2025-12-04 13:45:20.560127 | controller | changed: [instance] => (item=reproducer-inventory) 2025-12-04 13:45:20.560136 | controller | ok: [instance] => (item=volumes) 2025-12-04 13:45:20.560143 | controller | 2025-12-04 13:45:20.560150 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2025-12-04 13:45:20.560235 | controller | Thursday 04 December 2025 13:45:20 +0000 (0:00:00.555) 0:01:27.541 ***** 2025-12-04 13:45:20.967078 | controller | changed: [instance] => (item=workload) 2025-12-04 13:45:20.992901 | controller | changed: [instance] => (item=volumes) 2025-12-04 13:45:20.992934 | controller | 2025-12-04 13:45:20.992944 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2025-12-04 13:45:20.992951 | controller | Thursday 04 December 2025 13:45:20 +0000 (0:00:00.407) 0:01:27.949 ***** 2025-12-04 13:45:20.992983 | controller | skipping: [instance] 2025-12-04 13:45:21.986892 | controller | 2025-12-04 13:45:21.986924 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2025-12-04 13:45:21.986932 | controller | Thursday 04 December 2025 13:45:20 +0000 (0:00:00.026) 0:01:27.975 ***** 2025-12-04 13:45:21.986942 | controller | changed: [instance] => (item=compute) 2025-12-04 13:45:22.334221 | controller | changed: [instance] => (item=controller) 2025-12-04 13:45:22.334255 | controller | changed: [instance] => (item=crc) 2025-12-04 13:45:22.334264 | controller | 2025-12-04 13:45:22.334270 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2025-12-04 13:45:22.334276 | controller | Thursday 04 December 2025 13:45:21 +0000 (0:00:00.993) 0:01:28.969 ***** 2025-12-04 13:45:22.334286 | controller | changed: [instance] 2025-12-04 13:45:22.374063 | controller | 2025-12-04 13:45:22.374098 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2025-12-04 13:45:22.374110 | controller | Thursday 04 December 2025 13:45:22 +0000 (0:00:00.347) 0:01:29.316 ***** 2025-12-04 13:45:22.374123 | controller | skipping: [instance] 2025-12-04 13:45:22.374314 | controller | 2025-12-04 13:45:22.374334 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2025-12-04 13:45:22.434083 | controller | Thursday 04 December 2025 13:45:22 +0000 (0:00:00.040) 0:01:29.357 ***** 2025-12-04 13:45:22.434128 | controller | skipping: [instance] => (item=crc) 2025-12-04 13:45:22.434160 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2025-12-04 13:45:22.434168 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2025-12-04 13:45:22.434177 | controller | 2025-12-04 13:45:22.434370 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-12-04 13:45:22.639858 | controller | Thursday 04 December 2025 13:45:22 +0000 (0:00:00.059) 0:01:29.417 ***** 2025-12-04 13:45:22.639895 | controller | changed: [instance] 2025-12-04 13:45:22.813385 | controller | 2025-12-04 13:45:22.813407 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-12-04 13:45:22.813415 | controller | Thursday 04 December 2025 13:45:22 +0000 (0:00:00.205) 0:01:29.622 ***** 2025-12-04 13:45:22.813435 | controller | ok: [instance] 2025-12-04 13:45:43.218602 | controller | 2025-12-04 13:45:43.218641 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-12-04 13:45:43.218649 | controller | Thursday 04 December 2025 13:45:22 +0000 (0:00:00.173) 0:01:29.796 ***** 2025-12-04 13:45:43.218660 | controller | changed: [instance] 2025-12-04 13:45:43.414398 | controller | 2025-12-04 13:45:43.414429 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-12-04 13:45:43.414437 | controller | Thursday 04 December 2025 13:45:43 +0000 (0:00:20.404) 0:01:50.200 ***** 2025-12-04 13:45:43.414446 | controller | ok: [instance] 2025-12-04 13:45:43.454865 | controller | 2025-12-04 13:45:43.454888 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-12-04 13:45:43.454903 | controller | Thursday 04 December 2025 13:45:43 +0000 (0:00:00.196) 0:01:50.397 ***** 2025-12-04 13:45:43.454914 | controller | ok: [instance] => changed=false 2025-12-04 13:45:43.660800 | controller | msg: All assertions passed 2025-12-04 13:45:43.660819 | controller | 2025-12-04 13:45:43.660826 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-12-04 13:45:43.660832 | controller | Thursday 04 December 2025 13:45:43 +0000 (0:00:00.040) 0:01:50.437 ***** 2025-12-04 13:45:43.660840 | controller | changed: [instance] 2025-12-04 13:45:43.860928 | controller | 2025-12-04 13:45:43.860972 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-12-04 13:45:43.860983 | controller | Thursday 04 December 2025 13:45:43 +0000 (0:00:00.205) 0:01:50.643 ***** 2025-12-04 13:45:43.860993 | controller | ok: [instance] 2025-12-04 13:45:44.048992 | controller | 2025-12-04 13:45:44.049024 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-12-04 13:45:44.049037 | controller | Thursday 04 December 2025 13:45:43 +0000 (0:00:00.200) 0:01:50.843 ***** 2025-12-04 13:45:44.049052 | controller | ok: [instance] 2025-12-04 13:45:44.069545 | controller | 2025-12-04 13:45:44.069562 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-12-04 13:45:44.069569 | controller | Thursday 04 December 2025 13:45:44 +0000 (0:00:00.188) 0:01:51.031 ***** 2025-12-04 13:45:44.069577 | controller | skipping: [instance] 2025-12-04 13:45:44.253842 | controller | 2025-12-04 13:45:44.253861 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-12-04 13:45:44.253868 | controller | Thursday 04 December 2025 13:45:44 +0000 (0:00:00.020) 0:01:51.052 ***** 2025-12-04 13:45:44.253876 | controller | ok: [instance] 2025-12-04 13:45:44.293014 | controller | 2025-12-04 13:45:44.293031 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-12-04 13:45:44.293038 | controller | Thursday 04 December 2025 13:45:44 +0000 (0:00:00.184) 0:01:51.236 ***** 2025-12-04 13:45:44.293046 | controller | ok: [instance] => changed=false 2025-12-04 13:45:44.496902 | controller | msg: All assertions passed 2025-12-04 13:45:44.496919 | controller | 2025-12-04 13:45:44.496926 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-12-04 13:45:44.496931 | controller | Thursday 04 December 2025 13:45:44 +0000 (0:00:00.038) 0:01:51.275 ***** 2025-12-04 13:45:44.496943 | controller | ok: [instance] 2025-12-04 13:45:44.674652 | controller | 2025-12-04 13:45:44.674672 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2025-12-04 13:45:44.674680 | controller | Thursday 04 December 2025 13:45:44 +0000 (0:00:00.204) 0:01:51.479 ***** 2025-12-04 13:45:44.674688 | controller | ok: [instance] 2025-12-04 13:45:45.053491 | controller | 2025-12-04 13:45:45.053510 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2025-12-04 13:45:45.053518 | controller | Thursday 04 December 2025 13:45:44 +0000 (0:00:00.177) 0:01:51.657 ***** 2025-12-04 13:45:45.053527 | controller | changed: [instance] 2025-12-04 13:45:45.231817 | controller | 2025-12-04 13:45:45.231836 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2025-12-04 13:45:45.231844 | controller | Thursday 04 December 2025 13:45:45 +0000 (0:00:00.378) 0:01:52.036 ***** 2025-12-04 13:45:45.231853 | controller | ok: [instance] 2025-12-04 13:45:45.407938 | controller | 2025-12-04 13:45:45.407975 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2025-12-04 13:45:45.407986 | controller | Thursday 04 December 2025 13:45:45 +0000 (0:00:00.178) 0:01:52.214 ***** 2025-12-04 13:45:45.407996 | controller | ok: [instance] 2025-12-04 13:45:45.798937 | controller | 2025-12-04 13:45:45.798989 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2025-12-04 13:45:45.799002 | controller | Thursday 04 December 2025 13:45:45 +0000 (0:00:00.175) 0:01:52.390 ***** 2025-12-04 13:45:45.799016 | controller | changed: [instance] 2025-12-04 13:45:45.820085 | controller | 2025-12-04 13:45:45.820116 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2025-12-04 13:45:45.820124 | controller | Thursday 04 December 2025 13:45:45 +0000 (0:00:00.390) 0:01:52.781 ***** 2025-12-04 13:45:45.820139 | controller | ok: [instance] 2025-12-04 13:45:45.820164 | controller | 2025-12-04 13:45:45.820171 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2025-12-04 13:45:45.820237 | controller | Thursday 04 December 2025 13:45:45 +0000 (0:00:00.021) 0:01:52.803 ***** 2025-12-04 13:45:46.040087 | controller | ok: [instance] 2025-12-04 13:45:46.040138 | controller | 2025-12-04 13:45:46.040460 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2025-12-04 13:45:46.487146 | controller | Thursday 04 December 2025 13:45:46 +0000 (0:00:00.219) 0:01:53.022 ***** 2025-12-04 13:45:46.487183 | controller | ok: [instance] 2025-12-04 13:45:46.487205 | controller | 2025-12-04 13:45:46.487212 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2025-12-04 13:45:46.487219 | controller | Thursday 04 December 2025 13:45:46 +0000 (0:00:00.446) 0:01:53.469 ***** 2025-12-04 13:45:46.603044 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-04 13:45:46.603388 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-04 13:45:46.603414 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-04 13:45:46.603426 | controller | 2025-12-04 13:45:46.851511 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2025-12-04 13:45:46.851530 | controller | Thursday 04 December 2025 13:45:46 +0000 (0:00:00.115) 0:01:53.585 ***** 2025-12-04 13:45:46.851540 | controller | changed: [instance] 2025-12-04 13:45:47.070095 | controller | 2025-12-04 13:45:47.070115 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2025-12-04 13:45:47.070122 | controller | Thursday 04 December 2025 13:45:46 +0000 (0:00:00.248) 0:01:53.834 ***** 2025-12-04 13:45:47.070131 | controller | changed: [instance] 2025-12-04 13:45:47.365088 | controller | 2025-12-04 13:45:47.365120 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2025-12-04 13:45:47.365128 | controller | Thursday 04 December 2025 13:45:47 +0000 (0:00:00.218) 0:01:54.052 ***** 2025-12-04 13:45:47.365138 | controller | changed: [instance] 2025-12-04 13:45:47.365164 | controller | 2025-12-04 13:45:47.365172 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2025-12-04 13:45:47.365281 | controller | Thursday 04 December 2025 13:45:47 +0000 (0:00:00.294) 0:01:54.347 ***** 2025-12-04 13:45:47.394668 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-04 13:45:47.440079 | controller | 2025-12-04 13:45:47.440110 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-04 13:45:47.440119 | controller | Thursday 04 December 2025 13:45:47 +0000 (0:00:00.029) 0:01:54.377 ***** 2025-12-04 13:45:47.440130 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-04 13:45:47.669569 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-04 13:45:47.669602 | controller | 2025-12-04 13:45:47.669611 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 13:45:47.669617 | controller | Thursday 04 December 2025 13:45:47 +0000 (0:00:00.045) 0:01:54.422 ***** 2025-12-04 13:45:47.669627 | controller | ok: [instance] 2025-12-04 13:45:47.712113 | controller | 2025-12-04 13:45:47.712149 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 13:45:47.712161 | controller | Thursday 04 December 2025 13:45:47 +0000 (0:00:00.229) 0:01:54.652 ***** 2025-12-04 13:45:47.712172 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 13:45:47.712202 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 13:45:47.712230 | controller | 2025-12-04 13:45:47.712674 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 13:45:47.944390 | controller | Thursday 04 December 2025 13:45:47 +0000 (0:00:00.042) 0:01:54.694 ***** 2025-12-04 13:45:47.944439 | controller | ok: [instance] 2025-12-04 13:45:48.144526 | controller | 2025-12-04 13:45:48.144553 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 13:45:48.144561 | controller | Thursday 04 December 2025 13:45:47 +0000 (0:00:00.232) 0:01:54.927 ***** 2025-12-04 13:45:48.144571 | controller | ok: [instance] 2025-12-04 13:45:48.426564 | controller | 2025-12-04 13:45:48.426591 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2025-12-04 13:45:48.426599 | controller | Thursday 04 December 2025 13:45:48 +0000 (0:00:00.200) 0:01:55.127 ***** 2025-12-04 13:45:48.426610 | controller | changed: [instance] 2025-12-04 13:45:48.652040 | controller | 2025-12-04 13:45:48.652069 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 13:45:48.652076 | controller | Thursday 04 December 2025 13:45:48 +0000 (0:00:00.281) 0:01:55.409 ***** 2025-12-04 13:45:48.652085 | controller | ok: [instance] 2025-12-04 13:45:48.652100 | controller | 2025-12-04 13:45:48.652107 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 13:45:48.652127 | controller | Thursday 04 December 2025 13:45:48 +0000 (0:00:00.225) 0:01:55.634 ***** 2025-12-04 13:45:48.695012 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 13:45:48.918480 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 13:45:48.918509 | controller | 2025-12-04 13:45:48.918517 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 13:45:48.918523 | controller | Thursday 04 December 2025 13:45:48 +0000 (0:00:00.043) 0:01:55.677 ***** 2025-12-04 13:45:48.918533 | controller | ok: [instance] 2025-12-04 13:45:49.113905 | controller | 2025-12-04 13:45:49.113937 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 13:45:49.113946 | controller | Thursday 04 December 2025 13:45:48 +0000 (0:00:00.223) 0:01:55.901 ***** 2025-12-04 13:45:49.113956 | controller | ok: [instance] 2025-12-04 13:45:49.450800 | controller | 2025-12-04 13:45:49.450828 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2025-12-04 13:45:49.450836 | controller | Thursday 04 December 2025 13:45:49 +0000 (0:00:00.195) 0:01:56.096 ***** 2025-12-04 13:45:49.450846 | controller | changed: [instance] 2025-12-04 13:45:49.471800 | controller | 2025-12-04 13:45:49.471823 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2025-12-04 13:45:49.471832 | controller | Thursday 04 December 2025 13:45:49 +0000 (0:00:00.336) 0:01:56.433 ***** 2025-12-04 13:45:49.471843 | controller | skipping: [instance] 2025-12-04 13:45:49.497745 | controller | 2025-12-04 13:45:49.497763 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2025-12-04 13:45:49.497770 | controller | Thursday 04 December 2025 13:45:49 +0000 (0:00:00.021) 0:01:56.454 ***** 2025-12-04 13:45:49.497779 | controller | skipping: [instance] 2025-12-04 13:45:49.524980 | controller | 2025-12-04 13:45:49.524999 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2025-12-04 13:45:49.525007 | controller | Thursday 04 December 2025 13:45:49 +0000 (0:00:00.025) 0:01:56.480 ***** 2025-12-04 13:45:49.525015 | controller | skipping: [instance] 2025-12-04 13:45:49.550261 | controller | 2025-12-04 13:45:49.550297 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2025-12-04 13:45:49.550310 | controller | Thursday 04 December 2025 13:45:49 +0000 (0:00:00.027) 0:01:56.507 ***** 2025-12-04 13:45:49.550325 | controller | skipping: [instance] 2025-12-04 13:45:49.760912 | controller | 2025-12-04 13:45:49.760932 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-04 13:45:49.760939 | controller | Thursday 04 December 2025 13:45:49 +0000 (0:00:00.025) 0:01:56.532 ***** 2025-12-04 13:45:49.760947 | controller | changed: [instance] 2025-12-04 13:45:49.797145 | controller | 2025-12-04 13:45:49.797188 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-04 13:45:49.797211 | controller | Thursday 04 December 2025 13:45:49 +0000 (0:00:00.210) 0:01:56.743 ***** 2025-12-04 13:45:49.797223 | controller | ok: [instance] 2025-12-04 13:45:49.797256 | controller | 2025-12-04 13:45:49.797265 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-04 13:45:49.797288 | controller | Thursday 04 December 2025 13:45:49 +0000 (0:00:00.035) 0:01:56.779 ***** 2025-12-04 13:45:49.848603 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-12-04 13:45:50.038877 | controller | 2025-12-04 13:45:50.038895 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-12-04 13:45:50.038902 | controller | Thursday 04 December 2025 13:45:49 +0000 (0:00:00.051) 0:01:56.831 ***** 2025-12-04 13:45:50.038910 | controller | ok: [instance] 2025-12-04 13:45:50.097769 | controller | 2025-12-04 13:45:50.097795 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-12-04 13:45:50.097801 | controller | Thursday 04 December 2025 13:45:50 +0000 (0:00:00.190) 0:01:57.021 ***** 2025-12-04 13:45:50.097809 | controller | ok: [instance] 2025-12-04 13:45:50.141083 | controller | 2025-12-04 13:45:50.141116 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-12-04 13:45:50.141126 | controller | Thursday 04 December 2025 13:45:50 +0000 (0:00:00.058) 0:01:57.080 ***** 2025-12-04 13:45:50.141140 | controller | ok: [instance] 2025-12-04 13:45:50.141176 | controller | 2025-12-04 13:45:50.141185 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-12-04 13:45:50.141195 | controller | Thursday 04 December 2025 13:45:50 +0000 (0:00:00.043) 0:01:57.124 ***** 2025-12-04 13:45:50.183710 | controller | skipping: [instance] 2025-12-04 13:45:50.226501 | controller | 2025-12-04 13:45:50.226523 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-12-04 13:45:50.226532 | controller | Thursday 04 December 2025 13:45:50 +0000 (0:00:00.042) 0:01:57.166 ***** 2025-12-04 13:45:50.226543 | controller | skipping: [instance] 2025-12-04 13:45:50.309954 | controller | 2025-12-04 13:45:50.310015 | controller | TASK [Call the config_drive role] ********************************************** 2025-12-04 13:45:50.310036 | controller | Thursday 04 December 2025 13:45:50 +0000 (0:00:00.042) 0:01:57.209 ***** 2025-12-04 13:45:50.310052 | controller | 2025-12-04 13:45:50.729035 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-12-04 13:45:50.729064 | controller | Thursday 04 December 2025 13:45:50 +0000 (0:00:00.083) 0:01:57.292 ***** 2025-12-04 13:45:50.729076 | controller | ok: [instance] => (item=artifacts) 2025-12-04 13:45:50.729097 | controller | ok: [instance] => (item=logs) 2025-12-04 13:45:50.729103 | controller | 2025-12-04 13:45:50.729110 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-12-04 13:45:50.729230 | controller | Thursday 04 December 2025 13:45:50 +0000 (0:00:00.419) 0:01:57.711 ***** 2025-12-04 13:45:51.903021 | controller | ok: [instance] 2025-12-04 13:45:52.123599 | controller | 2025-12-04 13:45:52.123629 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-12-04 13:45:52.123638 | controller | Thursday 04 December 2025 13:45:51 +0000 (0:00:01.173) 0:01:58.885 ***** 2025-12-04 13:45:52.123648 | controller | changed: [instance] 2025-12-04 13:45:52.495868 | controller | 2025-12-04 13:45:52.495896 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-12-04 13:45:52.495904 | controller | Thursday 04 December 2025 13:45:52 +0000 (0:00:00.220) 0:01:59.106 ***** 2025-12-04 13:45:52.495914 | controller | changed: [instance] 2025-12-04 13:45:52.878122 | controller | 2025-12-04 13:45:52.878162 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-12-04 13:45:52.878173 | controller | Thursday 04 December 2025 13:45:52 +0000 (0:00:00.372) 0:01:59.478 ***** 2025-12-04 13:45:52.878186 | controller | changed: [instance] 2025-12-04 13:45:52.923545 | controller | 2025-12-04 13:45:52.923579 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-12-04 13:45:52.923589 | controller | Thursday 04 December 2025 13:45:52 +0000 (0:00:00.382) 0:01:59.860 ***** 2025-12-04 13:45:52.923607 | controller | skipping: [instance] 2025-12-04 13:45:53.128089 | controller | 2025-12-04 13:45:53.128123 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-12-04 13:45:53.128134 | controller | Thursday 04 December 2025 13:45:52 +0000 (0:00:00.045) 0:01:59.906 ***** 2025-12-04 13:45:53.128146 | controller | ok: [instance] 2025-12-04 13:45:53.173666 | controller | 2025-12-04 13:45:53.173695 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-12-04 13:45:53.173703 | controller | Thursday 04 December 2025 13:45:53 +0000 (0:00:00.204) 0:02:00.110 ***** 2025-12-04 13:45:53.173713 | controller | skipping: [instance] 2025-12-04 13:45:53.410730 | controller | 2025-12-04 13:45:53.410757 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-12-04 13:45:53.410765 | controller | Thursday 04 December 2025 13:45:53 +0000 (0:00:00.045) 0:02:00.156 ***** 2025-12-04 13:45:53.410775 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2025-12-04 13:45:53.697033 | controller | changed: [instance] 2025-12-04 13:45:53.697069 | controller | 2025-12-04 13:45:53.697084 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-04 13:45:53.697092 | controller | Thursday 04 December 2025 13:45:53 +0000 (0:00:00.237) 0:02:00.393 ***** 2025-12-04 13:45:53.697105 | controller | changed: [instance] 2025-12-04 13:45:53.697147 | controller | 2025-12-04 13:45:53.697157 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-04 13:45:53.744118 | controller | Thursday 04 December 2025 13:45:53 +0000 (0:00:00.286) 0:02:00.679 ***** 2025-12-04 13:45:53.744162 | controller | skipping: [instance] 2025-12-04 13:45:53.773330 | controller | 2025-12-04 13:45:53.773349 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2025-12-04 13:45:53.773356 | controller | Thursday 04 December 2025 13:45:53 +0000 (0:00:00.046) 0:02:00.726 ***** 2025-12-04 13:45:53.773365 | controller | skipping: [instance] 2025-12-04 13:45:54.013030 | controller | 2025-12-04 13:45:54.013061 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2025-12-04 13:45:54.013071 | controller | Thursday 04 December 2025 13:45:53 +0000 (0:00:00.029) 0:02:00.756 ***** 2025-12-04 13:45:54.013083 | controller | changed: [instance] 2025-12-04 13:45:54.234094 | controller | 2025-12-04 13:45:54.234125 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2025-12-04 13:45:54.234134 | controller | Thursday 04 December 2025 13:45:54 +0000 (0:00:00.239) 0:02:00.995 ***** 2025-12-04 13:45:54.234147 | controller | changed: [instance] 2025-12-04 13:45:54.552037 | controller | 2025-12-04 13:45:54.552069 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2025-12-04 13:45:54.552079 | controller | Thursday 04 December 2025 13:45:54 +0000 (0:00:00.220) 0:02:01.216 ***** 2025-12-04 13:45:54.552091 | controller | changed: [instance] 2025-12-04 13:45:54.581062 | controller | 2025-12-04 13:45:54.581085 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2025-12-04 13:45:54.581094 | controller | Thursday 04 December 2025 13:45:54 +0000 (0:00:00.317) 0:02:01.534 ***** 2025-12-04 13:45:54.581109 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-04 13:45:54.581138 | controller | 2025-12-04 13:45:54.581148 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-04 13:45:54.581238 | controller | Thursday 04 December 2025 13:45:54 +0000 (0:00:00.029) 0:02:01.564 ***** 2025-12-04 13:45:54.627112 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-04 13:45:54.627510 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-04 13:45:54.627534 | controller | 2025-12-04 13:45:54.854618 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 13:45:54.854655 | controller | Thursday 04 December 2025 13:45:54 +0000 (0:00:00.045) 0:02:01.609 ***** 2025-12-04 13:45:54.854676 | controller | ok: [instance] 2025-12-04 13:45:54.899094 | controller | 2025-12-04 13:45:54.899129 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 13:45:54.899139 | controller | Thursday 04 December 2025 13:45:54 +0000 (0:00:00.227) 0:02:01.836 ***** 2025-12-04 13:45:54.899151 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 13:45:54.899182 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 13:45:54.899190 | controller | 2025-12-04 13:45:54.899199 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 13:45:54.899309 | controller | Thursday 04 December 2025 13:45:54 +0000 (0:00:00.044) 0:02:01.882 ***** 2025-12-04 13:45:55.128134 | controller | ok: [instance] 2025-12-04 13:45:55.128167 | controller | 2025-12-04 13:45:55.128176 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 13:45:55.128186 | controller | Thursday 04 December 2025 13:45:55 +0000 (0:00:00.228) 0:02:02.110 ***** 2025-12-04 13:45:55.326644 | controller | ok: [instance] 2025-12-04 13:45:55.606712 | controller | 2025-12-04 13:45:55.606741 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2025-12-04 13:45:55.606749 | controller | Thursday 04 December 2025 13:45:55 +0000 (0:00:00.198) 0:02:02.309 ***** 2025-12-04 13:45:55.606759 | controller | changed: [instance] 2025-12-04 13:45:55.836077 | controller | 2025-12-04 13:45:55.836128 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 13:45:55.836143 | controller | Thursday 04 December 2025 13:45:55 +0000 (0:00:00.280) 0:02:02.589 ***** 2025-12-04 13:45:55.836160 | controller | ok: [instance] 2025-12-04 13:45:55.836203 | controller | 2025-12-04 13:45:55.836216 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 13:45:55.836340 | controller | Thursday 04 December 2025 13:45:55 +0000 (0:00:00.229) 0:02:02.818 ***** 2025-12-04 13:45:55.881032 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 13:45:55.881441 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 13:45:56.116095 | controller | 2025-12-04 13:45:56.116123 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 13:45:56.116133 | controller | Thursday 04 December 2025 13:45:55 +0000 (0:00:00.045) 0:02:02.864 ***** 2025-12-04 13:45:56.116149 | controller | ok: [instance] 2025-12-04 13:45:56.116202 | controller | 2025-12-04 13:45:56.116218 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 13:45:56.116228 | controller | Thursday 04 December 2025 13:45:56 +0000 (0:00:00.234) 0:02:03.098 ***** 2025-12-04 13:45:56.324980 | controller | ok: [instance] 2025-12-04 13:45:56.606780 | controller | 2025-12-04 13:45:56.606807 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2025-12-04 13:45:56.606815 | controller | Thursday 04 December 2025 13:45:56 +0000 (0:00:00.208) 0:02:03.307 ***** 2025-12-04 13:45:56.606825 | controller | changed: [instance] 2025-12-04 13:45:56.629490 | controller | 2025-12-04 13:45:56.629509 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2025-12-04 13:45:56.629516 | controller | Thursday 04 December 2025 13:45:56 +0000 (0:00:00.281) 0:02:03.589 ***** 2025-12-04 13:45:56.629525 | controller | skipping: [instance] 2025-12-04 13:45:56.657487 | controller | 2025-12-04 13:45:56.657506 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2025-12-04 13:45:56.657513 | controller | Thursday 04 December 2025 13:45:56 +0000 (0:00:00.023) 0:02:03.612 ***** 2025-12-04 13:45:56.657522 | controller | skipping: [instance] 2025-12-04 13:45:56.685818 | controller | 2025-12-04 13:45:56.685840 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2025-12-04 13:45:56.685849 | controller | Thursday 04 December 2025 13:45:56 +0000 (0:00:00.027) 0:02:03.640 ***** 2025-12-04 13:45:56.685861 | controller | skipping: [instance] 2025-12-04 13:45:56.712602 | controller | 2025-12-04 13:45:56.712623 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2025-12-04 13:45:56.712632 | controller | Thursday 04 December 2025 13:45:56 +0000 (0:00:00.028) 0:02:03.668 ***** 2025-12-04 13:45:56.712650 | controller | skipping: [instance] 2025-12-04 13:45:56.924730 | controller | 2025-12-04 13:45:56.924749 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-04 13:45:56.924757 | controller | Thursday 04 December 2025 13:45:56 +0000 (0:00:00.026) 0:02:03.695 ***** 2025-12-04 13:45:56.924765 | controller | changed: [instance] 2025-12-04 13:45:56.963127 | controller | 2025-12-04 13:45:56.963166 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-04 13:45:56.963176 | controller | Thursday 04 December 2025 13:45:56 +0000 (0:00:00.212) 0:02:03.907 ***** 2025-12-04 13:45:56.963189 | controller | ok: [instance] 2025-12-04 13:45:56.963481 | controller | 2025-12-04 13:45:56.963517 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-04 13:45:57.016925 | controller | Thursday 04 December 2025 13:45:56 +0000 (0:00:00.038) 0:02:03.945 ***** 2025-12-04 13:45:57.016948 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-12-04 13:45:57.214267 | controller | 2025-12-04 13:45:57.214293 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-12-04 13:45:57.214302 | controller | Thursday 04 December 2025 13:45:57 +0000 (0:00:00.053) 0:02:03.999 ***** 2025-12-04 13:45:57.214311 | controller | ok: [instance] 2025-12-04 13:45:57.276181 | controller | 2025-12-04 13:45:57.276214 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-12-04 13:45:57.276223 | controller | Thursday 04 December 2025 13:45:57 +0000 (0:00:00.197) 0:02:04.197 ***** 2025-12-04 13:45:57.276235 | controller | ok: [instance] 2025-12-04 13:45:57.276293 | controller | 2025-12-04 13:45:57.276314 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-12-04 13:45:57.276325 | controller | Thursday 04 December 2025 13:45:57 +0000 (0:00:00.062) 0:02:04.259 ***** 2025-12-04 13:45:57.320575 | controller | ok: [instance] 2025-12-04 13:45:57.364010 | controller | 2025-12-04 13:45:57.364028 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-12-04 13:45:57.364035 | controller | Thursday 04 December 2025 13:45:57 +0000 (0:00:00.044) 0:02:04.303 ***** 2025-12-04 13:45:57.364043 | controller | skipping: [instance] 2025-12-04 13:45:57.364330 | controller | 2025-12-04 13:45:57.407266 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-12-04 13:45:57.407284 | controller | Thursday 04 December 2025 13:45:57 +0000 (0:00:00.043) 0:02:04.347 ***** 2025-12-04 13:45:57.407294 | controller | skipping: [instance] 2025-12-04 13:45:57.407441 | controller | 2025-12-04 13:45:57.407580 | controller | TASK [Call the config_drive role] ********************************************** 2025-12-04 13:45:57.407706 | controller | Thursday 04 December 2025 13:45:57 +0000 (0:00:00.043) 0:02:04.390 ***** 2025-12-04 13:45:57.464838 | controller | 2025-12-04 13:45:57.465074 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-12-04 13:45:57.465257 | controller | Thursday 04 December 2025 13:45:57 +0000 (0:00:00.057) 0:02:04.447 ***** 2025-12-04 13:45:57.864115 | controller | ok: [instance] => (item=artifacts) 2025-12-04 13:45:59.000847 | controller | ok: [instance] => (item=logs) 2025-12-04 13:45:59.000879 | controller | 2025-12-04 13:45:59.000887 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-12-04 13:45:59.000893 | controller | Thursday 04 December 2025 13:45:57 +0000 (0:00:00.398) 0:02:04.846 ***** 2025-12-04 13:45:59.000903 | controller | ok: [instance] 2025-12-04 13:45:59.217145 | controller | 2025-12-04 13:45:59.217186 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-12-04 13:45:59.217196 | controller | Thursday 04 December 2025 13:45:58 +0000 (0:00:01.136) 0:02:05.983 ***** 2025-12-04 13:45:59.217209 | controller | changed: [instance] 2025-12-04 13:45:59.217240 | controller | 2025-12-04 13:45:59.217250 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-12-04 13:45:59.217276 | controller | Thursday 04 December 2025 13:45:59 +0000 (0:00:00.216) 0:02:06.199 ***** 2025-12-04 13:45:59.584566 | controller | changed: [instance] 2025-12-04 13:45:59.956801 | controller | 2025-12-04 13:45:59.956827 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-12-04 13:45:59.956840 | controller | Thursday 04 December 2025 13:45:59 +0000 (0:00:00.367) 0:02:06.567 ***** 2025-12-04 13:45:59.956851 | controller | changed: [instance] 2025-12-04 13:46:00.003515 | controller | 2025-12-04 13:46:00.003535 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-12-04 13:46:00.003542 | controller | Thursday 04 December 2025 13:45:59 +0000 (0:00:00.371) 0:02:06.939 ***** 2025-12-04 13:46:00.003551 | controller | skipping: [instance] 2025-12-04 13:46:00.195171 | controller | 2025-12-04 13:46:00.195192 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-12-04 13:46:00.195201 | controller | Thursday 04 December 2025 13:46:00 +0000 (0:00:00.046) 0:02:06.986 ***** 2025-12-04 13:46:00.195211 | controller | ok: [instance] 2025-12-04 13:46:00.235041 | controller | 2025-12-04 13:46:00.235077 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-12-04 13:46:00.235085 | controller | Thursday 04 December 2025 13:46:00 +0000 (0:00:00.191) 0:02:07.178 ***** 2025-12-04 13:46:00.235095 | controller | skipping: [instance] 2025-12-04 13:46:00.470515 | controller | 2025-12-04 13:46:00.470537 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-12-04 13:46:00.470545 | controller | Thursday 04 December 2025 13:46:00 +0000 (0:00:00.039) 0:02:07.218 ***** 2025-12-04 13:46:00.470554 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2025-12-04 13:46:00.749998 | controller | changed: [instance] 2025-12-04 13:46:00.750030 | controller | 2025-12-04 13:46:00.750038 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-04 13:46:00.750044 | controller | Thursday 04 December 2025 13:46:00 +0000 (0:00:00.235) 0:02:07.453 ***** 2025-12-04 13:46:00.750054 | controller | changed: [instance] 2025-12-04 13:46:00.796769 | controller | 2025-12-04 13:46:00.796789 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-04 13:46:00.796797 | controller | Thursday 04 December 2025 13:46:00 +0000 (0:00:00.279) 0:02:07.732 ***** 2025-12-04 13:46:00.796806 | controller | skipping: [instance] 2025-12-04 13:46:00.826370 | controller | 2025-12-04 13:46:00.826399 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2025-12-04 13:46:00.826408 | controller | Thursday 04 December 2025 13:46:00 +0000 (0:00:00.047) 0:02:07.779 ***** 2025-12-04 13:46:00.826417 | controller | skipping: [instance] 2025-12-04 13:46:01.182076 | controller | 2025-12-04 13:46:01.182109 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2025-12-04 13:46:01.182119 | controller | Thursday 04 December 2025 13:46:00 +0000 (0:00:00.029) 0:02:07.809 ***** 2025-12-04 13:46:01.182136 | controller | changed: [instance] 2025-12-04 13:46:01.182157 | controller | 2025-12-04 13:46:01.182166 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2025-12-04 13:46:01.182206 | controller | Thursday 04 December 2025 13:46:01 +0000 (0:00:00.355) 0:02:08.164 ***** 2025-12-04 13:46:01.425076 | controller | changed: [instance] 2025-12-04 13:46:01.425148 | controller | 2025-12-04 13:46:01.425419 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2025-12-04 13:46:01.711945 | controller | Thursday 04 December 2025 13:46:01 +0000 (0:00:00.242) 0:02:08.407 ***** 2025-12-04 13:46:01.712008 | controller | changed: [instance] 2025-12-04 13:46:01.742225 | controller | 2025-12-04 13:46:01.742261 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2025-12-04 13:46:01.742273 | controller | Thursday 04 December 2025 13:46:01 +0000 (0:00:00.286) 0:02:08.694 ***** 2025-12-04 13:46:01.742286 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-04 13:46:01.786171 | controller | 2025-12-04 13:46:01.786215 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-04 13:46:01.786230 | controller | Thursday 04 December 2025 13:46:01 +0000 (0:00:00.030) 0:02:08.725 ***** 2025-12-04 13:46:01.786249 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-04 13:46:02.006478 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-04 13:46:02.006507 | controller | 2025-12-04 13:46:02.006514 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 13:46:02.006521 | controller | Thursday 04 December 2025 13:46:01 +0000 (0:00:00.043) 0:02:08.768 ***** 2025-12-04 13:46:02.006530 | controller | ok: [instance] 2025-12-04 13:46:02.050754 | controller | 2025-12-04 13:46:02.050773 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 13:46:02.050780 | controller | Thursday 04 December 2025 13:46:02 +0000 (0:00:00.220) 0:02:08.989 ***** 2025-12-04 13:46:02.050789 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 13:46:02.275248 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 13:46:02.275272 | controller | 2025-12-04 13:46:02.275281 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 13:46:02.275288 | controller | Thursday 04 December 2025 13:46:02 +0000 (0:00:00.044) 0:02:09.033 ***** 2025-12-04 13:46:02.275299 | controller | ok: [instance] 2025-12-04 13:46:02.471142 | controller | 2025-12-04 13:46:02.471179 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 13:46:02.471190 | controller | Thursday 04 December 2025 13:46:02 +0000 (0:00:00.224) 0:02:09.258 ***** 2025-12-04 13:46:02.471203 | controller | ok: [instance] 2025-12-04 13:46:03.747741 | controller | 2025-12-04 13:46:03.747771 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2025-12-04 13:46:03.747778 | controller | Thursday 04 December 2025 13:46:02 +0000 (0:00:00.195) 0:02:09.453 ***** 2025-12-04 13:46:03.747788 | controller | changed: [instance] 2025-12-04 13:46:03.976762 | controller | 2025-12-04 13:46:03.976791 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-04 13:46:03.976799 | controller | Thursday 04 December 2025 13:46:03 +0000 (0:00:01.276) 0:02:10.730 ***** 2025-12-04 13:46:03.976808 | controller | ok: [instance] 2025-12-04 13:46:04.020033 | controller | 2025-12-04 13:46:04.020058 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-04 13:46:04.020069 | controller | Thursday 04 December 2025 13:46:03 +0000 (0:00:00.228) 0:02:10.959 ***** 2025-12-04 13:46:04.020081 | controller | ok: [instance] => (item=cifmw-public) 2025-12-04 13:46:04.020110 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-04 13:46:04.020119 | controller | 2025-12-04 13:46:04.020128 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-04 13:46:04.020285 | controller | Thursday 04 December 2025 13:46:04 +0000 (0:00:00.043) 0:02:11.002 ***** 2025-12-04 13:46:04.251793 | controller | ok: [instance] 2025-12-04 13:46:04.453943 | controller | 2025-12-04 13:46:04.453998 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-04 13:46:04.454007 | controller | Thursday 04 December 2025 13:46:04 +0000 (0:00:00.231) 0:02:11.234 ***** 2025-12-04 13:46:04.454016 | controller | ok: [instance] 2025-12-04 13:46:05.739199 | controller | 2025-12-04 13:46:05.739252 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2025-12-04 13:46:05.739266 | controller | Thursday 04 December 2025 13:46:04 +0000 (0:00:00.202) 0:02:11.436 ***** 2025-12-04 13:46:05.739285 | controller | changed: [instance] 2025-12-04 13:46:05.760535 | controller | 2025-12-04 13:46:05.760567 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2025-12-04 13:46:05.760575 | controller | Thursday 04 December 2025 13:46:05 +0000 (0:00:01.285) 0:02:12.721 ***** 2025-12-04 13:46:05.760585 | controller | skipping: [instance] 2025-12-04 13:46:05.788069 | controller | 2025-12-04 13:46:05.788103 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2025-12-04 13:46:05.788114 | controller | Thursday 04 December 2025 13:46:05 +0000 (0:00:00.021) 0:02:12.743 ***** 2025-12-04 13:46:05.788127 | controller | skipping: [instance] 2025-12-04 13:46:05.788296 | controller | 2025-12-04 13:46:05.788324 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2025-12-04 13:46:05.815107 | controller | Thursday 04 December 2025 13:46:05 +0000 (0:00:00.027) 0:02:12.771 ***** 2025-12-04 13:46:05.815136 | controller | skipping: [instance] 2025-12-04 13:46:05.815394 | controller | 2025-12-04 13:46:05.815423 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2025-12-04 13:46:05.841477 | controller | Thursday 04 December 2025 13:46:05 +0000 (0:00:00.027) 0:02:12.798 ***** 2025-12-04 13:46:05.841500 | controller | skipping: [instance] 2025-12-04 13:46:07.058644 | controller | 2025-12-04 13:46:07.058678 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-04 13:46:07.058687 | controller | Thursday 04 December 2025 13:46:05 +0000 (0:00:00.026) 0:02:12.824 ***** 2025-12-04 13:46:07.058697 | controller | changed: [instance] 2025-12-04 13:46:07.094399 | controller | 2025-12-04 13:46:07.094425 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-04 13:46:07.094434 | controller | Thursday 04 December 2025 13:46:07 +0000 (0:00:01.216) 0:02:14.041 ***** 2025-12-04 13:46:07.094445 | controller | ok: [instance] 2025-12-04 13:46:07.120118 | controller | 2025-12-04 13:46:07.120144 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-04 13:46:07.120153 | controller | Thursday 04 December 2025 13:46:07 +0000 (0:00:00.035) 0:02:14.077 ***** 2025-12-04 13:46:07.120165 | controller | skipping: [instance] 2025-12-04 13:46:07.120351 | controller | 2025-12-04 13:46:07.120370 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-04 13:46:07.147759 | controller | Thursday 04 December 2025 13:46:07 +0000 (0:00:00.025) 0:02:14.103 ***** 2025-12-04 13:46:07.147785 | controller | skipping: [instance] 2025-12-04 13:46:07.192541 | controller | 2025-12-04 13:46:07.192564 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-04 13:46:07.192573 | controller | Thursday 04 December 2025 13:46:07 +0000 (0:00:00.027) 0:02:14.130 ***** 2025-12-04 13:46:07.192584 | controller | skipping: [instance] 2025-12-04 13:46:07.218135 | controller | 2025-12-04 13:46:07.218198 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2025-12-04 13:46:07.218208 | controller | Thursday 04 December 2025 13:46:07 +0000 (0:00:00.044) 0:02:14.175 ***** 2025-12-04 13:46:07.218220 | controller | skipping: [instance] 2025-12-04 13:46:07.280085 | controller | 2025-12-04 13:46:07.280108 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2025-12-04 13:46:07.280118 | controller | Thursday 04 December 2025 13:46:07 +0000 (0:00:00.025) 0:02:14.201 ***** 2025-12-04 13:46:07.280129 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2025-12-04 13:46:07.280150 | controller | 2025-12-04 13:46:07.280157 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2025-12-04 13:46:07.280166 | controller | Thursday 04 December 2025 13:46:07 +0000 (0:00:00.061) 0:02:14.262 ***** 2025-12-04 13:46:07.514221 | controller | ok: [instance] => (item=crc) 2025-12-04 13:46:07.514564 | controller | 2025-12-04 13:46:09.583653 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2025-12-04 13:46:09.583687 | controller | Thursday 04 December 2025 13:46:07 +0000 (0:00:00.234) 0:02:14.497 ***** 2025-12-04 13:46:09.583699 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-04 13:46:10.408101 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-04 13:46:10.408136 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-04 13:46:10.408145 | controller | 2025-12-04 13:46:10.408153 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-04 13:46:10.408160 | controller | Thursday 04 December 2025 13:46:09 +0000 (0:00:02.068) 0:02:16.565 ***** 2025-12-04 13:46:10.408179 | controller | changed: [instance] 2025-12-04 13:46:11.197265 | controller | 2025-12-04 13:46:11.197298 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-04 13:46:11.197307 | controller | Thursday 04 December 2025 13:46:10 +0000 (0:00:00.824) 0:02:17.390 ***** 2025-12-04 13:46:11.197317 | controller | changed: [instance] 2025-12-04 13:46:11.998210 | controller | 2025-12-04 13:46:11.998240 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-04 13:46:11.998248 | controller | Thursday 04 December 2025 13:46:11 +0000 (0:00:00.788) 0:02:18.179 ***** 2025-12-04 13:46:11.998259 | controller | changed: [instance] 2025-12-04 13:46:12.736315 | controller | 2025-12-04 13:46:12.736347 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2025-12-04 13:46:12.736355 | controller | Thursday 04 December 2025 13:46:11 +0000 (0:00:00.801) 0:02:18.980 ***** 2025-12-04 13:46:12.736366 | controller | changed: [instance] => (item=compute-0.utility) 2025-12-04 13:46:32.646901 | controller | changed: [instance] => (item=controller-0.utility) 2025-12-04 13:46:32.646938 | controller | changed: [instance] => (item=crc-0.utility) 2025-12-04 13:46:32.646946 | controller | 2025-12-04 13:46:32.646952 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2025-12-04 13:46:32.646972 | controller | Thursday 04 December 2025 13:46:12 +0000 (0:00:00.737) 0:02:19.718 ***** 2025-12-04 13:46:32.646987 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-12-04 13:46:32.648127 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2025-12-04 13:46:32.762804 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2025-12-04 13:46:32.762825 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2025-12-04 13:46:32.762833 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2025-12-04 13:46:32.762839 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j782127146343.24005', 'results_file': '/home/zuul/.ansible_async/j782127146343.24005', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2025-12-04 13:46:32.762851 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j981072975770.24023', 'results_file': '/home/zuul/.ansible_async/j981072975770.24023', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2025-12-04 13:46:32.762856 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-12-04 13:46:32.762862 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j558932767879.24039', 'results_file': '/home/zuul/.ansible_async/j558932767879.24039', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2025-12-04 13:46:32.762867 | controller | 2025-12-04 13:46:32.762872 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2025-12-04 13:46:32.762878 | controller | Thursday 04 December 2025 13:46:32 +0000 (0:00:19.911) 0:02:39.629 ***** 2025-12-04 13:46:32.762888 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-04 13:46:32.786309 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-04 13:46:32.786346 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-04 13:46:32.786367 | controller | 2025-12-04 13:46:32.786373 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-04 13:46:32.786380 | controller | Thursday 04 December 2025 13:46:32 +0000 (0:00:00.115) 0:02:39.745 ***** 2025-12-04 13:46:32.786404 | controller | skipping: [instance] 2025-12-04 13:46:32.786494 | controller | 2025-12-04 13:46:32.786540 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2025-12-04 13:46:32.824886 | controller | Thursday 04 December 2025 13:46:32 +0000 (0:00:00.023) 0:02:39.769 ***** 2025-12-04 13:46:32.824911 | controller | 2025-12-04 13:46:32.825004 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-04 13:46:32.825117 | controller | Thursday 04 December 2025 13:46:32 +0000 (0:00:00.038) 0:02:39.807 ***** 2025-12-04 13:46:32.917230 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-12-04 13:46:32.917292 | controller | 2025-12-04 13:46:32.917418 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-04 13:46:32.917534 | controller | Thursday 04 December 2025 13:46:32 +0000 (0:00:00.092) 0:02:39.900 ***** 2025-12-04 13:46:33.162494 | controller | changed: [instance] 2025-12-04 13:46:33.407881 | controller | 2025-12-04 13:46:33.407915 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-04 13:46:33.407923 | controller | Thursday 04 December 2025 13:46:33 +0000 (0:00:00.244) 0:02:40.144 ***** 2025-12-04 13:46:33.407934 | controller | changed: [instance] 2025-12-04 13:46:33.817195 | controller | 2025-12-04 13:46:33.817227 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2025-12-04 13:46:33.817235 | controller | Thursday 04 December 2025 13:46:33 +0000 (0:00:00.245) 0:02:40.390 ***** 2025-12-04 13:46:33.817245 | controller | changed: [instance] 2025-12-04 13:46:33.850000 | controller | 2025-12-04 13:46:33.850027 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2025-12-04 13:46:33.850035 | controller | Thursday 04 December 2025 13:46:33 +0000 (0:00:00.409) 0:02:40.799 ***** 2025-12-04 13:46:33.850045 | controller | skipping: [instance] 2025-12-04 13:46:33.879388 | controller | 2025-12-04 13:46:33.879413 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-04 13:46:33.879421 | controller | Thursday 04 December 2025 13:46:33 +0000 (0:00:00.033) 0:02:40.832 ***** 2025-12-04 13:46:33.879430 | controller | skipping: [instance] 2025-12-04 13:46:33.932016 | controller | 2025-12-04 13:46:33.932040 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2025-12-04 13:46:33.932048 | controller | Thursday 04 December 2025 13:46:33 +0000 (0:00:00.029) 0:02:40.862 ***** 2025-12-04 13:46:33.932058 | controller | skipping: [instance] 2025-12-04 13:46:33.932250 | controller | 2025-12-04 13:46:33.932263 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2025-12-04 13:46:33.980641 | controller | Thursday 04 December 2025 13:46:33 +0000 (0:00:00.052) 0:02:40.914 ***** 2025-12-04 13:46:33.980663 | controller | skipping: [instance] 2025-12-04 13:46:34.004685 | controller | 2025-12-04 13:46:34.004704 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-04 13:46:34.004711 | controller | Thursday 04 December 2025 13:46:33 +0000 (0:00:00.048) 0:02:40.963 ***** 2025-12-04 13:46:34.004720 | controller | skipping: [instance] 2025-12-04 13:46:34.044383 | controller | 2025-12-04 13:46:34.044402 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2025-12-04 13:46:34.044410 | controller | Thursday 04 December 2025 13:46:34 +0000 (0:00:00.024) 0:02:40.987 ***** 2025-12-04 13:46:34.044418 | controller | 2025-12-04 13:46:34.125974 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-04 13:46:34.125998 | controller | Thursday 04 December 2025 13:46:34 +0000 (0:00:00.039) 0:02:41.027 ***** 2025-12-04 13:46:34.126010 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-12-04 13:46:34.126170 | controller | 2025-12-04 13:46:34.126338 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-04 13:46:34.126493 | controller | Thursday 04 December 2025 13:46:34 +0000 (0:00:00.081) 0:02:41.109 ***** 2025-12-04 13:46:34.337507 | controller | ok: [instance] 2025-12-04 13:46:34.337557 | controller | 2025-12-04 13:46:34.337568 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-04 13:46:34.337663 | controller | Thursday 04 December 2025 13:46:34 +0000 (0:00:00.211) 0:02:41.320 ***** 2025-12-04 13:46:34.549903 | controller | ok: [instance] 2025-12-04 13:46:34.969212 | controller | 2025-12-04 13:46:34.969257 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2025-12-04 13:46:34.969270 | controller | Thursday 04 December 2025 13:46:34 +0000 (0:00:00.212) 0:02:41.532 ***** 2025-12-04 13:46:34.969282 | controller | changed: [instance] 2025-12-04 13:46:34.969590 | controller | 2025-12-04 13:46:34.997973 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2025-12-04 13:46:34.997999 | controller | Thursday 04 December 2025 13:46:34 +0000 (0:00:00.417) 0:02:41.949 ***** 2025-12-04 13:46:34.998012 | controller | skipping: [instance] 2025-12-04 13:46:35.029134 | controller | 2025-12-04 13:46:35.029163 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-04 13:46:35.029171 | controller | Thursday 04 December 2025 13:46:34 +0000 (0:00:00.031) 0:02:41.980 ***** 2025-12-04 13:46:35.029182 | controller | skipping: [instance] 2025-12-04 13:46:36.566862 | controller | 2025-12-04 13:46:36.566898 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2025-12-04 13:46:36.566907 | controller | Thursday 04 December 2025 13:46:35 +0000 (0:00:00.031) 0:02:42.012 ***** 2025-12-04 13:46:36.566917 | controller | changed: [instance -> controller-0.instance] 2025-12-04 13:46:37.626820 | controller | 2025-12-04 13:46:37.626862 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2025-12-04 13:46:37.626871 | controller | Thursday 04 December 2025 13:46:36 +0000 (0:00:01.537) 0:02:43.549 ***** 2025-12-04 13:46:37.626881 | controller | changed: [instance -> controller-0.instance] 2025-12-04 13:46:37.626898 | controller | 2025-12-04 13:46:37.626906 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-04 13:46:37.626989 | controller | Thursday 04 December 2025 13:46:37 +0000 (0:00:01.060) 0:02:44.609 ***** 2025-12-04 13:46:37.666306 | controller | 2025-12-04 13:46:37.868187 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-12-04 13:46:37.868223 | controller | Thursday 04 December 2025 13:46:37 +0000 (0:00:00.039) 0:02:44.649 ***** 2025-12-04 13:46:37.868234 | controller | ok: [instance] 2025-12-04 13:46:37.893378 | controller | 2025-12-04 13:46:37.893398 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-12-04 13:46:37.893405 | controller | Thursday 04 December 2025 13:46:37 +0000 (0:00:00.201) 0:02:44.850 ***** 2025-12-04 13:46:37.893414 | controller | ok: [instance] 2025-12-04 13:46:37.922834 | controller | 2025-12-04 13:46:37.922871 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-12-04 13:46:37.922880 | controller | Thursday 04 December 2025 13:46:37 +0000 (0:00:00.025) 0:02:44.876 ***** 2025-12-04 13:46:37.922891 | controller | skipping: [instance] 2025-12-04 13:46:37.922910 | controller | 2025-12-04 13:46:37.923010 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2025-12-04 13:46:37.923101 | controller | Thursday 04 December 2025 13:46:37 +0000 (0:00:00.029) 0:02:44.905 ***** 2025-12-04 13:46:37.966092 | controller | 2025-12-04 13:46:37.966191 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-04 13:46:37.966293 | controller | Thursday 04 December 2025 13:46:37 +0000 (0:00:00.043) 0:02:44.949 ***** 2025-12-04 13:46:38.045586 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2025-12-04 13:46:38.045800 | controller | 2025-12-04 13:46:38.045854 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-04 13:46:38.045865 | controller | Thursday 04 December 2025 13:46:38 +0000 (0:00:00.079) 0:02:45.028 ***** 2025-12-04 13:46:38.255640 | controller | ok: [instance] 2025-12-04 13:46:38.255703 | controller | 2025-12-04 13:46:38.255775 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-04 13:46:38.255873 | controller | Thursday 04 December 2025 13:46:38 +0000 (0:00:00.209) 0:02:45.238 ***** 2025-12-04 13:46:38.467603 | controller | ok: [instance] 2025-12-04 13:46:38.467658 | controller | 2025-12-04 13:46:38.467765 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2025-12-04 13:46:38.467866 | controller | Thursday 04 December 2025 13:46:38 +0000 (0:00:00.212) 0:02:45.450 ***** 2025-12-04 13:46:38.852385 | controller | changed: [instance] 2025-12-04 13:46:38.852440 | controller | 2025-12-04 13:46:38.852542 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2025-12-04 13:46:38.852637 | controller | Thursday 04 December 2025 13:46:38 +0000 (0:00:00.384) 0:02:45.835 ***** 2025-12-04 13:46:39.694182 | controller | changed: [instance] 2025-12-04 13:46:39.694249 | controller | 2025-12-04 13:46:39.694358 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-04 13:46:39.694456 | controller | Thursday 04 December 2025 13:46:39 +0000 (0:00:00.841) 0:02:46.676 ***** 2025-12-04 13:46:39.724290 | controller | skipping: [instance] 2025-12-04 13:46:39.724379 | controller | 2025-12-04 13:46:39.724482 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2025-12-04 13:46:39.724582 | controller | Thursday 04 December 2025 13:46:39 +0000 (0:00:00.030) 0:02:46.707 ***** 2025-12-04 13:46:39.775690 | controller | skipping: [instance] 2025-12-04 13:46:39.775771 | controller | 2025-12-04 13:46:39.775876 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2025-12-04 13:46:39.776005 | controller | Thursday 04 December 2025 13:46:39 +0000 (0:00:00.051) 0:02:46.758 ***** 2025-12-04 13:46:39.823374 | controller | skipping: [instance] 2025-12-04 13:46:39.823462 | controller | 2025-12-04 13:46:39.823566 | controller | TASK [Create VBMC entity] ****************************************************** 2025-12-04 13:46:39.823669 | controller | Thursday 04 December 2025 13:46:39 +0000 (0:00:00.047) 0:02:46.806 ***** 2025-12-04 13:46:39.877932 | controller | skipping: [instance] => (item=compute-0) 2025-12-04 13:46:39.878103 | controller | skipping: [instance] => (item=controller-0) 2025-12-04 13:46:39.878277 | controller | skipping: [instance] => (item=crc-0) 2025-12-04 13:46:39.878610 | controller | skipping: [instance] 2025-12-04 13:46:39.878741 | controller | 2025-12-04 13:46:39.878875 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2025-12-04 13:46:39.879031 | controller | Thursday 04 December 2025 13:46:39 +0000 (0:00:00.054) 0:02:46.861 ***** 2025-12-04 13:46:40.133464 | controller | ok: [instance] 2025-12-04 13:46:40.133617 | controller | 2025-12-04 13:46:40.133756 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2025-12-04 13:46:40.133893 | controller | Thursday 04 December 2025 13:46:40 +0000 (0:00:00.255) 0:02:47.116 ***** 2025-12-04 13:46:40.508251 | controller | changed: [instance] 2025-12-04 13:46:40.544456 | controller | 2025-12-04 13:46:40.544498 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2025-12-04 13:46:40.544507 | controller | Thursday 04 December 2025 13:46:40 +0000 (0:00:00.374) 0:02:47.490 ***** 2025-12-04 13:46:40.544517 | controller | skipping: [instance] 2025-12-04 13:46:40.544535 | controller | 2025-12-04 13:46:40.544541 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2025-12-04 13:46:40.544548 | controller | Thursday 04 December 2025 13:46:40 +0000 (0:00:00.036) 0:02:47.527 ***** 2025-12-04 13:46:40.578227 | controller | skipping: [instance] 2025-12-04 13:46:40.578447 | controller | 2025-12-04 13:46:40.578475 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2025-12-04 13:46:40.613919 | controller | Thursday 04 December 2025 13:46:40 +0000 (0:00:00.033) 0:02:47.561 ***** 2025-12-04 13:46:40.613949 | controller | skipping: [instance] 2025-12-04 13:46:41.321821 | controller | 2025-12-04 13:46:41.321858 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2025-12-04 13:46:41.321867 | controller | Thursday 04 December 2025 13:46:40 +0000 (0:00:00.035) 0:02:47.596 ***** 2025-12-04 13:46:41.321878 | controller | changed: [instance] 2025-12-04 13:46:41.970061 | controller | 2025-12-04 13:46:41.970095 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2025-12-04 13:46:41.970103 | controller | Thursday 04 December 2025 13:46:41 +0000 (0:00:00.707) 0:02:48.304 ***** 2025-12-04 13:46:41.970114 | controller | changed: [instance] 2025-12-04 13:46:41.970139 | controller | 2025-12-04 13:46:41.970147 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2025-12-04 13:46:41.970279 | controller | Thursday 04 December 2025 13:46:41 +0000 (0:00:00.647) 0:02:48.952 ***** 2025-12-04 13:46:42.019379 | controller | skipping: [instance] 2025-12-04 13:46:42.092148 | controller | 2025-12-04 13:46:42.092212 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2025-12-04 13:46:42.092222 | controller | Thursday 04 December 2025 13:46:42 +0000 (0:00:00.049) 0:02:49.001 ***** 2025-12-04 13:46:42.092238 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2025-12-04 13:46:42.092246 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2025-12-04 13:46:42.092252 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2025-12-04 13:46:42.092258 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2025-12-04 13:46:42.092263 | controller | 2025-12-04 13:46:42.092272 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2025-12-04 13:46:42.139781 | controller | Thursday 04 December 2025 13:46:42 +0000 (0:00:00.072) 0:02:49.074 ***** 2025-12-04 13:46:42.139843 | controller | skipping: [instance] 2025-12-04 13:46:42.139872 | controller | 2025-12-04 13:46:42.139912 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2025-12-04 13:46:42.140088 | controller | Thursday 04 December 2025 13:46:42 +0000 (0:00:00.048) 0:02:49.122 ***** 2025-12-04 13:46:42.193650 | controller | skipping: [instance] 2025-12-04 13:46:42.235881 | controller | 2025-12-04 13:46:42.235928 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2025-12-04 13:46:42.235938 | controller | Thursday 04 December 2025 13:46:42 +0000 (0:00:00.053) 0:02:49.176 ***** 2025-12-04 13:46:42.235951 | controller | skipping: [instance] 2025-12-04 13:46:42.236010 | controller | 2025-12-04 13:46:42.236023 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2025-12-04 13:46:42.236150 | controller | Thursday 04 December 2025 13:46:42 +0000 (0:00:00.042) 0:02:49.218 ***** 2025-12-04 13:46:42.278628 | controller | skipping: [instance] 2025-12-04 13:46:42.952099 | controller | 2025-12-04 13:46:42.952134 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2025-12-04 13:46:42.952143 | controller | Thursday 04 December 2025 13:46:42 +0000 (0:00:00.042) 0:02:49.261 ***** 2025-12-04 13:46:42.952153 | controller | changed: [instance] 2025-12-04 13:46:42.952182 | controller | 2025-12-04 13:46:42.952190 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2025-12-04 13:46:42.952260 | controller | Thursday 04 December 2025 13:46:42 +0000 (0:00:00.673) 0:02:49.934 ***** 2025-12-04 13:46:42.988573 | controller | skipping: [instance] 2025-12-04 13:46:43.022860 | controller | 2025-12-04 13:46:43.022899 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2025-12-04 13:46:43.022912 | controller | Thursday 04 December 2025 13:46:42 +0000 (0:00:00.036) 0:02:49.971 ***** 2025-12-04 13:46:43.022923 | controller | skipping: [instance] 2025-12-04 13:46:43.022951 | controller | 2025-12-04 13:46:43.022976 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2025-12-04 13:46:43.023137 | controller | Thursday 04 December 2025 13:46:43 +0000 (0:00:00.034) 0:02:50.005 ***** 2025-12-04 13:46:43.057631 | controller | skipping: [instance] 2025-12-04 13:46:43.058168 | controller | 2025-12-04 13:46:43.092532 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-12-04 13:46:43.092557 | controller | Thursday 04 December 2025 13:46:43 +0000 (0:00:00.034) 0:02:50.040 ***** 2025-12-04 13:46:43.092568 | controller | skipping: [instance] 2025-12-04 13:46:43.129314 | controller | 2025-12-04 13:46:43.129358 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-12-04 13:46:43.129367 | controller | Thursday 04 December 2025 13:46:43 +0000 (0:00:00.035) 0:02:50.075 ***** 2025-12-04 13:46:43.129377 | controller | skipping: [instance] 2025-12-04 13:46:43.163750 | controller | 2025-12-04 13:46:43.163771 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-12-04 13:46:43.163779 | controller | Thursday 04 December 2025 13:46:43 +0000 (0:00:00.036) 0:02:50.111 ***** 2025-12-04 13:46:43.163788 | controller | skipping: [instance] 2025-12-04 13:46:43.201927 | controller | 2025-12-04 13:46:43.201976 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-12-04 13:46:43.201988 | controller | Thursday 04 December 2025 13:46:43 +0000 (0:00:00.034) 0:02:50.146 ***** 2025-12-04 13:46:43.201999 | controller | skipping: [instance] 2025-12-04 13:46:43.246246 | controller | 2025-12-04 13:46:43.246269 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-12-04 13:46:43.246277 | controller | Thursday 04 December 2025 13:46:43 +0000 (0:00:00.037) 0:02:50.184 ***** 2025-12-04 13:46:43.246286 | controller | skipping: [instance] 2025-12-04 13:46:43.246595 | controller | 2025-12-04 13:46:43.288499 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-12-04 13:46:43.288520 | controller | Thursday 04 December 2025 13:46:43 +0000 (0:00:00.044) 0:02:50.228 ***** 2025-12-04 13:46:43.288532 | controller | skipping: [instance] 2025-12-04 13:46:43.341489 | controller | 2025-12-04 13:46:43.341528 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-12-04 13:46:43.341536 | controller | Thursday 04 December 2025 13:46:43 +0000 (0:00:00.042) 0:02:50.271 ***** 2025-12-04 13:46:43.341547 | controller | skipping: [instance] 2025-12-04 13:46:43.341709 | controller | 2025-12-04 13:46:43.341860 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2025-12-04 13:46:43.342033 | controller | Thursday 04 December 2025 13:46:43 +0000 (0:00:00.052) 0:02:50.324 ***** 2025-12-04 13:46:43.386302 | controller | skipping: [instance] 2025-12-04 13:46:43.551737 | controller | 2025-12-04 13:46:43.551758 | controller | TASK [reproducer : Configure Controller node] ********************************** 2025-12-04 13:46:43.551766 | controller | Thursday 04 December 2025 13:46:43 +0000 (0:00:00.044) 0:02:50.368 ***** 2025-12-04 13:46:43.551775 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2025-12-04 13:46:44.993930 | controller | 2025-12-04 13:46:44.993978 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-12-04 13:46:44.993990 | controller | Thursday 04 December 2025 13:46:43 +0000 (0:00:00.165) 0:02:50.534 ***** 2025-12-04 13:46:44.994001 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-12-04 13:46:45.016971 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-12-04 13:46:45.016990 | controller | 2025-12-04 13:46:45.016998 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-12-04 13:46:45.017008 | controller | Thursday 04 December 2025 13:46:44 +0000 (0:00:01.441) 0:02:51.976 ***** 2025-12-04 13:46:45.017017 | controller | skipping: [instance] 2025-12-04 13:46:45.657777 | controller | 2025-12-04 13:46:45.657809 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-04 13:46:45.657817 | controller | Thursday 04 December 2025 13:46:45 +0000 (0:00:00.023) 0:02:51.999 ***** 2025-12-04 13:46:45.657827 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:46:45.695549 | controller | 2025-12-04 13:46:45.695578 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-04 13:46:45.695586 | controller | Thursday 04 December 2025 13:46:45 +0000 (0:00:00.640) 0:02:52.640 ***** 2025-12-04 13:46:45.695596 | controller | skipping: [instance] 2025-12-04 13:46:45.737000 | controller | 2025-12-04 13:46:45.737022 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-04 13:46:45.737029 | controller | Thursday 04 December 2025 13:46:45 +0000 (0:00:00.037) 0:02:52.677 ***** 2025-12-04 13:46:45.737038 | controller | skipping: [instance] 2025-12-04 13:46:45.783657 | controller | 2025-12-04 13:46:45.783680 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-04 13:46:45.783690 | controller | Thursday 04 December 2025 13:46:45 +0000 (0:00:00.041) 0:02:52.719 ***** 2025-12-04 13:46:45.783701 | controller | skipping: [instance] 2025-12-04 13:46:45.834075 | controller | 2025-12-04 13:46:45.834123 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-04 13:46:45.834132 | controller | Thursday 04 December 2025 13:46:45 +0000 (0:00:00.046) 0:02:52.766 ***** 2025-12-04 13:46:45.834144 | controller | skipping: [instance] 2025-12-04 13:46:45.834165 | controller | 2025-12-04 13:46:45.834172 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2025-12-04 13:46:45.834180 | controller | Thursday 04 December 2025 13:46:45 +0000 (0:00:00.050) 0:02:52.816 ***** 2025-12-04 13:46:45.874991 | controller | skipping: [instance] 2025-12-04 13:46:45.875114 | controller | 2025-12-04 13:46:45.875266 | controller | TASK [reproducer : Install repos] ********************************************** 2025-12-04 13:46:45.875419 | controller | Thursday 04 December 2025 13:46:45 +0000 (0:00:00.041) 0:02:52.858 ***** 2025-12-04 13:46:45.918652 | controller | skipping: [instance] 2025-12-04 13:46:45.918773 | controller | 2025-12-04 13:46:45.918918 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2025-12-04 13:46:45.919103 | controller | Thursday 04 December 2025 13:46:45 +0000 (0:00:00.043) 0:02:52.901 ***** 2025-12-04 13:46:45.958289 | controller | skipping: [instance] 2025-12-04 13:46:45.958403 | controller | 2025-12-04 13:46:45.958525 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2025-12-04 13:46:45.958626 | controller | Thursday 04 December 2025 13:46:45 +0000 (0:00:00.039) 0:02:52.941 ***** 2025-12-04 13:46:46.000353 | controller | skipping: [instance] 2025-12-04 13:46:46.000544 | controller | 2025-12-04 13:46:46.000725 | controller | TASK [reproducer : Install some tools] ***************************************** 2025-12-04 13:46:46.000852 | controller | Thursday 04 December 2025 13:46:45 +0000 (0:00:00.041) 0:02:52.983 ***** 2025-12-04 13:46:47.123316 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:46:48.233849 | controller | 2025-12-04 13:46:48.233882 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2025-12-04 13:46:48.233890 | controller | Thursday 04 December 2025 13:46:47 +0000 (0:00:01.122) 0:02:54.105 ***** 2025-12-04 13:46:48.233900 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:46:48.880221 | controller | 2025-12-04 13:46:48.880257 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2025-12-04 13:46:48.880265 | controller | Thursday 04 December 2025 13:46:48 +0000 (0:00:01.110) 0:02:55.216 ***** 2025-12-04 13:46:48.880276 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:46:48.880572 | controller | 2025-12-04 13:46:48.880586 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2025-12-04 13:46:49.942253 | controller | Thursday 04 December 2025 13:46:48 +0000 (0:00:00.646) 0:02:55.862 ***** 2025-12-04 13:46:49.942290 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:46:51.090644 | controller | 2025-12-04 13:46:51.090691 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2025-12-04 13:46:51.090700 | controller | Thursday 04 December 2025 13:46:49 +0000 (0:00:01.062) 0:02:56.924 ***** 2025-12-04 13:46:51.090710 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-12-04 13:46:51.090943 | controller | skipping: [instance] => (item=compute-0) 2025-12-04 13:46:51.091077 | controller | skipping: [instance] => (item=controller-0) 2025-12-04 13:46:51.091439 | controller | skipping: [instance] => (item=crc-0) 2025-12-04 13:46:51.091593 | controller | 2025-12-04 13:46:51.091605 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2025-12-04 13:46:51.091614 | controller | Thursday 04 December 2025 13:46:51 +0000 (0:00:01.148) 0:02:58.073 ***** 2025-12-04 13:46:51.777069 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-12-04 13:46:53.503277 | controller | skipping: [instance] => (item=compute-0) 2025-12-04 13:46:53.503312 | controller | skipping: [instance] => (item=controller-0) 2025-12-04 13:46:53.503320 | controller | skipping: [instance] => (item=crc-0) 2025-12-04 13:46:53.503325 | controller | 2025-12-04 13:46:53.503343 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2025-12-04 13:46:53.503349 | controller | Thursday 04 December 2025 13:46:51 +0000 (0:00:00.685) 0:02:58.759 ***** 2025-12-04 13:46:53.503359 | controller | skipping: [instance] => (item=instance) 2025-12-04 13:46:54.146487 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2025-12-04 13:46:54.146527 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-12-04 13:46:54.146537 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2025-12-04 13:46:54.146545 | controller | 2025-12-04 13:46:54.146553 | controller | TASK [reproducer : Create kube directory] ************************************** 2025-12-04 13:46:54.146561 | controller | Thursday 04 December 2025 13:46:53 +0000 (0:00:01.725) 0:03:00.485 ***** 2025-12-04 13:46:54.146573 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:46:55.168049 | controller | 2025-12-04 13:46:55.168083 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2025-12-04 13:46:55.168091 | controller | Thursday 04 December 2025 13:46:54 +0000 (0:00:00.643) 0:03:01.128 ***** 2025-12-04 13:46:55.168102 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:46:56.169894 | controller | 2025-12-04 13:46:56.169926 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2025-12-04 13:46:56.169934 | controller | Thursday 04 December 2025 13:46:55 +0000 (0:00:01.018) 0:03:02.147 ***** 2025-12-04 13:46:56.169944 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:46:56.203004 | controller | 2025-12-04 13:46:56.203028 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2025-12-04 13:46:56.203036 | controller | Thursday 04 December 2025 13:46:56 +0000 (0:00:01.005) 0:03:03.152 ***** 2025-12-04 13:46:56.203045 | controller | skipping: [instance] 2025-12-04 13:46:56.777557 | controller | 2025-12-04 13:46:56.777592 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2025-12-04 13:46:56.777601 | controller | Thursday 04 December 2025 13:46:56 +0000 (0:00:00.033) 0:03:03.185 ***** 2025-12-04 13:46:56.777611 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:46:57.359255 | controller | 2025-12-04 13:46:57.359290 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2025-12-04 13:46:57.359298 | controller | Thursday 04 December 2025 13:46:56 +0000 (0:00:00.574) 0:03:03.759 ***** 2025-12-04 13:46:57.359309 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:46:57.402011 | controller | 2025-12-04 13:46:57.402031 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2025-12-04 13:46:57.402038 | controller | Thursday 04 December 2025 13:46:57 +0000 (0:00:00.581) 0:03:04.341 ***** 2025-12-04 13:46:57.402047 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:46:57.402340 | controller | 2025-12-04 13:46:57.469815 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2025-12-04 13:46:57.469835 | controller | Thursday 04 December 2025 13:46:57 +0000 (0:00:00.043) 0:03:04.385 ***** 2025-12-04 13:46:57.469846 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2025-12-04 13:46:57.527493 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2025-12-04 13:46:57.527524 | controller | 2025-12-04 13:46:57.527532 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-12-04 13:46:57.527538 | controller | Thursday 04 December 2025 13:46:57 +0000 (0:00:00.067) 0:03:04.452 ***** 2025-12-04 13:46:57.527548 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 13:46:57.573730 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2025-12-04 13:46:57.573749 | controller | 2025-12-04 13:46:57.573756 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-12-04 13:46:57.573762 | controller | Thursday 04 December 2025 13:46:57 +0000 (0:00:00.057) 0:03:04.510 ***** 2025-12-04 13:46:57.573770 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 13:46:57.625727 | controller | _secret_file: '' 2025-12-04 13:46:57.625747 | controller | 2025-12-04 13:46:57.625754 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-12-04 13:46:57.625760 | controller | Thursday 04 December 2025 13:46:57 +0000 (0:00:00.046) 0:03:04.556 ***** 2025-12-04 13:46:57.625769 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 13:46:57.673979 | controller | _secret_content: my-default-location-place 2025-12-04 13:46:57.673998 | controller | 2025-12-04 13:46:57.674005 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-12-04 13:46:57.674011 | controller | Thursday 04 December 2025 13:46:57 +0000 (0:00:00.051) 0:03:04.608 ***** 2025-12-04 13:46:57.674019 | controller | skipping: [instance] 2025-12-04 13:46:57.723712 | controller | 2025-12-04 13:46:57.723737 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-12-04 13:46:57.723744 | controller | Thursday 04 December 2025 13:46:57 +0000 (0:00:00.048) 0:03:04.656 ***** 2025-12-04 13:46:57.723753 | controller | skipping: [instance] 2025-12-04 13:46:57.771817 | controller | 2025-12-04 13:46:57.771836 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-12-04 13:46:57.771844 | controller | Thursday 04 December 2025 13:46:57 +0000 (0:00:00.047) 0:03:04.704 ***** 2025-12-04 13:46:57.771853 | controller | skipping: [instance] 2025-12-04 13:46:58.782262 | controller | 2025-12-04 13:46:58.782298 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-12-04 13:46:58.782306 | controller | Thursday 04 December 2025 13:46:57 +0000 (0:00:00.050) 0:03:04.754 ***** 2025-12-04 13:46:58.782316 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:46:58.838120 | controller | 2025-12-04 13:46:58.838143 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-12-04 13:46:58.838151 | controller | Thursday 04 December 2025 13:46:58 +0000 (0:00:01.010) 0:03:05.764 ***** 2025-12-04 13:46:58.838161 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 13:46:58.887249 | controller | _secret_dest: /home/zuul/ipmi-things 2025-12-04 13:46:58.887269 | controller | 2025-12-04 13:46:58.887277 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-12-04 13:46:58.887283 | controller | Thursday 04 December 2025 13:46:58 +0000 (0:00:00.056) 0:03:05.820 ***** 2025-12-04 13:46:58.887292 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 13:46:58.937942 | controller | _secret_file: /tmp/ipmi-things 2025-12-04 13:46:58.937978 | controller | 2025-12-04 13:46:58.937989 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-12-04 13:46:58.937996 | controller | Thursday 04 December 2025 13:46:58 +0000 (0:00:00.049) 0:03:05.870 ***** 2025-12-04 13:46:58.938009 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-04 13:46:58.992066 | controller | _secret_content: '' 2025-12-04 13:46:58.992099 | controller | 2025-12-04 13:46:58.992114 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-12-04 13:46:58.992121 | controller | Thursday 04 December 2025 13:46:58 +0000 (0:00:00.050) 0:03:05.920 ***** 2025-12-04 13:46:58.992130 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2025-12-04 13:46:59.573674 | controller | msg: All assertions passed 2025-12-04 13:46:59.573707 | controller | 2025-12-04 13:46:59.573715 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-12-04 13:46:59.573722 | controller | Thursday 04 December 2025 13:46:58 +0000 (0:00:00.053) 0:03:05.974 ***** 2025-12-04 13:46:59.573731 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:47:00.597214 | controller | 2025-12-04 13:47:00.597246 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-12-04 13:47:00.597254 | controller | Thursday 04 December 2025 13:46:59 +0000 (0:00:00.581) 0:03:06.556 ***** 2025-12-04 13:47:00.597264 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:47:00.650413 | controller | 2025-12-04 13:47:00.650435 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-12-04 13:47:00.650443 | controller | Thursday 04 December 2025 13:47:00 +0000 (0:00:01.023) 0:03:07.579 ***** 2025-12-04 13:47:00.650452 | controller | skipping: [instance] 2025-12-04 13:47:01.286070 | controller | 2025-12-04 13:47:01.286103 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2025-12-04 13:47:01.286111 | controller | Thursday 04 December 2025 13:47:00 +0000 (0:00:00.053) 0:03:07.633 ***** 2025-12-04 13:47:01.286121 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:47:01.871446 | controller | 2025-12-04 13:47:01.871479 | controller | TASK [reproducer : Check if async file is still available] ********************* 2025-12-04 13:47:01.871488 | controller | Thursday 04 December 2025 13:47:01 +0000 (0:00:00.635) 0:03:08.268 ***** 2025-12-04 13:47:01.871498 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:03.346844 | controller | 2025-12-04 13:48:03.346915 | controller | TASK [reproducer : Check package install status] ******************************* 2025-12-04 13:48:03.346925 | controller | Thursday 04 December 2025 13:47:01 +0000 (0:00:00.585) 0:03:08.853 ***** 2025-12-04 13:48:03.346938 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2025-12-04 13:48:03.347936 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2025-12-04 13:48:03.347952 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2025-12-04 13:48:03.347979 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2025-12-04 13:48:03.347985 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2025-12-04 13:48:03.347990 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2025-12-04 13:48:03.347995 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2025-12-04 13:48:03.348003 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2025-12-04 13:48:04.036797 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). 2025-12-04 13:48:04.036840 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left). 2025-12-04 13:48:04.036853 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (90 retries left). 2025-12-04 13:48:04.036859 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:04.036866 | controller | 2025-12-04 13:48:04.036871 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2025-12-04 13:48:04.036882 | controller | Thursday 04 December 2025 13:48:03 +0000 (0:01:01.471) 0:04:10.325 ***** 2025-12-04 13:48:04.036895 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:07.126752 | controller | 2025-12-04 13:48:07.126803 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2025-12-04 13:48:07.126811 | controller | Thursday 04 December 2025 13:48:04 +0000 (0:00:00.693) 0:04:11.019 ***** 2025-12-04 13:48:07.126825 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:07.183503 | controller | 2025-12-04 13:48:07.183532 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2025-12-04 13:48:07.183539 | controller | Thursday 04 December 2025 13:48:07 +0000 (0:00:03.089) 0:04:14.108 ***** 2025-12-04 13:48:07.183550 | controller | skipping: [instance] 2025-12-04 13:48:07.240571 | controller | 2025-12-04 13:48:07.240592 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2025-12-04 13:48:07.240600 | controller | Thursday 04 December 2025 13:48:07 +0000 (0:00:00.057) 0:04:14.166 ***** 2025-12-04 13:48:07.240609 | controller | skipping: [instance] 2025-12-04 13:48:07.995445 | controller | 2025-12-04 13:48:07.995499 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2025-12-04 13:48:07.995508 | controller | Thursday 04 December 2025 13:48:07 +0000 (0:00:00.057) 0:04:14.223 ***** 2025-12-04 13:48:07.995521 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:08.647546 | controller | 2025-12-04 13:48:08.647605 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2025-12-04 13:48:08.647614 | controller | Thursday 04 December 2025 13:48:07 +0000 (0:00:00.753) 0:04:14.977 ***** 2025-12-04 13:48:08.647627 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:09.028458 | controller | 2025-12-04 13:48:09.028513 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2025-12-04 13:48:09.028522 | controller | Thursday 04 December 2025 13:48:08 +0000 (0:00:00.651) 0:04:15.629 ***** 2025-12-04 13:48:09.028535 | controller | changed: [instance] 2025-12-04 13:48:09.920831 | controller | 2025-12-04 13:48:09.920886 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2025-12-04 13:48:09.920895 | controller | Thursday 04 December 2025 13:48:09 +0000 (0:00:00.381) 0:04:16.010 ***** 2025-12-04 13:48:09.920908 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:11.051875 | controller | 2025-12-04 13:48:11.051931 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2025-12-04 13:48:11.051940 | controller | Thursday 04 December 2025 13:48:09 +0000 (0:00:00.892) 0:04:16.902 ***** 2025-12-04 13:48:11.051953 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:11.103008 | controller | 2025-12-04 13:48:11.103028 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-04 13:48:11.103036 | controller | Thursday 04 December 2025 13:48:11 +0000 (0:00:01.131) 0:04:18.034 ***** 2025-12-04 13:48:11.103046 | controller | skipping: [instance] 2025-12-04 13:48:11.150835 | controller | 2025-12-04 13:48:11.150861 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-04 13:48:11.150870 | controller | Thursday 04 December 2025 13:48:11 +0000 (0:00:00.051) 0:04:18.085 ***** 2025-12-04 13:48:11.150881 | controller | skipping: [instance] 2025-12-04 13:48:11.191519 | controller | 2025-12-04 13:48:11.191544 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-04 13:48:11.191555 | controller | Thursday 04 December 2025 13:48:11 +0000 (0:00:00.048) 0:04:18.133 ***** 2025-12-04 13:48:11.191567 | controller | skipping: [instance] 2025-12-04 13:48:11.245681 | controller | 2025-12-04 13:48:11.245699 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2025-12-04 13:48:11.245705 | controller | Thursday 04 December 2025 13:48:11 +0000 (0:00:00.040) 0:04:18.174 ***** 2025-12-04 13:48:11.245714 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:11.300884 | controller | 2025-12-04 13:48:11.300903 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2025-12-04 13:48:11.300911 | controller | Thursday 04 December 2025 13:48:11 +0000 (0:00:00.054) 0:04:18.228 ***** 2025-12-04 13:48:11.300919 | controller | skipping: [instance] 2025-12-04 13:48:11.348734 | controller | 2025-12-04 13:48:11.348786 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2025-12-04 13:48:11.348795 | controller | Thursday 04 December 2025 13:48:11 +0000 (0:00:00.055) 0:04:18.283 ***** 2025-12-04 13:48:11.348808 | controller | skipping: [instance] 2025-12-04 13:48:11.395707 | controller | 2025-12-04 13:48:11.395737 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2025-12-04 13:48:11.395747 | controller | Thursday 04 December 2025 13:48:11 +0000 (0:00:00.046) 0:04:18.330 ***** 2025-12-04 13:48:11.395759 | controller | skipping: [instance] 2025-12-04 13:48:11.395932 | controller | 2025-12-04 13:48:11.396147 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2025-12-04 13:48:11.396361 | controller | Thursday 04 December 2025 13:48:11 +0000 (0:00:00.048) 0:04:18.378 ***** 2025-12-04 13:48:12.015921 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:12.131878 | controller | 2025-12-04 13:48:12.131920 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2025-12-04 13:48:12.131929 | controller | Thursday 04 December 2025 13:48:12 +0000 (0:00:00.619) 0:04:18.997 ***** 2025-12-04 13:48:12.131940 | controller | skipping: [instance] => (item=secret) 2025-12-04 13:48:13.269135 | controller | skipping: [instance] => (item=configmap) 2025-12-04 13:48:13.269192 | controller | skipping: [instance] => (item=pod) 2025-12-04 13:48:13.269200 | controller | skipping: [instance] => (item=service) 2025-12-04 13:48:13.269206 | controller | skipping: [instance] => (item=route) 2025-12-04 13:48:13.269212 | controller | skipping: [instance] 2025-12-04 13:48:13.269218 | controller | 2025-12-04 13:48:13.269225 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2025-12-04 13:48:13.269231 | controller | Thursday 04 December 2025 13:48:12 +0000 (0:00:00.116) 0:04:19.114 ***** 2025-12-04 13:48:13.269244 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:13.269420 | controller | 2025-12-04 13:48:13.269432 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2025-12-04 13:48:13.269441 | controller | Thursday 04 December 2025 13:48:13 +0000 (0:00:01.137) 0:04:20.251 ***** 2025-12-04 13:48:14.342637 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:14.390670 | controller | 2025-12-04 13:48:14.390707 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2025-12-04 13:48:14.390715 | controller | Thursday 04 December 2025 13:48:14 +0000 (0:00:01.073) 0:04:21.324 ***** 2025-12-04 13:48:14.390727 | controller | skipping: [instance] 2025-12-04 13:48:14.435431 | controller | 2025-12-04 13:48:14.435461 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2025-12-04 13:48:14.435469 | controller | Thursday 04 December 2025 13:48:14 +0000 (0:00:00.048) 0:04:21.373 ***** 2025-12-04 13:48:14.435481 | controller | skipping: [instance] 2025-12-04 13:48:14.517717 | controller | 2025-12-04 13:48:14.517752 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2025-12-04 13:48:14.517761 | controller | Thursday 04 December 2025 13:48:14 +0000 (0:00:00.044) 0:04:21.418 ***** 2025-12-04 13:48:14.517771 | controller | skipping: [instance] => (item=secret) 2025-12-04 13:48:14.567056 | controller | skipping: [instance] => (item=configmap) 2025-12-04 13:48:14.567074 | controller | skipping: [instance] => (item=service) 2025-12-04 13:48:14.567081 | controller | skipping: [instance] => (item=route) 2025-12-04 13:48:14.567087 | controller | skipping: [instance] 2025-12-04 13:48:14.567093 | controller | 2025-12-04 13:48:14.567098 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2025-12-04 13:48:14.567103 | controller | Thursday 04 December 2025 13:48:14 +0000 (0:00:00.079) 0:04:21.497 ***** 2025-12-04 13:48:14.567111 | controller | skipping: [instance] 2025-12-04 13:48:14.567203 | controller | 2025-12-04 13:48:14.567212 | controller | TASK [podman : Ensure podman is installed] ************************************* 2025-12-04 13:48:14.567229 | controller | Thursday 04 December 2025 13:48:14 +0000 (0:00:00.052) 0:04:21.549 ***** 2025-12-04 13:48:16.195440 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:17.107730 | controller | 2025-12-04 13:48:17.107781 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2025-12-04 13:48:17.107789 | controller | Thursday 04 December 2025 13:48:16 +0000 (0:00:01.627) 0:04:23.177 ***** 2025-12-04 13:48:17.107802 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:17.160483 | controller | 2025-12-04 13:48:17.160523 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2025-12-04 13:48:17.160531 | controller | Thursday 04 December 2025 13:48:17 +0000 (0:00:00.912) 0:04:24.089 ***** 2025-12-04 13:48:17.160544 | controller | skipping: [instance] 2025-12-04 13:48:17.206614 | controller | 2025-12-04 13:48:17.206637 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2025-12-04 13:48:17.206645 | controller | Thursday 04 December 2025 13:48:17 +0000 (0:00:00.053) 0:04:24.143 ***** 2025-12-04 13:48:17.206655 | controller | skipping: [instance] 2025-12-04 13:48:17.261479 | controller | 2025-12-04 13:48:17.261505 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2025-12-04 13:48:17.261513 | controller | Thursday 04 December 2025 13:48:17 +0000 (0:00:00.046) 0:04:24.189 ***** 2025-12-04 13:48:17.261524 | controller | skipping: [instance] 2025-12-04 13:48:28.165894 | controller | 2025-12-04 13:48:28.165933 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2025-12-04 13:48:28.165942 | controller | Thursday 04 December 2025 13:48:17 +0000 (0:00:00.054) 0:04:24.244 ***** 2025-12-04 13:48:28.165952 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:29.673274 | controller | 2025-12-04 13:48:29.673309 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2025-12-04 13:48:29.673317 | controller | Thursday 04 December 2025 13:48:28 +0000 (0:00:10.903) 0:04:35.148 ***** 2025-12-04 13:48:29.673327 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:30.859943 | controller | 2025-12-04 13:48:30.860028 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-12-04 13:48:30.860039 | controller | Thursday 04 December 2025 13:48:29 +0000 (0:00:01.506) 0:04:36.654 ***** 2025-12-04 13:48:30.860060 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-12-04 13:48:30.907936 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-12-04 13:48:30.907991 | controller | 2025-12-04 13:48:30.908004 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2025-12-04 13:48:30.908011 | controller | Thursday 04 December 2025 13:48:30 +0000 (0:00:01.186) 0:04:37.840 ***** 2025-12-04 13:48:30.908022 | controller | skipping: [instance] 2025-12-04 13:48:31.501667 | controller | 2025-12-04 13:48:31.501705 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2025-12-04 13:48:31.501713 | controller | Thursday 04 December 2025 13:48:30 +0000 (0:00:00.049) 0:04:37.890 ***** 2025-12-04 13:48:31.501723 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:31.549590 | controller | 2025-12-04 13:48:31.549608 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2025-12-04 13:48:31.549615 | controller | Thursday 04 December 2025 13:48:31 +0000 (0:00:00.593) 0:04:38.483 ***** 2025-12-04 13:48:31.549623 | controller | skipping: [instance] 2025-12-04 13:48:31.600262 | controller | 2025-12-04 13:48:31.600278 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2025-12-04 13:48:31.600285 | controller | Thursday 04 December 2025 13:48:31 +0000 (0:00:00.048) 0:04:38.532 ***** 2025-12-04 13:48:31.600293 | controller | skipping: [instance] 2025-12-04 13:48:31.600438 | controller | 2025-12-04 13:48:31.600578 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-12-04 13:48:31.600707 | controller | Thursday 04 December 2025 13:48:31 +0000 (0:00:00.051) 0:04:38.583 ***** 2025-12-04 13:48:31.650664 | controller | skipping: [instance] 2025-12-04 13:48:31.650887 | controller | 2025-12-04 13:48:31.651135 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-12-04 13:48:31.651325 | controller | Thursday 04 December 2025 13:48:31 +0000 (0:00:00.050) 0:04:38.633 ***** 2025-12-04 13:48:31.695683 | controller | skipping: [instance] 2025-12-04 13:48:31.695856 | controller | 2025-12-04 13:48:31.696104 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2025-12-04 13:48:31.696296 | controller | Thursday 04 December 2025 13:48:31 +0000 (0:00:00.045) 0:04:38.678 ***** 2025-12-04 13:48:31.830256 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '7f0bb2eb-b49b-4fb4-ac01-f2e9f5079178'}) 2025-12-04 13:48:31.830463 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '152f8a3e-c102-4758-9ceb-7fd43c0b6e64'}) 2025-12-04 13:48:31.830628 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '3a5bc07b-1ca3-48cc-883f-7de73113990a'}) 2025-12-04 13:48:31.830772 | controller | 2025-12-04 13:48:31.830924 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2025-12-04 13:48:31.831098 | controller | Thursday 04 December 2025 13:48:31 +0000 (0:00:00.134) 0:04:38.813 ***** 2025-12-04 13:48:32.946039 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:32.946210 | controller | 2025-12-04 13:48:32.946358 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2025-12-04 13:48:32.946491 | controller | Thursday 04 December 2025 13:48:32 +0000 (0:00:01.114) 0:04:39.927 ***** 2025-12-04 13:48:32.993578 | controller | skipping: [instance] 2025-12-04 13:48:32.993733 | controller | 2025-12-04 13:48:32.993876 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2025-12-04 13:48:32.994043 | controller | Thursday 04 December 2025 13:48:32 +0000 (0:00:00.048) 0:04:39.976 ***** 2025-12-04 13:48:33.134640 | controller | 2025-12-04 13:48:33.134836 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2025-12-04 13:48:33.135025 | controller | Thursday 04 December 2025 13:48:33 +0000 (0:00:00.140) 0:04:40.117 ***** 2025-12-04 13:48:33.200630 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:33.253658 | controller | 2025-12-04 13:48:33.253690 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-12-04 13:48:33.253703 | controller | Thursday 04 December 2025 13:48:33 +0000 (0:00:00.065) 0:04:40.182 ***** 2025-12-04 13:48:33.253719 | controller | skipping: [instance] 2025-12-04 13:48:33.296765 | controller | 2025-12-04 13:48:33.296784 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-12-04 13:48:33.296792 | controller | Thursday 04 December 2025 13:48:33 +0000 (0:00:00.053) 0:04:40.236 ***** 2025-12-04 13:48:33.296801 | controller | skipping: [instance] 2025-12-04 13:48:34.656211 | controller | 2025-12-04 13:48:34.656246 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2025-12-04 13:48:34.656255 | controller | Thursday 04 December 2025 13:48:33 +0000 (0:00:00.043) 0:04:40.279 ***** 2025-12-04 13:48:34.656266 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:39.693135 | controller | 2025-12-04 13:48:39.693174 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2025-12-04 13:48:39.693183 | controller | Thursday 04 December 2025 13:48:34 +0000 (0:00:01.359) 0:04:41.638 ***** 2025-12-04 13:48:39.693194 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=7f0bb2eb-b49b-4fb4-ac01-f2e9f5079178) 2025-12-04 13:48:39.803001 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=152f8a3e-c102-4758-9ceb-7fd43c0b6e64) 2025-12-04 13:48:39.803065 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=3a5bc07b-1ca3-48cc-883f-7de73113990a) 2025-12-04 13:48:39.803073 | controller | 2025-12-04 13:48:39.803080 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2025-12-04 13:48:39.803101 | controller | Thursday 04 December 2025 13:48:39 +0000 (0:00:05.036) 0:04:46.675 ***** 2025-12-04 13:48:39.803115 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2025-12-04 13:48:40.063478 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2025-12-04 13:48:40.063523 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2025-12-04 13:48:40.063532 | controller | 2025-12-04 13:48:40.063538 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2025-12-04 13:48:40.063550 | controller | Thursday 04 December 2025 13:48:39 +0000 (0:00:00.109) 0:04:46.784 ***** 2025-12-04 13:48:40.063561 | controller | ok: [instance -> localhost] 2025-12-04 13:48:42.333326 | controller | 2025-12-04 13:48:42.333378 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2025-12-04 13:48:42.333387 | controller | Thursday 04 December 2025 13:48:40 +0000 (0:00:00.260) 0:04:47.045 ***** 2025-12-04 13:48:42.333398 | controller | changed: [instance -> localhost] => (item=controller-0) 2025-12-04 13:48:43.021268 | controller | 2025-12-04 13:48:43.021304 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2025-12-04 13:48:43.021311 | controller | Thursday 04 December 2025 13:48:42 +0000 (0:00:02.268) 0:04:49.313 ***** 2025-12-04 13:48:43.021321 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:43.888258 | controller | 2025-12-04 13:48:43.888297 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2025-12-04 13:48:43.888305 | controller | Thursday 04 December 2025 13:48:43 +0000 (0:00:00.689) 0:04:50.003 ***** 2025-12-04 13:48:43.888316 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:45.058007 | controller | 2025-12-04 13:48:45.058049 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2025-12-04 13:48:45.058057 | controller | Thursday 04 December 2025 13:48:43 +0000 (0:00:00.866) 0:04:50.870 ***** 2025-12-04 13:48:45.058069 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:45.768951 | controller | 2025-12-04 13:48:45.769009 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2025-12-04 13:48:45.769018 | controller | Thursday 04 December 2025 13:48:45 +0000 (0:00:01.169) 0:04:52.040 ***** 2025-12-04 13:48:45.769028 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:46.877472 | controller | 2025-12-04 13:48:46.877509 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2025-12-04 13:48:46.877518 | controller | Thursday 04 December 2025 13:48:45 +0000 (0:00:00.705) 0:04:52.745 ***** 2025-12-04 13:48:46.877528 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:47.540778 | controller | 2025-12-04 13:48:47.540814 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2025-12-04 13:48:47.540823 | controller | Thursday 04 December 2025 13:48:46 +0000 (0:00:01.113) 0:04:53.859 ***** 2025-12-04 13:48:47.540833 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:48.153830 | controller | 2025-12-04 13:48:48.153870 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2025-12-04 13:48:48.153879 | controller | Thursday 04 December 2025 13:48:47 +0000 (0:00:00.663) 0:04:54.523 ***** 2025-12-04 13:48:48.153889 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:49.520519 | controller | 2025-12-04 13:48:49.520561 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2025-12-04 13:48:49.520569 | controller | Thursday 04 December 2025 13:48:48 +0000 (0:00:00.612) 0:04:55.136 ***** 2025-12-04 13:48:49.520580 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-12-04 13:48:49.557531 | controller | 2025-12-04 13:48:49.557566 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-04 13:48:49.557574 | controller | Thursday 04 December 2025 13:48:49 +0000 (0:00:01.366) 0:04:56.502 ***** 2025-12-04 13:48:49.557590 | controller | skipping: [instance] 2025-12-04 13:48:49.598864 | controller | 2025-12-04 13:48:49.598894 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-04 13:48:49.598902 | controller | Thursday 04 December 2025 13:48:49 +0000 (0:00:00.037) 0:04:56.540 ***** 2025-12-04 13:48:49.598913 | controller | skipping: [instance] 2025-12-04 13:48:49.637405 | controller | 2025-12-04 13:48:49.637437 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-04 13:48:49.637444 | controller | Thursday 04 December 2025 13:48:49 +0000 (0:00:00.041) 0:04:56.581 ***** 2025-12-04 13:48:49.637455 | controller | skipping: [instance] 2025-12-04 13:48:49.674890 | controller | 2025-12-04 13:48:49.674913 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-04 13:48:49.674921 | controller | Thursday 04 December 2025 13:48:49 +0000 (0:00:00.038) 0:04:56.620 ***** 2025-12-04 13:48:49.674930 | controller | skipping: [instance] 2025-12-04 13:48:49.716804 | controller | 2025-12-04 13:48:49.716837 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-04 13:48:49.716845 | controller | Thursday 04 December 2025 13:48:49 +0000 (0:00:00.037) 0:04:56.657 ***** 2025-12-04 13:48:49.716855 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:49.826635 | controller | 2025-12-04 13:48:49.826676 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-04 13:48:49.826684 | controller | Thursday 04 December 2025 13:48:49 +0000 (0:00:00.041) 0:04:56.699 ***** 2025-12-04 13:48:49.826704 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-12-04 13:48:49.877772 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2025-12-04 13:48:49.877803 | controller | 2025-12-04 13:48:49.877811 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-04 13:48:49.877822 | controller | Thursday 04 December 2025 13:48:49 +0000 (0:00:00.109) 0:04:56.808 ***** 2025-12-04 13:48:49.877833 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2025-12-04 13:48:53.224364 | controller | 2025-12-04 13:48:53.224415 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2025-12-04 13:48:53.224425 | controller | Thursday 04 December 2025 13:48:49 +0000 (0:00:00.051) 0:04:56.860 ***** 2025-12-04 13:48:53.224442 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-12-04 13:48:54.372838 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2025-12-04 13:48:54.372878 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-12-04 13:48:54.372886 | controller | 2025-12-04 13:48:54.372893 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2025-12-04 13:48:54.372899 | controller | Thursday 04 December 2025 13:48:53 +0000 (0:00:03.343) 0:05:00.204 ***** 2025-12-04 13:48:54.372931 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:54.877987 | controller | 2025-12-04 13:48:54.878021 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-04 13:48:54.878030 | controller | Thursday 04 December 2025 13:48:54 +0000 (0:00:01.150) 0:05:01.354 ***** 2025-12-04 13:48:54.878041 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:55.876402 | controller | 2025-12-04 13:48:55.876436 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-04 13:48:55.876444 | controller | Thursday 04 December 2025 13:48:54 +0000 (0:00:00.503) 0:05:01.857 ***** 2025-12-04 13:48:55.876454 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:55.967129 | controller | 2025-12-04 13:48:55.967163 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-04 13:48:55.967172 | controller | Thursday 04 December 2025 13:48:55 +0000 (0:00:00.995) 0:05:02.853 ***** 2025-12-04 13:48:55.967183 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:55.967331 | controller | 2025-12-04 13:48:55.967494 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-04 13:48:55.967635 | controller | Thursday 04 December 2025 13:48:55 +0000 (0:00:00.096) 0:05:02.950 ***** 2025-12-04 13:48:56.030704 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:56.976491 | controller | 2025-12-04 13:48:56.976522 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-04 13:48:56.976529 | controller | Thursday 04 December 2025 13:48:56 +0000 (0:00:00.063) 0:05:03.013 ***** 2025-12-04 13:48:56.976540 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:48:57.909492 | controller | 2025-12-04 13:48:57.909524 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2025-12-04 13:48:57.909533 | controller | Thursday 04 December 2025 13:48:56 +0000 (0:00:00.945) 0:05:03.959 ***** 2025-12-04 13:48:57.909543 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:03.928238 | controller | 2025-12-04 13:49:03.928268 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2025-12-04 13:49:03.928276 | controller | Thursday 04 December 2025 13:48:57 +0000 (0:00:00.932) 0:05:04.891 ***** 2025-12-04 13:49:03.928286 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2025-12-04 13:49:04.132928 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:04.132975 | controller | 2025-12-04 13:49:04.132986 | controller | TASK [Configure ntp service] *************************************************** 2025-12-04 13:49:04.132993 | controller | Thursday 04 December 2025 13:49:03 +0000 (0:00:06.018) 0:05:10.910 ***** 2025-12-04 13:49:04.133002 | controller | 2025-12-04 13:49:05.192467 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2025-12-04 13:49:05.192503 | controller | Thursday 04 December 2025 13:49:04 +0000 (0:00:00.204) 0:05:11.115 ***** 2025-12-04 13:49:05.192515 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:06.164829 | controller | 2025-12-04 13:49:06.164862 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2025-12-04 13:49:06.164871 | controller | Thursday 04 December 2025 13:49:05 +0000 (0:00:01.059) 0:05:12.175 ***** 2025-12-04 13:49:06.164882 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2025-12-04 13:49:07.053495 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2025-12-04 13:49:07.053531 | controller | 2025-12-04 13:49:07.053540 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2025-12-04 13:49:07.053546 | controller | Thursday 04 December 2025 13:49:06 +0000 (0:00:00.971) 0:05:13.146 ***** 2025-12-04 13:49:07.053556 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:07.650147 | controller | 2025-12-04 13:49:07.650183 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2025-12-04 13:49:07.650192 | controller | Thursday 04 December 2025 13:49:07 +0000 (0:00:00.883) 0:05:14.030 ***** 2025-12-04 13:49:07.650202 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:07.818103 | controller | 2025-12-04 13:49:07.818145 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2025-12-04 13:49:07.818162 | controller | Thursday 04 December 2025 13:49:07 +0000 (0:00:00.601) 0:05:14.632 ***** 2025-12-04 13:49:07.818177 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2025-12-04 13:49:08.311205 | controller | 2025-12-04 13:49:08.311243 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2025-12-04 13:49:08.311252 | controller | Thursday 04 December 2025 13:49:07 +0000 (0:00:00.168) 0:05:14.800 ***** 2025-12-04 13:49:08.311263 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:08.804233 | controller | 2025-12-04 13:49:08.804267 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2025-12-04 13:49:08.804275 | controller | Thursday 04 December 2025 13:49:08 +0000 (0:00:00.492) 0:05:15.293 ***** 2025-12-04 13:49:08.804284 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-12-04 13:49:09.476909 | controller | 2025-12-04 13:49:09.476952 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2025-12-04 13:49:09.476972 | controller | Thursday 04 December 2025 13:49:08 +0000 (0:00:00.493) 0:05:15.786 ***** 2025-12-04 13:49:09.476984 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-04 13:49:10.054662 | controller | 2025-12-04 13:49:10.054695 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2025-12-04 13:49:10.054702 | controller | Thursday 04 December 2025 13:49:09 +0000 (0:00:00.672) 0:05:16.459 ***** 2025-12-04 13:49:10.054712 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-04 13:49:10.105213 | controller | 2025-12-04 13:49:10.105238 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2025-12-04 13:49:10.105246 | controller | Thursday 04 December 2025 13:49:10 +0000 (0:00:00.577) 0:05:17.037 ***** 2025-12-04 13:49:10.105256 | controller | 2025-12-04 13:49:10.605378 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2025-12-04 13:49:10.605407 | controller | Thursday 04 December 2025 13:49:10 +0000 (0:00:00.050) 0:05:17.088 ***** 2025-12-04 13:49:10.605418 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-12-04 13:49:11.334588 | controller | 2025-12-04 13:49:11.334622 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2025-12-04 13:49:11.334630 | controller | Thursday 04 December 2025 13:49:10 +0000 (0:00:00.499) 0:05:17.587 ***** 2025-12-04 13:49:11.334641 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-04 13:49:11.367476 | controller | 2025-12-04 13:49:11.367503 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2025-12-04 13:49:11.367516 | controller | Thursday 04 December 2025 13:49:11 +0000 (0:00:00.728) 0:05:18.316 ***** 2025-12-04 13:49:11.367527 | controller | skipping: [instance] 2025-12-04 13:49:11.404184 | controller | 2025-12-04 13:49:11.404203 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2025-12-04 13:49:11.404211 | controller | Thursday 04 December 2025 13:49:11 +0000 (0:00:00.033) 0:05:18.350 ***** 2025-12-04 13:49:11.404220 | controller | skipping: [instance] 2025-12-04 13:49:11.640669 | controller | 2025-12-04 13:49:11.640696 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2025-12-04 13:49:11.640704 | controller | Thursday 04 December 2025 13:49:11 +0000 (0:00:00.036) 0:05:18.387 ***** 2025-12-04 13:49:11.640714 | controller | changed: [instance] 2025-12-04 13:49:11.640929 | controller | 2025-12-04 13:49:11.640944 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2025-12-04 13:49:11.716943 | controller | Thursday 04 December 2025 13:49:11 +0000 (0:00:00.235) 0:05:18.623 ***** 2025-12-04 13:49:11.716988 | controller | skipping: [instance] => (item=) 2025-12-04 13:49:11.750416 | controller | 2025-12-04 13:49:11.750434 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2025-12-04 13:49:11.750442 | controller | Thursday 04 December 2025 13:49:11 +0000 (0:00:00.076) 0:05:18.699 ***** 2025-12-04 13:49:11.750451 | controller | ok: [instance] 2025-12-04 13:49:11.834326 | controller | 2025-12-04 13:49:11.834346 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-04 13:49:11.834365 | controller | Thursday 04 December 2025 13:49:11 +0000 (0:00:00.033) 0:05:18.733 ***** 2025-12-04 13:49:11.834375 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-12-04 13:49:12.100406 | controller | 2025-12-04 13:49:12.100439 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-04 13:49:12.100447 | controller | Thursday 04 December 2025 13:49:11 +0000 (0:00:00.083) 0:05:18.817 ***** 2025-12-04 13:49:12.100458 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-12-04 13:49:12.153705 | controller | 2025-12-04 13:49:12.153725 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2025-12-04 13:49:12.153733 | controller | Thursday 04 December 2025 13:49:12 +0000 (0:00:00.265) 0:05:19.082 ***** 2025-12-04 13:49:12.153749 | controller | 2025-12-04 13:49:12.309385 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-04 13:49:12.309404 | controller | Thursday 04 December 2025 13:49:12 +0000 (0:00:00.053) 0:05:19.136 ***** 2025-12-04 13:49:12.309415 | controller | ok: [instance] 2025-12-04 13:49:12.367257 | controller | 2025-12-04 13:49:12.367276 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-04 13:49:12.367283 | controller | Thursday 04 December 2025 13:49:12 +0000 (0:00:00.155) 0:05:19.292 ***** 2025-12-04 13:49:12.367292 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-12-04 13:49:12.662974 | controller | 2025-12-04 13:49:12.663001 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-04 13:49:12.663009 | controller | Thursday 04 December 2025 13:49:12 +0000 (0:00:00.057) 0:05:19.350 ***** 2025-12-04 13:49:12.663018 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-12-04 13:49:13.099010 | controller | 2025-12-04 13:49:13.099045 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2025-12-04 13:49:13.099054 | controller | Thursday 04 December 2025 13:49:12 +0000 (0:00:00.295) 0:05:19.645 ***** 2025-12-04 13:49:13.099065 | controller | changed: [instance] 2025-12-04 13:49:13.892813 | controller | 2025-12-04 13:49:13.892845 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-12-04 13:49:13.892854 | controller | Thursday 04 December 2025 13:49:13 +0000 (0:00:00.420) 0:05:20.066 ***** 2025-12-04 13:49:13.892865 | controller | 2025-12-04 13:49:13.892870 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2025-12-04 13:49:13.892876 | controller | Thursday 04 December 2025 13:49:13 +0000 (0:00:00.014) 0:05:20.081 ***** 2025-12-04 13:49:13.892885 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:14.316100 | controller | 2025-12-04 13:49:14.316136 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-04 13:49:14.316144 | controller | Thursday 04 December 2025 13:49:13 +0000 (0:00:00.793) 0:05:20.875 ***** 2025-12-04 13:49:14.316156 | controller | changed: [instance] 2025-12-04 13:49:14.316183 | controller | 2025-12-04 13:49:14.316190 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2025-12-04 13:49:14.316197 | controller | Thursday 04 December 2025 13:49:14 +0000 (0:00:00.423) 0:05:21.298 ***** 2025-12-04 13:49:14.492386 | controller | skipping: [instance] => (item=controller-0) 2025-12-04 13:49:14.492514 | controller | skipping: [instance] => (item=crc-0) 2025-12-04 13:49:14.492744 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2025-12-04 13:49:14.492853 | controller | 2025-12-04 13:49:14.492976 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2025-12-04 13:49:14.493080 | controller | Thursday 04 December 2025 13:49:14 +0000 (0:00:00.176) 0:05:21.475 ***** 2025-12-04 13:49:15.989081 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-12-04 13:49:15.989137 | controller | 2025-12-04 13:49:15.989400 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-12-04 13:49:16.022301 | controller | Thursday 04 December 2025 13:49:15 +0000 (0:00:01.496) 0:05:22.971 ***** 2025-12-04 13:49:16.022324 | controller | skipping: [instance] 2025-12-04 13:49:16.548656 | controller | 2025-12-04 13:49:16.548694 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-04 13:49:16.548705 | controller | Thursday 04 December 2025 13:49:16 +0000 (0:00:00.033) 0:05:23.004 ***** 2025-12-04 13:49:16.548717 | controller | ok: [instance -> compute-0(compute-0.instance)] 2025-12-04 13:49:16.594708 | controller | 2025-12-04 13:49:16.594759 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-04 13:49:16.594769 | controller | Thursday 04 December 2025 13:49:16 +0000 (0:00:00.526) 0:05:23.530 ***** 2025-12-04 13:49:16.594782 | controller | skipping: [instance] 2025-12-04 13:49:16.594977 | controller | 2025-12-04 13:49:16.594994 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-04 13:49:16.639523 | controller | Thursday 04 December 2025 13:49:16 +0000 (0:00:00.046) 0:05:23.577 ***** 2025-12-04 13:49:16.639557 | controller | skipping: [instance] 2025-12-04 13:49:16.684128 | controller | 2025-12-04 13:49:16.684169 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-04 13:49:16.684180 | controller | Thursday 04 December 2025 13:49:16 +0000 (0:00:00.044) 0:05:23.621 ***** 2025-12-04 13:49:16.684193 | controller | skipping: [instance] 2025-12-04 13:49:16.734176 | controller | 2025-12-04 13:49:16.734220 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-04 13:49:16.734231 | controller | Thursday 04 December 2025 13:49:16 +0000 (0:00:00.044) 0:05:23.666 ***** 2025-12-04 13:49:16.734245 | controller | skipping: [instance] 2025-12-04 13:49:16.776836 | controller | 2025-12-04 13:49:16.776866 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2025-12-04 13:49:16.776883 | controller | Thursday 04 December 2025 13:49:16 +0000 (0:00:00.050) 0:05:23.716 ***** 2025-12-04 13:49:16.776896 | controller | skipping: [instance] 2025-12-04 13:49:16.802158 | controller | 2025-12-04 13:49:16.802176 | controller | TASK [reproducer : Create repositories on computes] **************************** 2025-12-04 13:49:16.802183 | controller | Thursday 04 December 2025 13:49:16 +0000 (0:00:00.042) 0:05:23.759 ***** 2025-12-04 13:49:16.802192 | controller | skipping: [instance] 2025-12-04 13:49:16.802351 | controller | 2025-12-04 13:49:16.802543 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2025-12-04 13:49:16.802729 | controller | Thursday 04 December 2025 13:49:16 +0000 (0:00:00.025) 0:05:23.785 ***** 2025-12-04 13:49:16.836395 | controller | skipping: [instance] 2025-12-04 13:49:16.836533 | controller | 2025-12-04 13:49:16.836664 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2025-12-04 13:49:16.836808 | controller | Thursday 04 December 2025 13:49:16 +0000 (0:00:00.034) 0:05:23.819 ***** 2025-12-04 13:49:16.900170 | controller | ok: [instance] 2025-12-04 13:49:16.900323 | controller | 2025-12-04 13:49:16.900335 | controller | TASK [reproducer : Push local code] ******************************************** 2025-12-04 13:49:16.999008 | controller | Thursday 04 December 2025 13:49:16 +0000 (0:00:00.062) 0:05:23.881 ***** 2025-12-04 13:49:16.999065 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2025-12-04 13:49:17.043727 | controller | 2025-12-04 13:49:17.043781 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2025-12-04 13:49:17.043791 | controller | Thursday 04 December 2025 13:49:16 +0000 (0:00:00.099) 0:05:23.981 ***** 2025-12-04 13:49:17.043804 | controller | skipping: [instance] 2025-12-04 13:49:17.097779 | controller | 2025-12-04 13:49:17.097799 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2025-12-04 13:49:17.097807 | controller | Thursday 04 December 2025 13:49:17 +0000 (0:00:00.044) 0:05:24.026 ***** 2025-12-04 13:49:17.097816 | controller | skipping: [instance] 2025-12-04 13:49:17.145727 | controller | 2025-12-04 13:49:17.145746 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2025-12-04 13:49:17.145753 | controller | Thursday 04 December 2025 13:49:17 +0000 (0:00:00.054) 0:05:24.080 ***** 2025-12-04 13:49:17.145761 | controller | skipping: [instance] 2025-12-04 13:49:17.194434 | controller | 2025-12-04 13:49:17.194451 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2025-12-04 13:49:17.194458 | controller | Thursday 04 December 2025 13:49:17 +0000 (0:00:00.048) 0:05:24.128 ***** 2025-12-04 13:49:17.194466 | controller | skipping: [instance] 2025-12-04 13:49:17.236805 | controller | 2025-12-04 13:49:17.236824 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2025-12-04 13:49:17.236832 | controller | Thursday 04 December 2025 13:49:17 +0000 (0:00:00.048) 0:05:24.177 ***** 2025-12-04 13:49:17.236841 | controller | skipping: [instance] 2025-12-04 13:49:17.237009 | controller | 2025-12-04 13:49:17.237173 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2025-12-04 13:49:17.237314 | controller | Thursday 04 December 2025 13:49:17 +0000 (0:00:00.042) 0:05:24.219 ***** 2025-12-04 13:49:17.715530 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2025-12-04 13:49:18.307786 | controller | 2025-12-04 13:49:18.307836 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2025-12-04 13:49:18.307844 | controller | Thursday 04 December 2025 13:49:17 +0000 (0:00:00.477) 0:05:24.697 ***** 2025-12-04 13:49:18.307856 | controller | ok: [instance -> localhost] => (item=ci-framework) 2025-12-04 13:49:18.352224 | controller | 2025-12-04 13:49:18.352266 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2025-12-04 13:49:18.352275 | controller | Thursday 04 December 2025 13:49:18 +0000 (0:00:00.591) 0:05:25.289 ***** 2025-12-04 13:49:18.352287 | controller | skipping: [instance] => (item=ci-framework) 2025-12-04 13:49:18.352309 | controller | skipping: [instance] 2025-12-04 13:49:18.352367 | controller | 2025-12-04 13:49:18.352485 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2025-12-04 13:49:18.352572 | controller | Thursday 04 December 2025 13:49:18 +0000 (0:00:00.045) 0:05:25.335 ***** 2025-12-04 13:49:18.428589 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2025-12-04 13:49:18.428685 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2025-12-04 13:49:18.428791 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2025-12-04 13:49:18.428879 | controller | 2025-12-04 13:49:18.429069 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2025-12-04 13:49:18.429172 | controller | Thursday 04 December 2025 13:49:18 +0000 (0:00:00.076) 0:05:25.411 ***** 2025-12-04 13:49:18.909528 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:18.909594 | controller | 2025-12-04 13:49:18.909690 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2025-12-04 13:49:18.909793 | controller | Thursday 04 December 2025 13:49:18 +0000 (0:00:00.480) 0:05:25.892 ***** 2025-12-04 13:49:18.949384 | controller | skipping: [instance] 2025-12-04 13:49:18.949481 | controller | 2025-12-04 13:49:18.949601 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2025-12-04 13:49:18.949722 | controller | Thursday 04 December 2025 13:49:18 +0000 (0:00:00.040) 0:05:25.932 ***** 2025-12-04 13:49:19.445477 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:19.445797 | controller | 2025-12-04 13:49:19.488826 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2025-12-04 13:49:19.488861 | controller | Thursday 04 December 2025 13:49:19 +0000 (0:00:00.495) 0:05:26.428 ***** 2025-12-04 13:49:19.488873 | controller | skipping: [instance] 2025-12-04 13:49:19.992123 | controller | 2025-12-04 13:49:19.992173 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2025-12-04 13:49:19.992183 | controller | Thursday 04 December 2025 13:49:19 +0000 (0:00:00.043) 0:05:26.471 ***** 2025-12-04 13:49:19.992198 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:19.992221 | controller | 2025-12-04 13:49:19.992248 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2025-12-04 13:49:19.992421 | controller | Thursday 04 December 2025 13:49:19 +0000 (0:00:00.503) 0:05:26.974 ***** 2025-12-04 13:49:22.389166 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:22.389275 | controller | 2025-12-04 13:49:22.389289 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2025-12-04 13:49:41.843867 | controller | Thursday 04 December 2025 13:49:22 +0000 (0:00:02.396) 0:05:29.371 ***** 2025-12-04 13:49:41.843907 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:42.804576 | controller | 2025-12-04 13:49:42.804612 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2025-12-04 13:49:42.804620 | controller | Thursday 04 December 2025 13:49:41 +0000 (0:00:19.454) 0:05:48.826 ***** 2025-12-04 13:49:42.804631 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:42.804696 | controller | 2025-12-04 13:49:42.804732 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2025-12-04 13:49:42.804745 | controller | Thursday 04 December 2025 13:49:42 +0000 (0:00:00.960) 0:05:49.787 ***** 2025-12-04 13:49:42.904087 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2025-12-04 13:49:42.904227 | controller | 2025-12-04 13:49:42.904254 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2025-12-04 13:49:43.350678 | controller | Thursday 04 December 2025 13:49:42 +0000 (0:00:00.099) 0:05:49.886 ***** 2025-12-04 13:49:43.350716 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:43.350777 | controller | 2025-12-04 13:49:43.350789 | controller | TASK [reproducer : Rotate log if present] ************************************** 2025-12-04 13:49:43.350878 | controller | Thursday 04 December 2025 13:49:43 +0000 (0:00:00.446) 0:05:50.333 ***** 2025-12-04 13:49:43.385637 | controller | skipping: [instance] 2025-12-04 13:49:43.385720 | controller | 2025-12-04 13:49:43.385834 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2025-12-04 13:49:43.385938 | controller | Thursday 04 December 2025 13:49:43 +0000 (0:00:00.035) 0:05:50.368 ***** 2025-12-04 13:49:43.428871 | controller | skipping: [instance] 2025-12-04 13:49:43.428950 | controller | 2025-12-04 13:49:43.429074 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2025-12-04 13:49:43.429189 | controller | Thursday 04 December 2025 13:49:43 +0000 (0:00:00.043) 0:05:50.412 ***** 2025-12-04 13:49:43.564582 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:43.564663 | controller | 2025-12-04 13:49:43.564766 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-04 13:49:43.564866 | controller | Thursday 04 December 2025 13:49:43 +0000 (0:00:00.135) 0:05:50.547 ***** 2025-12-04 13:49:44.030205 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:44.030257 | controller | 2025-12-04 13:49:44.030370 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-04 13:49:44.030485 | controller | Thursday 04 December 2025 13:49:44 +0000 (0:00:00.465) 0:05:51.013 ***** 2025-12-04 13:49:44.071109 | controller | skipping: [instance] 2025-12-04 13:49:44.071195 | controller | 2025-12-04 13:49:44.071296 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-04 13:49:44.071406 | controller | Thursday 04 December 2025 13:49:44 +0000 (0:00:00.041) 0:05:51.054 ***** 2025-12-04 13:49:44.113573 | controller | skipping: [instance] 2025-12-04 13:49:44.113664 | controller | 2025-12-04 13:49:44.113827 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-04 13:49:44.113885 | controller | Thursday 04 December 2025 13:49:44 +0000 (0:00:00.042) 0:05:51.096 ***** 2025-12-04 13:49:44.153922 | controller | skipping: [instance] 2025-12-04 13:49:44.154042 | controller | 2025-12-04 13:49:44.154148 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-04 13:49:44.154252 | controller | Thursday 04 December 2025 13:49:44 +0000 (0:00:00.040) 0:05:51.137 ***** 2025-12-04 13:49:44.200689 | controller | skipping: [instance] 2025-12-04 13:49:44.200860 | controller | 2025-12-04 13:49:44.201034 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-12-04 13:49:44.201134 | controller | Thursday 04 December 2025 13:49:44 +0000 (0:00:00.046) 0:05:51.183 ***** 2025-12-04 13:49:45.647258 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 13:49:45.647312 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 13:49:45.647428 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 13:49:45.647530 | controller | changed: [instance -> controller-0] 2025-12-04 13:49:45.647623 | controller | 2025-12-04 13:49:45.647722 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-12-04 13:49:45.647813 | controller | Thursday 04 December 2025 13:49:45 +0000 (0:00:01.445) 0:05:52.629 ***** 2025-12-04 13:49:46.616846 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:46.616902 | controller | 2025-12-04 13:49:46.617031 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-12-04 13:49:46.617131 | controller | Thursday 04 December 2025 13:49:46 +0000 (0:00:00.969) 0:05:53.599 ***** 2025-12-04 13:49:47.954906 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:47.955178 | controller | 2025-12-04 13:49:47.955234 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-12-04 13:49:47.955245 | controller | Thursday 04 December 2025 13:49:47 +0000 (0:00:01.338) 0:05:54.937 ***** 2025-12-04 13:49:55.757348 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:55.757429 | controller | 2025-12-04 13:49:55.757456 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-12-04 13:49:55.757607 | controller | Thursday 04 December 2025 13:49:55 +0000 (0:00:07.802) 0:06:02.739 ***** 2025-12-04 13:49:56.789465 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:56.789550 | controller | 2025-12-04 13:49:56.789634 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-12-04 13:49:56.789658 | controller | Thursday 04 December 2025 13:49:56 +0000 (0:00:01.031) 0:06:03.771 ***** 2025-12-04 13:49:56.832019 | controller | skipping: [instance] 2025-12-04 13:49:58.065916 | controller | 2025-12-04 13:49:58.066026 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-12-04 13:49:58.066038 | controller | Thursday 04 December 2025 13:49:56 +0000 (0:00:00.043) 0:06:03.814 ***** 2025-12-04 13:49:58.066053 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:58.136234 | controller | 2025-12-04 13:49:58.136289 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-12-04 13:49:58.136346 | controller | Thursday 04 December 2025 13:49:58 +0000 (0:00:01.233) 0:06:05.047 ***** 2025-12-04 13:49:58.136362 | controller | skipping: [instance] 2025-12-04 13:49:58.136625 | controller | 2025-12-04 13:49:58.136639 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-12-04 13:49:58.199919 | controller | Thursday 04 December 2025 13:49:58 +0000 (0:00:00.070) 0:06:05.118 ***** 2025-12-04 13:49:58.199940 | controller | skipping: [instance] 2025-12-04 13:49:58.267360 | controller | 2025-12-04 13:49:58.267394 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-12-04 13:49:58.267402 | controller | Thursday 04 December 2025 13:49:58 +0000 (0:00:00.064) 0:06:05.182 ***** 2025-12-04 13:49:58.267413 | controller | skipping: [instance] 2025-12-04 13:49:59.137056 | controller | 2025-12-04 13:49:59.137102 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-12-04 13:49:59.137110 | controller | Thursday 04 December 2025 13:49:58 +0000 (0:00:00.063) 0:06:05.246 ***** 2025-12-04 13:49:59.137121 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:49:59.137141 | controller | 2025-12-04 13:49:59.137224 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-12-04 13:49:59.137317 | controller | Thursday 04 December 2025 13:49:59 +0000 (0:00:00.872) 0:06:06.119 ***** 2025-12-04 13:50:00.096019 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:00.096083 | controller | 2025-12-04 13:50:00.096177 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-12-04 13:50:00.096282 | controller | Thursday 04 December 2025 13:50:00 +0000 (0:00:00.958) 0:06:07.078 ***** 2025-12-04 13:50:00.145467 | controller | skipping: [instance] 2025-12-04 13:50:00.145569 | controller | 2025-12-04 13:50:00.145668 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-12-04 13:50:00.145764 | controller | Thursday 04 December 2025 13:50:00 +0000 (0:00:00.048) 0:06:07.126 ***** 2025-12-04 13:50:00.198114 | controller | skipping: [instance] 2025-12-04 13:50:00.198197 | controller | 2025-12-04 13:50:00.198293 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-12-04 13:50:00.198396 | controller | Thursday 04 December 2025 13:50:00 +0000 (0:00:00.053) 0:06:07.180 ***** 2025-12-04 13:50:00.239810 | controller | skipping: [instance] 2025-12-04 13:50:00.239918 | controller | 2025-12-04 13:50:00.240048 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-12-04 13:50:00.240167 | controller | Thursday 04 December 2025 13:50:00 +0000 (0:00:00.042) 0:06:07.222 ***** 2025-12-04 13:50:00.298420 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:00.298535 | controller | 2025-12-04 13:50:00.298631 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-12-04 13:50:00.298740 | controller | Thursday 04 December 2025 13:50:00 +0000 (0:00:00.058) 0:06:07.281 ***** 2025-12-04 13:50:00.343615 | controller | skipping: [instance] 2025-12-04 13:50:00.343707 | controller | 2025-12-04 13:50:00.343826 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-12-04 13:50:00.343938 | controller | Thursday 04 December 2025 13:50:00 +0000 (0:00:00.044) 0:06:07.326 ***** 2025-12-04 13:50:00.391161 | controller | skipping: [instance] 2025-12-04 13:50:00.391247 | controller | 2025-12-04 13:50:00.391347 | controller | TASK [Download the RPM] ******************************************************** 2025-12-04 13:50:00.391458 | controller | Thursday 04 December 2025 13:50:00 +0000 (0:00:00.047) 0:06:07.374 ***** 2025-12-04 13:50:00.440044 | controller | skipping: [instance] 2025-12-04 13:50:00.440151 | controller | 2025-12-04 13:50:00.440250 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-12-04 13:50:00.440373 | controller | Thursday 04 December 2025 13:50:00 +0000 (0:00:00.048) 0:06:07.422 ***** 2025-12-04 13:50:00.485903 | controller | skipping: [instance] 2025-12-04 13:50:00.486027 | controller | 2025-12-04 13:50:00.486128 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-12-04 13:50:00.486228 | controller | Thursday 04 December 2025 13:50:00 +0000 (0:00:00.045) 0:06:07.468 ***** 2025-12-04 13:50:00.530196 | controller | skipping: [instance] 2025-12-04 13:50:00.530281 | controller | 2025-12-04 13:50:00.530382 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-12-04 13:50:00.530503 | controller | Thursday 04 December 2025 13:50:00 +0000 (0:00:00.043) 0:06:07.512 ***** 2025-12-04 13:50:00.573193 | controller | skipping: [instance] 2025-12-04 13:50:00.573279 | controller | 2025-12-04 13:50:00.573383 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-12-04 13:50:00.573507 | controller | Thursday 04 December 2025 13:50:00 +0000 (0:00:00.043) 0:06:07.556 ***** 2025-12-04 13:50:00.613558 | controller | skipping: [instance] 2025-12-04 13:50:00.614462 | controller | 2025-12-04 13:50:01.138135 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-12-04 13:50:01.138182 | controller | Thursday 04 December 2025 13:50:00 +0000 (0:00:00.040) 0:06:07.596 ***** 2025-12-04 13:50:01.138199 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:01.138312 | controller | 2025-12-04 13:50:01.138334 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-12-04 13:50:01.138426 | controller | Thursday 04 December 2025 13:50:01 +0000 (0:00:00.523) 0:06:08.120 ***** 2025-12-04 13:50:01.199063 | controller | skipping: [instance] 2025-12-04 13:50:01.199158 | controller | 2025-12-04 13:50:01.199281 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-12-04 13:50:01.199378 | controller | Thursday 04 December 2025 13:50:01 +0000 (0:00:00.061) 0:06:08.181 ***** 2025-12-04 13:50:01.260922 | controller | skipping: [instance] 2025-12-04 13:50:01.260949 | controller | 2025-12-04 13:50:01.261144 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-12-04 13:50:01.261230 | controller | Thursday 04 December 2025 13:50:01 +0000 (0:00:00.061) 0:06:08.243 ***** 2025-12-04 13:50:01.313117 | controller | skipping: [instance] 2025-12-04 13:50:01.313184 | controller | 2025-12-04 13:50:01.313301 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-12-04 13:50:01.313416 | controller | Thursday 04 December 2025 13:50:01 +0000 (0:00:00.052) 0:06:08.295 ***** 2025-12-04 13:50:01.375870 | controller | skipping: [instance] 2025-12-04 13:50:01.375978 | controller | 2025-12-04 13:50:01.376099 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-12-04 13:50:01.376203 | controller | Thursday 04 December 2025 13:50:01 +0000 (0:00:00.062) 0:06:08.358 ***** 2025-12-04 13:50:01.439947 | controller | skipping: [instance] 2025-12-04 13:50:01.440054 | controller | 2025-12-04 13:50:01.440164 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-12-04 13:50:01.440272 | controller | Thursday 04 December 2025 13:50:01 +0000 (0:00:00.064) 0:06:08.422 ***** 2025-12-04 13:50:01.507937 | controller | skipping: [instance] 2025-12-04 13:50:01.508056 | controller | 2025-12-04 13:50:01.508158 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-12-04 13:50:01.508272 | controller | Thursday 04 December 2025 13:50:01 +0000 (0:00:00.067) 0:06:08.490 ***** 2025-12-04 13:50:01.576583 | controller | skipping: [instance] 2025-12-04 13:50:01.576684 | controller | 2025-12-04 13:50:01.576799 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-12-04 13:50:01.576908 | controller | Thursday 04 December 2025 13:50:01 +0000 (0:00:00.068) 0:06:08.559 ***** 2025-12-04 13:50:01.644801 | controller | skipping: [instance] 2025-12-04 13:50:01.644855 | controller | 2025-12-04 13:50:01.644983 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-12-04 13:50:01.645083 | controller | Thursday 04 December 2025 13:50:01 +0000 (0:00:00.068) 0:06:08.627 ***** 2025-12-04 13:50:02.352182 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:02.352240 | controller | 2025-12-04 13:50:02.352350 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-12-04 13:50:02.352456 | controller | Thursday 04 December 2025 13:50:02 +0000 (0:00:00.706) 0:06:09.334 ***** 2025-12-04 13:50:03.479695 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 13:50:03.479738 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 13:50:03.479854 | controller | changed: [instance -> controller-0] 2025-12-04 13:50:03.479980 | controller | 2025-12-04 13:50:03.480092 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-12-04 13:50:03.480189 | controller | Thursday 04 December 2025 13:50:03 +0000 (0:00:01.127) 0:06:10.461 ***** 2025-12-04 13:50:05.225850 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:05.226139 | controller | 2025-12-04 13:50:05.226199 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-12-04 13:50:05.226213 | controller | Thursday 04 December 2025 13:50:05 +0000 (0:00:01.744) 0:06:12.206 ***** 2025-12-04 13:50:05.798515 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:05.859551 | controller | 2025-12-04 13:50:05.859587 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-12-04 13:50:05.859595 | controller | Thursday 04 December 2025 13:50:05 +0000 (0:00:00.574) 0:06:12.780 ***** 2025-12-04 13:50:05.859606 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 13:50:05.909866 | controller | ok: [instance -> controller-0] 2025-12-04 13:50:05.909910 | controller | 2025-12-04 13:50:05.909919 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-12-04 13:50:05.909926 | controller | Thursday 04 December 2025 13:50:05 +0000 (0:00:00.061) 0:06:12.842 ***** 2025-12-04 13:50:05.909939 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:39.424237 | controller | 2025-12-04 13:50:39.424483 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-12-04 13:50:39.424493 | controller | Thursday 04 December 2025 13:50:05 +0000 (0:00:00.049) 0:06:12.892 ***** 2025-12-04 13:50:39.424507 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:39.919280 | controller | 2025-12-04 13:50:39.919353 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-12-04 13:50:39.919362 | controller | Thursday 04 December 2025 13:50:39 +0000 (0:00:33.500) 0:06:46.392 ***** 2025-12-04 13:50:39.919378 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:39.919401 | controller | 2025-12-04 13:50:39.919541 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-12-04 13:50:39.919596 | controller | Thursday 04 December 2025 13:50:39 +0000 (0:00:00.509) 0:06:46.901 ***** 2025-12-04 13:50:40.442626 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:46.447302 | controller | 2025-12-04 13:50:46.447337 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-12-04 13:50:46.447346 | controller | Thursday 04 December 2025 13:50:40 +0000 (0:00:00.522) 0:06:47.424 ***** 2025-12-04 13:50:46.447370 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:46.498829 | controller | 2025-12-04 13:50:46.498868 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-12-04 13:50:46.498877 | controller | Thursday 04 December 2025 13:50:46 +0000 (0:00:06.004) 0:06:53.429 ***** 2025-12-04 13:50:46.498889 | controller | skipping: [instance] 2025-12-04 13:50:46.498908 | controller | 2025-12-04 13:50:46.499082 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-12-04 13:50:47.093815 | controller | Thursday 04 December 2025 13:50:46 +0000 (0:00:00.052) 0:06:53.481 ***** 2025-12-04 13:50:47.093875 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:47.606429 | controller | 2025-12-04 13:50:47.606468 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-12-04 13:50:47.606477 | controller | Thursday 04 December 2025 13:50:47 +0000 (0:00:00.594) 0:06:54.075 ***** 2025-12-04 13:50:47.606488 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:47.652711 | controller | 2025-12-04 13:50:47.652743 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-12-04 13:50:47.652752 | controller | Thursday 04 December 2025 13:50:47 +0000 (0:00:00.512) 0:06:54.588 ***** 2025-12-04 13:50:47.652762 | controller | skipping: [instance] 2025-12-04 13:50:47.652856 | controller | 2025-12-04 13:50:47.653085 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-12-04 13:50:47.653191 | controller | Thursday 04 December 2025 13:50:47 +0000 (0:00:00.046) 0:06:54.635 ***** 2025-12-04 13:50:47.796465 | controller | skipping: [instance] 2025-12-04 13:50:47.838609 | controller | 2025-12-04 13:50:47.838683 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-12-04 13:50:47.838692 | controller | Thursday 04 December 2025 13:50:47 +0000 (0:00:00.143) 0:06:54.778 ***** 2025-12-04 13:50:47.838706 | controller | skipping: [instance] 2025-12-04 13:50:47.838811 | controller | 2025-12-04 13:50:47.838853 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-12-04 13:50:47.838871 | controller | Thursday 04 December 2025 13:50:47 +0000 (0:00:00.042) 0:06:54.821 ***** 2025-12-04 13:50:47.881065 | controller | skipping: [instance] 2025-12-04 13:50:47.919718 | controller | 2025-12-04 13:50:47.919736 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-12-04 13:50:47.919743 | controller | Thursday 04 December 2025 13:50:47 +0000 (0:00:00.041) 0:06:54.863 ***** 2025-12-04 13:50:47.919751 | controller | skipping: [instance] 2025-12-04 13:50:47.919886 | controller | 2025-12-04 13:50:47.920062 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-12-04 13:50:47.920195 | controller | Thursday 04 December 2025 13:50:47 +0000 (0:00:00.039) 0:06:54.902 ***** 2025-12-04 13:50:47.970408 | controller | skipping: [instance] 2025-12-04 13:50:47.970583 | controller | 2025-12-04 13:50:47.970722 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-12-04 13:50:47.970853 | controller | Thursday 04 December 2025 13:50:47 +0000 (0:00:00.050) 0:06:54.953 ***** 2025-12-04 13:50:50.749915 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 13:50:50.750016 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 13:50:50.750027 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 13:50:50.750034 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 13:50:50.750041 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 13:50:50.750119 | controller | changed: [instance -> controller-0] 2025-12-04 13:50:50.750130 | controller | 2025-12-04 13:50:50.750213 | controller | TASK [Prepare install_yamls make targets] ************************************** 2025-12-04 13:50:50.750306 | controller | Thursday 04 December 2025 13:50:50 +0000 (0:00:02.777) 0:06:57.731 ***** 2025-12-04 13:50:50.911359 | controller | 2025-12-04 13:50:50.911423 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2025-12-04 13:50:50.911544 | controller | Thursday 04 December 2025 13:50:50 +0000 (0:00:00.163) 0:06:57.894 ***** 2025-12-04 13:50:52.571893 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 13:50:52.571992 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 13:50:52.572037 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 13:50:52.572166 | controller | changed: [instance -> controller-0] 2025-12-04 13:50:52.572274 | controller | 2025-12-04 13:50:52.572390 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2025-12-04 13:50:52.572533 | controller | Thursday 04 December 2025 13:50:52 +0000 (0:00:01.659) 0:06:59.553 ***** 2025-12-04 13:50:52.649569 | controller | 2025-12-04 13:50:52.649797 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2025-12-04 13:50:52.698500 | controller | Thursday 04 December 2025 13:50:52 +0000 (0:00:00.078) 0:06:59.632 ***** 2025-12-04 13:50:52.698524 | controller | skipping: [instance] 2025-12-04 13:50:52.766995 | controller | 2025-12-04 13:50:52.767064 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2025-12-04 13:50:52.767076 | controller | Thursday 04 December 2025 13:50:52 +0000 (0:00:00.048) 0:06:59.680 ***** 2025-12-04 13:50:52.767091 | controller | skipping: [instance] 2025-12-04 13:50:52.767116 | controller | 2025-12-04 13:50:52.767125 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2025-12-04 13:50:52.767211 | controller | Thursday 04 December 2025 13:50:52 +0000 (0:00:00.068) 0:06:59.748 ***** 2025-12-04 13:50:52.840849 | controller | 2025-12-04 13:50:52.840977 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-04 13:50:52.841108 | controller | Thursday 04 December 2025 13:50:52 +0000 (0:00:00.074) 0:06:59.823 ***** 2025-12-04 13:50:52.887382 | controller | skipping: [instance] 2025-12-04 13:50:52.887460 | controller | 2025-12-04 13:50:52.887534 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-04 13:50:52.887661 | controller | Thursday 04 December 2025 13:50:52 +0000 (0:00:00.046) 0:06:59.869 ***** 2025-12-04 13:50:52.932739 | controller | skipping: [instance] 2025-12-04 13:50:52.932803 | controller | 2025-12-04 13:50:52.932892 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-04 13:50:52.933019 | controller | Thursday 04 December 2025 13:50:52 +0000 (0:00:00.045) 0:06:59.915 ***** 2025-12-04 13:50:52.990622 | controller | skipping: [instance] 2025-12-04 13:50:52.990695 | controller | 2025-12-04 13:50:52.990788 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-04 13:50:52.990904 | controller | Thursday 04 December 2025 13:50:52 +0000 (0:00:00.057) 0:06:59.972 ***** 2025-12-04 13:50:53.045522 | controller | skipping: [instance] 2025-12-04 13:50:53.045696 | controller | 2025-12-04 13:50:53.046438 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2025-12-04 13:50:53.140407 | controller | Thursday 04 December 2025 13:50:53 +0000 (0:00:00.055) 0:07:00.028 ***** 2025-12-04 13:50:53.140463 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-04 13:50:53.140499 | controller | ok: [instance -> controller-0] 2025-12-04 13:50:53.140596 | controller | 2025-12-04 13:50:53.140703 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2025-12-04 13:50:53.140801 | controller | Thursday 04 December 2025 13:50:53 +0000 (0:00:00.094) 0:07:00.122 ***** 2025-12-04 13:50:53.223575 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:53.223634 | controller | 2025-12-04 13:50:53.223748 | controller | TASK [install_yamls : Get environment structure] ******************************* 2025-12-04 13:50:53.223853 | controller | Thursday 04 December 2025 13:50:53 +0000 (0:00:00.083) 0:07:00.206 ***** 2025-12-04 13:50:54.327829 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:54.327884 | controller | 2025-12-04 13:50:54.327974 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2025-12-04 13:50:54.328098 | controller | Thursday 04 December 2025 13:50:54 +0000 (0:00:01.104) 0:07:01.310 ***** 2025-12-04 13:50:54.370282 | controller | skipping: [instance] 2025-12-04 13:50:54.370348 | controller | 2025-12-04 13:50:54.370473 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2025-12-04 13:50:54.370573 | controller | Thursday 04 December 2025 13:50:54 +0000 (0:00:00.043) 0:07:01.353 ***** 2025-12-04 13:50:54.427177 | controller | skipping: [instance] 2025-12-04 13:50:54.427263 | controller | 2025-12-04 13:50:54.427368 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2025-12-04 13:50:54.427491 | controller | Thursday 04 December 2025 13:50:54 +0000 (0:00:00.056) 0:07:01.409 ***** 2025-12-04 13:50:54.472014 | controller | skipping: [instance] 2025-12-04 13:50:54.472105 | controller | 2025-12-04 13:50:54.472206 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2025-12-04 13:50:54.472295 | controller | Thursday 04 December 2025 13:50:54 +0000 (0:00:00.044) 0:07:01.454 ***** 2025-12-04 13:50:54.535148 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:54.535235 | controller | 2025-12-04 13:50:54.535331 | controller | TASK [install_yamls : Show the env structure] ********************************** 2025-12-04 13:50:54.535442 | controller | Thursday 04 December 2025 13:50:54 +0000 (0:00:00.063) 0:07:01.518 ***** 2025-12-04 13:50:54.580643 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:54.580741 | controller | 2025-12-04 13:50:54.580874 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2025-12-04 13:50:54.581017 | controller | Thursday 04 December 2025 13:50:54 +0000 (0:00:00.045) 0:07:01.563 ***** 2025-12-04 13:50:54.642747 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:54.642831 | controller | 2025-12-04 13:50:54.642929 | controller | TASK [install_yamls : Generate make targets] *********************************** 2025-12-04 13:50:54.643050 | controller | Thursday 04 December 2025 13:50:54 +0000 (0:00:00.061) 0:07:01.625 ***** 2025-12-04 13:50:55.334046 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:55.334112 | controller | 2025-12-04 13:50:55.334203 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2025-12-04 13:50:55.334302 | controller | Thursday 04 December 2025 13:50:55 +0000 (0:00:00.691) 0:07:02.316 ***** 2025-12-04 13:50:55.382769 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:56.351087 | controller | 2025-12-04 13:50:56.351135 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2025-12-04 13:50:56.351144 | controller | Thursday 04 December 2025 13:50:55 +0000 (0:00:00.048) 0:07:02.365 ***** 2025-12-04 13:50:56.351156 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:56.400778 | controller | 2025-12-04 13:50:56.400826 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2025-12-04 13:50:56.400836 | controller | Thursday 04 December 2025 13:50:56 +0000 (0:00:00.968) 0:07:03.333 ***** 2025-12-04 13:50:56.400850 | controller | skipping: [instance] 2025-12-04 13:50:57.170878 | controller | 2025-12-04 13:50:57.170923 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-12-04 13:50:57.170932 | controller | Thursday 04 December 2025 13:50:56 +0000 (0:00:00.049) 0:07:03.383 ***** 2025-12-04 13:50:57.170945 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:57.170996 | controller | 2025-12-04 13:50:57.171028 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-12-04 13:50:57.171252 | controller | Thursday 04 December 2025 13:50:57 +0000 (0:00:00.770) 0:07:04.153 ***** 2025-12-04 13:50:57.233222 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:58.222603 | controller | 2025-12-04 13:50:58.222637 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2025-12-04 13:50:58.222645 | controller | Thursday 04 December 2025 13:50:57 +0000 (0:00:00.062) 0:07:04.215 ***** 2025-12-04 13:50:58.222656 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:58.222682 | controller | 2025-12-04 13:50:58.222690 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2025-12-04 13:50:58.222860 | controller | Thursday 04 December 2025 13:50:58 +0000 (0:00:00.988) 0:07:05.204 ***** 2025-12-04 13:50:58.718780 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:50:58.874309 | controller | 2025-12-04 13:50:58.874382 | controller | TASK [Configure CRC network if needed] ***************************************** 2025-12-04 13:50:58.874392 | controller | Thursday 04 December 2025 13:50:58 +0000 (0:00:00.495) 0:07:05.700 ***** 2025-12-04 13:50:58.874405 | controller | 2025-12-04 13:51:00.152507 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2025-12-04 13:51:00.152603 | controller | Thursday 04 December 2025 13:50:58 +0000 (0:00:00.155) 0:07:05.856 ***** 2025-12-04 13:51:00.152636 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:51:01.341686 | controller | 2025-12-04 13:51:01.341774 | controller | TASK [openshift_setup : Patch network operator] ******************************** 2025-12-04 13:51:01.341784 | controller | Thursday 04 December 2025 13:51:00 +0000 (0:00:01.277) 0:07:07.134 ***** 2025-12-04 13:51:01.341806 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:51:01.341812 | controller | 2025-12-04 13:51:01.341820 | controller | TASK [Ensure OCP cluster is stable] ******************************************** 2025-12-04 13:51:01.341953 | controller | Thursday 04 December 2025 13:51:01 +0000 (0:00:01.189) 0:07:08.323 ***** 2025-12-04 13:51:01.379533 | controller | skipping: [instance] 2025-12-04 13:51:01.379602 | controller | 2025-12-04 13:51:01.379699 | controller | TASK [reproducer : Emulate CI job] ********************************************* 2025-12-04 13:51:01.379801 | controller | Thursday 04 December 2025 13:51:01 +0000 (0:00:00.038) 0:07:08.362 ***** 2025-12-04 13:51:01.425432 | controller | skipping: [instance] 2025-12-04 13:51:01.425536 | controller | 2025-12-04 13:51:01.425683 | controller | TASK [reproducer : Prepare architecture-based deployment] ********************** 2025-12-04 13:51:01.425786 | controller | Thursday 04 December 2025 13:51:01 +0000 (0:00:00.045) 0:07:08.408 ***** 2025-12-04 13:51:01.467484 | controller | skipping: [instance] 2025-12-04 13:51:01.467594 | controller | 2025-12-04 13:51:01.467778 | controller | TASK [reproducer : Prepare architecture-based post deployment] ***************** 2025-12-04 13:51:01.467859 | controller | Thursday 04 December 2025 13:51:01 +0000 (0:00:00.041) 0:07:08.450 ***** 2025-12-04 13:51:01.515394 | controller | skipping: [instance] 2025-12-04 13:51:01.515488 | controller | 2025-12-04 13:51:01.515610 | controller | TASK [reproducer : Prepare ci-like EDPM deploy] ******************************** 2025-12-04 13:51:01.515692 | controller | Thursday 04 December 2025 13:51:01 +0000 (0:00:00.048) 0:07:08.498 ***** 2025-12-04 13:51:02.535753 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:51:02.536096 | controller | 2025-12-04 13:51:03.054811 | controller | TASK [Ensure we have appropriate credentials for OpenShift accesses] *********** 2025-12-04 13:51:03.054873 | controller | Thursday 04 December 2025 13:51:02 +0000 (0:00:01.019) 0:07:09.518 ***** 2025-12-04 13:51:03.054890 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:51:03.541070 | controller | 2025-12-04 13:51:03.541134 | controller | TASK [Ensure we have needed inventory files] *********************************** 2025-12-04 13:51:03.541144 | controller | Thursday 04 December 2025 13:51:03 +0000 (0:00:00.518) 0:07:10.036 ***** 2025-12-04 13:51:03.541164 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:51:03.541210 | controller | 2025-12-04 13:51:03.541218 | controller | TASK [Ensure we have CRC ssh key] ********************************************** 2025-12-04 13:51:03.541241 | controller | Thursday 04 December 2025 13:51:03 +0000 (0:00:00.486) 0:07:10.523 ***** 2025-12-04 13:51:04.108109 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:51:04.654887 | controller | 2025-12-04 13:51:04.654970 | controller | TASK [Ensure we have the MAC mapping file] ************************************* 2025-12-04 13:51:04.654985 | controller | Thursday 04 December 2025 13:51:04 +0000 (0:00:00.566) 0:07:11.090 ***** 2025-12-04 13:51:04.655000 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:51:04.655197 | controller | 2025-12-04 13:51:04.655212 | controller | TASK [Load crc inventory] ****************************************************** 2025-12-04 13:51:05.158974 | controller | Thursday 04 December 2025 13:51:04 +0000 (0:00:00.546) 0:07:11.636 ***** 2025-12-04 13:51:05.159056 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:51:05.639804 | controller | 2025-12-04 13:51:05.639849 | controller | TASK [Load compute inventory] ************************************************** 2025-12-04 13:51:05.639858 | controller | Thursday 04 December 2025 13:51:05 +0000 (0:00:00.504) 0:07:12.140 ***** 2025-12-04 13:51:05.639870 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:51:06.163456 | controller | 2025-12-04 13:51:06.163517 | controller | TASK [Ensure we can ping compute-0 on osp_trunk net] *************************** 2025-12-04 13:51:06.163535 | controller | Thursday 04 December 2025 13:51:05 +0000 (0:00:00.480) 0:07:12.621 ***** 2025-12-04 13:51:06.163549 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:51:06.709513 | controller | 2025-12-04 13:51:06.709577 | controller | TASK [Ensure we can ping crc-0 on osp_trunk net] ******************************* 2025-12-04 13:51:06.709586 | controller | Thursday 04 December 2025 13:51:06 +0000 (0:00:00.523) 0:07:13.145 ***** 2025-12-04 13:51:06.709599 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:51:07.211711 | controller | 2025-12-04 13:51:07.211746 | controller | TASK [Check default location secret file] ************************************** 2025-12-04 13:51:07.211755 | controller | Thursday 04 December 2025 13:51:06 +0000 (0:00:00.545) 0:07:13.691 ***** 2025-12-04 13:51:07.211774 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:51:07.211807 | controller | 2025-12-04 13:51:07.212111 | controller | TASK [Check non-default location secret] *************************************** 2025-12-04 13:51:07.790258 | controller | Thursday 04 December 2025 13:51:07 +0000 (0:00:00.502) 0:07:14.194 ***** 2025-12-04 13:51:07.790322 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-04 13:51:07.842397 | controller | 2025-12-04 13:51:07.842448 | controller | TASK [Assert all of the tests] ************************************************* 2025-12-04 13:51:07.842457 | controller | Thursday 04 December 2025 13:51:07 +0000 (0:00:00.576) 0:07:14.770 ***** 2025-12-04 13:51:07.842470 | controller | ok: [instance] 2025-12-04 13:51:08.087188 | controller | 2025-12-04 13:51:08.087250 | controller | TASK [Create dnsmasq dir] ****************************************************** 2025-12-04 13:51:08.087260 | controller | Thursday 04 December 2025 13:51:07 +0000 (0:00:00.054) 0:07:14.824 ***** 2025-12-04 13:51:08.087275 | controller | changed: [instance] 2025-12-04 13:51:08.087306 | controller | 2025-12-04 13:51:08.087314 | controller | TASK [Get journalctl in a file] ************************************************ 2025-12-04 13:51:08.333928 | controller | Thursday 04 December 2025 13:51:08 +0000 (0:00:00.244) 0:07:15.069 ***** 2025-12-04 13:51:08.334017 | controller | changed: [instance] 2025-12-04 13:51:08.773785 | controller | 2025-12-04 13:51:08.773827 | controller | TASK [Dump journalctl output] ************************************************** 2025-12-04 13:51:08.773836 | controller | Thursday 04 December 2025 13:51:08 +0000 (0:00:00.246) 0:07:15.315 ***** 2025-12-04 13:51:08.773847 | controller | changed: [instance] 2025-12-04 13:51:08.773879 | controller | 2025-12-04 13:51:08.773887 | controller | TASK [Copy all dnsmasq config] ************************************************* 2025-12-04 13:51:08.774048 | controller | Thursday 04 December 2025 13:51:08 +0000 (0:00:00.439) 0:07:15.755 ***** 2025-12-04 13:51:09.303104 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-12-04 13:51:09.303175 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2025-12-04 13:51:09.303187 | controller | 2025-12-04 13:51:09.303360 | controller | TASK [Create log directory] **************************************************** 2025-12-04 13:51:09.522543 | controller | Thursday 04 December 2025 13:51:09 +0000 (0:00:00.530) 0:07:16.285 ***** 2025-12-04 13:51:09.522588 | controller | changed: [instance] 2025-12-04 13:51:10.517947 | controller | 2025-12-04 13:51:10.518024 | controller | TASK [Sync logs from controller-0] ********************************************* 2025-12-04 13:51:10.518036 | controller | Thursday 04 December 2025 13:51:09 +0000 (0:00:00.219) 0:07:16.504 ***** 2025-12-04 13:51:10.518052 | controller | changed: [instance] 2025-12-04 13:51:10.518526 | controller | 2025-12-04 13:51:10.518561 | controller | PLAY RECAP ********************************************************************* 2025-12-04 13:51:10.518609 | controller | instance : ok=537 changed=200 unreachable=0 failed=0 skipped=229 rescued=0 ignored=0 2025-12-04 13:51:10.518618 | controller | 2025-12-04 13:51:10.518624 | controller | Thursday 04 December 2025 13:51:10 +0000 (0:00:00.993) 0:07:17.498 ***** 2025-12-04 13:51:10.518629 | controller | =============================================================================== 2025-12-04 13:51:10.518635 | controller | reproducer : Check package install status ------------------------------ 61.47s 2025-12-04 13:51:10.518649 | controller | ci_setup : Install needed packages ------------------------------------- 33.50s 2025-12-04 13:51:10.518728 | controller | libvirt_manager : Download base image ---------------------------------- 20.40s 2025-12-04 13:51:10.518760 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.91s 2025-12-04 13:51:10.519162 | controller | reproducer : Install collections on controller-0 ----------------------- 19.45s 2025-12-04 13:51:10.519742 | controller | libvirt_manager : Install packages required for using KVM -------------- 13.83s 2025-12-04 13:51:10.519757 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.90s 2025-12-04 13:51:10.519763 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.80s 2025-12-04 13:51:10.519772 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.02s 2025-12-04 13:51:10.520034 | controller | ci_setup : Install openshift client ------------------------------------- 6.00s 2025-12-04 13:51:10.520045 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 5.04s 2025-12-04 13:51:10.520051 | controller | ci_nmstate : Install required packages on localhost --------------------- 4.77s 2025-12-04 13:51:10.520063 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.65s 2025-12-04 13:51:10.520069 | controller | networking_mapper : Gather the facts ------------------------------------ 3.34s 2025-12-04 13:51:10.520076 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.21s 2025-12-04 13:51:10.520295 | controller | sushy_emulator : Install required packages ------------------------------ 3.09s 2025-12-04 13:51:10.520304 | controller | ci_setup : Manage directories ------------------------------------------- 2.78s 2025-12-04 13:51:10.520312 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.40s 2025-12-04 13:51:10.699878 | controller | reproducer : Restart NetworkManager ------------------------------------- 2.30s 2025-12-04 13:51:10.699913 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.27s 2025-12-04 13:51:10.699926 | controller | INFO Running crc_layout > cleanup 2025-12-04 13:51:10.700347 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-04 13:51:10.707352 | controller | INFO Running job_uri > prepare 2025-12-04 13:51:10.707735 | controller | WARNING Skipping, prepare playbook not configured. 2025-12-04 13:51:10.714992 | controller | INFO Running job_uri > converge 2025-12-04 13:51:11.159203 | controller | 2025-12-04 13:51:11.159379 | controller | PLAY [Prepare] ***************************************************************** 2025-12-04 13:51:11.159509 | controller | 2025-12-04 13:51:11.159623 | controller | TASK [Call task file in loop] ************************************************** 2025-12-04 13:51:11.159762 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.034) 0:00:00.034 ***** 2025-12-04 13:51:11.237242 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////'}) 2025-12-04 13:51:11.237386 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2025-12-04 13:51:11.237536 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2025-12-04 13:51:11.237677 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35'}) 2025-12-04 13:51:11.237800 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2025-12-04 13:51:11.237930 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2025-12-04 13:51:11.238077 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log'}) 2025-12-04 13:51:11.238216 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/'}) 2025-12-04 13:51:11.238366 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4'}) 2025-12-04 13:51:11.238508 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': '/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a'}) 2025-12-04 13:51:11.238632 | controller | 2025-12-04 13:51:11.238756 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////] *** 2025-12-04 13:51:11.238867 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.077) 0:00:00.112 ***** 2025-12-04 13:51:11.277156 | controller | 2025-12-04 13:51:11.277318 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 13:51:11.277449 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.041) 0:00:00.153 ***** 2025-12-04 13:51:11.321109 | controller | ok: [instance] 2025-12-04 13:51:11.321297 | controller | 2025-12-04 13:51:11.321444 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 13:51:11.321577 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.043) 0:00:00.196 ***** 2025-12-04 13:51:11.368479 | controller | ok: [instance] 2025-12-04 13:51:11.425704 | controller | 2025-12-04 13:51:11.425729 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 13:51:11.425737 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.047) 0:00:00.244 ***** 2025-12-04 13:51:11.425747 | controller | ok: [instance] 2025-12-04 13:51:11.425770 | controller | 2025-12-04 13:51:11.425779 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 13:51:11.425885 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.057) 0:00:00.301 ***** 2025-12-04 13:51:11.456638 | controller | skipping: [instance] 2025-12-04 13:51:11.456718 | controller | 2025-12-04 13:51:11.456839 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 13:51:11.456922 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.031) 0:00:00.332 ***** 2025-12-04 13:51:11.538589 | controller | ok: [instance] => changed=false 2025-12-04 13:51:11.538712 | controller | msg: All assertions passed 2025-12-04 13:51:11.538793 | controller | 2025-12-04 13:51:11.538917 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2025-12-04 13:51:11.539050 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.081) 0:00:00.414 ***** 2025-12-04 13:51:11.584159 | controller | 2025-12-04 13:51:11.584252 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 13:51:11.584356 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.045) 0:00:00.460 ***** 2025-12-04 13:51:11.624569 | controller | ok: [instance] 2025-12-04 13:51:11.624663 | controller | 2025-12-04 13:51:11.624764 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 13:51:11.624876 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.040) 0:00:00.500 ***** 2025-12-04 13:51:11.670175 | controller | ok: [instance] 2025-12-04 13:51:11.670250 | controller | 2025-12-04 13:51:11.670366 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 13:51:11.670463 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.045) 0:00:00.546 ***** 2025-12-04 13:51:11.714814 | controller | ok: [instance] 2025-12-04 13:51:11.714899 | controller | 2025-12-04 13:51:11.715048 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 13:51:11.715146 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.044) 0:00:00.590 ***** 2025-12-04 13:51:11.752606 | controller | skipping: [instance] 2025-12-04 13:51:11.752663 | controller | 2025-12-04 13:51:11.752776 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 13:51:11.752874 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.038) 0:00:00.628 ***** 2025-12-04 13:51:11.796025 | controller | ok: [instance] => changed=false 2025-12-04 13:51:11.796121 | controller | msg: All assertions passed 2025-12-04 13:51:11.796220 | controller | 2025-12-04 13:51:11.796332 | controller | TASK [Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2025-12-04 13:51:11.796439 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.043) 0:00:00.672 ***** 2025-12-04 13:51:11.842631 | controller | 2025-12-04 13:51:11.842733 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 13:51:11.842827 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.046) 0:00:00.718 ***** 2025-12-04 13:51:11.882234 | controller | ok: [instance] 2025-12-04 13:51:11.882320 | controller | 2025-12-04 13:51:11.882421 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 13:51:11.882529 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.039) 0:00:00.758 ***** 2025-12-04 13:51:11.922381 | controller | ok: [instance] 2025-12-04 13:51:11.922479 | controller | 2025-12-04 13:51:11.922575 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 13:51:11.922706 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.040) 0:00:00.798 ***** 2025-12-04 13:51:11.961184 | controller | ok: [instance] 2025-12-04 13:51:11.961270 | controller | 2025-12-04 13:51:11.961379 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 13:51:11.961511 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.038) 0:00:00.837 ***** 2025-12-04 13:51:11.995130 | controller | skipping: [instance] 2025-12-04 13:51:11.995211 | controller | 2025-12-04 13:51:11.995318 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 13:51:11.995419 | controller | Thursday 04 December 2025 13:51:11 +0000 (0:00:00.033) 0:00:00.871 ***** 2025-12-04 13:51:12.040048 | controller | ok: [instance] => changed=false 2025-12-04 13:51:12.040148 | controller | msg: All assertions passed 2025-12-04 13:51:12.040243 | controller | 2025-12-04 13:51:12.040353 | controller | TASK [Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35] *** 2025-12-04 13:51:12.040471 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.045) 0:00:00.916 ***** 2025-12-04 13:51:12.083695 | controller | 2025-12-04 13:51:12.083815 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 13:51:12.083930 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.043) 0:00:00.959 ***** 2025-12-04 13:51:12.129630 | controller | ok: [instance] 2025-12-04 13:51:12.129698 | controller | 2025-12-04 13:51:12.129818 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 13:51:12.129913 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.045) 0:00:01.005 ***** 2025-12-04 13:51:12.178769 | controller | ok: [instance] 2025-12-04 13:51:12.178852 | controller | 2025-12-04 13:51:12.178972 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 13:51:12.179083 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.049) 0:00:01.054 ***** 2025-12-04 13:51:12.214701 | controller | ok: [instance] 2025-12-04 13:51:12.214793 | controller | 2025-12-04 13:51:12.214925 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 13:51:12.215066 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.035) 0:00:01.090 ***** 2025-12-04 13:51:12.243528 | controller | skipping: [instance] 2025-12-04 13:51:12.243634 | controller | 2025-12-04 13:51:12.243733 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 13:51:12.243841 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.028) 0:00:01.119 ***** 2025-12-04 13:51:12.288436 | controller | ok: [instance] => changed=false 2025-12-04 13:51:12.288542 | controller | msg: All assertions passed 2025-12-04 13:51:12.288662 | controller | 2025-12-04 13:51:12.288792 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2025-12-04 13:51:12.288888 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.045) 0:00:01.164 ***** 2025-12-04 13:51:12.363789 | controller | 2025-12-04 13:51:12.363878 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 13:51:12.364003 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.075) 0:00:01.240 ***** 2025-12-04 13:51:12.399440 | controller | ok: [instance] 2025-12-04 13:51:12.399524 | controller | 2025-12-04 13:51:12.399652 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 13:51:12.399747 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.035) 0:00:01.275 ***** 2025-12-04 13:51:12.429221 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:12.429330 | controller | assertion: _matched_url | default('') | length > 0 2025-12-04 13:51:12.429440 | controller | evaluated_to: false 2025-12-04 13:51:12.429555 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-04 13:51:12.456438 | controller | 2025-12-04 13:51:12.456612 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-04 13:51:12.456720 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.041) 0:00:01.316 ***** 2025-12-04 13:51:12.456820 | controller | 2025-12-04 13:51:12.456918 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-04 13:51:12.457133 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.015) 0:00:01.332 ***** 2025-12-04 13:51:12.502086 | controller | skipping: [instance] 2025-12-04 13:51:12.502176 | controller | 2025-12-04 13:51:12.502285 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-04 13:51:12.502501 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.045) 0:00:01.378 ***** 2025-12-04 13:51:12.548892 | controller | skipping: [instance] 2025-12-04 13:51:12.548978 | controller | 2025-12-04 13:51:12.549116 | controller | TASK [Call task file with httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2025-12-04 13:51:12.549221 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.046) 0:00:01.424 ***** 2025-12-04 13:51:12.597565 | controller | 2025-12-04 13:51:12.597663 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 13:51:12.597769 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.048) 0:00:01.473 ***** 2025-12-04 13:51:12.642726 | controller | ok: [instance] 2025-12-04 13:51:12.642833 | controller | 2025-12-04 13:51:12.642936 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 13:51:12.643089 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.045) 0:00:01.518 ***** 2025-12-04 13:51:12.677482 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:12.677587 | controller | assertion: _matched_url | default('') | length > 0 2025-12-04 13:51:12.677675 | controller | evaluated_to: false 2025-12-04 13:51:12.677802 | controller | msg: 'The cifmw_job_uri value provided is not valid: httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-04 13:51:12.708205 | controller | 2025-12-04 13:51:12.708301 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-04 13:51:12.708401 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.049) 0:00:01.568 ***** 2025-12-04 13:51:12.708509 | controller | 2025-12-04 13:51:12.708624 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-04 13:51:12.708699 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.016) 0:00:01.584 ***** 2025-12-04 13:51:12.750298 | controller | skipping: [instance] 2025-12-04 13:51:12.750385 | controller | 2025-12-04 13:51:12.750519 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-04 13:51:12.750610 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.042) 0:00:01.626 ***** 2025-12-04 13:51:12.792397 | controller | skipping: [instance] 2025-12-04 13:51:12.792500 | controller | 2025-12-04 13:51:12.792616 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log] *** 2025-12-04 13:51:12.792734 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.041) 0:00:01.668 ***** 2025-12-04 13:51:12.834307 | controller | 2025-12-04 13:51:12.834824 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 13:51:12.834929 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.042) 0:00:01.710 ***** 2025-12-04 13:51:12.873392 | controller | ok: [instance] 2025-12-04 13:51:12.873488 | controller | 2025-12-04 13:51:12.873588 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 13:51:12.873716 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.038) 0:00:01.749 ***** 2025-12-04 13:51:12.915699 | controller | ok: [instance] 2025-12-04 13:51:12.915881 | controller | 2025-12-04 13:51:12.916007 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 13:51:12.916031 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.042) 0:00:01.791 ***** 2025-12-04 13:51:12.959872 | controller | ok: [instance] 2025-12-04 13:51:12.959979 | controller | 2025-12-04 13:51:12.960071 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 13:51:12.960185 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.044) 0:00:01.836 ***** 2025-12-04 13:51:12.991289 | controller | skipping: [instance] 2025-12-04 13:51:12.991376 | controller | 2025-12-04 13:51:12.991508 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 13:51:12.991601 | controller | Thursday 04 December 2025 13:51:12 +0000 (0:00:00.031) 0:00:01.867 ***** 2025-12-04 13:51:13.032240 | controller | ok: [instance] => changed=false 2025-12-04 13:51:13.032341 | controller | msg: All assertions passed 2025-12-04 13:51:13.032443 | controller | 2025-12-04 13:51:13.032553 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/] *** 2025-12-04 13:51:13.032666 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.041) 0:00:01.908 ***** 2025-12-04 13:51:13.104226 | controller | 2025-12-04 13:51:13.104311 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 13:51:13.104408 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.071) 0:00:01.980 ***** 2025-12-04 13:51:13.150168 | controller | ok: [instance] 2025-12-04 13:51:13.150256 | controller | 2025-12-04 13:51:13.150377 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 13:51:13.150489 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.045) 0:00:02.026 ***** 2025-12-04 13:51:13.193850 | controller | ok: [instance] 2025-12-04 13:51:13.193939 | controller | 2025-12-04 13:51:13.194065 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-12-04 13:51:13.194149 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.043) 0:00:02.070 ***** 2025-12-04 13:51:13.238459 | controller | ok: [instance] 2025-12-04 13:51:13.238561 | controller | 2025-12-04 13:51:13.238707 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-12-04 13:51:13.238805 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.043) 0:00:02.114 ***** 2025-12-04 13:51:13.270370 | controller | skipping: [instance] 2025-12-04 13:51:13.270474 | controller | 2025-12-04 13:51:13.270579 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-12-04 13:51:13.270678 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.032) 0:00:02.146 ***** 2025-12-04 13:51:13.311590 | controller | ok: [instance] => changed=false 2025-12-04 13:51:13.311741 | controller | msg: All assertions passed 2025-12-04 13:51:13.311893 | controller | 2025-12-04 13:51:13.312071 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4] *** 2025-12-04 13:51:13.312210 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.041) 0:00:02.187 ***** 2025-12-04 13:51:13.351569 | controller | 2025-12-04 13:51:13.351681 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 13:51:13.351783 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.040) 0:00:02.227 ***** 2025-12-04 13:51:13.394527 | controller | ok: [instance] 2025-12-04 13:51:13.394629 | controller | 2025-12-04 13:51:13.394730 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 13:51:13.394828 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.042) 0:00:02.270 ***** 2025-12-04 13:51:13.424493 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:13.424608 | controller | assertion: _matched_url | default('') | length > 0 2025-12-04 13:51:13.424706 | controller | evaluated_to: false 2025-12-04 13:51:13.424816 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-04 13:51:13.453033 | controller | 2025-12-04 13:51:13.453129 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-04 13:51:13.453231 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.041) 0:00:02.312 ***** 2025-12-04 13:51:13.453330 | controller | 2025-12-04 13:51:13.453441 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-04 13:51:13.453538 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.017) 0:00:02.329 ***** 2025-12-04 13:51:13.487950 | controller | skipping: [instance] 2025-12-04 13:51:13.488077 | controller | 2025-12-04 13:51:13.488180 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-04 13:51:13.488276 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.035) 0:00:02.364 ***** 2025-12-04 13:51:13.520437 | controller | skipping: [instance] 2025-12-04 13:51:13.520528 | controller | 2025-12-04 13:51:13.520659 | controller | TASK [Call task file with /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a] *** 2025-12-04 13:51:13.520760 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.032) 0:00:02.396 ***** 2025-12-04 13:51:13.564384 | controller | 2025-12-04 13:51:13.564495 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-12-04 13:51:13.564606 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.043) 0:00:02.440 ***** 2025-12-04 13:51:13.601564 | controller | ok: [instance] 2025-12-04 13:51:13.601668 | controller | 2025-12-04 13:51:13.601771 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-12-04 13:51:13.601879 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.037) 0:00:02.477 ***** 2025-12-04 13:51:13.632763 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:13.632848 | controller | assertion: _matched_url | default('') | length > 0 2025-12-04 13:51:13.632935 | controller | evaluated_to: false 2025-12-04 13:51:13.633063 | controller | msg: 'The cifmw_job_uri value provided is not valid: /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-12-04 13:51:13.663370 | controller | 2025-12-04 13:51:13.663470 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-12-04 13:51:13.663883 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.045) 0:00:02.523 ***** 2025-12-04 13:51:13.707191 | controller | 2025-12-04 13:51:13.707212 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-12-04 13:51:13.707220 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.016) 0:00:02.539 ***** 2025-12-04 13:51:13.707229 | controller | skipping: [instance] 2025-12-04 13:51:13.707292 | controller | 2025-12-04 13:51:13.707391 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-12-04 13:51:13.707503 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.043) 0:00:02.583 ***** 2025-12-04 13:51:13.744824 | controller | skipping: [instance] 2025-12-04 13:51:13.744911 | controller | 2025-12-04 13:51:13.745036 | controller | TASK [Print success message] *************************************************** 2025-12-04 13:51:13.745143 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.037) 0:00:02.621 ***** 2025-12-04 13:51:13.839344 | controller | ok: [instance] => 2025-12-04 13:51:13.839435 | controller | msg: All strings passed! 2025-12-04 13:51:13.839527 | controller | 2025-12-04 13:51:13.839659 | controller | PLAY RECAP ********************************************************************* 2025-12-04 13:51:13.839772 | controller | instance : ok=39 changed=0 unreachable=0 failed=0 skipped=14 rescued=4 ignored=0 2025-12-04 13:51:13.839852 | controller | 2025-12-04 13:51:13.839950 | controller | Thursday 04 December 2025 13:51:13 +0000 (0:00:00.091) 0:00:02.712 ***** 2025-12-04 13:51:13.840059 | controller | =============================================================================== 2025-12-04 13:51:13.840150 | controller | Print success message --------------------------------------------------- 0.09s 2025-12-04 13:51:13.840240 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.08s 2025-12-04 13:51:13.840331 | controller | Call task file in loop -------------------------------------------------- 0.08s 2025-12-04 13:51:13.840441 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 --- 0.08s 2025-12-04 13:51:13.840536 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/ --- 0.07s 2025-12-04 13:51:13.840642 | controller | reproducer : Extract job id for later reference ------------------------- 0.06s 2025-12-04 13:51:13.840730 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.05s 2025-12-04 13:51:13.840818 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.05s 2025-12-04 13:51:13.840915 | controller | Call task file with httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 --- 0.05s 2025-12-04 13:51:13.841029 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.05s 2025-12-04 13:51:13.841131 | controller | Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7 --- 0.05s 2025-12-04 13:51:13.841221 | controller | Really fail if string failed but should have passed --------------------- 0.05s 2025-12-04 13:51:13.841341 | controller | Really fail if string passed but should have failed --------------------- 0.05s 2025-12-04 13:51:13.841398 | controller | reproducer : Apply regex match filter ----------------------------------- 0.05s 2025-12-04 13:51:13.841499 | controller | reproducer : Apply regex match filter ----------------------------------- 0.05s 2025-12-04 13:51:13.841615 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7 --- 0.05s 2025-12-04 13:51:13.841693 | controller | reproducer : Apply regex match filter ----------------------------------- 0.05s 2025-12-04 13:51:13.841927 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.05s 2025-12-04 13:51:13.841946 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.05s 2025-12-04 13:51:13.841983 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.05s 2025-12-04 13:51:13.932388 | controller | INFO Running job_uri > cleanup 2025-12-04 13:51:13.932796 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-04 13:51:13.940204 | controller | INFO Running network_validations > prepare 2025-12-04 13:51:13.940594 | controller | WARNING Skipping, prepare playbook not configured. 2025-12-04 13:51:13.948249 | controller | INFO Running network_validations > converge 2025-12-04 13:51:14.374928 | controller | 2025-12-04 13:51:14.375088 | controller | PLAY [Prepare] ***************************************************************** 2025-12-04 13:51:14.375189 | controller | 2025-12-04 13:51:14.375300 | controller | TASK [Set failed fact] ********************************************************* 2025-12-04 13:51:14.375407 | controller | Thursday 04 December 2025 13:51:14 +0000 (0:00:00.031) 0:00:00.031 ***** 2025-12-04 13:51:14.403709 | controller | ok: [instance] 2025-12-04 13:51:14.403789 | controller | 2025-12-04 13:51:14.403896 | controller | TASK [Load scenarios] ********************************************************** 2025-12-04 13:51:14.403999 | controller | Thursday 04 December 2025 13:51:14 +0000 (0:00:00.029) 0:00:00.061 ***** 2025-12-04 13:51:14.436834 | controller | ok: [instance] 2025-12-04 13:51:14.436940 | controller | 2025-12-04 13:51:14.437044 | controller | TASK [Test network validations] ************************************************ 2025-12-04 13:51:14.437155 | controller | Thursday 04 December 2025 13:51:14 +0000 (0:00:00.033) 0:00:00.094 ***** 2025-12-04 13:51:14.501597 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets only) 2025-12-04 13:51:14.501728 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets and spine/leaf) 2025-12-04 13:51:14.501828 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets with extra defined net) 2025-12-04 13:51:14.501930 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing default net definition) 2025-12-04 13:51:14.502058 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing spine/leaf net definition) 2025-12-04 13:51:14.502154 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=No network for a VM) 2025-12-04 13:51:14.502235 | controller | 2025-12-04 13:51:14.502325 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:14.502420 | controller | Thursday 04 December 2025 13:51:14 +0000 (0:00:00.064) 0:00:00.159 ***** 2025-12-04 13:51:14.529484 | controller | ok: [instance] 2025-12-04 13:51:14.529593 | controller | 2025-12-04 13:51:14.529736 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:14.529833 | controller | Thursday 04 December 2025 13:51:14 +0000 (0:00:00.027) 0:00:00.186 ***** 2025-12-04 13:51:14.559355 | controller | ok: [instance] 2025-12-04 13:51:14.559457 | controller | 2025-12-04 13:51:14.559568 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:14.559683 | controller | Thursday 04 December 2025 13:51:14 +0000 (0:00:00.030) 0:00:00.216 ***** 2025-12-04 13:51:14.585736 | controller | ok: [instance] => 2025-12-04 13:51:14.585835 | controller | msg: 'Running: Default nets only' 2025-12-04 13:51:14.585941 | controller | 2025-12-04 13:51:14.586326 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:14.586474 | controller | Thursday 04 December 2025 13:51:14 +0000 (0:00:00.026) 0:00:00.243 ***** 2025-12-04 13:51:14.647819 | controller | 2025-12-04 13:51:14.647925 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 13:51:14.648061 | controller | Thursday 04 December 2025 13:51:14 +0000 (0:00:00.061) 0:00:00.305 ***** 2025-12-04 13:51:14.694274 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 13:51:14.694298 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 13:51:14.694375 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 13:51:14.694502 | controller | collisions and unexpected behavior. 2025-12-04 13:51:14.740984 | controller | ok: [instance] => (item=controller) 2025-12-04 13:51:14.741104 | controller | 2025-12-04 13:51:14.741223 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 13:51:14.741340 | controller | Thursday 04 December 2025 13:51:14 +0000 (0:00:00.093) 0:00:00.398 ***** 2025-12-04 13:51:14.805202 | controller | ok: [instance] 2025-12-04 13:51:14.805273 | controller | 2025-12-04 13:51:14.805376 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-04 13:51:14.805491 | controller | Thursday 04 December 2025 13:51:14 +0000 (0:00:00.064) 0:00:00.462 ***** 2025-12-04 13:51:14.875082 | controller | ok: [instance] => changed=false 2025-12-04 13:51:14.875181 | controller | msg: All assertions passed 2025-12-04 13:51:14.875283 | controller | 2025-12-04 13:51:14.875389 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:14.875515 | controller | Thursday 04 December 2025 13:51:14 +0000 (0:00:00.069) 0:00:00.532 ***** 2025-12-04 13:51:14.926901 | controller | skipping: [instance] 2025-12-04 13:51:14.927023 | controller | 2025-12-04 13:51:14.927152 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:14.927241 | controller | Thursday 04 December 2025 13:51:14 +0000 (0:00:00.050) 0:00:00.583 ***** 2025-12-04 13:51:14.964814 | controller | skipping: [instance] 2025-12-04 13:51:14.964912 | controller | 2025-12-04 13:51:14.965049 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:14.965166 | controller | Thursday 04 December 2025 13:51:14 +0000 (0:00:00.038) 0:00:00.622 ***** 2025-12-04 13:51:15.010337 | controller | skipping: [instance] 2025-12-04 13:51:15.010435 | controller | 2025-12-04 13:51:15.010548 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:15.010674 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.045) 0:00:00.667 ***** 2025-12-04 13:51:15.036239 | controller | ok: [instance] 2025-12-04 13:51:15.036324 | controller | 2025-12-04 13:51:15.036419 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:15.036534 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.026) 0:00:00.694 ***** 2025-12-04 13:51:15.067445 | controller | ok: [instance] 2025-12-04 13:51:15.067529 | controller | 2025-12-04 13:51:15.067634 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:15.067728 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.031) 0:00:00.725 ***** 2025-12-04 13:51:15.100015 | controller | ok: [instance] => 2025-12-04 13:51:15.100120 | controller | msg: 'Running: Default nets and spine/leaf' 2025-12-04 13:51:15.100201 | controller | 2025-12-04 13:51:15.100302 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:15.100392 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.032) 0:00:00.757 ***** 2025-12-04 13:51:15.144277 | controller | 2025-12-04 13:51:15.144379 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 13:51:15.144485 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.044) 0:00:00.802 ***** 2025-12-04 13:51:15.175094 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 13:51:15.194743 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 13:51:15.194775 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 13:51:15.194783 | controller | collisions and unexpected behavior. 2025-12-04 13:51:15.194793 | controller | ok: [instance] => (item=controller) 2025-12-04 13:51:15.250817 | controller | 2025-12-04 13:51:15.250848 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 13:51:15.250857 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.049) 0:00:00.852 ***** 2025-12-04 13:51:15.250868 | controller | ok: [instance] 2025-12-04 13:51:15.314346 | controller | 2025-12-04 13:51:15.314380 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-04 13:51:15.314391 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.056) 0:00:00.908 ***** 2025-12-04 13:51:15.314404 | controller | ok: [instance] => changed=false 2025-12-04 13:51:15.360364 | controller | msg: All assertions passed 2025-12-04 13:51:15.360459 | controller | 2025-12-04 13:51:15.360469 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:15.360476 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.063) 0:00:00.971 ***** 2025-12-04 13:51:15.360515 | controller | skipping: [instance] 2025-12-04 13:51:15.360536 | controller | 2025-12-04 13:51:15.360616 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:15.360625 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.046) 0:00:01.017 ***** 2025-12-04 13:51:15.407790 | controller | skipping: [instance] 2025-12-04 13:51:15.407862 | controller | 2025-12-04 13:51:15.407979 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:15.408078 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.047) 0:00:01.065 ***** 2025-12-04 13:51:15.454255 | controller | skipping: [instance] 2025-12-04 13:51:15.454346 | controller | 2025-12-04 13:51:15.454479 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:15.454608 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.043) 0:00:01.108 ***** 2025-12-04 13:51:15.484565 | controller | ok: [instance] 2025-12-04 13:51:15.484661 | controller | 2025-12-04 13:51:15.484782 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:15.484890 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.033) 0:00:01.142 ***** 2025-12-04 13:51:15.519518 | controller | ok: [instance] 2025-12-04 13:51:15.519633 | controller | 2025-12-04 13:51:15.519746 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:15.519863 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.034) 0:00:01.177 ***** 2025-12-04 13:51:15.551810 | controller | ok: [instance] => 2025-12-04 13:51:15.551920 | controller | msg: 'Running: Default nets with extra defined net' 2025-12-04 13:51:15.552068 | controller | 2025-12-04 13:51:15.552174 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:15.552292 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.032) 0:00:01.209 ***** 2025-12-04 13:51:15.598895 | controller | 2025-12-04 13:51:15.598992 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 13:51:15.599114 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.047) 0:00:01.256 ***** 2025-12-04 13:51:15.669376 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 13:51:15.669497 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 13:51:15.669598 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 13:51:15.670088 | controller | collisions and unexpected behavior. 2025-12-04 13:51:15.681629 | controller | ok: [instance] => (item=controller) 2025-12-04 13:51:15.681715 | controller | 2025-12-04 13:51:15.681801 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 13:51:15.681904 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.082) 0:00:01.339 ***** 2025-12-04 13:51:15.737341 | controller | ok: [instance] 2025-12-04 13:51:15.737432 | controller | 2025-12-04 13:51:15.737547 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-04 13:51:15.737689 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.055) 0:00:01.394 ***** 2025-12-04 13:51:15.786264 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:15.786375 | controller | assertion: _defined | difference(_all_nets) | length == 0 2025-12-04 13:51:15.786500 | controller | evaluated_to: false 2025-12-04 13:51:15.786628 | controller | msg: 'Inconsistency detected: ensure you''re attaching all of the defined networks. Those nets don''t seem to be attached: [''extra_net_1'']' 2025-12-04 13:51:15.801566 | controller | 2025-12-04 13:51:15.801691 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-04 13:51:15.801793 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.064) 0:00:01.458 ***** 2025-12-04 13:51:15.838904 | controller | ok: [instance] => 2025-12-04 13:51:15.839023 | controller | cifmw_libvirt_manager_configuration: 2025-12-04 13:51:15.839115 | controller | networks: 2025-12-04 13:51:15.839215 | controller | public: defined 2025-12-04 13:51:15.839316 | controller | vms: 2025-12-04 13:51:15.839400 | controller | controller: 2025-12-04 13:51:15.839504 | controller | nets: 2025-12-04 13:51:15.839603 | controller | - public 2025-12-04 13:51:15.839675 | controller | 2025-12-04 13:51:15.839774 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-04 13:51:15.839870 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.037) 0:00:01.496 ***** 2025-12-04 13:51:15.869535 | controller | skipping: [instance] 2025-12-04 13:51:15.869627 | controller | 2025-12-04 13:51:15.869726 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-04 13:51:15.869832 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.031) 0:00:01.527 ***** 2025-12-04 13:51:15.945675 | controller | skipping: [instance] 2025-12-04 13:51:15.945781 | controller | 2025-12-04 13:51:15.945893 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-04 13:51:15.946053 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.075) 0:00:01.602 ***** 2025-12-04 13:51:15.993449 | controller | ok: [instance] => 2025-12-04 13:51:15.993545 | controller | _cifmw_libvirt_manager_layout: 2025-12-04 13:51:15.993661 | controller | networks: 2025-12-04 13:51:15.993763 | controller | extra_net_1: defined 2025-12-04 13:51:15.993863 | controller | public: defined 2025-12-04 13:51:15.993984 | controller | vms: 2025-12-04 13:51:15.994079 | controller | controller: 2025-12-04 13:51:15.994176 | controller | nets: 2025-12-04 13:51:15.994270 | controller | - public 2025-12-04 13:51:15.994359 | controller | 2025-12-04 13:51:15.994474 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-04 13:51:15.994576 | controller | Thursday 04 December 2025 13:51:15 +0000 (0:00:00.047) 0:00:01.650 ***** 2025-12-04 13:51:16.011995 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:16.040984 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-04 13:51:16.041016 | controller | 2025-12-04 13:51:16.041100 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 13:51:16.041222 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.029) 0:00:01.680 ***** 2025-12-04 13:51:16.041302 | controller | 2025-12-04 13:51:16.041403 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:16.041541 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.017) 0:00:01.698 ***** 2025-12-04 13:51:16.067689 | controller | ok: [instance] 2025-12-04 13:51:16.067799 | controller | 2025-12-04 13:51:16.067906 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:16.068039 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.027) 0:00:01.725 ***** 2025-12-04 13:51:16.113697 | controller | skipping: [instance] 2025-12-04 13:51:16.113783 | controller | 2025-12-04 13:51:16.113892 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:16.114031 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.045) 0:00:01.771 ***** 2025-12-04 13:51:16.152813 | controller | skipping: [instance] 2025-12-04 13:51:16.152910 | controller | 2025-12-04 13:51:16.153062 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:16.153157 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.039) 0:00:01.810 ***** 2025-12-04 13:51:16.198276 | controller | skipping: [instance] 2025-12-04 13:51:16.198359 | controller | 2025-12-04 13:51:16.198491 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:16.198613 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.045) 0:00:01.855 ***** 2025-12-04 13:51:16.223473 | controller | ok: [instance] 2025-12-04 13:51:16.223565 | controller | 2025-12-04 13:51:16.223701 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:16.223813 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.025) 0:00:01.881 ***** 2025-12-04 13:51:16.255820 | controller | ok: [instance] 2025-12-04 13:51:16.255914 | controller | 2025-12-04 13:51:16.256062 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:16.256161 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.032) 0:00:01.913 ***** 2025-12-04 13:51:16.294165 | controller | ok: [instance] => 2025-12-04 13:51:16.294263 | controller | msg: 'Running: Missing default net definition' 2025-12-04 13:51:16.294361 | controller | 2025-12-04 13:51:16.294482 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:16.294587 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.038) 0:00:01.951 ***** 2025-12-04 13:51:16.342564 | controller | 2025-12-04 13:51:16.342688 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 13:51:16.342795 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.048) 0:00:02.000 ***** 2025-12-04 13:51:16.376771 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 13:51:16.376912 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 13:51:16.376935 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 13:51:16.376983 | controller | collisions and unexpected behavior. 2025-12-04 13:51:16.401386 | controller | ok: [instance] => (item=controller) 2025-12-04 13:51:16.401486 | controller | 2025-12-04 13:51:16.401611 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 13:51:16.401726 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.058) 0:00:02.058 ***** 2025-12-04 13:51:16.454020 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:16.454154 | controller | assertion: _all_nets | difference(_defined) | length == 0 2025-12-04 13:51:16.454246 | controller | evaluated_to: false 2025-12-04 13:51:16.454370 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''foo'']' 2025-12-04 13:51:16.466566 | controller | 2025-12-04 13:51:16.466705 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-04 13:51:16.466848 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.064) 0:00:02.123 ***** 2025-12-04 13:51:16.508871 | controller | ok: [instance] => 2025-12-04 13:51:16.508980 | controller | cifmw_libvirt_manager_configuration: 2025-12-04 13:51:16.509096 | controller | networks: 2025-12-04 13:51:16.509195 | controller | public: defined 2025-12-04 13:51:16.509294 | controller | vms: 2025-12-04 13:51:16.509390 | controller | controller: 2025-12-04 13:51:16.509502 | controller | nets: 2025-12-04 13:51:16.509601 | controller | - public 2025-12-04 13:51:16.509692 | controller | 2025-12-04 13:51:16.509793 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-04 13:51:16.509892 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.042) 0:00:02.166 ***** 2025-12-04 13:51:16.549702 | controller | skipping: [instance] 2025-12-04 13:51:16.549928 | controller | 2025-12-04 13:51:16.550009 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-04 13:51:16.550027 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.040) 0:00:02.207 ***** 2025-12-04 13:51:16.726541 | controller | skipping: [instance] 2025-12-04 13:51:16.726635 | controller | 2025-12-04 13:51:16.726755 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-04 13:51:16.726771 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.175) 0:00:02.383 ***** 2025-12-04 13:51:16.772408 | controller | ok: [instance] => 2025-12-04 13:51:16.772519 | controller | _cifmw_libvirt_manager_layout: 2025-12-04 13:51:16.772661 | controller | networks: 2025-12-04 13:51:16.772750 | controller | public: defined 2025-12-04 13:51:16.772851 | controller | vms: 2025-12-04 13:51:16.772950 | controller | controller: 2025-12-04 13:51:16.773091 | controller | nets: 2025-12-04 13:51:16.773192 | controller | - public 2025-12-04 13:51:16.773400 | controller | - foo 2025-12-04 13:51:16.773461 | controller | 2025-12-04 13:51:16.773471 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-04 13:51:16.773809 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.046) 0:00:02.430 ***** 2025-12-04 13:51:16.786001 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:16.786105 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-04 13:51:16.813818 | controller | 2025-12-04 13:51:16.813895 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 13:51:16.814041 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.024) 0:00:02.454 ***** 2025-12-04 13:51:16.814128 | controller | 2025-12-04 13:51:16.814263 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:16.814365 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.017) 0:00:02.471 ***** 2025-12-04 13:51:16.840115 | controller | ok: [instance] 2025-12-04 13:51:16.840203 | controller | 2025-12-04 13:51:16.840312 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:16.840413 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.026) 0:00:02.497 ***** 2025-12-04 13:51:16.887192 | controller | skipping: [instance] 2025-12-04 13:51:16.887246 | controller | 2025-12-04 13:51:16.887391 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:16.887511 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.046) 0:00:02.544 ***** 2025-12-04 13:51:16.929041 | controller | skipping: [instance] 2025-12-04 13:51:16.929117 | controller | 2025-12-04 13:51:16.929184 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:16.929294 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.041) 0:00:02.586 ***** 2025-12-04 13:51:16.970684 | controller | skipping: [instance] 2025-12-04 13:51:16.970753 | controller | 2025-12-04 13:51:16.970867 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:16.970998 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.041) 0:00:02.628 ***** 2025-12-04 13:51:17.000236 | controller | ok: [instance] 2025-12-04 13:51:17.000328 | controller | 2025-12-04 13:51:17.000442 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:17.000549 | controller | Thursday 04 December 2025 13:51:16 +0000 (0:00:00.029) 0:00:02.657 ***** 2025-12-04 13:51:17.032976 | controller | ok: [instance] 2025-12-04 13:51:17.033054 | controller | 2025-12-04 13:51:17.033162 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:17.033262 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.032) 0:00:02.690 ***** 2025-12-04 13:51:17.064383 | controller | ok: [instance] => 2025-12-04 13:51:17.064508 | controller | msg: 'Running: Missing spine/leaf net definition' 2025-12-04 13:51:17.064620 | controller | 2025-12-04 13:51:17.064739 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:17.064844 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.031) 0:00:02.722 ***** 2025-12-04 13:51:17.107840 | controller | 2025-12-04 13:51:17.107943 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 13:51:17.108074 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.043) 0:00:02.765 ***** 2025-12-04 13:51:17.136500 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 13:51:17.136732 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 13:51:17.136872 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 13:51:17.136901 | controller | collisions and unexpected behavior. 2025-12-04 13:51:17.160541 | controller | ok: [instance] => (item=controller) 2025-12-04 13:51:17.160655 | controller | 2025-12-04 13:51:17.160779 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-04 13:51:17.160886 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.052) 0:00:02.818 ***** 2025-12-04 13:51:17.214280 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:17.214372 | controller | assertion: _all_nets | difference(_defined) | length == 0 2025-12-04 13:51:17.214669 | controller | evaluated_to: false 2025-12-04 13:51:17.214683 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''l00-s1'']' 2025-12-04 13:51:17.226562 | controller | 2025-12-04 13:51:17.226773 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-04 13:51:17.226810 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.065) 0:00:02.883 ***** 2025-12-04 13:51:17.269083 | controller | ok: [instance] => 2025-12-04 13:51:17.269165 | controller | cifmw_libvirt_manager_configuration: 2025-12-04 13:51:17.269271 | controller | networks: 2025-12-04 13:51:17.269392 | controller | l00-s0: defined 2025-12-04 13:51:17.269503 | controller | public: defined 2025-12-04 13:51:17.269597 | controller | vms: 2025-12-04 13:51:17.269698 | controller | controller: 2025-12-04 13:51:17.269790 | controller | nets: 2025-12-04 13:51:17.269876 | controller | - public 2025-12-04 13:51:17.269994 | controller | spineleafnets: 2025-12-04 13:51:17.270094 | controller | - l00-s0 2025-12-04 13:51:17.270193 | controller | 2025-12-04 13:51:17.270293 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-04 13:51:17.270391 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.042) 0:00:02.926 ***** 2025-12-04 13:51:17.302750 | controller | skipping: [instance] 2025-12-04 13:51:17.303059 | controller | 2025-12-04 13:51:17.386746 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-04 13:51:17.386825 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.033) 0:00:02.960 ***** 2025-12-04 13:51:17.386844 | controller | skipping: [instance] 2025-12-04 13:51:17.386896 | controller | 2025-12-04 13:51:17.386910 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-04 13:51:17.387049 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.084) 0:00:03.044 ***** 2025-12-04 13:51:17.439194 | controller | ok: [instance] => 2025-12-04 13:51:17.439261 | controller | _cifmw_libvirt_manager_layout: 2025-12-04 13:51:17.439383 | controller | networks: 2025-12-04 13:51:17.439498 | controller | l00-s0: defined 2025-12-04 13:51:17.439598 | controller | public: defined 2025-12-04 13:51:17.439704 | controller | vms: 2025-12-04 13:51:17.439794 | controller | controller: 2025-12-04 13:51:17.439888 | controller | nets: 2025-12-04 13:51:17.439992 | controller | - public 2025-12-04 13:51:17.440119 | controller | spineleafnets: 2025-12-04 13:51:17.440204 | controller | - l00-s0 2025-12-04 13:51:17.440295 | controller | - l00-s1 2025-12-04 13:51:17.440386 | controller | 2025-12-04 13:51:17.440498 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-04 13:51:17.440619 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.052) 0:00:03.096 ***** 2025-12-04 13:51:17.458612 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:17.458774 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-04 13:51:17.489385 | controller | 2025-12-04 13:51:17.489550 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 13:51:17.489687 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.034) 0:00:03.130 ***** 2025-12-04 13:51:17.489815 | controller | 2025-12-04 13:51:17.489954 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:17.490110 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.016) 0:00:03.146 ***** 2025-12-04 13:51:17.516183 | controller | ok: [instance] 2025-12-04 13:51:17.516305 | controller | 2025-12-04 13:51:17.516450 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:17.516586 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.027) 0:00:03.173 ***** 2025-12-04 13:51:17.560017 | controller | skipping: [instance] 2025-12-04 13:51:17.560065 | controller | 2025-12-04 13:51:17.560169 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:17.560257 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.043) 0:00:03.217 ***** 2025-12-04 13:51:17.658644 | controller | skipping: [instance] 2025-12-04 13:51:17.658711 | controller | 2025-12-04 13:51:17.658772 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:17.658888 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.098) 0:00:03.316 ***** 2025-12-04 13:51:17.701495 | controller | skipping: [instance] 2025-12-04 13:51:17.701544 | controller | 2025-12-04 13:51:17.701667 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:17.701782 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.042) 0:00:03.359 ***** 2025-12-04 13:51:17.727679 | controller | ok: [instance] 2025-12-04 13:51:17.727744 | controller | 2025-12-04 13:51:17.727878 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:17.727969 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.026) 0:00:03.385 ***** 2025-12-04 13:51:17.758649 | controller | ok: [instance] 2025-12-04 13:51:17.758758 | controller | 2025-12-04 13:51:17.758935 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:17.790036 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.030) 0:00:03.416 ***** 2025-12-04 13:51:17.790120 | controller | ok: [instance] => 2025-12-04 13:51:17.790224 | controller | msg: 'Running: No network for a VM' 2025-12-04 13:51:17.790235 | controller | 2025-12-04 13:51:17.790392 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:17.790559 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.030) 0:00:03.446 ***** 2025-12-04 13:51:17.844783 | controller | 2025-12-04 13:51:17.844889 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-04 13:51:17.844993 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.055) 0:00:03.502 ***** 2025-12-04 13:51:17.879779 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-12-04 13:51:17.879883 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-12-04 13:51:17.880058 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-12-04 13:51:17.880146 | controller | collisions and unexpected behavior. 2025-12-04 13:51:17.895308 | controller | failed: [instance] (item=foo) => changed=false 2025-12-04 13:51:17.895394 | controller | ansible_loop_var: item 2025-12-04 13:51:17.895404 | controller | assertion: item.value.nets is defined 2025-12-04 13:51:17.895414 | controller | evaluated_to: false 2025-12-04 13:51:17.895526 | controller | item: 2025-12-04 13:51:17.895722 | controller | key: foo 2025-12-04 13:51:17.895815 | controller | value: 2025-12-04 13:51:17.895826 | controller | disksize: 10 2025-12-04 13:51:17.895937 | controller | msg: 'Inconsistency detected: VM type "foo" doesn''t seem to have any network.' 2025-12-04 13:51:17.908472 | controller | ok: [instance] => (item=controller) 2025-12-04 13:51:17.908562 | controller | 2025-12-04 13:51:17.908663 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-12-04 13:51:17.908777 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.063) 0:00:03.566 ***** 2025-12-04 13:51:17.949401 | controller | ok: [instance] => 2025-12-04 13:51:17.949508 | controller | cifmw_libvirt_manager_configuration: 2025-12-04 13:51:17.949658 | controller | networks: 2025-12-04 13:51:17.949761 | controller | public: defined 2025-12-04 13:51:17.949859 | controller | vms: 2025-12-04 13:51:17.949979 | controller | controller: 2025-12-04 13:51:17.950074 | controller | nets: 2025-12-04 13:51:17.950175 | controller | - public 2025-12-04 13:51:17.950266 | controller | 2025-12-04 13:51:17.950366 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-12-04 13:51:17.950478 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.040) 0:00:03.606 ***** 2025-12-04 13:51:17.984533 | controller | skipping: [instance] 2025-12-04 13:51:17.984652 | controller | 2025-12-04 13:51:17.984763 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-12-04 13:51:17.984872 | controller | Thursday 04 December 2025 13:51:17 +0000 (0:00:00.035) 0:00:03.642 ***** 2025-12-04 13:51:18.059211 | controller | skipping: [instance] 2025-12-04 13:51:18.059321 | controller | 2025-12-04 13:51:18.059458 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-12-04 13:51:18.059618 | controller | Thursday 04 December 2025 13:51:18 +0000 (0:00:00.074) 0:00:03.716 ***** 2025-12-04 13:51:18.101640 | controller | ok: [instance] => 2025-12-04 13:51:18.101735 | controller | _cifmw_libvirt_manager_layout: 2025-12-04 13:51:18.101854 | controller | networks: 2025-12-04 13:51:18.101987 | controller | public: defined 2025-12-04 13:51:18.102122 | controller | vms: 2025-12-04 13:51:18.102214 | controller | controller: 2025-12-04 13:51:18.102307 | controller | nets: 2025-12-04 13:51:18.102411 | controller | - public 2025-12-04 13:51:18.102508 | controller | foo: 2025-12-04 13:51:18.102613 | controller | disksize: 10 2025-12-04 13:51:18.102698 | controller | 2025-12-04 13:51:18.102806 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-12-04 13:51:18.102896 | controller | Thursday 04 December 2025 13:51:18 +0000 (0:00:00.042) 0:00:03.759 ***** 2025-12-04 13:51:18.116008 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:18.116109 | controller | msg: Error detected, please check assertions and debugging output above. 2025-12-04 13:51:18.144214 | controller | 2025-12-04 13:51:18.144344 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 13:51:18.144449 | controller | Thursday 04 December 2025 13:51:18 +0000 (0:00:00.024) 0:00:03.784 ***** 2025-12-04 13:51:18.144558 | controller | 2025-12-04 13:51:18.144676 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:18.144785 | controller | Thursday 04 December 2025 13:51:18 +0000 (0:00:00.017) 0:00:03.801 ***** 2025-12-04 13:51:18.171113 | controller | ok: [instance] 2025-12-04 13:51:18.171219 | controller | 2025-12-04 13:51:18.171348 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:18.171448 | controller | Thursday 04 December 2025 13:51:18 +0000 (0:00:00.026) 0:00:03.828 ***** 2025-12-04 13:51:18.211742 | controller | skipping: [instance] 2025-12-04 13:51:18.211827 | controller | 2025-12-04 13:51:18.211972 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:18.212066 | controller | Thursday 04 December 2025 13:51:18 +0000 (0:00:00.040) 0:00:03.869 ***** 2025-12-04 13:51:18.245876 | controller | skipping: [instance] 2025-12-04 13:51:18.246032 | controller | 2025-12-04 13:51:18.246248 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:18.246369 | controller | Thursday 04 December 2025 13:51:18 +0000 (0:00:00.034) 0:00:03.903 ***** 2025-12-04 13:51:18.290108 | controller | skipping: [instance] 2025-12-04 13:51:18.290165 | controller | 2025-12-04 13:51:18.290270 | controller | TASK [Fail if needed] ********************************************************** 2025-12-04 13:51:18.290380 | controller | Thursday 04 December 2025 13:51:18 +0000 (0:00:00.044) 0:00:03.947 ***** 2025-12-04 13:51:18.358819 | controller | skipping: [instance] 2025-12-04 13:51:18.358895 | controller | 2025-12-04 13:51:18.359035 | controller | PLAY RECAP ********************************************************************* 2025-12-04 13:51:18.359146 | controller | instance : ok=48 changed=0 unreachable=0 failed=0 skipped=27 rescued=8 ignored=0 2025-12-04 13:51:18.359847 | controller | 2025-12-04 13:51:18.360011 | controller | Thursday 04 December 2025 13:51:18 +0000 (0:00:00.068) 0:00:04.016 ***** 2025-12-04 13:51:18.360041 | controller | =============================================================================== 2025-12-04 13:51:18.360053 | controller | reproducer : Dump layout patches ---------------------------------------- 0.18s 2025-12-04 13:51:18.360061 | controller | Display error message --------------------------------------------------- 0.10s 2025-12-04 13:51:18.360067 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.09s 2025-12-04 13:51:18.360077 | controller | reproducer : Dump layout patches ---------------------------------------- 0.08s 2025-12-04 13:51:18.360189 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.08s 2025-12-04 13:51:18.360200 | controller | reproducer : Dump layout patches ---------------------------------------- 0.08s 2025-12-04 13:51:18.360209 | controller | reproducer : Dump layout patches ---------------------------------------- 0.07s 2025-12-04 13:51:18.360218 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.07s 2025-12-04 13:51:18.360291 | controller | Fail if needed ---------------------------------------------------------- 0.07s 2025-12-04 13:51:18.360385 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.07s 2025-12-04 13:51:18.360528 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-12-04 13:51:18.360848 | controller | Test network validations ------------------------------------------------ 0.06s 2025-12-04 13:51:18.360875 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2025-12-04 13:51:18.361119 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-12-04 13:51:18.361134 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.06s 2025-12-04 13:51:18.361186 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.06s 2025-12-04 13:51:18.361288 | controller | Validate data ----------------------------------------------------------- 0.06s 2025-12-04 13:51:18.361382 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.06s 2025-12-04 13:51:18.361487 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-12-04 13:51:18.361590 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-12-04 13:51:18.466940 | controller | INFO Running network_validations > cleanup 2025-12-04 13:51:18.467386 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-04 13:51:18.474817 | controller | INFO Running ocp_validations > prepare 2025-12-04 13:51:18.475225 | controller | WARNING Skipping, prepare playbook not configured. 2025-12-04 13:51:18.483162 | controller | INFO Running ocp_validations > converge 2025-12-04 13:51:18.953480 | controller | 2025-12-04 13:51:18.953534 | controller | PLAY [Prepare] ***************************************************************** 2025-12-04 13:51:18.953632 | controller | 2025-12-04 13:51:18.953717 | controller | TASK [Set failed fact] ********************************************************* 2025-12-04 13:51:18.953816 | controller | Thursday 04 December 2025 13:51:18 +0000 (0:00:00.033) 0:00:00.033 ***** 2025-12-04 13:51:18.977712 | controller | ok: [instance] 2025-12-04 13:51:18.977741 | controller | 2025-12-04 13:51:18.977849 | controller | TASK [Load scenarios] ********************************************************** 2025-12-04 13:51:18.977912 | controller | Thursday 04 December 2025 13:51:18 +0000 (0:00:00.024) 0:00:00.057 ***** 2025-12-04 13:51:19.008452 | controller | ok: [instance] 2025-12-04 13:51:19.008534 | controller | 2025-12-04 13:51:19.008645 | controller | TASK [Test no volumes] ********************************************************* 2025-12-04 13:51:19.008741 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.030) 0:00:00.088 ***** 2025-12-04 13:51:19.108617 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, no worker) 2025-12-04 13:51:19.108715 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, with worker) 2025-12-04 13:51:19.108813 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, no worker) 2025-12-04 13:51:19.108929 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, with worker) 2025-12-04 13:51:19.109033 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Too many allocated volumes) 2025-12-04 13:51:19.109134 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Different volume amount) 2025-12-04 13:51:19.109221 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVM without volume) 2025-12-04 13:51:19.109326 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVMS without volume) 2025-12-04 13:51:19.109438 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice) 2025-12-04 13:51:19.109565 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no LVMS) 2025-12-04 13:51:19.109671 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no cinder_lvm) 2025-12-04 13:51:19.109774 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Config overrides via devscripts) 2025-12-04 13:51:19.109879 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 10 dev-scripts extra_worker) 2025-12-04 13:51:19.110007 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 0 dev-scripts extra_worker) 2025-12-04 13:51:19.110094 | controller | 2025-12-04 13:51:19.110197 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:19.110292 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.099) 0:00:00.188 ***** 2025-12-04 13:51:19.134149 | controller | ok: [instance] 2025-12-04 13:51:19.134227 | controller | 2025-12-04 13:51:19.134329 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:19.134438 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.025) 0:00:00.214 ***** 2025-12-04 13:51:19.164060 | controller | ok: [instance] 2025-12-04 13:51:19.164111 | controller | 2025-12-04 13:51:19.164236 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:19.164336 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.029) 0:00:00.243 ***** 2025-12-04 13:51:19.196170 | controller | ok: [instance] => 2025-12-04 13:51:19.196261 | controller | msg: 'Running: No volume, no worker' 2025-12-04 13:51:19.196368 | controller | 2025-12-04 13:51:19.196480 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:19.196602 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.032) 0:00:00.276 ***** 2025-12-04 13:51:19.274313 | controller | 2025-12-04 13:51:19.274402 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 13:51:19.274516 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.078) 0:00:00.354 ***** 2025-12-04 13:51:19.337624 | controller | ok: [instance] 2025-12-04 13:51:19.337734 | controller | 2025-12-04 13:51:19.337833 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 13:51:19.337935 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.063) 0:00:00.417 ***** 2025-12-04 13:51:19.384439 | controller | ok: [instance] 2025-12-04 13:51:19.384530 | controller | 2025-12-04 13:51:19.384651 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 13:51:19.384764 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.046) 0:00:00.464 ***** 2025-12-04 13:51:19.459027 | controller | ok: [instance] 2025-12-04 13:51:19.459111 | controller | 2025-12-04 13:51:19.459216 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 13:51:19.459333 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.074) 0:00:00.538 ***** 2025-12-04 13:51:19.503324 | controller | skipping: [instance] 2025-12-04 13:51:19.503421 | controller | 2025-12-04 13:51:19.503529 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 13:51:19.503635 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.044) 0:00:00.583 ***** 2025-12-04 13:51:19.558721 | controller | ok: [instance] 2025-12-04 13:51:19.558831 | controller | 2025-12-04 13:51:19.558943 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 13:51:19.559059 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.055) 0:00:00.638 ***** 2025-12-04 13:51:19.604772 | controller | skipping: [instance] 2025-12-04 13:51:19.604844 | controller | 2025-12-04 13:51:19.604943 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 13:51:19.605057 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.046) 0:00:00.684 ***** 2025-12-04 13:51:19.649346 | controller | skipping: [instance] 2025-12-04 13:51:19.649476 | controller | 2025-12-04 13:51:19.649558 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 13:51:19.649732 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.044) 0:00:00.729 ***** 2025-12-04 13:51:19.696075 | controller | skipping: [instance] 2025-12-04 13:51:19.696159 | controller | 2025-12-04 13:51:19.696306 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 13:51:19.696421 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.046) 0:00:00.776 ***** 2025-12-04 13:51:19.743114 | controller | skipping: [instance] 2025-12-04 13:51:19.743201 | controller | 2025-12-04 13:51:19.743297 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 13:51:19.743400 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.047) 0:00:00.823 ***** 2025-12-04 13:51:19.792164 | controller | skipping: [instance] 2025-12-04 13:51:19.792243 | controller | 2025-12-04 13:51:19.792342 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 13:51:19.792440 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.048) 0:00:00.872 ***** 2025-12-04 13:51:19.847325 | controller | skipping: [instance] 2025-12-04 13:51:19.847405 | controller | 2025-12-04 13:51:19.847511 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:19.847691 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.054) 0:00:00.926 ***** 2025-12-04 13:51:19.887068 | controller | skipping: [instance] 2025-12-04 13:51:19.887152 | controller | 2025-12-04 13:51:19.887291 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:19.887377 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.040) 0:00:00.967 ***** 2025-12-04 13:51:19.925586 | controller | skipping: [instance] 2025-12-04 13:51:19.925702 | controller | 2025-12-04 13:51:19.925840 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:19.925992 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.038) 0:00:01.005 ***** 2025-12-04 13:51:19.963231 | controller | skipping: [instance] 2025-12-04 13:51:19.963322 | controller | 2025-12-04 13:51:19.963449 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:19.963591 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.037) 0:00:01.043 ***** 2025-12-04 13:51:19.991118 | controller | ok: [instance] 2025-12-04 13:51:19.991177 | controller | 2025-12-04 13:51:19.991281 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:19.991400 | controller | Thursday 04 December 2025 13:51:19 +0000 (0:00:00.027) 0:00:01.071 ***** 2025-12-04 13:51:20.021670 | controller | ok: [instance] 2025-12-04 13:51:20.021773 | controller | 2025-12-04 13:51:20.021882 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:20.022004 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.030) 0:00:01.101 ***** 2025-12-04 13:51:20.052676 | controller | ok: [instance] => 2025-12-04 13:51:20.052770 | controller | msg: 'Running: No volume, with worker' 2025-12-04 13:51:20.052868 | controller | 2025-12-04 13:51:20.052998 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:20.053090 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.030) 0:00:01.132 ***** 2025-12-04 13:51:20.104704 | controller | 2025-12-04 13:51:20.104861 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 13:51:20.104993 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.051) 0:00:01.184 ***** 2025-12-04 13:51:20.168689 | controller | ok: [instance] 2025-12-04 13:51:20.168781 | controller | 2025-12-04 13:51:20.168895 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 13:51:20.169001 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.064) 0:00:01.248 ***** 2025-12-04 13:51:20.214596 | controller | ok: [instance] 2025-12-04 13:51:20.214711 | controller | 2025-12-04 13:51:20.214841 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 13:51:20.214970 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.045) 0:00:01.294 ***** 2025-12-04 13:51:20.383055 | controller | ok: [instance] 2025-12-04 13:51:20.383122 | controller | 2025-12-04 13:51:20.383242 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 13:51:20.383359 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.168) 0:00:01.462 ***** 2025-12-04 13:51:20.463409 | controller | ok: [instance] 2025-12-04 13:51:20.464092 | controller | 2025-12-04 13:51:20.520331 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 13:51:20.520357 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.080) 0:00:01.543 ***** 2025-12-04 13:51:20.520370 | controller | ok: [instance] 2025-12-04 13:51:20.520504 | controller | 2025-12-04 13:51:20.520619 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 13:51:20.520714 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.057) 0:00:01.600 ***** 2025-12-04 13:51:20.564311 | controller | skipping: [instance] 2025-12-04 13:51:20.564405 | controller | 2025-12-04 13:51:20.564543 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 13:51:20.564670 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.044) 0:00:01.644 ***** 2025-12-04 13:51:20.608097 | controller | skipping: [instance] 2025-12-04 13:51:20.608175 | controller | 2025-12-04 13:51:20.608268 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 13:51:20.608381 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.043) 0:00:01.688 ***** 2025-12-04 13:51:20.647279 | controller | skipping: [instance] 2025-12-04 13:51:20.647384 | controller | 2025-12-04 13:51:20.647511 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 13:51:20.647632 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.039) 0:00:01.727 ***** 2025-12-04 13:51:20.692770 | controller | skipping: [instance] 2025-12-04 13:51:20.692866 | controller | 2025-12-04 13:51:20.693022 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 13:51:20.693112 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.045) 0:00:01.772 ***** 2025-12-04 13:51:20.740934 | controller | skipping: [instance] 2025-12-04 13:51:20.741029 | controller | 2025-12-04 13:51:20.741144 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 13:51:20.741253 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.048) 0:00:01.821 ***** 2025-12-04 13:51:20.802667 | controller | skipping: [instance] 2025-12-04 13:51:20.802770 | controller | 2025-12-04 13:51:20.802893 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:20.802990 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.061) 0:00:01.882 ***** 2025-12-04 13:51:20.842766 | controller | skipping: [instance] 2025-12-04 13:51:20.842857 | controller | 2025-12-04 13:51:20.842973 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:20.843072 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.040) 0:00:01.922 ***** 2025-12-04 13:51:20.876028 | controller | skipping: [instance] 2025-12-04 13:51:20.876087 | controller | 2025-12-04 13:51:20.876181 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:20.876286 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.032) 0:00:01.955 ***** 2025-12-04 13:51:20.910001 | controller | skipping: [instance] 2025-12-04 13:51:20.910470 | controller | 2025-12-04 13:51:20.910602 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:20.910687 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.034) 0:00:01.990 ***** 2025-12-04 13:51:20.936333 | controller | ok: [instance] 2025-12-04 13:51:20.936451 | controller | 2025-12-04 13:51:20.936562 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:20.936771 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.025) 0:00:02.015 ***** 2025-12-04 13:51:20.966161 | controller | ok: [instance] 2025-12-04 13:51:20.966248 | controller | 2025-12-04 13:51:20.966350 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:20.966466 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.030) 0:00:02.046 ***** 2025-12-04 13:51:20.997214 | controller | ok: [instance] => 2025-12-04 13:51:20.997318 | controller | msg: 'Running: Volume, no worker' 2025-12-04 13:51:20.997420 | controller | 2025-12-04 13:51:20.997552 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:20.997667 | controller | Thursday 04 December 2025 13:51:20 +0000 (0:00:00.031) 0:00:02.077 ***** 2025-12-04 13:51:21.040349 | controller | 2025-12-04 13:51:21.040534 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 13:51:21.040547 | controller | Thursday 04 December 2025 13:51:21 +0000 (0:00:00.043) 0:00:02.120 ***** 2025-12-04 13:51:21.104359 | controller | ok: [instance] 2025-12-04 13:51:21.104424 | controller | 2025-12-04 13:51:21.104481 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 13:51:21.104592 | controller | Thursday 04 December 2025 13:51:21 +0000 (0:00:00.063) 0:00:02.184 ***** 2025-12-04 13:51:21.151501 | controller | ok: [instance] 2025-12-04 13:51:21.151588 | controller | 2025-12-04 13:51:21.151714 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 13:51:21.151826 | controller | Thursday 04 December 2025 13:51:21 +0000 (0:00:00.047) 0:00:02.231 ***** 2025-12-04 13:51:21.230735 | controller | ok: [instance] 2025-12-04 13:51:21.230820 | controller | 2025-12-04 13:51:21.230829 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 13:51:21.230849 | controller | Thursday 04 December 2025 13:51:21 +0000 (0:00:00.078) 0:00:02.310 ***** 2025-12-04 13:51:21.277724 | controller | skipping: [instance] 2025-12-04 13:51:21.277813 | controller | 2025-12-04 13:51:21.277923 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 13:51:21.278079 | controller | Thursday 04 December 2025 13:51:21 +0000 (0:00:00.047) 0:00:02.357 ***** 2025-12-04 13:51:21.327486 | controller | skipping: [instance] 2025-12-04 13:51:21.327624 | controller | 2025-12-04 13:51:21.327781 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 13:51:21.327923 | controller | Thursday 04 December 2025 13:51:21 +0000 (0:00:00.049) 0:00:02.407 ***** 2025-12-04 13:51:21.453454 | controller | ok: [instance] 2025-12-04 13:51:21.453536 | controller | 2025-12-04 13:51:21.453577 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 13:51:21.453739 | controller | Thursday 04 December 2025 13:51:21 +0000 (0:00:00.125) 0:00:02.533 ***** 2025-12-04 13:51:21.511750 | controller | skipping: [instance] 2025-12-04 13:51:21.511835 | controller | 2025-12-04 13:51:21.511953 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 13:51:21.512083 | controller | Thursday 04 December 2025 13:51:21 +0000 (0:00:00.058) 0:00:02.591 ***** 2025-12-04 13:51:21.584947 | controller | ok: [instance] 2025-12-04 13:51:21.585056 | controller | 2025-12-04 13:51:21.585163 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 13:51:21.585266 | controller | Thursday 04 December 2025 13:51:21 +0000 (0:00:00.073) 0:00:02.665 ***** 2025-12-04 13:51:21.662012 | controller | ok: [instance] 2025-12-04 13:51:21.662101 | controller | 2025-12-04 13:51:21.662230 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 13:51:21.662358 | controller | Thursday 04 December 2025 13:51:21 +0000 (0:00:00.076) 0:00:02.741 ***** 2025-12-04 13:51:21.735946 | controller | ok: [instance] => changed=false 2025-12-04 13:51:21.736025 | controller | msg: All assertions passed 2025-12-04 13:51:21.736136 | controller | 2025-12-04 13:51:21.736204 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 13:51:21.736293 | controller | Thursday 04 December 2025 13:51:21 +0000 (0:00:00.074) 0:00:02.815 ***** 2025-12-04 13:51:21.826289 | controller | ok: [instance] => changed=false 2025-12-04 13:51:21.826350 | controller | msg: All assertions passed 2025-12-04 13:51:21.826445 | controller | 2025-12-04 13:51:21.826541 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:21.826658 | controller | Thursday 04 December 2025 13:51:21 +0000 (0:00:00.090) 0:00:02.906 ***** 2025-12-04 13:51:21.878871 | controller | skipping: [instance] 2025-12-04 13:51:21.878980 | controller | 2025-12-04 13:51:21.879200 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:21.921006 | controller | Thursday 04 December 2025 13:51:21 +0000 (0:00:00.052) 0:00:02.958 ***** 2025-12-04 13:51:21.921042 | controller | skipping: [instance] 2025-12-04 13:51:21.921103 | controller | 2025-12-04 13:51:21.921466 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:21.972349 | controller | Thursday 04 December 2025 13:51:21 +0000 (0:00:00.042) 0:00:03.001 ***** 2025-12-04 13:51:21.972394 | controller | skipping: [instance] 2025-12-04 13:51:21.972408 | controller | 2025-12-04 13:51:21.972560 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:21.972656 | controller | Thursday 04 December 2025 13:51:21 +0000 (0:00:00.049) 0:00:03.050 ***** 2025-12-04 13:51:22.004791 | controller | ok: [instance] 2025-12-04 13:51:22.005347 | controller | 2025-12-04 13:51:22.005373 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:22.035176 | controller | Thursday 04 December 2025 13:51:22 +0000 (0:00:00.032) 0:00:03.083 ***** 2025-12-04 13:51:22.035205 | controller | ok: [instance] 2025-12-04 13:51:22.035273 | controller | 2025-12-04 13:51:22.035387 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:22.035496 | controller | Thursday 04 December 2025 13:51:22 +0000 (0:00:00.031) 0:00:03.115 ***** 2025-12-04 13:51:22.064385 | controller | ok: [instance] => 2025-12-04 13:51:22.064476 | controller | msg: 'Running: Volume, with worker' 2025-12-04 13:51:22.064584 | controller | 2025-12-04 13:51:22.064707 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:22.064805 | controller | Thursday 04 December 2025 13:51:22 +0000 (0:00:00.029) 0:00:03.144 ***** 2025-12-04 13:51:22.106784 | controller | 2025-12-04 13:51:22.106876 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 13:51:22.107001 | controller | Thursday 04 December 2025 13:51:22 +0000 (0:00:00.042) 0:00:03.186 ***** 2025-12-04 13:51:22.174400 | controller | ok: [instance] 2025-12-04 13:51:22.174542 | controller | 2025-12-04 13:51:22.174692 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 13:51:22.174831 | controller | Thursday 04 December 2025 13:51:22 +0000 (0:00:00.067) 0:00:03.254 ***** 2025-12-04 13:51:22.219778 | controller | ok: [instance] 2025-12-04 13:51:22.219916 | controller | 2025-12-04 13:51:22.219975 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 13:51:22.220111 | controller | Thursday 04 December 2025 13:51:22 +0000 (0:00:00.045) 0:00:03.299 ***** 2025-12-04 13:51:22.295114 | controller | ok: [instance] 2025-12-04 13:51:22.295152 | controller | 2025-12-04 13:51:22.295295 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 13:51:22.295383 | controller | Thursday 04 December 2025 13:51:22 +0000 (0:00:00.075) 0:00:03.375 ***** 2025-12-04 13:51:22.377405 | controller | ok: [instance] 2025-12-04 13:51:22.377503 | controller | 2025-12-04 13:51:22.377611 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 13:51:22.377739 | controller | Thursday 04 December 2025 13:51:22 +0000 (0:00:00.082) 0:00:03.457 ***** 2025-12-04 13:51:22.426342 | controller | skipping: [instance] 2025-12-04 13:51:22.426414 | controller | 2025-12-04 13:51:22.426558 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 13:51:22.427044 | controller | Thursday 04 December 2025 13:51:22 +0000 (0:00:00.048) 0:00:03.506 ***** 2025-12-04 13:51:22.487268 | controller | ok: [instance] 2025-12-04 13:51:22.487370 | controller | 2025-12-04 13:51:22.487515 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 13:51:22.487633 | controller | Thursday 04 December 2025 13:51:22 +0000 (0:00:00.061) 0:00:03.567 ***** 2025-12-04 13:51:22.544000 | controller | ok: [instance] 2025-12-04 13:51:22.544084 | controller | 2025-12-04 13:51:22.544183 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 13:51:22.544280 | controller | Thursday 04 December 2025 13:51:22 +0000 (0:00:00.056) 0:00:03.623 ***** 2025-12-04 13:51:22.701392 | controller | ok: [instance] 2025-12-04 13:51:22.701499 | controller | 2025-12-04 13:51:22.701628 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 13:51:22.701773 | controller | Thursday 04 December 2025 13:51:22 +0000 (0:00:00.157) 0:00:03.781 ***** 2025-12-04 13:51:22.777067 | controller | ok: [instance] 2025-12-04 13:51:22.777146 | controller | 2025-12-04 13:51:22.777246 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 13:51:22.777360 | controller | Thursday 04 December 2025 13:51:22 +0000 (0:00:00.075) 0:00:03.857 ***** 2025-12-04 13:51:22.858724 | controller | ok: [instance] => changed=false 2025-12-04 13:51:22.858802 | controller | msg: All assertions passed 2025-12-04 13:51:22.858892 | controller | 2025-12-04 13:51:22.859022 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 13:51:22.859119 | controller | Thursday 04 December 2025 13:51:22 +0000 (0:00:00.081) 0:00:03.938 ***** 2025-12-04 13:51:22.949843 | controller | ok: [instance] => changed=false 2025-12-04 13:51:22.950010 | controller | msg: All assertions passed 2025-12-04 13:51:22.950198 | controller | 2025-12-04 13:51:22.950335 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:22.950482 | controller | Thursday 04 December 2025 13:51:22 +0000 (0:00:00.091) 0:00:04.029 ***** 2025-12-04 13:51:22.995905 | controller | skipping: [instance] 2025-12-04 13:51:22.996022 | controller | 2025-12-04 13:51:22.996105 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:22.996296 | controller | Thursday 04 December 2025 13:51:22 +0000 (0:00:00.046) 0:00:04.075 ***** 2025-12-04 13:51:23.039175 | controller | skipping: [instance] 2025-12-04 13:51:23.039256 | controller | 2025-12-04 13:51:23.039353 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:23.039462 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.043) 0:00:04.119 ***** 2025-12-04 13:51:23.079986 | controller | skipping: [instance] 2025-12-04 13:51:23.080092 | controller | 2025-12-04 13:51:23.080193 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:23.080304 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.040) 0:00:04.159 ***** 2025-12-04 13:51:23.108258 | controller | ok: [instance] 2025-12-04 13:51:23.108343 | controller | 2025-12-04 13:51:23.108466 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:23.108607 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.028) 0:00:04.188 ***** 2025-12-04 13:51:23.139346 | controller | ok: [instance] 2025-12-04 13:51:23.139443 | controller | 2025-12-04 13:51:23.139556 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:23.139705 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.030) 0:00:04.219 ***** 2025-12-04 13:51:23.169265 | controller | ok: [instance] => 2025-12-04 13:51:23.169350 | controller | msg: 'Running: Too many allocated volumes' 2025-12-04 13:51:23.169451 | controller | 2025-12-04 13:51:23.169558 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:23.169656 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.030) 0:00:04.249 ***** 2025-12-04 13:51:23.216681 | controller | 2025-12-04 13:51:23.216791 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 13:51:23.216877 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.046) 0:00:04.295 ***** 2025-12-04 13:51:23.278518 | controller | ok: [instance] 2025-12-04 13:51:23.278736 | controller | 2025-12-04 13:51:23.278888 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 13:51:23.278918 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.062) 0:00:04.358 ***** 2025-12-04 13:51:23.322775 | controller | ok: [instance] 2025-12-04 13:51:23.322830 | controller | 2025-12-04 13:51:23.322936 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 13:51:23.323077 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.044) 0:00:04.402 ***** 2025-12-04 13:51:23.391318 | controller | ok: [instance] 2025-12-04 13:51:23.391402 | controller | 2025-12-04 13:51:23.391525 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 13:51:23.391668 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.068) 0:00:04.471 ***** 2025-12-04 13:51:23.435226 | controller | skipping: [instance] 2025-12-04 13:51:23.435337 | controller | 2025-12-04 13:51:23.435446 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 13:51:23.435591 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.043) 0:00:04.514 ***** 2025-12-04 13:51:23.480672 | controller | skipping: [instance] 2025-12-04 13:51:23.480761 | controller | 2025-12-04 13:51:23.480866 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 13:51:23.480981 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.045) 0:00:04.560 ***** 2025-12-04 13:51:23.535319 | controller | ok: [instance] 2025-12-04 13:51:23.535397 | controller | 2025-12-04 13:51:23.535522 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 13:51:23.535636 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.054) 0:00:04.614 ***** 2025-12-04 13:51:23.581750 | controller | skipping: [instance] 2025-12-04 13:51:23.581816 | controller | 2025-12-04 13:51:23.581924 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 13:51:23.582037 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.046) 0:00:04.661 ***** 2025-12-04 13:51:23.636950 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:23.637062 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2025-12-04 13:51:23.637173 | controller | evaluated_to: false 2025-12-04 13:51:23.637292 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 3' 2025-12-04 13:51:23.665311 | controller | 2025-12-04 13:51:23.665406 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 13:51:23.665520 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.068) 0:00:04.730 ***** 2025-12-04 13:51:23.665610 | controller | 2025-12-04 13:51:23.665700 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:23.665811 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.014) 0:00:04.745 ***** 2025-12-04 13:51:23.739905 | controller | ok: [instance] 2025-12-04 13:51:23.739993 | controller | 2025-12-04 13:51:23.740146 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:23.740244 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.074) 0:00:04.819 ***** 2025-12-04 13:51:23.781879 | controller | skipping: [instance] 2025-12-04 13:51:23.781976 | controller | 2025-12-04 13:51:23.782093 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:23.782196 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.042) 0:00:04.862 ***** 2025-12-04 13:51:23.825017 | controller | skipping: [instance] 2025-12-04 13:51:23.825089 | controller | 2025-12-04 13:51:23.825200 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:23.825306 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.043) 0:00:04.905 ***** 2025-12-04 13:51:23.862808 | controller | skipping: [instance] 2025-12-04 13:51:23.862896 | controller | 2025-12-04 13:51:23.863008 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:23.863128 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.037) 0:00:04.942 ***** 2025-12-04 13:51:23.889306 | controller | ok: [instance] 2025-12-04 13:51:23.889379 | controller | 2025-12-04 13:51:23.889549 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:23.889654 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.026) 0:00:04.968 ***** 2025-12-04 13:51:23.918336 | controller | ok: [instance] 2025-12-04 13:51:23.918409 | controller | 2025-12-04 13:51:23.918520 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:23.918632 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.029) 0:00:04.998 ***** 2025-12-04 13:51:23.946745 | controller | ok: [instance] => 2025-12-04 13:51:23.946833 | controller | msg: 'Running: Different volume amount' 2025-12-04 13:51:23.946925 | controller | 2025-12-04 13:51:23.947054 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:23.947162 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.028) 0:00:05.026 ***** 2025-12-04 13:51:23.994872 | controller | 2025-12-04 13:51:24.055921 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 13:51:24.055949 | controller | Thursday 04 December 2025 13:51:23 +0000 (0:00:00.046) 0:00:05.073 ***** 2025-12-04 13:51:24.055983 | controller | ok: [instance] 2025-12-04 13:51:24.056028 | controller | 2025-12-04 13:51:24.056146 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 13:51:24.056255 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.062) 0:00:05.135 ***** 2025-12-04 13:51:24.105427 | controller | ok: [instance] 2025-12-04 13:51:24.105476 | controller | 2025-12-04 13:51:24.105606 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 13:51:24.105703 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.048) 0:00:05.184 ***** 2025-12-04 13:51:24.180266 | controller | ok: [instance] 2025-12-04 13:51:24.180338 | controller | 2025-12-04 13:51:24.180458 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 13:51:24.180579 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.075) 0:00:05.260 ***** 2025-12-04 13:51:24.251721 | controller | ok: [instance] 2025-12-04 13:51:24.251782 | controller | 2025-12-04 13:51:24.251894 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 13:51:24.252004 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.071) 0:00:05.331 ***** 2025-12-04 13:51:24.301689 | controller | skipping: [instance] 2025-12-04 13:51:24.301753 | controller | 2025-12-04 13:51:24.301852 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 13:51:24.301947 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.049) 0:00:05.381 ***** 2025-12-04 13:51:24.353913 | controller | ok: [instance] 2025-12-04 13:51:24.353998 | controller | 2025-12-04 13:51:24.354102 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 13:51:24.354199 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.052) 0:00:05.433 ***** 2025-12-04 13:51:24.405986 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:24.406128 | controller | assertion: (_work.extra_disks_num is defined and _ocp.extra_disks_num == _work.extra_disks_num and _ocp.extra_disks_size is defined and _work.extra_disks_size is defined and _ocp.extra_disks_size == _work.extra_disks_size) or _ocp.extra_disks_num is undefined or _ocp.extra_disks_num == 0 2025-12-04 13:51:24.406226 | controller | evaluated_to: false 2025-12-04 13:51:24.406336 | controller | msg: 'Inconsistency detected: ensure you don''t allocate more disks in cifmw_lvms_disk_list and cifmw_devscripts_cinder_volume_pvs than available.' 2025-12-04 13:51:24.435053 | controller | 2025-12-04 13:51:24.435150 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 13:51:24.435278 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.064) 0:00:05.498 ***** 2025-12-04 13:51:24.435376 | controller | 2025-12-04 13:51:24.435493 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:24.435609 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.016) 0:00:05.514 ***** 2025-12-04 13:51:24.461638 | controller | ok: [instance] 2025-12-04 13:51:24.461783 | controller | 2025-12-04 13:51:24.461936 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:24.462101 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.027) 0:00:05.541 ***** 2025-12-04 13:51:24.505985 | controller | skipping: [instance] 2025-12-04 13:51:24.506063 | controller | 2025-12-04 13:51:24.506179 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:24.506274 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.044) 0:00:05.585 ***** 2025-12-04 13:51:24.545762 | controller | skipping: [instance] 2025-12-04 13:51:24.545839 | controller | 2025-12-04 13:51:24.545934 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:24.546056 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.039) 0:00:05.625 ***** 2025-12-04 13:51:24.589499 | controller | skipping: [instance] 2025-12-04 13:51:24.589583 | controller | 2025-12-04 13:51:24.589674 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:24.589786 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.042) 0:00:05.668 ***** 2025-12-04 13:51:24.617015 | controller | ok: [instance] 2025-12-04 13:51:24.617115 | controller | 2025-12-04 13:51:24.617239 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:24.617351 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.028) 0:00:05.696 ***** 2025-12-04 13:51:24.651526 | controller | ok: [instance] 2025-12-04 13:51:24.651617 | controller | 2025-12-04 13:51:24.651732 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:24.651843 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.034) 0:00:05.731 ***** 2025-12-04 13:51:24.727753 | controller | ok: [instance] => 2025-12-04 13:51:24.727839 | controller | msg: 'Running: Create LVM without volume' 2025-12-04 13:51:24.727931 | controller | 2025-12-04 13:51:24.728069 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:24.728159 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.076) 0:00:05.807 ***** 2025-12-04 13:51:24.781583 | controller | 2025-12-04 13:51:24.781670 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 13:51:24.781747 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.053) 0:00:05.861 ***** 2025-12-04 13:51:24.849229 | controller | ok: [instance] 2025-12-04 13:51:24.849292 | controller | 2025-12-04 13:51:24.849424 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 13:51:24.849534 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.067) 0:00:05.929 ***** 2025-12-04 13:51:24.901354 | controller | ok: [instance] 2025-12-04 13:51:24.901438 | controller | 2025-12-04 13:51:24.901550 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 13:51:24.901670 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.052) 0:00:05.981 ***** 2025-12-04 13:51:24.982744 | controller | ok: [instance] 2025-12-04 13:51:24.982807 | controller | 2025-12-04 13:51:24.982913 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 13:51:24.983023 | controller | Thursday 04 December 2025 13:51:24 +0000 (0:00:00.081) 0:00:06.062 ***** 2025-12-04 13:51:25.038185 | controller | skipping: [instance] 2025-12-04 13:51:25.038270 | controller | 2025-12-04 13:51:25.038336 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 13:51:25.038447 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.055) 0:00:06.117 ***** 2025-12-04 13:51:25.091682 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:25.091740 | controller | assertion: not cifmw_devscripts_create_logical_volume | bool 2025-12-04 13:51:25.091852 | controller | evaluated_to: false 2025-12-04 13:51:25.091944 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2025-12-04 13:51:25.118428 | controller | 2025-12-04 13:51:25.118521 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 13:51:25.118638 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.064) 0:00:06.182 ***** 2025-12-04 13:51:25.118736 | controller | 2025-12-04 13:51:25.118825 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:25.118941 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.015) 0:00:06.198 ***** 2025-12-04 13:51:25.149875 | controller | ok: [instance] 2025-12-04 13:51:25.149911 | controller | 2025-12-04 13:51:25.150058 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:25.150164 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.029) 0:00:06.227 ***** 2025-12-04 13:51:25.198019 | controller | skipping: [instance] 2025-12-04 13:51:25.238347 | controller | 2025-12-04 13:51:25.238395 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:25.238405 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.047) 0:00:06.274 ***** 2025-12-04 13:51:25.238419 | controller | skipping: [instance] 2025-12-04 13:51:25.238551 | controller | 2025-12-04 13:51:25.238587 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:25.238674 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.043) 0:00:06.318 ***** 2025-12-04 13:51:25.288740 | controller | skipping: [instance] 2025-12-04 13:51:25.288875 | controller | 2025-12-04 13:51:25.288927 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:25.288941 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.050) 0:00:06.368 ***** 2025-12-04 13:51:25.314478 | controller | ok: [instance] 2025-12-04 13:51:25.314574 | controller | 2025-12-04 13:51:25.314699 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:25.314792 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.026) 0:00:06.394 ***** 2025-12-04 13:51:25.343583 | controller | ok: [instance] 2025-12-04 13:51:25.343665 | controller | 2025-12-04 13:51:25.343767 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:25.343863 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.029) 0:00:06.423 ***** 2025-12-04 13:51:25.379421 | controller | ok: [instance] => 2025-12-04 13:51:25.379513 | controller | msg: 'Running: Create LVMS without volume' 2025-12-04 13:51:25.379623 | controller | 2025-12-04 13:51:25.379727 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:25.379813 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.035) 0:00:06.459 ***** 2025-12-04 13:51:25.428101 | controller | 2025-12-04 13:51:25.428198 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 13:51:25.428334 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.048) 0:00:06.508 ***** 2025-12-04 13:51:25.497796 | controller | ok: [instance] 2025-12-04 13:51:25.497855 | controller | 2025-12-04 13:51:25.497983 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 13:51:25.498094 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.069) 0:00:06.577 ***** 2025-12-04 13:51:25.550607 | controller | ok: [instance] 2025-12-04 13:51:25.550736 | controller | 2025-12-04 13:51:25.550837 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 13:51:25.550944 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.052) 0:00:06.630 ***** 2025-12-04 13:51:25.640788 | controller | ok: [instance] 2025-12-04 13:51:25.640841 | controller | 2025-12-04 13:51:25.640954 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 13:51:25.641063 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.088) 0:00:06.719 ***** 2025-12-04 13:51:25.689176 | controller | skipping: [instance] 2025-12-04 13:51:25.689275 | controller | 2025-12-04 13:51:25.689381 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 13:51:25.689510 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.049) 0:00:06.769 ***** 2025-12-04 13:51:25.738996 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:25.791632 | controller | assertion: cifmw_lvms_disk_list is undefined or (cifmw_lvms_disk_list | length) == 0 2025-12-04 13:51:25.791668 | controller | evaluated_to: false 2025-12-04 13:51:25.791678 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2025-12-04 13:51:25.791689 | controller | 2025-12-04 13:51:25.791748 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 13:51:25.791863 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.085) 0:00:06.855 ***** 2025-12-04 13:51:25.791954 | controller | 2025-12-04 13:51:25.792067 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:25.792183 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.016) 0:00:06.871 ***** 2025-12-04 13:51:25.815897 | controller | ok: [instance] 2025-12-04 13:51:25.816010 | controller | 2025-12-04 13:51:25.816114 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:25.816225 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.024) 0:00:06.896 ***** 2025-12-04 13:51:25.860706 | controller | skipping: [instance] 2025-12-04 13:51:25.862244 | controller | 2025-12-04 13:51:25.908886 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:25.908928 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.044) 0:00:06.940 ***** 2025-12-04 13:51:25.908942 | controller | skipping: [instance] 2025-12-04 13:51:25.908951 | controller | 2025-12-04 13:51:25.909116 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:25.909198 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.048) 0:00:06.989 ***** 2025-12-04 13:51:25.948131 | controller | skipping: [instance] 2025-12-04 13:51:25.948227 | controller | 2025-12-04 13:51:25.948321 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:25.948417 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.039) 0:00:07.028 ***** 2025-12-04 13:51:25.975729 | controller | ok: [instance] 2025-12-04 13:51:25.975819 | controller | 2025-12-04 13:51:25.975931 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:25.976078 | controller | Thursday 04 December 2025 13:51:25 +0000 (0:00:00.027) 0:00:07.055 ***** 2025-12-04 13:51:26.009885 | controller | ok: [instance] 2025-12-04 13:51:26.009977 | controller | 2025-12-04 13:51:26.010077 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:26.010177 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.034) 0:00:07.090 ***** 2025-12-04 13:51:26.045858 | controller | ok: [instance] => 2025-12-04 13:51:26.045946 | controller | msg: 'Running: Allocate same volume twice' 2025-12-04 13:51:26.046073 | controller | 2025-12-04 13:51:26.046184 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:26.046264 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.035) 0:00:07.125 ***** 2025-12-04 13:51:26.098806 | controller | 2025-12-04 13:51:26.098871 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 13:51:26.098999 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.051) 0:00:07.177 ***** 2025-12-04 13:51:26.157617 | controller | ok: [instance] 2025-12-04 13:51:26.157734 | controller | 2025-12-04 13:51:26.157830 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 13:51:26.157939 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.060) 0:00:07.237 ***** 2025-12-04 13:51:26.199725 | controller | ok: [instance] 2025-12-04 13:51:26.199813 | controller | 2025-12-04 13:51:26.199899 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 13:51:26.200002 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.042) 0:00:07.279 ***** 2025-12-04 13:51:26.279674 | controller | ok: [instance] 2025-12-04 13:51:26.279753 | controller | 2025-12-04 13:51:26.279887 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 13:51:26.280006 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.079) 0:00:07.359 ***** 2025-12-04 13:51:26.327805 | controller | skipping: [instance] 2025-12-04 13:51:26.327887 | controller | 2025-12-04 13:51:26.327996 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 13:51:26.328134 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.048) 0:00:07.407 ***** 2025-12-04 13:51:26.380527 | controller | skipping: [instance] 2025-12-04 13:51:26.380620 | controller | 2025-12-04 13:51:26.380709 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 13:51:26.380830 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.052) 0:00:07.460 ***** 2025-12-04 13:51:26.432649 | controller | ok: [instance] 2025-12-04 13:51:26.432759 | controller | 2025-12-04 13:51:26.432855 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 13:51:26.432984 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.052) 0:00:07.512 ***** 2025-12-04 13:51:26.488383 | controller | skipping: [instance] 2025-12-04 13:51:26.488521 | controller | 2025-12-04 13:51:26.488678 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 13:51:26.488804 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.055) 0:00:07.568 ***** 2025-12-04 13:51:26.562070 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:26.562200 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2025-12-04 13:51:26.562299 | controller | evaluated_to: false 2025-12-04 13:51:26.562382 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 4' 2025-12-04 13:51:26.595199 | controller | 2025-12-04 13:51:26.595402 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 13:51:26.595451 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.089) 0:00:07.657 ***** 2025-12-04 13:51:26.595548 | controller | 2025-12-04 13:51:26.595677 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:26.595802 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.017) 0:00:07.674 ***** 2025-12-04 13:51:26.626690 | controller | ok: [instance] 2025-12-04 13:51:26.626776 | controller | 2025-12-04 13:51:26.626877 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:26.626972 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.031) 0:00:07.706 ***** 2025-12-04 13:51:26.672920 | controller | skipping: [instance] 2025-12-04 13:51:26.673020 | controller | 2025-12-04 13:51:26.673133 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:26.673235 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.045) 0:00:07.751 ***** 2025-12-04 13:51:26.754557 | controller | skipping: [instance] 2025-12-04 13:51:26.754664 | controller | 2025-12-04 13:51:26.754789 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:26.754873 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.083) 0:00:07.834 ***** 2025-12-04 13:51:26.791289 | controller | skipping: [instance] 2025-12-04 13:51:26.791368 | controller | 2025-12-04 13:51:26.791479 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:26.791592 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.036) 0:00:07.871 ***** 2025-12-04 13:51:26.817819 | controller | ok: [instance] 2025-12-04 13:51:26.844781 | controller | 2025-12-04 13:51:26.844804 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:26.844812 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.025) 0:00:07.897 ***** 2025-12-04 13:51:26.844821 | controller | ok: [instance] 2025-12-04 13:51:26.844844 | controller | 2025-12-04 13:51:26.844975 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:26.845098 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.027) 0:00:07.924 ***** 2025-12-04 13:51:26.871346 | controller | ok: [instance] => 2025-12-04 13:51:26.871460 | controller | msg: 'Running: Allocate same volume twice - no LVMS' 2025-12-04 13:51:26.871552 | controller | 2025-12-04 13:51:26.871649 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:26.871758 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.026) 0:00:07.951 ***** 2025-12-04 13:51:26.912474 | controller | 2025-12-04 13:51:26.912582 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 13:51:26.912682 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.041) 0:00:07.992 ***** 2025-12-04 13:51:26.976664 | controller | ok: [instance] 2025-12-04 13:51:26.976743 | controller | 2025-12-04 13:51:26.976869 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 13:51:26.976992 | controller | Thursday 04 December 2025 13:51:26 +0000 (0:00:00.063) 0:00:08.056 ***** 2025-12-04 13:51:27.028465 | controller | ok: [instance] 2025-12-04 13:51:27.028550 | controller | 2025-12-04 13:51:27.028670 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 13:51:27.028805 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.051) 0:00:08.107 ***** 2025-12-04 13:51:27.108864 | controller | ok: [instance] 2025-12-04 13:51:27.108931 | controller | 2025-12-04 13:51:27.109071 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 13:51:27.109173 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.080) 0:00:08.188 ***** 2025-12-04 13:51:27.156388 | controller | skipping: [instance] 2025-12-04 13:51:27.156493 | controller | 2025-12-04 13:51:27.156607 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 13:51:27.156707 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.048) 0:00:08.236 ***** 2025-12-04 13:51:27.206325 | controller | skipping: [instance] 2025-12-04 13:51:27.206425 | controller | 2025-12-04 13:51:27.206520 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 13:51:27.206626 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.049) 0:00:08.286 ***** 2025-12-04 13:51:27.260223 | controller | ok: [instance] 2025-12-04 13:51:27.260300 | controller | 2025-12-04 13:51:27.260411 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 13:51:27.260510 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.053) 0:00:08.340 ***** 2025-12-04 13:51:27.315903 | controller | skipping: [instance] 2025-12-04 13:51:27.316002 | controller | 2025-12-04 13:51:27.316156 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 13:51:27.316244 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.055) 0:00:08.395 ***** 2025-12-04 13:51:27.394876 | controller | ok: [instance] 2025-12-04 13:51:27.394947 | controller | 2025-12-04 13:51:27.395058 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 13:51:27.395184 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.078) 0:00:08.474 ***** 2025-12-04 13:51:27.449637 | controller | skipping: [instance] 2025-12-04 13:51:27.449744 | controller | 2025-12-04 13:51:27.449836 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 13:51:27.449953 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.054) 0:00:08.528 ***** 2025-12-04 13:51:27.527841 | controller | ok: [instance] => changed=false 2025-12-04 13:51:27.527909 | controller | msg: All assertions passed 2025-12-04 13:51:27.527995 | controller | 2025-12-04 13:51:27.528106 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 13:51:27.528212 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.078) 0:00:08.607 ***** 2025-12-04 13:51:27.624049 | controller | ok: [instance] => changed=false 2025-12-04 13:51:27.624147 | controller | msg: All assertions passed 2025-12-04 13:51:27.624159 | controller | 2025-12-04 13:51:27.624300 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:27.624401 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.095) 0:00:08.703 ***** 2025-12-04 13:51:27.665350 | controller | skipping: [instance] 2025-12-04 13:51:27.665416 | controller | 2025-12-04 13:51:27.665519 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:27.665642 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.041) 0:00:08.745 ***** 2025-12-04 13:51:27.702199 | controller | skipping: [instance] 2025-12-04 13:51:27.702263 | controller | 2025-12-04 13:51:27.702385 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:27.702515 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.036) 0:00:08.781 ***** 2025-12-04 13:51:27.742117 | controller | skipping: [instance] 2025-12-04 13:51:27.742180 | controller | 2025-12-04 13:51:27.742286 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:27.742388 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.039) 0:00:08.821 ***** 2025-12-04 13:51:27.767755 | controller | ok: [instance] 2025-12-04 13:51:27.767819 | controller | 2025-12-04 13:51:27.770030 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:27.833012 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.025) 0:00:08.847 ***** 2025-12-04 13:51:27.833093 | controller | ok: [instance] 2025-12-04 13:51:27.833228 | controller | 2025-12-04 13:51:27.833248 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:27.833319 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.065) 0:00:08.912 ***** 2025-12-04 13:51:27.862161 | controller | ok: [instance] => 2025-12-04 13:51:27.862262 | controller | msg: 'Running: Allocate same volume twice - no cinder_lvm' 2025-12-04 13:51:27.862346 | controller | 2025-12-04 13:51:27.862463 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:27.862603 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.029) 0:00:08.942 ***** 2025-12-04 13:51:27.910448 | controller | 2025-12-04 13:51:27.910532 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 13:51:27.910647 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.047) 0:00:08.989 ***** 2025-12-04 13:51:27.976362 | controller | ok: [instance] 2025-12-04 13:51:27.976446 | controller | 2025-12-04 13:51:27.976540 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 13:51:27.976647 | controller | Thursday 04 December 2025 13:51:27 +0000 (0:00:00.066) 0:00:09.056 ***** 2025-12-04 13:51:28.025406 | controller | ok: [instance] 2025-12-04 13:51:28.025482 | controller | 2025-12-04 13:51:28.025607 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 13:51:28.025727 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.047) 0:00:09.103 ***** 2025-12-04 13:51:28.108672 | controller | ok: [instance] 2025-12-04 13:51:28.108744 | controller | 2025-12-04 13:51:28.108889 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 13:51:28.108980 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.084) 0:00:09.188 ***** 2025-12-04 13:51:28.160371 | controller | skipping: [instance] 2025-12-04 13:51:28.160452 | controller | 2025-12-04 13:51:28.160585 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 13:51:28.160697 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.051) 0:00:09.239 ***** 2025-12-04 13:51:28.215043 | controller | skipping: [instance] 2025-12-04 13:51:28.215142 | controller | 2025-12-04 13:51:28.215264 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 13:51:28.215387 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.054) 0:00:09.294 ***** 2025-12-04 13:51:28.270044 | controller | ok: [instance] 2025-12-04 13:51:28.270112 | controller | 2025-12-04 13:51:28.270246 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 13:51:28.270354 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.054) 0:00:09.349 ***** 2025-12-04 13:51:28.318207 | controller | skipping: [instance] 2025-12-04 13:51:28.318298 | controller | 2025-12-04 13:51:28.318402 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 13:51:28.318525 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.048) 0:00:09.398 ***** 2025-12-04 13:51:28.385085 | controller | ok: [instance] 2025-12-04 13:51:28.385172 | controller | 2025-12-04 13:51:28.385280 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 13:51:28.385385 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.066) 0:00:09.465 ***** 2025-12-04 13:51:28.441082 | controller | skipping: [instance] 2025-12-04 13:51:28.441133 | controller | 2025-12-04 13:51:28.441289 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 13:51:28.441388 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.055) 0:00:09.520 ***** 2025-12-04 13:51:28.519837 | controller | ok: [instance] => changed=false 2025-12-04 13:51:28.519914 | controller | msg: All assertions passed 2025-12-04 13:51:28.520048 | controller | 2025-12-04 13:51:28.520165 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 13:51:28.520282 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.078) 0:00:09.599 ***** 2025-12-04 13:51:28.594464 | controller | skipping: [instance] 2025-12-04 13:51:28.594541 | controller | 2025-12-04 13:51:28.594651 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:28.594754 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.074) 0:00:09.674 ***** 2025-12-04 13:51:28.638792 | controller | skipping: [instance] 2025-12-04 13:51:28.638878 | controller | 2025-12-04 13:51:28.639005 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:28.639116 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.043) 0:00:09.718 ***** 2025-12-04 13:51:28.674336 | controller | skipping: [instance] 2025-12-04 13:51:28.674431 | controller | 2025-12-04 13:51:28.674579 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:28.674663 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.036) 0:00:09.754 ***** 2025-12-04 13:51:28.710490 | controller | skipping: [instance] 2025-12-04 13:51:28.710539 | controller | 2025-12-04 13:51:28.710683 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:28.710779 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.035) 0:00:09.790 ***** 2025-12-04 13:51:28.737108 | controller | ok: [instance] 2025-12-04 13:51:28.737202 | controller | 2025-12-04 13:51:28.737299 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:28.737404 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.026) 0:00:09.817 ***** 2025-12-04 13:51:28.765423 | controller | ok: [instance] 2025-12-04 13:51:28.765508 | controller | 2025-12-04 13:51:28.765628 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:28.765730 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.028) 0:00:09.845 ***** 2025-12-04 13:51:28.795314 | controller | ok: [instance] => 2025-12-04 13:51:28.795408 | controller | msg: 'Running: Config overrides via devscripts' 2025-12-04 13:51:28.795523 | controller | 2025-12-04 13:51:28.795624 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:28.795732 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.029) 0:00:09.875 ***** 2025-12-04 13:51:28.874830 | controller | 2025-12-04 13:51:28.874944 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 13:51:28.877869 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.079) 0:00:09.954 ***** 2025-12-04 13:51:28.911233 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:28.911332 | controller | assertion: cifmw_devscripts_config.master_memory is undefined 2025-12-04 13:51:28.911473 | controller | evaluated_to: false 2025-12-04 13:51:28.911588 | controller | msg: 'Inconsistency detected: your environment wants to provide devscripts configuration overrides. This isn''t supported, and you must pass those ressource allocation via the usual cifmw_libvirt_manager_configuration, or patch it.' 2025-12-04 13:51:28.939488 | controller | 2025-12-04 13:51:28.939609 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 13:51:28.939714 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.047) 0:00:10.002 ***** 2025-12-04 13:51:28.939809 | controller | 2025-12-04 13:51:28.939924 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:28.940053 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.016) 0:00:10.019 ***** 2025-12-04 13:51:28.967446 | controller | ok: [instance] 2025-12-04 13:51:28.967606 | controller | 2025-12-04 13:51:28.967635 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:28.967652 | controller | Thursday 04 December 2025 13:51:28 +0000 (0:00:00.024) 0:00:10.043 ***** 2025-12-04 13:51:29.006481 | controller | skipping: [instance] 2025-12-04 13:51:29.006530 | controller | 2025-12-04 13:51:29.006699 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:29.006773 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.042) 0:00:10.086 ***** 2025-12-04 13:51:29.041281 | controller | skipping: [instance] 2025-12-04 13:51:29.041361 | controller | 2025-12-04 13:51:29.041490 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:29.041632 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.034) 0:00:10.121 ***** 2025-12-04 13:51:29.079446 | controller | skipping: [instance] 2025-12-04 13:51:29.079524 | controller | 2025-12-04 13:51:29.079638 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:29.079740 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.038) 0:00:10.159 ***** 2025-12-04 13:51:29.108217 | controller | ok: [instance] 2025-12-04 13:51:29.108304 | controller | 2025-12-04 13:51:29.108412 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:29.108540 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.028) 0:00:10.188 ***** 2025-12-04 13:51:29.141936 | controller | ok: [instance] 2025-12-04 13:51:29.142059 | controller | 2025-12-04 13:51:29.142170 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:29.142288 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.033) 0:00:10.221 ***** 2025-12-04 13:51:29.174678 | controller | ok: [instance] => 2025-12-04 13:51:29.174769 | controller | msg: 'Running: Inject 10 dev-scripts extra_worker' 2025-12-04 13:51:29.174860 | controller | 2025-12-04 13:51:29.174953 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:29.175066 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.032) 0:00:10.254 ***** 2025-12-04 13:51:29.221395 | controller | 2025-12-04 13:51:29.221543 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 13:51:29.221674 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.046) 0:00:10.301 ***** 2025-12-04 13:51:29.285118 | controller | ok: [instance] 2025-12-04 13:51:29.285195 | controller | 2025-12-04 13:51:29.285310 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 13:51:29.285414 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.063) 0:00:10.365 ***** 2025-12-04 13:51:29.317844 | controller | fatal: [instance]: FAILED! => changed=false 2025-12-04 13:51:29.317996 | controller | assertion: cifmw_devscripts_config.num_extra_workers is undefined or cifmw_devscripts_config.num_extra_workers == 0 2025-12-04 13:51:29.318012 | controller | evaluated_to: false 2025-12-04 13:51:29.318128 | controller | msg: 'Inconsistency detected: dev-scripts extra_worker resources aren''t supported here. You can create compute, networker or any other kind of VM by defining it as you define OCP cluster nodes.' 2025-12-04 13:51:29.344982 | controller | 2025-12-04 13:51:29.345103 | controller | TASK [Clear host errors] ******************************************************* 2025-12-04 13:51:29.345200 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.043) 0:00:10.408 ***** 2025-12-04 13:51:29.345294 | controller | 2025-12-04 13:51:29.345409 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:29.345543 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.016) 0:00:10.424 ***** 2025-12-04 13:51:29.372813 | controller | ok: [instance] 2025-12-04 13:51:29.372906 | controller | 2025-12-04 13:51:29.373034 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:29.373150 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.028) 0:00:10.452 ***** 2025-12-04 13:51:29.412841 | controller | skipping: [instance] 2025-12-04 13:51:29.412923 | controller | 2025-12-04 13:51:29.413086 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:29.413208 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.040) 0:00:10.493 ***** 2025-12-04 13:51:29.457488 | controller | skipping: [instance] 2025-12-04 13:51:29.457585 | controller | 2025-12-04 13:51:29.457709 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:29.457834 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.044) 0:00:10.537 ***** 2025-12-04 13:51:29.501786 | controller | skipping: [instance] 2025-12-04 13:51:29.501898 | controller | 2025-12-04 13:51:29.502029 | controller | TASK [Mark run as failed] ****************************************************** 2025-12-04 13:51:29.502141 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.044) 0:00:10.581 ***** 2025-12-04 13:51:29.530008 | controller | ok: [instance] 2025-12-04 13:51:29.530092 | controller | 2025-12-04 13:51:29.530126 | controller | TASK [Load environment file] *************************************************** 2025-12-04 13:51:29.530245 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.028) 0:00:10.610 ***** 2025-12-04 13:51:29.564832 | controller | ok: [instance] 2025-12-04 13:51:29.564894 | controller | 2025-12-04 13:51:29.565030 | controller | TASK [Output scenario name] **************************************************** 2025-12-04 13:51:29.565146 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.034) 0:00:10.644 ***** 2025-12-04 13:51:29.597152 | controller | ok: [instance] => 2025-12-04 13:51:29.597273 | controller | msg: 'Running: Inject 0 dev-scripts extra_worker' 2025-12-04 13:51:29.597369 | controller | 2025-12-04 13:51:29.597482 | controller | TASK [Validate data] *********************************************************** 2025-12-04 13:51:29.597611 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.032) 0:00:10.677 ***** 2025-12-04 13:51:29.683477 | controller | 2025-12-04 13:51:29.683542 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-12-04 13:51:29.683684 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.086) 0:00:10.763 ***** 2025-12-04 13:51:29.746847 | controller | ok: [instance] 2025-12-04 13:51:29.746898 | controller | 2025-12-04 13:51:29.747030 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-12-04 13:51:29.747130 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.063) 0:00:10.826 ***** 2025-12-04 13:51:29.801329 | controller | ok: [instance] 2025-12-04 13:51:29.801388 | controller | 2025-12-04 13:51:29.801540 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-12-04 13:51:29.801676 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.054) 0:00:10.881 ***** 2025-12-04 13:51:29.878912 | controller | ok: [instance] 2025-12-04 13:51:29.879035 | controller | 2025-12-04 13:51:29.879052 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-12-04 13:51:29.879167 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.076) 0:00:10.958 ***** 2025-12-04 13:51:29.930423 | controller | skipping: [instance] 2025-12-04 13:51:29.930522 | controller | 2025-12-04 13:51:29.930695 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-12-04 13:51:29.930758 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.052) 0:00:11.010 ***** 2025-12-04 13:51:29.992915 | controller | ok: [instance] 2025-12-04 13:51:29.993007 | controller | 2025-12-04 13:51:29.993147 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-12-04 13:51:29.993254 | controller | Thursday 04 December 2025 13:51:29 +0000 (0:00:00.062) 0:00:11.072 ***** 2025-12-04 13:51:30.041516 | controller | skipping: [instance] 2025-12-04 13:51:30.041609 | controller | 2025-12-04 13:51:30.041734 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-12-04 13:51:30.041839 | controller | Thursday 04 December 2025 13:51:30 +0000 (0:00:00.048) 0:00:11.121 ***** 2025-12-04 13:51:30.088475 | controller | skipping: [instance] 2025-12-04 13:51:30.088584 | controller | 2025-12-04 13:51:30.088686 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-12-04 13:51:30.088788 | controller | Thursday 04 December 2025 13:51:30 +0000 (0:00:00.046) 0:00:11.168 ***** 2025-12-04 13:51:30.131454 | controller | skipping: [instance] 2025-12-04 13:51:30.131498 | controller | 2025-12-04 13:51:30.131694 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-12-04 13:51:30.131708 | controller | Thursday 04 December 2025 13:51:30 +0000 (0:00:00.042) 0:00:11.211 ***** 2025-12-04 13:51:30.177630 | controller | skipping: [instance] 2025-12-04 13:51:30.177702 | controller | 2025-12-04 13:51:30.177803 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-12-04 13:51:30.177944 | controller | Thursday 04 December 2025 13:51:30 +0000 (0:00:00.046) 0:00:11.257 ***** 2025-12-04 13:51:30.226672 | controller | skipping: [instance] 2025-12-04 13:51:30.226778 | controller | 2025-12-04 13:51:30.226875 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-12-04 13:51:30.227000 | controller | Thursday 04 December 2025 13:51:30 +0000 (0:00:00.049) 0:00:11.306 ***** 2025-12-04 13:51:30.283013 | controller | skipping: [instance] 2025-12-04 13:51:30.283123 | controller | 2025-12-04 13:51:30.283221 | controller | TASK [Mark failure] ************************************************************ 2025-12-04 13:51:30.283324 | controller | Thursday 04 December 2025 13:51:30 +0000 (0:00:00.056) 0:00:11.362 ***** 2025-12-04 13:51:30.326177 | controller | skipping: [instance] 2025-12-04 13:51:30.326261 | controller | 2025-12-04 13:51:30.326384 | controller | TASK [Display error message] *************************************************** 2025-12-04 13:51:30.326502 | controller | Thursday 04 December 2025 13:51:30 +0000 (0:00:00.043) 0:00:11.406 ***** 2025-12-04 13:51:30.368720 | controller | skipping: [instance] 2025-12-04 13:51:30.368805 | controller | 2025-12-04 13:51:30.368906 | controller | TASK [Append failed scenario to list] ****************************************** 2025-12-04 13:51:30.369031 | controller | Thursday 04 December 2025 13:51:30 +0000 (0:00:00.042) 0:00:11.448 ***** 2025-12-04 13:51:30.410038 | controller | skipping: [instance] 2025-12-04 13:51:30.410121 | controller | 2025-12-04 13:51:30.410235 | controller | TASK [Fail if needed] ********************************************************** 2025-12-04 13:51:30.410475 | controller | Thursday 04 December 2025 13:51:30 +0000 (0:00:00.041) 0:00:11.489 ***** 2025-12-04 13:51:30.478593 | controller | skipping: [instance] 2025-12-04 13:51:30.478696 | controller | 2025-12-04 13:51:30.478797 | controller | PLAY RECAP ********************************************************************* 2025-12-04 13:51:30.478923 | controller | instance : ok=129 changed=0 unreachable=0 failed=0 skipped=85 rescued=7 ignored=0 2025-12-04 13:51:30.479037 | controller | 2025-12-04 13:51:30.479135 | controller | Thursday 04 December 2025 13:51:30 +0000 (0:00:00.067) 0:00:11.557 ***** 2025-12-04 13:51:30.479231 | controller | =============================================================================== 2025-12-04 13:51:30.479370 | controller | reproducer : Ensure we get required data in the layout description ------ 0.17s 2025-12-04 13:51:30.479480 | controller | reproducer : Ensure created amount matches at least allocated amounts --- 0.16s 2025-12-04 13:51:30.479632 | controller | reproducer : Ensure we get disk_size ------------------------------------ 0.13s 2025-12-04 13:51:30.479679 | controller | Test no volumes --------------------------------------------------------- 0.10s 2025-12-04 13:51:30.479774 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.10s 2025-12-04 13:51:30.479872 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.09s 2025-12-04 13:51:30.479989 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.09s 2025-12-04 13:51:30.480111 | controller | reproducer : Ensure created amount matches at least allocated amounts --- 0.09s 2025-12-04 13:51:30.480208 | controller | reproducer : Ensure we get required data in the layout description ------ 0.09s 2025-12-04 13:51:30.480293 | controller | Validate data ----------------------------------------------------------- 0.09s 2025-12-04 13:51:30.480384 | controller | reproducer : Ensure we don't set some parameters when no extra disks ---- 0.09s 2025-12-04 13:51:30.480490 | controller | reproducer : Ensure we get required data in the layout description ------ 0.08s 2025-12-04 13:51:30.480634 | controller | Display error message --------------------------------------------------- 0.08s 2025-12-04 13:51:30.480675 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.08s 2025-12-04 13:51:30.480772 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.08s 2025-12-04 13:51:30.480864 | controller | reproducer : Ensure we get required data in the layout description ------ 0.08s 2025-12-04 13:51:30.480979 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.08s 2025-12-04 13:51:30.481095 | controller | reproducer : Ensure we get required data in the layout description ------ 0.08s 2025-12-04 13:51:30.481192 | controller | reproducer : Ensure we get required data in the layout description ------ 0.08s 2025-12-04 13:51:30.481305 | controller | Validate data ----------------------------------------------------------- 0.08s 2025-12-04 13:51:30.595272 | controller | INFO Running ocp_validations > cleanup 2025-12-04 13:51:30.595704 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-04 13:51:30.596467 | controller | INFO Writing /tmp/report.html report. 2025-12-04 13:51:30.761027 | [controller] Waiting on logger 2025-12-04 13:51:35.922343 | [controller] Waiting on logger 2025-12-04 13:51:46.354492 | [controller] Waiting on logger 2025-12-04 13:51:56.786582 | [controller] Waiting on logger 2025-12-04 13:52:00.757490 | [Zuul] Log Stream did not terminate 2025-12-04 13:52:00.757819 | controller | changed 2025-12-04 13:52:00.805841 | 2025-12-04 13:52:00.805901 | PLAY RECAP 2025-12-04 13:52:00.805986 | controller | ok: 4 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-12-04 13:52:00.806018 | 2025-12-04 13:52:00.868981 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-12-04 13:52:00.869700 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-12-04 13:52:01.342567 | 2025-12-04 13:52:01.342661 | PLAY [Run ci/playbooks/collect-logs.yml] 2025-12-04 13:52:01.361113 | 2025-12-04 13:52:01.361180 | TASK [Filter out host if needed] 2025-12-04 13:52:01.368865 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2025-12-04 13:52:01.373067 | 2025-12-04 13:52:01.373129 | TASK [Ensure file is present] 2025-12-04 13:52:01.776159 | controller | ok 2025-12-04 13:52:01.782676 | 2025-12-04 13:52:01.782739 | TASK [Manage molecule report file] 2025-12-04 13:52:01.801666 | [controller] Waiting on logger 2025-12-04 13:52:11.186583 | [controller] Waiting on logger 2025-12-04 13:52:21.618392 | [controller] Waiting on logger 2025-12-04 13:52:30.962519 | [controller] Waiting on logger 2025-12-04 13:52:32.174784 | [Zuul] Log Stream did not terminate 2025-12-04 13:52:32.175043 | controller | changed 2025-12-04 13:52:32.180454 | 2025-12-04 13:52:32.180517 | TASK [Check if we get ci-framework-data basedir] 2025-12-04 13:52:32.483767 | controller | ok 2025-12-04 13:52:32.488825 | 2025-12-04 13:52:32.488928 | TASK [Create ci-framework-data log directory for zuul] 2025-12-04 13:52:32.872565 | controller | changed 2025-12-04 13:52:32.878074 | 2025-12-04 13:52:32.878141 | TASK [Copy ci-framework interesting files] 2025-12-04 13:52:32.900473 | [controller] Waiting on logger 2025-12-04 13:52:43.314569 | [controller] Waiting on logger 2025-12-04 13:52:53.746502 | [controller] Waiting on logger 2025-12-04 13:53:03.090504 | [controller] Waiting on logger 2025-12-04 13:53:03.202357 | [Zuul] Log Stream did not terminate 2025-12-04 13:53:03.202630 | controller | changed 2025-12-04 13:53:03.207972 | 2025-12-04 13:53:03.208035 | TASK [Get SELinux listing] 2025-12-04 13:53:04.242559 | [controller] Waiting on logger 2025-12-04 13:53:16.722530 | [controller] Waiting on logger 2025-12-04 13:53:26.066549 | [controller] Waiting on logger 2025-12-04 13:53:33.508024 | [Zuul] Log Stream did not terminate 2025-12-04 13:53:33.508289 | controller | changed 2025-12-04 13:53:33.514040 | 2025-12-04 13:53:33.514105 | TASK [Generate log index] 2025-12-04 13:53:34.812331 | controller | changed 2025-12-04 13:53:34.817156 | 2025-12-04 13:53:34.817219 | TASK [Get some env related data] 2025-12-04 13:53:34.837718 | [controller] Waiting on logger 2025-12-04 13:53:45.266541 | [controller] Waiting on logger 2025-12-04 13:53:55.698488 | [controller] Waiting on logger 2025-12-04 13:54:05.042700 | [controller] Waiting on logger 2025-12-04 13:54:06.092843 | [Zuul] Log Stream did not terminate 2025-12-04 13:54:06.093250 | controller | changed 2025-12-04 13:54:06.098541 | 2025-12-04 13:54:06.098609 | TASK [Generate list of logs to collect in home directory] 2025-12-04 13:54:06.460148 | controller | ok: All paths examined 2025-12-04 13:54:06.464903 | 2025-12-04 13:54:06.464985 | LOOP [Copy logs from home directory] 2025-12-04 13:54:07.110020 | controller | changed: 2025-12-04 13:54:07.110217 | controller | { 2025-12-04 13:54:07.110244 | controller | "atime": 1743544925.4788878, 2025-12-04 13:54:07.110264 | controller | "ctime": 1743545329.1409318, 2025-12-04 13:54:07.110293 | controller | "dev": 64513, 2025-12-04 13:54:07.110312 | controller | "gid": 1000, 2025-12-04 13:54:07.110327 | controller | "gr_name": "zuul", 2025-12-04 13:54:07.110343 | controller | "inode": 4518807, 2025-12-04 13:54:07.110358 | controller | "isblk": false, 2025-12-04 13:54:07.110372 | controller | "ischr": false, 2025-12-04 13:54:07.110385 | controller | "isdir": false, 2025-12-04 13:54:07.110399 | controller | "isfifo": false, 2025-12-04 13:54:07.110415 | controller | "isgid": false, 2025-12-04 13:54:07.110430 | controller | "islnk": false, 2025-12-04 13:54:07.110443 | controller | "isreg": true, 2025-12-04 13:54:07.110456 | controller | "issock": false, 2025-12-04 13:54:07.110469 | controller | "isuid": false, 2025-12-04 13:54:07.110482 | controller | "mode": "0644", 2025-12-04 13:54:07.110494 | controller | "mtime": 1743545329.1409318, 2025-12-04 13:54:07.110507 | controller | "nlink": 1, 2025-12-04 13:54:07.110521 | controller | "path": "/home/zuul/crc-setup.log", 2025-12-04 13:54:07.110534 | controller | "pw_name": "zuul", 2025-12-04 13:54:07.110548 | controller | "rgrp": true, 2025-12-04 13:54:07.110561 | controller | "roth": true, 2025-12-04 13:54:07.110574 | controller | "rusr": true, 2025-12-04 13:54:07.110587 | controller | "size": 4108, 2025-12-04 13:54:07.110599 | controller | "uid": 1000, 2025-12-04 13:54:07.110611 | controller | "wgrp": false, 2025-12-04 13:54:07.110622 | controller | "woth": false, 2025-12-04 13:54:07.110633 | controller | "wusr": true, 2025-12-04 13:54:07.110645 | controller | "xgrp": false, 2025-12-04 13:54:07.110665 | controller | "xoth": false, 2025-12-04 13:54:07.110679 | controller | "xusr": false 2025-12-04 13:54:07.110691 | controller | } 2025-12-04 13:54:07.747698 | controller | changed: 2025-12-04 13:54:07.747779 | controller | { 2025-12-04 13:54:07.747805 | controller | "atime": 1743545331.0429637, 2025-12-04 13:54:07.747824 | controller | "ctime": 1743545842.0111232, 2025-12-04 13:54:07.747840 | controller | "dev": 64513, 2025-12-04 13:54:07.747857 | controller | "gid": 1000, 2025-12-04 13:54:07.747873 | controller | "gr_name": "zuul", 2025-12-04 13:54:07.747887 | controller | "inode": 4194437, 2025-12-04 13:54:07.747901 | controller | "isblk": false, 2025-12-04 13:54:07.747938 | controller | "ischr": false, 2025-12-04 13:54:07.747955 | controller | "isdir": false, 2025-12-04 13:54:07.747969 | controller | "isfifo": false, 2025-12-04 13:54:07.747983 | controller | "isgid": false, 2025-12-04 13:54:07.747996 | controller | "islnk": false, 2025-12-04 13:54:07.748009 | controller | "isreg": true, 2025-12-04 13:54:07.748022 | controller | "issock": false, 2025-12-04 13:54:07.748035 | controller | "isuid": false, 2025-12-04 13:54:07.748047 | controller | "mode": "0644", 2025-12-04 13:54:07.748060 | controller | "mtime": 1743545842.0111232, 2025-12-04 13:54:07.748072 | controller | "nlink": 1, 2025-12-04 13:54:07.748085 | controller | "path": "/home/zuul/crc-start.log", 2025-12-04 13:54:07.748098 | controller | "pw_name": "zuul", 2025-12-04 13:54:07.748111 | controller | "rgrp": true, 2025-12-04 13:54:07.748123 | controller | "roth": true, 2025-12-04 13:54:07.748138 | controller | "rusr": true, 2025-12-04 13:54:07.748153 | controller | "size": 4023, 2025-12-04 13:54:07.748167 | controller | "uid": 1000, 2025-12-04 13:54:07.748181 | controller | "wgrp": false, 2025-12-04 13:54:07.748195 | controller | "woth": false, 2025-12-04 13:54:07.748208 | controller | "wusr": true, 2025-12-04 13:54:07.748221 | controller | "xgrp": false, 2025-12-04 13:54:07.748233 | controller | "xoth": false, 2025-12-04 13:54:07.748246 | controller | "xusr": false 2025-12-04 13:54:07.748258 | controller | } 2025-12-04 13:54:08.359532 | controller | changed: 2025-12-04 13:54:08.359589 | controller | { 2025-12-04 13:54:08.359615 | controller | "atime": 1764855705.9466505, 2025-12-04 13:54:08.359633 | controller | "ctime": 1764855721.0356367, 2025-12-04 13:54:08.359666 | controller | "dev": 64513, 2025-12-04 13:54:08.359687 | controller | "gid": 1000, 2025-12-04 13:54:08.359705 | controller | "gr_name": "zuul", 2025-12-04 13:54:08.359723 | controller | "inode": 4686304, 2025-12-04 13:54:08.359738 | controller | "isblk": false, 2025-12-04 13:54:08.359752 | controller | "ischr": false, 2025-12-04 13:54:08.359766 | controller | "isdir": false, 2025-12-04 13:54:08.359780 | controller | "isfifo": false, 2025-12-04 13:54:08.359793 | controller | "isgid": false, 2025-12-04 13:54:08.359807 | controller | "islnk": false, 2025-12-04 13:54:08.359820 | controller | "isreg": true, 2025-12-04 13:54:08.359834 | controller | "issock": false, 2025-12-04 13:54:08.359848 | controller | "isuid": false, 2025-12-04 13:54:08.359861 | controller | "mode": "0644", 2025-12-04 13:54:08.359875 | controller | "mtime": 1764855721.0356367, 2025-12-04 13:54:08.359889 | controller | "nlink": 1, 2025-12-04 13:54:08.359903 | controller | "path": "/home/zuul/ansible.log", 2025-12-04 13:54:08.359941 | controller | "pw_name": "zuul", 2025-12-04 13:54:08.359959 | controller | "rgrp": true, 2025-12-04 13:54:08.359974 | controller | "roth": true, 2025-12-04 13:54:08.359988 | controller | "rusr": true, 2025-12-04 13:54:08.360001 | controller | "size": 6749, 2025-12-04 13:54:08.360014 | controller | "uid": 1000, 2025-12-04 13:54:08.360026 | controller | "wgrp": false, 2025-12-04 13:54:08.360039 | controller | "woth": false, 2025-12-04 13:54:08.360051 | controller | "wusr": true, 2025-12-04 13:54:08.360064 | controller | "xgrp": false, 2025-12-04 13:54:08.360076 | controller | "xoth": false, 2025-12-04 13:54:08.360088 | controller | "xusr": false 2025-12-04 13:54:08.360101 | controller | } 2025-12-04 13:54:08.366946 | 2025-12-04 13:54:08.367014 | TASK [Copy crio stats log file] 2025-12-04 13:54:08.380870 | controller | skipping: Conditional result was False 2025-12-04 13:54:08.385867 | 2025-12-04 13:54:08.385945 | TASK [Get SELinux related data] 2025-12-04 13:54:08.406018 | [controller] Waiting on logger 2025-12-04 13:54:14.629342 | controller | ERROR 2025-12-04 13:54:14.629514 | controller | { 2025-12-04 13:54:14.629543 | controller | "delta": "0:00:00.011215", 2025-12-04 13:54:14.629561 | controller | "end": "2025-12-04 13:54:08.688131", 2025-12-04 13:54:14.629578 | controller | "msg": "non-zero return code", 2025-12-04 13:54:14.629595 | controller | "rc": 1, 2025-12-04 13:54:14.629611 | controller | "start": "2025-12-04 13:54:08.676916" 2025-12-04 13:54:14.629625 | controller | } 2025-12-04 13:54:14.629645 | controller | ERROR: Ignoring Errors 2025-12-04 13:54:14.634297 | 2025-12-04 13:54:14.634363 | TASK [Create system configuration directory] 2025-12-04 13:54:14.955991 | controller | changed 2025-12-04 13:54:14.960484 | 2025-12-04 13:54:14.960543 | TASK [Get some of the system configurations] 2025-12-04 13:54:14.979679 | [controller] Waiting on logger 2025-12-04 13:54:25.394330 | [controller] Waiting on logger 2025-12-04 13:54:34.774964 | [controller] Waiting on logger 2025-12-04 13:54:45.170624 | [controller] Waiting on logger 2025-12-04 13:54:45.311088 | [Zuul] Log Stream did not terminate 2025-12-04 13:54:45.311273 | controller | changed 2025-12-04 13:54:45.316316 | 2025-12-04 13:54:45.316378 | TASK [Copy generated documentation if available] 2025-12-04 13:54:45.329570 | controller | skipping: Conditional result was False 2025-12-04 13:54:45.335220 | 2025-12-04 13:54:45.335284 | TASK [Copy generated AsciiDoc documentation if available] 2025-12-04 13:54:45.348336 | controller | skipping: Conditional result was False 2025-12-04 13:54:45.353382 | 2025-12-04 13:54:45.353444 | TASK [Compress logs bigger than 2MB] 2025-12-04 13:54:48.434961 | [controller] Waiting on logger 2025-12-04 13:55:00.914408 | [controller] Waiting on logger 2025-12-04 13:55:11.346612 | [controller] Waiting on logger 2025-12-04 13:55:15.654464 | [Zuul] Log Stream did not terminate 2025-12-04 13:55:15.654754 | controller | changed 2025-12-04 13:55:15.659884 | 2025-12-04 13:55:15.659962 | TASK [Copy files from workspace on node] 2025-12-04 13:55:15.677456 | controller | ok 2025-12-04 13:55:15.698828 | 2025-12-04 13:55:15.698894 | TASK [fetch-output : Set log path for multiple nodes] 2025-12-04 13:55:15.711991 | controller | skipping: Conditional result was False 2025-12-04 13:55:15.717217 | 2025-12-04 13:55:15.717282 | TASK [fetch-output : Set log path for single node] 2025-12-04 13:55:15.744645 | controller | ok 2025-12-04 13:55:15.749088 | 2025-12-04 13:55:15.749148 | LOOP [fetch-output : Ensure local output dirs] 2025-12-04 13:55:15.927344 | controller -> localhost | ok: "/var/lib/zuul/builds/e88577a964ae4ccc9a1175c8e14d229c/work/logs" 2025-12-04 13:55:15.927535 | controller -> localhost | changed: All items complete 2025-12-04 13:55:15.927564 | 2025-12-04 13:55:16.099762 | controller -> localhost | changed: "/var/lib/zuul/builds/e88577a964ae4ccc9a1175c8e14d229c/work/artifacts" 2025-12-04 13:55:16.268521 | controller -> localhost | changed: "/var/lib/zuul/builds/e88577a964ae4ccc9a1175c8e14d229c/work/docs" 2025-12-04 13:55:16.284362 | 2025-12-04 13:55:16.284459 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-12-04 13:55:16.944561 | controller | changed: 2025-12-04 13:55:16.944729 | controller | .d..t...... ./ 2025-12-04 13:55:16.944756 | controller | >f+++++++++ README.html 2025-12-04 13:55:16.944777 | controller | >f+++++++++ ansible-execution.log 2025-12-04 13:55:16.944796 | controller | >f+++++++++ ansible.log 2025-12-04 13:55:16.944814 | controller | >f+++++++++ crc-setup.log 2025-12-04 13:55:16.944829 | controller | >f+++++++++ crc-start.log 2025-12-04 13:55:16.944845 | controller | >f+++++++++ dmesg.log 2025-12-04 13:55:16.944862 | controller | >f+++++++++ installed-pkgs.log 2025-12-04 13:55:16.944877 | controller | >f+++++++++ python.log 2025-12-04 13:55:16.944892 | controller | >f+++++++++ registries.conf 2025-12-04 13:55:16.944922 | controller | >f+++++++++ report.html 2025-12-04 13:55:16.944943 | controller | >f+++++++++ selinux-denials.log 2025-12-04 13:55:16.944961 | controller | >f+++++++++ selinux-listing.log 2025-12-04 13:55:16.944978 | controller | cd+++++++++ ci-framework-data/ 2025-12-04 13:55:16.944993 | controller | cd+++++++++ ci-framework-data/artifacts/ 2025-12-04 13:55:16.945009 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2025-12-04 13:55:16.945025 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2025-12-04 13:55:16.945040 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2025-12-04 13:55:16.945055 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2025-12-04 13:55:16.945069 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2025-12-04 13:55:16.945082 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2025-12-04 13:55:16.945096 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2025-12-04 13:55:16.945110 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2025-12-04 13:55:16.945125 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2025-12-04 13:55:16.945140 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2025-12-04 13:55:16.945154 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2025-12-04 13:55:16.945168 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2025-12-04 13:55:16.945182 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2025-12-04 13:55:16.945196 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:a3:cb:98 2025-12-04 13:55:16.945210 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:18:b7:34 2025-12-04 13:55:16.945225 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:bf:0a:45 2025-12-04 13:55:16.945244 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:58:86:ae 2025-12-04 13:55:16.945259 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:ab:09:fe 2025-12-04 13:55:16.945274 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:43:b8:f7 2025-12-04 13:55:16.945288 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2025-12-04 13:55:16.945302 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2025-12-04 13:55:16.945317 | controller | cd+++++++++ ci-framework-data/logs/ 2025-12-04 13:55:16.945331 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2025-12-04 13:55:16.945345 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2025-12-04 13:55:16.945358 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2025-12-04 13:55:16.945372 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2025-12-04 13:55:16.945385 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2025-12-04 13:55:16.945402 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2025-12-04 13:55:16.945418 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2025-12-04 13:55:16.945433 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2025-12-04 13:55:16.945447 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2025-12-04 13:55:16.945461 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2025-12-04 13:55:16.945475 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2025-12-04 13:55:16.945489 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2025-12-04 13:55:16.945506 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2025-12-04 13:55:16.945521 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2025-12-04 13:55:16.945535 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2025-12-04 13:55:16.945549 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2025-12-04 13:55:16.945562 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2025-12-04 13:55:16.945577 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2025-12-04 13:55:16.945591 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2025-12-04 13:55:16.945604 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2025-12-04 13:55:16.945618 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2025-12-04 13:55:16.945632 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2025-12-04 13:55:16.945645 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2025-12-04 13:55:16.945669 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2025-12-04 13:55:16.945684 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2025-12-04 13:55:16.945701 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2025-12-04 13:55:16.945715 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2025-12-04 13:55:16.945729 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2025-12-04 13:55:16.945743 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2025-12-04 13:55:16.945758 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2025-12-04 13:55:16.945771 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2025-12-04 13:55:16.945785 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2025-12-04 13:55:16.945799 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2025-12-04 13:55:16.945813 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2025-12-04 13:55:16.945826 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2025-12-04 13:55:16.945839 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2025-12-04 13:55:16.945853 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2025-12-04 13:55:16.945866 | controller | cd+++++++++ registries.conf.d/ 2025-12-04 13:55:16.945880 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2025-12-04 13:55:16.945893 | controller | cd+++++++++ system-config/ 2025-12-04 13:55:16.945923 | controller | cd+++++++++ system-config/libvirt/ 2025-12-04 13:55:16.945946 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2025-12-04 13:55:16.945963 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2025-12-04 13:55:16.945978 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2025-12-04 13:55:16.945993 | controller | >f+++++++++ system-config/libvirt/network.conf 2025-12-04 13:55:16.946008 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2025-12-04 13:55:16.946023 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2025-12-04 13:55:16.946037 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2025-12-04 13:55:16.946051 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2025-12-04 13:55:16.946065 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2025-12-04 13:55:16.946079 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2025-12-04 13:55:16.946092 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2025-12-04 13:55:16.946106 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2025-12-04 13:55:16.946120 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2025-12-04 13:55:16.946134 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2025-12-04 13:55:16.946148 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2025-12-04 13:55:16.946163 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2025-12-04 13:55:17.398660 | controller | changed: .d..t...... ./ 2025-12-04 13:55:17.843606 | controller | changed: .d..t...... ./ 2025-12-04 13:55:17.860811 | 2025-12-04 13:55:17.860880 | TASK [Return artifact to Zuul] 2025-12-04 13:55:17.888619 | controller | ok 2025-12-04 13:55:17.906819 | 2025-12-04 13:55:17.906875 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2025-12-04 13:55:17.906999 | 2025-12-04 13:55:17.907032 | PLAY RECAP 2025-12-04 13:55:17.907075 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2025-12-04 13:55:17.907097 | 2025-12-04 13:55:17.981792 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-12-04 13:55:17.982493 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-12-04 13:55:18.477932 | 2025-12-04 13:55:18.478029 | PLAY [all] 2025-12-04 13:55:18.495149 | 2025-12-04 13:55:18.495216 | TASK [include_role : fetch-output] 2025-12-04 13:55:18.523134 | controller | ok 2025-12-04 13:55:18.539421 | 2025-12-04 13:55:18.539499 | TASK [fetch-output : Set log path for multiple nodes] 2025-12-04 13:55:18.583476 | controller | skipping: Conditional result was False 2025-12-04 13:55:18.588929 | 2025-12-04 13:55:18.589000 | TASK [fetch-output : Set log path for single node] 2025-12-04 13:55:18.616732 | controller | ok 2025-12-04 13:55:18.621574 | 2025-12-04 13:55:18.621642 | LOOP [fetch-output : Ensure local output dirs] 2025-12-04 13:55:18.921230 | controller -> localhost | ok: "/var/lib/zuul/builds/e88577a964ae4ccc9a1175c8e14d229c/work/logs" 2025-12-04 13:55:19.094215 | controller -> localhost | ok: "/var/lib/zuul/builds/e88577a964ae4ccc9a1175c8e14d229c/work/artifacts" 2025-12-04 13:55:19.258210 | controller -> localhost | ok: "/var/lib/zuul/builds/e88577a964ae4ccc9a1175c8e14d229c/work/docs" 2025-12-04 13:55:19.269286 | 2025-12-04 13:55:19.269360 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-12-04 13:55:19.846537 | controller | ok 2025-12-04 13:55:19.846694 | controller | ok: All items complete 2025-12-04 13:55:19.846722 | 2025-12-04 13:55:20.309048 | controller | ok 2025-12-04 13:55:20.766431 | controller | ok 2025-12-04 13:55:20.781684 | 2025-12-04 13:55:20.781783 | TASK [include_role : fetch-output-openshift] 2025-12-04 13:55:20.794903 | controller | skipping: Conditional result was False 2025-12-04 13:55:20.800387 | 2025-12-04 13:55:20.800458 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2025-12-04 13:55:21.106596 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.005632 2025-12-04 13:55:21.295612 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006490 2025-12-04 13:55:21.323677 | 2025-12-04 13:55:21.323755 | PLAY [all] 2025-12-04 13:55:21.337428 | 2025-12-04 13:55:21.337498 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2025-12-04 13:55:21.824277 | controller | changed 2025-12-04 13:55:21.845725 | 2025-12-04 13:55:21.845776 | PLAY RECAP 2025-12-04 13:55:21.845820 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2025-12-04 13:55:21.845844 | 2025-12-04 13:55:21.911105 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-12-04 13:55:21.911760 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2025-12-04 13:55:22.420993 | 2025-12-04 13:55:22.421097 | PLAY [localhost] 2025-12-04 13:55:22.438426 | 2025-12-04 13:55:22.438500 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2025-12-04 13:55:22.729926 | localhost | changed 2025-12-04 13:55:22.734478 | 2025-12-04 13:55:22.734555 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2025-12-04 13:55:22.751798 | localhost | ok 2025-12-04 13:55:22.759671 | 2025-12-04 13:55:22.759743 | TASK [add-fileserver : Create SSH private key tempfile] 2025-12-04 13:55:23.029700 | localhost | changed 2025-12-04 13:55:23.035393 | 2025-12-04 13:55:23.035460 | TASK [add-fileserver : Create SSH private key from secret] 2025-12-04 13:55:23.537320 | localhost | changed 2025-12-04 13:55:23.541874 | 2025-12-04 13:55:23.542003 | TASK [add-fileserver : Add fileserver ssh key] 2025-12-04 13:55:23.852409 | localhost | Identity added: /var/lib/zuul/builds/e88577a964ae4ccc9a1175c8e14d229c/work/tmp/ansible.kvc05qwl (/var/lib/zuul/builds/e88577a964ae4ccc9a1175c8e14d229c/work/tmp/ansible.kvc05qwl) 2025-12-04 13:55:23.852550 | localhost | ok: Runtime: 0:00:00.005808 2025-12-04 13:55:23.856621 | 2025-12-04 13:55:23.856698 | TASK [add-fileserver : Remove SSH private key from disk] 2025-12-04 13:55:24.055898 | localhost | ok: Runtime: 0:00:00.003810 2025-12-04 13:55:24.060357 | 2025-12-04 13:55:24.060429 | TASK [add-fileserver : Add fileserver to inventory] 2025-12-04 13:55:24.108141 | localhost | changed 2025-12-04 13:55:24.112474 | 2025-12-04 13:55:24.112534 | TASK [add-fileserver : Add fileserver server to known hosts] 2025-12-04 13:55:24.413339 | localhost | changed 2025-12-04 13:55:24.431966 | 2025-12-04 13:55:24.432030 | PLAY [localhost] 2025-12-04 13:55:24.443181 | 2025-12-04 13:55:24.443244 | TASK [Generate bulk log download script] 2025-12-04 13:55:24.461004 | localhost | ok 2025-12-04 13:55:24.471836 | 2025-12-04 13:55:24.471900 | TASK [local-log-download : Check API endpoint is defined] 2025-12-04 13:55:24.499007 | localhost | ok: All assertions passed 2025-12-04 13:55:24.503239 | 2025-12-04 13:55:24.503301 | TASK [local-log-download : Create download script] 2025-12-04 13:55:24.840210 | localhost -> localhost | changed 2025-12-04 13:55:24.848758 | 2025-12-04 13:55:24.848825 | TASK [Register quick-download link] 2025-12-04 13:55:24.865634 | localhost | ok 2025-12-04 13:55:24.898339 | 2025-12-04 13:55:24.898414 | PLAY [logserver.rdoproject.org] 2025-12-04 13:55:24.907492 | 2025-12-04 13:55:24.907550 | TASK [Set zuul-log-path fact] 2025-12-04 13:55:24.922869 | logserver.rdoproject.org | ok 2025-12-04 13:55:24.931568 | 2025-12-04 13:55:24.931634 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-12-04 13:55:24.947622 | logserver.rdoproject.org | ok 2025-12-04 13:55:24.952364 | 2025-12-04 13:55:24.952427 | TASK [upload-logs : Create log directories] 2025-12-04 13:55:26.532306 | logserver.rdoproject.org | changed 2025-12-04 13:55:26.535297 | 2025-12-04 13:55:26.535360 | TASK [upload-logs : Ensure logs are readable before uploading] 2025-12-04 13:55:26.750693 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.005464 2025-12-04 13:55:26.755168 | 2025-12-04 13:55:26.755233 | TASK [upload-logs : Upload logs to log server] 2025-12-04 13:55:28.250778 | logserver.rdoproject.org | Output suppressed because no_log was given 2025-12-04 13:55:28.253669 | 2025-12-04 13:55:28.253733 | LOOP [upload-logs : Compress console log and json output] 2025-12-04 13:55:28.290541 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-04 13:55:28.298640 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-04 13:55:28.310769 | 2025-12-04 13:55:28.310852 | LOOP [upload-logs : Upload compressed console log and json output] 2025-12-04 13:55:28.341564 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-04 13:55:28.342294 | 2025-12-04 13:55:28.345751 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-04 13:55:28.357124 | 2025-12-04 13:55:28.357202 | LOOP [upload-logs : Upload console log and json output]