2025-11-26 13:01:57.946869 | Job console starting... 2025-11-26 13:01:58.155760 | Updating repositories 2025-11-26 13:01:58.903736 | Preparing job workspace 2025-11-26 13:02:06.115464 | Running Ansible setup... 2025-11-26 13:02:09.705811 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-11-26 13:02:10.220737 | 2025-11-26 13:02:10.220858 | PLAY [localhost] 2025-11-26 13:02:10.229237 | 2025-11-26 13:02:10.229307 | TASK [Gathering Facts] 2025-11-26 13:02:11.023304 | localhost | ok 2025-11-26 13:02:11.040323 | 2025-11-26 13:02:11.040438 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2025-11-26 13:02:11.358768 | localhost -> localhost | changed 2025-11-26 13:02:11.364068 | 2025-11-26 13:02:11.364140 | TASK [log-inventory : Copy ansible inventory to logs dir] 2025-11-26 13:02:12.065628 | localhost -> localhost | changed 2025-11-26 13:02:12.073675 | 2025-11-26 13:02:12.073743 | TASK [Setup log path fact] 2025-11-26 13:02:12.091532 | localhost | ok 2025-11-26 13:02:12.103336 | 2025-11-26 13:02:12.103412 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-11-26 13:02:12.120398 | localhost | ok 2025-11-26 13:02:12.128051 | 2025-11-26 13:02:12.128120 | TASK [emit-job-header : Print job information] 2025-11-26 13:02:12.155178 | # Job Information 2025-11-26 13:02:12.155285 | Ansible Version: 2.15.12 2025-11-26 13:02:12.155316 | Job: cifmw-molecule-reproducer 2025-11-26 13:02:12.155340 | Pipeline: github-check 2025-11-26 13:02:12.155361 | Executor: ibm-bm4-ze.softwarefactory-project.io 2025-11-26 13:02:12.155382 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3505 2025-11-26 13:02:12.155402 | Log URL (when completed): https://logserver.rdoproject.org/73d/rdoproject.org/73d0e05660c2474e8e0c4a335bc18c73/ 2025-11-26 13:02:12.155422 | Event ID: f60e99a0-cac7-11f0-9616-c92b2331d00d 2025-11-26 13:02:12.158876 | 2025-11-26 13:02:12.158957 | LOOP [emit-job-header : Print node information] 2025-11-26 13:02:12.244047 | localhost | ok: 2025-11-26 13:02:12.244246 | localhost | # Node Information 2025-11-26 13:02:12.244279 | localhost | Inventory Hostname: controller 2025-11-26 13:02:12.244309 | localhost | Hostname: np0005536702 2025-11-26 13:02:12.244405 | localhost | Username: zuul 2025-11-26 13:02:12.244454 | localhost | Distro: CentOS 9 2025-11-26 13:02:12.244482 | localhost | Provider: ibm-bm4-nodepool 2025-11-26 13:02:12.244508 | localhost | Region: regionOne 2025-11-26 13:02:12.244525 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2025-11-26 13:02:12.244542 | localhost | Product Name: OpenStack Compute 2025-11-26 13:02:12.244558 | localhost | Interface IP: 192.168.26.85 2025-11-26 13:02:12.271985 | 2025-11-26 13:02:12.272063 | PLAY [all] 2025-11-26 13:02:12.278195 | 2025-11-26 13:02:12.278256 | TASK [Gather network facts] 2025-11-26 13:02:12.691786 | controller | ok 2025-11-26 13:02:12.705805 | 2025-11-26 13:02:12.705870 | TASK [include_role : start-zuul-console] 2025-11-26 13:02:12.723960 | controller | ok 2025-11-26 13:02:12.735132 | 2025-11-26 13:02:12.735200 | TASK [start-zuul-console : Start zuul_console daemon.] 2025-11-26 13:02:13.095652 | controller | ok 2025-11-26 13:02:13.104118 | 2025-11-26 13:02:13.104181 | TASK [include_role : add-build-sshkey] 2025-11-26 13:02:13.122103 | controller | ok 2025-11-26 13:02:13.134617 | 2025-11-26 13:02:13.134684 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2025-11-26 13:02:13.320141 | controller -> localhost | ok 2025-11-26 13:02:13.325276 | 2025-11-26 13:02:13.325344 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2025-11-26 13:02:13.344009 | controller | ok 2025-11-26 13:02:13.355831 | controller | included: /var/lib/zuul/builds/73d0e05660c2474e8e0c4a335bc18c73/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2025-11-26 13:02:13.361582 | 2025-11-26 13:02:13.361647 | TASK [add-build-sshkey : Create Temp SSH key] 2025-11-26 13:02:13.861570 | controller -> localhost | Generating public/private rsa key pair. 2025-11-26 13:02:13.861732 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/73d0e05660c2474e8e0c4a335bc18c73/work/73d0e05660c2474e8e0c4a335bc18c73_id_rsa. 2025-11-26 13:02:13.861768 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/73d0e05660c2474e8e0c4a335bc18c73/work/73d0e05660c2474e8e0c4a335bc18c73_id_rsa.pub. 2025-11-26 13:02:13.861795 | controller -> localhost | The key fingerprint is: 2025-11-26 13:02:13.861818 | controller -> localhost | SHA256:T5mwNlBZb4SqpH6gyWkHE9MXmHee/j58r327Z+pcu9Q zuul-build-sshkey 2025-11-26 13:02:13.861840 | controller -> localhost | The key's randomart image is: 2025-11-26 13:02:13.861861 | controller -> localhost | +---[RSA 3072]----+ 2025-11-26 13:02:13.861881 | controller -> localhost | | o .o... | 2025-11-26 13:02:13.861901 | controller -> localhost | | o o.o .o | 2025-11-26 13:02:13.861964 | controller -> localhost | | . ..+.o o | 2025-11-26 13:02:13.861991 | controller -> localhost | | o . o.+o + | 2025-11-26 13:02:13.862021 | controller -> localhost | | o + oS + | 2025-11-26 13:02:13.862044 | controller -> localhost | | o o ...+ .| 2025-11-26 13:02:13.862065 | controller -> localhost | | . B . o. .E| 2025-11-26 13:02:13.862085 | controller -> localhost | | * o . + .o..=| 2025-11-26 13:02:13.862104 | controller -> localhost | | . . . ..o.+*O=| 2025-11-26 13:02:13.862122 | controller -> localhost | +----[SHA256]-----+ 2025-11-26 13:02:13.862170 | controller -> localhost | ok: Runtime: 0:00:00.161554 2025-11-26 13:02:13.867850 | 2025-11-26 13:02:13.867941 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2025-11-26 13:02:13.886460 | controller | ok 2025-11-26 13:02:13.895666 | controller | included: /var/lib/zuul/builds/73d0e05660c2474e8e0c4a335bc18c73/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2025-11-26 13:02:13.903629 | 2025-11-26 13:02:13.903706 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2025-11-26 13:02:13.917177 | controller | skipping: Conditional result was False 2025-11-26 13:02:13.922632 | 2025-11-26 13:02:13.922699 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2025-11-26 13:02:14.386390 | controller | changed 2025-11-26 13:02:14.390933 | 2025-11-26 13:02:14.390998 | TASK [add-build-sshkey : Make sure user has a .ssh] 2025-11-26 13:02:14.641422 | controller | ok 2025-11-26 13:02:14.646209 | 2025-11-26 13:02:14.646272 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2025-11-26 13:02:15.656848 | controller | changed 2025-11-26 13:02:15.661779 | 2025-11-26 13:02:15.661852 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2025-11-26 13:02:16.682640 | controller | changed 2025-11-26 13:02:16.687376 | 2025-11-26 13:02:16.687441 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2025-11-26 13:02:16.701040 | controller | skipping: Conditional result was False 2025-11-26 13:02:16.706212 | 2025-11-26 13:02:16.706278 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2025-11-26 13:02:17.004251 | controller -> localhost | changed 2025-11-26 13:02:17.013862 | 2025-11-26 13:02:17.013954 | TASK [add-build-sshkey : Add back temp key] 2025-11-26 13:02:17.230257 | controller -> localhost | Identity added: /var/lib/zuul/builds/73d0e05660c2474e8e0c4a335bc18c73/work/73d0e05660c2474e8e0c4a335bc18c73_id_rsa (zuul-build-sshkey) 2025-11-26 13:02:17.230435 | controller -> localhost | ok: Runtime: 0:00:00.006854 2025-11-26 13:02:17.235896 | 2025-11-26 13:02:17.235980 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2025-11-26 13:02:17.577480 | controller | ok 2025-11-26 13:02:17.581919 | 2025-11-26 13:02:17.581983 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2025-11-26 13:02:17.605427 | controller | skipping: Conditional result was False 2025-11-26 13:02:17.614054 | 2025-11-26 13:02:17.614117 | TASK [include_role : validate-host] 2025-11-26 13:02:17.631808 | controller | ok 2025-11-26 13:02:17.650032 | 2025-11-26 13:02:17.650107 | TASK [validate-host : Define zuul_info_dir fact] 2025-11-26 13:02:17.677732 | controller | ok 2025-11-26 13:02:17.682097 | 2025-11-26 13:02:17.682160 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2025-11-26 13:02:17.877471 | controller -> localhost | ok 2025-11-26 13:02:17.883067 | 2025-11-26 13:02:17.883135 | TASK [validate-host : Collect information about the host] 2025-11-26 13:02:18.565922 | controller | ok 2025-11-26 13:02:18.573690 | 2025-11-26 13:02:18.573756 | TASK [validate-host : Sanitize hostname] 2025-11-26 13:02:18.611408 | controller | ok 2025-11-26 13:02:18.616035 | 2025-11-26 13:02:18.616101 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2025-11-26 13:02:18.983639 | controller -> localhost | changed 2025-11-26 13:02:18.988868 | 2025-11-26 13:02:18.988953 | TASK [validate-host : Collect information about zuul worker] 2025-11-26 13:02:19.363392 | controller | ok 2025-11-26 13:02:19.368165 | 2025-11-26 13:02:19.368237 | TASK [validate-host : Write out all zuul information for each host] 2025-11-26 13:02:19.717406 | controller -> localhost | changed 2025-11-26 13:02:19.726851 | 2025-11-26 13:02:19.726935 | TASK [include_role : prepare-workspace-openshift] 2025-11-26 13:02:19.740080 | controller | skipping: Conditional result was False 2025-11-26 13:02:19.744838 | 2025-11-26 13:02:19.744901 | TASK [include_role : remove-zuul-sshkey] 2025-11-26 13:02:19.757984 | controller | skipping: Conditional result was False 2025-11-26 13:02:19.763500 | 2025-11-26 13:02:19.763564 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2025-11-26 13:02:20.013222 | controller | ok: "logs" 2025-11-26 13:02:20.013445 | controller | ok: All items complete 2025-11-26 13:02:20.013475 | 2025-11-26 13:02:20.231423 | controller | ok: "artifacts" 2025-11-26 13:02:20.449273 | controller | ok: "docs" 2025-11-26 13:02:20.463343 | 2025-11-26 13:02:20.463410 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2025-11-26 13:02:20.711553 | controller | changed: "logs" 2025-11-26 13:02:20.933941 | controller | changed: "artifacts" 2025-11-26 13:02:21.159932 | controller | changed: "docs" 2025-11-26 13:02:21.187435 | 2025-11-26 13:02:21.187488 | PLAY RECAP 2025-11-26 13:02:21.187532 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-11-26 13:02:21.187559 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-11-26 13:02:21.187579 | 2025-11-26 13:02:21.260674 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-11-26 13:02:21.261462 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-11-26 13:02:21.793886 | 2025-11-26 13:02:21.794004 | PLAY [all] 2025-11-26 13:02:21.813133 | 2025-11-26 13:02:21.813208 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-11-26 13:02:21.861645 | controller | ok 2025-11-26 13:02:21.866562 | 2025-11-26 13:02:21.866660 | TASK [mirror-info-fork : Create /etc/ci] 2025-11-26 13:02:22.260716 | controller | changed 2025-11-26 13:02:22.266292 | 2025-11-26 13:02:22.266363 | TASK [mirror-info-fork : Install ci_mirror script] 2025-11-26 13:02:23.520514 | controller | changed 2025-11-26 13:02:23.530351 | 2025-11-26 13:02:23.530422 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2025-11-26 13:02:23.985283 | controller | changed: 2025-11-26 13:02:23.985583 | controller | { 2025-11-26 13:02:23.985624 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2025-11-26 13:02:23.985656 | controller | } 2025-11-26 13:02:24.306022 | controller | changed: 2025-11-26 13:02:24.306110 | controller | { 2025-11-26 13:02:24.306139 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2025-11-26 13:02:24.306161 | controller | } 2025-11-26 13:02:24.605743 | controller | changed: 2025-11-26 13:02:24.605819 | controller | { 2025-11-26 13:02:24.605847 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2025-11-26 13:02:24.605868 | controller | } 2025-11-26 13:02:24.906356 | controller | changed: 2025-11-26 13:02:24.906427 | controller | { 2025-11-26 13:02:24.906456 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2025-11-26 13:02:24.906489 | controller | } 2025-11-26 13:02:25.197310 | controller | changed: 2025-11-26 13:02:25.197470 | controller | { 2025-11-26 13:02:25.197507 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2025-11-26 13:02:25.197536 | controller | } 2025-11-26 13:02:25.490277 | controller | changed: 2025-11-26 13:02:25.490407 | controller | { 2025-11-26 13:02:25.490440 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2025-11-26 13:02:25.490463 | controller | } 2025-11-26 13:02:25.784032 | controller | changed: 2025-11-26 13:02:25.784208 | controller | { 2025-11-26 13:02:25.784329 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2025-11-26 13:02:25.784366 | controller | } 2025-11-26 13:02:26.070668 | controller | changed: 2025-11-26 13:02:26.070778 | controller | { 2025-11-26 13:02:26.070808 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2025-11-26 13:02:26.070831 | controller | } 2025-11-26 13:02:26.359465 | controller | changed: 2025-11-26 13:02:26.359523 | controller | { 2025-11-26 13:02:26.359549 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2025-11-26 13:02:26.359570 | controller | } 2025-11-26 13:02:26.671188 | controller | changed: 2025-11-26 13:02:26.671255 | controller | { 2025-11-26 13:02:26.671280 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2025-11-26 13:02:26.671299 | controller | } 2025-11-26 13:02:26.962988 | controller | changed: 2025-11-26 13:02:26.963084 | controller | { 2025-11-26 13:02:26.963112 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2025-11-26 13:02:26.963133 | controller | } 2025-11-26 13:02:27.261725 | controller | changed: 2025-11-26 13:02:27.261818 | controller | { 2025-11-26 13:02:27.261845 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2025-11-26 13:02:27.261865 | controller | } 2025-11-26 13:02:27.558045 | controller | changed: 2025-11-26 13:02:27.558143 | controller | { 2025-11-26 13:02:27.558170 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGpU/BepK3qX0NRf5Np+dOBDqzQEefhNrw2DCZaH3uWW rebtoor@monolith" 2025-11-26 13:02:27.558192 | controller | } 2025-11-26 13:02:27.863414 | controller | changed: 2025-11-26 13:02:27.863521 | controller | { 2025-11-26 13:02:27.863556 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2025-11-26 13:02:27.863583 | controller | } 2025-11-26 13:02:28.167241 | controller | changed: 2025-11-26 13:02:28.167337 | controller | { 2025-11-26 13:02:28.167365 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2025-11-26 13:02:28.167387 | controller | } 2025-11-26 13:02:28.464396 | controller | changed: 2025-11-26 13:02:28.464459 | controller | { 2025-11-26 13:02:28.464486 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2025-11-26 13:02:28.464507 | controller | } 2025-11-26 13:02:28.762763 | controller | changed: 2025-11-26 13:02:28.762836 | controller | { 2025-11-26 13:02:28.762863 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2025-11-26 13:02:28.762884 | controller | } 2025-11-26 13:02:29.067860 | controller | changed: 2025-11-26 13:02:29.067968 | controller | { 2025-11-26 13:02:29.067997 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2025-11-26 13:02:29.068037 | controller | } 2025-11-26 13:02:29.371427 | controller | changed: 2025-11-26 13:02:29.371478 | controller | { 2025-11-26 13:02:29.371504 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2025-11-26 13:02:29.371524 | controller | } 2025-11-26 13:02:29.669740 | controller | changed: 2025-11-26 13:02:29.669835 | controller | { 2025-11-26 13:02:29.669863 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2025-11-26 13:02:29.669884 | controller | } 2025-11-26 13:02:29.971383 | controller | changed: 2025-11-26 13:02:29.971458 | controller | { 2025-11-26 13:02:29.971485 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2025-11-26 13:02:29.971507 | controller | } 2025-11-26 13:02:30.266329 | controller | changed: 2025-11-26 13:02:30.266401 | controller | { 2025-11-26 13:02:30.266428 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2025-11-26 13:02:30.266448 | controller | } 2025-11-26 13:02:30.555104 | controller | changed: 2025-11-26 13:02:30.555158 | controller | { 2025-11-26 13:02:30.555185 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2025-11-26 13:02:30.555207 | controller | } 2025-11-26 13:02:30.849285 | controller | changed: 2025-11-26 13:02:30.849378 | controller | { 2025-11-26 13:02:30.849405 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2025-11-26 13:02:30.849426 | controller | } 2025-11-26 13:02:31.141759 | controller | changed: 2025-11-26 13:02:31.141839 | controller | { 2025-11-26 13:02:31.142054 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2025-11-26 13:02:31.142087 | controller | } 2025-11-26 13:02:31.415951 | controller | changed: 2025-11-26 13:02:31.416065 | controller | { 2025-11-26 13:02:31.416091 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2025-11-26 13:02:31.416112 | controller | } 2025-11-26 13:02:31.436781 | 2025-11-26 13:02:31.436882 | TASK [Set timezone to UTC] 2025-11-26 13:02:31.930708 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2025-11-26 13:02:31.935688 | 2025-11-26 13:02:31.935772 | TASK [Create nodepool directory] 2025-11-26 13:02:32.218284 | controller | changed 2025-11-26 13:02:32.223736 | 2025-11-26 13:02:32.223820 | TASK [Create nodepool sub_nodes file] 2025-11-26 13:02:33.173529 | controller | changed 2025-11-26 13:02:33.178416 | 2025-11-26 13:02:33.178486 | TASK [Create nodepool sub_nodes_private file] 2025-11-26 13:02:34.129363 | controller | changed 2025-11-26 13:02:34.134298 | 2025-11-26 13:02:34.134359 | LOOP [Populate nodepool sub_nodes file] 2025-11-26 13:02:34.163789 | 2025-11-26 13:02:34.163928 | LOOP [Populate nodepool sub_nodes_private file] 2025-11-26 13:02:34.192433 | 2025-11-26 13:02:34.192581 | TASK [Create nodepool primary file] 2025-11-26 13:02:34.215817 | controller | skipping: Conditional result was False 2025-11-26 13:02:34.221141 | 2025-11-26 13:02:34.221222 | TASK [Create nodepool node_private for this node] 2025-11-26 13:02:35.190681 | controller | changed 2025-11-26 13:02:35.195936 | 2025-11-26 13:02:35.196027 | LOOP [Copy ssh keys to nodepool directory] 2025-11-26 13:02:35.596930 | controller | ok: Item: id_rsa Runtime: 0:00:00.004738 2025-11-26 13:02:35.597120 | 2025-11-26 13:02:35.830340 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.004808 2025-11-26 13:02:35.839951 | 2025-11-26 13:02:35.840044 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2025-11-26 13:02:36.813202 | controller | changed 2025-11-26 13:02:36.818116 | 2025-11-26 13:02:36.818186 | TASK [Validate sudoers config after edits] 2025-11-26 13:02:37.107285 | controller | /etc/sudoers: parsed OK 2025-11-26 13:02:37.107348 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2025-11-26 13:02:37.107358 | controller | /etc/sudoers.d/zuul: parsed OK 2025-11-26 13:02:37.107364 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2025-11-26 13:02:37.344606 | controller | ok: Runtime: 0:00:00.005169 2025-11-26 13:02:37.350673 | 2025-11-26 13:02:37.350751 | TASK [Show the environment passed in to job shell scripts] 2025-11-26 13:02:37.612344 | controller | SHELL=/bin/bash 2025-11-26 13:02:37.612387 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2025-11-26 13:02:37.612396 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2025-11-26 13:02:37.612403 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/05/3505/91087e335108d4981acbad87d9ac8e1414bafb63 2025-11-26 13:02:37.612409 | controller | PWD=/home/zuul 2025-11-26 13:02:37.612414 | controller | ZUUL_PIPELINE=github-check 2025-11-26 13:02:37.612420 | controller | LOGNAME=zuul 2025-11-26 13:02:37.612425 | controller | XDG_SESSION_TYPE=tty 2025-11-26 13:02:37.612430 | controller | _=/usr/bin/env 2025-11-26 13:02:37.612436 | controller | MOTD_SHOWN=pam 2025-11-26 13:02:37.612441 | controller | HOME=/home/zuul 2025-11-26 13:02:37.612495 | controller | LANG=en_US.UTF-8 2025-11-26 13:02:37.612504 | controller | SSH_CONNECTION=192.168.26.12 48850 192.168.26.85 22 2025-11-26 13:02:37.612510 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2025-11-26 13:02:37.612519 | controller | ZUUL_CHANGE_IDS=3505,91087e335108d4981acbad87d9ac8e1414bafb63 2025-11-26 13:02:37.612524 | controller | WORKSPACE=/home/zuul/workspace 2025-11-26 13:02:37.612530 | controller | XDG_SESSION_CLASS=user 2025-11-26 13:02:37.612536 | controller | SELINUX_ROLE_REQUESTED= 2025-11-26 13:02:37.612541 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2025-11-26 13:02:37.612546 | controller | USER=zuul 2025-11-26 13:02:37.612551 | controller | ZUUL_VOTING=True 2025-11-26 13:02:37.612557 | controller | BUILD_TIMEOUT=5400000 2025-11-26 13:02:37.612562 | controller | SELINUX_USE_CURRENT_RANGE= 2025-11-26 13:02:37.612567 | controller | SHLVL=1 2025-11-26 13:02:37.612572 | controller | ZUUL_PATCHSET=91087e335108d4981acbad87d9ac8e1414bafb63 2025-11-26 13:02:37.612578 | controller | XDG_SESSION_ID=1 2025-11-26 13:02:37.612583 | controller | ZUUL_BRANCH=main 2025-11-26 13:02:37.612589 | controller | XDG_RUNTIME_DIR=/run/user/1000 2025-11-26 13:02:37.612594 | controller | SSH_CLIENT=192.168.26.12 48850 22 2025-11-26 13:02:37.612600 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2025-11-26 13:02:37.612605 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2025-11-26 13:02:37.612611 | controller | which_declare=declare -f 2025-11-26 13:02:37.612616 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2025-11-26 13:02:37.612622 | controller | SELINUX_LEVEL_REQUESTED= 2025-11-26 13:02:37.612627 | controller | ZUUL_CHANGE=3505 2025-11-26 13:02:37.612632 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2025-11-26 13:02:37.612637 | controller | ZUUL_UUID=73d0e05660c2474e8e0c4a335bc18c73 2025-11-26 13:02:37.612642 | controller | BASH_FUNC_which%%=() { ( alias; 2025-11-26 13:02:37.612648 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2025-11-26 13:02:37.612653 | controller | } 2025-11-26 13:02:37.876831 | controller | ok: Runtime: 0:00:00.006386 2025-11-26 13:02:37.881876 | 2025-11-26 13:02:37.881978 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2025-11-26 13:02:37.895155 | controller | skipping: Conditional result was False 2025-11-26 13:02:37.900205 | 2025-11-26 13:02:37.900267 | TASK [Symlink /home/zuul-worker/workspace] 2025-11-26 13:02:38.443590 | controller | skipping: Conditional result was False 2025-11-26 13:02:38.449598 | 2025-11-26 13:02:38.449675 | TASK [Ensure legacy workspace directory] 2025-11-26 13:02:38.701643 | controller | changed 2025-11-26 13:02:38.719604 | 2025-11-26 13:02:38.719662 | PLAY RECAP 2025-11-26 13:02:38.719708 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-11-26 13:02:38.719731 | 2025-11-26 13:02:38.787877 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-11-26 13:02:38.788886 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-11-26 13:02:39.288556 | 2025-11-26 13:02:39.288695 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2025-11-26 13:02:39.308837 | 2025-11-26 13:02:39.308942 | TASK [Create zuul-output directory] 2025-11-26 13:02:39.682431 | controller | changed 2025-11-26 13:02:39.687586 | 2025-11-26 13:02:39.687664 | TASK [Slurp Zuul inventory test] 2025-11-26 13:02:39.954307 | controller -> localhost | ok 2025-11-26 13:02:39.960614 | 2025-11-26 13:02:39.960685 | TASK [Save zuul inventory] 2025-11-26 13:02:41.133292 | controller | changed 2025-11-26 13:02:41.138714 | 2025-11-26 13:02:41.138785 | TASK [Save zuul vars without the change_message] 2025-11-26 13:02:42.160248 | controller | changed 2025-11-26 13:02:42.177872 | 2025-11-26 13:02:42.177946 | PLAY RECAP 2025-11-26 13:02:42.177991 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-11-26 13:02:42.178026 | 2025-11-26 13:02:42.253054 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-11-26 13:02:42.253721 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-11-26 13:02:42.778135 | 2025-11-26 13:02:42.778235 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2025-11-26 13:02:42.797983 | 2025-11-26 13:02:42.798065 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2025-11-26 13:02:42.816215 | controller | ok 2025-11-26 13:02:42.832586 | 2025-11-26 13:02:42.832663 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-11-26 13:02:42.856202 | controller | skipping: Conditional result was False 2025-11-26 13:02:42.861785 | 2025-11-26 13:02:42.861854 | TASK [mirror-info-fork : Create /etc/ci] 2025-11-26 13:02:43.234608 | controller | ok 2025-11-26 13:02:43.240078 | 2025-11-26 13:02:43.240151 | TASK [mirror-info-fork : Install ci_mirror script] 2025-11-26 13:02:44.172751 | controller | ok 2025-11-26 13:02:44.181853 | 2025-11-26 13:02:44.181957 | TASK [Prepare workspace] 2025-11-26 13:02:44.200142 | controller | ok 2025-11-26 13:02:44.216012 | 2025-11-26 13:02:44.216080 | TASK [prepare-workspace : Start zuul_console daemon.] 2025-11-26 13:02:44.589081 | controller | ok 2025-11-26 13:02:44.594670 | 2025-11-26 13:02:44.594754 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2025-11-26 13:02:46.967546 | controller | Output suppressed because no_log was given 2025-11-26 13:02:46.976529 | 2025-11-26 13:02:46.976594 | LOOP [Create zuul-output directory] 2025-11-26 13:02:47.226423 | controller | changed: "/home/zuul/ci-framework-data/logs" 2025-11-26 13:02:47.441451 | controller | ok: "/home/zuul/zuul-output/logs" 2025-11-26 13:02:47.452677 | 2025-11-26 13:02:47.452797 | TASK [Install required packages] 2025-11-26 13:03:04.473874 | controller | ok: Nothing to do 2025-11-26 13:03:04.478774 | 2025-11-26 13:03:04.478836 | TASK [Install venv] 2025-11-26 13:04:00.842481 | controller | changed 2025-11-26 13:04:00.867320 | 2025-11-26 13:04:00.867395 | PLAY RECAP 2025-11-26 13:04:00.867439 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-11-26 13:04:00.867464 | 2025-11-26 13:04:00.940660 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-11-26 13:04:00.941576 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-11-26 13:04:01.445243 | 2025-11-26 13:04:01.445342 | PLAY [Run ci/playbooks/molecule-test.yml] 2025-11-26 13:04:01.465022 | 2025-11-26 13:04:01.465096 | TASK [Gather required facts] 2025-11-26 13:04:02.003319 | controller | ok 2025-11-26 13:04:02.008572 | 2025-11-26 13:04:02.008645 | TASK [Load environment var if instructed to] 2025-11-26 13:04:02.032887 | controller | skipping: Conditional result was False 2025-11-26 13:04:02.038294 | 2025-11-26 13:04:02.038358 | TASK [Ensure group_vars dir exists] 2025-11-26 13:04:02.402487 | controller | ok 2025-11-26 13:04:02.407442 | 2025-11-26 13:04:02.407508 | TASK [Print related variables] 2025-11-26 13:04:02.436407 | controller | ok: 2025-11-26 13:04:02.436549 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2025-11-26 13:04:02.436579 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2025-11-26 13:04:02.441313 | 2025-11-26 13:04:02.441377 | TASK [Run molecule] 2025-11-26 13:04:03.397462 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2025-11-26 13:04:03.666593 | controller | INFO Performing prerun with role_name_check=0... 2025-11-26 13:04:19.652565 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 13:04:19.653006 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 13:04:19.653462 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 13:04:19.653908 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 13:04:19.654435 | controller | WARNING Another version of 'cifmw.general' 1.0.0+91087e33 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+91087e33 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 13:04:19.654877 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 13:04:19.655336 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 13:04:19.655775 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 13:04:19.656206 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 13:04:19.656591 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 13:04:19.656986 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 13:04:19.657502 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 13:04:19.657904 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 13:04:19.658375 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 13:04:19.658820 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-11-26 13:04:19.667917 | controller | INFO Running crc_layout > prepare 2025-11-26 13:04:20.319430 | controller | 2025-11-26 13:04:20.319539 | controller | PLAY [Prepare] ***************************************************************** 2025-11-26 13:04:20.319556 | controller | 2025-11-26 13:04:20.319637 | controller | TASK [Gathering Facts] ********************************************************* 2025-11-26 13:04:20.319740 | controller | Wednesday 26 November 2025 13:04:20 +0000 (0:00:00.019) 0:00:00.019 **** 2025-11-26 13:04:21.130971 | controller | ok: [instance] 2025-11-26 13:04:21.131027 | controller | 2025-11-26 13:04:21.131171 | controller | TASK [Create custom basedir] *************************************************** 2025-11-26 13:04:21.131275 | controller | Wednesday 26 November 2025 13:04:21 +0000 (0:00:00.812) 0:00:00.831 **** 2025-11-26 13:04:21.430557 | controller | changed: [instance] 2025-11-26 13:04:21.430629 | controller | 2025-11-26 13:04:21.430736 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2025-11-26 13:04:21.430836 | controller | Wednesday 26 November 2025 13:04:21 +0000 (0:00:00.299) 0:00:01.131 **** 2025-11-26 13:04:21.448668 | controller | skipping: [instance] 2025-11-26 13:04:21.448857 | controller | 2025-11-26 13:04:21.449103 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2025-11-26 13:04:21.449313 | controller | Wednesday 26 November 2025 13:04:21 +0000 (0:00:00.018) 0:00:01.149 **** 2025-11-26 13:04:21.490702 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2025-11-26 13:04:21.490883 | controller | 2025-11-26 13:04:21.491094 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2025-11-26 13:04:21.491291 | controller | Wednesday 26 November 2025 13:04:21 +0000 (0:00:00.041) 0:00:01.191 **** 2025-11-26 13:04:21.765366 | controller | ok: [instance] 2025-11-26 13:04:21.765439 | controller | 2025-11-26 13:04:21.765547 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2025-11-26 13:04:21.765651 | controller | Wednesday 26 November 2025 13:04:21 +0000 (0:00:00.274) 0:00:01.466 **** 2025-11-26 13:04:21.969613 | controller | ok: [instance] 2025-11-26 13:04:21.969700 | controller | 2025-11-26 13:04:21.969804 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2025-11-26 13:04:21.969906 | controller | Wednesday 26 November 2025 13:04:21 +0000 (0:00:00.204) 0:00:01.670 **** 2025-11-26 13:04:22.636754 | controller | ok: [instance] => (item=ubi-9-appstream) 2025-11-26 13:04:22.636828 | controller | ok: [instance] => (item=ubi-9-baseos) 2025-11-26 13:04:22.636930 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2025-11-26 13:04:22.637030 | controller | 2025-11-26 13:04:22.637175 | controller | TASK [Deploy repo-setup] ******************************************************* 2025-11-26 13:04:22.637258 | controller | Wednesday 26 November 2025 13:04:22 +0000 (0:00:00.666) 0:00:02.337 **** 2025-11-26 13:04:22.695854 | controller | 2025-11-26 13:04:22.695958 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-11-26 13:04:22.696110 | controller | Wednesday 26 November 2025 13:04:22 +0000 (0:00:00.059) 0:00:02.396 **** 2025-11-26 13:04:23.217455 | controller | changed: [instance] => (item=tmp) 2025-11-26 13:04:23.217614 | controller | changed: [instance] => (item=artifacts/repositories) 2025-11-26 13:04:23.217789 | controller | changed: [instance] => (item=venv/repo_setup) 2025-11-26 13:04:23.217882 | controller | 2025-11-26 13:04:23.217984 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-11-26 13:04:23.218112 | controller | Wednesday 26 November 2025 13:04:23 +0000 (0:00:00.521) 0:00:02.918 **** 2025-11-26 13:04:23.998214 | controller | ok: [instance] 2025-11-26 13:04:23.998523 | controller | 2025-11-26 13:04:25.033779 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-11-26 13:04:25.033809 | controller | Wednesday 26 November 2025 13:04:23 +0000 (0:00:00.780) 0:00:03.698 **** 2025-11-26 13:04:25.033820 | controller | changed: [instance] 2025-11-26 13:04:32.640142 | controller | 2025-11-26 13:04:32.640193 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-11-26 13:04:32.640203 | controller | Wednesday 26 November 2025 13:04:25 +0000 (0:00:01.035) 0:00:04.734 **** 2025-11-26 13:04:32.640215 | controller | changed: [instance] 2025-11-26 13:04:32.640245 | controller | 2025-11-26 13:04:32.640255 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-11-26 13:04:32.640281 | controller | Wednesday 26 November 2025 13:04:32 +0000 (0:00:07.606) 0:00:12.340 **** 2025-11-26 13:04:33.333775 | controller | changed: [instance] 2025-11-26 13:04:33.355329 | controller | 2025-11-26 13:04:33.355366 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-11-26 13:04:33.355376 | controller | Wednesday 26 November 2025 13:04:33 +0000 (0:00:00.693) 0:00:13.034 **** 2025-11-26 13:04:33.355388 | controller | skipping: [instance] 2025-11-26 13:04:33.355421 | controller | 2025-11-26 13:04:33.355429 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-11-26 13:04:33.355437 | controller | Wednesday 26 November 2025 13:04:33 +0000 (0:00:00.021) 0:00:13.056 **** 2025-11-26 13:04:35.238093 | controller | changed: [instance] 2025-11-26 13:04:35.238146 | controller | 2025-11-26 13:04:35.238157 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-11-26 13:04:35.238167 | controller | Wednesday 26 November 2025 13:04:35 +0000 (0:00:01.882) 0:00:14.938 **** 2025-11-26 13:04:35.274164 | controller | skipping: [instance] 2025-11-26 13:04:35.274298 | controller | 2025-11-26 13:04:35.274332 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-11-26 13:04:35.274347 | controller | Wednesday 26 November 2025 13:04:35 +0000 (0:00:00.035) 0:00:14.974 **** 2025-11-26 13:04:35.308999 | controller | skipping: [instance] 2025-11-26 13:04:35.344102 | controller | 2025-11-26 13:04:35.344127 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-11-26 13:04:35.344137 | controller | Wednesday 26 November 2025 13:04:35 +0000 (0:00:00.035) 0:00:15.009 **** 2025-11-26 13:04:35.344149 | controller | skipping: [instance] 2025-11-26 13:04:35.344486 | controller | 2025-11-26 13:04:35.344516 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-11-26 13:04:35.873882 | controller | Wednesday 26 November 2025 13:04:35 +0000 (0:00:00.035) 0:00:15.044 **** 2025-11-26 13:04:35.873918 | controller | changed: [instance] 2025-11-26 13:04:36.315939 | controller | 2025-11-26 13:04:36.315969 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-11-26 13:04:36.315977 | controller | Wednesday 26 November 2025 13:04:35 +0000 (0:00:00.529) 0:00:15.573 **** 2025-11-26 13:04:36.315986 | controller | changed: [instance] 2025-11-26 13:04:36.344212 | controller | 2025-11-26 13:04:36.344260 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-11-26 13:04:36.344274 | controller | Wednesday 26 November 2025 13:04:36 +0000 (0:00:00.442) 0:00:16.016 **** 2025-11-26 13:04:36.344292 | controller | skipping: [instance] 2025-11-26 13:04:36.372125 | controller | 2025-11-26 13:04:36.372150 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-11-26 13:04:36.372158 | controller | Wednesday 26 November 2025 13:04:36 +0000 (0:00:00.028) 0:00:16.044 **** 2025-11-26 13:04:36.372171 | controller | skipping: [instance] 2025-11-26 13:04:36.398940 | controller | 2025-11-26 13:04:36.398958 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-11-26 13:04:36.398966 | controller | Wednesday 26 November 2025 13:04:36 +0000 (0:00:00.027) 0:00:16.072 **** 2025-11-26 13:04:36.398975 | controller | skipping: [instance] 2025-11-26 13:04:36.436187 | controller | 2025-11-26 13:04:36.436227 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-11-26 13:04:36.436237 | controller | Wednesday 26 November 2025 13:04:36 +0000 (0:00:00.027) 0:00:16.099 **** 2025-11-26 13:04:36.436249 | controller | ok: [instance] 2025-11-26 13:04:36.464183 | controller | 2025-11-26 13:04:36.464206 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-11-26 13:04:36.464215 | controller | Wednesday 26 November 2025 13:04:36 +0000 (0:00:00.037) 0:00:16.136 **** 2025-11-26 13:04:36.464235 | controller | skipping: [instance] 2025-11-26 13:04:36.464582 | controller | 2025-11-26 13:04:36.464618 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-11-26 13:04:36.490034 | controller | Wednesday 26 November 2025 13:04:36 +0000 (0:00:00.028) 0:00:16.164 **** 2025-11-26 13:04:36.490061 | controller | skipping: [instance] 2025-11-26 13:04:36.490268 | controller | 2025-11-26 13:04:36.490447 | controller | TASK [Download the RPM] ******************************************************** 2025-11-26 13:04:36.490614 | controller | Wednesday 26 November 2025 13:04:36 +0000 (0:00:00.026) 0:00:16.191 **** 2025-11-26 13:04:36.516029 | controller | skipping: [instance] 2025-11-26 13:04:36.516203 | controller | 2025-11-26 13:04:36.516360 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-11-26 13:04:36.516499 | controller | Wednesday 26 November 2025 13:04:36 +0000 (0:00:00.025) 0:00:16.217 **** 2025-11-26 13:04:36.542504 | controller | skipping: [instance] 2025-11-26 13:04:36.542689 | controller | 2025-11-26 13:04:36.542861 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-11-26 13:04:36.543059 | controller | Wednesday 26 November 2025 13:04:36 +0000 (0:00:00.026) 0:00:16.243 **** 2025-11-26 13:04:36.569389 | controller | skipping: [instance] 2025-11-26 13:04:36.569576 | controller | 2025-11-26 13:04:36.569750 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-11-26 13:04:36.569917 | controller | Wednesday 26 November 2025 13:04:36 +0000 (0:00:00.026) 0:00:16.270 **** 2025-11-26 13:04:36.600897 | controller | skipping: [instance] 2025-11-26 13:04:36.601123 | controller | 2025-11-26 13:04:36.601313 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-11-26 13:04:36.601460 | controller | Wednesday 26 November 2025 13:04:36 +0000 (0:00:00.031) 0:00:16.302 **** 2025-11-26 13:04:36.646105 | controller | skipping: [instance] 2025-11-26 13:04:36.646348 | controller | 2025-11-26 13:04:36.646495 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-11-26 13:04:36.646633 | controller | Wednesday 26 November 2025 13:04:36 +0000 (0:00:00.045) 0:00:16.347 **** 2025-11-26 13:04:36.825859 | controller | ok: [instance] 2025-11-26 13:04:36.826074 | controller | 2025-11-26 13:04:36.826280 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-11-26 13:04:36.826463 | controller | Wednesday 26 November 2025 13:04:36 +0000 (0:00:00.179) 0:00:16.526 **** 2025-11-26 13:04:37.031996 | controller | changed: [instance] 2025-11-26 13:04:37.254244 | controller | 2025-11-26 13:04:37.254273 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-11-26 13:04:37.254280 | controller | Wednesday 26 November 2025 13:04:37 +0000 (0:00:00.205) 0:00:16.732 **** 2025-11-26 13:04:37.254290 | controller | changed: [instance] 2025-11-26 13:04:37.275898 | controller | 2025-11-26 13:04:37.275918 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-11-26 13:04:37.275927 | controller | Wednesday 26 November 2025 13:04:37 +0000 (0:00:00.222) 0:00:16.954 **** 2025-11-26 13:04:37.275937 | controller | skipping: [instance] 2025-11-26 13:04:37.297141 | controller | 2025-11-26 13:04:37.297175 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-11-26 13:04:37.297185 | controller | Wednesday 26 November 2025 13:04:37 +0000 (0:00:00.021) 0:00:16.976 **** 2025-11-26 13:04:37.297204 | controller | skipping: [instance] 2025-11-26 13:04:37.297237 | controller | 2025-11-26 13:04:37.297570 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-11-26 13:04:37.317601 | controller | Wednesday 26 November 2025 13:04:37 +0000 (0:00:00.021) 0:00:16.997 **** 2025-11-26 13:04:37.317622 | controller | skipping: [instance] 2025-11-26 13:04:37.339178 | controller | 2025-11-26 13:04:37.339212 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-11-26 13:04:37.339225 | controller | Wednesday 26 November 2025 13:04:37 +0000 (0:00:00.020) 0:00:17.018 **** 2025-11-26 13:04:37.339240 | controller | skipping: [instance] 2025-11-26 13:04:37.339281 | controller | 2025-11-26 13:04:37.339294 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-11-26 13:04:37.339463 | controller | Wednesday 26 November 2025 13:04:37 +0000 (0:00:00.021) 0:00:17.039 **** 2025-11-26 13:04:37.360647 | controller | skipping: [instance] 2025-11-26 13:04:37.382160 | controller | 2025-11-26 13:04:37.382182 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-11-26 13:04:37.382192 | controller | Wednesday 26 November 2025 13:04:37 +0000 (0:00:00.021) 0:00:17.061 **** 2025-11-26 13:04:37.382206 | controller | skipping: [instance] 2025-11-26 13:04:37.382382 | controller | 2025-11-26 13:04:37.382555 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-11-26 13:04:37.382703 | controller | Wednesday 26 November 2025 13:04:37 +0000 (0:00:00.021) 0:00:17.083 **** 2025-11-26 13:04:37.397702 | controller | skipping: [instance] 2025-11-26 13:04:37.397865 | controller | 2025-11-26 13:04:37.398050 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-11-26 13:04:37.398230 | controller | Wednesday 26 November 2025 13:04:37 +0000 (0:00:00.015) 0:00:17.098 **** 2025-11-26 13:04:37.424734 | controller | skipping: [instance] 2025-11-26 13:04:37.424931 | controller | 2025-11-26 13:04:37.425149 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-11-26 13:04:37.425335 | controller | Wednesday 26 November 2025 13:04:37 +0000 (0:00:00.026) 0:00:17.125 **** 2025-11-26 13:04:37.440344 | controller | skipping: [instance] 2025-11-26 13:04:37.440622 | controller | 2025-11-26 13:04:37.440839 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-11-26 13:04:37.440979 | controller | Wednesday 26 November 2025 13:04:37 +0000 (0:00:00.015) 0:00:17.141 **** 2025-11-26 13:04:37.459674 | controller | skipping: [instance] 2025-11-26 13:04:37.459880 | controller | 2025-11-26 13:04:37.460050 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2025-11-26 13:04:37.460221 | controller | Wednesday 26 November 2025 13:04:37 +0000 (0:00:00.019) 0:00:17.160 **** 2025-11-26 13:04:37.487755 | controller | skipping: [instance] 2025-11-26 13:04:37.487941 | controller | 2025-11-26 13:04:37.488170 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2025-11-26 13:04:37.488345 | controller | Wednesday 26 November 2025 13:04:37 +0000 (0:00:00.028) 0:00:17.188 **** 2025-11-26 13:04:37.519101 | controller | skipping: [instance] 2025-11-26 13:04:37.519236 | controller | 2025-11-26 13:04:37.519362 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2025-11-26 13:04:37.519480 | controller | Wednesday 26 November 2025 13:04:37 +0000 (0:00:00.031) 0:00:17.220 **** 2025-11-26 13:04:37.547809 | controller | skipping: [instance] 2025-11-26 13:04:37.547974 | controller | 2025-11-26 13:04:37.548105 | controller | TASK [test_deps : Install additional packages] ********************************* 2025-11-26 13:04:37.548237 | controller | Wednesday 26 November 2025 13:04:37 +0000 (0:00:00.028) 0:00:17.248 **** 2025-11-26 13:04:37.575944 | controller | skipping: [instance] 2025-11-26 13:04:37.576192 | controller | 2025-11-26 13:04:37.576412 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2025-11-26 13:04:37.576622 | controller | Wednesday 26 November 2025 13:04:37 +0000 (0:00:00.028) 0:00:17.277 **** 2025-11-26 13:05:25.071748 | controller | ok: [instance] 2025-11-26 13:05:26.411584 | controller | 2025-11-26 13:05:26.411615 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2025-11-26 13:05:26.411623 | controller | Wednesday 26 November 2025 13:05:25 +0000 (0:00:47.495) 0:01:04.772 **** 2025-11-26 13:05:26.411633 | controller | ok: [instance] 2025-11-26 13:05:26.443244 | controller | 2025-11-26 13:05:26.443310 | controller | TASK [test_deps : Install extra packages] ************************************** 2025-11-26 13:05:26.443321 | controller | Wednesday 26 November 2025 13:05:26 +0000 (0:00:01.339) 0:01:06.112 **** 2025-11-26 13:05:26.443338 | controller | skipping: [instance] 2025-11-26 13:05:26.484464 | controller | 2025-11-26 13:05:26.484506 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-11-26 13:05:26.484515 | controller | Wednesday 26 November 2025 13:05:26 +0000 (0:00:00.031) 0:01:06.143 **** 2025-11-26 13:05:26.484527 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2025-11-26 13:05:26.503147 | controller | 2025-11-26 13:05:26.503196 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-11-26 13:05:26.503221 | controller | Wednesday 26 November 2025 13:05:26 +0000 (0:00:00.041) 0:01:06.185 **** 2025-11-26 13:05:26.503234 | controller | ok: [instance] => 2025-11-26 13:05:36.027588 | controller | cifmw_ci_setup_packages: 2025-11-26 13:05:36.027633 | controller | - bash-completion 2025-11-26 13:05:36.027641 | controller | - ca-certificates 2025-11-26 13:05:36.027647 | controller | - git-core 2025-11-26 13:05:36.027653 | controller | - make 2025-11-26 13:05:36.027658 | controller | - tar 2025-11-26 13:05:36.027663 | controller | - tmux 2025-11-26 13:05:36.027668 | controller | - python3-pip 2025-11-26 13:05:36.027674 | controller | 2025-11-26 13:05:36.027679 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-11-26 13:05:36.027685 | controller | Wednesday 26 November 2025 13:05:26 +0000 (0:00:00.018) 0:01:06.203 **** 2025-11-26 13:05:36.027695 | controller | changed: [instance] 2025-11-26 13:05:36.645798 | controller | 2025-11-26 13:05:36.645830 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-11-26 13:05:36.645838 | controller | Wednesday 26 November 2025 13:05:36 +0000 (0:00:09.524) 0:01:15.727 **** 2025-11-26 13:05:36.645849 | controller | ok: [instance] 2025-11-26 13:05:36.874628 | controller | 2025-11-26 13:05:36.874660 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-11-26 13:05:36.874668 | controller | Wednesday 26 November 2025 13:05:36 +0000 (0:00:00.618) 0:01:16.346 **** 2025-11-26 13:05:36.874679 | controller | changed: [instance] 2025-11-26 13:05:42.946815 | controller | 2025-11-26 13:05:42.946845 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-11-26 13:05:42.946853 | controller | Wednesday 26 November 2025 13:05:36 +0000 (0:00:00.228) 0:01:16.574 **** 2025-11-26 13:05:42.946864 | controller | changed: [instance] 2025-11-26 13:05:42.982089 | controller | 2025-11-26 13:05:42.982130 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-11-26 13:05:42.982138 | controller | Wednesday 26 November 2025 13:05:42 +0000 (0:00:06.072) 0:01:22.647 **** 2025-11-26 13:05:42.982149 | controller | ok: [instance] 2025-11-26 13:05:42.982172 | controller | 2025-11-26 13:05:42.982180 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-11-26 13:05:42.982305 | controller | Wednesday 26 November 2025 13:05:42 +0000 (0:00:00.035) 0:01:22.683 **** 2025-11-26 13:05:43.254459 | controller | changed: [instance] 2025-11-26 13:05:43.506585 | controller | 2025-11-26 13:05:43.506614 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-11-26 13:05:43.506622 | controller | Wednesday 26 November 2025 13:05:43 +0000 (0:00:00.271) 0:01:22.954 **** 2025-11-26 13:05:43.506632 | controller | changed: [instance] 2025-11-26 13:05:43.523123 | controller | 2025-11-26 13:05:43.523157 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-11-26 13:05:43.523167 | controller | Wednesday 26 November 2025 13:05:43 +0000 (0:00:00.252) 0:01:23.207 **** 2025-11-26 13:05:43.523180 | controller | skipping: [instance] 2025-11-26 13:05:43.523210 | controller | 2025-11-26 13:05:43.523446 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-11-26 13:05:43.539599 | controller | Wednesday 26 November 2025 13:05:43 +0000 (0:00:00.016) 0:01:23.224 **** 2025-11-26 13:05:43.539621 | controller | skipping: [instance] 2025-11-26 13:05:43.556175 | controller | 2025-11-26 13:05:43.556201 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-11-26 13:05:43.556211 | controller | Wednesday 26 November 2025 13:05:43 +0000 (0:00:00.016) 0:01:23.240 **** 2025-11-26 13:05:43.556222 | controller | skipping: [instance] 2025-11-26 13:05:43.556418 | controller | 2025-11-26 13:05:43.556441 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-11-26 13:05:43.572736 | controller | Wednesday 26 November 2025 13:05:43 +0000 (0:00:00.016) 0:01:23.257 **** 2025-11-26 13:05:43.572760 | controller | skipping: [instance] 2025-11-26 13:05:43.588954 | controller | 2025-11-26 13:05:43.588978 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-11-26 13:05:43.588995 | controller | Wednesday 26 November 2025 13:05:43 +0000 (0:00:00.016) 0:01:23.273 **** 2025-11-26 13:05:43.589026 | controller | skipping: [instance] 2025-11-26 13:05:43.610131 | controller | 2025-11-26 13:05:43.610153 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-11-26 13:05:43.610162 | controller | Wednesday 26 November 2025 13:05:43 +0000 (0:00:00.016) 0:01:23.289 **** 2025-11-26 13:05:43.610173 | controller | skipping: [instance] 2025-11-26 13:05:44.554036 | controller | 2025-11-26 13:05:44.554065 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-11-26 13:05:44.554074 | controller | Wednesday 26 November 2025 13:05:43 +0000 (0:00:00.021) 0:01:23.310 **** 2025-11-26 13:05:44.554084 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2025-11-26 13:05:44.885109 | controller | changed: [instance] => (item=/opt/basedir/logs) 2025-11-26 13:05:44.885147 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2025-11-26 13:05:44.885156 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2025-11-26 13:05:44.885163 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2025-11-26 13:05:44.885170 | controller | 2025-11-26 13:05:44.885177 | controller | TASK [Create secret file] ****************************************************** 2025-11-26 13:05:44.885184 | controller | Wednesday 26 November 2025 13:05:44 +0000 (0:00:00.943) 0:01:24.254 **** 2025-11-26 13:05:44.885203 | controller | changed: [instance] 2025-11-26 13:05:44.885231 | controller | 2025-11-26 13:05:44.885239 | controller | PLAY RECAP ********************************************************************* 2025-11-26 13:05:44.885246 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2025-11-26 13:05:44.885253 | controller | 2025-11-26 13:05:44.885262 | controller | Wednesday 26 November 2025 13:05:44 +0000 (0:00:00.331) 0:01:24.585 **** 2025-11-26 13:05:44.886065 | controller | =============================================================================== 2025-11-26 13:05:44.886079 | controller | test_deps : Install selinux python libs -------------------------------- 47.50s 2025-11-26 13:05:44.887068 | controller | ci_setup : Install needed packages -------------------------------------- 9.52s 2025-11-26 13:05:44.887098 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.61s 2025-11-26 13:05:44.887105 | controller | ci_setup : Install openshift client ------------------------------------- 6.07s 2025-11-26 13:05:44.887111 | controller | repo_setup : Run repo-setup --------------------------------------------- 1.88s 2025-11-26 13:05:44.887116 | controller | test_deps : Install python yaml libs ------------------------------------ 1.34s 2025-11-26 13:05:44.887121 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.04s 2025-11-26 13:05:44.887127 | controller | ci_setup : Manage directories ------------------------------------------- 0.94s 2025-11-26 13:05:44.887132 | controller | Gathering Facts --------------------------------------------------------- 0.81s 2025-11-26 13:05:44.887141 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.78s 2025-11-26 13:05:44.937184 | controller | repo_setup : Install repo-setup package --------------------------------- 0.69s 2025-11-26 13:05:44.937216 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.67s 2025-11-26 13:05:44.937224 | controller | ci_setup : Gather version of openshift client --------------------------- 0.62s 2025-11-26 13:05:44.937233 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.53s 2025-11-26 13:05:44.937239 | controller | repo_setup : Ensure directories are present ----------------------------- 0.52s 2025-11-26 13:05:44.937244 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.44s 2025-11-26 13:05:44.937249 | controller | Create secret file ------------------------------------------------------ 0.33s 2025-11-26 13:05:44.937254 | controller | Create custom basedir --------------------------------------------------- 0.30s 2025-11-26 13:05:44.937260 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.27s 2025-11-26 13:05:44.937270 | controller | ci_setup : Create completion file --------------------------------------- 0.27s 2025-11-26 13:05:44.937281 | controller | INFO Running crc_layout > converge 2025-11-26 13:05:45.509495 | controller | 2025-11-26 13:05:45.509716 | controller | PLAY [Converge] **************************************************************** 2025-11-26 13:05:45.509854 | controller | 2025-11-26 13:05:45.509995 | controller | TASK [Gathering Facts] ********************************************************* 2025-11-26 13:05:45.510159 | controller | Wednesday 26 November 2025 13:05:45 +0000 (0:00:00.024) 0:00:00.024 **** 2025-11-26 13:05:46.301574 | controller | ok: [instance] 2025-11-26 13:05:46.336583 | controller | 2025-11-26 13:05:46.336614 | controller | TASK [Load networking definition from scenario file] *************************** 2025-11-26 13:05:46.336624 | controller | Wednesday 26 November 2025 13:05:46 +0000 (0:00:00.791) 0:00:00.816 **** 2025-11-26 13:05:46.336636 | controller | ok: [instance] 2025-11-26 13:05:48.157674 | controller | 2025-11-26 13:05:48.157706 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-11-26 13:05:48.157714 | controller | Wednesday 26 November 2025 13:05:46 +0000 (0:00:00.035) 0:00:00.851 **** 2025-11-26 13:05:48.157724 | controller | changed: [instance] 2025-11-26 13:05:48.185126 | controller | 2025-11-26 13:05:48.185153 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-11-26 13:05:48.185173 | controller | Wednesday 26 November 2025 13:05:48 +0000 (0:00:01.821) 0:00:02.672 **** 2025-11-26 13:05:48.185185 | controller | ok: [instance] 2025-11-26 13:05:48.185213 | controller | 2025-11-26 13:05:48.185223 | controller | TASK [reproducer : Load CI job environment] ************************************ 2025-11-26 13:05:48.185290 | controller | Wednesday 26 November 2025 13:05:48 +0000 (0:00:00.027) 0:00:02.700 **** 2025-11-26 13:05:48.206106 | controller | skipping: [instance] 2025-11-26 13:05:48.206386 | controller | 2025-11-26 13:05:48.206405 | controller | TASK [Build final libvirt layout] ********************************************** 2025-11-26 13:05:48.269140 | controller | Wednesday 26 November 2025 13:05:48 +0000 (0:00:00.021) 0:00:02.721 **** 2025-11-26 13:05:48.269185 | controller | 2025-11-26 13:05:48.269266 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2025-11-26 13:05:48.269289 | controller | Wednesday 26 November 2025 13:05:48 +0000 (0:00:00.063) 0:00:02.784 **** 2025-11-26 13:05:48.346083 | controller | ok: [instance] 2025-11-26 13:05:48.346757 | controller | 2025-11-26 13:05:48.405887 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2025-11-26 13:05:48.405909 | controller | Wednesday 26 November 2025 13:05:48 +0000 (0:00:00.076) 0:00:02.861 **** 2025-11-26 13:05:48.405920 | controller | skipping: [instance] 2025-11-26 13:05:48.430502 | controller | 2025-11-26 13:05:48.430537 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2025-11-26 13:05:48.430546 | controller | Wednesday 26 November 2025 13:05:48 +0000 (0:00:00.059) 0:00:02.921 **** 2025-11-26 13:05:48.430557 | controller | ok: [instance] 2025-11-26 13:05:48.430728 | controller | 2025-11-26 13:05:48.430888 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2025-11-26 13:05:48.431061 | controller | Wednesday 26 November 2025 13:05:48 +0000 (0:00:00.025) 0:00:02.946 **** 2025-11-26 13:05:48.453136 | controller | ok: [instance] => changed=false 2025-11-26 13:05:48.453347 | controller | msg: All assertions passed 2025-11-26 13:05:48.453527 | controller | 2025-11-26 13:05:48.453700 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2025-11-26 13:05:48.453842 | controller | Wednesday 26 November 2025 13:05:48 +0000 (0:00:00.022) 0:00:02.968 **** 2025-11-26 13:05:48.494684 | controller | ok: [instance] 2025-11-26 13:05:48.494845 | controller | 2025-11-26 13:05:48.494989 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2025-11-26 13:05:48.495154 | controller | Wednesday 26 November 2025 13:05:48 +0000 (0:00:00.041) 0:00:03.010 **** 2025-11-26 13:05:48.935021 | controller | ok: [instance] => (item=artifacts) 2025-11-26 13:05:49.008163 | controller | ok: [instance] => (item=logs) 2025-11-26 13:05:49.008202 | controller | 2025-11-26 13:05:49.008211 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2025-11-26 13:05:49.008232 | controller | Wednesday 26 November 2025 13:05:48 +0000 (0:00:00.439) 0:00:03.450 **** 2025-11-26 13:05:49.008244 | controller | 2025-11-26 13:05:49.197457 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2025-11-26 13:05:49.197488 | controller | Wednesday 26 November 2025 13:05:49 +0000 (0:00:00.073) 0:00:03.523 **** 2025-11-26 13:05:49.197500 | controller | ok: [instance] 2025-11-26 13:05:49.452165 | controller | 2025-11-26 13:05:49.452208 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2025-11-26 13:05:49.452219 | controller | Wednesday 26 November 2025 13:05:49 +0000 (0:00:00.189) 0:00:03.712 **** 2025-11-26 13:05:49.452231 | controller | changed: [instance] 2025-11-26 13:05:49.738753 | controller | 2025-11-26 13:05:49.738788 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2025-11-26 13:05:49.738798 | controller | Wednesday 26 November 2025 13:05:49 +0000 (0:00:00.254) 0:00:03.967 **** 2025-11-26 13:05:49.738810 | controller | ok: [instance] 2025-11-26 13:05:49.766399 | controller | 2025-11-26 13:05:49.766431 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2025-11-26 13:05:49.766438 | controller | Wednesday 26 November 2025 13:05:49 +0000 (0:00:00.286) 0:00:04.253 **** 2025-11-26 13:05:49.766447 | controller | skipping: [instance] 2025-11-26 13:05:49.783151 | controller | 2025-11-26 13:05:49.783185 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2025-11-26 13:05:49.783194 | controller | Wednesday 26 November 2025 13:05:49 +0000 (0:00:00.028) 0:00:04.281 **** 2025-11-26 13:05:49.783206 | controller | skipping: [instance] 2025-11-26 13:05:49.783236 | controller | 2025-11-26 13:05:49.783246 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2025-11-26 13:05:49.783371 | controller | Wednesday 26 November 2025 13:05:49 +0000 (0:00:00.017) 0:00:04.298 **** 2025-11-26 13:05:49.803090 | controller | ok: [instance] 2025-11-26 13:05:49.803210 | controller | 2025-11-26 13:05:49.803230 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2025-11-26 13:05:49.803246 | controller | Wednesday 26 November 2025 13:05:49 +0000 (0:00:00.019) 0:00:04.318 **** 2025-11-26 13:05:49.830522 | controller | skipping: [instance] 2025-11-26 13:05:58.114157 | controller | 2025-11-26 13:05:58.114188 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2025-11-26 13:05:58.114196 | controller | Wednesday 26 November 2025 13:05:49 +0000 (0:00:00.027) 0:00:04.345 **** 2025-11-26 13:05:58.114206 | controller | changed: [instance] 2025-11-26 13:05:58.316307 | controller | 2025-11-26 13:05:58.316340 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2025-11-26 13:05:58.316348 | controller | Wednesday 26 November 2025 13:05:58 +0000 (0:00:08.283) 0:00:12.629 **** 2025-11-26 13:05:58.316358 | controller | changed: [instance] 2025-11-26 13:05:58.316561 | controller | 2025-11-26 13:05:58.796765 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2025-11-26 13:05:58.796795 | controller | Wednesday 26 November 2025 13:05:58 +0000 (0:00:00.202) 0:00:12.831 **** 2025-11-26 13:05:58.796807 | controller | changed: [instance] 2025-11-26 13:05:59.377632 | controller | 2025-11-26 13:05:59.377662 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2025-11-26 13:05:59.377671 | controller | Wednesday 26 November 2025 13:05:58 +0000 (0:00:00.480) 0:00:13.311 **** 2025-11-26 13:05:59.377680 | controller | changed: [instance] 2025-11-26 13:05:59.567121 | controller | 2025-11-26 13:05:59.567159 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2025-11-26 13:05:59.567167 | controller | Wednesday 26 November 2025 13:05:59 +0000 (0:00:00.580) 0:00:13.892 **** 2025-11-26 13:05:59.567176 | controller | ok: [instance] 2025-11-26 13:05:59.567199 | controller | 2025-11-26 13:05:59.567207 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2025-11-26 13:05:59.567274 | controller | Wednesday 26 November 2025 13:05:59 +0000 (0:00:00.189) 0:00:14.082 **** 2025-11-26 13:06:00.223700 | controller | ok: [instance] 2025-11-26 13:06:01.098584 | controller | 2025-11-26 13:06:01.098613 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2025-11-26 13:06:01.098628 | controller | Wednesday 26 November 2025 13:06:00 +0000 (0:00:00.656) 0:00:14.738 **** 2025-11-26 13:06:01.098638 | controller | changed: [instance] 2025-11-26 13:06:01.183169 | controller | 2025-11-26 13:06:01.183207 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2025-11-26 13:06:01.183218 | controller | Wednesday 26 November 2025 13:06:01 +0000 (0:00:00.874) 0:00:15.613 **** 2025-11-26 13:06:01.183244 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2025-11-26 13:06:01.183287 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2025-11-26 13:06:01.183297 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2025-11-26 13:06:01.183305 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2025-11-26 13:06:01.183312 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2025-11-26 13:06:01.183319 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2025-11-26 13:06:01.183326 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2025-11-26 13:06:01.183333 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2025-11-26 13:06:01.183343 | controller | 2025-11-26 13:06:01.183365 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2025-11-26 13:06:01.183432 | controller | Wednesday 26 November 2025 13:06:01 +0000 (0:00:00.084) 0:00:15.697 **** 2025-11-26 13:06:01.497161 | controller | ok: [instance] 2025-11-26 13:06:01.497370 | controller | 2025-11-26 13:06:01.497389 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2025-11-26 13:06:01.806508 | controller | Wednesday 26 November 2025 13:06:01 +0000 (0:00:00.314) 0:00:16.012 **** 2025-11-26 13:06:01.806537 | controller | ok: [instance] 2025-11-26 13:06:02.115622 | controller | 2025-11-26 13:06:02.115655 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2025-11-26 13:06:02.115664 | controller | Wednesday 26 November 2025 13:06:01 +0000 (0:00:00.309) 0:00:16.321 **** 2025-11-26 13:06:02.115676 | controller | ok: [instance] 2025-11-26 13:06:02.421101 | controller | 2025-11-26 13:06:02.421134 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2025-11-26 13:06:02.421144 | controller | Wednesday 26 November 2025 13:06:02 +0000 (0:00:00.308) 0:00:16.630 **** 2025-11-26 13:06:02.421156 | controller | ok: [instance] 2025-11-26 13:06:02.421185 | controller | 2025-11-26 13:06:02.421426 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2025-11-26 13:06:02.732615 | controller | Wednesday 26 November 2025 13:06:02 +0000 (0:00:00.305) 0:00:16.936 **** 2025-11-26 13:06:02.732648 | controller | ok: [instance] 2025-11-26 13:06:03.043835 | controller | 2025-11-26 13:06:03.043868 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2025-11-26 13:06:03.043878 | controller | Wednesday 26 November 2025 13:06:02 +0000 (0:00:00.311) 0:00:17.247 **** 2025-11-26 13:06:03.043889 | controller | ok: [instance] 2025-11-26 13:06:03.352238 | controller | 2025-11-26 13:06:03.352266 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2025-11-26 13:06:03.352274 | controller | Wednesday 26 November 2025 13:06:03 +0000 (0:00:00.311) 0:00:17.558 **** 2025-11-26 13:06:03.352284 | controller | ok: [instance] 2025-11-26 13:06:03.658137 | controller | 2025-11-26 13:06:03.658180 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2025-11-26 13:06:03.658204 | controller | Wednesday 26 November 2025 13:06:03 +0000 (0:00:00.308) 0:00:17.867 **** 2025-11-26 13:06:03.658224 | controller | ok: [instance] 2025-11-26 13:06:03.658254 | controller | 2025-11-26 13:06:03.658264 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2025-11-26 13:06:03.658402 | controller | Wednesday 26 November 2025 13:06:03 +0000 (0:00:00.306) 0:00:18.173 **** 2025-11-26 13:06:03.969936 | controller | ok: [instance] 2025-11-26 13:06:04.277812 | controller | 2025-11-26 13:06:04.277840 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2025-11-26 13:06:04.277848 | controller | Wednesday 26 November 2025 13:06:03 +0000 (0:00:00.311) 0:00:18.485 **** 2025-11-26 13:06:04.277858 | controller | ok: [instance] 2025-11-26 13:06:04.590643 | controller | 2025-11-26 13:06:04.590672 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2025-11-26 13:06:04.590680 | controller | Wednesday 26 November 2025 13:06:04 +0000 (0:00:00.308) 0:00:18.793 **** 2025-11-26 13:06:04.590690 | controller | ok: [instance] 2025-11-26 13:06:04.908952 | controller | 2025-11-26 13:06:04.908981 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2025-11-26 13:06:04.908989 | controller | Wednesday 26 November 2025 13:06:04 +0000 (0:00:00.312) 0:00:19.105 **** 2025-11-26 13:06:04.908999 | controller | ok: [instance] 2025-11-26 13:06:05.221075 | controller | 2025-11-26 13:06:05.221111 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2025-11-26 13:06:05.221120 | controller | Wednesday 26 November 2025 13:06:04 +0000 (0:00:00.318) 0:00:19.424 **** 2025-11-26 13:06:05.221131 | controller | ok: [instance] 2025-11-26 13:06:05.221328 | controller | 2025-11-26 13:06:05.221358 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2025-11-26 13:06:05.525832 | controller | Wednesday 26 November 2025 13:06:05 +0000 (0:00:00.312) 0:00:19.736 **** 2025-11-26 13:06:05.525864 | controller | ok: [instance] 2025-11-26 13:06:05.836530 | controller | 2025-11-26 13:06:05.836558 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2025-11-26 13:06:05.836566 | controller | Wednesday 26 November 2025 13:06:05 +0000 (0:00:00.304) 0:00:20.041 **** 2025-11-26 13:06:05.836575 | controller | ok: [instance] 2025-11-26 13:06:06.141498 | controller | 2025-11-26 13:06:06.141526 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2025-11-26 13:06:06.141534 | controller | Wednesday 26 November 2025 13:06:05 +0000 (0:00:00.310) 0:00:20.351 **** 2025-11-26 13:06:06.141544 | controller | ok: [instance] 2025-11-26 13:06:06.452070 | controller | 2025-11-26 13:06:06.452100 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2025-11-26 13:06:06.452108 | controller | Wednesday 26 November 2025 13:06:06 +0000 (0:00:00.304) 0:00:20.656 **** 2025-11-26 13:06:06.452118 | controller | ok: [instance] 2025-11-26 13:06:06.452329 | controller | 2025-11-26 13:06:06.452352 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2025-11-26 13:06:06.765039 | controller | Wednesday 26 November 2025 13:06:06 +0000 (0:00:00.310) 0:00:20.967 **** 2025-11-26 13:06:06.765069 | controller | ok: [instance] 2025-11-26 13:06:07.076102 | controller | 2025-11-26 13:06:07.076160 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2025-11-26 13:06:07.076171 | controller | Wednesday 26 November 2025 13:06:06 +0000 (0:00:00.312) 0:00:21.280 **** 2025-11-26 13:06:07.076186 | controller | ok: [instance] 2025-11-26 13:06:07.076453 | controller | 2025-11-26 13:06:07.395904 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2025-11-26 13:06:07.395943 | controller | Wednesday 26 November 2025 13:06:07 +0000 (0:00:00.311) 0:00:21.591 **** 2025-11-26 13:06:07.395957 | controller | ok: [instance] 2025-11-26 13:06:07.714923 | controller | 2025-11-26 13:06:07.714956 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2025-11-26 13:06:07.714964 | controller | Wednesday 26 November 2025 13:06:07 +0000 (0:00:00.319) 0:00:21.910 **** 2025-11-26 13:06:07.714974 | controller | ok: [instance] 2025-11-26 13:06:08.026108 | controller | 2025-11-26 13:06:08.026162 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2025-11-26 13:06:08.026173 | controller | Wednesday 26 November 2025 13:06:07 +0000 (0:00:00.319) 0:00:22.230 **** 2025-11-26 13:06:08.026195 | controller | ok: [instance] 2025-11-26 13:06:08.341639 | controller | 2025-11-26 13:06:08.341671 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2025-11-26 13:06:08.341688 | controller | Wednesday 26 November 2025 13:06:08 +0000 (0:00:00.311) 0:00:22.541 **** 2025-11-26 13:06:08.341701 | controller | ok: [instance] 2025-11-26 13:06:08.655072 | controller | 2025-11-26 13:06:08.655097 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2025-11-26 13:06:08.655105 | controller | Wednesday 26 November 2025 13:06:08 +0000 (0:00:00.315) 0:00:22.856 **** 2025-11-26 13:06:08.655124 | controller | ok: [instance] 2025-11-26 13:06:08.655181 | controller | 2025-11-26 13:06:08.655200 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2025-11-26 13:06:08.655213 | controller | Wednesday 26 November 2025 13:06:08 +0000 (0:00:00.313) 0:00:23.170 **** 2025-11-26 13:06:08.674564 | controller | skipping: [instance] 2025-11-26 13:06:08.951605 | controller | 2025-11-26 13:06:08.951636 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2025-11-26 13:06:08.951644 | controller | Wednesday 26 November 2025 13:06:08 +0000 (0:00:00.019) 0:00:23.189 **** 2025-11-26 13:06:08.951653 | controller | ok: [instance] 2025-11-26 13:06:09.316077 | controller | 2025-11-26 13:06:09.316117 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2025-11-26 13:06:09.316126 | controller | Wednesday 26 November 2025 13:06:08 +0000 (0:00:00.277) 0:00:23.466 **** 2025-11-26 13:06:09.316136 | controller | ok: [instance] 2025-11-26 13:06:09.611701 | controller | 2025-11-26 13:06:09.611730 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2025-11-26 13:06:09.611738 | controller | Wednesday 26 November 2025 13:06:09 +0000 (0:00:00.364) 0:00:23.831 **** 2025-11-26 13:06:09.611748 | controller | changed: [instance] 2025-11-26 13:06:09.891360 | controller | 2025-11-26 13:06:09.891384 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2025-11-26 13:06:09.891393 | controller | Wednesday 26 November 2025 13:06:09 +0000 (0:00:00.295) 0:00:24.126 **** 2025-11-26 13:06:09.891404 | controller | [WARNING]: Reset is not implemented for this connection 2025-11-26 13:06:09.901185 | controller | changed: [instance] 2025-11-26 13:06:09.901243 | controller | 2025-11-26 13:06:09.901253 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2025-11-26 13:06:09.901264 | controller | Wednesday 26 November 2025 13:06:09 +0000 (0:00:00.274) 0:00:24.401 **** 2025-11-26 13:06:09.901520 | controller | 2025-11-26 13:06:09.974129 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2025-11-26 13:06:09.974153 | controller | Wednesday 26 November 2025 13:06:09 +0000 (0:00:00.015) 0:00:24.416 **** 2025-11-26 13:06:09.974166 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2025-11-26 13:06:09.974199 | controller | 2025-11-26 13:06:09.974209 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2025-11-26 13:06:09.974283 | controller | Wednesday 26 November 2025 13:06:09 +0000 (0:00:00.072) 0:00:24.489 **** 2025-11-26 13:06:10.014141 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2025-11-26 13:06:10.058156 | controller | 2025-11-26 13:06:10.058172 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-26 13:06:10.058179 | controller | Wednesday 26 November 2025 13:06:10 +0000 (0:00:00.039) 0:00:24.529 **** 2025-11-26 13:06:10.058189 | controller | ok: [instance] => (item=compute) 2025-11-26 13:06:10.058329 | controller | ok: [instance] => (item=controller) 2025-11-26 13:06:10.058451 | controller | ok: [instance] => (item=crc) 2025-11-26 13:06:10.058562 | controller | 2025-11-26 13:06:10.058679 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-26 13:06:10.058791 | controller | Wednesday 26 November 2025 13:06:10 +0000 (0:00:00.044) 0:00:24.573 **** 2025-11-26 13:06:10.098887 | controller | ok: [instance] 2025-11-26 13:06:10.098991 | controller | 2025-11-26 13:06:10.099185 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-11-26 13:06:10.099286 | controller | Wednesday 26 November 2025 13:06:10 +0000 (0:00:00.040) 0:00:24.614 **** 2025-11-26 13:06:10.158309 | controller | ok: [instance] => changed=false 2025-11-26 13:06:10.158477 | controller | msg: All assertions passed 2025-11-26 13:06:10.158591 | controller | 2025-11-26 13:06:10.158708 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2025-11-26 13:06:10.158825 | controller | Wednesday 26 November 2025 13:06:10 +0000 (0:00:00.059) 0:00:24.674 **** 2025-11-26 13:06:10.200206 | controller | 2025-11-26 13:06:10.200356 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2025-11-26 13:06:10.200534 | controller | Wednesday 26 November 2025 13:06:10 +0000 (0:00:00.041) 0:00:24.715 **** 2025-11-26 13:06:10.272878 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2025-11-26 13:06:10.273000 | controller | ok: [instance] => (item={}) 2025-11-26 13:06:10.273182 | controller | 2025-11-26 13:06:10.273372 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2025-11-26 13:06:10.273485 | controller | Wednesday 26 November 2025 13:06:10 +0000 (0:00:00.072) 0:00:24.788 **** 2025-11-26 13:06:10.288585 | controller | skipping: [instance] 2025-11-26 13:06:10.288682 | controller | 2025-11-26 13:06:10.288847 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2025-11-26 13:06:10.288932 | controller | Wednesday 26 November 2025 13:06:10 +0000 (0:00:00.015) 0:00:24.804 **** 2025-11-26 13:06:10.499535 | controller | ok: [instance] 2025-11-26 13:06:10.845998 | controller | 2025-11-26 13:06:10.846040 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2025-11-26 13:06:10.846048 | controller | Wednesday 26 November 2025 13:06:10 +0000 (0:00:00.210) 0:00:25.014 **** 2025-11-26 13:06:10.846057 | controller | changed: [instance] 2025-11-26 13:06:11.572974 | controller | 2025-11-26 13:06:11.573003 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2025-11-26 13:06:11.573030 | controller | Wednesday 26 November 2025 13:06:10 +0000 (0:00:00.346) 0:00:25.360 **** 2025-11-26 13:06:11.573041 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2025-11-26 13:06:11.604925 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2025-11-26 13:06:11.604943 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2025-11-26 13:06:11.604950 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2025-11-26 13:06:11.604956 | controller | 2025-11-26 13:06:11.604961 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2025-11-26 13:06:11.604966 | controller | Wednesday 26 November 2025 13:06:11 +0000 (0:00:00.726) 0:00:26.087 **** 2025-11-26 13:06:11.604975 | controller | skipping: [instance] 2025-11-26 13:06:11.975118 | controller | 2025-11-26 13:06:11.975148 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2025-11-26 13:06:11.975156 | controller | Wednesday 26 November 2025 13:06:11 +0000 (0:00:00.032) 0:00:26.120 **** 2025-11-26 13:06:11.975166 | controller | changed: [instance] 2025-11-26 13:06:12.412521 | controller | 2025-11-26 13:06:12.412553 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2025-11-26 13:06:12.412561 | controller | Wednesday 26 November 2025 13:06:11 +0000 (0:00:00.360) 0:00:26.480 **** 2025-11-26 13:06:12.412567 | controller | 2025-11-26 13:06:12.412580 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-11-26 13:06:12.412585 | controller | Wednesday 26 November 2025 13:06:11 +0000 (0:00:00.009) 0:00:26.489 **** 2025-11-26 13:06:12.412602 | controller | changed: [instance] 2025-11-26 13:06:12.412622 | controller | 2025-11-26 13:06:12.412845 | controller | TASK [Ensure no default networks exists] *************************************** 2025-11-26 13:06:12.485925 | controller | Wednesday 26 November 2025 13:06:12 +0000 (0:00:00.438) 0:00:26.927 **** 2025-11-26 13:06:12.485959 | controller | 2025-11-26 13:06:13.728116 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2025-11-26 13:06:13.728150 | controller | Wednesday 26 November 2025 13:06:12 +0000 (0:00:00.073) 0:00:27.001 **** 2025-11-26 13:06:13.728163 | controller | ok: [instance] 2025-11-26 13:06:13.958691 | controller | 2025-11-26 13:06:13.958724 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2025-11-26 13:06:13.958733 | controller | Wednesday 26 November 2025 13:06:13 +0000 (0:00:01.241) 0:00:28.243 **** 2025-11-26 13:06:13.958742 | controller | ok: [instance] 2025-11-26 13:06:14.466147 | controller | 2025-11-26 13:06:14.466192 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2025-11-26 13:06:14.466203 | controller | Wednesday 26 November 2025 13:06:13 +0000 (0:00:00.230) 0:00:28.473 **** 2025-11-26 13:06:14.466215 | controller | ok: [instance] 2025-11-26 13:06:14.466236 | controller | 2025-11-26 13:06:14.466471 | controller | TASK [libvirt_manager : Removing default] ************************************** 2025-11-26 13:06:14.682913 | controller | Wednesday 26 November 2025 13:06:14 +0000 (0:00:00.507) 0:00:28.981 **** 2025-11-26 13:06:14.682952 | controller | ok: [instance] 2025-11-26 13:06:15.869176 | controller | 2025-11-26 13:06:15.869209 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2025-11-26 13:06:15.869219 | controller | Wednesday 26 November 2025 13:06:14 +0000 (0:00:00.216) 0:00:29.198 **** 2025-11-26 13:06:15.869231 | controller | ok: [instance] 2025-11-26 13:06:15.869621 | controller | 2025-11-26 13:06:16.177177 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2025-11-26 13:06:16.177212 | controller | Wednesday 26 November 2025 13:06:15 +0000 (0:00:01.186) 0:00:30.384 **** 2025-11-26 13:06:16.177234 | controller | ok: [instance] 2025-11-26 13:06:16.476309 | controller | 2025-11-26 13:06:16.476345 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2025-11-26 13:06:16.476355 | controller | Wednesday 26 November 2025 13:06:16 +0000 (0:00:00.307) 0:00:30.692 **** 2025-11-26 13:06:16.476366 | controller | changed: [instance] 2025-11-26 13:06:16.773227 | controller | 2025-11-26 13:06:16.773265 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2025-11-26 13:06:16.773274 | controller | Wednesday 26 November 2025 13:06:16 +0000 (0:00:00.298) 0:00:30.991 **** 2025-11-26 13:06:16.773284 | controller | changed: [instance] 2025-11-26 13:06:17.324712 | controller | 2025-11-26 13:06:17.324744 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2025-11-26 13:06:17.324751 | controller | Wednesday 26 November 2025 13:06:16 +0000 (0:00:00.297) 0:00:31.288 **** 2025-11-26 13:06:17.324762 | controller | changed: [instance] => (item=arptables) 2025-11-26 13:06:17.622923 | controller | changed: [instance] => (item=iptables) 2025-11-26 13:06:17.622951 | controller | changed: [instance] => (item=ip6tables) 2025-11-26 13:06:17.622958 | controller | 2025-11-26 13:06:17.622964 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2025-11-26 13:06:17.622970 | controller | Wednesday 26 November 2025 13:06:17 +0000 (0:00:00.551) 0:00:31.839 **** 2025-11-26 13:06:17.622980 | controller | ok: [instance] 2025-11-26 13:06:17.730838 | controller | 2025-11-26 13:06:17.730870 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2025-11-26 13:06:17.730878 | controller | Wednesday 26 November 2025 13:06:17 +0000 (0:00:00.298) 0:00:32.138 **** 2025-11-26 13:06:17.730888 | controller | ok: [instance] 2025-11-26 13:06:17.773126 | controller | 2025-11-26 13:06:17.773149 | controller | TASK [Ensure the required network configurations are applied] ****************** 2025-11-26 13:06:17.773159 | controller | Wednesday 26 November 2025 13:06:17 +0000 (0:00:00.107) 0:00:32.245 **** 2025-11-26 13:06:17.773170 | controller | 2025-11-26 13:06:17.795601 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2025-11-26 13:06:17.795630 | controller | Wednesday 26 November 2025 13:06:17 +0000 (0:00:00.042) 0:00:32.288 **** 2025-11-26 13:06:17.795644 | controller | skipping: [instance] 2025-11-26 13:06:17.816728 | controller | 2025-11-26 13:06:17.816749 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2025-11-26 13:06:17.816758 | controller | Wednesday 26 November 2025 13:06:17 +0000 (0:00:00.022) 0:00:32.310 **** 2025-11-26 13:06:17.816769 | controller | skipping: [instance] 2025-11-26 13:06:17.837843 | controller | 2025-11-26 13:06:17.837862 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-11-26 13:06:17.837871 | controller | Wednesday 26 November 2025 13:06:17 +0000 (0:00:00.021) 0:00:32.332 **** 2025-11-26 13:06:17.837880 | controller | skipping: [instance] 2025-11-26 13:06:17.863697 | controller | 2025-11-26 13:06:17.863724 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2025-11-26 13:06:17.863733 | controller | Wednesday 26 November 2025 13:06:17 +0000 (0:00:00.021) 0:00:32.353 **** 2025-11-26 13:06:17.863743 | controller | skipping: [instance] 2025-11-26 13:06:17.863918 | controller | 2025-11-26 13:06:17.864135 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2025-11-26 13:06:17.864280 | controller | Wednesday 26 November 2025 13:06:17 +0000 (0:00:00.025) 0:00:32.379 **** 2025-11-26 13:06:17.901446 | controller | ok: [instance] 2025-11-26 13:06:17.901599 | controller | 2025-11-26 13:06:17.901754 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2025-11-26 13:06:17.901899 | controller | Wednesday 26 November 2025 13:06:17 +0000 (0:00:00.038) 0:00:32.417 **** 2025-11-26 13:06:17.935443 | controller | skipping: [instance] 2025-11-26 13:06:17.935642 | controller | 2025-11-26 13:06:17.935820 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2025-11-26 13:06:17.935990 | controller | Wednesday 26 November 2025 13:06:17 +0000 (0:00:00.033) 0:00:32.451 **** 2025-11-26 13:06:17.976939 | controller | skipping: [instance] 2025-11-26 13:06:17.977124 | controller | 2025-11-26 13:06:17.977278 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2025-11-26 13:06:17.977416 | controller | Wednesday 26 November 2025 13:06:17 +0000 (0:00:00.041) 0:00:32.492 **** 2025-11-26 13:06:18.031548 | controller | ok: [instance] 2025-11-26 13:06:18.031690 | controller | 2025-11-26 13:06:18.031821 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2025-11-26 13:06:18.031948 | controller | Wednesday 26 November 2025 13:06:18 +0000 (0:00:00.054) 0:00:32.547 **** 2025-11-26 13:06:18.053782 | controller | skipping: [instance] 2025-11-26 13:06:18.053969 | controller | 2025-11-26 13:06:18.054194 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2025-11-26 13:06:18.054385 | controller | Wednesday 26 November 2025 13:06:18 +0000 (0:00:00.021) 0:00:32.569 **** 2025-11-26 13:06:18.099667 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2025-11-26 13:06:18.099820 | controller | 2025-11-26 13:06:18.099961 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-11-26 13:06:18.100134 | controller | Wednesday 26 November 2025 13:06:18 +0000 (0:00:00.046) 0:00:32.615 **** 2025-11-26 13:06:18.408750 | controller | ok: [instance -> localhost] 2025-11-26 13:06:24.577117 | controller | 2025-11-26 13:06:24.577149 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2025-11-26 13:06:24.577157 | controller | Wednesday 26 November 2025 13:06:18 +0000 (0:00:00.308) 0:00:32.923 **** 2025-11-26 13:06:24.577167 | controller | changed: [instance -> localhost] 2025-11-26 13:06:24.577190 | controller | 2025-11-26 13:06:24.577197 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-11-26 13:06:24.577204 | controller | Wednesday 26 November 2025 13:06:24 +0000 (0:00:06.168) 0:00:39.092 **** 2025-11-26 13:06:24.771736 | controller | changed: [instance] 2025-11-26 13:06:25.106886 | controller | 2025-11-26 13:06:25.106913 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2025-11-26 13:06:25.106921 | controller | Wednesday 26 November 2025 13:06:24 +0000 (0:00:00.194) 0:00:39.287 **** 2025-11-26 13:06:25.106938 | controller | changed: [instance] 2025-11-26 13:06:26.718728 | controller | 2025-11-26 13:06:26.718769 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2025-11-26 13:06:26.718777 | controller | Wednesday 26 November 2025 13:06:25 +0000 (0:00:00.335) 0:00:39.622 **** 2025-11-26 13:06:26.718786 | controller | changed: [instance -> localhost] 2025-11-26 13:06:27.087869 | controller | 2025-11-26 13:06:27.087908 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2025-11-26 13:06:27.087917 | controller | Wednesday 26 November 2025 13:06:26 +0000 (0:00:01.611) 0:00:41.233 **** 2025-11-26 13:06:27.087927 | controller | changed: [instance] 2025-11-26 13:06:27.115896 | controller | 2025-11-26 13:06:27.115915 | controller | TASK [reproducer : Select right domain] **************************************** 2025-11-26 13:06:27.115924 | controller | Wednesday 26 November 2025 13:06:27 +0000 (0:00:00.369) 0:00:41.603 **** 2025-11-26 13:06:27.115934 | controller | ok: [instance] 2025-11-26 13:06:27.227640 | controller | 2025-11-26 13:06:27.227661 | controller | TASK [Create the virtual networks] ********************************************* 2025-11-26 13:06:27.227669 | controller | Wednesday 26 November 2025 13:06:27 +0000 (0:00:00.028) 0:00:41.631 **** 2025-11-26 13:06:27.227680 | controller | 2025-11-26 13:06:27.245722 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2025-11-26 13:06:27.245740 | controller | Wednesday 26 November 2025 13:06:27 +0000 (0:00:00.111) 0:00:41.743 **** 2025-11-26 13:06:27.245751 | controller | ok: [instance] 2025-11-26 13:06:27.430074 | controller | 2025-11-26 13:06:27.430108 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2025-11-26 13:06:27.430116 | controller | Wednesday 26 November 2025 13:06:27 +0000 (0:00:00.017) 0:00:41.761 **** 2025-11-26 13:06:27.430127 | controller | ok: [instance] 2025-11-26 13:06:27.458213 | controller | 2025-11-26 13:06:27.458236 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2025-11-26 13:06:27.458245 | controller | Wednesday 26 November 2025 13:06:27 +0000 (0:00:00.184) 0:00:41.945 **** 2025-11-26 13:06:27.458256 | controller | skipping: [instance] 2025-11-26 13:06:27.458284 | controller | 2025-11-26 13:06:27.458294 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2025-11-26 13:06:27.458432 | controller | Wednesday 26 November 2025 13:06:27 +0000 (0:00:00.028) 0:00:41.973 **** 2025-11-26 13:06:27.486541 | controller | skipping: [instance] 2025-11-26 13:06:27.539508 | controller | 2025-11-26 13:06:27.539526 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2025-11-26 13:06:27.539533 | controller | Wednesday 26 November 2025 13:06:27 +0000 (0:00:00.028) 0:00:42.001 **** 2025-11-26 13:06:27.539541 | controller | ok: [instance] 2025-11-26 13:06:27.659761 | controller | 2025-11-26 13:06:27.659781 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2025-11-26 13:06:27.659788 | controller | Wednesday 26 November 2025 13:06:27 +0000 (0:00:00.052) 0:00:42.054 **** 2025-11-26 13:06:27.659797 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2025-11-26 13:06:27.692088 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2025-11-26 13:06:27.692120 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2025-11-26 13:06:27.692128 | controller | 2025-11-26 13:06:27.692134 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2025-11-26 13:06:27.692140 | controller | Wednesday 26 November 2025 13:06:27 +0000 (0:00:00.119) 0:00:42.174 **** 2025-11-26 13:06:27.692158 | controller | skipping: [instance] 2025-11-26 13:06:27.692184 | controller | 2025-11-26 13:06:27.692250 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2025-11-26 13:06:27.692394 | controller | Wednesday 26 November 2025 13:06:27 +0000 (0:00:00.032) 0:00:42.207 **** 2025-11-26 13:06:28.034534 | controller | changed: [instance] 2025-11-26 13:06:28.149979 | controller | 2025-11-26 13:06:28.150031 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2025-11-26 13:06:28.150042 | controller | Wednesday 26 November 2025 13:06:28 +0000 (0:00:00.342) 0:00:42.549 **** 2025-11-26 13:06:28.150066 | controller | changed: [instance] => (item=Adding compute-0 to computes) 2025-11-26 13:06:28.172944 | controller | changed: [instance] => (item=Adding controller-0 to controllers) 2025-11-26 13:06:28.172969 | controller | changed: [instance] => (item=Adding crc-0 to ocps) 2025-11-26 13:06:28.172976 | controller | 2025-11-26 13:06:28.172982 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-11-26 13:06:28.172987 | controller | Wednesday 26 November 2025 13:06:28 +0000 (0:00:00.115) 0:00:42.664 **** 2025-11-26 13:06:28.172997 | controller | skipping: [instance] 2025-11-26 13:06:28.197106 | controller | 2025-11-26 13:06:28.197139 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-11-26 13:06:28.197147 | controller | Wednesday 26 November 2025 13:06:28 +0000 (0:00:00.023) 0:00:42.688 **** 2025-11-26 13:06:28.197157 | controller | skipping: [instance] 2025-11-26 13:06:28.197182 | controller | 2025-11-26 13:06:28.197190 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-11-26 13:06:28.197292 | controller | Wednesday 26 November 2025 13:06:28 +0000 (0:00:00.024) 0:00:42.712 **** 2025-11-26 13:06:28.221213 | controller | skipping: [instance] 2025-11-26 13:06:28.221275 | controller | 2025-11-26 13:06:28.221292 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-11-26 13:06:28.221399 | controller | Wednesday 26 November 2025 13:06:28 +0000 (0:00:00.023) 0:00:42.736 **** 2025-11-26 13:06:28.244182 | controller | skipping: [instance] 2025-11-26 13:06:28.244280 | controller | 2025-11-26 13:06:28.244294 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-11-26 13:06:28.244305 | controller | Wednesday 26 November 2025 13:06:28 +0000 (0:00:00.023) 0:00:42.759 **** 2025-11-26 13:06:28.262550 | controller | ok: [instance] 2025-11-26 13:06:28.262689 | controller | 2025-11-26 13:06:28.262876 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-11-26 13:06:28.262967 | controller | Wednesday 26 November 2025 13:06:28 +0000 (0:00:00.018) 0:00:42.778 **** 2025-11-26 13:06:28.368487 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-11-26 13:06:28.368603 | controller | 2025-11-26 13:06:28.368739 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-11-26 13:06:28.368865 | controller | Wednesday 26 November 2025 13:06:28 +0000 (0:00:00.105) 0:00:42.883 **** 2025-11-26 13:06:28.387394 | controller | skipping: [instance] 2025-11-26 13:06:28.387529 | controller | 2025-11-26 13:06:28.387655 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-11-26 13:06:28.387774 | controller | Wednesday 26 November 2025 13:06:28 +0000 (0:00:00.018) 0:00:42.902 **** 2025-11-26 13:06:28.591423 | controller | changed: [instance] 2025-11-26 13:06:28.986201 | controller | 2025-11-26 13:06:28.986237 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-11-26 13:06:28.986247 | controller | Wednesday 26 November 2025 13:06:28 +0000 (0:00:00.203) 0:00:43.106 **** 2025-11-26 13:06:28.986259 | controller | changed: [instance] 2025-11-26 13:06:29.045478 | controller | 2025-11-26 13:06:29.045512 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-11-26 13:06:29.045520 | controller | Wednesday 26 November 2025 13:06:28 +0000 (0:00:00.394) 0:00:43.501 **** 2025-11-26 13:06:29.045531 | controller | ok: [instance] 2025-11-26 13:06:29.075120 | controller | 2025-11-26 13:06:29.075152 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-11-26 13:06:29.075161 | controller | Wednesday 26 November 2025 13:06:29 +0000 (0:00:00.059) 0:00:43.560 **** 2025-11-26 13:06:29.075172 | controller | ok: [instance] 2025-11-26 13:06:29.471316 | controller | 2025-11-26 13:06:29.471359 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-11-26 13:06:29.471369 | controller | Wednesday 26 November 2025 13:06:29 +0000 (0:00:00.029) 0:00:43.590 **** 2025-11-26 13:06:29.471381 | controller | changed: [instance] 2025-11-26 13:06:29.471404 | controller | 2025-11-26 13:06:29.471613 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2025-11-26 13:06:29.551163 | controller | Wednesday 26 November 2025 13:06:29 +0000 (0:00:00.396) 0:00:43.986 **** 2025-11-26 13:06:29.551201 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2025-11-26 13:06:29.551389 | controller | 2025-11-26 13:06:29.551407 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2025-11-26 13:06:29.603157 | controller | Wednesday 26 November 2025 13:06:29 +0000 (0:00:00.079) 0:00:44.066 **** 2025-11-26 13:06:29.603204 | controller | ok: [instance] => (item=public) 2025-11-26 13:06:29.603357 | controller | ok: [instance] => (item=osp_trunk) 2025-11-26 13:06:29.603376 | controller | 2025-11-26 13:06:29.603387 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2025-11-26 13:06:30.033171 | controller | Wednesday 26 November 2025 13:06:29 +0000 (0:00:00.051) 0:00:44.118 **** 2025-11-26 13:06:30.033209 | controller | changed: [instance] => (item=cifmw-public) 2025-11-26 13:06:30.593847 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-11-26 13:06:30.593876 | controller | 2025-11-26 13:06:30.593884 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2025-11-26 13:06:30.593890 | controller | Wednesday 26 November 2025 13:06:30 +0000 (0:00:00.429) 0:00:44.548 **** 2025-11-26 13:06:30.593900 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 13:06:31.015872 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 13:06:31.015906 | controller | 2025-11-26 13:06:31.015916 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2025-11-26 13:06:31.015923 | controller | Wednesday 26 November 2025 13:06:30 +0000 (0:00:00.560) 0:00:45.109 **** 2025-11-26 13:06:31.015935 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 13:06:31.433148 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 13:06:31.433184 | controller | 2025-11-26 13:06:31.433194 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2025-11-26 13:06:31.433201 | controller | Wednesday 26 November 2025 13:06:31 +0000 (0:00:00.421) 0:00:45.530 **** 2025-11-26 13:06:31.433224 | controller | changed: [instance] => (item=cifmw-public) 2025-11-26 13:06:31.489520 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-11-26 13:06:31.489542 | controller | 2025-11-26 13:06:31.489550 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2025-11-26 13:06:31.489557 | controller | Wednesday 26 November 2025 13:06:31 +0000 (0:00:00.417) 0:00:45.947 **** 2025-11-26 13:06:31.489567 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2025-11-26 13:06:31.669086 | controller | 2025-11-26 13:06:31.669119 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2025-11-26 13:06:31.669129 | controller | Wednesday 26 November 2025 13:06:31 +0000 (0:00:00.056) 0:00:46.004 **** 2025-11-26 13:06:31.669141 | controller | ok: [instance] 2025-11-26 13:06:32.040672 | controller | 2025-11-26 13:06:32.040703 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2025-11-26 13:06:32.040711 | controller | Wednesday 26 November 2025 13:06:31 +0000 (0:00:00.179) 0:00:46.184 **** 2025-11-26 13:06:32.040721 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 13:06:32.107152 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 13:06:32.107185 | controller | 2025-11-26 13:06:32.107195 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2025-11-26 13:06:32.107203 | controller | Wednesday 26 November 2025 13:06:32 +0000 (0:00:00.371) 0:00:46.555 **** 2025-11-26 13:06:32.107214 | controller | 2025-11-26 13:06:32.107246 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-11-26 13:06:32.107356 | controller | Wednesday 26 November 2025 13:06:32 +0000 (0:00:00.066) 0:00:46.622 **** 2025-11-26 13:06:32.141522 | controller | skipping: [instance] 2025-11-26 13:06:33.361557 | controller | 2025-11-26 13:06:33.361588 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2025-11-26 13:06:33.361596 | controller | Wednesday 26 November 2025 13:06:32 +0000 (0:00:00.034) 0:00:46.656 **** 2025-11-26 13:06:33.361606 | controller | ok: [instance] 2025-11-26 13:06:33.562502 | controller | 2025-11-26 13:06:33.562533 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-11-26 13:06:33.562541 | controller | Wednesday 26 November 2025 13:06:33 +0000 (0:00:01.219) 0:00:47.876 **** 2025-11-26 13:06:33.562551 | controller | ok: [instance] 2025-11-26 13:06:33.921196 | controller | 2025-11-26 13:06:33.921229 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2025-11-26 13:06:33.921239 | controller | Wednesday 26 November 2025 13:06:33 +0000 (0:00:00.201) 0:00:48.077 **** 2025-11-26 13:06:33.921251 | controller | changed: [instance] 2025-11-26 13:06:35.561166 | controller | 2025-11-26 13:06:35.561199 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2025-11-26 13:06:35.561209 | controller | Wednesday 26 November 2025 13:06:33 +0000 (0:00:00.358) 0:00:48.436 **** 2025-11-26 13:06:35.561221 | controller | changed: [instance] 2025-11-26 13:06:35.561257 | controller | 2025-11-26 13:06:35.561267 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2025-11-26 13:06:35.913032 | controller | Wednesday 26 November 2025 13:06:35 +0000 (0:00:01.640) 0:00:50.076 **** 2025-11-26 13:06:35.913072 | controller | changed: [instance] 2025-11-26 13:06:35.945222 | controller | 2025-11-26 13:06:35.945258 | controller | TASK [Create extra network configuration] ************************************** 2025-11-26 13:06:35.945267 | controller | Wednesday 26 November 2025 13:06:35 +0000 (0:00:00.351) 0:00:50.428 **** 2025-11-26 13:06:35.945287 | controller | skipping: [instance] 2025-11-26 13:06:35.973683 | controller | 2025-11-26 13:06:35.973707 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2025-11-26 13:06:35.973716 | controller | Wednesday 26 November 2025 13:06:35 +0000 (0:00:00.032) 0:00:50.460 **** 2025-11-26 13:06:35.973726 | controller | skipping: [instance] 2025-11-26 13:06:36.404903 | controller | 2025-11-26 13:06:36.404933 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2025-11-26 13:06:36.404945 | controller | Wednesday 26 November 2025 13:06:35 +0000 (0:00:00.028) 0:00:50.489 **** 2025-11-26 13:06:36.404955 | controller | ok: [instance] 2025-11-26 13:06:36.600002 | controller | 2025-11-26 13:06:36.600039 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2025-11-26 13:06:36.600047 | controller | Wednesday 26 November 2025 13:06:36 +0000 (0:00:00.430) 0:00:50.920 **** 2025-11-26 13:06:36.600056 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 13:06:37.842372 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 13:06:37.842402 | controller | 2025-11-26 13:06:37.842410 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2025-11-26 13:06:37.842416 | controller | Wednesday 26 November 2025 13:06:36 +0000 (0:00:00.194) 0:00:51.114 **** 2025-11-26 13:06:37.842425 | controller | ok: [instance] 2025-11-26 13:06:41.496801 | controller | 2025-11-26 13:06:41.496832 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2025-11-26 13:06:41.496840 | controller | Wednesday 26 November 2025 13:06:37 +0000 (0:00:01.242) 0:00:52.357 **** 2025-11-26 13:06:41.496850 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2025-11-26 13:06:41.710550 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2025-11-26 13:06:41.710580 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2025-11-26 13:06:41.710587 | controller | 2025-11-26 13:06:41.710593 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2025-11-26 13:06:41.710599 | controller | Wednesday 26 November 2025 13:06:41 +0000 (0:00:03.654) 0:00:56.011 **** 2025-11-26 13:06:41.710608 | controller | changed: [instance] 2025-11-26 13:06:42.062715 | controller | 2025-11-26 13:06:42.062744 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2025-11-26 13:06:42.062752 | controller | Wednesday 26 November 2025 13:06:41 +0000 (0:00:00.213) 0:00:56.225 **** 2025-11-26 13:06:42.062761 | controller | changed: [instance] 2025-11-26 13:06:42.443948 | controller | 2025-11-26 13:06:42.443978 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2025-11-26 13:06:42.443986 | controller | Wednesday 26 November 2025 13:06:42 +0000 (0:00:00.352) 0:00:56.577 **** 2025-11-26 13:06:42.443997 | controller | changed: [instance] 2025-11-26 13:06:42.476192 | controller | 2025-11-26 13:06:42.476245 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2025-11-26 13:06:42.476256 | controller | Wednesday 26 November 2025 13:06:42 +0000 (0:00:00.381) 0:00:56.959 **** 2025-11-26 13:06:42.476270 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2025-11-26 13:06:42.859680 | controller | 2025-11-26 13:06:42.859709 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2025-11-26 13:06:42.859717 | controller | Wednesday 26 November 2025 13:06:42 +0000 (0:00:00.032) 0:00:56.991 **** 2025-11-26 13:06:42.859727 | controller | changed: [instance] 2025-11-26 13:06:42.878514 | controller | 2025-11-26 13:06:42.878543 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2025-11-26 13:06:42.878552 | controller | Wednesday 26 November 2025 13:06:42 +0000 (0:00:00.383) 0:00:57.374 **** 2025-11-26 13:06:42.878562 | controller | skipping: [instance] 2025-11-26 13:06:42.878915 | controller | 2025-11-26 13:06:42.912584 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2025-11-26 13:06:42.912604 | controller | Wednesday 26 November 2025 13:06:42 +0000 (0:00:00.019) 0:00:57.394 **** 2025-11-26 13:06:42.912614 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2025-11-26 13:06:43.275760 | controller | 2025-11-26 13:06:43.275788 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2025-11-26 13:06:43.275796 | controller | Wednesday 26 November 2025 13:06:42 +0000 (0:00:00.033) 0:00:57.427 **** 2025-11-26 13:06:43.275806 | controller | changed: [instance] 2025-11-26 13:06:43.294141 | controller | 2025-11-26 13:06:43.294175 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2025-11-26 13:06:43.294185 | controller | Wednesday 26 November 2025 13:06:43 +0000 (0:00:00.363) 0:00:57.791 **** 2025-11-26 13:06:43.294196 | controller | skipping: [instance] 2025-11-26 13:06:43.294226 | controller | 2025-11-26 13:06:43.294236 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2025-11-26 13:06:43.294295 | controller | Wednesday 26 November 2025 13:06:43 +0000 (0:00:00.018) 0:00:57.809 **** 2025-11-26 13:06:43.498944 | controller | ok: [instance] => (item=127.0.0.2) 2025-11-26 13:06:44.163893 | controller | 2025-11-26 13:06:44.163922 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2025-11-26 13:06:44.163936 | controller | Wednesday 26 November 2025 13:06:43 +0000 (0:00:00.204) 0:00:58.014 **** 2025-11-26 13:06:44.163946 | controller | changed: [instance] 2025-11-26 13:06:44.184139 | controller | 2025-11-26 13:06:44.184164 | controller | TASK [dnsmasq : Stop service] ************************************************** 2025-11-26 13:06:44.184172 | controller | Wednesday 26 November 2025 13:06:44 +0000 (0:00:00.664) 0:00:58.679 **** 2025-11-26 13:06:44.184181 | controller | skipping: [instance] 2025-11-26 13:06:44.184223 | controller | 2025-11-26 13:06:44.184233 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2025-11-26 13:06:44.184347 | controller | Wednesday 26 November 2025 13:06:44 +0000 (0:00:00.020) 0:00:58.699 **** 2025-11-26 13:06:44.203877 | controller | skipping: [instance] 2025-11-26 13:06:44.232995 | controller | 2025-11-26 13:06:44.233029 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2025-11-26 13:06:44.233039 | controller | Wednesday 26 November 2025 13:06:44 +0000 (0:00:00.019) 0:00:58.719 **** 2025-11-26 13:06:44.233048 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-11-26 13:06:44.347336 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2025-11-26 13:06:44.347353 | controller | skipping: [instance] 2025-11-26 13:06:44.347360 | controller | 2025-11-26 13:06:44.347366 | controller | TASK [Create dnsmasq networks] ************************************************* 2025-11-26 13:06:44.347371 | controller | Wednesday 26 November 2025 13:06:44 +0000 (0:00:00.028) 0:00:58.748 **** 2025-11-26 13:06:44.347378 | controller | 2025-11-26 13:06:44.375745 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-11-26 13:06:44.375795 | controller | Wednesday 26 November 2025 13:06:44 +0000 (0:00:00.114) 0:00:58.862 **** 2025-11-26 13:06:44.375817 | controller | ok: [instance] => changed=false 2025-11-26 13:06:44.375862 | controller | msg: All assertions passed 2025-11-26 13:06:44.376155 | controller | 2025-11-26 13:06:44.376188 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-11-26 13:06:44.376206 | controller | Wednesday 26 November 2025 13:06:44 +0000 (0:00:00.028) 0:00:58.891 **** 2025-11-26 13:06:44.415177 | controller | ok: [instance] => changed=false 2025-11-26 13:06:44.415250 | controller | msg: All assertions passed 2025-11-26 13:06:44.415277 | controller | 2025-11-26 13:06:44.415286 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-11-26 13:06:44.415298 | controller | Wednesday 26 November 2025 13:06:44 +0000 (0:00:00.038) 0:00:58.930 **** 2025-11-26 13:06:44.842844 | controller | changed: [instance] 2025-11-26 13:06:44.862061 | controller | 2025-11-26 13:06:44.862102 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-11-26 13:06:44.862116 | controller | Wednesday 26 November 2025 13:06:44 +0000 (0:00:00.427) 0:00:59.358 **** 2025-11-26 13:06:44.862128 | controller | skipping: [instance] 2025-11-26 13:06:44.886202 | controller | 2025-11-26 13:06:44.886246 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-11-26 13:06:44.886260 | controller | Wednesday 26 November 2025 13:06:44 +0000 (0:00:00.019) 0:00:59.377 **** 2025-11-26 13:06:44.886275 | controller | skipping: [instance] 2025-11-26 13:06:44.886316 | controller | 2025-11-26 13:06:44.886329 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-11-26 13:06:44.886415 | controller | Wednesday 26 November 2025 13:06:44 +0000 (0:00:00.024) 0:00:59.401 **** 2025-11-26 13:06:44.917160 | controller | ok: [instance] => changed=false 2025-11-26 13:06:44.917210 | controller | msg: All assertions passed 2025-11-26 13:06:44.917220 | controller | 2025-11-26 13:06:44.917230 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-11-26 13:06:44.917382 | controller | Wednesday 26 November 2025 13:06:44 +0000 (0:00:00.030) 0:00:59.432 **** 2025-11-26 13:06:44.953539 | controller | ok: [instance] => changed=false 2025-11-26 13:06:45.373146 | controller | msg: All assertions passed 2025-11-26 13:06:45.373179 | controller | 2025-11-26 13:06:45.373189 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-11-26 13:06:45.373197 | controller | Wednesday 26 November 2025 13:06:44 +0000 (0:00:00.036) 0:00:59.468 **** 2025-11-26 13:06:45.373208 | controller | changed: [instance] 2025-11-26 13:06:45.373238 | controller | 2025-11-26 13:06:45.373248 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-11-26 13:06:45.373327 | controller | Wednesday 26 November 2025 13:06:45 +0000 (0:00:00.419) 0:00:59.888 **** 2025-11-26 13:06:45.391807 | controller | skipping: [instance] 2025-11-26 13:06:45.415916 | controller | 2025-11-26 13:06:45.415937 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-11-26 13:06:45.415945 | controller | Wednesday 26 November 2025 13:06:45 +0000 (0:00:00.018) 0:00:59.907 **** 2025-11-26 13:06:45.415954 | controller | skipping: [instance] 2025-11-26 13:06:45.446161 | controller | 2025-11-26 13:06:45.446197 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2025-11-26 13:06:45.446216 | controller | Wednesday 26 November 2025 13:06:45 +0000 (0:00:00.024) 0:00:59.931 **** 2025-11-26 13:06:45.446233 | controller | skipping: [instance] 2025-11-26 13:06:45.936660 | controller | 2025-11-26 13:06:45.936689 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2025-11-26 13:06:45.936697 | controller | Wednesday 26 November 2025 13:06:45 +0000 (0:00:00.030) 0:00:59.961 **** 2025-11-26 13:06:45.936707 | controller | changed: [instance] => (item=cifmw-public) 2025-11-26 13:06:45.971380 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-11-26 13:06:45.971404 | controller | 2025-11-26 13:06:45.971411 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-11-26 13:06:45.971417 | controller | Wednesday 26 November 2025 13:06:45 +0000 (0:00:00.490) 0:01:00.451 **** 2025-11-26 13:06:45.971426 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2025-11-26 13:06:46.298111 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2025-11-26 13:06:46.298141 | controller | 2025-11-26 13:06:46.298149 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-11-26 13:06:46.298155 | controller | Wednesday 26 November 2025 13:06:45 +0000 (0:00:00.034) 0:01:00.486 **** 2025-11-26 13:06:46.298165 | controller | ok: [instance] 2025-11-26 13:06:46.298404 | controller | 2025-11-26 13:06:46.298705 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-11-26 13:06:46.334156 | controller | Wednesday 26 November 2025 13:06:46 +0000 (0:00:00.327) 0:01:00.813 **** 2025-11-26 13:06:46.334202 | controller | ok: [instance] 2025-11-26 13:06:46.334403 | controller | 2025-11-26 13:06:46.334439 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-11-26 13:06:46.536042 | controller | Wednesday 26 November 2025 13:06:46 +0000 (0:00:00.035) 0:01:00.849 **** 2025-11-26 13:06:46.536094 | controller | ok: [instance] 2025-11-26 13:06:46.570137 | controller | 2025-11-26 13:06:46.570175 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-11-26 13:06:46.570185 | controller | Wednesday 26 November 2025 13:06:46 +0000 (0:00:00.201) 0:01:01.051 **** 2025-11-26 13:06:46.570199 | controller | ok: [instance] 2025-11-26 13:06:46.905791 | controller | 2025-11-26 13:06:46.905819 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2025-11-26 13:06:46.905827 | controller | Wednesday 26 November 2025 13:06:46 +0000 (0:00:00.034) 0:01:01.085 **** 2025-11-26 13:06:46.905842 | controller | changed: [instance] 2025-11-26 13:06:47.242385 | controller | 2025-11-26 13:06:47.242415 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2025-11-26 13:06:47.242424 | controller | Wednesday 26 November 2025 13:06:46 +0000 (0:00:00.335) 0:01:01.421 **** 2025-11-26 13:06:47.242437 | controller | changed: [instance] 2025-11-26 13:06:47.574110 | controller | 2025-11-26 13:06:47.574171 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2025-11-26 13:06:47.574180 | controller | Wednesday 26 November 2025 13:06:47 +0000 (0:00:00.336) 0:01:01.757 **** 2025-11-26 13:06:47.574195 | controller | changed: [instance] 2025-11-26 13:06:47.673113 | controller | 2025-11-26 13:06:47.673155 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2025-11-26 13:06:47.673169 | controller | Wednesday 26 November 2025 13:06:47 +0000 (0:00:00.331) 0:01:02.089 **** 2025-11-26 13:06:47.673186 | controller | ok: [instance] 2025-11-26 13:06:47.673365 | controller | 2025-11-26 13:06:47.673402 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2025-11-26 13:06:48.017471 | controller | Wednesday 26 November 2025 13:06:47 +0000 (0:00:00.099) 0:01:02.188 **** 2025-11-26 13:06:48.017506 | controller | changed: [instance] 2025-11-26 13:06:48.041137 | controller | 2025-11-26 13:06:48.041171 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-11-26 13:06:48.041180 | controller | Wednesday 26 November 2025 13:06:48 +0000 (0:00:00.344) 0:01:02.532 **** 2025-11-26 13:06:48.041193 | controller | skipping: [instance] 2025-11-26 13:06:48.064815 | controller | 2025-11-26 13:06:48.064839 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-11-26 13:06:48.064849 | controller | Wednesday 26 November 2025 13:06:48 +0000 (0:00:00.024) 0:01:02.556 **** 2025-11-26 13:06:48.064860 | controller | skipping: [instance] 2025-11-26 13:06:48.089121 | controller | 2025-11-26 13:06:48.089141 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-11-26 13:06:48.089149 | controller | Wednesday 26 November 2025 13:06:48 +0000 (0:00:00.023) 0:01:02.580 **** 2025-11-26 13:06:48.089159 | controller | skipping: [instance] 2025-11-26 13:06:48.114172 | controller | 2025-11-26 13:06:48.114198 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-11-26 13:06:48.114206 | controller | Wednesday 26 November 2025 13:06:48 +0000 (0:00:00.024) 0:01:02.604 **** 2025-11-26 13:06:48.114217 | controller | skipping: [instance] 2025-11-26 13:06:48.133130 | controller | 2025-11-26 13:06:48.133153 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-11-26 13:06:48.133166 | controller | Wednesday 26 November 2025 13:06:48 +0000 (0:00:00.025) 0:01:02.629 **** 2025-11-26 13:06:48.133185 | controller | ok: [instance] 2025-11-26 13:06:48.133361 | controller | 2025-11-26 13:06:48.133383 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-11-26 13:06:48.223759 | controller | Wednesday 26 November 2025 13:06:48 +0000 (0:00:00.019) 0:01:02.648 **** 2025-11-26 13:06:48.223784 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-11-26 13:06:48.242243 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-11-26 13:06:48.242262 | controller | 2025-11-26 13:06:48.242270 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-11-26 13:06:48.242275 | controller | Wednesday 26 November 2025 13:06:48 +0000 (0:00:00.090) 0:01:02.738 **** 2025-11-26 13:06:48.242284 | controller | skipping: [instance] 2025-11-26 13:06:48.242414 | controller | 2025-11-26 13:06:48.242550 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-11-26 13:06:48.242685 | controller | Wednesday 26 November 2025 13:06:48 +0000 (0:00:00.019) 0:01:02.758 **** 2025-11-26 13:06:48.491126 | controller | ok: [instance] 2025-11-26 13:06:48.491447 | controller | 2025-11-26 13:06:48.881197 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-11-26 13:06:48.881227 | controller | Wednesday 26 November 2025 13:06:48 +0000 (0:00:00.248) 0:01:03.006 **** 2025-11-26 13:06:48.881238 | controller | changed: [instance] 2025-11-26 13:06:48.942160 | controller | 2025-11-26 13:06:48.942198 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-11-26 13:06:48.942208 | controller | Wednesday 26 November 2025 13:06:48 +0000 (0:00:00.389) 0:01:03.396 **** 2025-11-26 13:06:48.942221 | controller | ok: [instance] 2025-11-26 13:06:48.974189 | controller | 2025-11-26 13:06:48.974235 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-11-26 13:06:48.974245 | controller | Wednesday 26 November 2025 13:06:48 +0000 (0:00:00.060) 0:01:03.457 **** 2025-11-26 13:06:48.974257 | controller | ok: [instance] 2025-11-26 13:06:48.974289 | controller | 2025-11-26 13:06:48.974299 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-11-26 13:06:49.378197 | controller | Wednesday 26 November 2025 13:06:48 +0000 (0:00:00.032) 0:01:03.489 **** 2025-11-26 13:06:49.378255 | controller | changed: [instance] 2025-11-26 13:06:49.378301 | controller | 2025-11-26 13:06:49.378316 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2025-11-26 13:06:49.378434 | controller | Wednesday 26 November 2025 13:06:49 +0000 (0:00:00.403) 0:01:03.893 **** 2025-11-26 13:06:49.408525 | controller | ok: [instance] 2025-11-26 13:06:49.426909 | controller | 2025-11-26 13:06:49.426932 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2025-11-26 13:06:49.426940 | controller | Wednesday 26 November 2025 13:06:49 +0000 (0:00:00.030) 0:01:03.923 **** 2025-11-26 13:06:49.426951 | controller | ok: [instance] 2025-11-26 13:06:49.445759 | controller | 2025-11-26 13:06:49.445779 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2025-11-26 13:06:49.445788 | controller | Wednesday 26 November 2025 13:06:49 +0000 (0:00:00.018) 0:01:03.942 **** 2025-11-26 13:06:49.445797 | controller | ok: [instance] 2025-11-26 13:06:49.517200 | controller | 2025-11-26 13:06:49.517248 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2025-11-26 13:06:49.517262 | controller | Wednesday 26 November 2025 13:06:49 +0000 (0:00:00.018) 0:01:03.961 **** 2025-11-26 13:06:49.517280 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2025-11-26 13:06:49.517325 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2025-11-26 13:06:49.517340 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2025-11-26 13:06:49.518106 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2025-11-26 13:06:49.648185 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2025-11-26 13:06:49.648221 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2025-11-26 13:06:49.648234 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2025-11-26 13:06:49.648244 | controller | 2025-11-26 13:06:49.648254 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-26 13:06:49.648264 | controller | Wednesday 26 November 2025 13:06:49 +0000 (0:00:00.071) 0:01:04.032 **** 2025-11-26 13:06:49.648281 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2025-11-26 13:06:49.648372 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2025-11-26 13:06:49.648389 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2025-11-26 13:06:49.648399 | controller | 2025-11-26 13:06:49.648409 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-26 13:06:49.648423 | controller | Wednesday 26 November 2025 13:06:49 +0000 (0:00:00.130) 0:01:04.163 **** 2025-11-26 13:06:49.727512 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2025-11-26 13:06:49.727681 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2025-11-26 13:06:49.727803 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2025-11-26 13:06:49.727967 | controller | skipping: [instance] 2025-11-26 13:06:49.728107 | controller | 2025-11-26 13:06:49.728258 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-26 13:06:49.728385 | controller | Wednesday 26 November 2025 13:06:49 +0000 (0:00:00.079) 0:01:04.243 **** 2025-11-26 13:06:49.806816 | controller | skipping: [instance] => (item=compute-0 - storage) 2025-11-26 13:06:49.806981 | controller | skipping: [instance] => (item=controller-0 - storage) 2025-11-26 13:06:49.807134 | controller | skipping: [instance] => (item=crc-0 - storage) 2025-11-26 13:06:49.807323 | controller | skipping: [instance] 2025-11-26 13:06:49.807416 | controller | 2025-11-26 13:06:49.807564 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-26 13:06:49.807689 | controller | Wednesday 26 November 2025 13:06:49 +0000 (0:00:00.079) 0:01:04.322 **** 2025-11-26 13:06:49.885332 | controller | skipping: [instance] => (item=compute-0 - tenant) 2025-11-26 13:06:49.885478 | controller | skipping: [instance] => (item=controller-0 - tenant) 2025-11-26 13:06:49.885585 | controller | skipping: [instance] => (item=crc-0 - tenant) 2025-11-26 13:06:49.885716 | controller | skipping: [instance] 2025-11-26 13:06:49.885845 | controller | 2025-11-26 13:06:49.885983 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-26 13:06:49.886141 | controller | Wednesday 26 November 2025 13:06:49 +0000 (0:00:00.078) 0:01:04.401 **** 2025-11-26 13:06:49.964395 | controller | skipping: [instance] => (item=compute-0 - external) 2025-11-26 13:06:49.964512 | controller | skipping: [instance] => (item=controller-0 - external) 2025-11-26 13:06:49.964610 | controller | skipping: [instance] => (item=crc-0 - external) 2025-11-26 13:06:49.964752 | controller | skipping: [instance] 2025-11-26 13:06:49.964811 | controller | 2025-11-26 13:06:49.964925 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-26 13:06:49.965022 | controller | Wednesday 26 November 2025 13:06:49 +0000 (0:00:00.079) 0:01:04.480 **** 2025-11-26 13:06:50.045737 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2025-11-26 13:06:50.045844 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2025-11-26 13:06:50.045997 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2025-11-26 13:06:50.046118 | controller | skipping: [instance] 2025-11-26 13:06:50.046234 | controller | 2025-11-26 13:06:50.046357 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-11-26 13:06:50.046464 | controller | Wednesday 26 November 2025 13:06:50 +0000 (0:00:00.081) 0:01:04.561 **** 2025-11-26 13:06:50.178002 | controller | ok: [instance] => (item=compute-0 - public) 2025-11-26 13:06:50.178151 | controller | ok: [instance] => (item=controller-0 - public) 2025-11-26 13:06:50.178371 | controller | ok: [instance] => (item=crc-0 - public) 2025-11-26 13:06:50.178427 | controller | 2025-11-26 13:06:50.178599 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2025-11-26 13:06:50.178704 | controller | Wednesday 26 November 2025 13:06:50 +0000 (0:00:00.132) 0:01:04.693 **** 2025-11-26 13:06:50.282858 | controller | 2025-11-26 13:06:50.282982 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2025-11-26 13:06:50.283170 | controller | Wednesday 26 November 2025 13:06:50 +0000 (0:00:00.104) 0:01:04.798 **** 2025-11-26 13:06:50.318901 | controller | ok: [instance] 2025-11-26 13:06:50.319027 | controller | 2025-11-26 13:06:50.319207 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2025-11-26 13:06:50.319320 | controller | Wednesday 26 November 2025 13:06:50 +0000 (0:00:00.036) 0:01:04.834 **** 2025-11-26 13:06:50.412797 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:7f:97:1b', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-11-26 13:06:50.412961 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:72:f0:60', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-11-26 13:06:50.413189 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:f1:02:5c', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-11-26 13:06:50.413279 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:6d:00:ac', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-11-26 13:06:50.413461 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:c3:18:79', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-11-26 13:06:50.413582 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:1b:65:c8', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-11-26 13:06:50.413716 | controller | 2025-11-26 13:06:50.413844 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2025-11-26 13:06:50.413969 | controller | Wednesday 26 November 2025 13:06:50 +0000 (0:00:00.093) 0:01:04.928 **** 2025-11-26 13:06:50.462100 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2025-11-26 13:06:50.462273 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2025-11-26 13:06:50.462379 | controller | 2025-11-26 13:06:50.462541 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-11-26 13:06:50.462642 | controller | Wednesday 26 November 2025 13:06:50 +0000 (0:00:00.049) 0:01:04.977 **** 2025-11-26 13:06:50.636492 | controller | ok: [instance] 2025-11-26 13:06:50.659075 | controller | 2025-11-26 13:06:50.659102 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-11-26 13:06:50.659117 | controller | Wednesday 26 November 2025 13:06:50 +0000 (0:00:00.173) 0:01:05.151 **** 2025-11-26 13:06:50.659129 | controller | ok: [instance] 2025-11-26 13:06:50.834707 | controller | 2025-11-26 13:06:50.834726 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-11-26 13:06:50.834734 | controller | Wednesday 26 November 2025 13:06:50 +0000 (0:00:00.022) 0:01:05.174 **** 2025-11-26 13:06:50.834743 | controller | ok: [instance] 2025-11-26 13:06:50.858164 | controller | 2025-11-26 13:06:50.858198 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-11-26 13:06:50.858208 | controller | Wednesday 26 November 2025 13:06:50 +0000 (0:00:00.175) 0:01:05.350 **** 2025-11-26 13:06:50.858220 | controller | ok: [instance] 2025-11-26 13:06:50.858416 | controller | 2025-11-26 13:06:50.858441 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2025-11-26 13:06:50.877124 | controller | Wednesday 26 November 2025 13:06:50 +0000 (0:00:00.023) 0:01:05.373 **** 2025-11-26 13:06:50.877153 | controller | ok: [instance] 2025-11-26 13:06:50.877312 | controller | 2025-11-26 13:06:50.877333 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2025-11-26 13:06:51.079217 | controller | Wednesday 26 November 2025 13:06:50 +0000 (0:00:00.019) 0:01:05.392 **** 2025-11-26 13:06:51.079264 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:7f:97:1b', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-11-26 13:06:51.079299 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:72:f0:60', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-11-26 13:06:51.079307 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:f1:02:5c', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-11-26 13:06:51.079316 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:6d:00:ac', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-11-26 13:06:51.079343 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:c3:18:79', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-11-26 13:06:51.079757 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:1b:65:c8', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-11-26 13:06:51.117713 | controller | 2025-11-26 13:06:51.117734 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2025-11-26 13:06:51.117742 | controller | Wednesday 26 November 2025 13:06:51 +0000 (0:00:00.201) 0:01:05.594 **** 2025-11-26 13:06:51.117751 | controller | ok: [instance] 2025-11-26 13:06:53.080171 | controller | 2025-11-26 13:06:53.080226 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2025-11-26 13:06:53.080242 | controller | Wednesday 26 November 2025 13:06:51 +0000 (0:00:00.038) 0:01:05.633 **** 2025-11-26 13:06:53.080261 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:7f:97:1b', 'entry': 'set:compute,52:54:00:7f:97:1b,192.168.140.100,compute-0', 'state': 'present'}) 2025-11-26 13:06:53.080331 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:72:f0:60', 'entry': 'set:controller,52:54:01:72:f0:60,192.168.140.9,controller-0', 'state': 'present'}) 2025-11-26 13:06:53.081067 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:f1:02:5c', 'entry': 'set:ocp,52:54:02:f1:02:5c,192.168.140.10,crc-0', 'state': 'present'}) 2025-11-26 13:06:53.081111 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:6d:00:ac', 'entry': 'set:compute,52:54:00:6d:00:ac,192.168.101.100,compute-0', 'state': 'present'}) 2025-11-26 13:06:53.103024 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:c3:18:79', 'entry': 'set:controller,52:54:01:c3:18:79,192.168.101.9,controller-0', 'state': 'present'}) 2025-11-26 13:06:53.103046 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:1b:65:c8', 'entry': 'set:ocp,52:54:02:1b:65:c8,192.168.101.10,crc-0', 'state': 'present'}) 2025-11-26 13:06:53.103065 | controller | 2025-11-26 13:06:53.103071 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2025-11-26 13:06:53.103081 | controller | Wednesday 26 November 2025 13:06:53 +0000 (0:00:01.962) 0:01:07.595 **** 2025-11-26 13:06:53.103090 | controller | skipping: [instance] 2025-11-26 13:06:53.314156 | controller | 2025-11-26 13:06:53.314190 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2025-11-26 13:06:53.314198 | controller | Wednesday 26 November 2025 13:06:53 +0000 (0:00:00.022) 0:01:07.618 **** 2025-11-26 13:06:53.314209 | controller | ok: [instance] => (item=compute-0) 2025-11-26 13:06:53.314320 | controller | ok: [instance] => (item=controller-0) 2025-11-26 13:06:53.314346 | controller | ok: [instance] => (item=crc-0) 2025-11-26 13:06:53.314355 | controller | 2025-11-26 13:06:53.314361 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2025-11-26 13:06:53.314371 | controller | Wednesday 26 November 2025 13:06:53 +0000 (0:00:00.210) 0:01:07.829 **** 2025-11-26 13:06:53.429132 | controller | 2025-11-26 13:06:53.471842 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-11-26 13:06:53.471865 | controller | Wednesday 26 November 2025 13:06:53 +0000 (0:00:00.115) 0:01:07.944 **** 2025-11-26 13:06:53.471877 | controller | ok: [instance] 2025-11-26 13:06:53.671824 | controller | 2025-11-26 13:06:53.671846 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-11-26 13:06:53.671855 | controller | Wednesday 26 November 2025 13:06:53 +0000 (0:00:00.042) 0:01:07.987 **** 2025-11-26 13:06:53.671865 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-11-26 13:06:53.672091 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-11-26 13:06:53.672236 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-11-26 13:06:53.672364 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-11-26 13:06:53.672491 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-11-26 13:06:53.672622 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-11-26 13:06:53.672747 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-11-26 13:06:53.672881 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-26 13:06:53.673038 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-26 13:06:53.673211 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-11-26 13:06:53.673340 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-11-26 13:06:53.673465 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-11-26 13:06:53.673597 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-11-26 13:06:53.673727 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-11-26 13:06:53.673856 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-11-26 13:06:53.673989 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-11-26 13:06:53.674133 | controller | 2025-11-26 13:06:53.674258 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-11-26 13:06:53.674379 | controller | Wednesday 26 November 2025 13:06:53 +0000 (0:00:00.200) 0:01:08.187 **** 2025-11-26 13:06:56.815122 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-11-26 13:06:56.815189 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-11-26 13:06:56.815202 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-11-26 13:06:56.815218 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-11-26 13:06:56.816068 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-11-26 13:06:56.816648 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-11-26 13:06:56.816680 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-11-26 13:06:56.816688 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-26 13:06:56.816695 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-26 13:06:56.816700 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-11-26 13:06:56.816706 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-11-26 13:06:56.816711 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-11-26 13:06:56.816717 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-11-26 13:06:56.816727 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-11-26 13:06:56.836159 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-11-26 13:06:56.836194 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-11-26 13:06:56.836203 | controller | 2025-11-26 13:06:56.836210 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2025-11-26 13:06:56.836217 | controller | Wednesday 26 November 2025 13:06:56 +0000 (0:00:03.142) 0:01:11.330 **** 2025-11-26 13:06:56.836228 | controller | ok: [instance] 2025-11-26 13:06:56.879242 | controller | 2025-11-26 13:06:56.879274 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2025-11-26 13:06:56.879284 | controller | Wednesday 26 November 2025 13:06:56 +0000 (0:00:00.021) 0:01:11.351 **** 2025-11-26 13:06:56.879296 | controller | skipping: [instance] => (item=compute) 2025-11-26 13:06:56.910102 | controller | skipping: [instance] => (item=controller) 2025-11-26 13:06:56.910130 | controller | skipping: [instance] => (item=crc) 2025-11-26 13:06:56.910140 | controller | skipping: [instance] 2025-11-26 13:06:56.910148 | controller | 2025-11-26 13:06:56.910155 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2025-11-26 13:06:56.910161 | controller | Wednesday 26 November 2025 13:06:56 +0000 (0:00:00.042) 0:01:11.394 **** 2025-11-26 13:06:56.910173 | controller | skipping: [instance] 2025-11-26 13:06:57.279999 | controller | 2025-11-26 13:06:57.280051 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2025-11-26 13:06:57.280068 | controller | Wednesday 26 November 2025 13:06:56 +0000 (0:00:00.031) 0:01:11.425 **** 2025-11-26 13:06:57.280079 | controller | changed: [instance] 2025-11-26 13:06:58.098665 | controller | 2025-11-26 13:06:58.098695 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2025-11-26 13:06:58.098703 | controller | Wednesday 26 November 2025 13:06:57 +0000 (0:00:00.358) 0:01:11.783 **** 2025-11-26 13:06:58.098708 | controller | 2025-11-26 13:06:58.098713 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-11-26 13:06:58.098719 | controller | Wednesday 26 November 2025 13:06:57 +0000 (0:00:00.010) 0:01:11.794 **** 2025-11-26 13:06:58.098728 | controller | changed: [instance] 2025-11-26 13:06:58.453557 | controller | 2025-11-26 13:06:58.453588 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-11-26 13:06:58.453596 | controller | Wednesday 26 November 2025 13:06:58 +0000 (0:00:00.818) 0:01:12.613 **** 2025-11-26 13:06:58.453607 | controller | changed: [instance] 2025-11-26 13:06:59.808142 | controller | 2025-11-26 13:06:59.808174 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2025-11-26 13:06:59.808182 | controller | Wednesday 26 November 2025 13:06:58 +0000 (0:00:00.354) 0:01:12.968 **** 2025-11-26 13:06:59.808192 | controller | changed: [instance] 2025-11-26 13:06:59.808219 | controller | 2025-11-26 13:06:59.808227 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2025-11-26 13:06:59.808324 | controller | Wednesday 26 November 2025 13:06:59 +0000 (0:00:01.354) 0:01:14.323 **** 2025-11-26 13:07:00.165649 | controller | changed: [instance] 2025-11-26 13:07:00.533575 | controller | 2025-11-26 13:07:00.533604 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2025-11-26 13:07:00.533612 | controller | Wednesday 26 November 2025 13:07:00 +0000 (0:00:00.357) 0:01:14.680 **** 2025-11-26 13:07:00.533628 | controller | changed: [instance] 2025-11-26 13:07:00.565349 | controller | 2025-11-26 13:07:00.565372 | controller | TASK [Build utility records dataset] ******************************************* 2025-11-26 13:07:00.565383 | controller | Wednesday 26 November 2025 13:07:00 +0000 (0:00:00.368) 0:01:15.048 **** 2025-11-26 13:07:00.565391 | controller | 2025-11-26 13:07:00.655533 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-11-26 13:07:00.655556 | controller | Wednesday 26 November 2025 13:07:00 +0000 (0:00:00.032) 0:01:15.080 **** 2025-11-26 13:07:00.655567 | controller | ok: [instance] 2025-11-26 13:07:00.754238 | controller | 2025-11-26 13:07:00.754273 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-11-26 13:07:00.754283 | controller | Wednesday 26 November 2025 13:07:00 +0000 (0:00:00.089) 0:01:15.170 **** 2025-11-26 13:07:00.754297 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-11-26 13:07:01.231165 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-26 13:07:01.231201 | controller | 2025-11-26 13:07:01.231211 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-11-26 13:07:01.231218 | controller | Wednesday 26 November 2025 13:07:00 +0000 (0:00:00.098) 0:01:15.269 **** 2025-11-26 13:07:01.231237 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-11-26 13:07:01.231267 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-11-26 13:07:01.231275 | controller | 2025-11-26 13:07:01.231281 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-11-26 13:07:01.231288 | controller | Wednesday 26 November 2025 13:07:01 +0000 (0:00:00.465) 0:01:15.735 **** 2025-11-26 13:07:01.231295 | controller | 2025-11-26 13:07:01.231306 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-11-26 13:07:01.231400 | controller | Wednesday 26 November 2025 13:07:01 +0000 (0:00:00.010) 0:01:15.745 **** 2025-11-26 13:07:01.710726 | controller | changed: [instance] 2025-11-26 13:07:02.084804 | controller | 2025-11-26 13:07:02.084839 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-11-26 13:07:02.084849 | controller | Wednesday 26 November 2025 13:07:01 +0000 (0:00:00.479) 0:01:16.225 **** 2025-11-26 13:07:02.084861 | controller | changed: [instance] 2025-11-26 13:07:02.116459 | controller | 2025-11-26 13:07:02.116483 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2025-11-26 13:07:02.116492 | controller | Wednesday 26 November 2025 13:07:02 +0000 (0:00:00.374) 0:01:16.599 **** 2025-11-26 13:07:02.116503 | controller | skipping: [instance] 2025-11-26 13:07:02.189320 | controller | 2025-11-26 13:07:02.189338 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2025-11-26 13:07:02.189344 | controller | Wednesday 26 November 2025 13:07:02 +0000 (0:00:00.031) 0:01:16.631 **** 2025-11-26 13:07:02.189353 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2025-11-26 13:07:02.370441 | controller | 2025-11-26 13:07:02.370459 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2025-11-26 13:07:02.370466 | controller | Wednesday 26 November 2025 13:07:02 +0000 (0:00:00.072) 0:01:16.704 **** 2025-11-26 13:07:02.370474 | controller | ok: [instance] 2025-11-26 13:07:02.390698 | controller | 2025-11-26 13:07:02.390713 | controller | TASK [Deploy CRC if needed] **************************************************** 2025-11-26 13:07:02.390719 | controller | Wednesday 26 November 2025 13:07:02 +0000 (0:00:00.181) 0:01:16.886 **** 2025-11-26 13:07:02.390727 | controller | skipping: [instance] 2025-11-26 13:07:02.694989 | controller | 2025-11-26 13:07:02.695027 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2025-11-26 13:07:02.695037 | controller | Wednesday 26 November 2025 13:07:02 +0000 (0:00:00.019) 0:01:16.905 **** 2025-11-26 13:07:02.695046 | controller | ok: [instance] 2025-11-26 13:07:02.936137 | controller | 2025-11-26 13:07:02.936183 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2025-11-26 13:07:02.936191 | controller | Wednesday 26 November 2025 13:07:02 +0000 (0:00:00.304) 0:01:17.210 **** 2025-11-26 13:07:02.936203 | controller | ok: [instance] 2025-11-26 13:07:02.936537 | controller | 2025-11-26 13:07:03.161718 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2025-11-26 13:07:03.161749 | controller | Wednesday 26 November 2025 13:07:02 +0000 (0:00:00.240) 0:01:17.451 **** 2025-11-26 13:07:03.161761 | controller | ok: [instance] 2025-11-26 13:07:03.377982 | controller | 2025-11-26 13:07:03.378029 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2025-11-26 13:07:03.378043 | controller | Wednesday 26 November 2025 13:07:03 +0000 (0:00:00.225) 0:01:17.676 **** 2025-11-26 13:07:03.378067 | controller | ok: [instance] 2025-11-26 13:07:03.599930 | controller | 2025-11-26 13:07:03.599949 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2025-11-26 13:07:03.599964 | controller | Wednesday 26 November 2025 13:07:03 +0000 (0:00:00.216) 0:01:17.893 **** 2025-11-26 13:07:03.599973 | controller | ok: [instance] 2025-11-26 13:07:03.638150 | controller | 2025-11-26 13:07:03.638213 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-11-26 13:07:03.638228 | controller | Wednesday 26 November 2025 13:07:03 +0000 (0:00:00.222) 0:01:18.115 **** 2025-11-26 13:07:03.638241 | controller | 2025-11-26 13:07:03.638324 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-11-26 13:07:03.829688 | controller | Wednesday 26 November 2025 13:07:03 +0000 (0:00:00.038) 0:01:18.153 **** 2025-11-26 13:07:03.829722 | controller | ok: [instance] 2025-11-26 13:07:03.852727 | controller | 2025-11-26 13:07:03.852747 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-11-26 13:07:03.852755 | controller | Wednesday 26 November 2025 13:07:03 +0000 (0:00:00.191) 0:01:18.344 **** 2025-11-26 13:07:03.852765 | controller | ok: [instance] 2025-11-26 13:07:03.878919 | controller | 2025-11-26 13:07:03.878936 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-11-26 13:07:03.878943 | controller | Wednesday 26 November 2025 13:07:03 +0000 (0:00:00.023) 0:01:18.368 **** 2025-11-26 13:07:03.878952 | controller | skipping: [instance] 2025-11-26 13:07:04.154186 | controller | 2025-11-26 13:07:04.154219 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2025-11-26 13:07:04.154229 | controller | Wednesday 26 November 2025 13:07:03 +0000 (0:00:00.026) 0:01:18.394 **** 2025-11-26 13:07:04.154241 | controller | ok: [instance] 2025-11-26 13:07:04.154271 | controller | 2025-11-26 13:07:04.154280 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2025-11-26 13:07:04.154370 | controller | Wednesday 26 November 2025 13:07:04 +0000 (0:00:00.275) 0:01:18.669 **** 2025-11-26 13:07:04.370173 | controller | ok: [instance] 2025-11-26 13:07:04.370233 | controller | 2025-11-26 13:07:04.370245 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2025-11-26 13:07:04.370318 | controller | Wednesday 26 November 2025 13:07:04 +0000 (0:00:00.215) 0:01:18.885 **** 2025-11-26 13:07:04.543686 | controller | ok: [instance] 2025-11-26 13:07:04.599739 | controller | 2025-11-26 13:07:04.599756 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2025-11-26 13:07:04.599763 | controller | Wednesday 26 November 2025 13:07:04 +0000 (0:00:00.173) 0:01:19.059 **** 2025-11-26 13:07:04.599772 | controller | 2025-11-26 13:07:04.642133 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-11-26 13:07:04.642173 | controller | Wednesday 26 November 2025 13:07:04 +0000 (0:00:00.056) 0:01:19.115 **** 2025-11-26 13:07:04.642189 | controller | ok: [instance] => changed=false 2025-11-26 13:07:04.819172 | controller | msg: All assertions passed 2025-11-26 13:07:04.819210 | controller | 2025-11-26 13:07:04.819220 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-11-26 13:07:04.819228 | controller | Wednesday 26 November 2025 13:07:04 +0000 (0:00:00.042) 0:01:19.157 **** 2025-11-26 13:07:04.819240 | controller | ok: [instance] 2025-11-26 13:07:04.819284 | controller | 2025-11-26 13:07:04.819293 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-11-26 13:07:04.819303 | controller | Wednesday 26 November 2025 13:07:04 +0000 (0:00:00.176) 0:01:19.334 **** 2025-11-26 13:07:05.007105 | controller | ok: [instance] 2025-11-26 13:07:05.031815 | controller | 2025-11-26 13:07:05.031841 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-11-26 13:07:05.031850 | controller | Wednesday 26 November 2025 13:07:05 +0000 (0:00:00.187) 0:01:19.522 **** 2025-11-26 13:07:05.031860 | controller | ok: [instance] => changed=false 2025-11-26 13:07:05.215126 | controller | msg: All assertions passed 2025-11-26 13:07:05.215151 | controller | 2025-11-26 13:07:05.215160 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-11-26 13:07:05.215168 | controller | Wednesday 26 November 2025 13:07:05 +0000 (0:00:00.024) 0:01:19.547 **** 2025-11-26 13:07:05.215178 | controller | ok: [instance] 2025-11-26 13:07:05.390137 | controller | 2025-11-26 13:07:05.390164 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-11-26 13:07:05.390173 | controller | Wednesday 26 November 2025 13:07:05 +0000 (0:00:00.183) 0:01:19.730 **** 2025-11-26 13:07:05.390184 | controller | ok: [instance] 2025-11-26 13:07:05.437540 | controller | 2025-11-26 13:07:05.437576 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-11-26 13:07:05.437584 | controller | Wednesday 26 November 2025 13:07:05 +0000 (0:00:00.175) 0:01:19.905 **** 2025-11-26 13:07:05.437599 | controller | ok: [instance] 2025-11-26 13:07:05.824749 | controller | 2025-11-26 13:07:05.824798 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2025-11-26 13:07:05.824807 | controller | Wednesday 26 November 2025 13:07:05 +0000 (0:00:00.047) 0:01:19.953 **** 2025-11-26 13:07:05.824820 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2025-11-26 13:07:05.844102 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2025-11-26 13:07:05.844127 | controller | 2025-11-26 13:07:05.844138 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2025-11-26 13:07:05.844146 | controller | Wednesday 26 November 2025 13:07:05 +0000 (0:00:00.386) 0:01:20.339 **** 2025-11-26 13:07:05.844158 | controller | skipping: [instance] 2025-11-26 13:07:05.844249 | controller | 2025-11-26 13:07:05.844268 | controller | TASK [Load the architecture local kustomize patches] *************************** 2025-11-26 13:07:05.844279 | controller | Wednesday 26 November 2025 13:07:05 +0000 (0:00:00.020) 0:01:20.359 **** 2025-11-26 13:07:05.870195 | controller | skipping: [instance] 2025-11-26 13:07:05.870256 | controller | 2025-11-26 13:07:05.870270 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2025-11-26 13:07:05.870341 | controller | Wednesday 26 November 2025 13:07:05 +0000 (0:00:00.026) 0:01:20.385 **** 2025-11-26 13:07:05.997743 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2025-11-26 13:07:06.022195 | controller | 2025-11-26 13:07:06.022226 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2025-11-26 13:07:06.022236 | controller | Wednesday 26 November 2025 13:07:05 +0000 (0:00:00.127) 0:01:20.512 **** 2025-11-26 13:07:06.022248 | controller | skipping: [instance] 2025-11-26 13:07:06.415585 | controller | 2025-11-26 13:07:06.415625 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2025-11-26 13:07:06.415634 | controller | Wednesday 26 November 2025 13:07:06 +0000 (0:00:00.024) 0:01:20.537 **** 2025-11-26 13:07:06.415645 | controller | changed: [instance] 2025-11-26 13:07:06.948162 | controller | 2025-11-26 13:07:06.948230 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2025-11-26 13:07:06.948242 | controller | Wednesday 26 November 2025 13:07:06 +0000 (0:00:00.393) 0:01:20.930 **** 2025-11-26 13:07:06.948256 | controller | changed: [instance] 2025-11-26 13:07:06.948291 | controller | 2025-11-26 13:07:06.948300 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2025-11-26 13:07:06.948307 | controller | Wednesday 26 November 2025 13:07:06 +0000 (0:00:00.491) 0:01:21.421 **** 2025-11-26 13:07:06.948316 | controller | 2025-11-26 13:07:06.948344 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-11-26 13:07:06.948469 | controller | Wednesday 26 November 2025 13:07:06 +0000 (0:00:00.041) 0:01:21.463 **** 2025-11-26 13:07:07.365618 | controller | changed: [instance] 2025-11-26 13:07:08.198401 | controller | 2025-11-26 13:07:08.198433 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-11-26 13:07:08.198441 | controller | Wednesday 26 November 2025 13:07:07 +0000 (0:00:00.417) 0:01:21.880 **** 2025-11-26 13:07:08.198451 | controller | changed: [instance] 2025-11-26 13:07:08.230629 | controller | 2025-11-26 13:07:08.230650 | controller | TASK [Deploy virtualbmc] ******************************************************* 2025-11-26 13:07:08.230657 | controller | Wednesday 26 November 2025 13:07:08 +0000 (0:00:00.832) 0:01:22.713 **** 2025-11-26 13:07:08.230666 | controller | skipping: [instance] 2025-11-26 13:07:08.263004 | controller | 2025-11-26 13:07:08.263061 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2025-11-26 13:07:08.263071 | controller | Wednesday 26 November 2025 13:07:08 +0000 (0:00:00.032) 0:01:22.745 **** 2025-11-26 13:07:08.263082 | controller | skipping: [instance] 2025-11-26 13:07:08.817084 | controller | 2025-11-26 13:07:08.817116 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2025-11-26 13:07:08.817124 | controller | Wednesday 26 November 2025 13:07:08 +0000 (0:00:00.032) 0:01:22.778 **** 2025-11-26 13:07:08.817134 | controller | changed: [instance] => (item=workload) 2025-11-26 13:07:08.817511 | controller | changed: [instance] => (item=reproducer-inventory) 2025-11-26 13:07:08.817545 | controller | ok: [instance] => (item=volumes) 2025-11-26 13:07:09.221750 | controller | 2025-11-26 13:07:09.221782 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2025-11-26 13:07:09.221790 | controller | Wednesday 26 November 2025 13:07:08 +0000 (0:00:00.553) 0:01:23.332 **** 2025-11-26 13:07:09.221800 | controller | changed: [instance] => (item=workload) 2025-11-26 13:07:09.246119 | controller | changed: [instance] => (item=volumes) 2025-11-26 13:07:09.246158 | controller | 2025-11-26 13:07:09.246168 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2025-11-26 13:07:09.246176 | controller | Wednesday 26 November 2025 13:07:09 +0000 (0:00:00.404) 0:01:23.736 **** 2025-11-26 13:07:09.246190 | controller | skipping: [instance] 2025-11-26 13:07:09.246221 | controller | 2025-11-26 13:07:09.246232 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2025-11-26 13:07:09.246288 | controller | Wednesday 26 November 2025 13:07:09 +0000 (0:00:00.024) 0:01:23.761 **** 2025-11-26 13:07:10.251771 | controller | changed: [instance] => (item=compute) 2025-11-26 13:07:10.608159 | controller | changed: [instance] => (item=controller) 2025-11-26 13:07:10.608209 | controller | changed: [instance] => (item=crc) 2025-11-26 13:07:10.608218 | controller | 2025-11-26 13:07:10.608225 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2025-11-26 13:07:10.608231 | controller | Wednesday 26 November 2025 13:07:10 +0000 (0:00:01.004) 0:01:24.766 **** 2025-11-26 13:07:10.608241 | controller | changed: [instance] 2025-11-26 13:07:10.647485 | controller | 2025-11-26 13:07:10.647516 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2025-11-26 13:07:10.647523 | controller | Wednesday 26 November 2025 13:07:10 +0000 (0:00:00.356) 0:01:25.123 **** 2025-11-26 13:07:10.647533 | controller | skipping: [instance] 2025-11-26 13:07:10.708193 | controller | 2025-11-26 13:07:10.708235 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2025-11-26 13:07:10.708246 | controller | Wednesday 26 November 2025 13:07:10 +0000 (0:00:00.039) 0:01:25.162 **** 2025-11-26 13:07:10.708260 | controller | skipping: [instance] => (item=crc) 2025-11-26 13:07:10.708290 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2025-11-26 13:07:10.708299 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2025-11-26 13:07:10.708308 | controller | 2025-11-26 13:07:10.708491 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-11-26 13:07:10.911853 | controller | Wednesday 26 November 2025 13:07:10 +0000 (0:00:00.060) 0:01:25.223 **** 2025-11-26 13:07:10.911887 | controller | changed: [instance] 2025-11-26 13:07:11.080132 | controller | 2025-11-26 13:07:11.080160 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-11-26 13:07:11.080168 | controller | Wednesday 26 November 2025 13:07:10 +0000 (0:00:00.203) 0:01:25.427 **** 2025-11-26 13:07:11.080178 | controller | ok: [instance] 2025-11-26 13:07:11.080199 | controller | 2025-11-26 13:07:11.080207 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-11-26 13:07:11.080315 | controller | Wednesday 26 November 2025 13:07:11 +0000 (0:00:00.168) 0:01:25.595 **** 2025-11-26 13:07:32.124938 | controller | changed: [instance] 2025-11-26 13:07:32.316166 | controller | 2025-11-26 13:07:32.316209 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-11-26 13:07:32.316219 | controller | Wednesday 26 November 2025 13:07:32 +0000 (0:00:21.044) 0:01:46.640 **** 2025-11-26 13:07:32.316231 | controller | ok: [instance] 2025-11-26 13:07:32.316253 | controller | 2025-11-26 13:07:32.316320 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-11-26 13:07:32.316447 | controller | Wednesday 26 November 2025 13:07:32 +0000 (0:00:00.191) 0:01:46.831 **** 2025-11-26 13:07:32.358721 | controller | ok: [instance] => changed=false 2025-11-26 13:07:32.561505 | controller | msg: All assertions passed 2025-11-26 13:07:32.561528 | controller | 2025-11-26 13:07:32.561537 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-11-26 13:07:32.561544 | controller | Wednesday 26 November 2025 13:07:32 +0000 (0:00:00.042) 0:01:46.873 **** 2025-11-26 13:07:32.561554 | controller | changed: [instance] 2025-11-26 13:07:32.764099 | controller | 2025-11-26 13:07:32.764126 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-11-26 13:07:32.764135 | controller | Wednesday 26 November 2025 13:07:32 +0000 (0:00:00.202) 0:01:47.076 **** 2025-11-26 13:07:32.764145 | controller | ok: [instance] 2025-11-26 13:07:32.955111 | controller | 2025-11-26 13:07:32.955147 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-11-26 13:07:32.955157 | controller | Wednesday 26 November 2025 13:07:32 +0000 (0:00:00.202) 0:01:47.279 **** 2025-11-26 13:07:32.955170 | controller | ok: [instance] 2025-11-26 13:07:32.955212 | controller | 2025-11-26 13:07:32.955236 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-11-26 13:07:32.955250 | controller | Wednesday 26 November 2025 13:07:32 +0000 (0:00:00.190) 0:01:47.470 **** 2025-11-26 13:07:32.976143 | controller | skipping: [instance] 2025-11-26 13:07:32.976391 | controller | 2025-11-26 13:07:32.976416 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-11-26 13:07:33.169331 | controller | Wednesday 26 November 2025 13:07:32 +0000 (0:00:00.021) 0:01:47.491 **** 2025-11-26 13:07:33.169354 | controller | ok: [instance] 2025-11-26 13:07:33.211983 | controller | 2025-11-26 13:07:33.212026 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-11-26 13:07:33.212037 | controller | Wednesday 26 November 2025 13:07:33 +0000 (0:00:00.193) 0:01:47.684 **** 2025-11-26 13:07:33.212047 | controller | ok: [instance] => changed=false 2025-11-26 13:07:33.411053 | controller | msg: All assertions passed 2025-11-26 13:07:33.411074 | controller | 2025-11-26 13:07:33.411082 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-11-26 13:07:33.411088 | controller | Wednesday 26 November 2025 13:07:33 +0000 (0:00:00.042) 0:01:47.727 **** 2025-11-26 13:07:33.411099 | controller | ok: [instance] 2025-11-26 13:07:33.585090 | controller | 2025-11-26 13:07:33.585121 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2025-11-26 13:07:33.585129 | controller | Wednesday 26 November 2025 13:07:33 +0000 (0:00:00.199) 0:01:47.926 **** 2025-11-26 13:07:33.585140 | controller | ok: [instance] 2025-11-26 13:07:33.585165 | controller | 2025-11-26 13:07:33.585325 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2025-11-26 13:07:33.968038 | controller | Wednesday 26 November 2025 13:07:33 +0000 (0:00:00.174) 0:01:48.100 **** 2025-11-26 13:07:33.968078 | controller | changed: [instance] 2025-11-26 13:07:34.138694 | controller | 2025-11-26 13:07:34.138729 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2025-11-26 13:07:34.138738 | controller | Wednesday 26 November 2025 13:07:33 +0000 (0:00:00.382) 0:01:48.483 **** 2025-11-26 13:07:34.138748 | controller | ok: [instance] 2025-11-26 13:07:34.306136 | controller | 2025-11-26 13:07:34.306155 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2025-11-26 13:07:34.306162 | controller | Wednesday 26 November 2025 13:07:34 +0000 (0:00:00.170) 0:01:48.653 **** 2025-11-26 13:07:34.306171 | controller | ok: [instance] 2025-11-26 13:07:34.690153 | controller | 2025-11-26 13:07:34.690192 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2025-11-26 13:07:34.690202 | controller | Wednesday 26 November 2025 13:07:34 +0000 (0:00:00.167) 0:01:48.821 **** 2025-11-26 13:07:34.690215 | controller | changed: [instance] 2025-11-26 13:07:34.690246 | controller | 2025-11-26 13:07:34.690463 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2025-11-26 13:07:34.709918 | controller | Wednesday 26 November 2025 13:07:34 +0000 (0:00:00.384) 0:01:49.205 **** 2025-11-26 13:07:34.709942 | controller | ok: [instance] 2025-11-26 13:07:34.922654 | controller | 2025-11-26 13:07:34.922675 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2025-11-26 13:07:34.922683 | controller | Wednesday 26 November 2025 13:07:34 +0000 (0:00:00.019) 0:01:49.225 **** 2025-11-26 13:07:34.922692 | controller | ok: [instance] 2025-11-26 13:07:35.372183 | controller | 2025-11-26 13:07:35.372230 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2025-11-26 13:07:35.372242 | controller | Wednesday 26 November 2025 13:07:34 +0000 (0:00:00.212) 0:01:49.438 **** 2025-11-26 13:07:35.372257 | controller | ok: [instance] 2025-11-26 13:07:35.489098 | controller | 2025-11-26 13:07:35.489139 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2025-11-26 13:07:35.489151 | controller | Wednesday 26 November 2025 13:07:35 +0000 (0:00:00.449) 0:01:49.887 **** 2025-11-26 13:07:35.489166 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-11-26 13:07:35.489621 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-11-26 13:07:35.758768 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-11-26 13:07:35.758788 | controller | 2025-11-26 13:07:35.758796 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2025-11-26 13:07:35.758802 | controller | Wednesday 26 November 2025 13:07:35 +0000 (0:00:00.117) 0:01:50.004 **** 2025-11-26 13:07:35.758811 | controller | changed: [instance] 2025-11-26 13:07:36.022653 | controller | 2025-11-26 13:07:36.022673 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2025-11-26 13:07:36.022681 | controller | Wednesday 26 November 2025 13:07:35 +0000 (0:00:00.269) 0:01:50.273 **** 2025-11-26 13:07:36.022690 | controller | changed: [instance] 2025-11-26 13:07:36.321397 | controller | 2025-11-26 13:07:36.321418 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2025-11-26 13:07:36.321426 | controller | Wednesday 26 November 2025 13:07:36 +0000 (0:00:00.264) 0:01:50.538 **** 2025-11-26 13:07:36.321435 | controller | changed: [instance] 2025-11-26 13:07:36.351067 | controller | 2025-11-26 13:07:36.351109 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2025-11-26 13:07:36.351119 | controller | Wednesday 26 November 2025 13:07:36 +0000 (0:00:00.298) 0:01:50.836 **** 2025-11-26 13:07:36.351133 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-11-26 13:07:36.394942 | controller | 2025-11-26 13:07:36.394962 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-11-26 13:07:36.394970 | controller | Wednesday 26 November 2025 13:07:36 +0000 (0:00:00.029) 0:01:50.866 **** 2025-11-26 13:07:36.394978 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-11-26 13:07:36.633559 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-11-26 13:07:36.633583 | controller | 2025-11-26 13:07:36.633590 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-26 13:07:36.633597 | controller | Wednesday 26 November 2025 13:07:36 +0000 (0:00:00.043) 0:01:50.910 **** 2025-11-26 13:07:36.633605 | controller | ok: [instance] 2025-11-26 13:07:36.683143 | controller | 2025-11-26 13:07:36.683167 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-26 13:07:36.683180 | controller | Wednesday 26 November 2025 13:07:36 +0000 (0:00:00.238) 0:01:51.148 **** 2025-11-26 13:07:36.683192 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 13:07:36.914455 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 13:07:36.914479 | controller | 2025-11-26 13:07:36.914487 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-26 13:07:36.914493 | controller | Wednesday 26 November 2025 13:07:36 +0000 (0:00:00.049) 0:01:51.198 **** 2025-11-26 13:07:36.914501 | controller | ok: [instance] 2025-11-26 13:07:37.111493 | controller | 2025-11-26 13:07:37.111513 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-26 13:07:37.111520 | controller | Wednesday 26 November 2025 13:07:36 +0000 (0:00:00.231) 0:01:51.429 **** 2025-11-26 13:07:37.111528 | controller | ok: [instance] 2025-11-26 13:07:37.403115 | controller | 2025-11-26 13:07:37.403149 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2025-11-26 13:07:37.403157 | controller | Wednesday 26 November 2025 13:07:37 +0000 (0:00:00.196) 0:01:51.626 **** 2025-11-26 13:07:37.403168 | controller | changed: [instance] 2025-11-26 13:07:37.403231 | controller | 2025-11-26 13:07:37.403253 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-26 13:07:37.403266 | controller | Wednesday 26 November 2025 13:07:37 +0000 (0:00:00.291) 0:01:51.918 **** 2025-11-26 13:07:37.632053 | controller | ok: [instance] 2025-11-26 13:07:37.675186 | controller | 2025-11-26 13:07:37.675236 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-26 13:07:37.675250 | controller | Wednesday 26 November 2025 13:07:37 +0000 (0:00:00.228) 0:01:52.147 **** 2025-11-26 13:07:37.675268 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 13:07:37.921473 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 13:07:37.921500 | controller | 2025-11-26 13:07:37.921508 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-26 13:07:37.921514 | controller | Wednesday 26 November 2025 13:07:37 +0000 (0:00:00.043) 0:01:52.190 **** 2025-11-26 13:07:37.921524 | controller | ok: [instance] 2025-11-26 13:07:38.141006 | controller | 2025-11-26 13:07:38.141058 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-26 13:07:38.141068 | controller | Wednesday 26 November 2025 13:07:37 +0000 (0:00:00.246) 0:01:52.436 **** 2025-11-26 13:07:38.141081 | controller | ok: [instance] 2025-11-26 13:07:38.433765 | controller | 2025-11-26 13:07:38.433788 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2025-11-26 13:07:38.433795 | controller | Wednesday 26 November 2025 13:07:38 +0000 (0:00:00.219) 0:01:52.656 **** 2025-11-26 13:07:38.433805 | controller | changed: [instance] 2025-11-26 13:07:38.457872 | controller | 2025-11-26 13:07:38.457890 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2025-11-26 13:07:38.457897 | controller | Wednesday 26 November 2025 13:07:38 +0000 (0:00:00.292) 0:01:52.949 **** 2025-11-26 13:07:38.457906 | controller | skipping: [instance] 2025-11-26 13:07:38.486685 | controller | 2025-11-26 13:07:38.486708 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2025-11-26 13:07:38.486717 | controller | Wednesday 26 November 2025 13:07:38 +0000 (0:00:00.024) 0:01:52.973 **** 2025-11-26 13:07:38.486728 | controller | skipping: [instance] 2025-11-26 13:07:38.513757 | controller | 2025-11-26 13:07:38.513779 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2025-11-26 13:07:38.513788 | controller | Wednesday 26 November 2025 13:07:38 +0000 (0:00:00.028) 0:01:53.001 **** 2025-11-26 13:07:38.513799 | controller | skipping: [instance] 2025-11-26 13:07:38.540235 | controller | 2025-11-26 13:07:38.540276 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2025-11-26 13:07:38.540285 | controller | Wednesday 26 November 2025 13:07:38 +0000 (0:00:00.027) 0:01:53.029 **** 2025-11-26 13:07:38.540298 | controller | skipping: [instance] 2025-11-26 13:07:38.540317 | controller | 2025-11-26 13:07:38.540327 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-11-26 13:07:39.763094 | controller | Wednesday 26 November 2025 13:07:38 +0000 (0:00:00.026) 0:01:53.055 **** 2025-11-26 13:07:39.763128 | controller | changed: [instance] 2025-11-26 13:07:39.763299 | controller | 2025-11-26 13:07:39.763336 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-11-26 13:07:39.799621 | controller | Wednesday 26 November 2025 13:07:39 +0000 (0:00:01.222) 0:01:54.278 **** 2025-11-26 13:07:39.799647 | controller | ok: [instance] 2025-11-26 13:07:39.855637 | controller | 2025-11-26 13:07:39.855655 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-11-26 13:07:39.855662 | controller | Wednesday 26 November 2025 13:07:39 +0000 (0:00:00.036) 0:01:54.315 **** 2025-11-26 13:07:39.855673 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-11-26 13:07:40.046892 | controller | 2025-11-26 13:07:40.046912 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-11-26 13:07:40.046919 | controller | Wednesday 26 November 2025 13:07:39 +0000 (0:00:00.055) 0:01:54.370 **** 2025-11-26 13:07:40.046928 | controller | ok: [instance] 2025-11-26 13:07:40.109160 | controller | 2025-11-26 13:07:40.109197 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-11-26 13:07:40.109207 | controller | Wednesday 26 November 2025 13:07:40 +0000 (0:00:00.191) 0:01:54.562 **** 2025-11-26 13:07:40.109219 | controller | ok: [instance] 2025-11-26 13:07:40.109249 | controller | 2025-11-26 13:07:40.109259 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-11-26 13:07:40.109351 | controller | Wednesday 26 November 2025 13:07:40 +0000 (0:00:00.062) 0:01:54.624 **** 2025-11-26 13:07:40.154967 | controller | ok: [instance] 2025-11-26 13:07:40.198955 | controller | 2025-11-26 13:07:40.199000 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-11-26 13:07:40.199046 | controller | Wednesday 26 November 2025 13:07:40 +0000 (0:00:00.045) 0:01:54.670 **** 2025-11-26 13:07:40.199063 | controller | skipping: [instance] 2025-11-26 13:07:40.239448 | controller | 2025-11-26 13:07:40.239465 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-11-26 13:07:40.239471 | controller | Wednesday 26 November 2025 13:07:40 +0000 (0:00:00.043) 0:01:54.714 **** 2025-11-26 13:07:40.239479 | controller | skipping: [instance] 2025-11-26 13:07:40.296143 | controller | 2025-11-26 13:07:40.296178 | controller | TASK [Call the config_drive role] ********************************************** 2025-11-26 13:07:40.296194 | controller | Wednesday 26 November 2025 13:07:40 +0000 (0:00:00.040) 0:01:54.754 **** 2025-11-26 13:07:40.296207 | controller | 2025-11-26 13:07:40.296235 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-11-26 13:07:40.296244 | controller | Wednesday 26 November 2025 13:07:40 +0000 (0:00:00.056) 0:01:54.811 **** 2025-11-26 13:07:40.695127 | controller | ok: [instance] => (item=artifacts) 2025-11-26 13:07:40.695182 | controller | ok: [instance] => (item=logs) 2025-11-26 13:07:40.695195 | controller | 2025-11-26 13:07:40.695219 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-11-26 13:07:40.695341 | controller | Wednesday 26 November 2025 13:07:40 +0000 (0:00:00.398) 0:01:55.210 **** 2025-11-26 13:07:41.881162 | controller | ok: [instance] 2025-11-26 13:07:42.094843 | controller | 2025-11-26 13:07:42.094881 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-11-26 13:07:42.094891 | controller | Wednesday 26 November 2025 13:07:41 +0000 (0:00:01.185) 0:01:56.396 **** 2025-11-26 13:07:42.094903 | controller | changed: [instance] 2025-11-26 13:07:42.458128 | controller | 2025-11-26 13:07:42.458176 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-11-26 13:07:42.458189 | controller | Wednesday 26 November 2025 13:07:42 +0000 (0:00:00.213) 0:01:56.610 **** 2025-11-26 13:07:42.458204 | controller | changed: [instance] 2025-11-26 13:07:42.833846 | controller | 2025-11-26 13:07:42.833883 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-11-26 13:07:42.833893 | controller | Wednesday 26 November 2025 13:07:42 +0000 (0:00:00.362) 0:01:56.972 **** 2025-11-26 13:07:42.833905 | controller | changed: [instance] 2025-11-26 13:07:42.879200 | controller | 2025-11-26 13:07:42.879247 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-11-26 13:07:42.879260 | controller | Wednesday 26 November 2025 13:07:42 +0000 (0:00:00.375) 0:01:57.348 **** 2025-11-26 13:07:42.879284 | controller | skipping: [instance] 2025-11-26 13:07:43.081138 | controller | 2025-11-26 13:07:43.081166 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-11-26 13:07:43.081174 | controller | Wednesday 26 November 2025 13:07:42 +0000 (0:00:00.045) 0:01:57.394 **** 2025-11-26 13:07:43.081184 | controller | ok: [instance] 2025-11-26 13:07:43.124236 | controller | 2025-11-26 13:07:43.124268 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-11-26 13:07:43.124282 | controller | Wednesday 26 November 2025 13:07:43 +0000 (0:00:00.202) 0:01:57.596 **** 2025-11-26 13:07:43.124297 | controller | skipping: [instance] 2025-11-26 13:07:43.365739 | controller | 2025-11-26 13:07:43.365771 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-11-26 13:07:43.365779 | controller | Wednesday 26 November 2025 13:07:43 +0000 (0:00:00.042) 0:01:57.638 **** 2025-11-26 13:07:43.365790 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2025-11-26 13:07:43.642161 | controller | changed: [instance] 2025-11-26 13:07:43.642197 | controller | 2025-11-26 13:07:43.642211 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-11-26 13:07:43.642219 | controller | Wednesday 26 November 2025 13:07:43 +0000 (0:00:00.242) 0:01:57.881 **** 2025-11-26 13:07:43.642231 | controller | changed: [instance] 2025-11-26 13:07:43.642262 | controller | 2025-11-26 13:07:43.642272 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-11-26 13:07:43.642384 | controller | Wednesday 26 November 2025 13:07:43 +0000 (0:00:00.276) 0:01:58.157 **** 2025-11-26 13:07:43.688163 | controller | skipping: [instance] 2025-11-26 13:07:43.688218 | controller | 2025-11-26 13:07:43.688231 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2025-11-26 13:07:43.688325 | controller | Wednesday 26 November 2025 13:07:43 +0000 (0:00:00.046) 0:01:58.203 **** 2025-11-26 13:07:43.718139 | controller | skipping: [instance] 2025-11-26 13:07:43.718198 | controller | 2025-11-26 13:07:43.718599 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2025-11-26 13:07:43.967753 | controller | Wednesday 26 November 2025 13:07:43 +0000 (0:00:00.029) 0:01:58.233 **** 2025-11-26 13:07:43.967777 | controller | changed: [instance] 2025-11-26 13:07:44.191026 | controller | 2025-11-26 13:07:44.191056 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2025-11-26 13:07:44.191065 | controller | Wednesday 26 November 2025 13:07:43 +0000 (0:00:00.249) 0:01:58.483 **** 2025-11-26 13:07:44.191075 | controller | changed: [instance] 2025-11-26 13:07:44.508151 | controller | 2025-11-26 13:07:44.508183 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2025-11-26 13:07:44.508191 | controller | Wednesday 26 November 2025 13:07:44 +0000 (0:00:00.222) 0:01:58.706 **** 2025-11-26 13:07:44.508201 | controller | changed: [instance] 2025-11-26 13:07:44.537511 | controller | 2025-11-26 13:07:44.537527 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2025-11-26 13:07:44.537534 | controller | Wednesday 26 November 2025 13:07:44 +0000 (0:00:00.317) 0:01:59.023 **** 2025-11-26 13:07:44.537546 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-11-26 13:07:44.582082 | controller | 2025-11-26 13:07:44.582108 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-11-26 13:07:44.582119 | controller | Wednesday 26 November 2025 13:07:44 +0000 (0:00:00.029) 0:01:59.052 **** 2025-11-26 13:07:44.582131 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-11-26 13:07:44.582161 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-11-26 13:07:44.582174 | controller | 2025-11-26 13:07:44.582181 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-26 13:07:44.582191 | controller | Wednesday 26 November 2025 13:07:44 +0000 (0:00:00.044) 0:01:59.097 **** 2025-11-26 13:07:44.804904 | controller | ok: [instance] 2025-11-26 13:07:44.851161 | controller | 2025-11-26 13:07:44.851201 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-26 13:07:44.851212 | controller | Wednesday 26 November 2025 13:07:44 +0000 (0:00:00.223) 0:01:59.320 **** 2025-11-26 13:07:44.851225 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 13:07:44.851250 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 13:07:44.851258 | controller | 2025-11-26 13:07:44.851265 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-26 13:07:44.851275 | controller | Wednesday 26 November 2025 13:07:44 +0000 (0:00:00.045) 0:01:59.366 **** 2025-11-26 13:07:45.086833 | controller | ok: [instance] 2025-11-26 13:07:45.285085 | controller | 2025-11-26 13:07:45.285117 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-26 13:07:45.285125 | controller | Wednesday 26 November 2025 13:07:45 +0000 (0:00:00.235) 0:01:59.602 **** 2025-11-26 13:07:45.285136 | controller | ok: [instance] 2025-11-26 13:07:46.565033 | controller | 2025-11-26 13:07:46.565068 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2025-11-26 13:07:46.565076 | controller | Wednesday 26 November 2025 13:07:45 +0000 (0:00:00.198) 0:01:59.800 **** 2025-11-26 13:07:46.565087 | controller | changed: [instance] 2025-11-26 13:07:46.795080 | controller | 2025-11-26 13:07:46.795105 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-26 13:07:46.795114 | controller | Wednesday 26 November 2025 13:07:46 +0000 (0:00:01.279) 0:02:01.080 **** 2025-11-26 13:07:46.795125 | controller | ok: [instance] 2025-11-26 13:07:46.795150 | controller | 2025-11-26 13:07:46.795159 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-26 13:07:46.795219 | controller | Wednesday 26 November 2025 13:07:46 +0000 (0:00:00.230) 0:02:01.310 **** 2025-11-26 13:07:46.839900 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 13:07:47.065053 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 13:07:47.065086 | controller | 2025-11-26 13:07:47.065095 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-26 13:07:47.065101 | controller | Wednesday 26 November 2025 13:07:46 +0000 (0:00:00.044) 0:02:01.355 **** 2025-11-26 13:07:47.065116 | controller | ok: [instance] 2025-11-26 13:07:47.267099 | controller | 2025-11-26 13:07:47.267140 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-26 13:07:47.267148 | controller | Wednesday 26 November 2025 13:07:47 +0000 (0:00:00.225) 0:02:01.580 **** 2025-11-26 13:07:47.267160 | controller | ok: [instance] 2025-11-26 13:07:47.267186 | controller | 2025-11-26 13:07:47.267380 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2025-11-26 13:07:47.547747 | controller | Wednesday 26 November 2025 13:07:47 +0000 (0:00:00.202) 0:02:01.782 **** 2025-11-26 13:07:47.547773 | controller | changed: [instance] 2025-11-26 13:07:47.569378 | controller | 2025-11-26 13:07:47.569396 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2025-11-26 13:07:47.569403 | controller | Wednesday 26 November 2025 13:07:47 +0000 (0:00:00.280) 0:02:02.063 **** 2025-11-26 13:07:47.569412 | controller | skipping: [instance] 2025-11-26 13:07:47.597518 | controller | 2025-11-26 13:07:47.597537 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2025-11-26 13:07:47.597545 | controller | Wednesday 26 November 2025 13:07:47 +0000 (0:00:00.021) 0:02:02.084 **** 2025-11-26 13:07:47.597555 | controller | skipping: [instance] 2025-11-26 13:07:47.630148 | controller | 2025-11-26 13:07:47.630195 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2025-11-26 13:07:47.630207 | controller | Wednesday 26 November 2025 13:07:47 +0000 (0:00:00.028) 0:02:02.112 **** 2025-11-26 13:07:47.630223 | controller | skipping: [instance] 2025-11-26 13:07:47.657608 | controller | 2025-11-26 13:07:47.657630 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2025-11-26 13:07:47.657638 | controller | Wednesday 26 November 2025 13:07:47 +0000 (0:00:00.032) 0:02:02.145 **** 2025-11-26 13:07:47.657652 | controller | skipping: [instance] 2025-11-26 13:07:48.871747 | controller | 2025-11-26 13:07:48.871774 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-11-26 13:07:48.871782 | controller | Wednesday 26 November 2025 13:07:47 +0000 (0:00:00.027) 0:02:02.172 **** 2025-11-26 13:07:48.871792 | controller | changed: [instance] 2025-11-26 13:07:48.908512 | controller | 2025-11-26 13:07:48.908534 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-11-26 13:07:48.908543 | controller | Wednesday 26 November 2025 13:07:48 +0000 (0:00:01.213) 0:02:03.386 **** 2025-11-26 13:07:48.908554 | controller | ok: [instance] 2025-11-26 13:07:48.960146 | controller | 2025-11-26 13:07:48.960178 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-11-26 13:07:48.960186 | controller | Wednesday 26 November 2025 13:07:48 +0000 (0:00:00.036) 0:02:03.423 **** 2025-11-26 13:07:48.960196 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-11-26 13:07:49.153122 | controller | 2025-11-26 13:07:49.153156 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-11-26 13:07:49.153164 | controller | Wednesday 26 November 2025 13:07:48 +0000 (0:00:00.051) 0:02:03.475 **** 2025-11-26 13:07:49.153175 | controller | ok: [instance] 2025-11-26 13:07:49.214228 | controller | 2025-11-26 13:07:49.214256 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-11-26 13:07:49.214264 | controller | Wednesday 26 November 2025 13:07:49 +0000 (0:00:00.192) 0:02:03.668 **** 2025-11-26 13:07:49.214274 | controller | ok: [instance] 2025-11-26 13:07:49.260942 | controller | 2025-11-26 13:07:49.260979 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-11-26 13:07:49.260989 | controller | Wednesday 26 November 2025 13:07:49 +0000 (0:00:00.061) 0:02:03.729 **** 2025-11-26 13:07:49.260999 | controller | ok: [instance] 2025-11-26 13:07:49.303826 | controller | 2025-11-26 13:07:49.303856 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-11-26 13:07:49.303868 | controller | Wednesday 26 November 2025 13:07:49 +0000 (0:00:00.046) 0:02:03.776 **** 2025-11-26 13:07:49.303882 | controller | skipping: [instance] 2025-11-26 13:07:49.304360 | controller | 2025-11-26 13:07:49.304606 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-11-26 13:07:49.304786 | controller | Wednesday 26 November 2025 13:07:49 +0000 (0:00:00.043) 0:02:03.819 **** 2025-11-26 13:07:49.344697 | controller | skipping: [instance] 2025-11-26 13:07:49.344994 | controller | 2025-11-26 13:07:49.345338 | controller | TASK [Call the config_drive role] ********************************************** 2025-11-26 13:07:49.345551 | controller | Wednesday 26 November 2025 13:07:49 +0000 (0:00:00.040) 0:02:03.860 **** 2025-11-26 13:07:49.402422 | controller | 2025-11-26 13:07:49.402644 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-11-26 13:07:49.402785 | controller | Wednesday 26 November 2025 13:07:49 +0000 (0:00:00.057) 0:02:03.918 **** 2025-11-26 13:07:49.804590 | controller | ok: [instance] => (item=artifacts) 2025-11-26 13:07:50.976397 | controller | ok: [instance] => (item=logs) 2025-11-26 13:07:50.976431 | controller | 2025-11-26 13:07:50.976441 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-11-26 13:07:50.976448 | controller | Wednesday 26 November 2025 13:07:49 +0000 (0:00:00.401) 0:02:04.319 **** 2025-11-26 13:07:50.976459 | controller | ok: [instance] 2025-11-26 13:07:51.187110 | controller | 2025-11-26 13:07:51.187133 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-11-26 13:07:51.187142 | controller | Wednesday 26 November 2025 13:07:50 +0000 (0:00:01.171) 0:02:05.491 **** 2025-11-26 13:07:51.187153 | controller | changed: [instance] 2025-11-26 13:07:51.187253 | controller | 2025-11-26 13:07:51.187272 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-11-26 13:07:51.549916 | controller | Wednesday 26 November 2025 13:07:51 +0000 (0:00:00.211) 0:02:05.702 **** 2025-11-26 13:07:51.549940 | controller | changed: [instance] 2025-11-26 13:07:51.912931 | controller | 2025-11-26 13:07:51.912972 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-11-26 13:07:51.912986 | controller | Wednesday 26 November 2025 13:07:51 +0000 (0:00:00.362) 0:02:06.064 **** 2025-11-26 13:07:51.912995 | controller | changed: [instance] 2025-11-26 13:07:51.957593 | controller | 2025-11-26 13:07:51.957637 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-11-26 13:07:51.957649 | controller | Wednesday 26 November 2025 13:07:51 +0000 (0:00:00.363) 0:02:06.428 **** 2025-11-26 13:07:51.957664 | controller | skipping: [instance] 2025-11-26 13:07:52.149186 | controller | 2025-11-26 13:07:52.149214 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-11-26 13:07:52.149223 | controller | Wednesday 26 November 2025 13:07:51 +0000 (0:00:00.044) 0:02:06.472 **** 2025-11-26 13:07:52.149235 | controller | ok: [instance] 2025-11-26 13:07:52.149372 | controller | 2025-11-26 13:07:52.149404 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-11-26 13:07:52.149423 | controller | Wednesday 26 November 2025 13:07:52 +0000 (0:00:00.191) 0:02:06.664 **** 2025-11-26 13:07:52.191545 | controller | skipping: [instance] 2025-11-26 13:07:52.423199 | controller | 2025-11-26 13:07:52.423249 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-11-26 13:07:52.423263 | controller | Wednesday 26 November 2025 13:07:52 +0000 (0:00:00.042) 0:02:06.706 **** 2025-11-26 13:07:52.423280 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2025-11-26 13:07:52.423331 | controller | changed: [instance] 2025-11-26 13:07:52.423342 | controller | 2025-11-26 13:07:52.423355 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-11-26 13:07:52.696675 | controller | Wednesday 26 November 2025 13:07:52 +0000 (0:00:00.231) 0:02:06.938 **** 2025-11-26 13:07:52.696712 | controller | changed: [instance] 2025-11-26 13:07:52.744162 | controller | 2025-11-26 13:07:52.744199 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-11-26 13:07:52.744209 | controller | Wednesday 26 November 2025 13:07:52 +0000 (0:00:00.273) 0:02:07.211 **** 2025-11-26 13:07:52.744221 | controller | skipping: [instance] 2025-11-26 13:07:52.744329 | controller | 2025-11-26 13:07:52.744359 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2025-11-26 13:07:52.744377 | controller | Wednesday 26 November 2025 13:07:52 +0000 (0:00:00.047) 0:02:07.259 **** 2025-11-26 13:07:52.771150 | controller | skipping: [instance] 2025-11-26 13:07:52.771211 | controller | 2025-11-26 13:07:52.771480 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2025-11-26 13:07:53.010138 | controller | Wednesday 26 November 2025 13:07:52 +0000 (0:00:00.027) 0:02:07.286 **** 2025-11-26 13:07:53.010179 | controller | changed: [instance] 2025-11-26 13:07:53.233460 | controller | 2025-11-26 13:07:53.233494 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2025-11-26 13:07:53.233502 | controller | Wednesday 26 November 2025 13:07:53 +0000 (0:00:00.238) 0:02:07.525 **** 2025-11-26 13:07:53.233513 | controller | changed: [instance] 2025-11-26 13:07:53.514168 | controller | 2025-11-26 13:07:53.514208 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2025-11-26 13:07:53.514222 | controller | Wednesday 26 November 2025 13:07:53 +0000 (0:00:00.223) 0:02:07.748 **** 2025-11-26 13:07:53.514244 | controller | changed: [instance] 2025-11-26 13:07:53.514285 | controller | 2025-11-26 13:07:53.514300 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2025-11-26 13:07:53.514394 | controller | Wednesday 26 November 2025 13:07:53 +0000 (0:00:00.280) 0:02:08.029 **** 2025-11-26 13:07:53.541555 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-11-26 13:07:53.582198 | controller | 2025-11-26 13:07:53.582244 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-11-26 13:07:53.582258 | controller | Wednesday 26 November 2025 13:07:53 +0000 (0:00:00.027) 0:02:08.056 **** 2025-11-26 13:07:53.582277 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-11-26 13:07:53.582331 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-11-26 13:07:53.582346 | controller | 2025-11-26 13:07:53.582606 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-26 13:07:53.807496 | controller | Wednesday 26 November 2025 13:07:53 +0000 (0:00:00.040) 0:02:08.097 **** 2025-11-26 13:07:53.807520 | controller | ok: [instance] 2025-11-26 13:07:53.851147 | controller | 2025-11-26 13:07:53.851181 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-26 13:07:53.851193 | controller | Wednesday 26 November 2025 13:07:53 +0000 (0:00:00.225) 0:02:08.322 **** 2025-11-26 13:07:53.851208 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 13:07:54.074458 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 13:07:54.074490 | controller | 2025-11-26 13:07:54.074498 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-26 13:07:54.074504 | controller | Wednesday 26 November 2025 13:07:53 +0000 (0:00:00.043) 0:02:08.366 **** 2025-11-26 13:07:54.074514 | controller | ok: [instance] 2025-11-26 13:07:54.269047 | controller | 2025-11-26 13:07:54.269074 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-26 13:07:54.269082 | controller | Wednesday 26 November 2025 13:07:54 +0000 (0:00:00.223) 0:02:08.589 **** 2025-11-26 13:07:54.269092 | controller | ok: [instance] 2025-11-26 13:07:55.545083 | controller | 2025-11-26 13:07:55.545113 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2025-11-26 13:07:55.545122 | controller | Wednesday 26 November 2025 13:07:54 +0000 (0:00:00.194) 0:02:08.784 **** 2025-11-26 13:07:55.545131 | controller | changed: [instance] 2025-11-26 13:07:55.545137 | controller | 2025-11-26 13:07:55.545142 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-11-26 13:07:55.545149 | controller | Wednesday 26 November 2025 13:07:55 +0000 (0:00:01.276) 0:02:10.060 **** 2025-11-26 13:07:55.773956 | controller | ok: [instance] 2025-11-26 13:07:55.818240 | controller | 2025-11-26 13:07:55.818287 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-11-26 13:07:55.818301 | controller | Wednesday 26 November 2025 13:07:55 +0000 (0:00:00.228) 0:02:10.289 **** 2025-11-26 13:07:55.818319 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-11-26 13:07:55.818366 | controller | ok: [instance] => (item=cifmw-public) 2025-11-26 13:07:55.818377 | controller | 2025-11-26 13:07:55.818390 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-11-26 13:07:55.818464 | controller | Wednesday 26 November 2025 13:07:55 +0000 (0:00:00.044) 0:02:10.333 **** 2025-11-26 13:07:56.041084 | controller | ok: [instance] 2025-11-26 13:07:56.271701 | controller | 2025-11-26 13:07:56.271734 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-11-26 13:07:56.271742 | controller | Wednesday 26 November 2025 13:07:56 +0000 (0:00:00.222) 0:02:10.556 **** 2025-11-26 13:07:56.271752 | controller | ok: [instance] 2025-11-26 13:07:56.549083 | controller | 2025-11-26 13:07:56.549106 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2025-11-26 13:07:56.549113 | controller | Wednesday 26 November 2025 13:07:56 +0000 (0:00:00.230) 0:02:10.786 **** 2025-11-26 13:07:56.549122 | controller | changed: [instance] 2025-11-26 13:07:56.571738 | controller | 2025-11-26 13:07:56.571759 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2025-11-26 13:07:56.571767 | controller | Wednesday 26 November 2025 13:07:56 +0000 (0:00:00.277) 0:02:11.064 **** 2025-11-26 13:07:56.571777 | controller | skipping: [instance] 2025-11-26 13:07:56.599162 | controller | 2025-11-26 13:07:56.599201 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2025-11-26 13:07:56.599216 | controller | Wednesday 26 November 2025 13:07:56 +0000 (0:00:00.022) 0:02:11.087 **** 2025-11-26 13:07:56.599232 | controller | skipping: [instance] 2025-11-26 13:07:56.599287 | controller | 2025-11-26 13:07:56.599317 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2025-11-26 13:07:56.599442 | controller | Wednesday 26 November 2025 13:07:56 +0000 (0:00:00.027) 0:02:11.114 **** 2025-11-26 13:07:56.627206 | controller | skipping: [instance] 2025-11-26 13:07:56.627279 | controller | 2025-11-26 13:07:56.627289 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2025-11-26 13:07:56.627304 | controller | Wednesday 26 November 2025 13:07:56 +0000 (0:00:00.027) 0:02:11.142 **** 2025-11-26 13:07:56.654797 | controller | skipping: [instance] 2025-11-26 13:07:57.869455 | controller | 2025-11-26 13:07:57.869480 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-11-26 13:07:57.869490 | controller | Wednesday 26 November 2025 13:07:56 +0000 (0:00:00.027) 0:02:11.170 **** 2025-11-26 13:07:57.869500 | controller | changed: [instance] 2025-11-26 13:07:57.906483 | controller | 2025-11-26 13:07:57.906510 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-11-26 13:07:57.906520 | controller | Wednesday 26 November 2025 13:07:57 +0000 (0:00:01.214) 0:02:12.384 **** 2025-11-26 13:07:57.906531 | controller | ok: [instance] 2025-11-26 13:07:57.934435 | controller | 2025-11-26 13:07:57.934456 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-11-26 13:07:57.934465 | controller | Wednesday 26 November 2025 13:07:57 +0000 (0:00:00.036) 0:02:12.421 **** 2025-11-26 13:07:57.934475 | controller | skipping: [instance] 2025-11-26 13:07:57.964869 | controller | 2025-11-26 13:07:57.964887 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-11-26 13:07:57.964895 | controller | Wednesday 26 November 2025 13:07:57 +0000 (0:00:00.028) 0:02:12.449 **** 2025-11-26 13:07:57.964903 | controller | skipping: [instance] 2025-11-26 13:07:58.009810 | controller | 2025-11-26 13:07:58.009830 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-11-26 13:07:58.009838 | controller | Wednesday 26 November 2025 13:07:57 +0000 (0:00:00.030) 0:02:12.479 **** 2025-11-26 13:07:58.009849 | controller | skipping: [instance] 2025-11-26 13:07:58.036988 | controller | 2025-11-26 13:07:58.037019 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2025-11-26 13:07:58.037029 | controller | Wednesday 26 November 2025 13:07:58 +0000 (0:00:00.045) 0:02:12.525 **** 2025-11-26 13:07:58.037038 | controller | skipping: [instance] 2025-11-26 13:07:58.096797 | controller | 2025-11-26 13:07:58.096817 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2025-11-26 13:07:58.096826 | controller | Wednesday 26 November 2025 13:07:58 +0000 (0:00:00.027) 0:02:12.552 **** 2025-11-26 13:07:58.096836 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2025-11-26 13:07:58.331537 | controller | 2025-11-26 13:07:58.331559 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2025-11-26 13:07:58.331567 | controller | Wednesday 26 November 2025 13:07:58 +0000 (0:00:00.059) 0:02:12.612 **** 2025-11-26 13:07:58.331577 | controller | ok: [instance] => (item=crc) 2025-11-26 13:07:58.331739 | controller | 2025-11-26 13:07:58.331900 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2025-11-26 13:07:58.332099 | controller | Wednesday 26 November 2025 13:07:58 +0000 (0:00:00.235) 0:02:12.847 **** 2025-11-26 13:08:00.400986 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-11-26 13:08:00.401359 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-11-26 13:08:00.401536 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-11-26 13:08:00.401654 | controller | 2025-11-26 13:08:00.401793 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-11-26 13:08:00.401918 | controller | Wednesday 26 November 2025 13:08:00 +0000 (0:00:02.068) 0:02:14.916 **** 2025-11-26 13:08:01.245807 | controller | changed: [instance] 2025-11-26 13:08:02.041188 | controller | 2025-11-26 13:08:02.041220 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-11-26 13:08:02.041230 | controller | Wednesday 26 November 2025 13:08:01 +0000 (0:00:00.844) 0:02:15.760 **** 2025-11-26 13:08:02.041242 | controller | changed: [instance] 2025-11-26 13:08:02.861900 | controller | 2025-11-26 13:08:02.861940 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-11-26 13:08:02.861949 | controller | Wednesday 26 November 2025 13:08:02 +0000 (0:00:00.795) 0:02:16.556 **** 2025-11-26 13:08:02.861959 | controller | changed: [instance] 2025-11-26 13:08:03.573446 | controller | 2025-11-26 13:08:03.573476 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2025-11-26 13:08:03.573484 | controller | Wednesday 26 November 2025 13:08:02 +0000 (0:00:00.820) 0:02:17.376 **** 2025-11-26 13:08:03.573494 | controller | changed: [instance] => (item=compute-0.utility) 2025-11-26 13:08:23.406211 | controller | changed: [instance] => (item=controller-0.utility) 2025-11-26 13:08:23.406251 | controller | changed: [instance] => (item=crc-0.utility) 2025-11-26 13:08:23.406259 | controller | 2025-11-26 13:08:23.406264 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2025-11-26 13:08:23.406270 | controller | Wednesday 26 November 2025 13:08:03 +0000 (0:00:00.711) 0:02:18.088 **** 2025-11-26 13:08:23.406280 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-11-26 13:08:23.527727 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2025-11-26 13:08:23.527753 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2025-11-26 13:08:23.527760 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2025-11-26 13:08:23.527766 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2025-11-26 13:08:23.527771 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j110635867745.24212', 'results_file': '/home/zuul/.ansible_async/j110635867745.24212', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2025-11-26 13:08:23.527782 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-11-26 13:08:23.527788 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j258930263553.24230', 'results_file': '/home/zuul/.ansible_async/j258930263553.24230', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2025-11-26 13:08:23.527793 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j586060745725.24246', 'results_file': '/home/zuul/.ansible_async/j586060745725.24246', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2025-11-26 13:08:23.527799 | controller | 2025-11-26 13:08:23.527804 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2025-11-26 13:08:23.527810 | controller | Wednesday 26 November 2025 13:08:23 +0000 (0:00:19.832) 0:02:37.920 **** 2025-11-26 13:08:23.527821 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-11-26 13:08:23.558879 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-11-26 13:08:23.558905 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-11-26 13:08:23.558913 | controller | 2025-11-26 13:08:23.558919 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-11-26 13:08:23.558925 | controller | Wednesday 26 November 2025 13:08:23 +0000 (0:00:00.122) 0:02:38.042 **** 2025-11-26 13:08:23.558934 | controller | skipping: [instance] 2025-11-26 13:08:23.602259 | controller | 2025-11-26 13:08:23.602283 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2025-11-26 13:08:23.602291 | controller | Wednesday 26 November 2025 13:08:23 +0000 (0:00:00.031) 0:02:38.074 **** 2025-11-26 13:08:23.602300 | controller | 2025-11-26 13:08:23.705359 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-11-26 13:08:23.705383 | controller | Wednesday 26 November 2025 13:08:23 +0000 (0:00:00.043) 0:02:38.117 **** 2025-11-26 13:08:23.705400 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-11-26 13:08:23.945039 | controller | 2025-11-26 13:08:23.945081 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-11-26 13:08:23.945090 | controller | Wednesday 26 November 2025 13:08:23 +0000 (0:00:00.102) 0:02:38.220 **** 2025-11-26 13:08:23.945102 | controller | changed: [instance] 2025-11-26 13:08:24.186103 | controller | 2025-11-26 13:08:24.186131 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-11-26 13:08:24.186139 | controller | Wednesday 26 November 2025 13:08:23 +0000 (0:00:00.239) 0:02:38.459 **** 2025-11-26 13:08:24.186149 | controller | changed: [instance] 2025-11-26 13:08:24.622725 | controller | 2025-11-26 13:08:24.622757 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2025-11-26 13:08:24.622765 | controller | Wednesday 26 November 2025 13:08:24 +0000 (0:00:00.241) 0:02:38.701 **** 2025-11-26 13:08:24.622775 | controller | changed: [instance] 2025-11-26 13:08:24.649493 | controller | 2025-11-26 13:08:24.649511 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2025-11-26 13:08:24.649518 | controller | Wednesday 26 November 2025 13:08:24 +0000 (0:00:00.436) 0:02:39.137 **** 2025-11-26 13:08:24.649526 | controller | skipping: [instance] 2025-11-26 13:08:24.675211 | controller | 2025-11-26 13:08:24.675229 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-11-26 13:08:24.675237 | controller | Wednesday 26 November 2025 13:08:24 +0000 (0:00:00.027) 0:02:39.164 **** 2025-11-26 13:08:24.675245 | controller | skipping: [instance] 2025-11-26 13:08:24.725520 | controller | 2025-11-26 13:08:24.725555 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2025-11-26 13:08:24.725563 | controller | Wednesday 26 November 2025 13:08:24 +0000 (0:00:00.025) 0:02:39.190 **** 2025-11-26 13:08:24.725581 | controller | skipping: [instance] 2025-11-26 13:08:24.725599 | controller | 2025-11-26 13:08:24.725607 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2025-11-26 13:08:24.725725 | controller | Wednesday 26 November 2025 13:08:24 +0000 (0:00:00.050) 0:02:39.240 **** 2025-11-26 13:08:24.780795 | controller | skipping: [instance] 2025-11-26 13:08:24.780845 | controller | 2025-11-26 13:08:24.780973 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-11-26 13:08:24.781109 | controller | Wednesday 26 November 2025 13:08:24 +0000 (0:00:00.055) 0:02:39.295 **** 2025-11-26 13:08:24.808388 | controller | skipping: [instance] 2025-11-26 13:08:24.808475 | controller | 2025-11-26 13:08:24.808590 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2025-11-26 13:08:24.808706 | controller | Wednesday 26 November 2025 13:08:24 +0000 (0:00:00.028) 0:02:39.324 **** 2025-11-26 13:08:24.846102 | controller | 2025-11-26 13:08:24.846212 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-11-26 13:08:24.846323 | controller | Wednesday 26 November 2025 13:08:24 +0000 (0:00:00.037) 0:02:39.361 **** 2025-11-26 13:08:24.956687 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-11-26 13:08:24.956756 | controller | 2025-11-26 13:08:24.956874 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-11-26 13:08:24.956983 | controller | Wednesday 26 November 2025 13:08:24 +0000 (0:00:00.110) 0:02:39.472 **** 2025-11-26 13:08:25.193626 | controller | ok: [instance] 2025-11-26 13:08:25.193703 | controller | 2025-11-26 13:08:25.193815 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-11-26 13:08:25.193934 | controller | Wednesday 26 November 2025 13:08:25 +0000 (0:00:00.236) 0:02:39.709 **** 2025-11-26 13:08:25.408553 | controller | ok: [instance] 2025-11-26 13:08:25.408603 | controller | 2025-11-26 13:08:25.408710 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2025-11-26 13:08:25.408811 | controller | Wednesday 26 November 2025 13:08:25 +0000 (0:00:00.211) 0:02:39.921 **** 2025-11-26 13:08:25.824297 | controller | changed: [instance] 2025-11-26 13:08:25.824349 | controller | 2025-11-26 13:08:25.824454 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2025-11-26 13:08:25.824554 | controller | Wednesday 26 November 2025 13:08:25 +0000 (0:00:00.418) 0:02:40.339 **** 2025-11-26 13:08:25.853571 | controller | skipping: [instance] 2025-11-26 13:08:25.853656 | controller | 2025-11-26 13:08:25.853756 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-11-26 13:08:25.853889 | controller | Wednesday 26 November 2025 13:08:25 +0000 (0:00:00.029) 0:02:40.369 **** 2025-11-26 13:08:25.881489 | controller | skipping: [instance] 2025-11-26 13:08:25.881569 | controller | 2025-11-26 13:08:25.881661 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2025-11-26 13:08:25.881750 | controller | Wednesday 26 November 2025 13:08:25 +0000 (0:00:00.028) 0:02:40.397 **** 2025-11-26 13:08:27.558465 | controller | changed: [instance -> controller-0.instance] 2025-11-26 13:08:27.558918 | controller | 2025-11-26 13:08:28.742908 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2025-11-26 13:08:28.742946 | controller | Wednesday 26 November 2025 13:08:27 +0000 (0:00:01.676) 0:02:42.073 **** 2025-11-26 13:08:28.742958 | controller | changed: [instance -> controller-0.instance] 2025-11-26 13:08:28.786563 | controller | 2025-11-26 13:08:28.786580 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-11-26 13:08:28.786588 | controller | Wednesday 26 November 2025 13:08:28 +0000 (0:00:01.183) 0:02:43.257 **** 2025-11-26 13:08:28.786596 | controller | 2025-11-26 13:08:29.020839 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-11-26 13:08:29.020870 | controller | Wednesday 26 November 2025 13:08:28 +0000 (0:00:00.044) 0:02:43.301 **** 2025-11-26 13:08:29.020881 | controller | ok: [instance] 2025-11-26 13:08:29.047207 | controller | 2025-11-26 13:08:29.047241 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-11-26 13:08:29.047249 | controller | Wednesday 26 November 2025 13:08:29 +0000 (0:00:00.234) 0:02:43.536 **** 2025-11-26 13:08:29.047259 | controller | ok: [instance] 2025-11-26 13:08:29.047276 | controller | 2025-11-26 13:08:29.047283 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-11-26 13:08:29.079203 | controller | Wednesday 26 November 2025 13:08:29 +0000 (0:00:00.026) 0:02:43.562 **** 2025-11-26 13:08:29.079233 | controller | skipping: [instance] 2025-11-26 13:08:29.079277 | controller | 2025-11-26 13:08:29.079454 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2025-11-26 13:08:29.134641 | controller | Wednesday 26 November 2025 13:08:29 +0000 (0:00:00.032) 0:02:43.594 **** 2025-11-26 13:08:29.134667 | controller | 2025-11-26 13:08:29.226063 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-11-26 13:08:29.226086 | controller | Wednesday 26 November 2025 13:08:29 +0000 (0:00:00.055) 0:02:43.649 **** 2025-11-26 13:08:29.226097 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2025-11-26 13:08:29.226292 | controller | 2025-11-26 13:08:29.226306 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-11-26 13:08:29.458448 | controller | Wednesday 26 November 2025 13:08:29 +0000 (0:00:00.091) 0:02:43.741 **** 2025-11-26 13:08:29.458489 | controller | ok: [instance] 2025-11-26 13:08:29.679205 | controller | 2025-11-26 13:08:29.679243 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-11-26 13:08:29.679252 | controller | Wednesday 26 November 2025 13:08:29 +0000 (0:00:00.231) 0:02:43.973 **** 2025-11-26 13:08:29.679263 | controller | ok: [instance] 2025-11-26 13:08:30.095136 | controller | 2025-11-26 13:08:30.095168 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2025-11-26 13:08:30.095176 | controller | Wednesday 26 November 2025 13:08:29 +0000 (0:00:00.220) 0:02:44.194 **** 2025-11-26 13:08:30.095185 | controller | changed: [instance] 2025-11-26 13:08:31.147516 | controller | 2025-11-26 13:08:31.147548 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2025-11-26 13:08:31.147555 | controller | Wednesday 26 November 2025 13:08:30 +0000 (0:00:00.415) 0:02:44.610 **** 2025-11-26 13:08:31.147565 | controller | changed: [instance] 2025-11-26 13:08:31.174440 | controller | 2025-11-26 13:08:31.174468 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-11-26 13:08:31.174476 | controller | Wednesday 26 November 2025 13:08:31 +0000 (0:00:01.052) 0:02:45.662 **** 2025-11-26 13:08:31.174488 | controller | skipping: [instance] 2025-11-26 13:08:31.229113 | controller | 2025-11-26 13:08:31.229137 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2025-11-26 13:08:31.229145 | controller | Wednesday 26 November 2025 13:08:31 +0000 (0:00:00.027) 0:02:45.689 **** 2025-11-26 13:08:31.229154 | controller | skipping: [instance] 2025-11-26 13:08:31.277122 | controller | 2025-11-26 13:08:31.277141 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2025-11-26 13:08:31.277149 | controller | Wednesday 26 November 2025 13:08:31 +0000 (0:00:00.054) 0:02:45.744 **** 2025-11-26 13:08:31.277158 | controller | skipping: [instance] 2025-11-26 13:08:31.326982 | controller | 2025-11-26 13:08:31.327026 | controller | TASK [Create VBMC entity] ****************************************************** 2025-11-26 13:08:31.327036 | controller | Wednesday 26 November 2025 13:08:31 +0000 (0:00:00.047) 0:02:45.792 **** 2025-11-26 13:08:31.327046 | controller | skipping: [instance] => (item=compute-0) 2025-11-26 13:08:31.584803 | controller | skipping: [instance] => (item=controller-0) 2025-11-26 13:08:31.584830 | controller | skipping: [instance] => (item=crc-0) 2025-11-26 13:08:31.584837 | controller | skipping: [instance] 2025-11-26 13:08:31.584852 | controller | 2025-11-26 13:08:31.584858 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2025-11-26 13:08:31.584863 | controller | Wednesday 26 November 2025 13:08:31 +0000 (0:00:00.050) 0:02:45.842 **** 2025-11-26 13:08:31.584872 | controller | ok: [instance] 2025-11-26 13:08:31.982869 | controller | 2025-11-26 13:08:31.982899 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2025-11-26 13:08:31.982907 | controller | Wednesday 26 November 2025 13:08:31 +0000 (0:00:00.257) 0:02:46.100 **** 2025-11-26 13:08:31.982918 | controller | changed: [instance] 2025-11-26 13:08:32.019605 | controller | 2025-11-26 13:08:32.019632 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2025-11-26 13:08:32.019639 | controller | Wednesday 26 November 2025 13:08:31 +0000 (0:00:00.398) 0:02:46.498 **** 2025-11-26 13:08:32.019648 | controller | skipping: [instance] 2025-11-26 13:08:32.055914 | controller | 2025-11-26 13:08:32.055935 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2025-11-26 13:08:32.055942 | controller | Wednesday 26 November 2025 13:08:32 +0000 (0:00:00.036) 0:02:46.535 **** 2025-11-26 13:08:32.055956 | controller | skipping: [instance] 2025-11-26 13:08:32.101039 | controller | 2025-11-26 13:08:32.101059 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2025-11-26 13:08:32.101066 | controller | Wednesday 26 November 2025 13:08:32 +0000 (0:00:00.036) 0:02:46.571 **** 2025-11-26 13:08:32.101075 | controller | skipping: [instance] 2025-11-26 13:08:32.847850 | controller | 2025-11-26 13:08:32.847883 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2025-11-26 13:08:32.847891 | controller | Wednesday 26 November 2025 13:08:32 +0000 (0:00:00.045) 0:02:46.616 **** 2025-11-26 13:08:32.847901 | controller | changed: [instance] 2025-11-26 13:08:33.599141 | controller | 2025-11-26 13:08:33.599192 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2025-11-26 13:08:33.599208 | controller | Wednesday 26 November 2025 13:08:32 +0000 (0:00:00.740) 0:02:47.357 **** 2025-11-26 13:08:33.599222 | controller | changed: [instance] 2025-11-26 13:08:33.651735 | controller | 2025-11-26 13:08:33.651783 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2025-11-26 13:08:33.651793 | controller | Wednesday 26 November 2025 13:08:33 +0000 (0:00:00.756) 0:02:48.114 **** 2025-11-26 13:08:33.651806 | controller | skipping: [instance] 2025-11-26 13:08:33.652028 | controller | 2025-11-26 13:08:33.652101 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2025-11-26 13:08:33.727852 | controller | Wednesday 26 November 2025 13:08:33 +0000 (0:00:00.052) 0:02:48.167 **** 2025-11-26 13:08:33.727876 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2025-11-26 13:08:33.772377 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2025-11-26 13:08:33.772426 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2025-11-26 13:08:33.772433 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2025-11-26 13:08:33.772439 | controller | 2025-11-26 13:08:33.772445 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2025-11-26 13:08:33.772451 | controller | Wednesday 26 November 2025 13:08:33 +0000 (0:00:00.075) 0:02:48.242 **** 2025-11-26 13:08:33.772462 | controller | skipping: [instance] 2025-11-26 13:08:33.772480 | controller | 2025-11-26 13:08:33.772488 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2025-11-26 13:08:33.772527 | controller | Wednesday 26 November 2025 13:08:33 +0000 (0:00:00.045) 0:02:48.287 **** 2025-11-26 13:08:33.816694 | controller | skipping: [instance] 2025-11-26 13:08:33.866286 | controller | 2025-11-26 13:08:33.866311 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2025-11-26 13:08:33.866322 | controller | Wednesday 26 November 2025 13:08:33 +0000 (0:00:00.044) 0:02:48.332 **** 2025-11-26 13:08:33.866335 | controller | skipping: [instance] 2025-11-26 13:08:33.906167 | controller | 2025-11-26 13:08:33.906209 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2025-11-26 13:08:33.906222 | controller | Wednesday 26 November 2025 13:08:33 +0000 (0:00:00.049) 0:02:48.381 **** 2025-11-26 13:08:33.906233 | controller | skipping: [instance] 2025-11-26 13:08:33.906257 | controller | 2025-11-26 13:08:33.906265 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2025-11-26 13:08:33.906357 | controller | Wednesday 26 November 2025 13:08:33 +0000 (0:00:00.040) 0:02:48.421 **** 2025-11-26 13:08:34.590505 | controller | changed: [instance] 2025-11-26 13:08:34.634200 | controller | 2025-11-26 13:08:34.634271 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2025-11-26 13:08:34.634286 | controller | Wednesday 26 November 2025 13:08:34 +0000 (0:00:00.683) 0:02:49.105 **** 2025-11-26 13:08:34.634309 | controller | skipping: [instance] 2025-11-26 13:08:34.673404 | controller | 2025-11-26 13:08:34.673435 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2025-11-26 13:08:34.673451 | controller | Wednesday 26 November 2025 13:08:34 +0000 (0:00:00.043) 0:02:49.149 **** 2025-11-26 13:08:34.673460 | controller | skipping: [instance] 2025-11-26 13:08:34.673483 | controller | 2025-11-26 13:08:34.673490 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2025-11-26 13:08:34.673705 | controller | Wednesday 26 November 2025 13:08:34 +0000 (0:00:00.039) 0:02:49.188 **** 2025-11-26 13:08:34.715341 | controller | skipping: [instance] 2025-11-26 13:08:34.715404 | controller | 2025-11-26 13:08:34.715417 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-11-26 13:08:34.715431 | controller | Wednesday 26 November 2025 13:08:34 +0000 (0:00:00.041) 0:02:49.229 **** 2025-11-26 13:08:34.753233 | controller | skipping: [instance] 2025-11-26 13:08:34.753310 | controller | 2025-11-26 13:08:34.753327 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-11-26 13:08:34.753501 | controller | Wednesday 26 November 2025 13:08:34 +0000 (0:00:00.038) 0:02:49.268 **** 2025-11-26 13:08:34.792524 | controller | skipping: [instance] 2025-11-26 13:08:34.792691 | controller | 2025-11-26 13:08:34.792825 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-11-26 13:08:34.792968 | controller | Wednesday 26 November 2025 13:08:34 +0000 (0:00:00.039) 0:02:49.307 **** 2025-11-26 13:08:34.834705 | controller | skipping: [instance] 2025-11-26 13:08:34.834894 | controller | 2025-11-26 13:08:34.835082 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-11-26 13:08:34.835244 | controller | Wednesday 26 November 2025 13:08:34 +0000 (0:00:00.041) 0:02:49.349 **** 2025-11-26 13:08:34.871566 | controller | skipping: [instance] 2025-11-26 13:08:34.871730 | controller | 2025-11-26 13:08:34.871907 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-11-26 13:08:34.872095 | controller | Wednesday 26 November 2025 13:08:34 +0000 (0:00:00.037) 0:02:49.387 **** 2025-11-26 13:08:34.912486 | controller | skipping: [instance] 2025-11-26 13:08:34.912779 | controller | 2025-11-26 13:08:34.912973 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-11-26 13:08:34.913128 | controller | Wednesday 26 November 2025 13:08:34 +0000 (0:00:00.040) 0:02:49.427 **** 2025-11-26 13:08:34.955436 | controller | skipping: [instance] 2025-11-26 13:08:35.012740 | controller | 2025-11-26 13:08:35.012827 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-11-26 13:08:35.012848 | controller | Wednesday 26 November 2025 13:08:34 +0000 (0:00:00.042) 0:02:49.470 **** 2025-11-26 13:08:35.012864 | controller | skipping: [instance] 2025-11-26 13:08:35.012885 | controller | 2025-11-26 13:08:35.012894 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2025-11-26 13:08:35.048631 | controller | Wednesday 26 November 2025 13:08:35 +0000 (0:00:00.057) 0:02:49.528 **** 2025-11-26 13:08:35.048687 | controller | skipping: [instance] 2025-11-26 13:08:35.048714 | controller | 2025-11-26 13:08:35.048730 | controller | TASK [reproducer : Configure Controller node] ********************************** 2025-11-26 13:08:35.048762 | controller | Wednesday 26 November 2025 13:08:35 +0000 (0:00:00.036) 0:02:49.564 **** 2025-11-26 13:08:35.202464 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2025-11-26 13:08:36.733936 | controller | 2025-11-26 13:08:36.733973 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-11-26 13:08:36.733981 | controller | Wednesday 26 November 2025 13:08:35 +0000 (0:00:00.153) 0:02:49.717 **** 2025-11-26 13:08:36.733991 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-11-26 13:08:36.756904 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-11-26 13:08:36.756932 | controller | 2025-11-26 13:08:36.756940 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-11-26 13:08:36.756950 | controller | Wednesday 26 November 2025 13:08:36 +0000 (0:00:01.530) 0:02:51.248 **** 2025-11-26 13:08:36.756960 | controller | skipping: [instance] 2025-11-26 13:08:37.442293 | controller | 2025-11-26 13:08:37.442339 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-11-26 13:08:37.442347 | controller | Wednesday 26 November 2025 13:08:36 +0000 (0:00:00.023) 0:02:51.272 **** 2025-11-26 13:08:37.442357 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:08:37.442373 | controller | 2025-11-26 13:08:37.442379 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-11-26 13:08:37.442385 | controller | Wednesday 26 November 2025 13:08:37 +0000 (0:00:00.685) 0:02:51.957 **** 2025-11-26 13:08:37.491800 | controller | skipping: [instance] 2025-11-26 13:08:37.491879 | controller | 2025-11-26 13:08:37.491980 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-11-26 13:08:37.492129 | controller | Wednesday 26 November 2025 13:08:37 +0000 (0:00:00.049) 0:02:52.007 **** 2025-11-26 13:08:37.537527 | controller | skipping: [instance] 2025-11-26 13:08:37.537615 | controller | 2025-11-26 13:08:37.537721 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-11-26 13:08:37.537814 | controller | Wednesday 26 November 2025 13:08:37 +0000 (0:00:00.045) 0:02:52.053 **** 2025-11-26 13:08:37.581653 | controller | skipping: [instance] 2025-11-26 13:08:37.581746 | controller | 2025-11-26 13:08:37.581852 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-11-26 13:08:37.581953 | controller | Wednesday 26 November 2025 13:08:37 +0000 (0:00:00.044) 0:02:52.097 **** 2025-11-26 13:08:39.246736 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:08:39.282887 | controller | 2025-11-26 13:08:39.282934 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2025-11-26 13:08:39.282946 | controller | Wednesday 26 November 2025 13:08:39 +0000 (0:00:01.663) 0:02:53.761 **** 2025-11-26 13:08:39.282961 | controller | skipping: [instance] 2025-11-26 13:08:39.283196 | controller | 2025-11-26 13:08:39.283393 | controller | TASK [reproducer : Install repos] ********************************************** 2025-11-26 13:08:39.283542 | controller | Wednesday 26 November 2025 13:08:39 +0000 (0:00:00.037) 0:02:53.798 **** 2025-11-26 13:08:39.331437 | controller | skipping: [instance] 2025-11-26 13:08:39.331662 | controller | 2025-11-26 13:08:39.331864 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2025-11-26 13:08:39.332082 | controller | Wednesday 26 November 2025 13:08:39 +0000 (0:00:00.048) 0:02:53.846 **** 2025-11-26 13:08:39.371182 | controller | skipping: [instance] 2025-11-26 13:08:39.371334 | controller | 2025-11-26 13:08:39.371480 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2025-11-26 13:08:39.371618 | controller | Wednesday 26 November 2025 13:08:39 +0000 (0:00:00.040) 0:02:53.886 **** 2025-11-26 13:08:39.410330 | controller | skipping: [instance] 2025-11-26 13:08:39.410520 | controller | 2025-11-26 13:08:39.410696 | controller | TASK [reproducer : Install some tools] ***************************************** 2025-11-26 13:08:39.410877 | controller | Wednesday 26 November 2025 13:08:39 +0000 (0:00:00.039) 0:02:53.926 **** 2025-11-26 13:08:40.655651 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:08:41.826168 | controller | 2025-11-26 13:08:41.826209 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2025-11-26 13:08:41.826219 | controller | Wednesday 26 November 2025 13:08:40 +0000 (0:00:01.244) 0:02:55.170 **** 2025-11-26 13:08:41.826232 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:08:41.826431 | controller | 2025-11-26 13:08:41.826469 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2025-11-26 13:08:42.561440 | controller | Wednesday 26 November 2025 13:08:41 +0000 (0:00:01.170) 0:02:56.341 **** 2025-11-26 13:08:42.561491 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:08:43.612751 | controller | 2025-11-26 13:08:43.612788 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2025-11-26 13:08:43.612797 | controller | Wednesday 26 November 2025 13:08:42 +0000 (0:00:00.734) 0:02:57.076 **** 2025-11-26 13:08:43.612818 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:08:44.826742 | controller | 2025-11-26 13:08:44.826778 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2025-11-26 13:08:44.826787 | controller | Wednesday 26 November 2025 13:08:43 +0000 (0:00:01.051) 0:02:58.127 **** 2025-11-26 13:08:44.826797 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-11-26 13:08:45.475090 | controller | skipping: [instance] => (item=compute-0) 2025-11-26 13:08:45.475127 | controller | skipping: [instance] => (item=controller-0) 2025-11-26 13:08:45.475134 | controller | skipping: [instance] => (item=crc-0) 2025-11-26 13:08:45.475140 | controller | 2025-11-26 13:08:45.475147 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2025-11-26 13:08:45.475153 | controller | Wednesday 26 November 2025 13:08:44 +0000 (0:00:01.213) 0:02:59.341 **** 2025-11-26 13:08:45.475168 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-11-26 13:08:45.475614 | controller | skipping: [instance] => (item=compute-0) 2025-11-26 13:08:45.475627 | controller | skipping: [instance] => (item=controller-0) 2025-11-26 13:08:45.475636 | controller | skipping: [instance] => (item=crc-0) 2025-11-26 13:08:47.120080 | controller | 2025-11-26 13:08:47.120114 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2025-11-26 13:08:47.120123 | controller | Wednesday 26 November 2025 13:08:45 +0000 (0:00:00.648) 0:02:59.990 **** 2025-11-26 13:08:47.120133 | controller | skipping: [instance] => (item=instance) 2025-11-26 13:08:47.120246 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2025-11-26 13:08:47.120256 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-11-26 13:08:47.120262 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2025-11-26 13:08:47.120267 | controller | 2025-11-26 13:08:47.120272 | controller | TASK [reproducer : Create kube directory] ************************************** 2025-11-26 13:08:47.120279 | controller | Wednesday 26 November 2025 13:08:47 +0000 (0:00:01.644) 0:03:01.635 **** 2025-11-26 13:08:47.688303 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:08:48.645467 | controller | 2025-11-26 13:08:48.645501 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2025-11-26 13:08:48.645509 | controller | Wednesday 26 November 2025 13:08:47 +0000 (0:00:00.568) 0:03:02.203 **** 2025-11-26 13:08:48.645519 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:08:49.585316 | controller | 2025-11-26 13:08:49.585351 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2025-11-26 13:08:49.585359 | controller | Wednesday 26 November 2025 13:08:48 +0000 (0:00:00.957) 0:03:03.160 **** 2025-11-26 13:08:49.585369 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:08:49.619241 | controller | 2025-11-26 13:08:49.619260 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2025-11-26 13:08:49.619267 | controller | Wednesday 26 November 2025 13:08:49 +0000 (0:00:00.939) 0:03:04.100 **** 2025-11-26 13:08:49.619276 | controller | skipping: [instance] 2025-11-26 13:08:50.186195 | controller | 2025-11-26 13:08:50.186233 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2025-11-26 13:08:50.186241 | controller | Wednesday 26 November 2025 13:08:49 +0000 (0:00:00.034) 0:03:04.134 **** 2025-11-26 13:08:50.186252 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:08:50.783299 | controller | 2025-11-26 13:08:50.783337 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2025-11-26 13:08:50.783346 | controller | Wednesday 26 November 2025 13:08:50 +0000 (0:00:00.566) 0:03:04.701 **** 2025-11-26 13:08:50.783357 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:08:50.825132 | controller | 2025-11-26 13:08:50.825151 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2025-11-26 13:08:50.825158 | controller | Wednesday 26 November 2025 13:08:50 +0000 (0:00:00.597) 0:03:05.298 **** 2025-11-26 13:08:50.825167 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:08:50.897597 | controller | 2025-11-26 13:08:50.897619 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2025-11-26 13:08:50.897626 | controller | Wednesday 26 November 2025 13:08:50 +0000 (0:00:00.042) 0:03:05.340 **** 2025-11-26 13:08:50.897636 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2025-11-26 13:08:50.952062 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2025-11-26 13:08:50.952081 | controller | 2025-11-26 13:08:50.952088 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-11-26 13:08:50.952095 | controller | Wednesday 26 November 2025 13:08:50 +0000 (0:00:00.071) 0:03:05.411 **** 2025-11-26 13:08:50.952107 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-26 13:08:50.952627 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2025-11-26 13:08:51.002771 | controller | 2025-11-26 13:08:51.002798 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-11-26 13:08:51.002806 | controller | Wednesday 26 November 2025 13:08:50 +0000 (0:00:00.055) 0:03:05.467 **** 2025-11-26 13:08:51.002815 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-26 13:08:51.055437 | controller | _secret_file: '' 2025-11-26 13:08:51.055465 | controller | 2025-11-26 13:08:51.055472 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-11-26 13:08:51.055479 | controller | Wednesday 26 November 2025 13:08:51 +0000 (0:00:00.050) 0:03:05.518 **** 2025-11-26 13:08:51.055487 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-26 13:08:51.102985 | controller | _secret_content: my-default-location-place 2025-11-26 13:08:51.103005 | controller | 2025-11-26 13:08:51.103033 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-11-26 13:08:51.103040 | controller | Wednesday 26 November 2025 13:08:51 +0000 (0:00:00.050) 0:03:05.568 **** 2025-11-26 13:08:51.103049 | controller | skipping: [instance] 2025-11-26 13:08:51.151637 | controller | 2025-11-26 13:08:51.151654 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-11-26 13:08:51.151661 | controller | Wednesday 26 November 2025 13:08:51 +0000 (0:00:00.049) 0:03:05.618 **** 2025-11-26 13:08:51.151669 | controller | skipping: [instance] 2025-11-26 13:08:51.203141 | controller | 2025-11-26 13:08:51.203174 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-11-26 13:08:51.203181 | controller | Wednesday 26 November 2025 13:08:51 +0000 (0:00:00.048) 0:03:05.667 **** 2025-11-26 13:08:51.203194 | controller | skipping: [instance] 2025-11-26 13:08:51.203399 | controller | 2025-11-26 13:08:51.203413 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-11-26 13:08:52.192651 | controller | Wednesday 26 November 2025 13:08:51 +0000 (0:00:00.051) 0:03:05.718 **** 2025-11-26 13:08:52.192689 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:08:52.246564 | controller | 2025-11-26 13:08:52.246602 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-11-26 13:08:52.246610 | controller | Wednesday 26 November 2025 13:08:52 +0000 (0:00:00.989) 0:03:06.707 **** 2025-11-26 13:08:52.246620 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-26 13:08:52.295441 | controller | _secret_dest: /home/zuul/ipmi-things 2025-11-26 13:08:52.295465 | controller | 2025-11-26 13:08:52.295473 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-11-26 13:08:52.295479 | controller | Wednesday 26 November 2025 13:08:52 +0000 (0:00:00.053) 0:03:06.761 **** 2025-11-26 13:08:52.295489 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-26 13:08:52.343702 | controller | _secret_file: /tmp/ipmi-things 2025-11-26 13:08:52.343732 | controller | 2025-11-26 13:08:52.343740 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-11-26 13:08:52.343750 | controller | Wednesday 26 November 2025 13:08:52 +0000 (0:00:00.049) 0:03:06.810 **** 2025-11-26 13:08:52.343760 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-11-26 13:08:52.397153 | controller | _secret_content: '' 2025-11-26 13:08:52.397185 | controller | 2025-11-26 13:08:52.397200 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-11-26 13:08:52.397207 | controller | Wednesday 26 November 2025 13:08:52 +0000 (0:00:00.048) 0:03:06.858 **** 2025-11-26 13:08:52.397218 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2025-11-26 13:08:52.979698 | controller | msg: All assertions passed 2025-11-26 13:08:52.979729 | controller | 2025-11-26 13:08:52.979737 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-11-26 13:08:52.979743 | controller | Wednesday 26 November 2025 13:08:52 +0000 (0:00:00.053) 0:03:06.912 **** 2025-11-26 13:08:52.979753 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:08:53.931824 | controller | 2025-11-26 13:08:53.931855 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-11-26 13:08:53.931862 | controller | Wednesday 26 November 2025 13:08:52 +0000 (0:00:00.582) 0:03:07.494 **** 2025-11-26 13:08:53.931872 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:08:53.982927 | controller | 2025-11-26 13:08:53.982958 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-11-26 13:08:53.982966 | controller | Wednesday 26 November 2025 13:08:53 +0000 (0:00:00.952) 0:03:08.446 **** 2025-11-26 13:08:53.982975 | controller | skipping: [instance] 2025-11-26 13:08:54.582480 | controller | 2025-11-26 13:08:54.582513 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2025-11-26 13:08:54.582521 | controller | Wednesday 26 November 2025 13:08:53 +0000 (0:00:00.051) 0:03:08.498 **** 2025-11-26 13:08:54.582532 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:08:55.192899 | controller | 2025-11-26 13:08:55.192936 | controller | TASK [reproducer : Check if async file is still available] ********************* 2025-11-26 13:08:55.192944 | controller | Wednesday 26 November 2025 13:08:54 +0000 (0:00:00.599) 0:03:09.097 **** 2025-11-26 13:08:55.192954 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:09:56.641317 | controller | 2025-11-26 13:09:56.641353 | controller | TASK [reproducer : Check package install status] ******************************* 2025-11-26 13:09:56.641361 | controller | Wednesday 26 November 2025 13:08:55 +0000 (0:00:00.610) 0:03:09.707 **** 2025-11-26 13:09:56.641371 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2025-11-26 13:09:57.264641 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2025-11-26 13:09:57.264672 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2025-11-26 13:09:57.264679 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2025-11-26 13:09:57.264685 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2025-11-26 13:09:57.264690 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2025-11-26 13:09:57.264696 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2025-11-26 13:09:57.264701 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2025-11-26 13:09:57.264706 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). 2025-11-26 13:09:57.264711 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left). 2025-11-26 13:09:57.264721 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (90 retries left). 2025-11-26 13:09:57.264728 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:09:57.264734 | controller | 2025-11-26 13:09:57.264740 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2025-11-26 13:09:57.264750 | controller | Wednesday 26 November 2025 13:09:56 +0000 (0:01:01.446) 0:04:11.154 **** 2025-11-26 13:09:57.264760 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:09:59.980275 | controller | 2025-11-26 13:09:59.980309 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2025-11-26 13:09:59.980318 | controller | Wednesday 26 November 2025 13:09:57 +0000 (0:00:00.625) 0:04:11.779 **** 2025-11-26 13:09:59.980329 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:00.031950 | controller | 2025-11-26 13:10:00.031980 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2025-11-26 13:10:00.031988 | controller | Wednesday 26 November 2025 13:09:59 +0000 (0:00:02.715) 0:04:14.495 **** 2025-11-26 13:10:00.031999 | controller | skipping: [instance] 2025-11-26 13:10:00.082413 | controller | 2025-11-26 13:10:00.082436 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2025-11-26 13:10:00.082444 | controller | Wednesday 26 November 2025 13:10:00 +0000 (0:00:00.051) 0:04:14.547 **** 2025-11-26 13:10:00.082454 | controller | skipping: [instance] 2025-11-26 13:10:00.684041 | controller | 2025-11-26 13:10:00.684086 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2025-11-26 13:10:00.684095 | controller | Wednesday 26 November 2025 13:10:00 +0000 (0:00:00.050) 0:04:14.597 **** 2025-11-26 13:10:00.684106 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:01.232986 | controller | 2025-11-26 13:10:01.233046 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2025-11-26 13:10:01.233055 | controller | Wednesday 26 November 2025 13:10:00 +0000 (0:00:00.601) 0:04:15.199 **** 2025-11-26 13:10:01.233078 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:01.538073 | controller | 2025-11-26 13:10:01.538103 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2025-11-26 13:10:01.538110 | controller | Wednesday 26 November 2025 13:10:01 +0000 (0:00:00.548) 0:04:15.748 **** 2025-11-26 13:10:01.538119 | controller | changed: [instance] 2025-11-26 13:10:02.182376 | controller | 2025-11-26 13:10:02.182409 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2025-11-26 13:10:02.182417 | controller | Wednesday 26 November 2025 13:10:01 +0000 (0:00:00.305) 0:04:16.053 **** 2025-11-26 13:10:02.182427 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:03.151176 | controller | 2025-11-26 13:10:03.151209 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2025-11-26 13:10:03.151218 | controller | Wednesday 26 November 2025 13:10:02 +0000 (0:00:00.644) 0:04:16.697 **** 2025-11-26 13:10:03.151228 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:03.193129 | controller | 2025-11-26 13:10:03.193155 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-11-26 13:10:03.193162 | controller | Wednesday 26 November 2025 13:10:03 +0000 (0:00:00.968) 0:04:17.665 **** 2025-11-26 13:10:03.193173 | controller | skipping: [instance] 2025-11-26 13:10:03.235367 | controller | 2025-11-26 13:10:03.235390 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-11-26 13:10:03.235397 | controller | Wednesday 26 November 2025 13:10:03 +0000 (0:00:00.042) 0:04:17.708 **** 2025-11-26 13:10:03.235407 | controller | skipping: [instance] 2025-11-26 13:10:03.271375 | controller | 2025-11-26 13:10:03.271395 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-11-26 13:10:03.271402 | controller | Wednesday 26 November 2025 13:10:03 +0000 (0:00:00.042) 0:04:17.750 **** 2025-11-26 13:10:03.271411 | controller | skipping: [instance] 2025-11-26 13:10:03.320349 | controller | 2025-11-26 13:10:03.320368 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2025-11-26 13:10:03.320375 | controller | Wednesday 26 November 2025 13:10:03 +0000 (0:00:00.036) 0:04:17.786 **** 2025-11-26 13:10:03.320385 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:03.359102 | controller | 2025-11-26 13:10:03.359129 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2025-11-26 13:10:03.359137 | controller | Wednesday 26 November 2025 13:10:03 +0000 (0:00:00.048) 0:04:17.835 **** 2025-11-26 13:10:03.359147 | controller | skipping: [instance] 2025-11-26 13:10:03.395820 | controller | 2025-11-26 13:10:03.395839 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2025-11-26 13:10:03.395847 | controller | Wednesday 26 November 2025 13:10:03 +0000 (0:00:00.038) 0:04:17.874 **** 2025-11-26 13:10:03.395855 | controller | skipping: [instance] 2025-11-26 13:10:03.433807 | controller | 2025-11-26 13:10:03.433829 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2025-11-26 13:10:03.433837 | controller | Wednesday 26 November 2025 13:10:03 +0000 (0:00:00.036) 0:04:17.911 **** 2025-11-26 13:10:03.433846 | controller | skipping: [instance] 2025-11-26 13:10:03.994752 | controller | 2025-11-26 13:10:03.994786 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2025-11-26 13:10:03.994799 | controller | Wednesday 26 November 2025 13:10:03 +0000 (0:00:00.037) 0:04:17.949 **** 2025-11-26 13:10:03.994809 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:04.091574 | controller | 2025-11-26 13:10:04.091604 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2025-11-26 13:10:04.091612 | controller | Wednesday 26 November 2025 13:10:03 +0000 (0:00:00.560) 0:04:18.509 **** 2025-11-26 13:10:04.091629 | controller | skipping: [instance] => (item=secret) 2025-11-26 13:10:05.104549 | controller | skipping: [instance] => (item=configmap) 2025-11-26 13:10:05.104581 | controller | skipping: [instance] => (item=pod) 2025-11-26 13:10:05.104588 | controller | skipping: [instance] => (item=service) 2025-11-26 13:10:05.104594 | controller | skipping: [instance] => (item=route) 2025-11-26 13:10:05.104600 | controller | skipping: [instance] 2025-11-26 13:10:05.104606 | controller | 2025-11-26 13:10:05.104612 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2025-11-26 13:10:05.104635 | controller | Wednesday 26 November 2025 13:10:04 +0000 (0:00:00.096) 0:04:18.606 **** 2025-11-26 13:10:05.104646 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:06.070123 | controller | 2025-11-26 13:10:06.070156 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2025-11-26 13:10:06.070164 | controller | Wednesday 26 November 2025 13:10:05 +0000 (0:00:01.013) 0:04:19.619 **** 2025-11-26 13:10:06.070175 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:06.107624 | controller | 2025-11-26 13:10:06.107655 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2025-11-26 13:10:06.107664 | controller | Wednesday 26 November 2025 13:10:06 +0000 (0:00:00.965) 0:04:20.585 **** 2025-11-26 13:10:06.107674 | controller | skipping: [instance] 2025-11-26 13:10:06.143647 | controller | 2025-11-26 13:10:06.143678 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2025-11-26 13:10:06.143686 | controller | Wednesday 26 November 2025 13:10:06 +0000 (0:00:00.037) 0:04:20.622 **** 2025-11-26 13:10:06.143697 | controller | skipping: [instance] 2025-11-26 13:10:06.143921 | controller | 2025-11-26 13:10:06.143935 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2025-11-26 13:10:06.218318 | controller | Wednesday 26 November 2025 13:10:06 +0000 (0:00:00.036) 0:04:20.658 **** 2025-11-26 13:10:06.218342 | controller | skipping: [instance] => (item=secret) 2025-11-26 13:10:06.256740 | controller | skipping: [instance] => (item=configmap) 2025-11-26 13:10:06.256766 | controller | skipping: [instance] => (item=service) 2025-11-26 13:10:06.256774 | controller | skipping: [instance] => (item=route) 2025-11-26 13:10:06.256780 | controller | skipping: [instance] 2025-11-26 13:10:06.256786 | controller | 2025-11-26 13:10:06.256792 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2025-11-26 13:10:06.256798 | controller | Wednesday 26 November 2025 13:10:06 +0000 (0:00:00.074) 0:04:20.733 **** 2025-11-26 13:10:06.256807 | controller | skipping: [instance] 2025-11-26 13:10:07.714786 | controller | 2025-11-26 13:10:07.714823 | controller | TASK [podman : Ensure podman is installed] ************************************* 2025-11-26 13:10:07.714831 | controller | Wednesday 26 November 2025 13:10:06 +0000 (0:00:00.038) 0:04:20.772 **** 2025-11-26 13:10:07.714842 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:08.456589 | controller | 2025-11-26 13:10:08.456629 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2025-11-26 13:10:08.456638 | controller | Wednesday 26 November 2025 13:10:07 +0000 (0:00:01.457) 0:04:22.229 **** 2025-11-26 13:10:08.456649 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:08.496539 | controller | 2025-11-26 13:10:08.496559 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2025-11-26 13:10:08.496567 | controller | Wednesday 26 November 2025 13:10:08 +0000 (0:00:00.741) 0:04:22.971 **** 2025-11-26 13:10:08.496577 | controller | skipping: [instance] 2025-11-26 13:10:08.534563 | controller | 2025-11-26 13:10:08.534587 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2025-11-26 13:10:08.534595 | controller | Wednesday 26 November 2025 13:10:08 +0000 (0:00:00.040) 0:04:23.012 **** 2025-11-26 13:10:08.534604 | controller | skipping: [instance] 2025-11-26 13:10:08.577755 | controller | 2025-11-26 13:10:08.577779 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2025-11-26 13:10:08.577787 | controller | Wednesday 26 November 2025 13:10:08 +0000 (0:00:00.037) 0:04:23.049 **** 2025-11-26 13:10:08.577797 | controller | skipping: [instance] 2025-11-26 13:10:19.130158 | controller | 2025-11-26 13:10:19.130198 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2025-11-26 13:10:19.130207 | controller | Wednesday 26 November 2025 13:10:08 +0000 (0:00:00.043) 0:04:23.093 **** 2025-11-26 13:10:19.130219 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:19.130240 | controller | 2025-11-26 13:10:19.130248 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2025-11-26 13:10:20.706941 | controller | Wednesday 26 November 2025 13:10:19 +0000 (0:00:10.551) 0:04:33.644 **** 2025-11-26 13:10:20.706992 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:20.707037 | controller | 2025-11-26 13:10:20.707116 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-11-26 13:10:20.707218 | controller | Wednesday 26 November 2025 13:10:20 +0000 (0:00:01.577) 0:04:35.221 **** 2025-11-26 13:10:22.031523 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-11-26 13:10:22.079523 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-11-26 13:10:22.079554 | controller | 2025-11-26 13:10:22.079566 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2025-11-26 13:10:22.079574 | controller | Wednesday 26 November 2025 13:10:22 +0000 (0:00:01.323) 0:04:36.544 **** 2025-11-26 13:10:22.079601 | controller | skipping: [instance] 2025-11-26 13:10:22.718692 | controller | 2025-11-26 13:10:22.718749 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2025-11-26 13:10:22.718758 | controller | Wednesday 26 November 2025 13:10:22 +0000 (0:00:00.049) 0:04:36.594 **** 2025-11-26 13:10:22.718772 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:22.771097 | controller | 2025-11-26 13:10:22.771136 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2025-11-26 13:10:22.771144 | controller | Wednesday 26 November 2025 13:10:22 +0000 (0:00:00.638) 0:04:37.233 **** 2025-11-26 13:10:22.771156 | controller | skipping: [instance] 2025-11-26 13:10:22.820481 | controller | 2025-11-26 13:10:22.820508 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2025-11-26 13:10:22.820516 | controller | Wednesday 26 November 2025 13:10:22 +0000 (0:00:00.053) 0:04:37.286 **** 2025-11-26 13:10:22.820526 | controller | skipping: [instance] 2025-11-26 13:10:22.865278 | controller | 2025-11-26 13:10:22.865307 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-11-26 13:10:22.865318 | controller | Wednesday 26 November 2025 13:10:22 +0000 (0:00:00.049) 0:04:37.335 **** 2025-11-26 13:10:22.865340 | controller | skipping: [instance] 2025-11-26 13:10:22.907412 | controller | 2025-11-26 13:10:22.907435 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-11-26 13:10:22.907443 | controller | Wednesday 26 November 2025 13:10:22 +0000 (0:00:00.044) 0:04:37.380 **** 2025-11-26 13:10:22.907452 | controller | skipping: [instance] 2025-11-26 13:10:23.050781 | controller | 2025-11-26 13:10:23.050805 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2025-11-26 13:10:23.050812 | controller | Wednesday 26 November 2025 13:10:22 +0000 (0:00:00.042) 0:04:37.422 **** 2025-11-26 13:10:23.050823 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': 'a1050c66-ea0f-4e44-be5e-343adcf0221d'}) 2025-11-26 13:10:24.247037 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '334110ea-c103-42f5-9b04-52d86c57a196'}) 2025-11-26 13:10:24.247095 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '7e5036af-7cb9-4c88-a55c-7ec173df84be'}) 2025-11-26 13:10:24.247103 | controller | 2025-11-26 13:10:24.247109 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2025-11-26 13:10:24.247115 | controller | Wednesday 26 November 2025 13:10:23 +0000 (0:00:00.143) 0:04:37.565 **** 2025-11-26 13:10:24.247128 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:24.294332 | controller | 2025-11-26 13:10:24.294374 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2025-11-26 13:10:24.294381 | controller | Wednesday 26 November 2025 13:10:24 +0000 (0:00:01.195) 0:04:38.761 **** 2025-11-26 13:10:24.294393 | controller | skipping: [instance] 2025-11-26 13:10:24.430394 | controller | 2025-11-26 13:10:24.430456 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2025-11-26 13:10:24.430468 | controller | Wednesday 26 November 2025 13:10:24 +0000 (0:00:00.047) 0:04:38.809 **** 2025-11-26 13:10:24.430484 | controller | 2025-11-26 13:10:24.487064 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2025-11-26 13:10:24.487082 | controller | Wednesday 26 November 2025 13:10:24 +0000 (0:00:00.135) 0:04:38.945 **** 2025-11-26 13:10:24.487093 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:24.533739 | controller | 2025-11-26 13:10:24.533843 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-11-26 13:10:24.533853 | controller | Wednesday 26 November 2025 13:10:24 +0000 (0:00:00.057) 0:04:39.002 **** 2025-11-26 13:10:24.533942 | controller | skipping: [instance] 2025-11-26 13:10:24.577460 | controller | 2025-11-26 13:10:24.577485 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-11-26 13:10:24.577496 | controller | Wednesday 26 November 2025 13:10:24 +0000 (0:00:00.046) 0:04:39.049 **** 2025-11-26 13:10:24.577508 | controller | skipping: [instance] 2025-11-26 13:10:26.051203 | controller | 2025-11-26 13:10:26.051256 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2025-11-26 13:10:26.051265 | controller | Wednesday 26 November 2025 13:10:24 +0000 (0:00:00.043) 0:04:39.092 **** 2025-11-26 13:10:26.051279 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:31.342298 | controller | 2025-11-26 13:10:31.342340 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2025-11-26 13:10:31.342349 | controller | Wednesday 26 November 2025 13:10:26 +0000 (0:00:01.473) 0:04:40.565 **** 2025-11-26 13:10:31.342361 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=a1050c66-ea0f-4e44-be5e-343adcf0221d) 2025-11-26 13:10:31.453824 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=334110ea-c103-42f5-9b04-52d86c57a196) 2025-11-26 13:10:31.453865 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=7e5036af-7cb9-4c88-a55c-7ec173df84be) 2025-11-26 13:10:31.453881 | controller | 2025-11-26 13:10:31.453887 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2025-11-26 13:10:31.453893 | controller | Wednesday 26 November 2025 13:10:31 +0000 (0:00:05.289) 0:04:45.855 **** 2025-11-26 13:10:31.453905 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2025-11-26 13:10:31.686147 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2025-11-26 13:10:31.686185 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2025-11-26 13:10:31.686193 | controller | 2025-11-26 13:10:31.686200 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2025-11-26 13:10:31.686211 | controller | Wednesday 26 November 2025 13:10:31 +0000 (0:00:00.113) 0:04:45.968 **** 2025-11-26 13:10:31.686222 | controller | ok: [instance -> localhost] 2025-11-26 13:10:34.105029 | controller | 2025-11-26 13:10:34.105067 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2025-11-26 13:10:34.105076 | controller | Wednesday 26 November 2025 13:10:31 +0000 (0:00:00.232) 0:04:46.200 **** 2025-11-26 13:10:34.105087 | controller | changed: [instance -> localhost] => (item=controller-0) 2025-11-26 13:10:34.844746 | controller | 2025-11-26 13:10:34.844787 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2025-11-26 13:10:34.844798 | controller | Wednesday 26 November 2025 13:10:34 +0000 (0:00:02.418) 0:04:48.619 **** 2025-11-26 13:10:34.844813 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:35.645159 | controller | 2025-11-26 13:10:35.645212 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2025-11-26 13:10:35.645221 | controller | Wednesday 26 November 2025 13:10:34 +0000 (0:00:00.739) 0:04:49.359 **** 2025-11-26 13:10:35.645232 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:36.791294 | controller | 2025-11-26 13:10:36.791329 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2025-11-26 13:10:36.791337 | controller | Wednesday 26 November 2025 13:10:35 +0000 (0:00:00.800) 0:04:50.159 **** 2025-11-26 13:10:36.791350 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:37.462729 | controller | 2025-11-26 13:10:37.462762 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2025-11-26 13:10:37.462771 | controller | Wednesday 26 November 2025 13:10:36 +0000 (0:00:01.146) 0:04:51.305 **** 2025-11-26 13:10:37.462782 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:38.567095 | controller | 2025-11-26 13:10:38.567129 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2025-11-26 13:10:38.567137 | controller | Wednesday 26 November 2025 13:10:37 +0000 (0:00:00.671) 0:04:51.977 **** 2025-11-26 13:10:38.567148 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:39.203510 | controller | 2025-11-26 13:10:39.203545 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2025-11-26 13:10:39.203554 | controller | Wednesday 26 November 2025 13:10:38 +0000 (0:00:01.104) 0:04:53.082 **** 2025-11-26 13:10:39.203575 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:39.929929 | controller | 2025-11-26 13:10:39.929965 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2025-11-26 13:10:39.929973 | controller | Wednesday 26 November 2025 13:10:39 +0000 (0:00:00.636) 0:04:53.718 **** 2025-11-26 13:10:39.929983 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:41.403033 | controller | 2025-11-26 13:10:41.403070 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2025-11-26 13:10:41.403080 | controller | Wednesday 26 November 2025 13:10:39 +0000 (0:00:00.726) 0:04:54.444 **** 2025-11-26 13:10:41.403092 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-11-26 13:10:41.403194 | controller | 2025-11-26 13:10:41.403206 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-11-26 13:10:41.446599 | controller | Wednesday 26 November 2025 13:10:41 +0000 (0:00:01.473) 0:04:55.917 **** 2025-11-26 13:10:41.446653 | controller | skipping: [instance] 2025-11-26 13:10:41.491348 | controller | 2025-11-26 13:10:41.491389 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-11-26 13:10:41.491402 | controller | Wednesday 26 November 2025 13:10:41 +0000 (0:00:00.043) 0:04:55.961 **** 2025-11-26 13:10:41.491416 | controller | skipping: [instance] 2025-11-26 13:10:41.538441 | controller | 2025-11-26 13:10:41.538466 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-11-26 13:10:41.538477 | controller | Wednesday 26 November 2025 13:10:41 +0000 (0:00:00.044) 0:04:56.006 **** 2025-11-26 13:10:41.538489 | controller | skipping: [instance] 2025-11-26 13:10:41.538666 | controller | 2025-11-26 13:10:41.539112 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-11-26 13:10:41.584970 | controller | Wednesday 26 November 2025 13:10:41 +0000 (0:00:00.047) 0:04:56.054 **** 2025-11-26 13:10:41.584994 | controller | skipping: [instance] 2025-11-26 13:10:41.629776 | controller | 2025-11-26 13:10:41.629799 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-11-26 13:10:41.629808 | controller | Wednesday 26 November 2025 13:10:41 +0000 (0:00:00.046) 0:04:56.100 **** 2025-11-26 13:10:41.629817 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:41.745297 | controller | 2025-11-26 13:10:41.745331 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-11-26 13:10:41.745339 | controller | Wednesday 26 November 2025 13:10:41 +0000 (0:00:00.044) 0:04:56.144 **** 2025-11-26 13:10:41.745360 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-11-26 13:10:41.745550 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2025-11-26 13:10:41.745574 | controller | 2025-11-26 13:10:41.745586 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-11-26 13:10:41.745595 | controller | Wednesday 26 November 2025 13:10:41 +0000 (0:00:00.115) 0:04:56.260 **** 2025-11-26 13:10:41.800064 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2025-11-26 13:10:45.686095 | controller | 2025-11-26 13:10:45.686138 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2025-11-26 13:10:45.686148 | controller | Wednesday 26 November 2025 13:10:41 +0000 (0:00:00.055) 0:04:56.315 **** 2025-11-26 13:10:45.686159 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-11-26 13:10:46.795218 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2025-11-26 13:10:46.795254 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-11-26 13:10:46.795262 | controller | 2025-11-26 13:10:46.795268 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2025-11-26 13:10:46.795274 | controller | Wednesday 26 November 2025 13:10:45 +0000 (0:00:03.885) 0:05:00.200 **** 2025-11-26 13:10:46.795309 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:47.323189 | controller | 2025-11-26 13:10:47.323224 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-11-26 13:10:47.323233 | controller | Wednesday 26 November 2025 13:10:46 +0000 (0:00:01.109) 0:05:01.310 **** 2025-11-26 13:10:47.323243 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:48.291433 | controller | 2025-11-26 13:10:48.291464 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-11-26 13:10:48.291472 | controller | Wednesday 26 November 2025 13:10:47 +0000 (0:00:00.527) 0:05:01.838 **** 2025-11-26 13:10:48.291482 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:48.384477 | controller | 2025-11-26 13:10:48.384497 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-11-26 13:10:48.384505 | controller | Wednesday 26 November 2025 13:10:48 +0000 (0:00:00.968) 0:05:02.806 **** 2025-11-26 13:10:48.384514 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:48.450370 | controller | 2025-11-26 13:10:48.450389 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-11-26 13:10:48.450397 | controller | Wednesday 26 November 2025 13:10:48 +0000 (0:00:00.093) 0:05:02.899 **** 2025-11-26 13:10:48.450405 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:49.545974 | controller | 2025-11-26 13:10:49.546022 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-11-26 13:10:49.546033 | controller | Wednesday 26 November 2025 13:10:48 +0000 (0:00:00.065) 0:05:02.965 **** 2025-11-26 13:10:49.546045 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:50.462672 | controller | 2025-11-26 13:10:50.462705 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2025-11-26 13:10:50.462713 | controller | Wednesday 26 November 2025 13:10:49 +0000 (0:00:01.095) 0:05:04.060 **** 2025-11-26 13:10:50.462724 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:56.710308 | controller | 2025-11-26 13:10:56.710366 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2025-11-26 13:10:56.710375 | controller | Wednesday 26 November 2025 13:10:50 +0000 (0:00:00.916) 0:05:04.977 **** 2025-11-26 13:10:56.710388 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2025-11-26 13:10:56.910534 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:56.910573 | controller | 2025-11-26 13:10:56.910582 | controller | TASK [Configure ntp service] *************************************************** 2025-11-26 13:10:56.910588 | controller | Wednesday 26 November 2025 13:10:56 +0000 (0:00:06.247) 0:05:11.224 **** 2025-11-26 13:10:56.910600 | controller | 2025-11-26 13:10:58.006282 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2025-11-26 13:10:58.006324 | controller | Wednesday 26 November 2025 13:10:56 +0000 (0:00:00.200) 0:05:11.425 **** 2025-11-26 13:10:58.006338 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:10:58.989463 | controller | 2025-11-26 13:10:58.989499 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2025-11-26 13:10:58.989507 | controller | Wednesday 26 November 2025 13:10:58 +0000 (0:00:01.095) 0:05:12.520 **** 2025-11-26 13:10:58.989528 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2025-11-26 13:10:59.915023 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2025-11-26 13:10:59.915059 | controller | 2025-11-26 13:10:59.915066 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2025-11-26 13:10:59.915073 | controller | Wednesday 26 November 2025 13:10:58 +0000 (0:00:00.983) 0:05:13.504 **** 2025-11-26 13:10:59.915084 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:00.523330 | controller | 2025-11-26 13:11:00.523366 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2025-11-26 13:11:00.523374 | controller | Wednesday 26 November 2025 13:10:59 +0000 (0:00:00.925) 0:05:14.429 **** 2025-11-26 13:11:00.523385 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:00.523748 | controller | 2025-11-26 13:11:00.668622 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2025-11-26 13:11:00.668665 | controller | Wednesday 26 November 2025 13:11:00 +0000 (0:00:00.608) 0:05:15.037 **** 2025-11-26 13:11:00.668679 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2025-11-26 13:11:01.125825 | controller | 2025-11-26 13:11:01.125860 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2025-11-26 13:11:01.125868 | controller | Wednesday 26 November 2025 13:11:00 +0000 (0:00:00.145) 0:05:15.183 **** 2025-11-26 13:11:01.125880 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:01.638069 | controller | 2025-11-26 13:11:01.638113 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2025-11-26 13:11:01.638121 | controller | Wednesday 26 November 2025 13:11:01 +0000 (0:00:00.457) 0:05:15.640 **** 2025-11-26 13:11:01.638133 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-11-26 13:11:02.261538 | controller | 2025-11-26 13:11:02.261575 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2025-11-26 13:11:02.261584 | controller | Wednesday 26 November 2025 13:11:01 +0000 (0:00:00.511) 0:05:16.152 **** 2025-11-26 13:11:02.261596 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-11-26 13:11:02.820924 | controller | 2025-11-26 13:11:02.820973 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2025-11-26 13:11:02.820982 | controller | Wednesday 26 November 2025 13:11:02 +0000 (0:00:00.623) 0:05:16.776 **** 2025-11-26 13:11:02.820994 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-11-26 13:11:02.869340 | controller | 2025-11-26 13:11:02.869377 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2025-11-26 13:11:02.869388 | controller | Wednesday 26 November 2025 13:11:02 +0000 (0:00:00.558) 0:05:17.334 **** 2025-11-26 13:11:02.869401 | controller | 2025-11-26 13:11:03.355535 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2025-11-26 13:11:03.355571 | controller | Wednesday 26 November 2025 13:11:02 +0000 (0:00:00.049) 0:05:17.384 **** 2025-11-26 13:11:03.355583 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-11-26 13:11:04.099248 | controller | 2025-11-26 13:11:04.099285 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2025-11-26 13:11:04.099294 | controller | Wednesday 26 November 2025 13:11:03 +0000 (0:00:00.485) 0:05:17.870 **** 2025-11-26 13:11:04.099305 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-11-26 13:11:04.130452 | controller | 2025-11-26 13:11:04.130494 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2025-11-26 13:11:04.130503 | controller | Wednesday 26 November 2025 13:11:04 +0000 (0:00:00.743) 0:05:18.614 **** 2025-11-26 13:11:04.130526 | controller | skipping: [instance] 2025-11-26 13:11:04.170431 | controller | 2025-11-26 13:11:04.170461 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2025-11-26 13:11:04.170470 | controller | Wednesday 26 November 2025 13:11:04 +0000 (0:00:00.031) 0:05:18.645 **** 2025-11-26 13:11:04.170481 | controller | skipping: [instance] 2025-11-26 13:11:04.417743 | controller | 2025-11-26 13:11:04.417789 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2025-11-26 13:11:04.417798 | controller | Wednesday 26 November 2025 13:11:04 +0000 (0:00:00.040) 0:05:18.685 **** 2025-11-26 13:11:04.417808 | controller | changed: [instance] 2025-11-26 13:11:04.489401 | controller | 2025-11-26 13:11:04.489434 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2025-11-26 13:11:04.489445 | controller | Wednesday 26 November 2025 13:11:04 +0000 (0:00:00.245) 0:05:18.931 **** 2025-11-26 13:11:04.489457 | controller | skipping: [instance] => (item=) 2025-11-26 13:11:04.526150 | controller | 2025-11-26 13:11:04.526176 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2025-11-26 13:11:04.526183 | controller | Wednesday 26 November 2025 13:11:04 +0000 (0:00:00.073) 0:05:19.004 **** 2025-11-26 13:11:04.526193 | controller | ok: [instance] 2025-11-26 13:11:04.602515 | controller | 2025-11-26 13:11:04.602545 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-11-26 13:11:04.602555 | controller | Wednesday 26 November 2025 13:11:04 +0000 (0:00:00.036) 0:05:19.041 **** 2025-11-26 13:11:04.602568 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-11-26 13:11:04.852949 | controller | 2025-11-26 13:11:04.852985 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-11-26 13:11:04.852993 | controller | Wednesday 26 November 2025 13:11:04 +0000 (0:00:00.076) 0:05:19.117 **** 2025-11-26 13:11:04.853004 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-11-26 13:11:04.898631 | controller | 2025-11-26 13:11:04.898658 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2025-11-26 13:11:04.898667 | controller | Wednesday 26 November 2025 13:11:04 +0000 (0:00:00.250) 0:05:19.367 **** 2025-11-26 13:11:04.898682 | controller | 2025-11-26 13:11:04.962249 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-11-26 13:11:04.962275 | controller | Wednesday 26 November 2025 13:11:04 +0000 (0:00:00.046) 0:05:19.414 **** 2025-11-26 13:11:04.962286 | controller | ok: [instance] 2025-11-26 13:11:05.022439 | controller | 2025-11-26 13:11:05.022458 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-11-26 13:11:05.022466 | controller | Wednesday 26 November 2025 13:11:04 +0000 (0:00:00.063) 0:05:19.477 **** 2025-11-26 13:11:05.022475 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-11-26 13:11:05.299900 | controller | 2025-11-26 13:11:05.299953 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-11-26 13:11:05.299963 | controller | Wednesday 26 November 2025 13:11:05 +0000 (0:00:00.060) 0:05:19.537 **** 2025-11-26 13:11:05.299974 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-11-26 13:11:05.702962 | controller | 2025-11-26 13:11:05.703000 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2025-11-26 13:11:05.703023 | controller | Wednesday 26 November 2025 13:11:05 +0000 (0:00:00.276) 0:05:19.814 **** 2025-11-26 13:11:05.703038 | controller | changed: [instance] 2025-11-26 13:11:05.703120 | controller | 2025-11-26 13:11:05.703129 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-11-26 13:11:05.703135 | controller | Wednesday 26 November 2025 13:11:05 +0000 (0:00:00.389) 0:05:20.204 **** 2025-11-26 13:11:05.703147 | controller | 2025-11-26 13:11:05.703153 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2025-11-26 13:11:05.703161 | controller | Wednesday 26 November 2025 13:11:05 +0000 (0:00:00.012) 0:05:20.217 **** 2025-11-26 13:11:06.416932 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:06.822212 | controller | 2025-11-26 13:11:06.822262 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-11-26 13:11:06.822277 | controller | Wednesday 26 November 2025 13:11:06 +0000 (0:00:00.713) 0:05:20.930 **** 2025-11-26 13:11:06.822295 | controller | changed: [instance] 2025-11-26 13:11:06.822328 | controller | 2025-11-26 13:11:06.822339 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2025-11-26 13:11:06.822352 | controller | Wednesday 26 November 2025 13:11:06 +0000 (0:00:00.406) 0:05:21.336 **** 2025-11-26 13:11:07.004728 | controller | skipping: [instance] => (item=controller-0) 2025-11-26 13:11:07.004817 | controller | skipping: [instance] => (item=crc-0) 2025-11-26 13:11:07.004978 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2025-11-26 13:11:07.005269 | controller | 2025-11-26 13:11:07.005315 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2025-11-26 13:11:07.005328 | controller | Wednesday 26 November 2025 13:11:07 +0000 (0:00:00.183) 0:05:21.520 **** 2025-11-26 13:11:08.538179 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-11-26 13:11:08.538322 | controller | 2025-11-26 13:11:08.538639 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-11-26 13:11:08.560893 | controller | Wednesday 26 November 2025 13:11:08 +0000 (0:00:01.533) 0:05:23.053 **** 2025-11-26 13:11:08.560915 | controller | skipping: [instance] 2025-11-26 13:11:09.095926 | controller | 2025-11-26 13:11:09.095989 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-11-26 13:11:09.096001 | controller | Wednesday 26 November 2025 13:11:08 +0000 (0:00:00.022) 0:05:23.076 **** 2025-11-26 13:11:09.096041 | controller | ok: [instance -> compute-0(compute-0.instance)] 2025-11-26 13:11:09.096113 | controller | 2025-11-26 13:11:09.096135 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-11-26 13:11:09.096150 | controller | Wednesday 26 November 2025 13:11:09 +0000 (0:00:00.534) 0:05:23.610 **** 2025-11-26 13:11:09.141692 | controller | skipping: [instance] 2025-11-26 13:11:09.142231 | controller | 2025-11-26 13:11:09.183070 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-11-26 13:11:09.183098 | controller | Wednesday 26 November 2025 13:11:09 +0000 (0:00:00.046) 0:05:23.656 **** 2025-11-26 13:11:09.183113 | controller | skipping: [instance] 2025-11-26 13:11:09.183182 | controller | 2025-11-26 13:11:09.183287 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-11-26 13:11:09.183390 | controller | Wednesday 26 November 2025 13:11:09 +0000 (0:00:00.041) 0:05:23.698 **** 2025-11-26 13:11:09.223152 | controller | skipping: [instance] 2025-11-26 13:11:09.223263 | controller | 2025-11-26 13:11:09.223415 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-11-26 13:11:09.223572 | controller | Wednesday 26 November 2025 13:11:09 +0000 (0:00:00.040) 0:05:23.738 **** 2025-11-26 13:11:10.822331 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-11-26 13:11:10.822385 | controller | 2025-11-26 13:11:10.822467 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2025-11-26 13:11:10.822577 | controller | Wednesday 26 November 2025 13:11:10 +0000 (0:00:01.598) 0:05:25.336 **** 2025-11-26 13:11:10.862610 | controller | skipping: [instance] 2025-11-26 13:11:10.862683 | controller | 2025-11-26 13:11:10.862787 | controller | TASK [reproducer : Create repositories on computes] **************************** 2025-11-26 13:11:10.862889 | controller | Wednesday 26 November 2025 13:11:10 +0000 (0:00:00.041) 0:05:25.378 **** 2025-11-26 13:11:10.883125 | controller | skipping: [instance] 2025-11-26 13:11:10.883206 | controller | 2025-11-26 13:11:10.883304 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2025-11-26 13:11:10.883401 | controller | Wednesday 26 November 2025 13:11:10 +0000 (0:00:00.020) 0:05:25.398 **** 2025-11-26 13:11:10.912350 | controller | skipping: [instance] 2025-11-26 13:11:10.912521 | controller | 2025-11-26 13:11:10.912626 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2025-11-26 13:11:10.912762 | controller | Wednesday 26 November 2025 13:11:10 +0000 (0:00:00.029) 0:05:25.428 **** 2025-11-26 13:11:10.969955 | controller | ok: [instance] 2025-11-26 13:11:10.970058 | controller | 2025-11-26 13:11:10.970232 | controller | TASK [reproducer : Push local code] ******************************************** 2025-11-26 13:11:10.970336 | controller | Wednesday 26 November 2025 13:11:10 +0000 (0:00:00.057) 0:05:25.485 **** 2025-11-26 13:11:11.064475 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2025-11-26 13:11:11.064560 | controller | 2025-11-26 13:11:11.064676 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2025-11-26 13:11:11.064777 | controller | Wednesday 26 November 2025 13:11:11 +0000 (0:00:00.094) 0:05:25.579 **** 2025-11-26 13:11:11.104158 | controller | skipping: [instance] 2025-11-26 13:11:11.104244 | controller | 2025-11-26 13:11:11.104347 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2025-11-26 13:11:11.104449 | controller | Wednesday 26 November 2025 13:11:11 +0000 (0:00:00.039) 0:05:25.619 **** 2025-11-26 13:11:11.156891 | controller | skipping: [instance] 2025-11-26 13:11:11.156980 | controller | 2025-11-26 13:11:11.157108 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2025-11-26 13:11:11.157222 | controller | Wednesday 26 November 2025 13:11:11 +0000 (0:00:00.052) 0:05:25.672 **** 2025-11-26 13:11:11.201694 | controller | skipping: [instance] 2025-11-26 13:11:11.201815 | controller | 2025-11-26 13:11:11.202029 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2025-11-26 13:11:11.202161 | controller | Wednesday 26 November 2025 13:11:11 +0000 (0:00:00.044) 0:05:25.716 **** 2025-11-26 13:11:11.250197 | controller | skipping: [instance] 2025-11-26 13:11:11.250259 | controller | 2025-11-26 13:11:11.250360 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2025-11-26 13:11:11.250459 | controller | Wednesday 26 November 2025 13:11:11 +0000 (0:00:00.048) 0:05:25.765 **** 2025-11-26 13:11:11.289726 | controller | skipping: [instance] 2025-11-26 13:11:11.289807 | controller | 2025-11-26 13:11:11.289918 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2025-11-26 13:11:11.290029 | controller | Wednesday 26 November 2025 13:11:11 +0000 (0:00:00.039) 0:05:25.805 **** 2025-11-26 13:11:11.756207 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2025-11-26 13:11:11.756353 | controller | 2025-11-26 13:11:11.756372 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2025-11-26 13:11:11.757074 | controller | Wednesday 26 November 2025 13:11:11 +0000 (0:00:00.466) 0:05:26.271 **** 2025-11-26 13:11:12.335612 | controller | ok: [instance -> localhost] => (item=ci-framework) 2025-11-26 13:11:12.335932 | controller | 2025-11-26 13:11:12.382282 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2025-11-26 13:11:12.382300 | controller | Wednesday 26 November 2025 13:11:12 +0000 (0:00:00.579) 0:05:26.850 **** 2025-11-26 13:11:12.382309 | controller | skipping: [instance] => (item=ci-framework) 2025-11-26 13:11:12.382415 | controller | skipping: [instance] 2025-11-26 13:11:12.382553 | controller | 2025-11-26 13:11:12.382690 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2025-11-26 13:11:12.382824 | controller | Wednesday 26 November 2025 13:11:12 +0000 (0:00:00.047) 0:05:26.897 **** 2025-11-26 13:11:12.465121 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2025-11-26 13:11:12.465331 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2025-11-26 13:11:12.465532 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2025-11-26 13:11:12.465709 | controller | 2025-11-26 13:11:12.465899 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2025-11-26 13:11:12.466107 | controller | Wednesday 26 November 2025 13:11:12 +0000 (0:00:00.082) 0:05:26.980 **** 2025-11-26 13:11:12.956835 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:12.956905 | controller | 2025-11-26 13:11:12.957039 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2025-11-26 13:11:12.957172 | controller | Wednesday 26 November 2025 13:11:12 +0000 (0:00:00.491) 0:05:27.472 **** 2025-11-26 13:11:12.997928 | controller | skipping: [instance] 2025-11-26 13:11:12.998041 | controller | 2025-11-26 13:11:12.998160 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2025-11-26 13:11:12.998264 | controller | Wednesday 26 November 2025 13:11:12 +0000 (0:00:00.041) 0:05:27.513 **** 2025-11-26 13:11:13.547497 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:13.547553 | controller | 2025-11-26 13:11:13.547649 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2025-11-26 13:11:13.547750 | controller | Wednesday 26 November 2025 13:11:13 +0000 (0:00:00.549) 0:05:28.062 **** 2025-11-26 13:11:13.588178 | controller | skipping: [instance] 2025-11-26 13:11:13.588269 | controller | 2025-11-26 13:11:13.588377 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2025-11-26 13:11:13.588480 | controller | Wednesday 26 November 2025 13:11:13 +0000 (0:00:00.041) 0:05:28.103 **** 2025-11-26 13:11:14.031067 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:14.031130 | controller | 2025-11-26 13:11:14.031243 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2025-11-26 13:11:14.031349 | controller | Wednesday 26 November 2025 13:11:14 +0000 (0:00:00.442) 0:05:28.546 **** 2025-11-26 13:11:16.192938 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:35.464786 | controller | 2025-11-26 13:11:35.464838 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2025-11-26 13:11:35.464847 | controller | Wednesday 26 November 2025 13:11:16 +0000 (0:00:02.161) 0:05:30.707 **** 2025-11-26 13:11:35.464858 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:35.464961 | controller | 2025-11-26 13:11:35.464974 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2025-11-26 13:11:36.571046 | controller | Wednesday 26 November 2025 13:11:35 +0000 (0:00:19.272) 0:05:49.979 **** 2025-11-26 13:11:36.571088 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:36.571157 | controller | 2025-11-26 13:11:36.571324 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2025-11-26 13:11:36.680152 | controller | Wednesday 26 November 2025 13:11:36 +0000 (0:00:01.105) 0:05:51.085 **** 2025-11-26 13:11:36.680189 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2025-11-26 13:11:36.680217 | controller | 2025-11-26 13:11:36.680224 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2025-11-26 13:11:36.680231 | controller | Wednesday 26 November 2025 13:11:36 +0000 (0:00:00.109) 0:05:51.195 **** 2025-11-26 13:11:37.173249 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:37.173621 | controller | 2025-11-26 13:11:37.231384 | controller | TASK [reproducer : Rotate log if present] ************************************** 2025-11-26 13:11:37.231419 | controller | Wednesday 26 November 2025 13:11:37 +0000 (0:00:00.492) 0:05:51.688 **** 2025-11-26 13:11:37.231432 | controller | skipping: [instance] 2025-11-26 13:11:37.291127 | controller | 2025-11-26 13:11:37.291158 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2025-11-26 13:11:37.291176 | controller | Wednesday 26 November 2025 13:11:37 +0000 (0:00:00.052) 0:05:51.740 **** 2025-11-26 13:11:37.291187 | controller | skipping: [instance] 2025-11-26 13:11:37.397154 | controller | 2025-11-26 13:11:37.397205 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2025-11-26 13:11:37.397215 | controller | Wednesday 26 November 2025 13:11:37 +0000 (0:00:00.065) 0:05:51.806 **** 2025-11-26 13:11:37.397230 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:37.397361 | controller | 2025-11-26 13:11:37.397380 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-11-26 13:11:37.397472 | controller | Wednesday 26 November 2025 13:11:37 +0000 (0:00:00.106) 0:05:51.912 **** 2025-11-26 13:11:37.938892 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:37.938939 | controller | 2025-11-26 13:11:37.939097 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-11-26 13:11:37.939207 | controller | Wednesday 26 November 2025 13:11:37 +0000 (0:00:00.541) 0:05:52.453 **** 2025-11-26 13:11:37.990040 | controller | skipping: [instance] 2025-11-26 13:11:37.990133 | controller | 2025-11-26 13:11:37.990252 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-11-26 13:11:37.990350 | controller | Wednesday 26 November 2025 13:11:37 +0000 (0:00:00.051) 0:05:52.505 **** 2025-11-26 13:11:38.041360 | controller | skipping: [instance] 2025-11-26 13:11:38.041437 | controller | 2025-11-26 13:11:38.041555 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-11-26 13:11:38.041666 | controller | Wednesday 26 November 2025 13:11:38 +0000 (0:00:00.051) 0:05:52.556 **** 2025-11-26 13:11:38.089936 | controller | skipping: [instance] 2025-11-26 13:11:38.089997 | controller | 2025-11-26 13:11:38.090150 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-11-26 13:11:38.090243 | controller | Wednesday 26 November 2025 13:11:38 +0000 (0:00:00.048) 0:05:52.605 **** 2025-11-26 13:11:39.656837 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:39.656923 | controller | 2025-11-26 13:11:39.657041 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-11-26 13:11:39.657167 | controller | Wednesday 26 November 2025 13:11:39 +0000 (0:00:01.565) 0:05:54.171 **** 2025-11-26 13:11:41.057369 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 13:11:41.057480 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 13:11:41.057588 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 13:11:41.057708 | controller | changed: [instance -> controller-0] 2025-11-26 13:11:41.057811 | controller | 2025-11-26 13:11:41.057912 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-11-26 13:11:41.058032 | controller | Wednesday 26 November 2025 13:11:41 +0000 (0:00:01.401) 0:05:55.572 **** 2025-11-26 13:11:42.004891 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:42.004945 | controller | 2025-11-26 13:11:42.005059 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-11-26 13:11:42.005168 | controller | Wednesday 26 November 2025 13:11:42 +0000 (0:00:00.947) 0:05:56.520 **** 2025-11-26 13:11:43.298721 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:43.298774 | controller | 2025-11-26 13:11:43.298896 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-11-26 13:11:43.299019 | controller | Wednesday 26 November 2025 13:11:43 +0000 (0:00:01.293) 0:05:57.814 **** 2025-11-26 13:11:51.200051 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:51.200417 | controller | 2025-11-26 13:11:52.211604 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-11-26 13:11:52.211633 | controller | Wednesday 26 November 2025 13:11:51 +0000 (0:00:07.900) 0:06:05.715 **** 2025-11-26 13:11:52.211644 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:52.264281 | controller | 2025-11-26 13:11:52.264303 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-11-26 13:11:52.264316 | controller | Wednesday 26 November 2025 13:11:52 +0000 (0:00:01.011) 0:06:06.726 **** 2025-11-26 13:11:52.264325 | controller | skipping: [instance] 2025-11-26 13:11:53.502986 | controller | 2025-11-26 13:11:53.503063 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-11-26 13:11:53.503072 | controller | Wednesday 26 November 2025 13:11:52 +0000 (0:00:00.052) 0:06:06.779 **** 2025-11-26 13:11:53.503085 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:53.561789 | controller | 2025-11-26 13:11:53.561840 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-11-26 13:11:53.561848 | controller | Wednesday 26 November 2025 13:11:53 +0000 (0:00:01.237) 0:06:08.017 **** 2025-11-26 13:11:53.561862 | controller | skipping: [instance] 2025-11-26 13:11:53.623122 | controller | 2025-11-26 13:11:53.623172 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-11-26 13:11:53.623181 | controller | Wednesday 26 November 2025 13:11:53 +0000 (0:00:00.059) 0:06:08.076 **** 2025-11-26 13:11:53.623193 | controller | skipping: [instance] 2025-11-26 13:11:53.698362 | controller | 2025-11-26 13:11:53.698389 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-11-26 13:11:53.698397 | controller | Wednesday 26 November 2025 13:11:53 +0000 (0:00:00.061) 0:06:08.137 **** 2025-11-26 13:11:53.698408 | controller | skipping: [instance] 2025-11-26 13:11:53.698466 | controller | 2025-11-26 13:11:53.698601 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-11-26 13:11:53.698699 | controller | Wednesday 26 November 2025 13:11:53 +0000 (0:00:00.075) 0:06:08.213 **** 2025-11-26 13:11:54.626777 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:55.651867 | controller | 2025-11-26 13:11:55.651932 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-11-26 13:11:55.651942 | controller | Wednesday 26 November 2025 13:11:54 +0000 (0:00:00.927) 0:06:09.140 **** 2025-11-26 13:11:55.651956 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:55.693290 | controller | 2025-11-26 13:11:55.693325 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-11-26 13:11:55.693333 | controller | Wednesday 26 November 2025 13:11:55 +0000 (0:00:01.025) 0:06:10.166 **** 2025-11-26 13:11:55.693344 | controller | skipping: [instance] 2025-11-26 13:11:55.743543 | controller | 2025-11-26 13:11:55.743595 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-11-26 13:11:55.743603 | controller | Wednesday 26 November 2025 13:11:55 +0000 (0:00:00.042) 0:06:10.208 **** 2025-11-26 13:11:55.743641 | controller | skipping: [instance] 2025-11-26 13:11:55.789943 | controller | 2025-11-26 13:11:55.789970 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-11-26 13:11:55.789978 | controller | Wednesday 26 November 2025 13:11:55 +0000 (0:00:00.049) 0:06:10.258 **** 2025-11-26 13:11:55.789988 | controller | skipping: [instance] 2025-11-26 13:11:55.790043 | controller | 2025-11-26 13:11:55.790052 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-11-26 13:11:55.790084 | controller | Wednesday 26 November 2025 13:11:55 +0000 (0:00:00.046) 0:06:10.305 **** 2025-11-26 13:11:55.850789 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:55.851151 | controller | 2025-11-26 13:11:55.902415 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-11-26 13:11:55.902483 | controller | Wednesday 26 November 2025 13:11:55 +0000 (0:00:00.060) 0:06:10.365 **** 2025-11-26 13:11:55.902512 | controller | skipping: [instance] 2025-11-26 13:11:55.946717 | controller | 2025-11-26 13:11:55.946750 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-11-26 13:11:55.946760 | controller | Wednesday 26 November 2025 13:11:55 +0000 (0:00:00.051) 0:06:10.417 **** 2025-11-26 13:11:55.946790 | controller | skipping: [instance] 2025-11-26 13:11:55.992464 | controller | 2025-11-26 13:11:55.992514 | controller | TASK [Download the RPM] ******************************************************** 2025-11-26 13:11:55.992530 | controller | Wednesday 26 November 2025 13:11:55 +0000 (0:00:00.044) 0:06:10.461 **** 2025-11-26 13:11:55.992542 | controller | skipping: [instance] 2025-11-26 13:11:55.992587 | controller | 2025-11-26 13:11:55.992741 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-11-26 13:11:55.992896 | controller | Wednesday 26 November 2025 13:11:55 +0000 (0:00:00.045) 0:06:10.507 **** 2025-11-26 13:11:56.037585 | controller | skipping: [instance] 2025-11-26 13:11:56.037803 | controller | 2025-11-26 13:11:56.037966 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-11-26 13:11:56.038134 | controller | Wednesday 26 November 2025 13:11:56 +0000 (0:00:00.045) 0:06:10.552 **** 2025-11-26 13:11:56.078644 | controller | skipping: [instance] 2025-11-26 13:11:56.118064 | controller | 2025-11-26 13:11:56.118105 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-11-26 13:11:56.118114 | controller | Wednesday 26 November 2025 13:11:56 +0000 (0:00:00.041) 0:06:10.593 **** 2025-11-26 13:11:56.118124 | controller | skipping: [instance] 2025-11-26 13:11:56.162420 | controller | 2025-11-26 13:11:56.162461 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-11-26 13:11:56.162470 | controller | Wednesday 26 November 2025 13:11:56 +0000 (0:00:00.038) 0:06:10.632 **** 2025-11-26 13:11:56.162481 | controller | skipping: [instance] 2025-11-26 13:11:56.647534 | controller | 2025-11-26 13:11:56.647601 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-11-26 13:11:56.647611 | controller | Wednesday 26 November 2025 13:11:56 +0000 (0:00:00.044) 0:06:10.677 **** 2025-11-26 13:11:56.647626 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:56.714521 | controller | 2025-11-26 13:11:56.714579 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-11-26 13:11:56.714588 | controller | Wednesday 26 November 2025 13:11:56 +0000 (0:00:00.484) 0:06:11.161 **** 2025-11-26 13:11:56.714602 | controller | skipping: [instance] 2025-11-26 13:11:56.779874 | controller | 2025-11-26 13:11:56.779955 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-11-26 13:11:56.779964 | controller | Wednesday 26 November 2025 13:11:56 +0000 (0:00:00.067) 0:06:11.229 **** 2025-11-26 13:11:56.779978 | controller | skipping: [instance] 2025-11-26 13:11:56.780030 | controller | 2025-11-26 13:11:56.780061 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-11-26 13:11:56.780191 | controller | Wednesday 26 November 2025 13:11:56 +0000 (0:00:00.065) 0:06:11.295 **** 2025-11-26 13:11:56.824410 | controller | skipping: [instance] 2025-11-26 13:11:56.824508 | controller | 2025-11-26 13:11:56.824622 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-11-26 13:11:56.824812 | controller | Wednesday 26 November 2025 13:11:56 +0000 (0:00:00.044) 0:06:11.340 **** 2025-11-26 13:11:56.880057 | controller | skipping: [instance] 2025-11-26 13:11:56.880131 | controller | 2025-11-26 13:11:56.880139 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-11-26 13:11:56.880148 | controller | Wednesday 26 November 2025 13:11:56 +0000 (0:00:00.055) 0:06:11.395 **** 2025-11-26 13:11:56.933805 | controller | skipping: [instance] 2025-11-26 13:11:56.933845 | controller | 2025-11-26 13:11:56.933852 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-11-26 13:11:56.933860 | controller | Wednesday 26 November 2025 13:11:56 +0000 (0:00:00.053) 0:06:11.448 **** 2025-11-26 13:11:56.992120 | controller | skipping: [instance] 2025-11-26 13:11:56.992225 | controller | 2025-11-26 13:11:56.992348 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-11-26 13:11:56.992463 | controller | Wednesday 26 November 2025 13:11:56 +0000 (0:00:00.058) 0:06:11.507 **** 2025-11-26 13:11:57.060231 | controller | skipping: [instance] 2025-11-26 13:11:57.060318 | controller | 2025-11-26 13:11:57.060426 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-11-26 13:11:57.060536 | controller | Wednesday 26 November 2025 13:11:57 +0000 (0:00:00.068) 0:06:11.575 **** 2025-11-26 13:11:57.122864 | controller | skipping: [instance] 2025-11-26 13:11:57.122945 | controller | 2025-11-26 13:11:57.123079 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-11-26 13:11:57.123172 | controller | Wednesday 26 November 2025 13:11:57 +0000 (0:00:00.062) 0:06:11.638 **** 2025-11-26 13:11:57.837365 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:57.837470 | controller | 2025-11-26 13:11:57.837529 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-11-26 13:11:57.837541 | controller | Wednesday 26 November 2025 13:11:57 +0000 (0:00:00.713) 0:06:12.351 **** 2025-11-26 13:11:58.982424 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 13:11:58.982523 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 13:11:58.982570 | controller | changed: [instance -> controller-0] 2025-11-26 13:11:58.982690 | controller | 2025-11-26 13:11:58.982815 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-11-26 13:11:58.982908 | controller | Wednesday 26 November 2025 13:11:58 +0000 (0:00:01.145) 0:06:13.497 **** 2025-11-26 13:11:59.738785 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:11:59.738882 | controller | 2025-11-26 13:11:59.738923 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-11-26 13:11:59.738935 | controller | Wednesday 26 November 2025 13:11:59 +0000 (0:00:00.756) 0:06:14.253 **** 2025-11-26 13:12:00.342195 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:00.342296 | controller | 2025-11-26 13:12:00.342357 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-11-26 13:12:00.342370 | controller | Wednesday 26 November 2025 13:12:00 +0000 (0:00:00.603) 0:06:14.856 **** 2025-11-26 13:12:00.420400 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 13:12:00.420464 | controller | ok: [instance -> controller-0] 2025-11-26 13:12:00.420558 | controller | 2025-11-26 13:12:00.420654 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-11-26 13:12:00.420941 | controller | Wednesday 26 November 2025 13:12:00 +0000 (0:00:00.079) 0:06:14.935 **** 2025-11-26 13:12:00.472749 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:00.472850 | controller | 2025-11-26 13:12:00.472958 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-11-26 13:12:00.473074 | controller | Wednesday 26 November 2025 13:12:00 +0000 (0:00:00.052) 0:06:14.988 **** 2025-11-26 13:12:30.413274 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:30.413317 | controller | 2025-11-26 13:12:30.413414 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-11-26 13:12:30.413480 | controller | Wednesday 26 November 2025 13:12:30 +0000 (0:00:29.938) 0:06:44.926 **** 2025-11-26 13:12:30.964527 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:31.524137 | controller | 2025-11-26 13:12:31.524173 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-11-26 13:12:31.524181 | controller | Wednesday 26 November 2025 13:12:30 +0000 (0:00:00.552) 0:06:45.479 **** 2025-11-26 13:12:31.524191 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:37.530524 | controller | 2025-11-26 13:12:37.530555 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-11-26 13:12:37.530564 | controller | Wednesday 26 November 2025 13:12:31 +0000 (0:00:00.559) 0:06:46.038 **** 2025-11-26 13:12:37.530574 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:37.530777 | controller | 2025-11-26 13:12:37.530792 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-11-26 13:12:37.582807 | controller | Wednesday 26 November 2025 13:12:37 +0000 (0:00:06.006) 0:06:52.045 **** 2025-11-26 13:12:37.582833 | controller | skipping: [instance] 2025-11-26 13:12:38.242404 | controller | 2025-11-26 13:12:38.242444 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-11-26 13:12:38.242461 | controller | Wednesday 26 November 2025 13:12:37 +0000 (0:00:00.052) 0:06:52.098 **** 2025-11-26 13:12:38.242472 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:38.242882 | controller | 2025-11-26 13:12:38.767741 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-11-26 13:12:38.767798 | controller | Wednesday 26 November 2025 13:12:38 +0000 (0:00:00.659) 0:06:52.757 **** 2025-11-26 13:12:38.767812 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:38.817221 | controller | 2025-11-26 13:12:38.817359 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-11-26 13:12:38.817370 | controller | Wednesday 26 November 2025 13:12:38 +0000 (0:00:00.524) 0:06:53.282 **** 2025-11-26 13:12:38.817398 | controller | skipping: [instance] 2025-11-26 13:12:38.817406 | controller | 2025-11-26 13:12:38.817411 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-11-26 13:12:38.817421 | controller | Wednesday 26 November 2025 13:12:38 +0000 (0:00:00.049) 0:06:53.332 **** 2025-11-26 13:12:38.861534 | controller | skipping: [instance] 2025-11-26 13:12:38.861592 | controller | 2025-11-26 13:12:38.861711 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-11-26 13:12:38.861813 | controller | Wednesday 26 November 2025 13:12:38 +0000 (0:00:00.044) 0:06:53.376 **** 2025-11-26 13:12:38.908583 | controller | skipping: [instance] 2025-11-26 13:12:38.953434 | controller | 2025-11-26 13:12:38.953456 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-11-26 13:12:38.953489 | controller | Wednesday 26 November 2025 13:12:38 +0000 (0:00:00.046) 0:06:53.423 **** 2025-11-26 13:12:38.953501 | controller | skipping: [instance] 2025-11-26 13:12:38.953522 | controller | 2025-11-26 13:12:38.953620 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-11-26 13:12:38.953719 | controller | Wednesday 26 November 2025 13:12:38 +0000 (0:00:00.045) 0:06:53.468 **** 2025-11-26 13:12:38.997454 | controller | skipping: [instance] 2025-11-26 13:12:38.997558 | controller | 2025-11-26 13:12:38.997687 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-11-26 13:12:38.997793 | controller | Wednesday 26 November 2025 13:12:38 +0000 (0:00:00.044) 0:06:53.512 **** 2025-11-26 13:12:39.052673 | controller | skipping: [instance] 2025-11-26 13:12:39.052749 | controller | 2025-11-26 13:12:39.052851 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-11-26 13:12:39.052973 | controller | Wednesday 26 November 2025 13:12:39 +0000 (0:00:00.055) 0:06:53.568 **** 2025-11-26 13:12:41.802344 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 13:12:41.802434 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 13:12:41.802689 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 13:12:41.802708 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 13:12:41.802727 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 13:12:41.802736 | controller | changed: [instance -> controller-0] 2025-11-26 13:12:41.803029 | controller | 2025-11-26 13:12:41.958512 | controller | TASK [Prepare install_yamls make targets] ************************************** 2025-11-26 13:12:41.958539 | controller | Wednesday 26 November 2025 13:12:41 +0000 (0:00:02.749) 0:06:56.317 **** 2025-11-26 13:12:41.958554 | controller | 2025-11-26 13:12:41.958648 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2025-11-26 13:12:41.958781 | controller | Wednesday 26 November 2025 13:12:41 +0000 (0:00:00.156) 0:06:56.473 **** 2025-11-26 13:12:43.584234 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 13:12:43.584345 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 13:12:43.584479 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 13:12:43.584499 | controller | changed: [instance -> controller-0] 2025-11-26 13:12:43.584522 | controller | 2025-11-26 13:12:43.584548 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2025-11-26 13:12:43.584658 | controller | Wednesday 26 November 2025 13:12:43 +0000 (0:00:01.625) 0:06:58.099 **** 2025-11-26 13:12:43.648220 | controller | 2025-11-26 13:12:43.648361 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2025-11-26 13:12:43.648515 | controller | Wednesday 26 November 2025 13:12:43 +0000 (0:00:00.063) 0:06:58.163 **** 2025-11-26 13:12:43.696926 | controller | skipping: [instance] 2025-11-26 13:12:43.696980 | controller | 2025-11-26 13:12:43.697140 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2025-11-26 13:12:43.697313 | controller | Wednesday 26 November 2025 13:12:43 +0000 (0:00:00.049) 0:06:58.212 **** 2025-11-26 13:12:43.748180 | controller | skipping: [instance] 2025-11-26 13:12:43.748244 | controller | 2025-11-26 13:12:43.748364 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2025-11-26 13:12:43.748476 | controller | Wednesday 26 November 2025 13:12:43 +0000 (0:00:00.051) 0:06:58.263 **** 2025-11-26 13:12:43.824626 | controller | 2025-11-26 13:12:43.824701 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2025-11-26 13:12:43.824827 | controller | Wednesday 26 November 2025 13:12:43 +0000 (0:00:00.076) 0:06:58.340 **** 2025-11-26 13:12:43.864714 | controller | skipping: [instance] 2025-11-26 13:12:43.864791 | controller | 2025-11-26 13:12:43.864894 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2025-11-26 13:12:43.864993 | controller | Wednesday 26 November 2025 13:12:43 +0000 (0:00:00.040) 0:06:58.380 **** 2025-11-26 13:12:43.904783 | controller | skipping: [instance] 2025-11-26 13:12:43.904882 | controller | 2025-11-26 13:12:43.905054 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2025-11-26 13:12:43.905189 | controller | Wednesday 26 November 2025 13:12:43 +0000 (0:00:00.039) 0:06:58.420 **** 2025-11-26 13:12:43.944145 | controller | skipping: [instance] 2025-11-26 13:12:43.944206 | controller | 2025-11-26 13:12:43.944326 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2025-11-26 13:12:43.944418 | controller | Wednesday 26 November 2025 13:12:43 +0000 (0:00:00.039) 0:06:58.459 **** 2025-11-26 13:12:43.986962 | controller | skipping: [instance] 2025-11-26 13:12:43.987049 | controller | 2025-11-26 13:12:43.987172 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2025-11-26 13:12:43.987271 | controller | Wednesday 26 November 2025 13:12:43 +0000 (0:00:00.042) 0:06:58.502 **** 2025-11-26 13:12:44.077206 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-11-26 13:12:44.077282 | controller | ok: [instance -> controller-0] 2025-11-26 13:12:44.077388 | controller | 2025-11-26 13:12:44.077496 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2025-11-26 13:12:44.077632 | controller | Wednesday 26 November 2025 13:12:44 +0000 (0:00:00.090) 0:06:58.592 **** 2025-11-26 13:12:44.160470 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:44.160574 | controller | 2025-11-26 13:12:44.160725 | controller | TASK [install_yamls : Get environment structure] ******************************* 2025-11-26 13:12:44.160872 | controller | Wednesday 26 November 2025 13:12:44 +0000 (0:00:00.083) 0:06:58.675 **** 2025-11-26 13:12:45.215421 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:45.215501 | controller | 2025-11-26 13:12:45.215623 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2025-11-26 13:12:45.215637 | controller | Wednesday 26 November 2025 13:12:45 +0000 (0:00:01.054) 0:06:59.730 **** 2025-11-26 13:12:45.264471 | controller | skipping: [instance] 2025-11-26 13:12:45.264529 | controller | 2025-11-26 13:12:45.264654 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2025-11-26 13:12:45.264849 | controller | Wednesday 26 November 2025 13:12:45 +0000 (0:00:00.049) 0:06:59.780 **** 2025-11-26 13:12:45.330803 | controller | skipping: [instance] 2025-11-26 13:12:45.379452 | controller | 2025-11-26 13:12:45.379472 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2025-11-26 13:12:45.379487 | controller | Wednesday 26 November 2025 13:12:45 +0000 (0:00:00.065) 0:06:59.845 **** 2025-11-26 13:12:45.379495 | controller | skipping: [instance] 2025-11-26 13:12:45.449135 | controller | 2025-11-26 13:12:45.449207 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2025-11-26 13:12:45.449217 | controller | Wednesday 26 November 2025 13:12:45 +0000 (0:00:00.049) 0:06:59.894 **** 2025-11-26 13:12:45.449237 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:45.449274 | controller | 2025-11-26 13:12:45.449280 | controller | TASK [install_yamls : Show the env structure] ********************************** 2025-11-26 13:12:45.449289 | controller | Wednesday 26 November 2025 13:12:45 +0000 (0:00:00.069) 0:06:59.964 **** 2025-11-26 13:12:45.506160 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:45.506200 | controller | 2025-11-26 13:12:45.506321 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2025-11-26 13:12:45.506417 | controller | Wednesday 26 November 2025 13:12:45 +0000 (0:00:00.057) 0:07:00.021 **** 2025-11-26 13:12:45.572625 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:45.572746 | controller | 2025-11-26 13:12:45.572884 | controller | TASK [install_yamls : Generate make targets] *********************************** 2025-11-26 13:12:45.573025 | controller | Wednesday 26 November 2025 13:12:45 +0000 (0:00:00.065) 0:07:00.087 **** 2025-11-26 13:12:46.286074 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:46.286136 | controller | 2025-11-26 13:12:46.286212 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2025-11-26 13:12:46.286342 | controller | Wednesday 26 November 2025 13:12:46 +0000 (0:00:00.713) 0:07:00.801 **** 2025-11-26 13:12:46.344532 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:46.344651 | controller | 2025-11-26 13:12:46.344801 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2025-11-26 13:12:46.344938 | controller | Wednesday 26 November 2025 13:12:46 +0000 (0:00:00.059) 0:07:00.860 **** 2025-11-26 13:12:47.366385 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:47.366469 | controller | 2025-11-26 13:12:47.366503 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2025-11-26 13:12:47.366610 | controller | Wednesday 26 November 2025 13:12:47 +0000 (0:00:01.021) 0:07:01.881 **** 2025-11-26 13:12:47.432209 | controller | skipping: [instance] 2025-11-26 13:12:47.432264 | controller | 2025-11-26 13:12:47.432863 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-11-26 13:12:48.295231 | controller | Wednesday 26 November 2025 13:12:47 +0000 (0:00:00.065) 0:07:01.947 **** 2025-11-26 13:12:48.295333 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:48.295421 | controller | 2025-11-26 13:12:48.295430 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-11-26 13:12:48.295440 | controller | Wednesday 26 November 2025 13:12:48 +0000 (0:00:00.862) 0:07:02.809 **** 2025-11-26 13:12:48.361455 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:48.361532 | controller | 2025-11-26 13:12:48.361608 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2025-11-26 13:12:48.361736 | controller | Wednesday 26 November 2025 13:12:48 +0000 (0:00:00.067) 0:07:02.876 **** 2025-11-26 13:12:49.416633 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:49.416949 | controller | 2025-11-26 13:12:49.960151 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2025-11-26 13:12:49.960186 | controller | Wednesday 26 November 2025 13:12:49 +0000 (0:00:01.055) 0:07:03.931 **** 2025-11-26 13:12:49.960206 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:50.116833 | controller | 2025-11-26 13:12:50.116873 | controller | TASK [Configure CRC network if needed] ***************************************** 2025-11-26 13:12:50.116881 | controller | Wednesday 26 November 2025 13:12:49 +0000 (0:00:00.542) 0:07:04.474 **** 2025-11-26 13:12:50.116892 | controller | 2025-11-26 13:12:51.383980 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2025-11-26 13:12:51.384074 | controller | Wednesday 26 November 2025 13:12:50 +0000 (0:00:00.157) 0:07:04.631 **** 2025-11-26 13:12:51.384090 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:52.674243 | controller | 2025-11-26 13:12:52.674275 | controller | TASK [openshift_setup : Patch network operator] ******************************** 2025-11-26 13:12:52.674282 | controller | Wednesday 26 November 2025 13:12:51 +0000 (0:00:01.266) 0:07:05.898 **** 2025-11-26 13:12:52.674292 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:52.717865 | controller | 2025-11-26 13:12:52.717889 | controller | TASK [Ensure OCP cluster is stable] ******************************************** 2025-11-26 13:12:52.717896 | controller | Wednesday 26 November 2025 13:12:52 +0000 (0:00:01.288) 0:07:07.187 **** 2025-11-26 13:12:52.717915 | controller | skipping: [instance] 2025-11-26 13:12:52.765922 | controller | 2025-11-26 13:12:52.765945 | controller | TASK [reproducer : Emulate CI job] ********************************************* 2025-11-26 13:12:52.765952 | controller | Wednesday 26 November 2025 13:12:52 +0000 (0:00:00.045) 0:07:07.233 **** 2025-11-26 13:12:52.765961 | controller | skipping: [instance] 2025-11-26 13:12:52.821570 | controller | 2025-11-26 13:12:52.821590 | controller | TASK [reproducer : Prepare architecture-based deployment] ********************** 2025-11-26 13:12:52.821598 | controller | Wednesday 26 November 2025 13:12:52 +0000 (0:00:00.047) 0:07:07.280 **** 2025-11-26 13:12:52.821608 | controller | skipping: [instance] 2025-11-26 13:12:52.821664 | controller | 2025-11-26 13:12:52.821781 | controller | TASK [reproducer : Prepare architecture-based post deployment] ***************** 2025-11-26 13:12:52.821889 | controller | Wednesday 26 November 2025 13:12:52 +0000 (0:00:00.055) 0:07:07.336 **** 2025-11-26 13:12:52.870946 | controller | skipping: [instance] 2025-11-26 13:12:53.951035 | controller | 2025-11-26 13:12:53.951069 | controller | TASK [reproducer : Prepare ci-like EDPM deploy] ******************************** 2025-11-26 13:12:53.951077 | controller | Wednesday 26 November 2025 13:12:52 +0000 (0:00:00.049) 0:07:07.385 **** 2025-11-26 13:12:53.951094 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:54.489046 | controller | 2025-11-26 13:12:54.489080 | controller | TASK [Ensure we have appropriate credentials for OpenShift accesses] *********** 2025-11-26 13:12:54.489088 | controller | Wednesday 26 November 2025 13:12:53 +0000 (0:00:01.079) 0:07:08.465 **** 2025-11-26 13:12:54.489098 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:55.021549 | controller | 2025-11-26 13:12:55.021577 | controller | TASK [Ensure we have needed inventory files] *********************************** 2025-11-26 13:12:55.021584 | controller | Wednesday 26 November 2025 13:12:54 +0000 (0:00:00.537) 0:07:09.003 **** 2025-11-26 13:12:55.021594 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:55.607810 | controller | 2025-11-26 13:12:55.607876 | controller | TASK [Ensure we have CRC ssh key] ********************************************** 2025-11-26 13:12:55.607884 | controller | Wednesday 26 November 2025 13:12:55 +0000 (0:00:00.532) 0:07:09.536 **** 2025-11-26 13:12:55.607899 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:55.608199 | controller | 2025-11-26 13:12:55.608222 | controller | TASK [Ensure we have the MAC mapping file] ************************************* 2025-11-26 13:12:55.608234 | controller | Wednesday 26 November 2025 13:12:55 +0000 (0:00:00.586) 0:07:10.122 **** 2025-11-26 13:12:56.178975 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:56.179119 | controller | 2025-11-26 13:12:56.179142 | controller | TASK [Load crc inventory] ****************************************************** 2025-11-26 13:12:56.179222 | controller | Wednesday 26 November 2025 13:12:56 +0000 (0:00:00.571) 0:07:10.694 **** 2025-11-26 13:12:56.689810 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:56.689858 | controller | 2025-11-26 13:12:56.689985 | controller | TASK [Load compute inventory] ************************************************** 2025-11-26 13:12:56.690108 | controller | Wednesday 26 November 2025 13:12:56 +0000 (0:00:00.510) 0:07:11.204 **** 2025-11-26 13:12:57.218828 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:57.218882 | controller | 2025-11-26 13:12:57.219225 | controller | TASK [Ensure we can ping compute-0 on osp_trunk net] *************************** 2025-11-26 13:12:57.775157 | controller | Wednesday 26 November 2025 13:12:57 +0000 (0:00:00.528) 0:07:11.733 **** 2025-11-26 13:12:57.775208 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:57.775339 | controller | 2025-11-26 13:12:57.775360 | controller | TASK [Ensure we can ping crc-0 on osp_trunk net] ******************************* 2025-11-26 13:12:57.775429 | controller | Wednesday 26 November 2025 13:12:57 +0000 (0:00:00.556) 0:07:12.290 **** 2025-11-26 13:12:58.334202 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:58.334248 | controller | 2025-11-26 13:12:58.334362 | controller | TASK [Check default location secret file] ************************************** 2025-11-26 13:12:58.334475 | controller | Wednesday 26 November 2025 13:12:58 +0000 (0:00:00.559) 0:07:12.849 **** 2025-11-26 13:12:58.895749 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:58.895799 | controller | 2025-11-26 13:12:58.895897 | controller | TASK [Check non-default location secret] *************************************** 2025-11-26 13:12:58.896037 | controller | Wednesday 26 November 2025 13:12:58 +0000 (0:00:00.561) 0:07:13.410 **** 2025-11-26 13:12:59.472626 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-11-26 13:12:59.472690 | controller | 2025-11-26 13:12:59.472806 | controller | TASK [Assert all of the tests] ************************************************* 2025-11-26 13:12:59.472908 | controller | Wednesday 26 November 2025 13:12:59 +0000 (0:00:00.576) 0:07:13.987 **** 2025-11-26 13:12:59.525248 | controller | ok: [instance] 2025-11-26 13:12:59.525324 | controller | 2025-11-26 13:12:59.525435 | controller | TASK [Create dnsmasq dir] ****************************************************** 2025-11-26 13:12:59.525532 | controller | Wednesday 26 November 2025 13:12:59 +0000 (0:00:00.052) 0:07:14.040 **** 2025-11-26 13:12:59.744458 | controller | changed: [instance] 2025-11-26 13:12:59.744516 | controller | 2025-11-26 13:12:59.744632 | controller | TASK [Get journalctl in a file] ************************************************ 2025-11-26 13:12:59.744742 | controller | Wednesday 26 November 2025 13:12:59 +0000 (0:00:00.219) 0:07:14.259 **** 2025-11-26 13:13:00.036783 | controller | changed: [instance] 2025-11-26 13:13:00.036824 | controller | 2025-11-26 13:13:00.036957 | controller | TASK [Dump journalctl output] ************************************************** 2025-11-26 13:13:00.037077 | controller | Wednesday 26 November 2025 13:13:00 +0000 (0:00:00.292) 0:07:14.551 **** 2025-11-26 13:13:00.493605 | controller | changed: [instance] 2025-11-26 13:13:00.493709 | controller | 2025-11-26 13:13:00.493744 | controller | TASK [Copy all dnsmasq config] ************************************************* 2025-11-26 13:13:00.493868 | controller | Wednesday 26 November 2025 13:13:00 +0000 (0:00:00.456) 0:07:15.008 **** 2025-11-26 13:13:01.056336 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-11-26 13:13:01.291140 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2025-11-26 13:13:01.291201 | controller | 2025-11-26 13:13:01.291210 | controller | TASK [Create log directory] **************************************************** 2025-11-26 13:13:01.291217 | controller | Wednesday 26 November 2025 13:13:01 +0000 (0:00:00.562) 0:07:15.571 **** 2025-11-26 13:13:01.291231 | controller | changed: [instance] 2025-11-26 13:13:01.291470 | controller | 2025-11-26 13:13:01.291482 | controller | TASK [Sync logs from controller-0] ********************************************* 2025-11-26 13:13:02.283052 | controller | Wednesday 26 November 2025 13:13:01 +0000 (0:00:00.235) 0:07:15.806 **** 2025-11-26 13:13:02.283131 | controller | changed: [instance] 2025-11-26 13:13:02.283182 | controller | 2025-11-26 13:13:02.283192 | controller | PLAY RECAP ********************************************************************* 2025-11-26 13:13:02.283311 | controller | instance : ok=540 changed=203 unreachable=0 failed=0 skipped=226 rescued=0 ignored=0 2025-11-26 13:13:02.283382 | controller | 2025-11-26 13:13:02.283484 | controller | Wednesday 26 November 2025 13:13:02 +0000 (0:00:00.989) 0:07:16.795 **** 2025-11-26 13:13:02.283566 | controller | =============================================================================== 2025-11-26 13:13:02.283666 | controller | reproducer : Check package install status ------------------------------ 61.45s 2025-11-26 13:13:02.283762 | controller | ci_setup : Install needed packages ------------------------------------- 29.94s 2025-11-26 13:13:02.284065 | controller | libvirt_manager : Download base image ---------------------------------- 21.04s 2025-11-26 13:13:02.284165 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.83s 2025-11-26 13:13:02.284256 | controller | reproducer : Install collections on controller-0 ----------------------- 19.27s 2025-11-26 13:13:02.284343 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.55s 2025-11-26 13:13:02.284434 | controller | libvirt_manager : Install packages required for using KVM --------------- 8.28s 2025-11-26 13:13:02.284523 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.90s 2025-11-26 13:13:02.284615 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.25s 2025-11-26 13:13:02.284714 | controller | ci_nmstate : Install required packages on localhost --------------------- 6.17s 2025-11-26 13:13:02.284811 | controller | ci_setup : Install openshift client ------------------------------------- 6.01s 2025-11-26 13:13:02.284898 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 5.29s 2025-11-26 13:13:02.284998 | controller | networking_mapper : Gather the facts ------------------------------------ 3.89s 2025-11-26 13:13:02.285102 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.65s 2025-11-26 13:13:02.285194 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.14s 2025-11-26 13:13:02.285274 | controller | ci_setup : Manage directories ------------------------------------------- 2.75s 2025-11-26 13:13:02.285375 | controller | sushy_emulator : Install required packages ------------------------------ 2.72s 2025-11-26 13:13:02.285466 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.42s 2025-11-26 13:13:02.285556 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.16s 2025-11-26 13:13:02.285655 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s 2025-11-26 13:13:02.505541 | controller | INFO Running crc_layout > cleanup 2025-11-26 13:13:02.505855 | controller | WARNING Skipping, cleanup playbook not configured. 2025-11-26 13:13:02.513028 | controller | INFO Running job_uri > prepare 2025-11-26 13:13:02.513405 | controller | WARNING Skipping, prepare playbook not configured. 2025-11-26 13:13:02.521376 | controller | INFO Running job_uri > converge 2025-11-26 13:13:02.951624 | controller | 2025-11-26 13:13:02.951718 | controller | PLAY [Prepare] ***************************************************************** 2025-11-26 13:13:02.951845 | controller | 2025-11-26 13:13:02.951961 | controller | TASK [Call task file in loop] ************************************************** 2025-11-26 13:13:02.952089 | controller | Wednesday 26 November 2025 13:13:02 +0000 (0:00:00.034) 0:00:00.034 **** 2025-11-26 13:13:03.028237 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////'}) 2025-11-26 13:13:03.028336 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2025-11-26 13:13:03.028445 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'}) 2025-11-26 13:13:03.028559 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35'}) 2025-11-26 13:13:03.028664 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2025-11-26 13:13:03.028785 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'}) 2025-11-26 13:13:03.028875 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log'}) 2025-11-26 13:13:03.029071 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/'}) 2025-11-26 13:13:03.029117 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4'}) 2025-11-26 13:13:03.029225 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': '/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a'}) 2025-11-26 13:13:03.029387 | controller | 2025-11-26 13:13:03.029427 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////] *** 2025-11-26 13:13:03.029522 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.077) 0:00:00.111 **** 2025-11-26 13:13:03.072586 | controller | 2025-11-26 13:13:03.072698 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 13:13:03.072804 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.044) 0:00:00.155 **** 2025-11-26 13:13:03.116708 | controller | ok: [instance] 2025-11-26 13:13:03.116804 | controller | 2025-11-26 13:13:03.116910 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 13:13:03.117066 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.043) 0:00:00.199 **** 2025-11-26 13:13:03.157402 | controller | ok: [instance] 2025-11-26 13:13:03.157501 | controller | 2025-11-26 13:13:03.157614 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-26 13:13:03.157737 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.040) 0:00:00.240 **** 2025-11-26 13:13:03.212038 | controller | ok: [instance] 2025-11-26 13:13:03.212158 | controller | 2025-11-26 13:13:03.212263 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-26 13:13:03.212366 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.054) 0:00:00.294 **** 2025-11-26 13:13:03.247039 | controller | skipping: [instance] 2025-11-26 13:13:03.247842 | controller | 2025-11-26 13:13:03.330807 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-26 13:13:03.330854 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.035) 0:00:00.329 **** 2025-11-26 13:13:03.330869 | controller | ok: [instance] => changed=false 2025-11-26 13:13:03.370873 | controller | msg: All assertions passed 2025-11-26 13:13:03.370901 | controller | 2025-11-26 13:13:03.370910 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2025-11-26 13:13:03.370917 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.083) 0:00:00.413 **** 2025-11-26 13:13:03.370927 | controller | 2025-11-26 13:13:03.370977 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 13:13:03.370989 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.040) 0:00:00.453 **** 2025-11-26 13:13:03.410184 | controller | ok: [instance] 2025-11-26 13:13:03.410258 | controller | 2025-11-26 13:13:03.410374 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 13:13:03.410465 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.039) 0:00:00.493 **** 2025-11-26 13:13:03.451198 | controller | ok: [instance] 2025-11-26 13:13:03.451282 | controller | 2025-11-26 13:13:03.451390 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-26 13:13:03.451491 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.040) 0:00:00.534 **** 2025-11-26 13:13:03.495036 | controller | ok: [instance] 2025-11-26 13:13:03.495163 | controller | 2025-11-26 13:13:03.495307 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-26 13:13:03.495426 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.043) 0:00:00.577 **** 2025-11-26 13:13:03.523591 | controller | skipping: [instance] 2025-11-26 13:13:03.523696 | controller | 2025-11-26 13:13:03.523814 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-26 13:13:03.523918 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.029) 0:00:00.606 **** 2025-11-26 13:13:03.557197 | controller | ok: [instance] => changed=false 2025-11-26 13:13:03.557299 | controller | msg: All assertions passed 2025-11-26 13:13:03.557394 | controller | 2025-11-26 13:13:03.557514 | controller | TASK [Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] *** 2025-11-26 13:13:03.557603 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.033) 0:00:00.640 **** 2025-11-26 13:13:03.596261 | controller | 2025-11-26 13:13:03.596376 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 13:13:03.596484 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.039) 0:00:00.679 **** 2025-11-26 13:13:03.644490 | controller | ok: [instance] 2025-11-26 13:13:03.644585 | controller | 2025-11-26 13:13:03.644709 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 13:13:03.644823 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.047) 0:00:00.727 **** 2025-11-26 13:13:03.689068 | controller | ok: [instance] 2025-11-26 13:13:03.689173 | controller | 2025-11-26 13:13:03.689275 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-26 13:13:03.689384 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.044) 0:00:00.772 **** 2025-11-26 13:13:03.735346 | controller | ok: [instance] 2025-11-26 13:13:03.735435 | controller | 2025-11-26 13:13:03.735546 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-26 13:13:03.735745 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.046) 0:00:00.818 **** 2025-11-26 13:13:03.768126 | controller | skipping: [instance] 2025-11-26 13:13:03.768220 | controller | 2025-11-26 13:13:03.768368 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-26 13:13:03.768475 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.032) 0:00:00.851 **** 2025-11-26 13:13:03.814736 | controller | ok: [instance] => changed=false 2025-11-26 13:13:03.814829 | controller | msg: All assertions passed 2025-11-26 13:13:03.814931 | controller | 2025-11-26 13:13:03.815074 | controller | TASK [Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35] *** 2025-11-26 13:13:03.815188 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.046) 0:00:00.897 **** 2025-11-26 13:13:03.859182 | controller | 2025-11-26 13:13:03.859280 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 13:13:03.859406 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.044) 0:00:00.942 **** 2025-11-26 13:13:03.896877 | controller | ok: [instance] 2025-11-26 13:13:03.897127 | controller | 2025-11-26 13:13:03.897214 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 13:13:03.897228 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.037) 0:00:00.980 **** 2025-11-26 13:13:03.941135 | controller | ok: [instance] 2025-11-26 13:13:03.941205 | controller | 2025-11-26 13:13:03.941321 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-26 13:13:03.941434 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.043) 0:00:01.023 **** 2025-11-26 13:13:03.986086 | controller | ok: [instance] 2025-11-26 13:13:03.986156 | controller | 2025-11-26 13:13:03.986256 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-26 13:13:03.986393 | controller | Wednesday 26 November 2025 13:13:03 +0000 (0:00:00.044) 0:00:01.068 **** 2025-11-26 13:13:04.015597 | controller | skipping: [instance] 2025-11-26 13:13:04.015694 | controller | 2025-11-26 13:13:04.015815 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-26 13:13:04.015958 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.030) 0:00:01.098 **** 2025-11-26 13:13:04.059912 | controller | ok: [instance] => changed=false 2025-11-26 13:13:04.060034 | controller | msg: All assertions passed 2025-11-26 13:13:04.060149 | controller | 2025-11-26 13:13:04.060263 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2025-11-26 13:13:04.060364 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.043) 0:00:01.142 **** 2025-11-26 13:13:04.160776 | controller | 2025-11-26 13:13:04.160889 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 13:13:04.161003 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.101) 0:00:01.243 **** 2025-11-26 13:13:04.204309 | controller | ok: [instance] 2025-11-26 13:13:04.204398 | controller | 2025-11-26 13:13:04.204504 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 13:13:04.204608 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.043) 0:00:01.287 **** 2025-11-26 13:13:04.241393 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:04.241494 | controller | assertion: _matched_url | default('') | length > 0 2025-11-26 13:13:04.241597 | controller | evaluated_to: false 2025-11-26 13:13:04.241738 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-11-26 13:13:04.274268 | controller | 2025-11-26 13:13:04.274404 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-11-26 13:13:04.274538 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.050) 0:00:01.337 **** 2025-11-26 13:13:04.274645 | controller | 2025-11-26 13:13:04.274760 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-11-26 13:13:04.274864 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.019) 0:00:01.356 **** 2025-11-26 13:13:04.311524 | controller | skipping: [instance] 2025-11-26 13:13:04.311614 | controller | 2025-11-26 13:13:04.311726 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-11-26 13:13:04.311829 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.038) 0:00:01.394 **** 2025-11-26 13:13:04.359161 | controller | skipping: [instance] 2025-11-26 13:13:04.359217 | controller | 2025-11-26 13:13:04.359228 | controller | TASK [Call task file with httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] *** 2025-11-26 13:13:04.359342 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.047) 0:00:01.442 **** 2025-11-26 13:13:04.403337 | controller | 2025-11-26 13:13:04.403445 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 13:13:04.403547 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.044) 0:00:01.486 **** 2025-11-26 13:13:04.447535 | controller | ok: [instance] 2025-11-26 13:13:04.447619 | controller | 2025-11-26 13:13:04.447744 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 13:13:04.447858 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.044) 0:00:01.530 **** 2025-11-26 13:13:04.482473 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:04.482568 | controller | assertion: _matched_url | default('') | length > 0 2025-11-26 13:13:04.482697 | controller | evaluated_to: false 2025-11-26 13:13:04.482822 | controller | msg: 'The cifmw_job_uri value provided is not valid: httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-11-26 13:13:04.511762 | controller | 2025-11-26 13:13:04.511856 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-11-26 13:13:04.511991 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.048) 0:00:01.578 **** 2025-11-26 13:13:04.512114 | controller | 2025-11-26 13:13:04.512215 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-11-26 13:13:04.512297 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.016) 0:00:01.594 **** 2025-11-26 13:13:04.555278 | controller | skipping: [instance] 2025-11-26 13:13:04.555357 | controller | 2025-11-26 13:13:04.555466 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-11-26 13:13:04.555563 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.043) 0:00:01.638 **** 2025-11-26 13:13:04.596265 | controller | skipping: [instance] 2025-11-26 13:13:04.596363 | controller | 2025-11-26 13:13:04.596477 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log] *** 2025-11-26 13:13:04.596580 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.041) 0:00:01.679 **** 2025-11-26 13:13:04.637776 | controller | 2025-11-26 13:13:04.638402 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 13:13:04.638516 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.041) 0:00:01.721 **** 2025-11-26 13:13:04.679336 | controller | ok: [instance] 2025-11-26 13:13:04.679415 | controller | 2025-11-26 13:13:04.679527 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 13:13:04.679626 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.041) 0:00:01.762 **** 2025-11-26 13:13:04.724542 | controller | ok: [instance] 2025-11-26 13:13:04.724700 | controller | 2025-11-26 13:13:04.724843 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-26 13:13:04.725031 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.044) 0:00:01.807 **** 2025-11-26 13:13:04.767425 | controller | ok: [instance] 2025-11-26 13:13:04.767512 | controller | 2025-11-26 13:13:04.767616 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-26 13:13:04.767727 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.043) 0:00:01.850 **** 2025-11-26 13:13:04.804336 | controller | skipping: [instance] 2025-11-26 13:13:04.804413 | controller | 2025-11-26 13:13:04.804515 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-26 13:13:04.804615 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.036) 0:00:01.887 **** 2025-11-26 13:13:04.858693 | controller | ok: [instance] => changed=false 2025-11-26 13:13:04.858792 | controller | msg: All assertions passed 2025-11-26 13:13:04.858884 | controller | 2025-11-26 13:13:04.859037 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/] *** 2025-11-26 13:13:04.859138 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.054) 0:00:01.941 **** 2025-11-26 13:13:04.946327 | controller | 2025-11-26 13:13:04.946436 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 13:13:04.946537 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.087) 0:00:02.029 **** 2025-11-26 13:13:04.987494 | controller | ok: [instance] 2025-11-26 13:13:04.987574 | controller | 2025-11-26 13:13:04.987793 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 13:13:04.987824 | controller | Wednesday 26 November 2025 13:13:04 +0000 (0:00:00.041) 0:00:02.070 **** 2025-11-26 13:13:05.028527 | controller | ok: [instance] 2025-11-26 13:13:05.028707 | controller | 2025-11-26 13:13:05.028819 | controller | TASK [reproducer : Extract job id for later reference] ************************* 2025-11-26 13:13:05.028831 | controller | Wednesday 26 November 2025 13:13:05 +0000 (0:00:00.041) 0:00:02.111 **** 2025-11-26 13:13:05.066314 | controller | ok: [instance] 2025-11-26 13:13:05.066369 | controller | 2025-11-26 13:13:05.066489 | controller | TASK [Fail if return string doesn't match expected value] ********************** 2025-11-26 13:13:05.066596 | controller | Wednesday 26 November 2025 13:13:05 +0000 (0:00:00.037) 0:00:02.149 **** 2025-11-26 13:13:05.092161 | controller | skipping: [instance] 2025-11-26 13:13:05.092203 | controller | 2025-11-26 13:13:05.092308 | controller | TASK [Fail if string incorrectly passed when defined not to pass] ************** 2025-11-26 13:13:05.092485 | controller | Wednesday 26 November 2025 13:13:05 +0000 (0:00:00.025) 0:00:02.175 **** 2025-11-26 13:13:05.129290 | controller | ok: [instance] => changed=false 2025-11-26 13:13:05.129366 | controller | msg: All assertions passed 2025-11-26 13:13:05.129394 | controller | 2025-11-26 13:13:05.129507 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4] *** 2025-11-26 13:13:05.129610 | controller | Wednesday 26 November 2025 13:13:05 +0000 (0:00:00.037) 0:00:02.212 **** 2025-11-26 13:13:05.169040 | controller | 2025-11-26 13:13:05.169161 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 13:13:05.169263 | controller | Wednesday 26 November 2025 13:13:05 +0000 (0:00:00.039) 0:00:02.252 **** 2025-11-26 13:13:05.206837 | controller | ok: [instance] 2025-11-26 13:13:05.206932 | controller | 2025-11-26 13:13:05.207049 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 13:13:05.207201 | controller | Wednesday 26 November 2025 13:13:05 +0000 (0:00:00.037) 0:00:02.290 **** 2025-11-26 13:13:05.236478 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:05.236593 | controller | assertion: _matched_url | default('') | length > 0 2025-11-26 13:13:05.236753 | controller | evaluated_to: false 2025-11-26 13:13:05.236805 | controller | msg: 'The cifmw_job_uri value provided is not valid: https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-11-26 13:13:05.266051 | controller | 2025-11-26 13:13:05.266133 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-11-26 13:13:05.266193 | controller | Wednesday 26 November 2025 13:13:05 +0000 (0:00:00.040) 0:00:02.330 **** 2025-11-26 13:13:05.266302 | controller | 2025-11-26 13:13:05.266388 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-11-26 13:13:05.266491 | controller | Wednesday 26 November 2025 13:13:05 +0000 (0:00:00.018) 0:00:02.348 **** 2025-11-26 13:13:05.307692 | controller | skipping: [instance] 2025-11-26 13:13:05.307790 | controller | 2025-11-26 13:13:05.308057 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-11-26 13:13:05.349976 | controller | Wednesday 26 November 2025 13:13:05 +0000 (0:00:00.041) 0:00:02.390 **** 2025-11-26 13:13:05.350029 | controller | skipping: [instance] 2025-11-26 13:13:05.350117 | controller | 2025-11-26 13:13:05.350130 | controller | TASK [Call task file with /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a] *** 2025-11-26 13:13:05.350155 | controller | Wednesday 26 November 2025 13:13:05 +0000 (0:00:00.041) 0:00:02.432 **** 2025-11-26 13:13:05.395770 | controller | 2025-11-26 13:13:05.395889 | controller | TASK [reproducer : Apply regex match filter] *********************************** 2025-11-26 13:13:05.396048 | controller | Wednesday 26 November 2025 13:13:05 +0000 (0:00:00.046) 0:00:02.478 **** 2025-11-26 13:13:05.437403 | controller | ok: [instance] 2025-11-26 13:13:05.437455 | controller | 2025-11-26 13:13:05.437575 | controller | TASK [reproducer : Verify URL is valid] **************************************** 2025-11-26 13:13:05.437694 | controller | Wednesday 26 November 2025 13:13:05 +0000 (0:00:00.041) 0:00:02.520 **** 2025-11-26 13:13:05.474579 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:05.474712 | controller | assertion: _matched_url | default('') | length > 0 2025-11-26 13:13:05.474833 | controller | evaluated_to: false 2025-11-26 13:13:05.474968 | controller | msg: 'The cifmw_job_uri value provided is not valid: /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job' 2025-11-26 13:13:05.504783 | controller | 2025-11-26 13:13:05.504916 | controller | TASK [Clear errors to manually handle them] ************************************ 2025-11-26 13:13:05.505028 | controller | Wednesday 26 November 2025 13:13:05 +0000 (0:00:00.051) 0:00:02.571 **** 2025-11-26 13:13:05.505159 | controller | 2025-11-26 13:13:05.505200 | controller | TASK [Really fail if string passed but should have failed] ********************* 2025-11-26 13:13:05.505300 | controller | Wednesday 26 November 2025 13:13:05 +0000 (0:00:00.016) 0:00:02.587 **** 2025-11-26 13:13:05.543339 | controller | skipping: [instance] 2025-11-26 13:13:05.543422 | controller | 2025-11-26 13:13:05.543521 | controller | TASK [Really fail if string failed but should have passed] ********************* 2025-11-26 13:13:05.543715 | controller | Wednesday 26 November 2025 13:13:05 +0000 (0:00:00.038) 0:00:02.626 **** 2025-11-26 13:13:05.582661 | controller | skipping: [instance] 2025-11-26 13:13:05.582753 | controller | 2025-11-26 13:13:05.582860 | controller | TASK [Print success message] *************************************************** 2025-11-26 13:13:05.582981 | controller | Wednesday 26 November 2025 13:13:05 +0000 (0:00:00.039) 0:00:02.665 **** 2025-11-26 13:13:05.699536 | controller | ok: [instance] => 2025-11-26 13:13:05.699608 | controller | msg: All strings passed! 2025-11-26 13:13:05.699672 | controller | 2025-11-26 13:13:05.699780 | controller | PLAY RECAP ********************************************************************* 2025-11-26 13:13:05.699905 | controller | instance : ok=39 changed=0 unreachable=0 failed=0 skipped=14 rescued=4 ignored=0 2025-11-26 13:13:05.700020 | controller | 2025-11-26 13:13:05.701101 | controller | Wednesday 26 November 2025 13:13:05 +0000 (0:00:00.116) 0:00:02.782 **** 2025-11-26 13:13:05.701171 | controller | =============================================================================== 2025-11-26 13:13:05.701188 | controller | Print success message --------------------------------------------------- 0.12s 2025-11-26 13:13:05.701196 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 --- 0.10s 2025-11-26 13:13:05.701202 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/ --- 0.09s 2025-11-26 13:13:05.701208 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.08s 2025-11-26 13:13:05.701214 | controller | Call task file in loop -------------------------------------------------- 0.08s 2025-11-26 13:13:05.701219 | controller | reproducer : Extract job id for later reference ------------------------- 0.05s 2025-11-26 13:13:05.701224 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.05s 2025-11-26 13:13:05.701230 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.05s 2025-11-26 13:13:05.701240 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.05s 2025-11-26 13:13:05.701353 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.05s 2025-11-26 13:13:05.701368 | controller | reproducer : Apply regex match filter ----------------------------------- 0.05s 2025-11-26 13:13:05.701444 | controller | Really fail if string failed but should have passed --------------------- 0.05s 2025-11-26 13:13:05.701549 | controller | Call task file with /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a --- 0.05s 2025-11-26 13:13:05.701659 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.05s 2025-11-26 13:13:05.701753 | controller | reproducer : Extract job id for later reference ------------------------- 0.05s 2025-11-26 13:13:05.701855 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-11-26 13:13:05.701954 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.04s 2025-11-26 13:13:05.702057 | controller | Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35 --- 0.04s 2025-11-26 13:13:05.702152 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything///// --- 0.04s 2025-11-26 13:13:05.702243 | controller | Call task file with httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 --- 0.04s 2025-11-26 13:13:05.794228 | controller | INFO Running job_uri > cleanup 2025-11-26 13:13:05.794550 | controller | WARNING Skipping, cleanup playbook not configured. 2025-11-26 13:13:05.802060 | controller | INFO Running network_validations > prepare 2025-11-26 13:13:05.802457 | controller | WARNING Skipping, prepare playbook not configured. 2025-11-26 13:13:05.810220 | controller | INFO Running network_validations > converge 2025-11-26 13:13:06.250023 | controller | 2025-11-26 13:13:06.250175 | controller | PLAY [Prepare] ***************************************************************** 2025-11-26 13:13:06.250361 | controller | 2025-11-26 13:13:06.250476 | controller | TASK [Set failed fact] ********************************************************* 2025-11-26 13:13:06.283245 | controller | Wednesday 26 November 2025 13:13:06 +0000 (0:00:00.035) 0:00:00.035 **** 2025-11-26 13:13:06.283286 | controller | ok: [instance] 2025-11-26 13:13:06.283376 | controller | 2025-11-26 13:13:06.283516 | controller | TASK [Load scenarios] ********************************************************** 2025-11-26 13:13:06.283671 | controller | Wednesday 26 November 2025 13:13:06 +0000 (0:00:00.035) 0:00:00.070 **** 2025-11-26 13:13:06.314865 | controller | ok: [instance] 2025-11-26 13:13:06.314964 | controller | 2025-11-26 13:13:06.315128 | controller | TASK [Test network validations] ************************************************ 2025-11-26 13:13:06.315221 | controller | Wednesday 26 November 2025 13:13:06 +0000 (0:00:00.031) 0:00:00.102 **** 2025-11-26 13:13:06.391392 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets only) 2025-11-26 13:13:06.391481 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets and spine/leaf) 2025-11-26 13:13:06.391599 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets with extra defined net) 2025-11-26 13:13:06.391728 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing default net definition) 2025-11-26 13:13:06.391833 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing spine/leaf net definition) 2025-11-26 13:13:06.391938 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=No network for a VM) 2025-11-26 13:13:06.392531 | controller | 2025-11-26 13:13:06.419805 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:06.419829 | controller | Wednesday 26 November 2025 13:13:06 +0000 (0:00:00.076) 0:00:00.179 **** 2025-11-26 13:13:06.419842 | controller | ok: [instance] 2025-11-26 13:13:06.420039 | controller | 2025-11-26 13:13:06.420150 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:06.420164 | controller | Wednesday 26 November 2025 13:13:06 +0000 (0:00:00.028) 0:00:00.207 **** 2025-11-26 13:13:06.454605 | controller | ok: [instance] 2025-11-26 13:13:06.454713 | controller | 2025-11-26 13:13:06.454827 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:06.454949 | controller | Wednesday 26 November 2025 13:13:06 +0000 (0:00:00.034) 0:00:00.242 **** 2025-11-26 13:13:06.487247 | controller | ok: [instance] => 2025-11-26 13:13:06.487342 | controller | msg: 'Running: Default nets only' 2025-11-26 13:13:06.487453 | controller | 2025-11-26 13:13:06.487546 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:06.487665 | controller | Wednesday 26 November 2025 13:13:06 +0000 (0:00:00.032) 0:00:00.274 **** 2025-11-26 13:13:06.542217 | controller | 2025-11-26 13:13:06.542360 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-26 13:13:06.542404 | controller | Wednesday 26 November 2025 13:13:06 +0000 (0:00:00.054) 0:00:00.329 **** 2025-11-26 13:13:06.599793 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-26 13:13:06.600401 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-26 13:13:06.653569 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-26 13:13:06.653594 | controller | collisions and unexpected behavior. 2025-11-26 13:13:06.653607 | controller | ok: [instance] => (item=controller) 2025-11-26 13:13:06.653661 | controller | 2025-11-26 13:13:06.653777 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-26 13:13:06.653870 | controller | Wednesday 26 November 2025 13:13:06 +0000 (0:00:00.112) 0:00:00.441 **** 2025-11-26 13:13:06.714789 | controller | ok: [instance] 2025-11-26 13:13:06.714863 | controller | 2025-11-26 13:13:06.714976 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-11-26 13:13:06.715078 | controller | Wednesday 26 November 2025 13:13:06 +0000 (0:00:00.061) 0:00:00.502 **** 2025-11-26 13:13:06.781773 | controller | ok: [instance] => changed=false 2025-11-26 13:13:06.781869 | controller | msg: All assertions passed 2025-11-26 13:13:06.782029 | controller | 2025-11-26 13:13:06.782068 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:06.782164 | controller | Wednesday 26 November 2025 13:13:06 +0000 (0:00:00.067) 0:00:00.569 **** 2025-11-26 13:13:06.824511 | controller | skipping: [instance] 2025-11-26 13:13:06.824573 | controller | 2025-11-26 13:13:06.824639 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:06.824759 | controller | Wednesday 26 November 2025 13:13:06 +0000 (0:00:00.042) 0:00:00.612 **** 2025-11-26 13:13:06.861184 | controller | skipping: [instance] 2025-11-26 13:13:06.861269 | controller | 2025-11-26 13:13:06.861373 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:06.861474 | controller | Wednesday 26 November 2025 13:13:06 +0000 (0:00:00.036) 0:00:00.649 **** 2025-11-26 13:13:06.896411 | controller | skipping: [instance] 2025-11-26 13:13:06.896468 | controller | 2025-11-26 13:13:06.896583 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:06.896685 | controller | Wednesday 26 November 2025 13:13:06 +0000 (0:00:00.035) 0:00:00.684 **** 2025-11-26 13:13:06.920552 | controller | ok: [instance] 2025-11-26 13:13:06.920642 | controller | 2025-11-26 13:13:06.920753 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:06.920851 | controller | Wednesday 26 November 2025 13:13:06 +0000 (0:00:00.024) 0:00:00.708 **** 2025-11-26 13:13:06.956292 | controller | ok: [instance] 2025-11-26 13:13:06.956383 | controller | 2025-11-26 13:13:06.956482 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:06.956585 | controller | Wednesday 26 November 2025 13:13:06 +0000 (0:00:00.035) 0:00:00.744 **** 2025-11-26 13:13:06.984348 | controller | ok: [instance] => 2025-11-26 13:13:06.984454 | controller | msg: 'Running: Default nets and spine/leaf' 2025-11-26 13:13:06.984548 | controller | 2025-11-26 13:13:06.984650 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:06.984759 | controller | Wednesday 26 November 2025 13:13:06 +0000 (0:00:00.028) 0:00:00.772 **** 2025-11-26 13:13:07.033599 | controller | 2025-11-26 13:13:07.033672 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-26 13:13:07.033735 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.048) 0:00:00.821 **** 2025-11-26 13:13:07.071300 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-26 13:13:07.071405 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-26 13:13:07.071509 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-26 13:13:07.071602 | controller | collisions and unexpected behavior. 2025-11-26 13:13:07.094114 | controller | ok: [instance] => (item=controller) 2025-11-26 13:13:07.094201 | controller | 2025-11-26 13:13:07.094309 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-26 13:13:07.094413 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.058) 0:00:00.880 **** 2025-11-26 13:13:07.158581 | controller | ok: [instance] 2025-11-26 13:13:07.158637 | controller | 2025-11-26 13:13:07.158773 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-11-26 13:13:07.158886 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.065) 0:00:00.945 **** 2025-11-26 13:13:07.234385 | controller | ok: [instance] => changed=false 2025-11-26 13:13:07.234445 | controller | msg: All assertions passed 2025-11-26 13:13:07.234509 | controller | 2025-11-26 13:13:07.234613 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:07.234718 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.075) 0:00:01.021 **** 2025-11-26 13:13:07.282280 | controller | skipping: [instance] 2025-11-26 13:13:07.282362 | controller | 2025-11-26 13:13:07.282469 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:07.282581 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.048) 0:00:01.069 **** 2025-11-26 13:13:07.330318 | controller | skipping: [instance] 2025-11-26 13:13:07.330399 | controller | 2025-11-26 13:13:07.330511 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:07.330634 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.048) 0:00:01.118 **** 2025-11-26 13:13:07.375039 | controller | skipping: [instance] 2025-11-26 13:13:07.375130 | controller | 2025-11-26 13:13:07.375240 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:07.375376 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.044) 0:00:01.162 **** 2025-11-26 13:13:07.405227 | controller | ok: [instance] 2025-11-26 13:13:07.405313 | controller | 2025-11-26 13:13:07.405435 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:07.405526 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.030) 0:00:01.193 **** 2025-11-26 13:13:07.441433 | controller | ok: [instance] 2025-11-26 13:13:07.441531 | controller | 2025-11-26 13:13:07.441630 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:07.441753 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.036) 0:00:01.229 **** 2025-11-26 13:13:07.476335 | controller | ok: [instance] => 2025-11-26 13:13:07.476443 | controller | msg: 'Running: Default nets with extra defined net' 2025-11-26 13:13:07.476530 | controller | 2025-11-26 13:13:07.476625 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:07.476739 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.034) 0:00:01.264 **** 2025-11-26 13:13:07.522395 | controller | 2025-11-26 13:13:07.522493 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-26 13:13:07.522596 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.046) 0:00:01.310 **** 2025-11-26 13:13:07.588707 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-26 13:13:07.589319 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-26 13:13:07.607792 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-26 13:13:07.607838 | controller | collisions and unexpected behavior. 2025-11-26 13:13:07.607853 | controller | ok: [instance] => (item=controller) 2025-11-26 13:13:07.607884 | controller | 2025-11-26 13:13:07.608040 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-26 13:13:07.608154 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.085) 0:00:01.395 **** 2025-11-26 13:13:07.668699 | controller | ok: [instance] 2025-11-26 13:13:07.668884 | controller | 2025-11-26 13:13:07.669004 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-11-26 13:13:07.669130 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.060) 0:00:01.456 **** 2025-11-26 13:13:07.724625 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:07.724743 | controller | assertion: _defined | difference(_all_nets) | length == 0 2025-11-26 13:13:07.724851 | controller | evaluated_to: false 2025-11-26 13:13:07.724972 | controller | msg: 'Inconsistency detected: ensure you''re attaching all of the defined networks. Those nets don''t seem to be attached: [''extra_net_1'']' 2025-11-26 13:13:07.735547 | controller | 2025-11-26 13:13:07.735652 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-11-26 13:13:07.735767 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.067) 0:00:01.523 **** 2025-11-26 13:13:07.775711 | controller | ok: [instance] => 2025-11-26 13:13:07.775819 | controller | cifmw_libvirt_manager_configuration: 2025-11-26 13:13:07.775948 | controller | networks: 2025-11-26 13:13:07.776041 | controller | public: defined 2025-11-26 13:13:07.776173 | controller | vms: 2025-11-26 13:13:07.776269 | controller | controller: 2025-11-26 13:13:07.776354 | controller | nets: 2025-11-26 13:13:07.776452 | controller | - public 2025-11-26 13:13:07.776537 | controller | 2025-11-26 13:13:07.776640 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-11-26 13:13:07.776759 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.040) 0:00:01.563 **** 2025-11-26 13:13:07.812945 | controller | skipping: [instance] 2025-11-26 13:13:07.813055 | controller | 2025-11-26 13:13:07.813164 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-11-26 13:13:07.813293 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.037) 0:00:01.600 **** 2025-11-26 13:13:07.892573 | controller | skipping: [instance] 2025-11-26 13:13:07.892680 | controller | 2025-11-26 13:13:07.892807 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-11-26 13:13:07.892917 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.079) 0:00:01.680 **** 2025-11-26 13:13:07.943042 | controller | ok: [instance] => 2025-11-26 13:13:07.943168 | controller | _cifmw_libvirt_manager_layout: 2025-11-26 13:13:07.943304 | controller | networks: 2025-11-26 13:13:07.943378 | controller | extra_net_1: defined 2025-11-26 13:13:07.943471 | controller | public: defined 2025-11-26 13:13:07.943567 | controller | vms: 2025-11-26 13:13:07.943665 | controller | controller: 2025-11-26 13:13:07.943767 | controller | nets: 2025-11-26 13:13:07.943862 | controller | - public 2025-11-26 13:13:07.943962 | controller | 2025-11-26 13:13:07.944074 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-11-26 13:13:07.944179 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.050) 0:00:01.730 **** 2025-11-26 13:13:07.958819 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:07.958947 | controller | msg: Error detected, please check assertions and debugging output above. 2025-11-26 13:13:07.986630 | controller | 2025-11-26 13:13:07.986736 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 13:13:07.986844 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.027) 0:00:01.758 **** 2025-11-26 13:13:07.986941 | controller | 2025-11-26 13:13:07.987041 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:07.987164 | controller | Wednesday 26 November 2025 13:13:07 +0000 (0:00:00.016) 0:00:01.774 **** 2025-11-26 13:13:08.013593 | controller | ok: [instance] 2025-11-26 13:13:08.013673 | controller | 2025-11-26 13:13:08.013792 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:08.014052 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.027) 0:00:01.801 **** 2025-11-26 13:13:08.056417 | controller | skipping: [instance] 2025-11-26 13:13:08.056513 | controller | 2025-11-26 13:13:08.056627 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:08.056746 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.042) 0:00:01.843 **** 2025-11-26 13:13:08.095161 | controller | skipping: [instance] 2025-11-26 13:13:08.095265 | controller | 2025-11-26 13:13:08.095366 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:08.095463 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.039) 0:00:01.883 **** 2025-11-26 13:13:08.141643 | controller | skipping: [instance] 2025-11-26 13:13:08.141737 | controller | 2025-11-26 13:13:08.141855 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:08.141955 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.046) 0:00:01.929 **** 2025-11-26 13:13:08.171133 | controller | ok: [instance] 2025-11-26 13:13:08.171230 | controller | 2025-11-26 13:13:08.171335 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:08.171439 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.029) 0:00:01.959 **** 2025-11-26 13:13:08.207431 | controller | ok: [instance] 2025-11-26 13:13:08.207517 | controller | 2025-11-26 13:13:08.207625 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:08.207767 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.035) 0:00:01.995 **** 2025-11-26 13:13:08.240227 | controller | ok: [instance] => 2025-11-26 13:13:08.240318 | controller | msg: 'Running: Missing default net definition' 2025-11-26 13:13:08.240388 | controller | 2025-11-26 13:13:08.240497 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:08.240604 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.032) 0:00:02.028 **** 2025-11-26 13:13:08.290216 | controller | 2025-11-26 13:13:08.290334 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-26 13:13:08.290442 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.049) 0:00:02.078 **** 2025-11-26 13:13:08.336557 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-26 13:13:08.351896 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-26 13:13:08.351918 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-26 13:13:08.351925 | controller | collisions and unexpected behavior. 2025-11-26 13:13:08.351936 | controller | ok: [instance] => (item=controller) 2025-11-26 13:13:08.351991 | controller | 2025-11-26 13:13:08.352108 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-26 13:13:08.352212 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.061) 0:00:02.139 **** 2025-11-26 13:13:08.411042 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:08.417611 | controller | assertion: _all_nets | difference(_defined) | length == 0 2025-11-26 13:13:08.417669 | controller | evaluated_to: false 2025-11-26 13:13:08.417680 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''foo'']' 2025-11-26 13:13:08.417694 | controller | 2025-11-26 13:13:08.417811 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-11-26 13:13:08.417823 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.065) 0:00:02.205 **** 2025-11-26 13:13:08.460637 | controller | ok: [instance] => 2025-11-26 13:13:08.460728 | controller | cifmw_libvirt_manager_configuration: 2025-11-26 13:13:08.460820 | controller | networks: 2025-11-26 13:13:08.460914 | controller | public: defined 2025-11-26 13:13:08.461048 | controller | vms: 2025-11-26 13:13:08.461156 | controller | controller: 2025-11-26 13:13:08.461230 | controller | nets: 2025-11-26 13:13:08.461320 | controller | - public 2025-11-26 13:13:08.461403 | controller | 2025-11-26 13:13:08.461496 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-11-26 13:13:08.461586 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.043) 0:00:02.248 **** 2025-11-26 13:13:08.494824 | controller | skipping: [instance] 2025-11-26 13:13:08.494906 | controller | 2025-11-26 13:13:08.495028 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-11-26 13:13:08.495124 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.034) 0:00:02.282 **** 2025-11-26 13:13:08.650130 | controller | skipping: [instance] 2025-11-26 13:13:08.650218 | controller | 2025-11-26 13:13:08.650329 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-11-26 13:13:08.650447 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.155) 0:00:02.437 **** 2025-11-26 13:13:08.697093 | controller | ok: [instance] => 2025-11-26 13:13:08.697201 | controller | _cifmw_libvirt_manager_layout: 2025-11-26 13:13:08.697296 | controller | networks: 2025-11-26 13:13:08.697399 | controller | public: defined 2025-11-26 13:13:08.697483 | controller | vms: 2025-11-26 13:13:08.697589 | controller | controller: 2025-11-26 13:13:08.697695 | controller | nets: 2025-11-26 13:13:08.697806 | controller | - public 2025-11-26 13:13:08.697899 | controller | - foo 2025-11-26 13:13:08.697987 | controller | 2025-11-26 13:13:08.698131 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-11-26 13:13:08.698225 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.046) 0:00:02.484 **** 2025-11-26 13:13:08.716347 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:08.716465 | controller | msg: Error detected, please check assertions and debugging output above. 2025-11-26 13:13:08.743944 | controller | 2025-11-26 13:13:08.744055 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 13:13:08.744207 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.031) 0:00:02.516 **** 2025-11-26 13:13:08.744318 | controller | 2025-11-26 13:13:08.744444 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:08.744529 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.015) 0:00:02.531 **** 2025-11-26 13:13:08.772438 | controller | ok: [instance] 2025-11-26 13:13:08.772558 | controller | 2025-11-26 13:13:08.772689 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:08.772795 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.028) 0:00:02.560 **** 2025-11-26 13:13:08.817160 | controller | skipping: [instance] 2025-11-26 13:13:08.817286 | controller | 2025-11-26 13:13:08.817440 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:08.817608 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.044) 0:00:02.604 **** 2025-11-26 13:13:08.863162 | controller | skipping: [instance] 2025-11-26 13:13:08.863297 | controller | 2025-11-26 13:13:08.863400 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:08.863497 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.045) 0:00:02.650 **** 2025-11-26 13:13:08.904927 | controller | skipping: [instance] 2025-11-26 13:13:08.905074 | controller | 2025-11-26 13:13:08.905185 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:08.905285 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.041) 0:00:02.692 **** 2025-11-26 13:13:08.933539 | controller | ok: [instance] 2025-11-26 13:13:08.933633 | controller | 2025-11-26 13:13:08.933756 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:08.933862 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.028) 0:00:02.721 **** 2025-11-26 13:13:08.966519 | controller | ok: [instance] 2025-11-26 13:13:08.966621 | controller | 2025-11-26 13:13:08.966742 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:08.966877 | controller | Wednesday 26 November 2025 13:13:08 +0000 (0:00:00.032) 0:00:02.754 **** 2025-11-26 13:13:09.004666 | controller | ok: [instance] => 2025-11-26 13:13:09.004772 | controller | msg: 'Running: Missing spine/leaf net definition' 2025-11-26 13:13:09.004880 | controller | 2025-11-26 13:13:09.004998 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:09.005128 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.037) 0:00:02.792 **** 2025-11-26 13:13:09.049050 | controller | 2025-11-26 13:13:09.049168 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-26 13:13:09.049272 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.044) 0:00:02.837 **** 2025-11-26 13:13:09.088099 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-26 13:13:09.088188 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-26 13:13:09.088283 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-26 13:13:09.088385 | controller | collisions and unexpected behavior. 2025-11-26 13:13:09.106565 | controller | ok: [instance] => (item=controller) 2025-11-26 13:13:09.106677 | controller | 2025-11-26 13:13:09.106858 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-11-26 13:13:09.106997 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.057) 0:00:02.894 **** 2025-11-26 13:13:09.158398 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:09.169248 | controller | assertion: _all_nets | difference(_defined) | length == 0 2025-11-26 13:13:09.169271 | controller | evaluated_to: false 2025-11-26 13:13:09.169279 | controller | msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''l00-s1'']' 2025-11-26 13:13:09.169292 | controller | 2025-11-26 13:13:09.169328 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-11-26 13:13:09.169428 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.062) 0:00:02.957 **** 2025-11-26 13:13:09.206487 | controller | ok: [instance] => 2025-11-26 13:13:09.206578 | controller | cifmw_libvirt_manager_configuration: 2025-11-26 13:13:09.206695 | controller | networks: 2025-11-26 13:13:09.206800 | controller | l00-s0: defined 2025-11-26 13:13:09.206890 | controller | public: defined 2025-11-26 13:13:09.207037 | controller | vms: 2025-11-26 13:13:09.207144 | controller | controller: 2025-11-26 13:13:09.207231 | controller | nets: 2025-11-26 13:13:09.207318 | controller | - public 2025-11-26 13:13:09.207419 | controller | spineleafnets: 2025-11-26 13:13:09.207498 | controller | - l00-s0 2025-11-26 13:13:09.207585 | controller | 2025-11-26 13:13:09.207703 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-11-26 13:13:09.207790 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.037) 0:00:02.994 **** 2025-11-26 13:13:09.236812 | controller | skipping: [instance] 2025-11-26 13:13:09.236909 | controller | 2025-11-26 13:13:09.237057 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-11-26 13:13:09.237165 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.030) 0:00:03.024 **** 2025-11-26 13:13:09.313995 | controller | skipping: [instance] 2025-11-26 13:13:09.314111 | controller | 2025-11-26 13:13:09.314224 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-11-26 13:13:09.314337 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.077) 0:00:03.101 **** 2025-11-26 13:13:09.361000 | controller | ok: [instance] => 2025-11-26 13:13:09.361108 | controller | _cifmw_libvirt_manager_layout: 2025-11-26 13:13:09.361211 | controller | networks: 2025-11-26 13:13:09.361310 | controller | l00-s0: defined 2025-11-26 13:13:09.361404 | controller | public: defined 2025-11-26 13:13:09.361498 | controller | vms: 2025-11-26 13:13:09.361593 | controller | controller: 2025-11-26 13:13:09.361689 | controller | nets: 2025-11-26 13:13:09.361787 | controller | - public 2025-11-26 13:13:09.361879 | controller | spineleafnets: 2025-11-26 13:13:09.361981 | controller | - l00-s0 2025-11-26 13:13:09.362111 | controller | - l00-s1 2025-11-26 13:13:09.362199 | controller | 2025-11-26 13:13:09.362296 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-11-26 13:13:09.362395 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.046) 0:00:03.148 **** 2025-11-26 13:13:09.380598 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:09.380718 | controller | msg: Error detected, please check assertions and debugging output above. 2025-11-26 13:13:09.408843 | controller | 2025-11-26 13:13:09.408941 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 13:13:09.409102 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.031) 0:00:03.180 **** 2025-11-26 13:13:09.409195 | controller | 2025-11-26 13:13:09.409300 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:09.409397 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.016) 0:00:03.196 **** 2025-11-26 13:13:09.437330 | controller | ok: [instance] 2025-11-26 13:13:09.437411 | controller | 2025-11-26 13:13:09.437519 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:09.437627 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.028) 0:00:03.225 **** 2025-11-26 13:13:09.482681 | controller | skipping: [instance] 2025-11-26 13:13:09.482781 | controller | 2025-11-26 13:13:09.482891 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:09.483035 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.045) 0:00:03.270 **** 2025-11-26 13:13:09.608981 | controller | skipping: [instance] 2025-11-26 13:13:09.609068 | controller | 2025-11-26 13:13:09.609176 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:09.609274 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.126) 0:00:03.396 **** 2025-11-26 13:13:09.645347 | controller | skipping: [instance] 2025-11-26 13:13:09.645419 | controller | 2025-11-26 13:13:09.645540 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:09.646299 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.036) 0:00:03.433 **** 2025-11-26 13:13:09.671979 | controller | ok: [instance] 2025-11-26 13:13:09.672117 | controller | 2025-11-26 13:13:09.672259 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:09.672385 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.026) 0:00:03.459 **** 2025-11-26 13:13:09.704717 | controller | ok: [instance] 2025-11-26 13:13:09.704799 | controller | 2025-11-26 13:13:09.704899 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:09.705026 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.032) 0:00:03.492 **** 2025-11-26 13:13:09.739848 | controller | ok: [instance] => 2025-11-26 13:13:09.739953 | controller | msg: 'Running: No network for a VM' 2025-11-26 13:13:09.740076 | controller | 2025-11-26 13:13:09.740172 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:09.740265 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.035) 0:00:03.527 **** 2025-11-26 13:13:09.784377 | controller | 2025-11-26 13:13:09.784478 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-11-26 13:13:09.784587 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.044) 0:00:03.572 **** 2025-11-26 13:13:09.820004 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter: 2025-11-26 13:13:09.820556 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value 2025-11-26 13:13:09.837889 | controller | in the `loop_control` option for the task to something else to avoid variable 2025-11-26 13:13:09.837911 | controller | collisions and unexpected behavior. 2025-11-26 13:13:09.837924 | controller | failed: [instance] (item=foo) => changed=false 2025-11-26 13:13:09.838002 | controller | ansible_loop_var: item 2025-11-26 13:13:09.838162 | controller | assertion: item.value.nets is defined 2025-11-26 13:13:09.838254 | controller | evaluated_to: false 2025-11-26 13:13:09.838359 | controller | item: 2025-11-26 13:13:09.838455 | controller | key: foo 2025-11-26 13:13:09.838554 | controller | value: 2025-11-26 13:13:09.838651 | controller | disksize: 10 2025-11-26 13:13:09.838768 | controller | msg: 'Inconsistency detected: VM type "foo" doesn''t seem to have any network.' 2025-11-26 13:13:09.851811 | controller | ok: [instance] => (item=controller) 2025-11-26 13:13:09.895649 | controller | 2025-11-26 13:13:09.895682 | controller | TASK [reproducer : Dump initial layout] **************************************** 2025-11-26 13:13:09.895690 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.067) 0:00:03.639 **** 2025-11-26 13:13:09.895700 | controller | ok: [instance] => 2025-11-26 13:13:09.895708 | controller | cifmw_libvirt_manager_configuration: 2025-11-26 13:13:09.895876 | controller | networks: 2025-11-26 13:13:09.895992 | controller | public: defined 2025-11-26 13:13:09.896063 | controller | vms: 2025-11-26 13:13:09.896166 | controller | controller: 2025-11-26 13:13:09.896259 | controller | nets: 2025-11-26 13:13:09.896352 | controller | - public 2025-11-26 13:13:09.896443 | controller | 2025-11-26 13:13:09.896535 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************ 2025-11-26 13:13:09.896637 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.043) 0:00:03.683 **** 2025-11-26 13:13:09.930327 | controller | skipping: [instance] 2025-11-26 13:13:09.930425 | controller | 2025-11-26 13:13:09.930529 | controller | TASK [reproducer : Dump layout patches] **************************************** 2025-11-26 13:13:09.930646 | controller | Wednesday 26 November 2025 13:13:09 +0000 (0:00:00.034) 0:00:03.718 **** 2025-11-26 13:13:10.009255 | controller | skipping: [instance] 2025-11-26 13:13:10.009339 | controller | 2025-11-26 13:13:10.009445 | controller | TASK [reproducer : Dump built layout] ****************************************** 2025-11-26 13:13:10.009547 | controller | Wednesday 26 November 2025 13:13:10 +0000 (0:00:00.078) 0:00:03.796 **** 2025-11-26 13:13:10.051829 | controller | ok: [instance] => 2025-11-26 13:13:10.052129 | controller | _cifmw_libvirt_manager_layout: 2025-11-26 13:13:10.052188 | controller | networks: 2025-11-26 13:13:10.052202 | controller | public: defined 2025-11-26 13:13:10.052285 | controller | vms: 2025-11-26 13:13:10.052402 | controller | controller: 2025-11-26 13:13:10.052497 | controller | nets: 2025-11-26 13:13:10.052575 | controller | - public 2025-11-26 13:13:10.052679 | controller | foo: 2025-11-26 13:13:10.052769 | controller | disksize: 10 2025-11-26 13:13:10.052860 | controller | 2025-11-26 13:13:10.052985 | controller | TASK [reproducer : Fail for good] ********************************************** 2025-11-26 13:13:10.053108 | controller | Wednesday 26 November 2025 13:13:10 +0000 (0:00:00.042) 0:00:03.839 **** 2025-11-26 13:13:10.067538 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:10.067649 | controller | msg: Error detected, please check assertions and debugging output above. 2025-11-26 13:13:10.096512 | controller | 2025-11-26 13:13:10.096671 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 13:13:10.096811 | controller | Wednesday 26 November 2025 13:13:10 +0000 (0:00:00.028) 0:00:03.868 **** 2025-11-26 13:13:10.096961 | controller | 2025-11-26 13:13:10.097108 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:10.097262 | controller | Wednesday 26 November 2025 13:13:10 +0000 (0:00:00.016) 0:00:03.884 **** 2025-11-26 13:13:10.120362 | controller | ok: [instance] 2025-11-26 13:13:10.120507 | controller | 2025-11-26 13:13:10.120649 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:10.120795 | controller | Wednesday 26 November 2025 13:13:10 +0000 (0:00:00.023) 0:00:03.908 **** 2025-11-26 13:13:10.158509 | controller | skipping: [instance] 2025-11-26 13:13:10.158584 | controller | 2025-11-26 13:13:10.158677 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:10.158808 | controller | Wednesday 26 November 2025 13:13:10 +0000 (0:00:00.037) 0:00:03.946 **** 2025-11-26 13:13:10.201406 | controller | skipping: [instance] 2025-11-26 13:13:10.201516 | controller | 2025-11-26 13:13:10.201831 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:10.201956 | controller | Wednesday 26 November 2025 13:13:10 +0000 (0:00:00.042) 0:00:03.988 **** 2025-11-26 13:13:10.240262 | controller | skipping: [instance] 2025-11-26 13:13:10.240346 | controller | 2025-11-26 13:13:10.240446 | controller | TASK [Fail if needed] ********************************************************** 2025-11-26 13:13:10.240555 | controller | Wednesday 26 November 2025 13:13:10 +0000 (0:00:00.039) 0:00:04.028 **** 2025-11-26 13:13:10.306153 | controller | skipping: [instance] 2025-11-26 13:13:10.306263 | controller | 2025-11-26 13:13:10.306382 | controller | PLAY RECAP ********************************************************************* 2025-11-26 13:13:10.306487 | controller | instance : ok=48 changed=0 unreachable=0 failed=0 skipped=27 rescued=8 ignored=0 2025-11-26 13:13:10.306572 | controller | 2025-11-26 13:13:10.306688 | controller | Wednesday 26 November 2025 13:13:10 +0000 (0:00:00.065) 0:00:04.093 **** 2025-11-26 13:13:10.306779 | controller | =============================================================================== 2025-11-26 13:13:10.306878 | controller | reproducer : Dump layout patches ---------------------------------------- 0.16s 2025-11-26 13:13:10.307004 | controller | Display error message --------------------------------------------------- 0.13s 2025-11-26 13:13:10.307115 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.11s 2025-11-26 13:13:10.307214 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.09s 2025-11-26 13:13:10.307307 | controller | reproducer : Dump layout patches ---------------------------------------- 0.08s 2025-11-26 13:13:10.307394 | controller | reproducer : Dump layout patches ---------------------------------------- 0.08s 2025-11-26 13:13:10.307480 | controller | reproducer : Dump layout patches ---------------------------------------- 0.08s 2025-11-26 13:13:10.307580 | controller | Test network validations ------------------------------------------------ 0.08s 2025-11-26 13:13:10.307683 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.08s 2025-11-26 13:13:10.307783 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.07s 2025-11-26 13:13:10.307877 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.07s 2025-11-26 13:13:10.308000 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.07s 2025-11-26 13:13:10.308108 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.07s 2025-11-26 13:13:10.308192 | controller | Fail if needed ---------------------------------------------------------- 0.07s 2025-11-26 13:13:10.308283 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.07s 2025-11-26 13:13:10.308367 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-11-26 13:13:10.308465 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.06s 2025-11-26 13:13:10.308561 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-11-26 13:13:10.308655 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.06s 2025-11-26 13:13:10.308782 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.06s 2025-11-26 13:13:10.407332 | controller | INFO Running network_validations > cleanup 2025-11-26 13:13:10.407802 | controller | WARNING Skipping, cleanup playbook not configured. 2025-11-26 13:13:10.415179 | controller | INFO Running ocp_validations > prepare 2025-11-26 13:13:10.415572 | controller | WARNING Skipping, prepare playbook not configured. 2025-11-26 13:13:10.423600 | controller | INFO Running ocp_validations > converge 2025-11-26 13:13:10.898830 | controller | 2025-11-26 13:13:10.898899 | controller | PLAY [Prepare] ***************************************************************** 2025-11-26 13:13:10.899033 | controller | 2025-11-26 13:13:10.899161 | controller | TASK [Set failed fact] ********************************************************* 2025-11-26 13:13:10.899502 | controller | Wednesday 26 November 2025 13:13:10 +0000 (0:00:00.037) 0:00:00.037 **** 2025-11-26 13:13:10.928270 | controller | ok: [instance] 2025-11-26 13:13:10.928332 | controller | 2025-11-26 13:13:10.928366 | controller | TASK [Load scenarios] ********************************************************** 2025-11-26 13:13:10.928493 | controller | Wednesday 26 November 2025 13:13:10 +0000 (0:00:00.030) 0:00:00.067 **** 2025-11-26 13:13:10.958731 | controller | ok: [instance] 2025-11-26 13:13:10.958849 | controller | 2025-11-26 13:13:10.958973 | controller | TASK [Test no volumes] ********************************************************* 2025-11-26 13:13:10.959118 | controller | Wednesday 26 November 2025 13:13:10 +0000 (0:00:00.030) 0:00:00.098 **** 2025-11-26 13:13:11.059141 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, no worker) 2025-11-26 13:13:11.059263 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, with worker) 2025-11-26 13:13:11.059394 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, no worker) 2025-11-26 13:13:11.059504 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, with worker) 2025-11-26 13:13:11.059613 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Too many allocated volumes) 2025-11-26 13:13:11.059760 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Different volume amount) 2025-11-26 13:13:11.059891 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVM without volume) 2025-11-26 13:13:11.060000 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVMS without volume) 2025-11-26 13:13:11.060159 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice) 2025-11-26 13:13:11.060254 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no LVMS) 2025-11-26 13:13:11.060366 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no cinder_lvm) 2025-11-26 13:13:11.060498 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Config overrides via devscripts) 2025-11-26 13:13:11.060798 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 10 dev-scripts extra_worker) 2025-11-26 13:13:11.060899 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 0 dev-scripts extra_worker) 2025-11-26 13:13:11.061027 | controller | 2025-11-26 13:13:11.061249 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:11.084938 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.099) 0:00:00.198 **** 2025-11-26 13:13:11.084966 | controller | ok: [instance] 2025-11-26 13:13:11.085072 | controller | 2025-11-26 13:13:11.085193 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:11.085448 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.026) 0:00:00.225 **** 2025-11-26 13:13:11.114312 | controller | ok: [instance] 2025-11-26 13:13:11.114414 | controller | 2025-11-26 13:13:11.114528 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:11.114631 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.029) 0:00:00.254 **** 2025-11-26 13:13:11.143645 | controller | ok: [instance] => 2025-11-26 13:13:11.143778 | controller | msg: 'Running: No volume, no worker' 2025-11-26 13:13:11.143887 | controller | 2025-11-26 13:13:11.143989 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:11.144125 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.029) 0:00:00.283 **** 2025-11-26 13:13:11.218268 | controller | 2025-11-26 13:13:11.218382 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 13:13:11.218495 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.074) 0:00:00.358 **** 2025-11-26 13:13:11.278895 | controller | ok: [instance] 2025-11-26 13:13:11.279554 | controller | 2025-11-26 13:13:11.331150 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 13:13:11.331176 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.060) 0:00:00.418 **** 2025-11-26 13:13:11.331193 | controller | ok: [instance] 2025-11-26 13:13:11.331339 | controller | 2025-11-26 13:13:11.331358 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 13:13:11.331369 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.052) 0:00:00.470 **** 2025-11-26 13:13:11.413219 | controller | ok: [instance] 2025-11-26 13:13:11.413313 | controller | 2025-11-26 13:13:11.413417 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 13:13:11.413521 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.082) 0:00:00.552 **** 2025-11-26 13:13:11.461571 | controller | skipping: [instance] 2025-11-26 13:13:11.461814 | controller | 2025-11-26 13:13:11.463139 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 13:13:11.463166 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.048) 0:00:00.601 **** 2025-11-26 13:13:11.519801 | controller | ok: [instance] 2025-11-26 13:13:11.519875 | controller | 2025-11-26 13:13:11.519996 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 13:13:11.520119 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.058) 0:00:00.659 **** 2025-11-26 13:13:11.567506 | controller | skipping: [instance] 2025-11-26 13:13:11.567613 | controller | 2025-11-26 13:13:11.567753 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 13:13:11.567871 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.047) 0:00:00.707 **** 2025-11-26 13:13:11.615971 | controller | skipping: [instance] 2025-11-26 13:13:11.616127 | controller | 2025-11-26 13:13:11.616229 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 13:13:11.616343 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.048) 0:00:00.755 **** 2025-11-26 13:13:11.666870 | controller | skipping: [instance] 2025-11-26 13:13:11.666958 | controller | 2025-11-26 13:13:11.667088 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-26 13:13:11.667182 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.050) 0:00:00.806 **** 2025-11-26 13:13:11.712217 | controller | skipping: [instance] 2025-11-26 13:13:11.712344 | controller | 2025-11-26 13:13:11.712419 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-26 13:13:11.712609 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.045) 0:00:00.852 **** 2025-11-26 13:13:11.764552 | controller | skipping: [instance] 2025-11-26 13:13:11.764642 | controller | 2025-11-26 13:13:11.764784 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-26 13:13:11.764939 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.052) 0:00:00.904 **** 2025-11-26 13:13:11.830949 | controller | skipping: [instance] 2025-11-26 13:13:11.831143 | controller | 2025-11-26 13:13:11.831169 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:11.831304 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.065) 0:00:00.969 **** 2025-11-26 13:13:11.875464 | controller | skipping: [instance] 2025-11-26 13:13:11.875551 | controller | 2025-11-26 13:13:11.875660 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:11.875762 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.045) 0:00:01.015 **** 2025-11-26 13:13:11.916973 | controller | skipping: [instance] 2025-11-26 13:13:11.917063 | controller | 2025-11-26 13:13:11.917186 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:11.917306 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.041) 0:00:01.057 **** 2025-11-26 13:13:11.957792 | controller | skipping: [instance] 2025-11-26 13:13:11.957879 | controller | 2025-11-26 13:13:11.957988 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:11.958134 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.040) 0:00:01.097 **** 2025-11-26 13:13:11.982907 | controller | ok: [instance] 2025-11-26 13:13:11.983036 | controller | 2025-11-26 13:13:11.983180 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:11.983308 | controller | Wednesday 26 November 2025 13:13:11 +0000 (0:00:00.025) 0:00:01.123 **** 2025-11-26 13:13:12.011478 | controller | ok: [instance] 2025-11-26 13:13:12.011568 | controller | 2025-11-26 13:13:12.011687 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:12.011795 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.028) 0:00:01.151 **** 2025-11-26 13:13:12.038638 | controller | ok: [instance] => 2025-11-26 13:13:12.038753 | controller | msg: 'Running: No volume, with worker' 2025-11-26 13:13:12.038833 | controller | 2025-11-26 13:13:12.038922 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:12.039047 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.027) 0:00:01.178 **** 2025-11-26 13:13:12.082508 | controller | 2025-11-26 13:13:12.082615 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 13:13:12.082718 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.043) 0:00:01.222 **** 2025-11-26 13:13:12.146558 | controller | ok: [instance] 2025-11-26 13:13:12.146748 | controller | 2025-11-26 13:13:12.146873 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 13:13:12.146894 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.064) 0:00:01.286 **** 2025-11-26 13:13:12.192236 | controller | ok: [instance] 2025-11-26 13:13:12.192320 | controller | 2025-11-26 13:13:12.192427 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 13:13:12.192529 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.045) 0:00:01.332 **** 2025-11-26 13:13:12.343206 | controller | ok: [instance] 2025-11-26 13:13:12.343293 | controller | 2025-11-26 13:13:12.343407 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 13:13:12.343511 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.151) 0:00:01.483 **** 2025-11-26 13:13:12.424196 | controller | ok: [instance] 2025-11-26 13:13:12.424296 | controller | 2025-11-26 13:13:12.424382 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 13:13:12.424501 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.080) 0:00:01.564 **** 2025-11-26 13:13:12.483258 | controller | ok: [instance] 2025-11-26 13:13:12.483345 | controller | 2025-11-26 13:13:12.483463 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 13:13:12.483608 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.059) 0:00:01.623 **** 2025-11-26 13:13:12.541240 | controller | skipping: [instance] 2025-11-26 13:13:12.541339 | controller | 2025-11-26 13:13:12.541468 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 13:13:12.541560 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.057) 0:00:01.681 **** 2025-11-26 13:13:12.591926 | controller | skipping: [instance] 2025-11-26 13:13:12.592035 | controller | 2025-11-26 13:13:12.592147 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 13:13:12.592248 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.050) 0:00:01.731 **** 2025-11-26 13:13:12.649104 | controller | skipping: [instance] 2025-11-26 13:13:12.649210 | controller | 2025-11-26 13:13:12.649348 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-26 13:13:12.649469 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.057) 0:00:01.788 **** 2025-11-26 13:13:12.704183 | controller | skipping: [instance] 2025-11-26 13:13:12.704288 | controller | 2025-11-26 13:13:12.704395 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-26 13:13:12.704493 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.055) 0:00:01.844 **** 2025-11-26 13:13:12.748711 | controller | skipping: [instance] 2025-11-26 13:13:12.748820 | controller | 2025-11-26 13:13:12.748960 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-26 13:13:12.749093 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.044) 0:00:01.888 **** 2025-11-26 13:13:12.804772 | controller | skipping: [instance] 2025-11-26 13:13:12.804845 | controller | 2025-11-26 13:13:12.804992 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:12.805114 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.055) 0:00:01.944 **** 2025-11-26 13:13:12.861199 | controller | skipping: [instance] 2025-11-26 13:13:12.861311 | controller | 2025-11-26 13:13:12.861430 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:12.861520 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.056) 0:00:02.000 **** 2025-11-26 13:13:12.905509 | controller | skipping: [instance] 2025-11-26 13:13:12.905607 | controller | 2025-11-26 13:13:12.905719 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:12.905843 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.044) 0:00:02.045 **** 2025-11-26 13:13:12.951083 | controller | skipping: [instance] 2025-11-26 13:13:12.951589 | controller | 2025-11-26 13:13:12.951716 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:12.951810 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.045) 0:00:02.090 **** 2025-11-26 13:13:12.976684 | controller | ok: [instance] 2025-11-26 13:13:12.976794 | controller | 2025-11-26 13:13:12.976941 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:12.977082 | controller | Wednesday 26 November 2025 13:13:12 +0000 (0:00:00.025) 0:00:02.116 **** 2025-11-26 13:13:13.009636 | controller | ok: [instance] 2025-11-26 13:13:13.009748 | controller | 2025-11-26 13:13:13.009859 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:13.009981 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.032) 0:00:02.149 **** 2025-11-26 13:13:13.040984 | controller | ok: [instance] => 2025-11-26 13:13:13.041146 | controller | msg: 'Running: Volume, no worker' 2025-11-26 13:13:13.041231 | controller | 2025-11-26 13:13:13.041338 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:13.041463 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.031) 0:00:02.180 **** 2025-11-26 13:13:13.090564 | controller | 2025-11-26 13:13:13.090728 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 13:13:13.090849 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.049) 0:00:02.230 **** 2025-11-26 13:13:13.159435 | controller | ok: [instance] 2025-11-26 13:13:13.159543 | controller | 2025-11-26 13:13:13.159642 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 13:13:13.159769 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.068) 0:00:02.298 **** 2025-11-26 13:13:13.207565 | controller | ok: [instance] 2025-11-26 13:13:13.207663 | controller | 2025-11-26 13:13:13.207779 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 13:13:13.207887 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.048) 0:00:02.347 **** 2025-11-26 13:13:13.285989 | controller | ok: [instance] 2025-11-26 13:13:13.286115 | controller | 2025-11-26 13:13:13.286221 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 13:13:13.286332 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.078) 0:00:02.425 **** 2025-11-26 13:13:13.333769 | controller | skipping: [instance] 2025-11-26 13:13:13.333868 | controller | 2025-11-26 13:13:13.333973 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 13:13:13.334100 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.047) 0:00:02.473 **** 2025-11-26 13:13:13.406907 | controller | skipping: [instance] 2025-11-26 13:13:13.407029 | controller | 2025-11-26 13:13:13.407134 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 13:13:13.407244 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.073) 0:00:02.547 **** 2025-11-26 13:13:13.453109 | controller | ok: [instance] 2025-11-26 13:13:13.454773 | controller | 2025-11-26 13:13:13.506528 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 13:13:13.506551 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.046) 0:00:02.593 **** 2025-11-26 13:13:13.506563 | controller | skipping: [instance] 2025-11-26 13:13:13.506651 | controller | 2025-11-26 13:13:13.506800 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 13:13:13.506907 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.053) 0:00:02.646 **** 2025-11-26 13:13:13.584552 | controller | ok: [instance] 2025-11-26 13:13:13.584905 | controller | 2025-11-26 13:13:13.658781 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-26 13:13:13.658808 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.077) 0:00:02.724 **** 2025-11-26 13:13:13.658821 | controller | ok: [instance] 2025-11-26 13:13:13.658875 | controller | 2025-11-26 13:13:13.659030 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-26 13:13:13.659157 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.074) 0:00:02.798 **** 2025-11-26 13:13:13.732084 | controller | ok: [instance] => changed=false 2025-11-26 13:13:13.732212 | controller | msg: All assertions passed 2025-11-26 13:13:13.732292 | controller | 2025-11-26 13:13:13.732398 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-26 13:13:13.732495 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.072) 0:00:02.871 **** 2025-11-26 13:13:13.821730 | controller | ok: [instance] => changed=false 2025-11-26 13:13:13.821828 | controller | msg: All assertions passed 2025-11-26 13:13:13.821923 | controller | 2025-11-26 13:13:13.822091 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:13.822202 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.089) 0:00:02.961 **** 2025-11-26 13:13:13.863766 | controller | skipping: [instance] 2025-11-26 13:13:13.863856 | controller | 2025-11-26 13:13:13.863966 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:13.864095 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.042) 0:00:03.003 **** 2025-11-26 13:13:13.905392 | controller | skipping: [instance] 2025-11-26 13:13:13.905497 | controller | 2025-11-26 13:13:13.905602 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:13.905723 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.041) 0:00:03.045 **** 2025-11-26 13:13:13.943128 | controller | skipping: [instance] 2025-11-26 13:13:13.943224 | controller | 2025-11-26 13:13:13.943336 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:13.943427 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.037) 0:00:03.083 **** 2025-11-26 13:13:13.968482 | controller | ok: [instance] 2025-11-26 13:13:13.968557 | controller | 2025-11-26 13:13:13.968661 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:13.968785 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.025) 0:00:03.108 **** 2025-11-26 13:13:13.999263 | controller | ok: [instance] 2025-11-26 13:13:13.999362 | controller | 2025-11-26 13:13:13.999465 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:13.999567 | controller | Wednesday 26 November 2025 13:13:13 +0000 (0:00:00.030) 0:00:03.139 **** 2025-11-26 13:13:14.031000 | controller | ok: [instance] => 2025-11-26 13:13:14.031113 | controller | msg: 'Running: Volume, with worker' 2025-11-26 13:13:14.031201 | controller | 2025-11-26 13:13:14.031299 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:14.031397 | controller | Wednesday 26 November 2025 13:13:14 +0000 (0:00:00.031) 0:00:03.171 **** 2025-11-26 13:13:14.073866 | controller | 2025-11-26 13:13:14.074183 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 13:13:14.074308 | controller | Wednesday 26 November 2025 13:13:14 +0000 (0:00:00.043) 0:00:03.214 **** 2025-11-26 13:13:14.135429 | controller | ok: [instance] 2025-11-26 13:13:14.135520 | controller | 2025-11-26 13:13:14.135626 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 13:13:14.135741 | controller | Wednesday 26 November 2025 13:13:14 +0000 (0:00:00.061) 0:00:03.275 **** 2025-11-26 13:13:14.179751 | controller | ok: [instance] 2025-11-26 13:13:14.180025 | controller | 2025-11-26 13:13:14.180141 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 13:13:14.180243 | controller | Wednesday 26 November 2025 13:13:14 +0000 (0:00:00.044) 0:00:03.319 **** 2025-11-26 13:13:14.255676 | controller | ok: [instance] 2025-11-26 13:13:14.255770 | controller | 2025-11-26 13:13:14.255885 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 13:13:14.256039 | controller | Wednesday 26 November 2025 13:13:14 +0000 (0:00:00.075) 0:00:03.395 **** 2025-11-26 13:13:14.343074 | controller | ok: [instance] 2025-11-26 13:13:14.343169 | controller | 2025-11-26 13:13:14.343276 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 13:13:14.343386 | controller | Wednesday 26 November 2025 13:13:14 +0000 (0:00:00.087) 0:00:03.482 **** 2025-11-26 13:13:14.389024 | controller | skipping: [instance] 2025-11-26 13:13:14.389135 | controller | 2025-11-26 13:13:14.389246 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 13:13:14.389340 | controller | Wednesday 26 November 2025 13:13:14 +0000 (0:00:00.046) 0:00:03.528 **** 2025-11-26 13:13:14.438952 | controller | ok: [instance] 2025-11-26 13:13:14.439077 | controller | 2025-11-26 13:13:14.439175 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 13:13:14.439275 | controller | Wednesday 26 November 2025 13:13:14 +0000 (0:00:00.049) 0:00:03.578 **** 2025-11-26 13:13:14.504063 | controller | ok: [instance] 2025-11-26 13:13:14.504156 | controller | 2025-11-26 13:13:14.504254 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 13:13:14.504351 | controller | Wednesday 26 November 2025 13:13:14 +0000 (0:00:00.065) 0:00:03.643 **** 2025-11-26 13:13:14.633437 | controller | ok: [instance] 2025-11-26 13:13:14.633481 | controller | 2025-11-26 13:13:14.633592 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-26 13:13:14.633685 | controller | Wednesday 26 November 2025 13:13:14 +0000 (0:00:00.129) 0:00:03.773 **** 2025-11-26 13:13:14.704649 | controller | ok: [instance] 2025-11-26 13:13:14.704735 | controller | 2025-11-26 13:13:14.704844 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-26 13:13:14.704957 | controller | Wednesday 26 November 2025 13:13:14 +0000 (0:00:00.071) 0:00:03.844 **** 2025-11-26 13:13:14.794823 | controller | ok: [instance] => changed=false 2025-11-26 13:13:14.794921 | controller | msg: All assertions passed 2025-11-26 13:13:14.795058 | controller | 2025-11-26 13:13:14.795180 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-26 13:13:14.795292 | controller | Wednesday 26 November 2025 13:13:14 +0000 (0:00:00.088) 0:00:03.932 **** 2025-11-26 13:13:14.889527 | controller | ok: [instance] => changed=false 2025-11-26 13:13:14.889609 | controller | msg: All assertions passed 2025-11-26 13:13:14.889713 | controller | 2025-11-26 13:13:14.889821 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:14.889925 | controller | Wednesday 26 November 2025 13:13:14 +0000 (0:00:00.096) 0:00:04.029 **** 2025-11-26 13:13:14.930865 | controller | skipping: [instance] 2025-11-26 13:13:14.930961 | controller | 2025-11-26 13:13:14.931101 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:14.931268 | controller | Wednesday 26 November 2025 13:13:14 +0000 (0:00:00.041) 0:00:04.071 **** 2025-11-26 13:13:14.972907 | controller | skipping: [instance] 2025-11-26 13:13:14.973054 | controller | 2025-11-26 13:13:14.973135 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:14.973239 | controller | Wednesday 26 November 2025 13:13:14 +0000 (0:00:00.041) 0:00:04.112 **** 2025-11-26 13:13:15.012749 | controller | skipping: [instance] 2025-11-26 13:13:15.012839 | controller | 2025-11-26 13:13:15.012969 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:15.013100 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.039) 0:00:04.152 **** 2025-11-26 13:13:15.041300 | controller | ok: [instance] 2025-11-26 13:13:15.041399 | controller | 2025-11-26 13:13:15.041504 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:15.041609 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.028) 0:00:04.181 **** 2025-11-26 13:13:15.072797 | controller | ok: [instance] 2025-11-26 13:13:15.072897 | controller | 2025-11-26 13:13:15.073037 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:15.073141 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.031) 0:00:04.212 **** 2025-11-26 13:13:15.102254 | controller | ok: [instance] => 2025-11-26 13:13:15.102350 | controller | msg: 'Running: Too many allocated volumes' 2025-11-26 13:13:15.102447 | controller | 2025-11-26 13:13:15.102554 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:15.102688 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.029) 0:00:04.242 **** 2025-11-26 13:13:15.144597 | controller | 2025-11-26 13:13:15.144724 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 13:13:15.144819 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.042) 0:00:04.284 **** 2025-11-26 13:13:15.209783 | controller | ok: [instance] 2025-11-26 13:13:15.209888 | controller | 2025-11-26 13:13:15.210030 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 13:13:15.210141 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.064) 0:00:04.349 **** 2025-11-26 13:13:15.262504 | controller | ok: [instance] 2025-11-26 13:13:15.262620 | controller | 2025-11-26 13:13:15.262723 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 13:13:15.262833 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.050) 0:00:04.400 **** 2025-11-26 13:13:15.336289 | controller | ok: [instance] 2025-11-26 13:13:15.336330 | controller | 2025-11-26 13:13:15.336455 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 13:13:15.336548 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.075) 0:00:04.476 **** 2025-11-26 13:13:15.384589 | controller | skipping: [instance] 2025-11-26 13:13:15.384759 | controller | 2025-11-26 13:13:15.384898 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 13:13:15.385054 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.048) 0:00:04.524 **** 2025-11-26 13:13:15.440472 | controller | skipping: [instance] 2025-11-26 13:13:15.440548 | controller | 2025-11-26 13:13:15.440650 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 13:13:15.440764 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.055) 0:00:04.580 **** 2025-11-26 13:13:15.492373 | controller | ok: [instance] 2025-11-26 13:13:15.492473 | controller | 2025-11-26 13:13:15.492585 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 13:13:15.492703 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.052) 0:00:04.632 **** 2025-11-26 13:13:15.539222 | controller | skipping: [instance] 2025-11-26 13:13:15.539315 | controller | 2025-11-26 13:13:15.539418 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 13:13:15.539523 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.046) 0:00:04.679 **** 2025-11-26 13:13:15.605521 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:15.605626 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2025-11-26 13:13:15.605771 | controller | evaluated_to: false 2025-11-26 13:13:15.605893 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 3' 2025-11-26 13:13:15.688034 | controller | 2025-11-26 13:13:15.688158 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 13:13:15.688265 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.081) 0:00:04.760 **** 2025-11-26 13:13:15.688367 | controller | 2025-11-26 13:13:15.688471 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:15.688591 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.067) 0:00:04.827 **** 2025-11-26 13:13:15.714633 | controller | ok: [instance] 2025-11-26 13:13:15.714711 | controller | 2025-11-26 13:13:15.714811 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:15.714924 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.027) 0:00:04.854 **** 2025-11-26 13:13:15.753574 | controller | skipping: [instance] 2025-11-26 13:13:15.753656 | controller | 2025-11-26 13:13:15.753761 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:15.753986 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.038) 0:00:04.893 **** 2025-11-26 13:13:15.795443 | controller | skipping: [instance] 2025-11-26 13:13:15.795528 | controller | 2025-11-26 13:13:15.795637 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:15.795752 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.041) 0:00:04.935 **** 2025-11-26 13:13:15.834650 | controller | skipping: [instance] 2025-11-26 13:13:15.834746 | controller | 2025-11-26 13:13:15.834855 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:15.834967 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.038) 0:00:04.974 **** 2025-11-26 13:13:15.868791 | controller | ok: [instance] 2025-11-26 13:13:15.868875 | controller | 2025-11-26 13:13:15.868981 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:15.869119 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.034) 0:00:05.008 **** 2025-11-26 13:13:15.901789 | controller | ok: [instance] 2025-11-26 13:13:15.901893 | controller | 2025-11-26 13:13:15.902043 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:15.902172 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.033) 0:00:05.041 **** 2025-11-26 13:13:15.934560 | controller | ok: [instance] => 2025-11-26 13:13:15.934662 | controller | msg: 'Running: Different volume amount' 2025-11-26 13:13:15.934686 | controller | 2025-11-26 13:13:15.934774 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:15.934896 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.032) 0:00:05.074 **** 2025-11-26 13:13:15.984233 | controller | 2025-11-26 13:13:15.984353 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 13:13:15.984464 | controller | Wednesday 26 November 2025 13:13:15 +0000 (0:00:00.049) 0:00:05.124 **** 2025-11-26 13:13:16.053249 | controller | ok: [instance] 2025-11-26 13:13:16.053334 | controller | 2025-11-26 13:13:16.053435 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 13:13:16.053547 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.068) 0:00:05.192 **** 2025-11-26 13:13:16.104022 | controller | ok: [instance] 2025-11-26 13:13:16.104137 | controller | 2025-11-26 13:13:16.104243 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 13:13:16.104348 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.051) 0:00:05.243 **** 2025-11-26 13:13:16.189242 | controller | ok: [instance] 2025-11-26 13:13:16.189330 | controller | 2025-11-26 13:13:16.189428 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 13:13:16.189536 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.084) 0:00:05.328 **** 2025-11-26 13:13:16.273275 | controller | ok: [instance] 2025-11-26 13:13:16.273361 | controller | 2025-11-26 13:13:16.273472 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 13:13:16.273588 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.084) 0:00:05.413 **** 2025-11-26 13:13:16.328207 | controller | skipping: [instance] 2025-11-26 13:13:16.328296 | controller | 2025-11-26 13:13:16.328399 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 13:13:16.328493 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.053) 0:00:05.466 **** 2025-11-26 13:13:16.383610 | controller | ok: [instance] 2025-11-26 13:13:16.383708 | controller | 2025-11-26 13:13:16.383818 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 13:13:16.383926 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.056) 0:00:05.523 **** 2025-11-26 13:13:16.431839 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:16.431969 | controller | assertion: (_work.extra_disks_num is defined and _ocp.extra_disks_num == _work.extra_disks_num and _ocp.extra_disks_size is defined and _work.extra_disks_size is defined and _ocp.extra_disks_size == _work.extra_disks_size) or _ocp.extra_disks_num is undefined or _ocp.extra_disks_num == 0 2025-11-26 13:13:16.432092 | controller | evaluated_to: false 2025-11-26 13:13:16.432248 | controller | msg: 'Inconsistency detected: ensure you don''t allocate more disks in cifmw_lvms_disk_list and cifmw_devscripts_cinder_volume_pvs than available.' 2025-11-26 13:13:16.463868 | controller | 2025-11-26 13:13:16.463963 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 13:13:16.464112 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.061) 0:00:05.584 **** 2025-11-26 13:13:16.464175 | controller | 2025-11-26 13:13:16.464284 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:16.464376 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.018) 0:00:05.603 **** 2025-11-26 13:13:16.488861 | controller | ok: [instance] 2025-11-26 13:13:16.488970 | controller | 2025-11-26 13:13:16.489092 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:16.489206 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.025) 0:00:05.628 **** 2025-11-26 13:13:16.531681 | controller | skipping: [instance] 2025-11-26 13:13:16.531767 | controller | 2025-11-26 13:13:16.531865 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:16.531965 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.042) 0:00:05.671 **** 2025-11-26 13:13:16.572726 | controller | skipping: [instance] 2025-11-26 13:13:16.572841 | controller | 2025-11-26 13:13:16.572940 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:16.573101 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.041) 0:00:05.712 **** 2025-11-26 13:13:16.614889 | controller | skipping: [instance] 2025-11-26 13:13:16.614981 | controller | 2025-11-26 13:13:16.615107 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:16.615198 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.042) 0:00:05.754 **** 2025-11-26 13:13:16.641417 | controller | ok: [instance] 2025-11-26 13:13:16.641559 | controller | 2025-11-26 13:13:16.641683 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:16.641779 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.026) 0:00:05.781 **** 2025-11-26 13:13:16.717949 | controller | ok: [instance] 2025-11-26 13:13:16.718103 | controller | 2025-11-26 13:13:16.718247 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:16.718404 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.076) 0:00:05.858 **** 2025-11-26 13:13:16.746258 | controller | ok: [instance] => 2025-11-26 13:13:16.746351 | controller | msg: 'Running: Create LVM without volume' 2025-11-26 13:13:16.746454 | controller | 2025-11-26 13:13:16.746532 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:16.746622 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.028) 0:00:05.886 **** 2025-11-26 13:13:16.788936 | controller | 2025-11-26 13:13:16.789109 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 13:13:16.789290 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.042) 0:00:05.929 **** 2025-11-26 13:13:16.853467 | controller | ok: [instance] 2025-11-26 13:13:16.853579 | controller | 2025-11-26 13:13:16.853740 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 13:13:16.853904 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.064) 0:00:05.993 **** 2025-11-26 13:13:16.900581 | controller | ok: [instance] 2025-11-26 13:13:16.900669 | controller | 2025-11-26 13:13:16.900789 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 13:13:16.900892 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.047) 0:00:06.040 **** 2025-11-26 13:13:16.974235 | controller | ok: [instance] 2025-11-26 13:13:16.974339 | controller | 2025-11-26 13:13:16.974443 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 13:13:16.974554 | controller | Wednesday 26 November 2025 13:13:16 +0000 (0:00:00.073) 0:00:06.114 **** 2025-11-26 13:13:17.021246 | controller | skipping: [instance] 2025-11-26 13:13:17.021343 | controller | 2025-11-26 13:13:17.021449 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 13:13:17.021566 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.046) 0:00:06.161 **** 2025-11-26 13:13:17.064063 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:17.064182 | controller | assertion: not cifmw_devscripts_create_logical_volume | bool 2025-11-26 13:13:17.064269 | controller | evaluated_to: false 2025-11-26 13:13:17.064374 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2025-11-26 13:13:17.094366 | controller | 2025-11-26 13:13:17.094470 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 13:13:17.094568 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.056) 0:00:06.217 **** 2025-11-26 13:13:17.094663 | controller | 2025-11-26 13:13:17.094799 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:17.094883 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.016) 0:00:06.234 **** 2025-11-26 13:13:17.120653 | controller | ok: [instance] 2025-11-26 13:13:17.163633 | controller | 2025-11-26 13:13:17.163655 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:17.163663 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.025) 0:00:06.260 **** 2025-11-26 13:13:17.163693 | controller | skipping: [instance] 2025-11-26 13:13:17.163802 | controller | 2025-11-26 13:13:17.163905 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:17.164029 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.043) 0:00:06.303 **** 2025-11-26 13:13:17.203359 | controller | skipping: [instance] 2025-11-26 13:13:17.203439 | controller | 2025-11-26 13:13:17.203544 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:17.203646 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.039) 0:00:06.343 **** 2025-11-26 13:13:17.241197 | controller | skipping: [instance] 2025-11-26 13:13:17.241286 | controller | 2025-11-26 13:13:17.241391 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:17.241505 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.037) 0:00:06.380 **** 2025-11-26 13:13:17.268641 | controller | ok: [instance] 2025-11-26 13:13:17.268797 | controller | 2025-11-26 13:13:17.268857 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:17.268963 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.027) 0:00:06.408 **** 2025-11-26 13:13:17.306069 | controller | ok: [instance] 2025-11-26 13:13:17.306157 | controller | 2025-11-26 13:13:17.306259 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:17.306355 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.037) 0:00:06.446 **** 2025-11-26 13:13:17.338361 | controller | ok: [instance] => 2025-11-26 13:13:17.338471 | controller | msg: 'Running: Create LVMS without volume' 2025-11-26 13:13:17.338555 | controller | 2025-11-26 13:13:17.338653 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:17.338760 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.032) 0:00:06.478 **** 2025-11-26 13:13:17.390714 | controller | 2025-11-26 13:13:17.390824 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 13:13:17.390930 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.052) 0:00:06.530 **** 2025-11-26 13:13:17.460312 | controller | ok: [instance] 2025-11-26 13:13:17.460350 | controller | 2025-11-26 13:13:17.460532 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 13:13:17.460664 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.069) 0:00:06.600 **** 2025-11-26 13:13:17.508792 | controller | ok: [instance] 2025-11-26 13:13:17.508943 | controller | 2025-11-26 13:13:17.509179 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 13:13:17.583986 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.048) 0:00:06.648 **** 2025-11-26 13:13:17.584028 | controller | ok: [instance] 2025-11-26 13:13:17.584093 | controller | 2025-11-26 13:13:17.584192 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 13:13:17.584290 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.075) 0:00:06.724 **** 2025-11-26 13:13:17.626456 | controller | skipping: [instance] 2025-11-26 13:13:17.626537 | controller | 2025-11-26 13:13:17.626643 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 13:13:17.626753 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.042) 0:00:06.766 **** 2025-11-26 13:13:17.761435 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:17.761506 | controller | assertion: cifmw_lvms_disk_list is undefined or (cifmw_lvms_disk_list | length) == 0 2025-11-26 13:13:17.761608 | controller | evaluated_to: false 2025-11-26 13:13:17.761726 | controller | msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members' 2025-11-26 13:13:17.786807 | controller | 2025-11-26 13:13:17.786931 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 13:13:17.787100 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.145) 0:00:06.911 **** 2025-11-26 13:13:17.787201 | controller | 2025-11-26 13:13:17.787297 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:17.787425 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.015) 0:00:06.926 **** 2025-11-26 13:13:17.815188 | controller | ok: [instance] 2025-11-26 13:13:17.815273 | controller | 2025-11-26 13:13:17.815400 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:17.815504 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.028) 0:00:06.955 **** 2025-11-26 13:13:17.865473 | controller | skipping: [instance] 2025-11-26 13:13:17.865558 | controller | 2025-11-26 13:13:17.865656 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:17.865766 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.050) 0:00:07.005 **** 2025-11-26 13:13:17.905730 | controller | skipping: [instance] 2025-11-26 13:13:17.906053 | controller | 2025-11-26 13:13:17.906197 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:17.906219 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.040) 0:00:07.045 **** 2025-11-26 13:13:17.948035 | controller | skipping: [instance] 2025-11-26 13:13:17.948133 | controller | 2025-11-26 13:13:17.948271 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:17.948351 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.042) 0:00:07.087 **** 2025-11-26 13:13:17.977281 | controller | ok: [instance] 2025-11-26 13:13:17.977414 | controller | 2025-11-26 13:13:17.977538 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:17.977689 | controller | Wednesday 26 November 2025 13:13:17 +0000 (0:00:00.029) 0:00:07.117 **** 2025-11-26 13:13:18.008163 | controller | ok: [instance] 2025-11-26 13:13:18.008258 | controller | 2025-11-26 13:13:18.008364 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:18.008471 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.031) 0:00:07.148 **** 2025-11-26 13:13:18.041876 | controller | ok: [instance] => 2025-11-26 13:13:18.041950 | controller | msg: 'Running: Allocate same volume twice' 2025-11-26 13:13:18.042061 | controller | 2025-11-26 13:13:18.042182 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:18.042282 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.033) 0:00:07.181 **** 2025-11-26 13:13:18.088893 | controller | 2025-11-26 13:13:18.089033 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 13:13:18.089163 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.047) 0:00:07.228 **** 2025-11-26 13:13:18.149524 | controller | ok: [instance] 2025-11-26 13:13:18.149587 | controller | 2025-11-26 13:13:18.149691 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 13:13:18.149792 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.060) 0:00:07.289 **** 2025-11-26 13:13:18.197705 | controller | ok: [instance] 2025-11-26 13:13:18.197803 | controller | 2025-11-26 13:13:18.197904 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 13:13:18.198046 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.048) 0:00:07.337 **** 2025-11-26 13:13:18.267922 | controller | ok: [instance] 2025-11-26 13:13:18.268032 | controller | 2025-11-26 13:13:18.268150 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 13:13:18.268300 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.070) 0:00:07.407 **** 2025-11-26 13:13:18.331682 | controller | skipping: [instance] 2025-11-26 13:13:18.331765 | controller | 2025-11-26 13:13:18.331864 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 13:13:18.331962 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.063) 0:00:07.471 **** 2025-11-26 13:13:18.379277 | controller | skipping: [instance] 2025-11-26 13:13:18.379366 | controller | 2025-11-26 13:13:18.379470 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 13:13:18.379573 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.047) 0:00:07.519 **** 2025-11-26 13:13:18.435182 | controller | ok: [instance] 2025-11-26 13:13:18.435269 | controller | 2025-11-26 13:13:18.435375 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 13:13:18.435479 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.054) 0:00:07.574 **** 2025-11-26 13:13:18.487881 | controller | skipping: [instance] 2025-11-26 13:13:18.487982 | controller | 2025-11-26 13:13:18.488152 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 13:13:18.488233 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.053) 0:00:07.627 **** 2025-11-26 13:13:18.552540 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:18.552707 | controller | assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int 2025-11-26 13:13:18.552852 | controller | evaluated_to: false 2025-11-26 13:13:18.553070 | controller | msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 4' 2025-11-26 13:13:18.583869 | controller | 2025-11-26 13:13:18.583969 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 13:13:18.584112 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.079) 0:00:07.707 **** 2025-11-26 13:13:18.584208 | controller | 2025-11-26 13:13:18.584306 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:18.584408 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.016) 0:00:07.723 **** 2025-11-26 13:13:18.611910 | controller | ok: [instance] 2025-11-26 13:13:18.612059 | controller | 2025-11-26 13:13:18.612222 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:18.612250 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.028) 0:00:07.752 **** 2025-11-26 13:13:18.653468 | controller | skipping: [instance] 2025-11-26 13:13:18.653569 | controller | 2025-11-26 13:13:18.653683 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:18.653790 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.041) 0:00:07.793 **** 2025-11-26 13:13:18.752239 | controller | skipping: [instance] 2025-11-26 13:13:18.752309 | controller | 2025-11-26 13:13:18.752408 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:18.752503 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.098) 0:00:07.892 **** 2025-11-26 13:13:18.788088 | controller | skipping: [instance] 2025-11-26 13:13:18.788182 | controller | 2025-11-26 13:13:18.788282 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:18.788383 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.035) 0:00:07.928 **** 2025-11-26 13:13:18.817985 | controller | ok: [instance] 2025-11-26 13:13:18.818111 | controller | 2025-11-26 13:13:18.818209 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:18.818318 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.029) 0:00:07.958 **** 2025-11-26 13:13:18.850902 | controller | ok: [instance] 2025-11-26 13:13:18.851004 | controller | 2025-11-26 13:13:18.851151 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:18.851252 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.032) 0:00:07.990 **** 2025-11-26 13:13:18.883096 | controller | ok: [instance] => 2025-11-26 13:13:18.883227 | controller | msg: 'Running: Allocate same volume twice - no LVMS' 2025-11-26 13:13:18.883267 | controller | 2025-11-26 13:13:18.883369 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:18.883468 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.032) 0:00:08.023 **** 2025-11-26 13:13:18.927049 | controller | 2025-11-26 13:13:18.927149 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 13:13:18.927249 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.043) 0:00:08.067 **** 2025-11-26 13:13:18.990628 | controller | ok: [instance] 2025-11-26 13:13:18.990734 | controller | 2025-11-26 13:13:18.990848 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 13:13:18.990945 | controller | Wednesday 26 November 2025 13:13:18 +0000 (0:00:00.063) 0:00:08.130 **** 2025-11-26 13:13:19.050484 | controller | ok: [instance] 2025-11-26 13:13:19.050566 | controller | 2025-11-26 13:13:19.050662 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 13:13:19.050768 | controller | Wednesday 26 November 2025 13:13:19 +0000 (0:00:00.059) 0:00:08.190 **** 2025-11-26 13:13:19.130548 | controller | ok: [instance] 2025-11-26 13:13:19.130662 | controller | 2025-11-26 13:13:19.130785 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 13:13:19.130894 | controller | Wednesday 26 November 2025 13:13:19 +0000 (0:00:00.080) 0:00:08.270 **** 2025-11-26 13:13:19.184118 | controller | skipping: [instance] 2025-11-26 13:13:19.184204 | controller | 2025-11-26 13:13:19.184302 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 13:13:19.184403 | controller | Wednesday 26 November 2025 13:13:19 +0000 (0:00:00.053) 0:00:08.324 **** 2025-11-26 13:13:19.231243 | controller | skipping: [instance] 2025-11-26 13:13:19.231349 | controller | 2025-11-26 13:13:19.231470 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 13:13:19.231578 | controller | Wednesday 26 November 2025 13:13:19 +0000 (0:00:00.047) 0:00:08.371 **** 2025-11-26 13:13:19.287743 | controller | ok: [instance] 2025-11-26 13:13:19.287876 | controller | 2025-11-26 13:13:19.288047 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 13:13:19.288210 | controller | Wednesday 26 November 2025 13:13:19 +0000 (0:00:00.056) 0:00:08.427 **** 2025-11-26 13:13:19.345003 | controller | skipping: [instance] 2025-11-26 13:13:19.345103 | controller | 2025-11-26 13:13:19.345218 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 13:13:19.345320 | controller | Wednesday 26 November 2025 13:13:19 +0000 (0:00:00.056) 0:00:08.483 **** 2025-11-26 13:13:19.432002 | controller | ok: [instance] 2025-11-26 13:13:19.432131 | controller | 2025-11-26 13:13:19.432231 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-26 13:13:19.432355 | controller | Wednesday 26 November 2025 13:13:19 +0000 (0:00:00.087) 0:00:08.571 **** 2025-11-26 13:13:19.496582 | controller | skipping: [instance] 2025-11-26 13:13:19.496693 | controller | 2025-11-26 13:13:19.496801 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-26 13:13:19.496911 | controller | Wednesday 26 November 2025 13:13:19 +0000 (0:00:00.064) 0:00:08.636 **** 2025-11-26 13:13:19.582468 | controller | ok: [instance] => changed=false 2025-11-26 13:13:19.582612 | controller | msg: All assertions passed 2025-11-26 13:13:19.582762 | controller | 2025-11-26 13:13:19.582915 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-26 13:13:19.583103 | controller | Wednesday 26 November 2025 13:13:19 +0000 (0:00:00.086) 0:00:08.722 **** 2025-11-26 13:13:19.669783 | controller | ok: [instance] => changed=false 2025-11-26 13:13:19.669862 | controller | msg: All assertions passed 2025-11-26 13:13:19.669965 | controller | 2025-11-26 13:13:19.670103 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:19.670187 | controller | Wednesday 26 November 2025 13:13:19 +0000 (0:00:00.087) 0:00:08.809 **** 2025-11-26 13:13:19.719980 | controller | skipping: [instance] 2025-11-26 13:13:19.720104 | controller | 2025-11-26 13:13:19.720216 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:19.720311 | controller | Wednesday 26 November 2025 13:13:19 +0000 (0:00:00.049) 0:00:08.858 **** 2025-11-26 13:13:19.761746 | controller | skipping: [instance] 2025-11-26 13:13:19.761857 | controller | 2025-11-26 13:13:19.761970 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:19.762102 | controller | Wednesday 26 November 2025 13:13:19 +0000 (0:00:00.042) 0:00:08.901 **** 2025-11-26 13:13:19.804493 | controller | skipping: [instance] 2025-11-26 13:13:19.804585 | controller | 2025-11-26 13:13:19.804694 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:19.804788 | controller | Wednesday 26 November 2025 13:13:19 +0000 (0:00:00.042) 0:00:08.944 **** 2025-11-26 13:13:19.906260 | controller | ok: [instance] 2025-11-26 13:13:19.906347 | controller | 2025-11-26 13:13:19.906443 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:19.906538 | controller | Wednesday 26 November 2025 13:13:19 +0000 (0:00:00.101) 0:00:09.045 **** 2025-11-26 13:13:19.938059 | controller | ok: [instance] 2025-11-26 13:13:19.938168 | controller | 2025-11-26 13:13:19.938271 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:19.938366 | controller | Wednesday 26 November 2025 13:13:19 +0000 (0:00:00.032) 0:00:09.078 **** 2025-11-26 13:13:19.966935 | controller | ok: [instance] => 2025-11-26 13:13:19.967054 | controller | msg: 'Running: Allocate same volume twice - no cinder_lvm' 2025-11-26 13:13:19.967155 | controller | 2025-11-26 13:13:19.967260 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:19.967362 | controller | Wednesday 26 November 2025 13:13:19 +0000 (0:00:00.028) 0:00:09.107 **** 2025-11-26 13:13:20.010446 | controller | 2025-11-26 13:13:20.010565 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 13:13:20.010670 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.043) 0:00:09.150 **** 2025-11-26 13:13:20.083290 | controller | ok: [instance] 2025-11-26 13:13:20.083369 | controller | 2025-11-26 13:13:20.083472 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 13:13:20.083572 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.072) 0:00:09.223 **** 2025-11-26 13:13:20.138159 | controller | ok: [instance] 2025-11-26 13:13:20.218764 | controller | 2025-11-26 13:13:20.218817 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 13:13:20.218835 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.054) 0:00:09.277 **** 2025-11-26 13:13:20.218850 | controller | ok: [instance] 2025-11-26 13:13:20.218925 | controller | 2025-11-26 13:13:20.218937 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 13:13:20.219075 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.081) 0:00:09.358 **** 2025-11-26 13:13:20.265433 | controller | skipping: [instance] 2025-11-26 13:13:20.265507 | controller | 2025-11-26 13:13:20.265603 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 13:13:20.265716 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.046) 0:00:09.405 **** 2025-11-26 13:13:20.317155 | controller | skipping: [instance] 2025-11-26 13:13:20.317235 | controller | 2025-11-26 13:13:20.317347 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 13:13:20.317440 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.051) 0:00:09.456 **** 2025-11-26 13:13:20.373715 | controller | ok: [instance] 2025-11-26 13:13:20.373811 | controller | 2025-11-26 13:13:20.373924 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 13:13:20.374068 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.056) 0:00:09.513 **** 2025-11-26 13:13:20.423870 | controller | skipping: [instance] 2025-11-26 13:13:20.423954 | controller | 2025-11-26 13:13:20.424076 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 13:13:20.424192 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.050) 0:00:09.563 **** 2025-11-26 13:13:20.502915 | controller | ok: [instance] 2025-11-26 13:13:20.503045 | controller | 2025-11-26 13:13:20.503161 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-26 13:13:20.503262 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.079) 0:00:09.642 **** 2025-11-26 13:13:20.572794 | controller | skipping: [instance] 2025-11-26 13:13:20.660423 | controller | 2025-11-26 13:13:20.660448 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-26 13:13:20.660457 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.068) 0:00:09.711 **** 2025-11-26 13:13:20.660467 | controller | ok: [instance] => changed=false 2025-11-26 13:13:20.660524 | controller | msg: All assertions passed 2025-11-26 13:13:20.660613 | controller | 2025-11-26 13:13:20.660732 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-26 13:13:20.660846 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.088) 0:00:09.800 **** 2025-11-26 13:13:20.728055 | controller | skipping: [instance] 2025-11-26 13:13:20.728207 | controller | 2025-11-26 13:13:20.728344 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:20.728478 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.066) 0:00:09.867 **** 2025-11-26 13:13:20.773993 | controller | skipping: [instance] 2025-11-26 13:13:20.774123 | controller | 2025-11-26 13:13:20.774243 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:20.774304 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.046) 0:00:09.914 **** 2025-11-26 13:13:20.815443 | controller | skipping: [instance] 2025-11-26 13:13:20.815524 | controller | 2025-11-26 13:13:20.815644 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:20.815738 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.041) 0:00:09.955 **** 2025-11-26 13:13:20.865287 | controller | skipping: [instance] 2025-11-26 13:13:20.865358 | controller | 2025-11-26 13:13:20.865475 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:20.865577 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.049) 0:00:10.005 **** 2025-11-26 13:13:20.895517 | controller | ok: [instance] 2025-11-26 13:13:20.895600 | controller | 2025-11-26 13:13:20.895710 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:20.895813 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.030) 0:00:10.035 **** 2025-11-26 13:13:20.931226 | controller | ok: [instance] 2025-11-26 13:13:20.931306 | controller | 2025-11-26 13:13:20.931402 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:20.931508 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.035) 0:00:10.071 **** 2025-11-26 13:13:20.962357 | controller | ok: [instance] => 2025-11-26 13:13:20.962432 | controller | msg: 'Running: Config overrides via devscripts' 2025-11-26 13:13:20.962531 | controller | 2025-11-26 13:13:20.962626 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:20.962715 | controller | Wednesday 26 November 2025 13:13:20 +0000 (0:00:00.031) 0:00:10.102 **** 2025-11-26 13:13:21.085617 | controller | 2025-11-26 13:13:21.085733 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 13:13:21.085851 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.122) 0:00:10.225 **** 2025-11-26 13:13:21.122718 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:21.122825 | controller | assertion: cifmw_devscripts_config.master_memory is undefined 2025-11-26 13:13:21.122923 | controller | evaluated_to: false 2025-11-26 13:13:21.123073 | controller | msg: 'Inconsistency detected: your environment wants to provide devscripts configuration overrides. This isn''t supported, and you must pass those ressource allocation via the usual cifmw_libvirt_manager_configuration, or patch it.' 2025-11-26 13:13:21.148791 | controller | 2025-11-26 13:13:21.148877 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 13:13:21.148964 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.048) 0:00:10.273 **** 2025-11-26 13:13:21.149122 | controller | 2025-11-26 13:13:21.149242 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:21.149310 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.015) 0:00:10.289 **** 2025-11-26 13:13:21.173282 | controller | ok: [instance] 2025-11-26 13:13:21.173390 | controller | 2025-11-26 13:13:21.173499 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:21.173617 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.024) 0:00:10.313 **** 2025-11-26 13:13:21.221985 | controller | skipping: [instance] 2025-11-26 13:13:21.222104 | controller | 2025-11-26 13:13:21.222207 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:21.222282 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.048) 0:00:10.361 **** 2025-11-26 13:13:21.270493 | controller | skipping: [instance] 2025-11-26 13:13:21.270577 | controller | 2025-11-26 13:13:21.270690 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:21.270796 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.048) 0:00:10.410 **** 2025-11-26 13:13:21.313114 | controller | skipping: [instance] 2025-11-26 13:13:21.313236 | controller | 2025-11-26 13:13:21.313286 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:21.313397 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.042) 0:00:10.453 **** 2025-11-26 13:13:21.346865 | controller | ok: [instance] 2025-11-26 13:13:21.346947 | controller | 2025-11-26 13:13:21.347080 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:21.347186 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.033) 0:00:10.486 **** 2025-11-26 13:13:21.389728 | controller | ok: [instance] 2025-11-26 13:13:21.390354 | controller | 2025-11-26 13:13:21.391330 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:21.392077 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.041) 0:00:10.527 **** 2025-11-26 13:13:21.431841 | controller | ok: [instance] => 2025-11-26 13:13:21.431958 | controller | msg: 'Running: Inject 10 dev-scripts extra_worker' 2025-11-26 13:13:21.432104 | controller | 2025-11-26 13:13:21.432200 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:21.432309 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.044) 0:00:10.571 **** 2025-11-26 13:13:21.479951 | controller | 2025-11-26 13:13:21.480096 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 13:13:21.480206 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.048) 0:00:10.620 **** 2025-11-26 13:13:21.548986 | controller | ok: [instance] 2025-11-26 13:13:21.549080 | controller | 2025-11-26 13:13:21.549207 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 13:13:21.549259 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.068) 0:00:10.688 **** 2025-11-26 13:13:21.588547 | controller | fatal: [instance]: FAILED! => changed=false 2025-11-26 13:13:21.588649 | controller | assertion: cifmw_devscripts_config.num_extra_workers is undefined or cifmw_devscripts_config.num_extra_workers == 0 2025-11-26 13:13:21.588761 | controller | evaluated_to: false 2025-11-26 13:13:21.588874 | controller | msg: 'Inconsistency detected: dev-scripts extra_worker resources aren''t supported here. You can create compute, networker or any other kind of VM by defining it as you define OCP cluster nodes.' 2025-11-26 13:13:21.618144 | controller | 2025-11-26 13:13:21.618228 | controller | TASK [Clear host errors] ******************************************************* 2025-11-26 13:13:21.618328 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.053) 0:00:10.742 **** 2025-11-26 13:13:21.618404 | controller | 2025-11-26 13:13:21.618496 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:21.618591 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.016) 0:00:10.758 **** 2025-11-26 13:13:21.642844 | controller | ok: [instance] 2025-11-26 13:13:21.642969 | controller | 2025-11-26 13:13:21.643076 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:21.643190 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.024) 0:00:10.783 **** 2025-11-26 13:13:21.689978 | controller | skipping: [instance] 2025-11-26 13:13:21.690108 | controller | 2025-11-26 13:13:21.690208 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:21.690305 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.046) 0:00:10.830 **** 2025-11-26 13:13:21.734926 | controller | skipping: [instance] 2025-11-26 13:13:21.735041 | controller | 2025-11-26 13:13:21.735173 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:21.735254 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.044) 0:00:10.875 **** 2025-11-26 13:13:21.773535 | controller | skipping: [instance] 2025-11-26 13:13:21.773613 | controller | 2025-11-26 13:13:21.773720 | controller | TASK [Mark run as failed] ****************************************************** 2025-11-26 13:13:21.773825 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.038) 0:00:10.913 **** 2025-11-26 13:13:21.802412 | controller | ok: [instance] 2025-11-26 13:13:21.802518 | controller | 2025-11-26 13:13:21.802632 | controller | TASK [Load environment file] *************************************************** 2025-11-26 13:13:21.802739 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.028) 0:00:10.942 **** 2025-11-26 13:13:21.833696 | controller | ok: [instance] 2025-11-26 13:13:21.833820 | controller | 2025-11-26 13:13:21.833968 | controller | TASK [Output scenario name] **************************************************** 2025-11-26 13:13:21.834129 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.031) 0:00:10.973 **** 2025-11-26 13:13:21.862091 | controller | ok: [instance] => 2025-11-26 13:13:21.862201 | controller | msg: 'Running: Inject 0 dev-scripts extra_worker' 2025-11-26 13:13:21.862288 | controller | 2025-11-26 13:13:21.862388 | controller | TASK [Validate data] *********************************************************** 2025-11-26 13:13:21.862489 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.028) 0:00:11.002 **** 2025-11-26 13:13:21.964433 | controller | 2025-11-26 13:13:21.964554 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] *** 2025-11-26 13:13:21.964658 | controller | Wednesday 26 November 2025 13:13:21 +0000 (0:00:00.102) 0:00:11.104 **** 2025-11-26 13:13:22.048537 | controller | ok: [instance] 2025-11-26 13:13:22.048626 | controller | 2025-11-26 13:13:22.048745 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] **************** 2025-11-26 13:13:22.048848 | controller | Wednesday 26 November 2025 13:13:22 +0000 (0:00:00.083) 0:00:11.187 **** 2025-11-26 13:13:22.107770 | controller | ok: [instance] 2025-11-26 13:13:22.107860 | controller | 2025-11-26 13:13:22.107985 | controller | TASK [reproducer : Ensure we get required data in the layout description] ****** 2025-11-26 13:13:22.108133 | controller | Wednesday 26 November 2025 13:13:22 +0000 (0:00:00.059) 0:00:11.247 **** 2025-11-26 13:13:22.190977 | controller | ok: [instance] 2025-11-26 13:13:22.191064 | controller | 2025-11-26 13:13:22.191192 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] ******* 2025-11-26 13:13:22.191292 | controller | Wednesday 26 November 2025 13:13:22 +0000 (0:00:00.083) 0:00:11.330 **** 2025-11-26 13:13:22.245366 | controller | skipping: [instance] 2025-11-26 13:13:22.310813 | controller | 2025-11-26 13:13:22.310836 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] **** 2025-11-26 13:13:22.310845 | controller | Wednesday 26 November 2025 13:13:22 +0000 (0:00:00.053) 0:00:11.384 **** 2025-11-26 13:13:22.310856 | controller | ok: [instance] 2025-11-26 13:13:22.310910 | controller | 2025-11-26 13:13:22.311032 | controller | TASK [reproducer : Ensure we get disk_size] ************************************ 2025-11-26 13:13:22.311146 | controller | Wednesday 26 November 2025 13:13:22 +0000 (0:00:00.065) 0:00:11.450 **** 2025-11-26 13:13:22.360703 | controller | skipping: [instance] 2025-11-26 13:13:22.360840 | controller | 2025-11-26 13:13:22.361027 | controller | TASK [reproducer : Ensure same amount of disks are created] ******************** 2025-11-26 13:13:22.361179 | controller | Wednesday 26 November 2025 13:13:22 +0000 (0:00:00.050) 0:00:11.500 **** 2025-11-26 13:13:22.415731 | controller | skipping: [instance] 2025-11-26 13:13:22.415820 | controller | 2025-11-26 13:13:22.415921 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] *** 2025-11-26 13:13:22.416076 | controller | Wednesday 26 November 2025 13:13:22 +0000 (0:00:00.055) 0:00:11.555 **** 2025-11-26 13:13:22.463577 | controller | skipping: [instance] 2025-11-26 13:13:22.463655 | controller | 2025-11-26 13:13:22.463768 | controller | TASK [reproducer : Ensure no allocation overlap] ******************************* 2025-11-26 13:13:22.463867 | controller | Wednesday 26 November 2025 13:13:22 +0000 (0:00:00.047) 0:00:11.603 **** 2025-11-26 13:13:22.517877 | controller | skipping: [instance] 2025-11-26 13:13:22.517980 | controller | 2025-11-26 13:13:22.518123 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ****************** 2025-11-26 13:13:22.518248 | controller | Wednesday 26 November 2025 13:13:22 +0000 (0:00:00.054) 0:00:11.657 **** 2025-11-26 13:13:22.569665 | controller | skipping: [instance] 2025-11-26 13:13:22.569700 | controller | 2025-11-26 13:13:22.569852 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************ 2025-11-26 13:13:22.569953 | controller | Wednesday 26 November 2025 13:13:22 +0000 (0:00:00.051) 0:00:11.709 **** 2025-11-26 13:13:22.629772 | controller | skipping: [instance] 2025-11-26 13:13:22.629810 | controller | 2025-11-26 13:13:22.629943 | controller | TASK [Mark failure] ************************************************************ 2025-11-26 13:13:22.630087 | controller | Wednesday 26 November 2025 13:13:22 +0000 (0:00:00.060) 0:00:11.769 **** 2025-11-26 13:13:22.673035 | controller | skipping: [instance] 2025-11-26 13:13:22.673128 | controller | 2025-11-26 13:13:22.673234 | controller | TASK [Display error message] *************************************************** 2025-11-26 13:13:22.673332 | controller | Wednesday 26 November 2025 13:13:22 +0000 (0:00:00.043) 0:00:11.812 **** 2025-11-26 13:13:22.710958 | controller | skipping: [instance] 2025-11-26 13:13:22.711073 | controller | 2025-11-26 13:13:22.711240 | controller | TASK [Append failed scenario to list] ****************************************** 2025-11-26 13:13:22.711371 | controller | Wednesday 26 November 2025 13:13:22 +0000 (0:00:00.038) 0:00:11.851 **** 2025-11-26 13:13:22.748753 | controller | skipping: [instance] 2025-11-26 13:13:22.748840 | controller | 2025-11-26 13:13:22.748937 | controller | TASK [Fail if needed] ********************************************************** 2025-11-26 13:13:22.749104 | controller | Wednesday 26 November 2025 13:13:22 +0000 (0:00:00.037) 0:00:11.888 **** 2025-11-26 13:13:22.813106 | controller | skipping: [instance] 2025-11-26 13:13:22.813196 | controller | 2025-11-26 13:13:22.813287 | controller | PLAY RECAP ********************************************************************* 2025-11-26 13:13:22.813401 | controller | instance : ok=129 changed=0 unreachable=0 failed=0 skipped=85 rescued=7 ignored=0 2025-11-26 13:13:22.813481 | controller | 2025-11-26 13:13:22.813594 | controller | Wednesday 26 November 2025 13:13:22 +0000 (0:00:00.063) 0:00:11.952 **** 2025-11-26 13:13:22.813671 | controller | =============================================================================== 2025-11-26 13:13:22.813780 | controller | reproducer : Ensure we get required data in the layout description ------ 0.15s 2025-11-26 13:13:22.813863 | controller | reproducer : Ensure we don't set some parameters when no extra disks ---- 0.15s 2025-11-26 13:13:22.813961 | controller | reproducer : Ensure created amount matches at least allocated amounts --- 0.13s 2025-11-26 13:13:22.814088 | controller | Validate data ----------------------------------------------------------- 0.12s 2025-11-26 13:13:22.814170 | controller | Validate data ----------------------------------------------------------- 0.10s 2025-11-26 13:13:22.814259 | controller | Mark run as failed ------------------------------------------------------ 0.10s 2025-11-26 13:13:22.814350 | controller | Test no volumes --------------------------------------------------------- 0.10s 2025-11-26 13:13:22.814445 | controller | Display error message --------------------------------------------------- 0.10s 2025-11-26 13:13:22.814539 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.10s 2025-11-26 13:13:22.814629 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.09s 2025-11-26 13:13:22.814726 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.09s 2025-11-26 13:13:22.814821 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.09s 2025-11-26 13:13:22.814908 | controller | reproducer : Ensure created amount matches at least allocated amounts --- 0.09s 2025-11-26 13:13:22.815050 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.09s 2025-11-26 13:13:22.815139 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.09s 2025-11-26 13:13:22.815217 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.09s 2025-11-26 13:13:22.815321 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.08s 2025-11-26 13:13:22.815442 | controller | reproducer : Ensure we get required data in the layout description ------ 0.08s 2025-11-26 13:13:22.815519 | controller | reproducer : Ensure we get required data in the layout description ------ 0.08s 2025-11-26 13:13:22.815623 | controller | reproducer : Ensure we don't try to pass resources via devscripts_overrides --- 0.08s 2025-11-26 13:13:22.936639 | controller | INFO Running ocp_validations > cleanup 2025-11-26 13:13:22.937022 | controller | WARNING Skipping, cleanup playbook not configured. 2025-11-26 13:13:22.937564 | controller | INFO Writing /tmp/report.html report. 2025-11-26 13:13:23.104765 | [controller] Waiting on logger 2025-11-26 13:13:28.242565 | [controller] Waiting on logger 2025-11-26 13:13:38.675023 | [controller] Waiting on logger 2025-11-26 13:13:49.106453 | [controller] Waiting on logger 2025-11-26 13:13:53.075873 | [Zuul] Log Stream did not terminate 2025-11-26 13:13:53.076176 | controller | changed 2025-11-26 13:13:53.120849 | 2025-11-26 13:13:53.120927 | PLAY RECAP 2025-11-26 13:13:53.120969 | controller | ok: 4 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-11-26 13:13:53.120989 | 2025-11-26 13:13:53.183697 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-11-26 13:13:53.185112 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-11-26 13:13:53.659646 | 2025-11-26 13:13:53.659735 | PLAY [Run ci/playbooks/collect-logs.yml] 2025-11-26 13:13:53.677871 | 2025-11-26 13:13:53.677971 | TASK [Filter out host if needed] 2025-11-26 13:13:53.685576 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2025-11-26 13:13:53.689787 | 2025-11-26 13:13:53.689853 | TASK [Ensure file is present] 2025-11-26 13:13:54.093399 | controller | ok 2025-11-26 13:13:54.099234 | 2025-11-26 13:13:54.099294 | TASK [Manage molecule report file] 2025-11-26 13:13:54.119983 | [controller] Waiting on logger 2025-11-26 13:14:03.506602 | [controller] Waiting on logger 2025-11-26 13:14:13.938530 | [controller] Waiting on logger 2025-11-26 13:14:23.282699 | [controller] Waiting on logger 2025-11-26 13:14:24.500947 | [Zuul] Log Stream did not terminate 2025-11-26 13:14:24.501228 | controller | changed 2025-11-26 13:14:24.506255 | 2025-11-26 13:14:24.506321 | TASK [Check if we get ci-framework-data basedir] 2025-11-26 13:14:24.819009 | controller | ok 2025-11-26 13:14:24.823520 | 2025-11-26 13:14:24.823578 | TASK [Create ci-framework-data log directory for zuul] 2025-11-26 13:14:25.186289 | controller | changed 2025-11-26 13:14:25.191372 | 2025-11-26 13:14:25.191431 | TASK [Copy ci-framework interesting files] 2025-11-26 13:14:25.209937 | [controller] Waiting on logger 2025-11-26 13:14:35.634610 | [controller] Waiting on logger 2025-11-26 13:14:46.066484 | [controller] Waiting on logger 2025-11-26 13:14:55.410475 | [controller] Waiting on logger 2025-11-26 13:14:55.512242 | [Zuul] Log Stream did not terminate 2025-11-26 13:14:55.512358 | controller | changed 2025-11-26 13:14:55.517503 | 2025-11-26 13:14:55.517565 | TASK [Get SELinux listing] 2025-11-26 13:14:58.610603 | [controller] Waiting on logger 2025-11-26 13:15:04.869193 | controller | changed 2025-11-26 13:15:04.874830 | 2025-11-26 13:15:04.874931 | TASK [Generate log index] 2025-11-26 13:15:06.201159 | controller | changed 2025-11-26 13:15:06.205856 | 2025-11-26 13:15:06.205947 | TASK [Get some env related data] 2025-11-26 13:15:06.227507 | [controller] Waiting on logger 2025-11-26 13:15:16.658362 | [controller] Waiting on logger 2025-11-26 13:15:27.090932 | [controller] Waiting on logger 2025-11-26 13:15:36.434468 | [controller] Waiting on logger 2025-11-26 13:15:37.483618 | [Zuul] Log Stream did not terminate 2025-11-26 13:15:37.483814 | controller | changed 2025-11-26 13:15:37.488897 | 2025-11-26 13:15:37.488981 | TASK [Generate list of logs to collect in home directory] 2025-11-26 13:15:37.860294 | controller | ok: All paths examined 2025-11-26 13:15:37.865038 | 2025-11-26 13:15:37.865091 | LOOP [Copy logs from home directory] 2025-11-26 13:15:38.542145 | controller | changed: 2025-11-26 13:15:38.542336 | controller | { 2025-11-26 13:15:38.542365 | controller | "atime": 1743544925.4788878, 2025-11-26 13:15:38.542390 | controller | "ctime": 1743545329.1409318, 2025-11-26 13:15:38.542408 | controller | "dev": 64513, 2025-11-26 13:15:38.542425 | controller | "gid": 1000, 2025-11-26 13:15:38.542441 | controller | "gr_name": "zuul", 2025-11-26 13:15:38.542457 | controller | "inode": 4518807, 2025-11-26 13:15:38.542472 | controller | "isblk": false, 2025-11-26 13:15:38.542486 | controller | "ischr": false, 2025-11-26 13:15:38.542501 | controller | "isdir": false, 2025-11-26 13:15:38.542514 | controller | "isfifo": false, 2025-11-26 13:15:38.542527 | controller | "isgid": false, 2025-11-26 13:15:38.542541 | controller | "islnk": false, 2025-11-26 13:15:38.542554 | controller | "isreg": true, 2025-11-26 13:15:38.542570 | controller | "issock": false, 2025-11-26 13:15:38.542584 | controller | "isuid": false, 2025-11-26 13:15:38.542597 | controller | "mode": "0644", 2025-11-26 13:15:38.542610 | controller | "mtime": 1743545329.1409318, 2025-11-26 13:15:38.542623 | controller | "nlink": 1, 2025-11-26 13:15:38.542637 | controller | "path": "/home/zuul/crc-setup.log", 2025-11-26 13:15:38.542650 | controller | "pw_name": "zuul", 2025-11-26 13:15:38.542663 | controller | "rgrp": true, 2025-11-26 13:15:38.542676 | controller | "roth": true, 2025-11-26 13:15:38.542689 | controller | "rusr": true, 2025-11-26 13:15:38.542702 | controller | "size": 4108, 2025-11-26 13:15:38.542715 | controller | "uid": 1000, 2025-11-26 13:15:38.542728 | controller | "wgrp": false, 2025-11-26 13:15:38.542741 | controller | "woth": false, 2025-11-26 13:15:38.542753 | controller | "wusr": true, 2025-11-26 13:15:38.542766 | controller | "xgrp": false, 2025-11-26 13:15:38.542778 | controller | "xoth": false, 2025-11-26 13:15:38.542791 | controller | "xusr": false 2025-11-26 13:15:38.542803 | controller | } 2025-11-26 13:15:39.194088 | controller | changed: 2025-11-26 13:15:39.194141 | controller | { 2025-11-26 13:15:39.194166 | controller | "atime": 1743545331.0429637, 2025-11-26 13:15:39.194183 | controller | "ctime": 1743545842.0111232, 2025-11-26 13:15:39.194199 | controller | "dev": 64513, 2025-11-26 13:15:39.194213 | controller | "gid": 1000, 2025-11-26 13:15:39.194227 | controller | "gr_name": "zuul", 2025-11-26 13:15:39.194241 | controller | "inode": 4194437, 2025-11-26 13:15:39.194255 | controller | "isblk": false, 2025-11-26 13:15:39.194269 | controller | "ischr": false, 2025-11-26 13:15:39.194283 | controller | "isdir": false, 2025-11-26 13:15:39.194296 | controller | "isfifo": false, 2025-11-26 13:15:39.194309 | controller | "isgid": false, 2025-11-26 13:15:39.194322 | controller | "islnk": false, 2025-11-26 13:15:39.194334 | controller | "isreg": true, 2025-11-26 13:15:39.194347 | controller | "issock": false, 2025-11-26 13:15:39.194359 | controller | "isuid": false, 2025-11-26 13:15:39.194371 | controller | "mode": "0644", 2025-11-26 13:15:39.194383 | controller | "mtime": 1743545842.0111232, 2025-11-26 13:15:39.194396 | controller | "nlink": 1, 2025-11-26 13:15:39.194409 | controller | "path": "/home/zuul/crc-start.log", 2025-11-26 13:15:39.194421 | controller | "pw_name": "zuul", 2025-11-26 13:15:39.194434 | controller | "rgrp": true, 2025-11-26 13:15:39.194446 | controller | "roth": true, 2025-11-26 13:15:39.194458 | controller | "rusr": true, 2025-11-26 13:15:39.194470 | controller | "size": 4023, 2025-11-26 13:15:39.194482 | controller | "uid": 1000, 2025-11-26 13:15:39.194493 | controller | "wgrp": false, 2025-11-26 13:15:39.194505 | controller | "woth": false, 2025-11-26 13:15:39.194517 | controller | "wusr": true, 2025-11-26 13:15:39.194529 | controller | "xgrp": false, 2025-11-26 13:15:39.194540 | controller | "xoth": false, 2025-11-26 13:15:39.194552 | controller | "xusr": false 2025-11-26 13:15:39.194564 | controller | } 2025-11-26 13:15:39.811228 | controller | changed: 2025-11-26 13:15:39.811318 | controller | { 2025-11-26 13:15:39.811344 | controller | "atime": 1764162225.374422, 2025-11-26 13:15:39.811364 | controller | "ctime": 1764162240.4307754, 2025-11-26 13:15:39.811387 | controller | "dev": 64513, 2025-11-26 13:15:39.811403 | controller | "gid": 1000, 2025-11-26 13:15:39.811420 | controller | "gr_name": "zuul", 2025-11-26 13:15:39.811439 | controller | "inode": 4518828, 2025-11-26 13:15:39.811455 | controller | "isblk": false, 2025-11-26 13:15:39.811470 | controller | "ischr": false, 2025-11-26 13:15:39.811488 | controller | "isdir": false, 2025-11-26 13:15:39.811503 | controller | "isfifo": false, 2025-11-26 13:15:39.811517 | controller | "isgid": false, 2025-11-26 13:15:39.811531 | controller | "islnk": false, 2025-11-26 13:15:39.811545 | controller | "isreg": true, 2025-11-26 13:15:39.811558 | controller | "issock": false, 2025-11-26 13:15:39.811572 | controller | "isuid": false, 2025-11-26 13:15:39.811585 | controller | "mode": "0644", 2025-11-26 13:15:39.811598 | controller | "mtime": 1764162240.4307754, 2025-11-26 13:15:39.811612 | controller | "nlink": 1, 2025-11-26 13:15:39.811625 | controller | "path": "/home/zuul/ansible.log", 2025-11-26 13:15:39.811638 | controller | "pw_name": "zuul", 2025-11-26 13:15:39.811652 | controller | "rgrp": true, 2025-11-26 13:15:39.811665 | controller | "roth": true, 2025-11-26 13:15:39.811679 | controller | "rusr": true, 2025-11-26 13:15:39.811692 | controller | "size": 6749, 2025-11-26 13:15:39.811706 | controller | "uid": 1000, 2025-11-26 13:15:39.811719 | controller | "wgrp": false, 2025-11-26 13:15:39.811733 | controller | "woth": false, 2025-11-26 13:15:39.811746 | controller | "wusr": true, 2025-11-26 13:15:39.811758 | controller | "xgrp": false, 2025-11-26 13:15:39.811771 | controller | "xoth": false, 2025-11-26 13:15:39.811784 | controller | "xusr": false 2025-11-26 13:15:39.811797 | controller | } 2025-11-26 13:15:39.826699 | 2025-11-26 13:15:39.826806 | TASK [Copy crio stats log file] 2025-11-26 13:15:39.839683 | controller | skipping: Conditional result was False 2025-11-26 13:15:39.844527 | 2025-11-26 13:15:39.844588 | TASK [Get SELinux related data] 2025-11-26 13:15:39.864813 | [controller] Waiting on logger 2025-11-26 13:15:49.541453 | controller | ERROR 2025-11-26 13:15:49.541666 | controller | { 2025-11-26 13:15:49.541701 | controller | "delta": "0:00:00.012900", 2025-11-26 13:15:49.541725 | controller | "end": "2025-11-26 13:15:40.140133", 2025-11-26 13:15:49.541745 | controller | "msg": "non-zero return code", 2025-11-26 13:15:49.541763 | controller | "rc": 1, 2025-11-26 13:15:49.541782 | controller | "start": "2025-11-26 13:15:40.127233" 2025-11-26 13:15:49.541799 | controller | } 2025-11-26 13:15:49.541823 | controller | ERROR: Ignoring Errors 2025-11-26 13:15:49.546736 | 2025-11-26 13:15:49.546800 | TASK [Create system configuration directory] 2025-11-26 13:15:49.818819 | controller | changed 2025-11-26 13:15:49.823493 | 2025-11-26 13:15:49.823556 | TASK [Get some of the system configurations] 2025-11-26 13:15:52.050672 | [controller] Waiting on logger 2025-11-26 13:15:54.849790 | controller | changed 2025-11-26 13:15:54.855554 | 2025-11-26 13:15:54.855620 | TASK [Copy generated documentation if available] 2025-11-26 13:15:54.869068 | controller | skipping: Conditional result was False 2025-11-26 13:15:54.874253 | 2025-11-26 13:15:54.874318 | TASK [Copy generated AsciiDoc documentation if available] 2025-11-26 13:15:54.888283 | controller | skipping: Conditional result was False 2025-11-26 13:15:54.893012 | 2025-11-26 13:15:54.893069 | TASK [Compress logs bigger than 2MB] 2025-11-26 13:15:59.917981 | controller | changed 2025-11-26 13:15:59.923172 | 2025-11-26 13:15:59.923238 | TASK [Copy files from workspace on node] 2025-11-26 13:15:59.941199 | controller | ok 2025-11-26 13:15:59.963994 | 2025-11-26 13:15:59.964064 | TASK [fetch-output : Set log path for multiple nodes] 2025-11-26 13:15:59.977410 | controller | skipping: Conditional result was False 2025-11-26 13:15:59.982497 | 2025-11-26 13:15:59.982569 | TASK [fetch-output : Set log path for single node] 2025-11-26 13:16:00.010103 | controller | ok 2025-11-26 13:16:00.014549 | 2025-11-26 13:16:00.014611 | LOOP [fetch-output : Ensure local output dirs] 2025-11-26 13:16:00.195812 | controller -> localhost | ok: "/var/lib/zuul/builds/73d0e05660c2474e8e0c4a335bc18c73/work/logs" 2025-11-26 13:16:00.196071 | controller -> localhost | changed: All items complete 2025-11-26 13:16:00.196102 | 2025-11-26 13:16:00.361582 | controller -> localhost | changed: "/var/lib/zuul/builds/73d0e05660c2474e8e0c4a335bc18c73/work/artifacts" 2025-11-26 13:16:00.523770 | controller -> localhost | changed: "/var/lib/zuul/builds/73d0e05660c2474e8e0c4a335bc18c73/work/docs" 2025-11-26 13:16:00.541290 | 2025-11-26 13:16:00.541425 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-11-26 13:16:01.199691 | controller | changed: 2025-11-26 13:16:01.199876 | controller | .d..t...... ./ 2025-11-26 13:16:01.199941 | controller | >f+++++++++ README.html 2025-11-26 13:16:01.199973 | controller | >f+++++++++ ansible-execution.log 2025-11-26 13:16:01.199995 | controller | >f+++++++++ ansible.log 2025-11-26 13:16:01.200015 | controller | >f+++++++++ crc-setup.log 2025-11-26 13:16:01.200033 | controller | >f+++++++++ crc-start.log 2025-11-26 13:16:01.200051 | controller | >f+++++++++ dmesg.log 2025-11-26 13:16:01.200067 | controller | >f+++++++++ installed-pkgs.log 2025-11-26 13:16:01.200083 | controller | >f+++++++++ python.log 2025-11-26 13:16:01.200098 | controller | >f+++++++++ registries.conf 2025-11-26 13:16:01.200114 | controller | >f+++++++++ report.html 2025-11-26 13:16:01.200128 | controller | >f+++++++++ selinux-denials.log 2025-11-26 13:16:01.200143 | controller | >f+++++++++ selinux-listing.log 2025-11-26 13:16:01.200157 | controller | cd+++++++++ ci-framework-data/ 2025-11-26 13:16:01.200172 | controller | cd+++++++++ ci-framework-data/artifacts/ 2025-11-26 13:16:01.200186 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2025-11-26 13:16:01.200201 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2025-11-26 13:16:01.200215 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2025-11-26 13:16:01.200229 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2025-11-26 13:16:01.200244 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2025-11-26 13:16:01.200258 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2025-11-26 13:16:01.200272 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2025-11-26 13:16:01.200286 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2025-11-26 13:16:01.200300 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2025-11-26 13:16:01.200314 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2025-11-26 13:16:01.200329 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2025-11-26 13:16:01.200343 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2025-11-26 13:16:01.200358 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2025-11-26 13:16:01.200373 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:7f:97:1b 2025-11-26 13:16:01.200388 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:72:f0:60 2025-11-26 13:16:01.200403 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:f1:02:5c 2025-11-26 13:16:01.200418 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:6d:00:ac 2025-11-26 13:16:01.200433 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:c3:18:79 2025-11-26 13:16:01.200447 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:1b:65:c8 2025-11-26 13:16:01.200462 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2025-11-26 13:16:01.200481 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2025-11-26 13:16:01.200498 | controller | cd+++++++++ ci-framework-data/logs/ 2025-11-26 13:16:01.200513 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2025-11-26 13:16:01.200528 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2025-11-26 13:16:01.200542 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2025-11-26 13:16:01.200556 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2025-11-26 13:16:01.200569 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2025-11-26 13:16:01.200583 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2025-11-26 13:16:01.200598 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2025-11-26 13:16:01.200612 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2025-11-26 13:16:01.200626 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2025-11-26 13:16:01.200640 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2025-11-26 13:16:01.200655 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2025-11-26 13:16:01.200670 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2025-11-26 13:16:01.200685 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2025-11-26 13:16:01.200700 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2025-11-26 13:16:01.200714 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2025-11-26 13:16:01.200729 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2025-11-26 13:16:01.200746 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2025-11-26 13:16:01.200761 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2025-11-26 13:16:01.200776 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2025-11-26 13:16:01.200791 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2025-11-26 13:16:01.200805 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2025-11-26 13:16:01.200820 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2025-11-26 13:16:01.200836 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2025-11-26 13:16:01.200853 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2025-11-26 13:16:01.200870 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2025-11-26 13:16:01.200897 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2025-11-26 13:16:01.200937 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2025-11-26 13:16:01.200959 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2025-11-26 13:16:01.200976 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2025-11-26 13:16:01.200999 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2025-11-26 13:16:01.201018 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2025-11-26 13:16:01.201036 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2025-11-26 13:16:01.201052 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2025-11-26 13:16:01.201068 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2025-11-26 13:16:01.201085 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2025-11-26 13:16:01.201101 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2025-11-26 13:16:01.201116 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2025-11-26 13:16:01.201132 | controller | cd+++++++++ registries.conf.d/ 2025-11-26 13:16:01.201148 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2025-11-26 13:16:01.201165 | controller | cd+++++++++ system-config/ 2025-11-26 13:16:01.201182 | controller | cd+++++++++ system-config/libvirt/ 2025-11-26 13:16:01.201199 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2025-11-26 13:16:01.201215 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2025-11-26 13:16:01.201232 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2025-11-26 13:16:01.201248 | controller | >f+++++++++ system-config/libvirt/network.conf 2025-11-26 13:16:01.201265 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2025-11-26 13:16:01.201281 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2025-11-26 13:16:01.201296 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2025-11-26 13:16:01.201312 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2025-11-26 13:16:01.201328 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2025-11-26 13:16:01.201343 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2025-11-26 13:16:01.201359 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2025-11-26 13:16:01.201375 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2025-11-26 13:16:01.201390 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2025-11-26 13:16:01.201405 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2025-11-26 13:16:01.201421 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2025-11-26 13:16:01.201436 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2025-11-26 13:16:01.394353 | [controller] Waiting on logger 2025-11-26 13:16:01.659509 | controller | changed: .d..t...... ./ 2025-11-26 13:16:02.120316 | controller | changed: .d..t...... ./ 2025-11-26 13:16:02.135351 | 2025-11-26 13:16:02.135416 | TASK [Return artifact to Zuul] 2025-11-26 13:16:02.163470 | controller | ok 2025-11-26 13:16:02.180554 | 2025-11-26 13:16:02.180602 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2025-11-26 13:16:02.180681 | 2025-11-26 13:16:02.180706 | PLAY RECAP 2025-11-26 13:16:02.180742 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2025-11-26 13:16:02.180762 | 2025-11-26 13:16:02.256544 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-11-26 13:16:02.257302 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-11-26 13:16:02.726304 | 2025-11-26 13:16:02.726392 | PLAY [all] 2025-11-26 13:16:02.743790 | 2025-11-26 13:16:02.743859 | TASK [include_role : fetch-output] 2025-11-26 13:16:02.771973 | controller | ok 2025-11-26 13:16:02.787152 | 2025-11-26 13:16:02.787227 | TASK [fetch-output : Set log path for multiple nodes] 2025-11-26 13:16:02.820762 | controller | skipping: Conditional result was False 2025-11-26 13:16:02.825815 | 2025-11-26 13:16:02.825881 | TASK [fetch-output : Set log path for single node] 2025-11-26 13:16:02.853550 | controller | ok 2025-11-26 13:16:02.858435 | 2025-11-26 13:16:02.858525 | LOOP [fetch-output : Ensure local output dirs] 2025-11-26 13:16:03.158195 | controller -> localhost | ok: "/var/lib/zuul/builds/73d0e05660c2474e8e0c4a335bc18c73/work/logs" 2025-11-26 13:16:03.325132 | controller -> localhost | ok: "/var/lib/zuul/builds/73d0e05660c2474e8e0c4a335bc18c73/work/artifacts" 2025-11-26 13:16:03.491833 | controller -> localhost | ok: "/var/lib/zuul/builds/73d0e05660c2474e8e0c4a335bc18c73/work/docs" 2025-11-26 13:16:03.505541 | 2025-11-26 13:16:03.505603 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-11-26 13:16:04.106310 | controller | ok 2025-11-26 13:16:04.106496 | controller | ok: All items complete 2025-11-26 13:16:04.106528 | 2025-11-26 13:16:04.567642 | controller | ok 2025-11-26 13:16:05.023983 | controller | ok 2025-11-26 13:16:05.034460 | 2025-11-26 13:16:05.034557 | TASK [include_role : fetch-output-openshift] 2025-11-26 13:16:05.047391 | controller | skipping: Conditional result was False 2025-11-26 13:16:05.052410 | 2025-11-26 13:16:05.052471 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2025-11-26 13:16:05.366038 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006266 2025-11-26 13:16:05.536532 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006082 2025-11-26 13:16:05.564943 | 2025-11-26 13:16:05.565033 | PLAY [all] 2025-11-26 13:16:05.577950 | 2025-11-26 13:16:05.578016 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2025-11-26 13:16:06.064163 | controller | changed 2025-11-26 13:16:06.084176 | 2025-11-26 13:16:06.084230 | PLAY RECAP 2025-11-26 13:16:06.084272 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2025-11-26 13:16:06.084295 | 2025-11-26 13:16:06.149089 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-11-26 13:16:06.149837 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2025-11-26 13:16:06.651675 | 2025-11-26 13:16:06.651774 | PLAY [localhost] 2025-11-26 13:16:06.669059 | 2025-11-26 13:16:06.669137 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2025-11-26 13:16:06.959980 | localhost | changed 2025-11-26 13:16:06.964678 | 2025-11-26 13:16:06.964758 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2025-11-26 13:16:06.982721 | localhost | ok 2025-11-26 13:16:06.989839 | 2025-11-26 13:16:06.989925 | TASK [add-fileserver : Create SSH private key tempfile] 2025-11-26 13:16:07.270592 | localhost | changed 2025-11-26 13:16:07.275891 | 2025-11-26 13:16:07.275977 | TASK [add-fileserver : Create SSH private key from secret] 2025-11-26 13:16:07.799195 | localhost | changed 2025-11-26 13:16:07.804121 | 2025-11-26 13:16:07.804196 | TASK [add-fileserver : Add fileserver ssh key] 2025-11-26 13:16:08.124848 | localhost | Identity added: /var/lib/zuul/builds/73d0e05660c2474e8e0c4a335bc18c73/work/tmp/ansible.j_agghci (/var/lib/zuul/builds/73d0e05660c2474e8e0c4a335bc18c73/work/tmp/ansible.j_agghci) 2025-11-26 13:16:08.125029 | localhost | ok: Runtime: 0:00:00.005801 2025-11-26 13:16:08.129135 | 2025-11-26 13:16:08.129200 | TASK [add-fileserver : Remove SSH private key from disk] 2025-11-26 13:16:08.348726 | localhost | ok: Runtime: 0:00:00.004704 2025-11-26 13:16:08.353379 | 2025-11-26 13:16:08.353456 | TASK [add-fileserver : Add fileserver to inventory] 2025-11-26 13:16:08.401586 | localhost | changed 2025-11-26 13:16:08.406403 | 2025-11-26 13:16:08.406470 | TASK [add-fileserver : Add fileserver server to known hosts] 2025-11-26 13:16:08.707924 | localhost | changed 2025-11-26 13:16:08.726749 | 2025-11-26 13:16:08.726805 | PLAY [localhost] 2025-11-26 13:16:08.737731 | 2025-11-26 13:16:08.737795 | TASK [Generate bulk log download script] 2025-11-26 13:16:08.755816 | localhost | ok 2025-11-26 13:16:08.766819 | 2025-11-26 13:16:08.766895 | TASK [local-log-download : Check API endpoint is defined] 2025-11-26 13:16:08.794244 | localhost | ok: All assertions passed 2025-11-26 13:16:08.798490 | 2025-11-26 13:16:08.798553 | TASK [local-log-download : Create download script] 2025-11-26 13:16:09.126430 | localhost -> localhost | changed 2025-11-26 13:16:09.134437 | 2025-11-26 13:16:09.134502 | TASK [Register quick-download link] 2025-11-26 13:16:09.151242 | localhost | ok 2025-11-26 13:16:09.183399 | 2025-11-26 13:16:09.183469 | PLAY [logserver.rdoproject.org] 2025-11-26 13:16:09.192789 | 2025-11-26 13:16:09.192848 | TASK [Set zuul-log-path fact] 2025-11-26 13:16:09.208515 | logserver.rdoproject.org | ok 2025-11-26 13:16:09.217073 | 2025-11-26 13:16:09.217139 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-11-26 13:16:09.233285 | logserver.rdoproject.org | ok 2025-11-26 13:16:09.238355 | 2025-11-26 13:16:09.238420 | TASK [upload-logs : Create log directories] 2025-11-26 13:16:10.950779 | logserver.rdoproject.org | changed 2025-11-26 13:16:10.953500 | 2025-11-26 13:16:10.953562 | TASK [upload-logs : Ensure logs are readable before uploading] 2025-11-26 13:16:11.159279 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.004369 2025-11-26 13:16:11.163653 | 2025-11-26 13:16:11.163716 | TASK [upload-logs : Upload logs to log server] 2025-11-26 13:16:12.638959 | logserver.rdoproject.org | Output suppressed because no_log was given 2025-11-26 13:16:12.641741 | 2025-11-26 13:16:12.641804 | LOOP [upload-logs : Compress console log and json output] 2025-11-26 13:16:12.678593 | logserver.rdoproject.org | skipping: Conditional result was False 2025-11-26 13:16:12.686756 | logserver.rdoproject.org | skipping: Conditional result was False 2025-11-26 13:16:12.699013 | 2025-11-26 13:16:12.699100 | LOOP [upload-logs : Upload compressed console log and json output] 2025-11-26 13:16:12.733008 | logserver.rdoproject.org | skipping: Conditional result was False 2025-11-26 13:16:12.733212 | 2025-11-26 13:16:12.736281 | logserver.rdoproject.org | skipping: Conditional result was False 2025-11-26 13:16:12.747239 | 2025-11-26 13:16:12.747321 | LOOP [upload-logs : Upload console log and json output]