2025-12-03 13:01:34.054403 | Job console starting... 2025-12-03 13:01:34.278248 | Updating repositories 2025-12-03 13:01:35.022775 | Preparing job workspace 2025-12-03 13:01:43.512953 | Running Ansible setup... 2025-12-03 13:01:47.177721 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-12-03 13:01:47.706497 | 2025-12-03 13:01:47.706601 | PLAY [localhost] 2025-12-03 13:01:47.715174 | 2025-12-03 13:01:47.715248 | TASK [Gathering Facts] 2025-12-03 13:01:48.571402 | localhost | ok 2025-12-03 13:01:48.584502 | 2025-12-03 13:01:48.584584 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2025-12-03 13:01:48.922567 | localhost -> localhost | changed 2025-12-03 13:01:48.928196 | 2025-12-03 13:01:48.928285 | TASK [log-inventory : Copy ansible inventory to logs dir] 2025-12-03 13:01:49.667020 | localhost -> localhost | changed 2025-12-03 13:01:49.676542 | 2025-12-03 13:01:49.676637 | TASK [Setup log path fact] 2025-12-03 13:01:49.694186 | localhost | ok 2025-12-03 13:01:49.705182 | 2025-12-03 13:01:49.705253 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-12-03 13:01:49.733177 | localhost | ok 2025-12-03 13:01:49.740511 | 2025-12-03 13:01:49.740579 | TASK [emit-job-header : Print job information] 2025-12-03 13:01:49.768613 | # Job Information 2025-12-03 13:01:49.768852 | Ansible Version: 2.15.12 2025-12-03 13:01:49.768885 | Job: cifmw-molecule-reproducer 2025-12-03 13:01:49.768907 | Pipeline: github-check 2025-12-03 13:01:49.768925 | Executor: ibm-bm3-ze.softwarefactory-project.io 2025-12-03 13:01:49.768944 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3505 2025-12-03 13:01:49.768962 | Log URL (when completed): https://logserver.rdoproject.org/124/rdoproject.org/1245cf0cec5a44359e24afa34990e190/ 2025-12-03 13:01:49.768993 | Event ID: 061d1f80-d048-11f0-86fd-d52ba4d8c355 2025-12-03 13:01:49.773172 | 2025-12-03 13:01:49.773242 | LOOP [emit-job-header : Print node information] 2025-12-03 13:01:49.866061 | localhost | ok: 2025-12-03 13:01:49.866226 | localhost | # Node Information 2025-12-03 13:01:49.866259 | localhost | Inventory Hostname: controller 2025-12-03 13:01:49.866285 | localhost | Hostname: np0005544083 2025-12-03 13:01:49.866306 | localhost | Username: zuul 2025-12-03 13:01:49.866328 | localhost | Distro: CentOS 9 2025-12-03 13:01:49.866347 | localhost | Provider: ibm-bm3-nodepool 2025-12-03 13:01:49.866365 | localhost | Region: regionOne 2025-12-03 13:01:49.866382 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2025-12-03 13:01:49.866398 | localhost | Product Name: OpenStack Compute 2025-12-03 13:01:49.866414 | localhost | Interface IP: 192.168.25.6 2025-12-03 13:01:49.886645 | 2025-12-03 13:01:49.886746 | PLAY [all] 2025-12-03 13:01:49.893186 | 2025-12-03 13:01:49.893260 | TASK [Gather network facts] 2025-12-03 13:01:50.297031 | controller | ok 2025-12-03 13:01:50.310812 | 2025-12-03 13:01:50.310875 | TASK [include_role : start-zuul-console] 2025-12-03 13:01:50.329491 | controller | ok 2025-12-03 13:01:50.340356 | 2025-12-03 13:01:50.340420 | TASK [start-zuul-console : Start zuul_console daemon.] 2025-12-03 13:01:50.702920 | controller | ok 2025-12-03 13:01:50.711205 | 2025-12-03 13:01:50.711266 | TASK [include_role : add-build-sshkey] 2025-12-03 13:01:50.738435 | controller | ok 2025-12-03 13:01:50.760995 | 2025-12-03 13:01:50.761113 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2025-12-03 13:01:50.968195 | controller -> localhost | ok 2025-12-03 13:01:50.974117 | 2025-12-03 13:01:50.974193 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2025-12-03 13:01:50.993967 | controller | ok 2025-12-03 13:01:51.006443 | controller | included: /var/lib/zuul/builds/1245cf0cec5a44359e24afa34990e190/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2025-12-03 13:01:51.011992 | 2025-12-03 13:01:51.012055 | TASK [add-build-sshkey : Create Temp SSH key] 2025-12-03 13:01:51.461015 | controller -> localhost | Generating public/private rsa key pair. 2025-12-03 13:01:51.461641 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/1245cf0cec5a44359e24afa34990e190/work/1245cf0cec5a44359e24afa34990e190_id_rsa. 2025-12-03 13:01:51.461684 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/1245cf0cec5a44359e24afa34990e190/work/1245cf0cec5a44359e24afa34990e190_id_rsa.pub. 2025-12-03 13:01:51.461726 | controller -> localhost | The key fingerprint is: 2025-12-03 13:01:51.461750 | controller -> localhost | SHA256:cGbo3j3FmMHVRX7+TLaORinD8338c1Nh4GgzJNH76Yk zuul-build-sshkey 2025-12-03 13:01:51.461775 | controller -> localhost | The key's randomart image is: 2025-12-03 13:01:51.461796 | controller -> localhost | +---[RSA 3072]----+ 2025-12-03 13:01:51.461815 | controller -> localhost | | .o .. oo| 2025-12-03 13:01:51.461834 | controller -> localhost | | . o + ... | 2025-12-03 13:01:51.461852 | controller -> localhost | | o + = + . o| 2025-12-03 13:01:51.461870 | controller -> localhost | | . = @ . +.| 2025-12-03 13:01:51.461889 | controller -> localhost | | . S = * + =| 2025-12-03 13:01:51.461907 | controller -> localhost | | . . . * = ++| 2025-12-03 13:01:51.461924 | controller -> localhost | | . . o O oo+| 2025-12-03 13:01:51.461944 | controller -> localhost | | E =o++| 2025-12-03 13:01:51.461961 | controller -> localhost | | .. .B| 2025-12-03 13:01:51.461986 | controller -> localhost | +----[SHA256]-----+ 2025-12-03 13:01:51.462032 | controller -> localhost | ok: Runtime: 0:00:00.106161 2025-12-03 13:01:51.467752 | 2025-12-03 13:01:51.467820 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2025-12-03 13:01:51.487039 | controller | ok 2025-12-03 13:01:51.496546 | controller | included: /var/lib/zuul/builds/1245cf0cec5a44359e24afa34990e190/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2025-12-03 13:01:51.504372 | 2025-12-03 13:01:51.504438 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2025-12-03 13:01:51.518995 | controller | skipping: Conditional result was False 2025-12-03 13:01:51.527383 | 2025-12-03 13:01:51.527468 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2025-12-03 13:01:52.002814 | controller | changed 2025-12-03 13:01:52.007805 | 2025-12-03 13:01:52.007871 | TASK [add-build-sshkey : Make sure user has a .ssh] 2025-12-03 13:01:52.261685 | controller | ok 2025-12-03 13:01:52.266831 | 2025-12-03 13:01:52.266901 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2025-12-03 13:01:53.368729 | controller | changed 2025-12-03 13:01:53.373560 | 2025-12-03 13:01:53.373636 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2025-12-03 13:01:54.465278 | controller | changed 2025-12-03 13:01:54.480513 | 2025-12-03 13:01:54.480613 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2025-12-03 13:01:54.495531 | controller | skipping: Conditional result was False 2025-12-03 13:01:54.501654 | 2025-12-03 13:01:54.501738 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2025-12-03 13:01:54.809368 | controller -> localhost | changed 2025-12-03 13:01:54.819957 | 2025-12-03 13:01:54.820044 | TASK [add-build-sshkey : Add back temp key] 2025-12-03 13:01:55.046686 | controller -> localhost | Identity added: /var/lib/zuul/builds/1245cf0cec5a44359e24afa34990e190/work/1245cf0cec5a44359e24afa34990e190_id_rsa (zuul-build-sshkey) 2025-12-03 13:01:55.046881 | controller -> localhost | ok: Runtime: 0:00:00.007497 2025-12-03 13:01:55.052437 | 2025-12-03 13:01:55.052505 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2025-12-03 13:01:55.397469 | controller | ok 2025-12-03 13:01:55.401863 | 2025-12-03 13:01:55.401936 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2025-12-03 13:01:55.426736 | controller | skipping: Conditional result was False 2025-12-03 13:01:55.435765 | 2025-12-03 13:01:55.435848 | TASK [include_role : validate-host] 2025-12-03 13:01:55.454055 | controller | ok 2025-12-03 13:01:55.472678 | 2025-12-03 13:01:55.472848 | TASK [validate-host : Define zuul_info_dir fact] 2025-12-03 13:01:55.501280 | controller | ok 2025-12-03 13:01:55.505775 | 2025-12-03 13:01:55.505840 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2025-12-03 13:01:55.714088 | controller -> localhost | ok 2025-12-03 13:01:55.719665 | 2025-12-03 13:01:55.719799 | TASK [validate-host : Collect information about the host] 2025-12-03 13:01:56.396629 | controller | ok 2025-12-03 13:01:56.404462 | 2025-12-03 13:01:56.404614 | TASK [validate-host : Sanitize hostname] 2025-12-03 13:01:56.444515 | controller | ok 2025-12-03 13:01:56.449718 | 2025-12-03 13:01:56.449789 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2025-12-03 13:01:56.831812 | controller -> localhost | changed 2025-12-03 13:01:56.837867 | 2025-12-03 13:01:56.837945 | TASK [validate-host : Collect information about zuul worker] 2025-12-03 13:01:57.202600 | controller | ok 2025-12-03 13:01:57.207312 | 2025-12-03 13:01:57.207383 | TASK [validate-host : Write out all zuul information for each host] 2025-12-03 13:01:57.586371 | controller -> localhost | changed 2025-12-03 13:01:57.595615 | 2025-12-03 13:01:57.595714 | TASK [include_role : prepare-workspace-openshift] 2025-12-03 13:01:57.609353 | controller | skipping: Conditional result was False 2025-12-03 13:01:57.614485 | 2025-12-03 13:01:57.614550 | TASK [include_role : remove-zuul-sshkey] 2025-12-03 13:01:57.627819 | controller | skipping: Conditional result was False 2025-12-03 13:01:57.632853 | 2025-12-03 13:01:57.632922 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2025-12-03 13:01:57.872319 | controller | ok: "logs" 2025-12-03 13:01:57.872584 | controller | ok: All items complete 2025-12-03 13:01:57.872618 | 2025-12-03 13:01:58.094012 | controller | ok: "artifacts" 2025-12-03 13:01:58.332736 | controller | ok: "docs" 2025-12-03 13:01:58.341467 | 2025-12-03 13:01:58.341540 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2025-12-03 13:01:58.609390 | controller | changed: "logs" 2025-12-03 13:01:58.834679 | controller | changed: "artifacts" 2025-12-03 13:01:59.056913 | controller | changed: "docs" 2025-12-03 13:01:59.084252 | 2025-12-03 13:01:59.084350 | PLAY RECAP 2025-12-03 13:01:59.084397 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-12-03 13:01:59.084425 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-12-03 13:01:59.084445 | 2025-12-03 13:01:59.159719 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-12-03 13:01:59.160553 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-12-03 13:01:59.753336 | 2025-12-03 13:01:59.753439 | PLAY [all] 2025-12-03 13:01:59.773030 | 2025-12-03 13:01:59.773105 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-12-03 13:01:59.821646 | controller | ok 2025-12-03 13:01:59.826516 | 2025-12-03 13:01:59.826593 | TASK [mirror-info-fork : Create /etc/ci] 2025-12-03 13:02:00.210517 | controller | changed 2025-12-03 13:02:00.216185 | 2025-12-03 13:02:00.216259 | TASK [mirror-info-fork : Install ci_mirror script] 2025-12-03 13:02:01.473500 | controller | changed 2025-12-03 13:02:01.483235 | 2025-12-03 13:02:01.483302 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2025-12-03 13:02:01.901671 | controller | changed: 2025-12-03 13:02:01.901882 | controller | { 2025-12-03 13:02:01.901917 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2025-12-03 13:02:01.901948 | controller | } 2025-12-03 13:02:02.173871 | controller | changed: 2025-12-03 13:02:02.173959 | controller | { 2025-12-03 13:02:02.173988 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2025-12-03 13:02:02.174011 | controller | } 2025-12-03 13:02:02.442882 | controller | changed: 2025-12-03 13:02:02.442984 | controller | { 2025-12-03 13:02:02.443012 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2025-12-03 13:02:02.443034 | controller | } 2025-12-03 13:02:02.711103 | controller | changed: 2025-12-03 13:02:02.711209 | controller | { 2025-12-03 13:02:02.711237 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2025-12-03 13:02:02.711256 | controller | } 2025-12-03 13:02:02.992377 | controller | changed: 2025-12-03 13:02:02.992478 | controller | { 2025-12-03 13:02:02.992505 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2025-12-03 13:02:02.992525 | controller | } 2025-12-03 13:02:03.279779 | controller | changed: 2025-12-03 13:02:03.279984 | controller | { 2025-12-03 13:02:03.280022 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2025-12-03 13:02:03.280047 | controller | } 2025-12-03 13:02:03.560339 | controller | changed: 2025-12-03 13:02:03.560442 | controller | { 2025-12-03 13:02:03.560470 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2025-12-03 13:02:03.560493 | controller | } 2025-12-03 13:02:03.852330 | controller | changed: 2025-12-03 13:02:03.852430 | controller | { 2025-12-03 13:02:03.852458 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2025-12-03 13:02:03.852482 | controller | } 2025-12-03 13:02:04.130771 | controller | changed: 2025-12-03 13:02:04.130884 | controller | { 2025-12-03 13:02:04.130911 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2025-12-03 13:02:04.130931 | controller | } 2025-12-03 13:02:04.430019 | controller | changed: 2025-12-03 13:02:04.430105 | controller | { 2025-12-03 13:02:04.430133 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2025-12-03 13:02:04.430172 | controller | } 2025-12-03 13:02:04.685994 | controller | changed: 2025-12-03 13:02:04.686084 | controller | { 2025-12-03 13:02:04.686110 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2025-12-03 13:02:04.686130 | controller | } 2025-12-03 13:02:04.960935 | controller | changed: 2025-12-03 13:02:04.961028 | controller | { 2025-12-03 13:02:04.961057 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2025-12-03 13:02:04.961079 | controller | } 2025-12-03 13:02:05.235311 | controller | changed: 2025-12-03 13:02:05.235409 | controller | { 2025-12-03 13:02:05.235435 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGpU/BepK3qX0NRf5Np+dOBDqzQEefhNrw2DCZaH3uWW rebtoor@monolith" 2025-12-03 13:02:05.235454 | controller | } 2025-12-03 13:02:05.507889 | controller | changed: 2025-12-03 13:02:05.507991 | controller | { 2025-12-03 13:02:05.508017 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2025-12-03 13:02:05.508037 | controller | } 2025-12-03 13:02:05.782182 | controller | changed: 2025-12-03 13:02:05.782270 | controller | { 2025-12-03 13:02:05.782296 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2025-12-03 13:02:05.782316 | controller | } 2025-12-03 13:02:06.057525 | controller | changed: 2025-12-03 13:02:06.057616 | controller | { 2025-12-03 13:02:06.057643 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2025-12-03 13:02:06.057663 | controller | } 2025-12-03 13:02:06.334206 | controller | changed: 2025-12-03 13:02:06.334303 | controller | { 2025-12-03 13:02:06.334330 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2025-12-03 13:02:06.334351 | controller | } 2025-12-03 13:02:06.612673 | controller | changed: 2025-12-03 13:02:06.612788 | controller | { 2025-12-03 13:02:06.612815 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2025-12-03 13:02:06.612846 | controller | } 2025-12-03 13:02:06.890334 | controller | changed: 2025-12-03 13:02:06.890432 | controller | { 2025-12-03 13:02:06.890458 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2025-12-03 13:02:06.890477 | controller | } 2025-12-03 13:02:07.168618 | controller | changed: 2025-12-03 13:02:07.168799 | controller | { 2025-12-03 13:02:07.168840 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2025-12-03 13:02:07.168930 | controller | } 2025-12-03 13:02:07.444459 | controller | changed: 2025-12-03 13:02:07.444556 | controller | { 2025-12-03 13:02:07.444583 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2025-12-03 13:02:07.444601 | controller | } 2025-12-03 13:02:07.725922 | controller | changed: 2025-12-03 13:02:07.725980 | controller | { 2025-12-03 13:02:07.726006 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2025-12-03 13:02:07.726026 | controller | } 2025-12-03 13:02:08.003135 | controller | changed: 2025-12-03 13:02:08.003203 | controller | { 2025-12-03 13:02:08.003229 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2025-12-03 13:02:08.003249 | controller | } 2025-12-03 13:02:08.282911 | controller | changed: 2025-12-03 13:02:08.283008 | controller | { 2025-12-03 13:02:08.283033 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2025-12-03 13:02:08.283053 | controller | } 2025-12-03 13:02:08.558333 | controller | changed: 2025-12-03 13:02:08.558482 | controller | { 2025-12-03 13:02:08.558516 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2025-12-03 13:02:08.558539 | controller | } 2025-12-03 13:02:08.838641 | controller | changed: 2025-12-03 13:02:08.838759 | controller | { 2025-12-03 13:02:08.838786 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2025-12-03 13:02:08.838807 | controller | } 2025-12-03 13:02:08.855754 | 2025-12-03 13:02:08.855824 | TASK [Set timezone to UTC] 2025-12-03 13:02:09.321154 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2025-12-03 13:02:09.325994 | 2025-12-03 13:02:09.326073 | TASK [Create nodepool directory] 2025-12-03 13:02:09.588237 | controller | changed 2025-12-03 13:02:09.594603 | 2025-12-03 13:02:09.594670 | TASK [Create nodepool sub_nodes file] 2025-12-03 13:02:10.528106 | controller | changed 2025-12-03 13:02:10.533025 | 2025-12-03 13:02:10.533091 | TASK [Create nodepool sub_nodes_private file] 2025-12-03 13:02:11.441134 | controller | changed 2025-12-03 13:02:11.446968 | 2025-12-03 13:02:11.447069 | LOOP [Populate nodepool sub_nodes file] 2025-12-03 13:02:11.489560 | 2025-12-03 13:02:11.489804 | LOOP [Populate nodepool sub_nodes_private file] 2025-12-03 13:02:11.521876 | 2025-12-03 13:02:11.522077 | TASK [Create nodepool primary file] 2025-12-03 13:02:11.548040 | controller | skipping: Conditional result was False 2025-12-03 13:02:11.554727 | 2025-12-03 13:02:11.554834 | TASK [Create nodepool node_private for this node] 2025-12-03 13:02:12.488629 | controller | changed 2025-12-03 13:02:12.495666 | 2025-12-03 13:02:12.495780 | LOOP [Copy ssh keys to nodepool directory] 2025-12-03 13:02:12.873070 | controller | ok: Item: id_rsa Runtime: 0:00:00.004353 2025-12-03 13:02:12.873321 | 2025-12-03 13:02:13.090836 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.004683 2025-12-03 13:02:13.105094 | 2025-12-03 13:02:13.105212 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2025-12-03 13:02:14.060935 | controller | changed 2025-12-03 13:02:14.065944 | 2025-12-03 13:02:14.066005 | TASK [Validate sudoers config after edits] 2025-12-03 13:02:14.351897 | controller | /etc/sudoers: parsed OK 2025-12-03 13:02:14.351955 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2025-12-03 13:02:14.351965 | controller | /etc/sudoers.d/zuul: parsed OK 2025-12-03 13:02:14.351972 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2025-12-03 13:02:14.593900 | controller | ok: Runtime: 0:00:00.006052 2025-12-03 13:02:14.599781 | 2025-12-03 13:02:14.599847 | TASK [Show the environment passed in to job shell scripts] 2025-12-03 13:02:14.870273 | controller | SHELL=/bin/bash 2025-12-03 13:02:14.870320 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2025-12-03 13:02:14.870330 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2025-12-03 13:02:14.870338 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/23/3523/b0014b650b386b32f65c1992c615d20c5b09b079^openstack-k8s-operators/ci-framework:main:refs/changes/05/3505/1984976a6c094fedb60916aad810b6bed5b06d95 2025-12-03 13:02:14.870376 | controller | PWD=/home/zuul 2025-12-03 13:02:14.870383 | controller | ZUUL_PIPELINE=github-check 2025-12-03 13:02:14.870389 | controller | LOGNAME=zuul 2025-12-03 13:02:14.870394 | controller | XDG_SESSION_TYPE=tty 2025-12-03 13:02:14.870399 | controller | _=/usr/bin/env 2025-12-03 13:02:14.870405 | controller | MOTD_SHOWN=pam 2025-12-03 13:02:14.870420 | controller | HOME=/home/zuul 2025-12-03 13:02:14.870426 | controller | LANG=en_US.UTF-8 2025-12-03 13:02:14.870432 | controller | SSH_CONNECTION=192.168.25.12 41678 192.168.25.6 22 2025-12-03 13:02:14.870437 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2025-12-03 13:02:14.870443 | controller | ZUUL_CHANGE_IDS=3523,b0014b650b386b32f65c1992c615d20c5b09b079 3505,1984976a6c094fedb60916aad810b6bed5b06d95 2025-12-03 13:02:14.870448 | controller | WORKSPACE=/home/zuul/workspace 2025-12-03 13:02:14.870454 | controller | XDG_SESSION_CLASS=user 2025-12-03 13:02:14.870459 | controller | SELINUX_ROLE_REQUESTED= 2025-12-03 13:02:14.870465 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2025-12-03 13:02:14.870470 | controller | USER=zuul 2025-12-03 13:02:14.870475 | controller | ZUUL_VOTING=True 2025-12-03 13:02:14.870480 | controller | BUILD_TIMEOUT=5400000 2025-12-03 13:02:14.870486 | controller | SELINUX_USE_CURRENT_RANGE= 2025-12-03 13:02:14.870491 | controller | SHLVL=1 2025-12-03 13:02:14.870496 | controller | ZUUL_PATCHSET=1984976a6c094fedb60916aad810b6bed5b06d95 2025-12-03 13:02:14.870502 | controller | XDG_SESSION_ID=1 2025-12-03 13:02:14.870507 | controller | ZUUL_BRANCH=main 2025-12-03 13:02:14.870512 | controller | XDG_RUNTIME_DIR=/run/user/1000 2025-12-03 13:02:14.870518 | controller | SSH_CLIENT=192.168.25.12 41678 22 2025-12-03 13:02:14.870523 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2025-12-03 13:02:14.870529 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2025-12-03 13:02:14.870534 | controller | which_declare=declare -f 2025-12-03 13:02:14.870540 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2025-12-03 13:02:14.870546 | controller | SELINUX_LEVEL_REQUESTED= 2025-12-03 13:02:14.870551 | controller | ZUUL_CHANGE=3505 2025-12-03 13:02:14.870556 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2025-12-03 13:02:14.870562 | controller | ZUUL_UUID=1245cf0cec5a44359e24afa34990e190 2025-12-03 13:02:14.870567 | controller | BASH_FUNC_which%%=() { ( alias; 2025-12-03 13:02:14.870573 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2025-12-03 13:02:14.870578 | controller | } 2025-12-03 13:02:15.123133 | controller | ok: Runtime: 0:00:00.006064 2025-12-03 13:02:15.129028 | 2025-12-03 13:02:15.129109 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2025-12-03 13:02:15.143976 | controller | skipping: Conditional result was False 2025-12-03 13:02:15.150125 | 2025-12-03 13:02:15.150202 | TASK [Symlink /home/zuul-worker/workspace] 2025-12-03 13:02:15.700064 | controller | skipping: Conditional result was False 2025-12-03 13:02:15.706234 | 2025-12-03 13:02:15.706313 | TASK [Ensure legacy workspace directory] 2025-12-03 13:02:15.960031 | controller | changed 2025-12-03 13:02:15.978411 | 2025-12-03 13:02:15.978481 | PLAY RECAP 2025-12-03 13:02:15.978529 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-12-03 13:02:15.978552 | 2025-12-03 13:02:16.060503 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-12-03 13:02:16.061280 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-12-03 13:02:16.554970 | 2025-12-03 13:02:16.555136 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2025-12-03 13:02:16.575265 | 2025-12-03 13:02:16.575337 | TASK [Create zuul-output directory] 2025-12-03 13:02:16.952559 | controller | changed 2025-12-03 13:02:16.957681 | 2025-12-03 13:02:16.957794 | TASK [Slurp Zuul inventory test] 2025-12-03 13:02:17.245179 | controller -> localhost | ok 2025-12-03 13:02:17.251921 | 2025-12-03 13:02:17.252003 | TASK [Save zuul inventory] 2025-12-03 13:02:18.525736 | controller | changed 2025-12-03 13:02:18.541264 | 2025-12-03 13:02:18.541513 | TASK [Save zuul vars without the change_message] 2025-12-03 13:02:19.521823 | controller | changed 2025-12-03 13:02:19.540717 | 2025-12-03 13:02:19.540811 | PLAY RECAP 2025-12-03 13:02:19.540861 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-12-03 13:02:19.540883 | 2025-12-03 13:02:19.611831 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-12-03 13:02:19.612537 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-12-03 13:02:20.155529 | 2025-12-03 13:02:20.155624 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2025-12-03 13:02:20.175989 | 2025-12-03 13:02:20.176062 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2025-12-03 13:02:20.195259 | controller | ok 2025-12-03 13:02:20.212411 | 2025-12-03 13:02:20.212491 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-12-03 13:02:20.237038 | controller | skipping: Conditional result was False 2025-12-03 13:02:20.242676 | 2025-12-03 13:02:20.242761 | TASK [mirror-info-fork : Create /etc/ci] 2025-12-03 13:02:20.606385 | controller | ok 2025-12-03 13:02:20.612184 | 2025-12-03 13:02:20.612259 | TASK [mirror-info-fork : Install ci_mirror script] 2025-12-03 13:02:21.505410 | controller | ok 2025-12-03 13:02:21.515340 | 2025-12-03 13:02:21.515406 | TASK [Prepare workspace] 2025-12-03 13:02:21.533558 | controller | ok 2025-12-03 13:02:21.549951 | 2025-12-03 13:02:21.550017 | TASK [prepare-workspace : Start zuul_console daemon.] 2025-12-03 13:02:21.882207 | controller | ok 2025-12-03 13:02:21.888070 | 2025-12-03 13:02:21.888134 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2025-12-03 13:02:24.285221 | controller | Output suppressed because no_log was given 2025-12-03 13:02:24.294627 | 2025-12-03 13:02:24.294707 | LOOP [Create zuul-output directory] 2025-12-03 13:02:24.538618 | controller | changed: "/home/zuul/ci-framework-data/logs" 2025-12-03 13:02:24.752736 | controller | ok: "/home/zuul/zuul-output/logs" 2025-12-03 13:02:24.763105 | 2025-12-03 13:02:24.763225 | TASK [Install required packages] 2025-12-03 13:02:48.490960 | controller | ok: Nothing to do 2025-12-03 13:02:48.496168 | 2025-12-03 13:02:48.496239 | TASK [Install venv] 2025-12-03 13:03:49.010172 | controller | changed 2025-12-03 13:03:49.053990 | 2025-12-03 13:03:49.054075 | PLAY RECAP 2025-12-03 13:03:49.054116 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-12-03 13:03:49.054150 | 2025-12-03 13:03:49.117209 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-12-03 13:03:49.118075 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-12-03 13:03:49.651976 | 2025-12-03 13:03:49.652109 | PLAY [Run ci/playbooks/molecule-test.yml] 2025-12-03 13:03:49.672819 | 2025-12-03 13:03:49.672905 | TASK [Gather required facts] 2025-12-03 13:03:50.240978 | controller | ok 2025-12-03 13:03:50.246317 | 2025-12-03 13:03:50.246394 | TASK [Load environment var if instructed to] 2025-12-03 13:03:50.270584 | controller | skipping: Conditional result was False 2025-12-03 13:03:50.275869 | 2025-12-03 13:03:50.275935 | TASK [Ensure group_vars dir exists] 2025-12-03 13:03:50.673937 | controller | ok 2025-12-03 13:03:50.679065 | 2025-12-03 13:03:50.679132 | TASK [Print related variables] 2025-12-03 13:03:50.707428 | controller | ok: 2025-12-03 13:03:50.707548 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2025-12-03 13:03:50.707577 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2025-12-03 13:03:50.712453 | 2025-12-03 13:03:50.712517 | TASK [Run molecule] 2025-12-03 13:03:51.714067 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2025-12-03 13:03:51.989731 | controller | INFO Performing prerun with role_name_check=0... 2025-12-03 13:04:08.048120 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 13:04:08.048493 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 13:04:08.048967 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 13:04:08.049436 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 13:04:08.049917 | controller | WARNING Another version of 'cifmw.general' 1.0.0+f81dfe06 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+f81dfe06 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 13:04:08.050377 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 13:04:08.050825 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 13:04:08.051287 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 13:04:08.051736 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 13:04:08.052192 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 13:04:08.052634 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 13:04:08.053091 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 13:04:08.053533 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 13:04:08.053975 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 13:04:08.054516 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-03 13:04:08.064033 | controller | INFO Running crc_layout > prepare 2025-12-03 13:04:08.731760 | controller | 2025-12-03 13:04:08.731937 | controller | PLAY [Prepare] ***************************************************************** 2025-12-03 13:04:08.732075 | controller | 2025-12-03 13:04:08.732181 | controller | TASK [Gathering Facts] ********************************************************* 2025-12-03 13:04:08.732280 | controller | Wednesday 03 December 2025 13:04:08 +0000 (0:00:00.018) 0:00:00.018 **** 2025-12-03 13:04:09.572559 | controller | ok: [instance] 2025-12-03 13:04:09.572619 | controller | 2025-12-03 13:04:09.572728 | controller | TASK [Create custom basedir] *************************************************** 2025-12-03 13:04:09.572845 | controller | Wednesday 03 December 2025 13:04:09 +0000 (0:00:00.841) 0:00:00.860 **** 2025-12-03 13:04:09.878389 | controller | changed: [instance] 2025-12-03 13:04:09.878500 | controller | 2025-12-03 13:04:09.878627 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2025-12-03 13:04:09.878774 | controller | Wednesday 03 December 2025 13:04:09 +0000 (0:00:00.305) 0:00:01.166 **** 2025-12-03 13:04:09.895990 | controller | skipping: [instance] 2025-12-03 13:04:09.896090 | controller | 2025-12-03 13:04:09.896206 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2025-12-03 13:04:09.896308 | controller | Wednesday 03 December 2025 13:04:09 +0000 (0:00:00.017) 0:00:01.184 **** 2025-12-03 13:04:09.937540 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2025-12-03 13:04:09.937709 | controller | 2025-12-03 13:04:09.937922 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2025-12-03 13:04:09.938108 | controller | Wednesday 03 December 2025 13:04:09 +0000 (0:00:00.041) 0:00:01.225 **** 2025-12-03 13:04:10.209136 | controller | ok: [instance] 2025-12-03 13:04:10.209201 | controller | 2025-12-03 13:04:10.209335 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2025-12-03 13:04:10.209431 | controller | Wednesday 03 December 2025 13:04:10 +0000 (0:00:00.271) 0:00:01.496 **** 2025-12-03 13:04:10.415216 | controller | ok: [instance] 2025-12-03 13:04:10.415260 | controller | 2025-12-03 13:04:10.415392 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2025-12-03 13:04:10.415498 | controller | Wednesday 03 December 2025 13:04:10 +0000 (0:00:00.206) 0:00:01.703 **** 2025-12-03 13:04:11.087598 | controller | ok: [instance] => (item=ubi-9-appstream) 2025-12-03 13:04:11.087683 | controller | ok: [instance] => (item=ubi-9-baseos) 2025-12-03 13:04:11.087791 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2025-12-03 13:04:11.087916 | controller | 2025-12-03 13:04:11.088006 | controller | TASK [Deploy repo-setup] ******************************************************* 2025-12-03 13:04:11.088117 | controller | Wednesday 03 December 2025 13:04:11 +0000 (0:00:00.672) 0:00:02.375 **** 2025-12-03 13:04:11.145996 | controller | 2025-12-03 13:04:11.146147 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-12-03 13:04:11.146290 | controller | Wednesday 03 December 2025 13:04:11 +0000 (0:00:00.058) 0:00:02.434 **** 2025-12-03 13:04:11.667245 | controller | changed: [instance] => (item=tmp) 2025-12-03 13:04:11.667338 | controller | changed: [instance] => (item=artifacts/repositories) 2025-12-03 13:04:11.667442 | controller | changed: [instance] => (item=venv/repo_setup) 2025-12-03 13:04:11.667538 | controller | 2025-12-03 13:04:11.667638 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-12-03 13:04:11.667745 | controller | Wednesday 03 December 2025 13:04:11 +0000 (0:00:00.521) 0:00:02.955 **** 2025-12-03 13:04:12.495671 | controller | ok: [instance] 2025-12-03 13:04:12.496014 | controller | 2025-12-03 13:04:13.533242 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-12-03 13:04:13.533286 | controller | Wednesday 03 December 2025 13:04:12 +0000 (0:00:00.828) 0:00:03.783 **** 2025-12-03 13:04:13.533302 | controller | changed: [instance] 2025-12-03 13:04:13.533334 | controller | 2025-12-03 13:04:13.533351 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-12-03 13:04:13.533378 | controller | Wednesday 03 December 2025 13:04:13 +0000 (0:00:01.037) 0:00:04.820 **** 2025-12-03 13:04:21.350093 | controller | changed: [instance] 2025-12-03 13:04:22.054242 | controller | 2025-12-03 13:04:22.054283 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-12-03 13:04:22.054293 | controller | Wednesday 03 December 2025 13:04:21 +0000 (0:00:07.816) 0:00:12.637 **** 2025-12-03 13:04:22.054306 | controller | changed: [instance] 2025-12-03 13:04:22.076169 | controller | 2025-12-03 13:04:22.076197 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-12-03 13:04:22.076207 | controller | Wednesday 03 December 2025 13:04:22 +0000 (0:00:00.704) 0:00:13.341 **** 2025-12-03 13:04:22.076219 | controller | skipping: [instance] 2025-12-03 13:04:22.076255 | controller | 2025-12-03 13:04:22.076265 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-12-03 13:04:22.076374 | controller | Wednesday 03 December 2025 13:04:22 +0000 (0:00:00.021) 0:00:13.363 **** 2025-12-03 13:04:22.883893 | controller | changed: [instance] 2025-12-03 13:04:22.920054 | controller | 2025-12-03 13:04:22.920091 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-12-03 13:04:22.920103 | controller | Wednesday 03 December 2025 13:04:22 +0000 (0:00:00.807) 0:00:14.171 **** 2025-12-03 13:04:22.920112 | controller | skipping: [instance] 2025-12-03 13:04:22.954945 | controller | 2025-12-03 13:04:22.954969 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-12-03 13:04:22.954979 | controller | Wednesday 03 December 2025 13:04:22 +0000 (0:00:00.035) 0:00:14.207 **** 2025-12-03 13:04:22.954990 | controller | skipping: [instance] 2025-12-03 13:04:22.990556 | controller | 2025-12-03 13:04:22.990580 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-12-03 13:04:22.990589 | controller | Wednesday 03 December 2025 13:04:22 +0000 (0:00:00.035) 0:00:14.242 **** 2025-12-03 13:04:22.990600 | controller | skipping: [instance] 2025-12-03 13:04:23.528552 | controller | 2025-12-03 13:04:23.528577 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-12-03 13:04:23.528585 | controller | Wednesday 03 December 2025 13:04:22 +0000 (0:00:00.035) 0:00:14.278 **** 2025-12-03 13:04:23.528594 | controller | changed: [instance] 2025-12-03 13:04:23.968893 | controller | 2025-12-03 13:04:23.968921 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-12-03 13:04:23.968929 | controller | Wednesday 03 December 2025 13:04:23 +0000 (0:00:00.537) 0:00:14.816 **** 2025-12-03 13:04:23.968938 | controller | changed: [instance] 2025-12-03 13:04:23.998152 | controller | 2025-12-03 13:04:23.998192 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-12-03 13:04:23.998202 | controller | Wednesday 03 December 2025 13:04:23 +0000 (0:00:00.440) 0:00:15.256 **** 2025-12-03 13:04:23.998216 | controller | skipping: [instance] 2025-12-03 13:04:24.026710 | controller | 2025-12-03 13:04:24.026742 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-12-03 13:04:24.026752 | controller | Wednesday 03 December 2025 13:04:23 +0000 (0:00:00.029) 0:00:15.285 **** 2025-12-03 13:04:24.026768 | controller | skipping: [instance] 2025-12-03 13:04:24.056626 | controller | 2025-12-03 13:04:24.056649 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-12-03 13:04:24.056659 | controller | Wednesday 03 December 2025 13:04:24 +0000 (0:00:00.028) 0:00:15.314 **** 2025-12-03 13:04:24.056670 | controller | skipping: [instance] 2025-12-03 13:04:24.094554 | controller | 2025-12-03 13:04:24.094576 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-12-03 13:04:24.094586 | controller | Wednesday 03 December 2025 13:04:24 +0000 (0:00:00.030) 0:00:15.344 **** 2025-12-03 13:04:24.094597 | controller | ok: [instance] 2025-12-03 13:04:24.121138 | controller | 2025-12-03 13:04:24.121157 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-12-03 13:04:24.121164 | controller | Wednesday 03 December 2025 13:04:24 +0000 (0:00:00.037) 0:00:15.382 **** 2025-12-03 13:04:24.121179 | controller | skipping: [instance] 2025-12-03 13:04:24.121386 | controller | 2025-12-03 13:04:24.121405 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-12-03 13:04:24.148922 | controller | Wednesday 03 December 2025 13:04:24 +0000 (0:00:00.026) 0:00:15.409 **** 2025-12-03 13:04:24.148947 | controller | skipping: [instance] 2025-12-03 13:04:24.149167 | controller | 2025-12-03 13:04:24.149350 | controller | TASK [Download the RPM] ******************************************************** 2025-12-03 13:04:24.149491 | controller | Wednesday 03 December 2025 13:04:24 +0000 (0:00:00.028) 0:00:15.437 **** 2025-12-03 13:04:24.175778 | controller | skipping: [instance] 2025-12-03 13:04:24.175963 | controller | 2025-12-03 13:04:24.176190 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-12-03 13:04:24.176367 | controller | Wednesday 03 December 2025 13:04:24 +0000 (0:00:00.026) 0:00:15.463 **** 2025-12-03 13:04:24.204262 | controller | skipping: [instance] 2025-12-03 13:04:24.204413 | controller | 2025-12-03 13:04:24.204556 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-12-03 13:04:24.204692 | controller | Wednesday 03 December 2025 13:04:24 +0000 (0:00:00.028) 0:00:15.492 **** 2025-12-03 13:04:24.232133 | controller | skipping: [instance] 2025-12-03 13:04:24.232331 | controller | 2025-12-03 13:04:24.232505 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-12-03 13:04:24.232646 | controller | Wednesday 03 December 2025 13:04:24 +0000 (0:00:00.027) 0:00:15.520 **** 2025-12-03 13:04:24.260660 | controller | skipping: [instance] 2025-12-03 13:04:24.260853 | controller | 2025-12-03 13:04:24.261059 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-12-03 13:04:24.261263 | controller | Wednesday 03 December 2025 13:04:24 +0000 (0:00:00.028) 0:00:15.548 **** 2025-12-03 13:04:24.286804 | controller | skipping: [instance] 2025-12-03 13:04:24.286991 | controller | 2025-12-03 13:04:24.287230 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-12-03 13:04:24.287410 | controller | Wednesday 03 December 2025 13:04:24 +0000 (0:00:00.026) 0:00:15.574 **** 2025-12-03 13:04:24.469156 | controller | ok: [instance] 2025-12-03 13:04:24.469246 | controller | 2025-12-03 13:04:24.469261 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-12-03 13:04:24.469271 | controller | Wednesday 03 December 2025 13:04:24 +0000 (0:00:00.182) 0:00:15.757 **** 2025-12-03 13:04:24.675203 | controller | changed: [instance] 2025-12-03 13:04:24.675312 | controller | 2025-12-03 13:04:24.675333 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-12-03 13:04:24.675345 | controller | Wednesday 03 December 2025 13:04:24 +0000 (0:00:00.206) 0:00:15.963 **** 2025-12-03 13:04:24.905016 | controller | changed: [instance] 2025-12-03 13:04:24.926171 | controller | 2025-12-03 13:04:24.926202 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-12-03 13:04:24.926210 | controller | Wednesday 03 December 2025 13:04:24 +0000 (0:00:00.229) 0:00:16.192 **** 2025-12-03 13:04:24.926221 | controller | skipping: [instance] 2025-12-03 13:04:24.926292 | controller | 2025-12-03 13:04:24.926313 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-12-03 13:04:24.926326 | controller | Wednesday 03 December 2025 13:04:24 +0000 (0:00:00.021) 0:00:16.214 **** 2025-12-03 13:04:24.948151 | controller | skipping: [instance] 2025-12-03 13:04:24.948554 | controller | 2025-12-03 13:04:24.970571 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-12-03 13:04:24.970593 | controller | Wednesday 03 December 2025 13:04:24 +0000 (0:00:00.022) 0:00:16.236 **** 2025-12-03 13:04:24.970613 | controller | skipping: [instance] 2025-12-03 13:04:24.991971 | controller | 2025-12-03 13:04:24.991989 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-12-03 13:04:24.991997 | controller | Wednesday 03 December 2025 13:04:24 +0000 (0:00:00.022) 0:00:16.258 **** 2025-12-03 13:04:24.992019 | controller | skipping: [instance] 2025-12-03 13:04:25.013534 | controller | 2025-12-03 13:04:25.013555 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-12-03 13:04:25.013571 | controller | Wednesday 03 December 2025 13:04:24 +0000 (0:00:00.021) 0:00:16.279 **** 2025-12-03 13:04:25.013582 | controller | skipping: [instance] 2025-12-03 13:04:25.034420 | controller | 2025-12-03 13:04:25.034442 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-12-03 13:04:25.034451 | controller | Wednesday 03 December 2025 13:04:25 +0000 (0:00:00.021) 0:00:16.301 **** 2025-12-03 13:04:25.034462 | controller | skipping: [instance] 2025-12-03 13:04:25.034635 | controller | 2025-12-03 13:04:25.034807 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-12-03 13:04:25.034983 | controller | Wednesday 03 December 2025 13:04:25 +0000 (0:00:00.021) 0:00:16.322 **** 2025-12-03 13:04:25.051391 | controller | skipping: [instance] 2025-12-03 13:04:25.051575 | controller | 2025-12-03 13:04:25.051751 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-12-03 13:04:25.051919 | controller | Wednesday 03 December 2025 13:04:25 +0000 (0:00:00.017) 0:00:16.339 **** 2025-12-03 13:04:25.080557 | controller | skipping: [instance] 2025-12-03 13:04:25.097493 | controller | 2025-12-03 13:04:25.097513 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-12-03 13:04:25.097522 | controller | Wednesday 03 December 2025 13:04:25 +0000 (0:00:00.028) 0:00:16.368 **** 2025-12-03 13:04:25.097532 | controller | skipping: [instance] 2025-12-03 13:04:25.117999 | controller | 2025-12-03 13:04:25.118035 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-12-03 13:04:25.118044 | controller | Wednesday 03 December 2025 13:04:25 +0000 (0:00:00.016) 0:00:16.385 **** 2025-12-03 13:04:25.118055 | controller | skipping: [instance] 2025-12-03 13:04:25.118243 | controller | 2025-12-03 13:04:25.118393 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2025-12-03 13:04:25.118531 | controller | Wednesday 03 December 2025 13:04:25 +0000 (0:00:00.020) 0:00:16.406 **** 2025-12-03 13:04:25.147654 | controller | skipping: [instance] 2025-12-03 13:04:25.147839 | controller | 2025-12-03 13:04:25.148034 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2025-12-03 13:04:25.148247 | controller | Wednesday 03 December 2025 13:04:25 +0000 (0:00:00.029) 0:00:16.435 **** 2025-12-03 13:04:25.176578 | controller | skipping: [instance] 2025-12-03 13:04:25.176760 | controller | 2025-12-03 13:04:25.176935 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2025-12-03 13:04:25.177150 | controller | Wednesday 03 December 2025 13:04:25 +0000 (0:00:00.028) 0:00:16.464 **** 2025-12-03 13:04:25.206301 | controller | skipping: [instance] 2025-12-03 13:04:25.206487 | controller | 2025-12-03 13:04:25.206670 | controller | TASK [test_deps : Install additional packages] ********************************* 2025-12-03 13:04:25.206840 | controller | Wednesday 03 December 2025 13:04:25 +0000 (0:00:00.029) 0:00:16.494 **** 2025-12-03 13:04:25.238995 | controller | skipping: [instance] 2025-12-03 13:04:25.239230 | controller | 2025-12-03 13:04:25.239416 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2025-12-03 13:04:25.239558 | controller | Wednesday 03 December 2025 13:04:25 +0000 (0:00:00.032) 0:00:16.527 **** 2025-12-03 13:05:13.711159 | controller | ok: [instance] 2025-12-03 13:05:14.914773 | controller | 2025-12-03 13:05:14.914804 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2025-12-03 13:05:14.914813 | controller | Wednesday 03 December 2025 13:05:13 +0000 (0:00:48.471) 0:01:04.998 **** 2025-12-03 13:05:14.914822 | controller | ok: [instance] 2025-12-03 13:05:14.946731 | controller | 2025-12-03 13:05:14.946760 | controller | TASK [test_deps : Install extra packages] ************************************** 2025-12-03 13:05:14.946772 | controller | Wednesday 03 December 2025 13:05:14 +0000 (0:00:01.203) 0:01:06.202 **** 2025-12-03 13:05:14.946787 | controller | skipping: [instance] 2025-12-03 13:05:14.987180 | controller | 2025-12-03 13:05:14.987216 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-12-03 13:05:14.987225 | controller | Wednesday 03 December 2025 13:05:14 +0000 (0:00:00.031) 0:01:06.234 **** 2025-12-03 13:05:14.987236 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2025-12-03 13:05:15.006209 | controller | 2025-12-03 13:05:15.006233 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-12-03 13:05:15.006242 | controller | Wednesday 03 December 2025 13:05:14 +0000 (0:00:00.040) 0:01:06.275 **** 2025-12-03 13:05:15.006254 | controller | ok: [instance] => 2025-12-03 13:05:15.006282 | controller | cifmw_ci_setup_packages: 2025-12-03 13:05:15.006292 | controller | - bash-completion 2025-12-03 13:05:15.007204 | controller | - ca-certificates 2025-12-03 13:05:19.313228 | controller | - git-core 2025-12-03 13:05:19.313271 | controller | - make 2025-12-03 13:05:19.313281 | controller | - tar 2025-12-03 13:05:19.313288 | controller | - tmux 2025-12-03 13:05:19.313295 | controller | - python3-pip 2025-12-03 13:05:19.313302 | controller | 2025-12-03 13:05:19.313309 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-12-03 13:05:19.313325 | controller | Wednesday 03 December 2025 13:05:15 +0000 (0:00:00.019) 0:01:06.294 **** 2025-12-03 13:05:19.313338 | controller | changed: [instance] 2025-12-03 13:05:19.871250 | controller | 2025-12-03 13:05:19.871293 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-12-03 13:05:19.871302 | controller | Wednesday 03 December 2025 13:05:19 +0000 (0:00:04.306) 0:01:10.600 **** 2025-12-03 13:05:19.871315 | controller | ok: [instance] 2025-12-03 13:05:19.871345 | controller | 2025-12-03 13:05:19.871355 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-12-03 13:05:19.871464 | controller | Wednesday 03 December 2025 13:05:19 +0000 (0:00:00.558) 0:01:11.159 **** 2025-12-03 13:05:20.071248 | controller | changed: [instance] 2025-12-03 13:05:20.071302 | controller | 2025-12-03 13:05:20.071315 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-12-03 13:05:20.071409 | controller | Wednesday 03 December 2025 13:05:20 +0000 (0:00:00.200) 0:01:11.359 **** 2025-12-03 13:05:26.047149 | controller | changed: [instance] 2025-12-03 13:05:26.082037 | controller | 2025-12-03 13:05:26.082060 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-12-03 13:05:26.082070 | controller | Wednesday 03 December 2025 13:05:26 +0000 (0:00:05.975) 0:01:17.334 **** 2025-12-03 13:05:26.082102 | controller | ok: [instance] 2025-12-03 13:05:26.344646 | controller | 2025-12-03 13:05:26.344676 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-12-03 13:05:26.344686 | controller | Wednesday 03 December 2025 13:05:26 +0000 (0:00:00.035) 0:01:17.369 **** 2025-12-03 13:05:26.344698 | controller | changed: [instance] 2025-12-03 13:05:26.597829 | controller | 2025-12-03 13:05:26.597856 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-12-03 13:05:26.597864 | controller | Wednesday 03 December 2025 13:05:26 +0000 (0:00:00.262) 0:01:17.632 **** 2025-12-03 13:05:26.597874 | controller | changed: [instance] 2025-12-03 13:05:26.614207 | controller | 2025-12-03 13:05:26.614242 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-12-03 13:05:26.614252 | controller | Wednesday 03 December 2025 13:05:26 +0000 (0:00:00.253) 0:01:17.885 **** 2025-12-03 13:05:26.614264 | controller | skipping: [instance] 2025-12-03 13:05:26.614292 | controller | 2025-12-03 13:05:26.614305 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-12-03 13:05:26.614372 | controller | Wednesday 03 December 2025 13:05:26 +0000 (0:00:00.016) 0:01:17.902 **** 2025-12-03 13:05:26.630204 | controller | skipping: [instance] 2025-12-03 13:05:26.646738 | controller | 2025-12-03 13:05:26.646757 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-12-03 13:05:26.646766 | controller | Wednesday 03 December 2025 13:05:26 +0000 (0:00:00.015) 0:01:17.917 **** 2025-12-03 13:05:26.646777 | controller | skipping: [instance] 2025-12-03 13:05:26.663165 | controller | 2025-12-03 13:05:26.663180 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-12-03 13:05:26.663187 | controller | Wednesday 03 December 2025 13:05:26 +0000 (0:00:00.016) 0:01:17.934 **** 2025-12-03 13:05:26.663197 | controller | skipping: [instance] 2025-12-03 13:05:26.663227 | controller | 2025-12-03 13:05:26.663235 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-12-03 13:05:26.663253 | controller | Wednesday 03 December 2025 13:05:26 +0000 (0:00:00.016) 0:01:17.950 **** 2025-12-03 13:05:26.679163 | controller | skipping: [instance] 2025-12-03 13:05:26.679370 | controller | 2025-12-03 13:05:26.679383 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-12-03 13:05:26.700885 | controller | Wednesday 03 December 2025 13:05:26 +0000 (0:00:00.016) 0:01:17.967 **** 2025-12-03 13:05:26.700918 | controller | skipping: [instance] 2025-12-03 13:05:27.654367 | controller | 2025-12-03 13:05:27.654404 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-12-03 13:05:27.654415 | controller | Wednesday 03 December 2025 13:05:26 +0000 (0:00:00.021) 0:01:17.988 **** 2025-12-03 13:05:27.654428 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2025-12-03 13:05:27.654460 | controller | changed: [instance] => (item=/opt/basedir/logs) 2025-12-03 13:05:27.654468 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2025-12-03 13:05:27.654475 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2025-12-03 13:05:27.654482 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2025-12-03 13:05:27.654489 | controller | 2025-12-03 13:05:27.654497 | controller | TASK [Create secret file] ****************************************************** 2025-12-03 13:05:27.654506 | controller | Wednesday 03 December 2025 13:05:27 +0000 (0:00:00.952) 0:01:18.941 **** 2025-12-03 13:05:27.986225 | controller | changed: [instance] 2025-12-03 13:05:27.986287 | controller | 2025-12-03 13:05:27.986298 | controller | PLAY RECAP ********************************************************************* 2025-12-03 13:05:27.986306 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2025-12-03 13:05:27.986313 | controller | 2025-12-03 13:05:27.986320 | controller | Wednesday 03 December 2025 13:05:27 +0000 (0:00:00.330) 0:01:19.272 **** 2025-12-03 13:05:27.986332 | controller | =============================================================================== 2025-12-03 13:05:27.986339 | controller | test_deps : Install selinux python libs -------------------------------- 48.47s 2025-12-03 13:05:27.986346 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.82s 2025-12-03 13:05:27.986353 | controller | ci_setup : Install openshift client ------------------------------------- 5.98s 2025-12-03 13:05:27.986359 | controller | ci_setup : Install needed packages -------------------------------------- 4.31s 2025-12-03 13:05:27.986366 | controller | test_deps : Install python yaml libs ------------------------------------ 1.20s 2025-12-03 13:05:27.986372 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.04s 2025-12-03 13:05:27.986378 | controller | ci_setup : Manage directories ------------------------------------------- 0.95s 2025-12-03 13:05:27.986385 | controller | Gathering Facts --------------------------------------------------------- 0.84s 2025-12-03 13:05:27.986391 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.83s 2025-12-03 13:05:27.986398 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.81s 2025-12-03 13:05:27.986404 | controller | repo_setup : Install repo-setup package --------------------------------- 0.70s 2025-12-03 13:05:27.986411 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.67s 2025-12-03 13:05:27.986417 | controller | ci_setup : Gather version of openshift client --------------------------- 0.56s 2025-12-03 13:05:27.986424 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.54s 2025-12-03 13:05:27.986433 | controller | repo_setup : Ensure directories are present ----------------------------- 0.52s 2025-12-03 13:05:27.986461 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.44s 2025-12-03 13:05:27.986742 | controller | Create secret file ------------------------------------------------------ 0.33s 2025-12-03 13:05:27.986757 | controller | Create custom basedir --------------------------------------------------- 0.31s 2025-12-03 13:05:28.042211 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.27s 2025-12-03 13:05:28.042258 | controller | ci_setup : Create completion file --------------------------------------- 0.26s 2025-12-03 13:05:28.042273 | controller | INFO Running crc_layout > converge 2025-12-03 13:05:28.634395 | controller | 2025-12-03 13:05:28.634516 | controller | PLAY [Converge] **************************************************************** 2025-12-03 13:05:28.634668 | controller | 2025-12-03 13:05:28.634757 | controller | TASK [Gathering Facts] ********************************************************* 2025-12-03 13:05:28.634879 | controller | Wednesday 03 December 2025 13:05:28 +0000 (0:00:00.027) 0:00:00.027 **** 2025-12-03 13:05:29.437214 | controller | ok: [instance] 2025-12-03 13:05:29.458105 | controller | 2025-12-03 13:05:29.458150 | controller | TASK [Load networking definition from scenario file] *************************** 2025-12-03 13:05:29.458158 | controller | Wednesday 03 December 2025 13:05:29 +0000 (0:00:00.802) 0:00:00.829 **** 2025-12-03 13:05:29.458169 | controller | ok: [instance] 2025-12-03 13:05:31.277159 | controller | 2025-12-03 13:05:31.277190 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-12-03 13:05:31.277198 | controller | Wednesday 03 December 2025 13:05:29 +0000 (0:00:00.021) 0:00:00.850 **** 2025-12-03 13:05:31.277209 | controller | changed: [instance] 2025-12-03 13:05:31.303763 | controller | 2025-12-03 13:05:31.303781 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-12-03 13:05:31.303789 | controller | Wednesday 03 December 2025 13:05:31 +0000 (0:00:01.818) 0:00:02.669 **** 2025-12-03 13:05:31.303797 | controller | ok: [instance] 2025-12-03 13:05:31.324335 | controller | 2025-12-03 13:05:31.324373 | controller | TASK [reproducer : Load CI job environment] ************************************ 2025-12-03 13:05:31.324393 | controller | Wednesday 03 December 2025 13:05:31 +0000 (0:00:00.026) 0:00:02.696 **** 2025-12-03 13:05:31.324406 | controller | skipping: [instance] 2025-12-03 13:05:31.385237 | controller | 2025-12-03 13:05:31.385282 | controller | TASK [Build final libvirt layout] ********************************************** 2025-12-03 13:05:31.385291 | controller | Wednesday 03 December 2025 13:05:31 +0000 (0:00:00.020) 0:00:02.717 **** 2025-12-03 13:05:31.385303 | controller | 2025-12-03 13:05:31.385366 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2025-12-03 13:05:31.385392 | controller | Wednesday 03 December 2025 13:05:31 +0000 (0:00:00.061) 0:00:02.778 **** 2025-12-03 13:05:31.465284 | controller | ok: [instance] 2025-12-03 13:05:31.465537 | controller | 2025-12-03 13:05:31.465558 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2025-12-03 13:05:31.525791 | controller | Wednesday 03 December 2025 13:05:31 +0000 (0:00:00.079) 0:00:02.857 **** 2025-12-03 13:05:31.525821 | controller | skipping: [instance] 2025-12-03 13:05:31.550992 | controller | 2025-12-03 13:05:31.551011 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2025-12-03 13:05:31.551019 | controller | Wednesday 03 December 2025 13:05:31 +0000 (0:00:00.060) 0:00:02.918 **** 2025-12-03 13:05:31.551028 | controller | ok: [instance] 2025-12-03 13:05:31.551207 | controller | 2025-12-03 13:05:31.551370 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2025-12-03 13:05:31.551511 | controller | Wednesday 03 December 2025 13:05:31 +0000 (0:00:00.025) 0:00:02.944 **** 2025-12-03 13:05:31.575460 | controller | ok: [instance] => changed=false 2025-12-03 13:05:31.575656 | controller | msg: All assertions passed 2025-12-03 13:05:31.575822 | controller | 2025-12-03 13:05:31.575992 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2025-12-03 13:05:31.576168 | controller | Wednesday 03 December 2025 13:05:31 +0000 (0:00:00.024) 0:00:02.968 **** 2025-12-03 13:05:31.617645 | controller | ok: [instance] 2025-12-03 13:05:31.617831 | controller | 2025-12-03 13:05:31.618014 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2025-12-03 13:05:31.618188 | controller | Wednesday 03 December 2025 13:05:31 +0000 (0:00:00.042) 0:00:03.010 **** 2025-12-03 13:05:32.062829 | controller | ok: [instance] => (item=artifacts) 2025-12-03 13:05:32.139229 | controller | ok: [instance] => (item=logs) 2025-12-03 13:05:32.139265 | controller | 2025-12-03 13:05:32.139275 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2025-12-03 13:05:32.139289 | controller | Wednesday 03 December 2025 13:05:32 +0000 (0:00:00.444) 0:00:03.455 **** 2025-12-03 13:05:32.139302 | controller | 2025-12-03 13:05:32.331813 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2025-12-03 13:05:32.331843 | controller | Wednesday 03 December 2025 13:05:32 +0000 (0:00:00.076) 0:00:03.531 **** 2025-12-03 13:05:32.331857 | controller | ok: [instance] 2025-12-03 13:05:32.586176 | controller | 2025-12-03 13:05:32.586207 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2025-12-03 13:05:32.586215 | controller | Wednesday 03 December 2025 13:05:32 +0000 (0:00:00.192) 0:00:03.724 **** 2025-12-03 13:05:32.586225 | controller | changed: [instance] 2025-12-03 13:05:32.871219 | controller | 2025-12-03 13:05:32.871248 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2025-12-03 13:05:32.871256 | controller | Wednesday 03 December 2025 13:05:32 +0000 (0:00:00.254) 0:00:03.978 **** 2025-12-03 13:05:32.871266 | controller | ok: [instance] 2025-12-03 13:05:32.871290 | controller | 2025-12-03 13:05:32.871481 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2025-12-03 13:05:32.900220 | controller | Wednesday 03 December 2025 13:05:32 +0000 (0:00:00.285) 0:00:04.263 **** 2025-12-03 13:05:32.900262 | controller | skipping: [instance] 2025-12-03 13:05:32.900324 | controller | 2025-12-03 13:05:32.900336 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2025-12-03 13:05:32.900414 | controller | Wednesday 03 December 2025 13:05:32 +0000 (0:00:00.029) 0:00:04.293 **** 2025-12-03 13:05:32.918734 | controller | skipping: [instance] 2025-12-03 13:05:32.938199 | controller | 2025-12-03 13:05:32.938228 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2025-12-03 13:05:32.938238 | controller | Wednesday 03 December 2025 13:05:32 +0000 (0:00:00.018) 0:00:04.311 **** 2025-12-03 13:05:32.938250 | controller | ok: [instance] 2025-12-03 13:05:32.938282 | controller | 2025-12-03 13:05:32.938533 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2025-12-03 13:05:32.965748 | controller | Wednesday 03 December 2025 13:05:32 +0000 (0:00:00.019) 0:00:04.331 **** 2025-12-03 13:05:32.965771 | controller | skipping: [instance] 2025-12-03 13:05:44.356429 | controller | 2025-12-03 13:05:44.356460 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2025-12-03 13:05:44.356473 | controller | Wednesday 03 December 2025 13:05:32 +0000 (0:00:00.027) 0:00:04.358 **** 2025-12-03 13:05:44.356490 | controller | changed: [instance] 2025-12-03 13:05:44.356509 | controller | 2025-12-03 13:05:44.356772 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2025-12-03 13:05:44.563679 | controller | Wednesday 03 December 2025 13:05:44 +0000 (0:00:11.390) 0:00:15.749 **** 2025-12-03 13:05:44.563713 | controller | changed: [instance] 2025-12-03 13:05:45.043300 | controller | 2025-12-03 13:05:45.043330 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2025-12-03 13:05:45.043338 | controller | Wednesday 03 December 2025 13:05:44 +0000 (0:00:00.207) 0:00:15.956 **** 2025-12-03 13:05:45.043348 | controller | changed: [instance] 2025-12-03 13:05:45.610623 | controller | 2025-12-03 13:05:45.610649 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2025-12-03 13:05:45.610657 | controller | Wednesday 03 December 2025 13:05:45 +0000 (0:00:00.479) 0:00:16.435 **** 2025-12-03 13:05:45.610667 | controller | changed: [instance] 2025-12-03 13:05:45.802231 | controller | 2025-12-03 13:05:45.802271 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2025-12-03 13:05:45.802281 | controller | Wednesday 03 December 2025 13:05:45 +0000 (0:00:00.567) 0:00:17.003 **** 2025-12-03 13:05:45.802294 | controller | ok: [instance] 2025-12-03 13:05:45.802324 | controller | 2025-12-03 13:05:45.802334 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2025-12-03 13:05:45.802540 | controller | Wednesday 03 December 2025 13:05:45 +0000 (0:00:00.191) 0:00:17.194 **** 2025-12-03 13:05:46.459213 | controller | ok: [instance] 2025-12-03 13:05:47.383018 | controller | 2025-12-03 13:05:47.383048 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2025-12-03 13:05:47.383063 | controller | Wednesday 03 December 2025 13:05:46 +0000 (0:00:00.656) 0:00:17.851 **** 2025-12-03 13:05:47.383073 | controller | changed: [instance] 2025-12-03 13:05:47.466386 | controller | 2025-12-03 13:05:47.466423 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2025-12-03 13:05:47.466433 | controller | Wednesday 03 December 2025 13:05:47 +0000 (0:00:00.923) 0:00:18.775 **** 2025-12-03 13:05:47.466446 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2025-12-03 13:05:47.466479 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2025-12-03 13:05:47.466486 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2025-12-03 13:05:47.466493 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2025-12-03 13:05:47.466502 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2025-12-03 13:05:47.466528 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2025-12-03 13:05:47.467071 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2025-12-03 13:05:47.786271 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2025-12-03 13:05:47.786313 | controller | 2025-12-03 13:05:47.786326 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2025-12-03 13:05:47.786337 | controller | Wednesday 03 December 2025 13:05:47 +0000 (0:00:00.083) 0:00:18.858 **** 2025-12-03 13:05:47.786351 | controller | ok: [instance] 2025-12-03 13:05:48.102233 | controller | 2025-12-03 13:05:48.102267 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2025-12-03 13:05:48.102276 | controller | Wednesday 03 December 2025 13:05:47 +0000 (0:00:00.320) 0:00:19.179 **** 2025-12-03 13:05:48.102288 | controller | ok: [instance] 2025-12-03 13:05:48.102474 | controller | 2025-12-03 13:05:48.102508 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2025-12-03 13:05:48.421593 | controller | Wednesday 03 December 2025 13:05:48 +0000 (0:00:00.315) 0:00:19.494 **** 2025-12-03 13:05:48.421633 | controller | ok: [instance] 2025-12-03 13:05:48.737655 | controller | 2025-12-03 13:05:48.737685 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2025-12-03 13:05:48.737693 | controller | Wednesday 03 December 2025 13:05:48 +0000 (0:00:00.319) 0:00:19.814 **** 2025-12-03 13:05:48.737703 | controller | ok: [instance] 2025-12-03 13:05:49.048182 | controller | 2025-12-03 13:05:49.048216 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2025-12-03 13:05:49.048225 | controller | Wednesday 03 December 2025 13:05:48 +0000 (0:00:00.316) 0:00:20.130 **** 2025-12-03 13:05:49.048235 | controller | ok: [instance] 2025-12-03 13:05:49.048259 | controller | 2025-12-03 13:05:49.048267 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2025-12-03 13:05:49.048348 | controller | Wednesday 03 December 2025 13:05:49 +0000 (0:00:00.310) 0:00:20.440 **** 2025-12-03 13:05:49.362751 | controller | ok: [instance] 2025-12-03 13:05:49.675208 | controller | 2025-12-03 13:05:49.675243 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2025-12-03 13:05:49.675253 | controller | Wednesday 03 December 2025 13:05:49 +0000 (0:00:00.314) 0:00:20.755 **** 2025-12-03 13:05:49.675265 | controller | ok: [instance] 2025-12-03 13:05:49.675288 | controller | 2025-12-03 13:05:49.675330 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2025-12-03 13:05:49.675478 | controller | Wednesday 03 December 2025 13:05:49 +0000 (0:00:00.313) 0:00:21.068 **** 2025-12-03 13:05:49.990244 | controller | ok: [instance] 2025-12-03 13:05:49.990351 | controller | 2025-12-03 13:05:49.990378 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2025-12-03 13:05:49.990389 | controller | Wednesday 03 December 2025 13:05:49 +0000 (0:00:00.314) 0:00:21.383 **** 2025-12-03 13:05:50.304190 | controller | ok: [instance] 2025-12-03 13:05:50.304424 | controller | 2025-12-03 13:05:50.304455 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2025-12-03 13:05:50.627583 | controller | Wednesday 03 December 2025 13:05:50 +0000 (0:00:00.313) 0:00:21.697 **** 2025-12-03 13:05:50.627612 | controller | ok: [instance] 2025-12-03 13:05:50.941244 | controller | 2025-12-03 13:05:50.941283 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2025-12-03 13:05:50.941293 | controller | Wednesday 03 December 2025 13:05:50 +0000 (0:00:00.323) 0:00:22.020 **** 2025-12-03 13:05:50.941306 | controller | ok: [instance] 2025-12-03 13:05:50.941337 | controller | 2025-12-03 13:05:50.941347 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2025-12-03 13:05:50.941502 | controller | Wednesday 03 December 2025 13:05:50 +0000 (0:00:00.313) 0:00:22.333 **** 2025-12-03 13:05:51.266727 | controller | ok: [instance] 2025-12-03 13:05:51.587643 | controller | 2025-12-03 13:05:51.587674 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2025-12-03 13:05:51.587682 | controller | Wednesday 03 December 2025 13:05:51 +0000 (0:00:00.325) 0:00:22.659 **** 2025-12-03 13:05:51.587693 | controller | ok: [instance] 2025-12-03 13:05:51.906602 | controller | 2025-12-03 13:05:51.906632 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2025-12-03 13:05:51.906640 | controller | Wednesday 03 December 2025 13:05:51 +0000 (0:00:00.321) 0:00:22.980 **** 2025-12-03 13:05:51.906650 | controller | ok: [instance] 2025-12-03 13:05:52.226169 | controller | 2025-12-03 13:05:52.226199 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2025-12-03 13:05:52.226207 | controller | Wednesday 03 December 2025 13:05:51 +0000 (0:00:00.319) 0:00:23.299 **** 2025-12-03 13:05:52.226217 | controller | ok: [instance] 2025-12-03 13:05:52.542165 | controller | 2025-12-03 13:05:52.542198 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2025-12-03 13:05:52.542207 | controller | Wednesday 03 December 2025 13:05:52 +0000 (0:00:00.319) 0:00:23.619 **** 2025-12-03 13:05:52.542217 | controller | ok: [instance] 2025-12-03 13:05:52.542242 | controller | 2025-12-03 13:05:52.542256 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2025-12-03 13:05:52.542435 | controller | Wednesday 03 December 2025 13:05:52 +0000 (0:00:00.316) 0:00:23.935 **** 2025-12-03 13:05:52.859919 | controller | ok: [instance] 2025-12-03 13:05:53.180199 | controller | 2025-12-03 13:05:53.180251 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2025-12-03 13:05:53.180261 | controller | Wednesday 03 December 2025 13:05:52 +0000 (0:00:00.317) 0:00:24.252 **** 2025-12-03 13:05:53.180277 | controller | ok: [instance] 2025-12-03 13:05:53.497249 | controller | 2025-12-03 13:05:53.497291 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2025-12-03 13:05:53.497300 | controller | Wednesday 03 December 2025 13:05:53 +0000 (0:00:00.320) 0:00:24.572 **** 2025-12-03 13:05:53.497314 | controller | ok: [instance] 2025-12-03 13:05:53.817180 | controller | 2025-12-03 13:05:53.817221 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2025-12-03 13:05:53.817229 | controller | Wednesday 03 December 2025 13:05:53 +0000 (0:00:00.317) 0:00:24.889 **** 2025-12-03 13:05:53.817241 | controller | ok: [instance] 2025-12-03 13:05:54.129250 | controller | 2025-12-03 13:05:54.129289 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2025-12-03 13:05:54.129299 | controller | Wednesday 03 December 2025 13:05:53 +0000 (0:00:00.319) 0:00:25.209 **** 2025-12-03 13:05:54.129312 | controller | ok: [instance] 2025-12-03 13:05:54.129342 | controller | 2025-12-03 13:05:54.129352 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2025-12-03 13:05:54.129445 | controller | Wednesday 03 December 2025 13:05:54 +0000 (0:00:00.312) 0:00:25.522 **** 2025-12-03 13:05:54.449609 | controller | ok: [instance] 2025-12-03 13:05:54.768709 | controller | 2025-12-03 13:05:54.768740 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2025-12-03 13:05:54.768748 | controller | Wednesday 03 December 2025 13:05:54 +0000 (0:00:00.320) 0:00:25.842 **** 2025-12-03 13:05:54.768759 | controller | ok: [instance] 2025-12-03 13:05:55.090160 | controller | 2025-12-03 13:05:55.090192 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2025-12-03 13:05:55.090206 | controller | Wednesday 03 December 2025 13:05:54 +0000 (0:00:00.319) 0:00:26.161 **** 2025-12-03 13:05:55.090217 | controller | ok: [instance] 2025-12-03 13:05:55.110854 | controller | 2025-12-03 13:05:55.110889 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2025-12-03 13:05:55.110897 | controller | Wednesday 03 December 2025 13:05:55 +0000 (0:00:00.321) 0:00:26.482 **** 2025-12-03 13:05:55.110908 | controller | skipping: [instance] 2025-12-03 13:05:55.389192 | controller | 2025-12-03 13:05:55.389227 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2025-12-03 13:05:55.389235 | controller | Wednesday 03 December 2025 13:05:55 +0000 (0:00:00.020) 0:00:26.503 **** 2025-12-03 13:05:55.389246 | controller | ok: [instance] 2025-12-03 13:05:55.389508 | controller | 2025-12-03 13:05:55.389538 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2025-12-03 13:05:55.389550 | controller | Wednesday 03 December 2025 13:05:55 +0000 (0:00:00.278) 0:00:26.781 **** 2025-12-03 13:05:55.763124 | controller | ok: [instance] 2025-12-03 13:05:56.066846 | controller | 2025-12-03 13:05:56.066875 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2025-12-03 13:05:56.066883 | controller | Wednesday 03 December 2025 13:05:55 +0000 (0:00:00.373) 0:00:27.155 **** 2025-12-03 13:05:56.066894 | controller | changed: [instance] 2025-12-03 13:05:56.356483 | controller | 2025-12-03 13:05:56.356511 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2025-12-03 13:05:56.356521 | controller | Wednesday 03 December 2025 13:05:56 +0000 (0:00:00.303) 0:00:27.459 **** 2025-12-03 13:05:56.356532 | controller | [WARNING]: Reset is not implemented for this connection 2025-12-03 13:05:56.366219 | controller | changed: [instance] 2025-12-03 13:05:56.366693 | controller | 2025-12-03 13:05:56.366712 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2025-12-03 13:05:56.366724 | controller | Wednesday 03 December 2025 13:05:56 +0000 (0:00:00.284) 0:00:27.743 **** 2025-12-03 13:05:56.438871 | controller | 2025-12-03 13:05:56.438894 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2025-12-03 13:05:56.438903 | controller | Wednesday 03 December 2025 13:05:56 +0000 (0:00:00.015) 0:00:27.759 **** 2025-12-03 13:05:56.438914 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2025-12-03 13:05:56.479832 | controller | 2025-12-03 13:05:56.479859 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2025-12-03 13:05:56.479869 | controller | Wednesday 03 December 2025 13:05:56 +0000 (0:00:00.072) 0:00:27.831 **** 2025-12-03 13:05:56.479880 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2025-12-03 13:05:56.526251 | controller | 2025-12-03 13:05:56.526297 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-03 13:05:56.526307 | controller | Wednesday 03 December 2025 13:05:56 +0000 (0:00:00.040) 0:00:27.872 **** 2025-12-03 13:05:56.526320 | controller | ok: [instance] => (item=compute) 2025-12-03 13:05:56.526357 | controller | ok: [instance] => (item=controller) 2025-12-03 13:05:56.526365 | controller | ok: [instance] => (item=crc) 2025-12-03 13:05:56.526374 | controller | 2025-12-03 13:05:56.526480 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-03 13:05:56.526501 | controller | Wednesday 03 December 2025 13:05:56 +0000 (0:00:00.046) 0:00:27.919 **** 2025-12-03 13:05:56.567194 | controller | ok: [instance] 2025-12-03 13:05:56.567218 | controller | 2025-12-03 13:05:56.567360 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-03 13:05:56.567480 | controller | Wednesday 03 December 2025 13:05:56 +0000 (0:00:00.041) 0:00:27.960 **** 2025-12-03 13:05:56.610338 | controller | ok: [instance] => changed=false 2025-12-03 13:05:56.610466 | controller | msg: All assertions passed 2025-12-03 13:05:56.610611 | controller | 2025-12-03 13:05:56.610763 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2025-12-03 13:05:56.610912 | controller | Wednesday 03 December 2025 13:05:56 +0000 (0:00:00.043) 0:00:28.003 **** 2025-12-03 13:05:56.669535 | controller | 2025-12-03 13:05:56.669674 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2025-12-03 13:05:56.669863 | controller | Wednesday 03 December 2025 13:05:56 +0000 (0:00:00.059) 0:00:28.062 **** 2025-12-03 13:05:56.744482 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2025-12-03 13:05:56.744619 | controller | ok: [instance] => (item={}) 2025-12-03 13:05:56.744769 | controller | 2025-12-03 13:05:56.744856 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2025-12-03 13:05:56.744980 | controller | Wednesday 03 December 2025 13:05:56 +0000 (0:00:00.074) 0:00:28.137 **** 2025-12-03 13:05:56.761526 | controller | skipping: [instance] 2025-12-03 13:05:56.761656 | controller | 2025-12-03 13:05:56.761837 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2025-12-03 13:05:56.761955 | controller | Wednesday 03 December 2025 13:05:56 +0000 (0:00:00.017) 0:00:28.154 **** 2025-12-03 13:05:56.976726 | controller | ok: [instance] 2025-12-03 13:05:57.326572 | controller | 2025-12-03 13:05:57.326602 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2025-12-03 13:05:57.326610 | controller | Wednesday 03 December 2025 13:05:56 +0000 (0:00:00.214) 0:00:28.369 **** 2025-12-03 13:05:57.326620 | controller | changed: [instance] 2025-12-03 13:05:58.059249 | controller | 2025-12-03 13:05:58.059290 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2025-12-03 13:05:58.059299 | controller | Wednesday 03 December 2025 13:05:57 +0000 (0:00:00.349) 0:00:28.719 **** 2025-12-03 13:05:58.059313 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2025-12-03 13:05:58.059344 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2025-12-03 13:05:58.059351 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2025-12-03 13:05:58.059358 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2025-12-03 13:05:58.059367 | controller | 2025-12-03 13:05:58.059554 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2025-12-03 13:05:58.084733 | controller | Wednesday 03 December 2025 13:05:58 +0000 (0:00:00.732) 0:00:29.451 **** 2025-12-03 13:05:58.084762 | controller | skipping: [instance] 2025-12-03 13:05:58.445224 | controller | 2025-12-03 13:05:58.445258 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2025-12-03 13:05:58.445268 | controller | Wednesday 03 December 2025 13:05:58 +0000 (0:00:00.025) 0:00:29.477 **** 2025-12-03 13:05:58.445280 | controller | changed: [instance] 2025-12-03 13:05:58.445309 | controller | 2025-12-03 13:05:58.445317 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2025-12-03 13:05:58.445326 | controller | Wednesday 03 December 2025 13:05:58 +0000 (0:00:00.351) 0:00:29.829 **** 2025-12-03 13:05:58.445598 | controller | 2025-12-03 13:05:58.874040 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-03 13:05:58.874075 | controller | Wednesday 03 December 2025 13:05:58 +0000 (0:00:00.008) 0:00:29.838 **** 2025-12-03 13:05:58.874116 | controller | changed: [instance] 2025-12-03 13:05:58.874124 | controller | 2025-12-03 13:05:58.874131 | controller | TASK [Ensure no default networks exists] *************************************** 2025-12-03 13:05:58.874291 | controller | Wednesday 03 December 2025 13:05:58 +0000 (0:00:00.428) 0:00:30.266 **** 2025-12-03 13:05:58.947229 | controller | 2025-12-03 13:05:58.947312 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2025-12-03 13:05:58.947345 | controller | Wednesday 03 December 2025 13:05:58 +0000 (0:00:00.073) 0:00:30.340 **** 2025-12-03 13:06:00.094206 | controller | ok: [instance] 2025-12-03 13:06:00.094291 | controller | 2025-12-03 13:06:00.094305 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2025-12-03 13:06:00.094428 | controller | Wednesday 03 December 2025 13:06:00 +0000 (0:00:01.146) 0:00:31.486 **** 2025-12-03 13:06:00.323252 | controller | ok: [instance] 2025-12-03 13:06:00.323326 | controller | 2025-12-03 13:06:00.323343 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2025-12-03 13:06:00.323453 | controller | Wednesday 03 December 2025 13:06:00 +0000 (0:00:00.228) 0:00:31.715 **** 2025-12-03 13:06:00.828226 | controller | ok: [instance] 2025-12-03 13:06:01.053181 | controller | 2025-12-03 13:06:01.053228 | controller | TASK [libvirt_manager : Removing default] ************************************** 2025-12-03 13:06:01.053238 | controller | Wednesday 03 December 2025 13:06:00 +0000 (0:00:00.505) 0:00:32.221 **** 2025-12-03 13:06:01.053253 | controller | ok: [instance] 2025-12-03 13:06:01.053517 | controller | 2025-12-03 13:06:01.053551 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2025-12-03 13:06:02.249158 | controller | Wednesday 03 December 2025 13:06:01 +0000 (0:00:00.224) 0:00:32.445 **** 2025-12-03 13:06:02.249193 | controller | ok: [instance] 2025-12-03 13:06:02.561697 | controller | 2025-12-03 13:06:02.561724 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2025-12-03 13:06:02.561732 | controller | Wednesday 03 December 2025 13:06:02 +0000 (0:00:01.195) 0:00:33.641 **** 2025-12-03 13:06:02.561742 | controller | ok: [instance] 2025-12-03 13:06:02.866422 | controller | 2025-12-03 13:06:02.866450 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2025-12-03 13:06:02.866458 | controller | Wednesday 03 December 2025 13:06:02 +0000 (0:00:00.312) 0:00:33.954 **** 2025-12-03 13:06:02.866474 | controller | changed: [instance] 2025-12-03 13:06:03.168801 | controller | 2025-12-03 13:06:03.168835 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2025-12-03 13:06:03.168843 | controller | Wednesday 03 December 2025 13:06:02 +0000 (0:00:00.304) 0:00:34.259 **** 2025-12-03 13:06:03.168853 | controller | changed: [instance] 2025-12-03 13:06:03.745092 | controller | 2025-12-03 13:06:03.745122 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2025-12-03 13:06:03.745130 | controller | Wednesday 03 December 2025 13:06:03 +0000 (0:00:00.302) 0:00:34.561 **** 2025-12-03 13:06:03.745151 | controller | changed: [instance] => (item=arptables) 2025-12-03 13:06:04.059856 | controller | changed: [instance] => (item=iptables) 2025-12-03 13:06:04.059880 | controller | changed: [instance] => (item=ip6tables) 2025-12-03 13:06:04.059888 | controller | 2025-12-03 13:06:04.059894 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2025-12-03 13:06:04.059900 | controller | Wednesday 03 December 2025 13:06:03 +0000 (0:00:00.576) 0:00:35.137 **** 2025-12-03 13:06:04.059909 | controller | ok: [instance] 2025-12-03 13:06:04.149658 | controller | 2025-12-03 13:06:04.149676 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2025-12-03 13:06:04.149683 | controller | Wednesday 03 December 2025 13:06:04 +0000 (0:00:00.315) 0:00:35.452 **** 2025-12-03 13:06:04.149692 | controller | ok: [instance] 2025-12-03 13:06:04.191802 | controller | 2025-12-03 13:06:04.191824 | controller | TASK [Ensure the required network configurations are applied] ****************** 2025-12-03 13:06:04.191833 | controller | Wednesday 03 December 2025 13:06:04 +0000 (0:00:00.089) 0:00:35.542 **** 2025-12-03 13:06:04.191844 | controller | 2025-12-03 13:06:04.238958 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2025-12-03 13:06:04.238984 | controller | Wednesday 03 December 2025 13:06:04 +0000 (0:00:00.042) 0:00:35.584 **** 2025-12-03 13:06:04.238994 | controller | skipping: [instance] 2025-12-03 13:06:04.261878 | controller | 2025-12-03 13:06:04.261897 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2025-12-03 13:06:04.261904 | controller | Wednesday 03 December 2025 13:06:04 +0000 (0:00:00.046) 0:00:35.631 **** 2025-12-03 13:06:04.261913 | controller | skipping: [instance] 2025-12-03 13:06:04.284324 | controller | 2025-12-03 13:06:04.284367 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-03 13:06:04.284378 | controller | Wednesday 03 December 2025 13:06:04 +0000 (0:00:00.022) 0:00:35.654 **** 2025-12-03 13:06:04.284390 | controller | skipping: [instance] 2025-12-03 13:06:04.284423 | controller | 2025-12-03 13:06:04.284756 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2025-12-03 13:06:04.310272 | controller | Wednesday 03 December 2025 13:06:04 +0000 (0:00:00.022) 0:00:35.677 **** 2025-12-03 13:06:04.310294 | controller | skipping: [instance] 2025-12-03 13:06:04.310437 | controller | 2025-12-03 13:06:04.310581 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2025-12-03 13:06:04.310718 | controller | Wednesday 03 December 2025 13:06:04 +0000 (0:00:00.026) 0:00:35.703 **** 2025-12-03 13:06:04.348838 | controller | ok: [instance] 2025-12-03 13:06:04.349022 | controller | 2025-12-03 13:06:04.349210 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2025-12-03 13:06:04.349366 | controller | Wednesday 03 December 2025 13:06:04 +0000 (0:00:00.038) 0:00:35.741 **** 2025-12-03 13:06:04.383211 | controller | skipping: [instance] 2025-12-03 13:06:04.383438 | controller | 2025-12-03 13:06:04.383668 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2025-12-03 13:06:04.383885 | controller | Wednesday 03 December 2025 13:06:04 +0000 (0:00:00.034) 0:00:35.776 **** 2025-12-03 13:06:04.405203 | controller | skipping: [instance] 2025-12-03 13:06:04.405374 | controller | 2025-12-03 13:06:04.405539 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2025-12-03 13:06:04.405660 | controller | Wednesday 03 December 2025 13:06:04 +0000 (0:00:00.022) 0:00:35.798 **** 2025-12-03 13:06:04.461050 | controller | ok: [instance] 2025-12-03 13:06:04.461213 | controller | 2025-12-03 13:06:04.461403 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2025-12-03 13:06:04.461530 | controller | Wednesday 03 December 2025 13:06:04 +0000 (0:00:00.055) 0:00:35.854 **** 2025-12-03 13:06:04.482201 | controller | skipping: [instance] 2025-12-03 13:06:04.482341 | controller | 2025-12-03 13:06:04.482531 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2025-12-03 13:06:04.482623 | controller | Wednesday 03 December 2025 13:06:04 +0000 (0:00:00.021) 0:00:35.875 **** 2025-12-03 13:06:04.530650 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2025-12-03 13:06:04.530761 | controller | 2025-12-03 13:06:04.530914 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-12-03 13:06:04.531017 | controller | Wednesday 03 December 2025 13:06:04 +0000 (0:00:00.048) 0:00:35.923 **** 2025-12-03 13:06:04.850977 | controller | ok: [instance -> localhost] 2025-12-03 13:06:04.851131 | controller | 2025-12-03 13:06:04.851310 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2025-12-03 13:06:04.851458 | controller | Wednesday 03 December 2025 13:06:04 +0000 (0:00:00.320) 0:00:36.243 **** 2025-12-03 13:06:09.883212 | controller | changed: [instance -> localhost] 2025-12-03 13:06:10.084038 | controller | 2025-12-03 13:06:10.084076 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-12-03 13:06:10.084103 | controller | Wednesday 03 December 2025 13:06:09 +0000 (0:00:05.031) 0:00:41.275 **** 2025-12-03 13:06:10.084116 | controller | changed: [instance] 2025-12-03 13:06:10.432421 | controller | 2025-12-03 13:06:10.432476 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2025-12-03 13:06:10.432485 | controller | Wednesday 03 December 2025 13:06:10 +0000 (0:00:00.201) 0:00:41.476 **** 2025-12-03 13:06:10.432511 | controller | changed: [instance] 2025-12-03 13:06:12.036688 | controller | 2025-12-03 13:06:12.036716 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2025-12-03 13:06:12.036724 | controller | Wednesday 03 December 2025 13:06:10 +0000 (0:00:00.348) 0:00:41.825 **** 2025-12-03 13:06:12.036734 | controller | changed: [instance -> localhost] 2025-12-03 13:06:12.382812 | controller | 2025-12-03 13:06:12.382842 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2025-12-03 13:06:12.382850 | controller | Wednesday 03 December 2025 13:06:12 +0000 (0:00:01.604) 0:00:43.429 **** 2025-12-03 13:06:12.382860 | controller | changed: [instance] 2025-12-03 13:06:12.413216 | controller | 2025-12-03 13:06:12.413248 | controller | TASK [reproducer : Select right domain] **************************************** 2025-12-03 13:06:12.413257 | controller | Wednesday 03 December 2025 13:06:12 +0000 (0:00:00.346) 0:00:43.775 **** 2025-12-03 13:06:12.413267 | controller | ok: [instance] 2025-12-03 13:06:12.413301 | controller | 2025-12-03 13:06:12.413310 | controller | TASK [Create the virtual networks] ********************************************* 2025-12-03 13:06:12.413416 | controller | Wednesday 03 December 2025 13:06:12 +0000 (0:00:00.030) 0:00:43.806 **** 2025-12-03 13:06:12.530679 | controller | 2025-12-03 13:06:12.549134 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2025-12-03 13:06:12.549170 | controller | Wednesday 03 December 2025 13:06:12 +0000 (0:00:00.117) 0:00:43.923 **** 2025-12-03 13:06:12.549183 | controller | ok: [instance] 2025-12-03 13:06:12.735622 | controller | 2025-12-03 13:06:12.735654 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2025-12-03 13:06:12.735664 | controller | Wednesday 03 December 2025 13:06:12 +0000 (0:00:00.018) 0:00:43.941 **** 2025-12-03 13:06:12.735676 | controller | ok: [instance] 2025-12-03 13:06:12.763193 | controller | 2025-12-03 13:06:12.763217 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2025-12-03 13:06:12.763226 | controller | Wednesday 03 December 2025 13:06:12 +0000 (0:00:00.186) 0:00:44.128 **** 2025-12-03 13:06:12.763237 | controller | skipping: [instance] 2025-12-03 13:06:12.763648 | controller | 2025-12-03 13:06:12.791031 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2025-12-03 13:06:12.791049 | controller | Wednesday 03 December 2025 13:06:12 +0000 (0:00:00.028) 0:00:44.156 **** 2025-12-03 13:06:12.791060 | controller | skipping: [instance] 2025-12-03 13:06:12.844655 | controller | 2025-12-03 13:06:12.844677 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2025-12-03 13:06:12.844686 | controller | Wednesday 03 December 2025 13:06:12 +0000 (0:00:00.027) 0:00:44.183 **** 2025-12-03 13:06:12.844697 | controller | ok: [instance] 2025-12-03 13:06:12.967545 | controller | 2025-12-03 13:06:12.967570 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2025-12-03 13:06:12.967577 | controller | Wednesday 03 December 2025 13:06:12 +0000 (0:00:00.053) 0:00:44.237 **** 2025-12-03 13:06:12.967587 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-03 13:06:13.000234 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-03 13:06:13.000277 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-03 13:06:13.000285 | controller | 2025-12-03 13:06:13.000292 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2025-12-03 13:06:13.000297 | controller | Wednesday 03 December 2025 13:06:12 +0000 (0:00:00.122) 0:00:44.360 **** 2025-12-03 13:06:13.000307 | controller | skipping: [instance] 2025-12-03 13:06:13.000338 | controller | 2025-12-03 13:06:13.000459 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2025-12-03 13:06:13.000470 | controller | Wednesday 03 December 2025 13:06:12 +0000 (0:00:00.033) 0:00:44.393 **** 2025-12-03 13:06:13.343225 | controller | changed: [instance] 2025-12-03 13:06:13.343283 | controller | 2025-12-03 13:06:13.343538 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2025-12-03 13:06:13.432218 | controller | Wednesday 03 December 2025 13:06:13 +0000 (0:00:00.342) 0:00:44.736 **** 2025-12-03 13:06:13.432261 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes) 2025-12-03 13:06:13.432293 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers) 2025-12-03 13:06:13.432304 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps) 2025-12-03 13:06:13.432591 | controller | 2025-12-03 13:06:13.506174 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2025-12-03 13:06:13.506208 | controller | Wednesday 03 December 2025 13:06:13 +0000 (0:00:00.088) 0:00:44.825 **** 2025-12-03 13:06:13.506220 | controller | changed: [instance] 2025-12-03 13:06:13.506252 | controller | 2025-12-03 13:06:13.506270 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2025-12-03 13:06:13.506280 | controller | Wednesday 03 December 2025 13:06:13 +0000 (0:00:00.073) 0:00:44.899 **** 2025-12-03 13:06:13.830624 | controller | changed: [instance] 2025-12-03 13:06:14.052046 | controller | 2025-12-03 13:06:14.052090 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2025-12-03 13:06:14.052101 | controller | Wednesday 03 December 2025 13:06:13 +0000 (0:00:00.324) 0:00:45.223 **** 2025-12-03 13:06:14.052112 | controller | changed: [instance] 2025-12-03 13:06:14.106976 | controller | 2025-12-03 13:06:14.106997 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2025-12-03 13:06:14.107005 | controller | Wednesday 03 December 2025 13:06:14 +0000 (0:00:00.221) 0:00:45.444 **** 2025-12-03 13:06:14.107014 | controller | changed: [instance] 2025-12-03 13:06:14.310686 | controller | 2025-12-03 13:06:14.310715 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2025-12-03 13:06:14.310723 | controller | Wednesday 03 December 2025 13:06:14 +0000 (0:00:00.055) 0:00:45.499 **** 2025-12-03 13:06:14.310733 | controller | changed: [instance] 2025-12-03 13:06:14.523227 | controller | 2025-12-03 13:06:14.523260 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2025-12-03 13:06:14.523270 | controller | Wednesday 03 December 2025 13:06:14 +0000 (0:00:00.203) 0:00:45.703 **** 2025-12-03 13:06:14.523281 | controller | changed: [instance] 2025-12-03 13:06:14.523312 | controller | 2025-12-03 13:06:14.523521 | controller | TASK [libvirt_manager : Add host to runtime inventory] ************************* 2025-12-03 13:06:14.576254 | controller | Wednesday 03 December 2025 13:06:14 +0000 (0:00:00.212) 0:00:45.916 **** 2025-12-03 13:06:14.576296 | controller | changed: [instance] 2025-12-03 13:06:14.775778 | controller | 2025-12-03 13:06:14.775808 | controller | TASK [libvirt_manager : Ensure group section exists] *************************** 2025-12-03 13:06:14.775816 | controller | Wednesday 03 December 2025 13:06:14 +0000 (0:00:00.052) 0:00:45.969 **** 2025-12-03 13:06:14.775826 | controller | changed: [instance] 2025-12-03 13:06:14.990583 | controller | 2025-12-03 13:06:14.990617 | controller | TASK [libvirt_manager : Append host under proper group] ************************ 2025-12-03 13:06:14.990627 | controller | Wednesday 03 December 2025 13:06:14 +0000 (0:00:00.199) 0:00:46.168 **** 2025-12-03 13:06:14.990638 | controller | changed: [instance] 2025-12-03 13:06:15.182521 | controller | 2025-12-03 13:06:15.182557 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ******************** 2025-12-03 13:06:15.182565 | controller | Wednesday 03 December 2025 13:06:14 +0000 (0:00:00.214) 0:00:46.383 **** 2025-12-03 13:06:15.182575 | controller | ok: [instance] 2025-12-03 13:06:15.691092 | controller | 2025-12-03 13:06:15.691123 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ****************** 2025-12-03 13:06:15.691131 | controller | Wednesday 03 December 2025 13:06:15 +0000 (0:00:00.192) 0:00:46.575 **** 2025-12-03 13:06:15.691149 | controller | changed: [instance] 2025-12-03 13:06:15.715240 | controller | 2025-12-03 13:06:15.715276 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-03 13:06:15.715286 | controller | Wednesday 03 December 2025 13:06:15 +0000 (0:00:00.508) 0:00:47.083 **** 2025-12-03 13:06:15.715303 | controller | skipping: [instance] 2025-12-03 13:06:15.715334 | controller | 2025-12-03 13:06:15.715344 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-03 13:06:15.715371 | controller | Wednesday 03 December 2025 13:06:15 +0000 (0:00:00.024) 0:00:47.108 **** 2025-12-03 13:06:15.738844 | controller | skipping: [instance] 2025-12-03 13:06:15.761949 | controller | 2025-12-03 13:06:15.761979 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-03 13:06:15.761989 | controller | Wednesday 03 December 2025 13:06:15 +0000 (0:00:00.023) 0:00:47.131 **** 2025-12-03 13:06:15.762001 | controller | skipping: [instance] 2025-12-03 13:06:15.786666 | controller | 2025-12-03 13:06:15.786688 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-03 13:06:15.786702 | controller | Wednesday 03 December 2025 13:06:15 +0000 (0:00:00.023) 0:00:47.154 **** 2025-12-03 13:06:15.786711 | controller | skipping: [instance] 2025-12-03 13:06:15.805644 | controller | 2025-12-03 13:06:15.805662 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-03 13:06:15.805669 | controller | Wednesday 03 December 2025 13:06:15 +0000 (0:00:00.024) 0:00:47.179 **** 2025-12-03 13:06:15.805678 | controller | ok: [instance] 2025-12-03 13:06:15.882773 | controller | 2025-12-03 13:06:15.882792 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-03 13:06:15.882800 | controller | Wednesday 03 December 2025 13:06:15 +0000 (0:00:00.019) 0:00:47.198 **** 2025-12-03 13:06:15.882810 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-12-03 13:06:15.900343 | controller | 2025-12-03 13:06:15.900365 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-03 13:06:15.900374 | controller | Wednesday 03 December 2025 13:06:15 +0000 (0:00:00.077) 0:00:47.275 **** 2025-12-03 13:06:15.900385 | controller | skipping: [instance] 2025-12-03 13:06:15.900562 | controller | 2025-12-03 13:06:15.900728 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-03 13:06:15.900870 | controller | Wednesday 03 December 2025 13:06:15 +0000 (0:00:00.017) 0:00:47.293 **** 2025-12-03 13:06:16.103060 | controller | changed: [instance] 2025-12-03 13:06:16.495649 | controller | 2025-12-03 13:06:16.495680 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-03 13:06:16.495690 | controller | Wednesday 03 December 2025 13:06:16 +0000 (0:00:00.202) 0:00:47.495 **** 2025-12-03 13:06:16.495701 | controller | changed: [instance] 2025-12-03 13:06:16.553833 | controller | 2025-12-03 13:06:16.553853 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-03 13:06:16.553860 | controller | Wednesday 03 December 2025 13:06:16 +0000 (0:00:00.392) 0:00:47.888 **** 2025-12-03 13:06:16.553869 | controller | ok: [instance] 2025-12-03 13:06:16.583886 | controller | 2025-12-03 13:06:16.583904 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-03 13:06:16.583912 | controller | Wednesday 03 December 2025 13:06:16 +0000 (0:00:00.058) 0:00:47.946 **** 2025-12-03 13:06:16.583920 | controller | ok: [instance] 2025-12-03 13:06:16.961208 | controller | 2025-12-03 13:06:16.961244 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-03 13:06:16.961254 | controller | Wednesday 03 December 2025 13:06:16 +0000 (0:00:00.030) 0:00:47.976 **** 2025-12-03 13:06:16.961267 | controller | changed: [instance] 2025-12-03 13:06:16.961298 | controller | 2025-12-03 13:06:16.961556 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2025-12-03 13:06:17.045233 | controller | Wednesday 03 December 2025 13:06:16 +0000 (0:00:00.377) 0:00:48.354 **** 2025-12-03 13:06:17.045272 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2025-12-03 13:06:17.045304 | controller | 2025-12-03 13:06:17.045315 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2025-12-03 13:06:17.045426 | controller | Wednesday 03 December 2025 13:06:17 +0000 (0:00:00.084) 0:00:48.438 **** 2025-12-03 13:06:17.095270 | controller | ok: [instance] => (item=public) 2025-12-03 13:06:17.095298 | controller | ok: [instance] => (item=osp_trunk) 2025-12-03 13:06:17.095306 | controller | 2025-12-03 13:06:17.095313 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2025-12-03 13:06:17.095321 | controller | Wednesday 03 December 2025 13:06:17 +0000 (0:00:00.049) 0:00:48.487 **** 2025-12-03 13:06:17.571965 | controller | changed: [instance] => (item=cifmw-public) 2025-12-03 13:06:17.572038 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-03 13:06:17.572069 | controller | 2025-12-03 13:06:17.572425 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2025-12-03 13:06:18.182828 | controller | Wednesday 03 December 2025 13:06:17 +0000 (0:00:00.476) 0:00:48.964 **** 2025-12-03 13:06:18.182863 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 13:06:18.662883 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 13:06:18.662921 | controller | 2025-12-03 13:06:18.662929 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2025-12-03 13:06:18.662936 | controller | Wednesday 03 December 2025 13:06:18 +0000 (0:00:00.610) 0:00:49.575 **** 2025-12-03 13:06:18.662945 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 13:06:19.177763 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 13:06:19.177797 | controller | 2025-12-03 13:06:19.177805 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2025-12-03 13:06:19.177811 | controller | Wednesday 03 December 2025 13:06:18 +0000 (0:00:00.479) 0:00:50.054 **** 2025-12-03 13:06:19.177821 | controller | changed: [instance] => (item=cifmw-public) 2025-12-03 13:06:19.245647 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-03 13:06:19.245677 | controller | 2025-12-03 13:06:19.245684 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2025-12-03 13:06:19.245690 | controller | Wednesday 03 December 2025 13:06:19 +0000 (0:00:00.515) 0:00:50.570 **** 2025-12-03 13:06:19.245711 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2025-12-03 13:06:19.455209 | controller | 2025-12-03 13:06:19.455251 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2025-12-03 13:06:19.455267 | controller | Wednesday 03 December 2025 13:06:19 +0000 (0:00:00.068) 0:00:50.638 **** 2025-12-03 13:06:19.455281 | controller | ok: [instance] 2025-12-03 13:06:19.455320 | controller | 2025-12-03 13:06:19.455331 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2025-12-03 13:06:19.455358 | controller | Wednesday 03 December 2025 13:06:19 +0000 (0:00:00.209) 0:00:50.847 **** 2025-12-03 13:06:19.890189 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 13:06:19.890550 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 13:06:19.890586 | controller | 2025-12-03 13:06:19.965588 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2025-12-03 13:06:19.965610 | controller | Wednesday 03 December 2025 13:06:19 +0000 (0:00:00.435) 0:00:51.282 **** 2025-12-03 13:06:19.965620 | controller | 2025-12-03 13:06:20.002178 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-12-03 13:06:20.002197 | controller | Wednesday 03 December 2025 13:06:19 +0000 (0:00:00.075) 0:00:51.358 **** 2025-12-03 13:06:20.002208 | controller | skipping: [instance] 2025-12-03 13:06:20.002291 | controller | 2025-12-03 13:06:20.002307 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2025-12-03 13:06:20.002317 | controller | Wednesday 03 December 2025 13:06:20 +0000 (0:00:00.036) 0:00:51.395 **** 2025-12-03 13:06:21.404274 | controller | ok: [instance] 2025-12-03 13:06:21.404349 | controller | 2025-12-03 13:06:21.404362 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-12-03 13:06:21.625962 | controller | Wednesday 03 December 2025 13:06:21 +0000 (0:00:01.401) 0:00:52.796 **** 2025-12-03 13:06:21.626002 | controller | ok: [instance] 2025-12-03 13:06:22.058705 | controller | 2025-12-03 13:06:22.058741 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2025-12-03 13:06:22.058749 | controller | Wednesday 03 December 2025 13:06:21 +0000 (0:00:00.221) 0:00:53.018 **** 2025-12-03 13:06:22.058759 | controller | changed: [instance] 2025-12-03 13:06:23.849148 | controller | 2025-12-03 13:06:23.849183 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2025-12-03 13:06:23.849192 | controller | Wednesday 03 December 2025 13:06:22 +0000 (0:00:00.432) 0:00:53.450 **** 2025-12-03 13:06:23.849202 | controller | changed: [instance] 2025-12-03 13:06:24.234026 | controller | 2025-12-03 13:06:24.234061 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2025-12-03 13:06:24.234069 | controller | Wednesday 03 December 2025 13:06:23 +0000 (0:00:01.790) 0:00:55.241 **** 2025-12-03 13:06:24.234094 | controller | changed: [instance] 2025-12-03 13:06:24.268555 | controller | 2025-12-03 13:06:24.268576 | controller | TASK [Create extra network configuration] ************************************** 2025-12-03 13:06:24.268584 | controller | Wednesday 03 December 2025 13:06:24 +0000 (0:00:00.385) 0:00:55.626 **** 2025-12-03 13:06:24.268592 | controller | skipping: [instance] 2025-12-03 13:06:24.298223 | controller | 2025-12-03 13:06:24.298259 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2025-12-03 13:06:24.298269 | controller | Wednesday 03 December 2025 13:06:24 +0000 (0:00:00.034) 0:00:55.661 **** 2025-12-03 13:06:24.298281 | controller | skipping: [instance] 2025-12-03 13:06:24.772760 | controller | 2025-12-03 13:06:24.772792 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2025-12-03 13:06:24.772800 | controller | Wednesday 03 December 2025 13:06:24 +0000 (0:00:00.029) 0:00:55.691 **** 2025-12-03 13:06:24.772810 | controller | ok: [instance] 2025-12-03 13:06:24.919916 | controller | 2025-12-03 13:06:24.919946 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2025-12-03 13:06:24.919954 | controller | Wednesday 03 December 2025 13:06:24 +0000 (0:00:00.474) 0:00:56.165 **** 2025-12-03 13:06:24.919964 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 13:06:26.207232 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 13:06:26.207284 | controller | 2025-12-03 13:06:26.207294 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2025-12-03 13:06:26.207302 | controller | Wednesday 03 December 2025 13:06:24 +0000 (0:00:00.146) 0:00:56.312 **** 2025-12-03 13:06:26.207315 | controller | ok: [instance] 2025-12-03 13:06:30.021233 | controller | 2025-12-03 13:06:30.021278 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2025-12-03 13:06:30.021288 | controller | Wednesday 03 December 2025 13:06:26 +0000 (0:00:01.287) 0:00:57.599 **** 2025-12-03 13:06:30.021303 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2025-12-03 13:06:30.021337 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2025-12-03 13:06:30.021345 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2025-12-03 13:06:30.021353 | controller | 2025-12-03 13:06:30.021371 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2025-12-03 13:06:30.239122 | controller | Wednesday 03 December 2025 13:06:30 +0000 (0:00:03.814) 0:01:01.413 **** 2025-12-03 13:06:30.239173 | controller | changed: [instance] 2025-12-03 13:06:30.600509 | controller | 2025-12-03 13:06:30.600539 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2025-12-03 13:06:30.600547 | controller | Wednesday 03 December 2025 13:06:30 +0000 (0:00:00.218) 0:01:01.631 **** 2025-12-03 13:06:30.600557 | controller | changed: [instance] 2025-12-03 13:06:30.990757 | controller | 2025-12-03 13:06:30.990787 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2025-12-03 13:06:30.990796 | controller | Wednesday 03 December 2025 13:06:30 +0000 (0:00:00.361) 0:01:01.993 **** 2025-12-03 13:06:30.990806 | controller | changed: [instance] 2025-12-03 13:06:31.023671 | controller | 2025-12-03 13:06:31.023697 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2025-12-03 13:06:31.023707 | controller | Wednesday 03 December 2025 13:06:30 +0000 (0:00:00.390) 0:01:02.383 **** 2025-12-03 13:06:31.023718 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2025-12-03 13:06:31.416489 | controller | 2025-12-03 13:06:31.416520 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2025-12-03 13:06:31.416529 | controller | Wednesday 03 December 2025 13:06:31 +0000 (0:00:00.033) 0:01:02.416 **** 2025-12-03 13:06:31.416539 | controller | changed: [instance] 2025-12-03 13:06:31.435178 | controller | 2025-12-03 13:06:31.435210 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2025-12-03 13:06:31.435218 | controller | Wednesday 03 December 2025 13:06:31 +0000 (0:00:00.392) 0:01:02.809 **** 2025-12-03 13:06:31.435228 | controller | skipping: [instance] 2025-12-03 13:06:31.468217 | controller | 2025-12-03 13:06:31.468246 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2025-12-03 13:06:31.468256 | controller | Wednesday 03 December 2025 13:06:31 +0000 (0:00:00.018) 0:01:02.827 **** 2025-12-03 13:06:31.468267 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2025-12-03 13:06:31.468297 | controller | 2025-12-03 13:06:31.468307 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2025-12-03 13:06:31.468423 | controller | Wednesday 03 December 2025 13:06:31 +0000 (0:00:00.033) 0:01:02.861 **** 2025-12-03 13:06:31.837985 | controller | changed: [instance] 2025-12-03 13:06:31.856038 | controller | 2025-12-03 13:06:31.856060 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2025-12-03 13:06:31.856068 | controller | Wednesday 03 December 2025 13:06:31 +0000 (0:00:00.369) 0:01:03.230 **** 2025-12-03 13:06:31.856100 | controller | skipping: [instance] 2025-12-03 13:06:32.065205 | controller | 2025-12-03 13:06:32.065239 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2025-12-03 13:06:32.065249 | controller | Wednesday 03 December 2025 13:06:31 +0000 (0:00:00.018) 0:01:03.248 **** 2025-12-03 13:06:32.065267 | controller | ok: [instance] => (item=127.0.0.2) 2025-12-03 13:06:32.065299 | controller | 2025-12-03 13:06:32.065471 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2025-12-03 13:06:32.768183 | controller | Wednesday 03 December 2025 13:06:32 +0000 (0:00:00.209) 0:01:03.458 **** 2025-12-03 13:06:32.768246 | controller | changed: [instance] 2025-12-03 13:06:32.768287 | controller | 2025-12-03 13:06:32.768298 | controller | TASK [dnsmasq : Stop service] ************************************************** 2025-12-03 13:06:32.768423 | controller | Wednesday 03 December 2025 13:06:32 +0000 (0:00:00.702) 0:01:04.160 **** 2025-12-03 13:06:32.790903 | controller | skipping: [instance] 2025-12-03 13:06:32.811020 | controller | 2025-12-03 13:06:32.811041 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2025-12-03 13:06:32.811051 | controller | Wednesday 03 December 2025 13:06:32 +0000 (0:00:00.022) 0:01:04.183 **** 2025-12-03 13:06:32.811061 | controller | skipping: [instance] 2025-12-03 13:06:32.841989 | controller | 2025-12-03 13:06:32.842005 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2025-12-03 13:06:32.842012 | controller | Wednesday 03 December 2025 13:06:32 +0000 (0:00:00.020) 0:01:04.203 **** 2025-12-03 13:06:32.842020 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-12-03 13:06:32.962947 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2025-12-03 13:06:32.962967 | controller | skipping: [instance] 2025-12-03 13:06:32.962974 | controller | 2025-12-03 13:06:32.962980 | controller | TASK [Create dnsmasq networks] ************************************************* 2025-12-03 13:06:32.962986 | controller | Wednesday 03 December 2025 13:06:32 +0000 (0:00:00.030) 0:01:04.234 **** 2025-12-03 13:06:32.962994 | controller | 2025-12-03 13:06:32.994655 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-12-03 13:06:32.994677 | controller | Wednesday 03 December 2025 13:06:32 +0000 (0:00:00.121) 0:01:04.355 **** 2025-12-03 13:06:32.994696 | controller | ok: [instance] => changed=false 2025-12-03 13:06:33.034282 | controller | msg: All assertions passed 2025-12-03 13:06:33.034326 | controller | 2025-12-03 13:06:33.034336 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-12-03 13:06:33.034345 | controller | Wednesday 03 December 2025 13:06:32 +0000 (0:00:00.031) 0:01:04.387 **** 2025-12-03 13:06:33.034356 | controller | ok: [instance] => changed=false 2025-12-03 13:06:33.034442 | controller | msg: All assertions passed 2025-12-03 13:06:33.034454 | controller | 2025-12-03 13:06:33.034464 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-12-03 13:06:33.034582 | controller | Wednesday 03 December 2025 13:06:33 +0000 (0:00:00.039) 0:01:04.427 **** 2025-12-03 13:06:33.553736 | controller | changed: [instance] 2025-12-03 13:06:33.573214 | controller | 2025-12-03 13:06:33.573240 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-12-03 13:06:33.573248 | controller | Wednesday 03 December 2025 13:06:33 +0000 (0:00:00.519) 0:01:04.946 **** 2025-12-03 13:06:33.573258 | controller | skipping: [instance] 2025-12-03 13:06:33.596821 | controller | 2025-12-03 13:06:33.596845 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-12-03 13:06:33.596854 | controller | Wednesday 03 December 2025 13:06:33 +0000 (0:00:00.019) 0:01:04.966 **** 2025-12-03 13:06:33.596865 | controller | skipping: [instance] 2025-12-03 13:06:33.625183 | controller | 2025-12-03 13:06:33.625209 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-12-03 13:06:33.625217 | controller | Wednesday 03 December 2025 13:06:33 +0000 (0:00:00.023) 0:01:04.989 **** 2025-12-03 13:06:33.625227 | controller | ok: [instance] => changed=false 2025-12-03 13:06:33.666041 | controller | msg: All assertions passed 2025-12-03 13:06:33.666063 | controller | 2025-12-03 13:06:33.666072 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-12-03 13:06:33.666101 | controller | Wednesday 03 December 2025 13:06:33 +0000 (0:00:00.028) 0:01:05.017 **** 2025-12-03 13:06:33.666116 | controller | ok: [instance] => changed=false 2025-12-03 13:06:34.124000 | controller | msg: All assertions passed 2025-12-03 13:06:34.124036 | controller | 2025-12-03 13:06:34.124044 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-12-03 13:06:34.124051 | controller | Wednesday 03 December 2025 13:06:33 +0000 (0:00:00.040) 0:01:05.058 **** 2025-12-03 13:06:34.124060 | controller | changed: [instance] 2025-12-03 13:06:34.144883 | controller | 2025-12-03 13:06:34.144904 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-12-03 13:06:34.144913 | controller | Wednesday 03 December 2025 13:06:34 +0000 (0:00:00.457) 0:01:05.516 **** 2025-12-03 13:06:34.144923 | controller | skipping: [instance] 2025-12-03 13:06:34.169665 | controller | 2025-12-03 13:06:34.169685 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-12-03 13:06:34.169693 | controller | Wednesday 03 December 2025 13:06:34 +0000 (0:00:00.021) 0:01:05.537 **** 2025-12-03 13:06:34.169703 | controller | skipping: [instance] 2025-12-03 13:06:34.200948 | controller | 2025-12-03 13:06:34.200971 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2025-12-03 13:06:34.200980 | controller | Wednesday 03 December 2025 13:06:34 +0000 (0:00:00.024) 0:01:05.562 **** 2025-12-03 13:06:34.200991 | controller | skipping: [instance] 2025-12-03 13:06:34.690382 | controller | 2025-12-03 13:06:34.690414 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2025-12-03 13:06:34.690422 | controller | Wednesday 03 December 2025 13:06:34 +0000 (0:00:00.031) 0:01:05.593 **** 2025-12-03 13:06:34.690432 | controller | changed: [instance] => (item=cifmw-public) 2025-12-03 13:06:34.726955 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-03 13:06:34.727010 | controller | 2025-12-03 13:06:34.727250 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-03 13:06:34.727426 | controller | Wednesday 03 December 2025 13:06:34 +0000 (0:00:00.483) 0:01:06.076 **** 2025-12-03 13:06:34.727494 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2025-12-03 13:06:35.061837 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2025-12-03 13:06:35.061867 | controller | 2025-12-03 13:06:35.061875 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-03 13:06:35.061882 | controller | Wednesday 03 December 2025 13:06:34 +0000 (0:00:00.042) 0:01:06.119 **** 2025-12-03 13:06:35.061892 | controller | ok: [instance] 2025-12-03 13:06:35.095752 | controller | 2025-12-03 13:06:35.095779 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-12-03 13:06:35.095788 | controller | Wednesday 03 December 2025 13:06:35 +0000 (0:00:00.334) 0:01:06.454 **** 2025-12-03 13:06:35.095800 | controller | ok: [instance] 2025-12-03 13:06:35.297178 | controller | 2025-12-03 13:06:35.297211 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-03 13:06:35.297219 | controller | Wednesday 03 December 2025 13:06:35 +0000 (0:00:00.034) 0:01:06.488 **** 2025-12-03 13:06:35.297230 | controller | ok: [instance] 2025-12-03 13:06:35.332122 | controller | 2025-12-03 13:06:35.332159 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-12-03 13:06:35.332173 | controller | Wednesday 03 December 2025 13:06:35 +0000 (0:00:00.201) 0:01:06.689 **** 2025-12-03 13:06:35.332184 | controller | ok: [instance] 2025-12-03 13:06:35.676168 | controller | 2025-12-03 13:06:35.676199 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2025-12-03 13:06:35.676207 | controller | Wednesday 03 December 2025 13:06:35 +0000 (0:00:00.035) 0:01:06.724 **** 2025-12-03 13:06:35.676217 | controller | changed: [instance] 2025-12-03 13:06:35.676241 | controller | 2025-12-03 13:06:35.676249 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2025-12-03 13:06:35.676342 | controller | Wednesday 03 December 2025 13:06:35 +0000 (0:00:00.344) 0:01:07.068 **** 2025-12-03 13:06:36.022256 | controller | changed: [instance] 2025-12-03 13:06:36.022371 | controller | 2025-12-03 13:06:36.022401 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2025-12-03 13:06:36.022419 | controller | Wednesday 03 December 2025 13:06:36 +0000 (0:00:00.345) 0:01:07.414 **** 2025-12-03 13:06:36.364885 | controller | changed: [instance] 2025-12-03 13:06:36.461276 | controller | 2025-12-03 13:06:36.461322 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2025-12-03 13:06:36.461336 | controller | Wednesday 03 December 2025 13:06:36 +0000 (0:00:00.342) 0:01:07.757 **** 2025-12-03 13:06:36.461353 | controller | ok: [instance] 2025-12-03 13:06:36.461370 | controller | 2025-12-03 13:06:36.461381 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2025-12-03 13:06:36.461393 | controller | Wednesday 03 December 2025 13:06:36 +0000 (0:00:00.096) 0:01:07.854 **** 2025-12-03 13:06:36.806198 | controller | changed: [instance] 2025-12-03 13:06:36.806263 | controller | 2025-12-03 13:06:36.806276 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-03 13:06:36.806304 | controller | Wednesday 03 December 2025 13:06:36 +0000 (0:00:00.344) 0:01:08.199 **** 2025-12-03 13:06:36.832018 | controller | skipping: [instance] 2025-12-03 13:06:36.856208 | controller | 2025-12-03 13:06:36.856234 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-03 13:06:36.856243 | controller | Wednesday 03 December 2025 13:06:36 +0000 (0:00:00.025) 0:01:08.224 **** 2025-12-03 13:06:36.856254 | controller | skipping: [instance] 2025-12-03 13:06:36.856420 | controller | 2025-12-03 13:06:36.856440 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-03 13:06:36.881821 | controller | Wednesday 03 December 2025 13:06:36 +0000 (0:00:00.024) 0:01:08.249 **** 2025-12-03 13:06:36.881846 | controller | skipping: [instance] 2025-12-03 13:06:36.906000 | controller | 2025-12-03 13:06:36.906019 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-03 13:06:36.906027 | controller | Wednesday 03 December 2025 13:06:36 +0000 (0:00:00.025) 0:01:08.274 **** 2025-12-03 13:06:36.906037 | controller | skipping: [instance] 2025-12-03 13:06:36.925696 | controller | 2025-12-03 13:06:36.925715 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-03 13:06:36.925724 | controller | Wednesday 03 December 2025 13:06:36 +0000 (0:00:00.024) 0:01:08.298 **** 2025-12-03 13:06:36.925734 | controller | ok: [instance] 2025-12-03 13:06:37.015273 | controller | 2025-12-03 13:06:37.015308 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-03 13:06:37.015317 | controller | Wednesday 03 December 2025 13:06:36 +0000 (0:00:00.019) 0:01:08.318 **** 2025-12-03 13:06:37.015333 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-12-03 13:06:37.015469 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-12-03 13:06:37.015486 | controller | 2025-12-03 13:06:37.015494 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-03 13:06:37.015504 | controller | Wednesday 03 December 2025 13:06:37 +0000 (0:00:00.089) 0:01:08.407 **** 2025-12-03 13:06:37.035770 | controller | skipping: [instance] 2025-12-03 13:06:37.035898 | controller | 2025-12-03 13:06:37.036095 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-03 13:06:37.036274 | controller | Wednesday 03 December 2025 13:06:37 +0000 (0:00:00.021) 0:01:08.428 **** 2025-12-03 13:06:37.241638 | controller | ok: [instance] 2025-12-03 13:06:37.639183 | controller | 2025-12-03 13:06:37.639214 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-03 13:06:37.639222 | controller | Wednesday 03 December 2025 13:06:37 +0000 (0:00:00.205) 0:01:08.634 **** 2025-12-03 13:06:37.639232 | controller | changed: [instance] 2025-12-03 13:06:37.639287 | controller | 2025-12-03 13:06:37.639316 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-03 13:06:37.639328 | controller | Wednesday 03 December 2025 13:06:37 +0000 (0:00:00.397) 0:01:09.031 **** 2025-12-03 13:06:37.702853 | controller | ok: [instance] 2025-12-03 13:06:37.736243 | controller | 2025-12-03 13:06:37.736277 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-03 13:06:37.736287 | controller | Wednesday 03 December 2025 13:06:37 +0000 (0:00:00.063) 0:01:09.095 **** 2025-12-03 13:06:37.736299 | controller | ok: [instance] 2025-12-03 13:06:38.142206 | controller | 2025-12-03 13:06:38.142233 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-03 13:06:38.142241 | controller | Wednesday 03 December 2025 13:06:37 +0000 (0:00:00.033) 0:01:09.128 **** 2025-12-03 13:06:38.142251 | controller | changed: [instance] 2025-12-03 13:06:38.142300 | controller | 2025-12-03 13:06:38.142324 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2025-12-03 13:06:38.142335 | controller | Wednesday 03 December 2025 13:06:38 +0000 (0:00:00.406) 0:01:09.535 **** 2025-12-03 13:06:38.170787 | controller | ok: [instance] 2025-12-03 13:06:38.190684 | controller | 2025-12-03 13:06:38.190707 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2025-12-03 13:06:38.190716 | controller | Wednesday 03 December 2025 13:06:38 +0000 (0:00:00.028) 0:01:09.563 **** 2025-12-03 13:06:38.190727 | controller | ok: [instance] 2025-12-03 13:06:38.210230 | controller | 2025-12-03 13:06:38.210264 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2025-12-03 13:06:38.210274 | controller | Wednesday 03 December 2025 13:06:38 +0000 (0:00:00.019) 0:01:09.583 **** 2025-12-03 13:06:38.210287 | controller | ok: [instance] 2025-12-03 13:06:38.210331 | controller | 2025-12-03 13:06:38.210353 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2025-12-03 13:06:38.210366 | controller | Wednesday 03 December 2025 13:06:38 +0000 (0:00:00.019) 0:01:09.603 **** 2025-12-03 13:06:38.285225 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2025-12-03 13:06:38.286124 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2025-12-03 13:06:38.286158 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2025-12-03 13:06:38.422250 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2025-12-03 13:06:38.422277 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2025-12-03 13:06:38.422287 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2025-12-03 13:06:38.422294 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2025-12-03 13:06:38.422301 | controller | 2025-12-03 13:06:38.422308 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 13:06:38.422316 | controller | Wednesday 03 December 2025 13:06:38 +0000 (0:00:00.075) 0:01:09.678 **** 2025-12-03 13:06:38.422327 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2025-12-03 13:06:38.422431 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2025-12-03 13:06:38.422443 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2025-12-03 13:06:38.422450 | controller | 2025-12-03 13:06:38.422457 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 13:06:38.422466 | controller | Wednesday 03 December 2025 13:06:38 +0000 (0:00:00.136) 0:01:09.815 **** 2025-12-03 13:06:38.503819 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2025-12-03 13:06:38.503992 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2025-12-03 13:06:38.504148 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2025-12-03 13:06:38.504351 | controller | skipping: [instance] 2025-12-03 13:06:38.504436 | controller | 2025-12-03 13:06:38.504561 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 13:06:38.504666 | controller | Wednesday 03 December 2025 13:06:38 +0000 (0:00:00.081) 0:01:09.896 **** 2025-12-03 13:06:38.587441 | controller | skipping: [instance] => (item=compute-0 - storage) 2025-12-03 13:06:38.587576 | controller | skipping: [instance] => (item=controller-0 - storage) 2025-12-03 13:06:38.587695 | controller | skipping: [instance] => (item=crc-0 - storage) 2025-12-03 13:06:38.587807 | controller | skipping: [instance] 2025-12-03 13:06:38.587913 | controller | 2025-12-03 13:06:38.588016 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 13:06:38.588173 | controller | Wednesday 03 December 2025 13:06:38 +0000 (0:00:00.083) 0:01:09.980 **** 2025-12-03 13:06:38.668076 | controller | skipping: [instance] => (item=compute-0 - tenant) 2025-12-03 13:06:38.668276 | controller | skipping: [instance] => (item=controller-0 - tenant) 2025-12-03 13:06:38.668442 | controller | skipping: [instance] => (item=crc-0 - tenant) 2025-12-03 13:06:38.668553 | controller | skipping: [instance] 2025-12-03 13:06:38.668679 | controller | 2025-12-03 13:06:38.668788 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 13:06:38.668898 | controller | Wednesday 03 December 2025 13:06:38 +0000 (0:00:00.080) 0:01:10.061 **** 2025-12-03 13:06:38.748245 | controller | skipping: [instance] => (item=compute-0 - external) 2025-12-03 13:06:38.748409 | controller | skipping: [instance] => (item=controller-0 - external) 2025-12-03 13:06:38.748529 | controller | skipping: [instance] => (item=crc-0 - external) 2025-12-03 13:06:38.748706 | controller | skipping: [instance] 2025-12-03 13:06:38.748797 | controller | 2025-12-03 13:06:38.748930 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 13:06:38.749032 | controller | Wednesday 03 December 2025 13:06:38 +0000 (0:00:00.080) 0:01:10.141 **** 2025-12-03 13:06:38.859414 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2025-12-03 13:06:38.859578 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2025-12-03 13:06:38.859699 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2025-12-03 13:06:38.859862 | controller | skipping: [instance] 2025-12-03 13:06:38.859966 | controller | 2025-12-03 13:06:38.860105 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-03 13:06:38.860248 | controller | Wednesday 03 December 2025 13:06:38 +0000 (0:00:00.111) 0:01:10.252 **** 2025-12-03 13:06:38.996446 | controller | ok: [instance] => (item=compute-0 - public) 2025-12-03 13:06:38.996588 | controller | ok: [instance] => (item=controller-0 - public) 2025-12-03 13:06:38.996765 | controller | ok: [instance] => (item=crc-0 - public) 2025-12-03 13:06:38.996866 | controller | 2025-12-03 13:06:38.997014 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2025-12-03 13:06:38.997187 | controller | Wednesday 03 December 2025 13:06:38 +0000 (0:00:00.137) 0:01:10.389 **** 2025-12-03 13:06:39.138553 | controller | 2025-12-03 13:06:39.138670 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2025-12-03 13:06:39.138793 | controller | Wednesday 03 December 2025 13:06:39 +0000 (0:00:00.142) 0:01:10.531 **** 2025-12-03 13:06:39.178912 | controller | ok: [instance] 2025-12-03 13:06:39.179039 | controller | 2025-12-03 13:06:39.179230 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2025-12-03 13:06:39.179419 | controller | Wednesday 03 December 2025 13:06:39 +0000 (0:00:00.040) 0:01:10.572 **** 2025-12-03 13:06:39.280432 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:59:b6:e2', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-12-03 13:06:39.280609 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:36:fc:85', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-12-03 13:06:39.280730 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:82:63:29', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-12-03 13:06:39.280898 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:28:9c:45', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-12-03 13:06:39.280999 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:ef:a8:1b', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-12-03 13:06:39.281146 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:36:3a:5e', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-12-03 13:06:39.281259 | controller | 2025-12-03 13:06:39.281368 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2025-12-03 13:06:39.281477 | controller | Wednesday 03 December 2025 13:06:39 +0000 (0:00:00.101) 0:01:10.673 **** 2025-12-03 13:06:39.333061 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2025-12-03 13:06:39.333286 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2025-12-03 13:06:39.333401 | controller | 2025-12-03 13:06:39.333546 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-12-03 13:06:39.333684 | controller | Wednesday 03 December 2025 13:06:39 +0000 (0:00:00.052) 0:01:10.726 **** 2025-12-03 13:06:39.511900 | controller | ok: [instance] 2025-12-03 13:06:39.535991 | controller | 2025-12-03 13:06:39.536013 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-12-03 13:06:39.536023 | controller | Wednesday 03 December 2025 13:06:39 +0000 (0:00:00.178) 0:01:10.904 **** 2025-12-03 13:06:39.536034 | controller | ok: [instance] 2025-12-03 13:06:39.715265 | controller | 2025-12-03 13:06:39.715311 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-12-03 13:06:39.715326 | controller | Wednesday 03 December 2025 13:06:39 +0000 (0:00:00.024) 0:01:10.928 **** 2025-12-03 13:06:39.715343 | controller | ok: [instance] 2025-12-03 13:06:39.715402 | controller | 2025-12-03 13:06:39.715418 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-12-03 13:06:39.739722 | controller | Wednesday 03 December 2025 13:06:39 +0000 (0:00:00.179) 0:01:11.108 **** 2025-12-03 13:06:39.739761 | controller | ok: [instance] 2025-12-03 13:06:39.760201 | controller | 2025-12-03 13:06:39.760229 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2025-12-03 13:06:39.760239 | controller | Wednesday 03 December 2025 13:06:39 +0000 (0:00:00.024) 0:01:11.132 **** 2025-12-03 13:06:39.760251 | controller | ok: [instance] 2025-12-03 13:06:39.941198 | controller | 2025-12-03 13:06:39.941241 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2025-12-03 13:06:39.941252 | controller | Wednesday 03 December 2025 13:06:39 +0000 (0:00:00.020) 0:01:11.153 **** 2025-12-03 13:06:39.941267 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:59:b6:e2', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-12-03 13:06:39.941306 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:36:fc:85', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-12-03 13:06:39.941314 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:82:63:29', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-12-03 13:06:39.941321 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:28:9c:45', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-12-03 13:06:39.941328 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:ef:a8:1b', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-12-03 13:06:39.941335 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:36:3a:5e', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-12-03 13:06:39.941341 | controller | 2025-12-03 13:06:39.941351 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2025-12-03 13:06:39.941359 | controller | Wednesday 03 December 2025 13:06:39 +0000 (0:00:00.180) 0:01:11.333 **** 2025-12-03 13:06:39.979275 | controller | ok: [instance] 2025-12-03 13:06:39.979331 | controller | 2025-12-03 13:06:39.979343 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2025-12-03 13:06:39.979417 | controller | Wednesday 03 December 2025 13:06:39 +0000 (0:00:00.038) 0:01:11.372 **** 2025-12-03 13:06:42.054235 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:59:b6:e2', 'entry': 'set:compute,52:54:00:59:b6:e2,192.168.140.100,compute-0', 'state': 'present'}) 2025-12-03 13:06:42.054297 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:36:fc:85', 'entry': 'set:controller,52:54:01:36:fc:85,192.168.140.9,controller-0', 'state': 'present'}) 2025-12-03 13:06:42.054951 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:82:63:29', 'entry': 'set:ocp,52:54:02:82:63:29,192.168.140.10,crc-0', 'state': 'present'}) 2025-12-03 13:06:42.078192 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:28:9c:45', 'entry': 'set:compute,52:54:00:28:9c:45,192.168.101.100,compute-0', 'state': 'present'}) 2025-12-03 13:06:42.078216 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:ef:a8:1b', 'entry': 'set:controller,52:54:01:ef:a8:1b,192.168.101.9,controller-0', 'state': 'present'}) 2025-12-03 13:06:42.078225 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:36:3a:5e', 'entry': 'set:ocp,52:54:02:36:3a:5e,192.168.101.10,crc-0', 'state': 'present'}) 2025-12-03 13:06:42.078232 | controller | 2025-12-03 13:06:42.078240 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2025-12-03 13:06:42.078247 | controller | Wednesday 03 December 2025 13:06:42 +0000 (0:00:02.075) 0:01:13.447 **** 2025-12-03 13:06:42.078257 | controller | skipping: [instance] 2025-12-03 13:06:42.299712 | controller | 2025-12-03 13:06:42.299730 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2025-12-03 13:06:42.299742 | controller | Wednesday 03 December 2025 13:06:42 +0000 (0:00:00.023) 0:01:13.471 **** 2025-12-03 13:06:42.299751 | controller | ok: [instance] => (item=compute-0) 2025-12-03 13:06:42.423961 | controller | ok: [instance] => (item=controller-0) 2025-12-03 13:06:42.423979 | controller | ok: [instance] => (item=crc-0) 2025-12-03 13:06:42.423986 | controller | 2025-12-03 13:06:42.423992 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2025-12-03 13:06:42.423998 | controller | Wednesday 03 December 2025 13:06:42 +0000 (0:00:00.221) 0:01:13.692 **** 2025-12-03 13:06:42.424006 | controller | 2025-12-03 13:06:42.466738 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-03 13:06:42.466756 | controller | Wednesday 03 December 2025 13:06:42 +0000 (0:00:00.124) 0:01:13.816 **** 2025-12-03 13:06:42.466766 | controller | ok: [instance] 2025-12-03 13:06:42.673230 | controller | 2025-12-03 13:06:42.673259 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-03 13:06:42.673268 | controller | Wednesday 03 December 2025 13:06:42 +0000 (0:00:00.042) 0:01:13.859 **** 2025-12-03 13:06:42.673280 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-03 13:06:42.673312 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-03 13:06:42.674938 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-12-03 13:06:45.811233 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-12-03 13:06:45.811266 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-12-03 13:06:45.811290 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-12-03 13:06:45.811297 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-12-03 13:06:45.811308 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 13:06:45.811315 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 13:06:45.811322 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-12-03 13:06:45.811329 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-03 13:06:45.811335 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-03 13:06:45.811342 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-12-03 13:06:45.811349 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-12-03 13:06:45.811356 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-12-03 13:06:45.811362 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-12-03 13:06:45.811373 | controller | 2025-12-03 13:06:45.811381 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-03 13:06:45.811388 | controller | Wednesday 03 December 2025 13:06:42 +0000 (0:00:00.206) 0:01:14.066 **** 2025-12-03 13:06:45.811402 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-03 13:06:45.811432 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-03 13:06:45.811440 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-12-03 13:06:45.811447 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-12-03 13:06:45.811454 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-12-03 13:06:45.811463 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-12-03 13:06:45.812251 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-12-03 13:06:45.812289 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 13:06:45.812315 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 13:06:45.812323 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-12-03 13:06:45.812328 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-03 13:06:45.812334 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-03 13:06:45.812340 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-12-03 13:06:45.812345 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-12-03 13:06:45.812350 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-12-03 13:06:45.812362 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-12-03 13:06:45.812625 | controller | 2025-12-03 13:06:45.831851 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2025-12-03 13:06:45.831872 | controller | Wednesday 03 December 2025 13:06:45 +0000 (0:00:03.137) 0:01:17.203 **** 2025-12-03 13:06:45.831884 | controller | ok: [instance] 2025-12-03 13:06:45.875197 | controller | 2025-12-03 13:06:45.875231 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2025-12-03 13:06:45.875242 | controller | Wednesday 03 December 2025 13:06:45 +0000 (0:00:00.021) 0:01:17.224 **** 2025-12-03 13:06:45.875254 | controller | skipping: [instance] => (item=compute) 2025-12-03 13:06:45.875290 | controller | skipping: [instance] => (item=controller) 2025-12-03 13:06:45.875298 | controller | skipping: [instance] => (item=crc) 2025-12-03 13:06:45.875310 | controller | skipping: [instance] 2025-12-03 13:06:45.875324 | controller | 2025-12-03 13:06:45.875494 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2025-12-03 13:06:45.905124 | controller | Wednesday 03 December 2025 13:06:45 +0000 (0:00:00.042) 0:01:17.267 **** 2025-12-03 13:06:45.905175 | controller | skipping: [instance] 2025-12-03 13:06:45.905422 | controller | 2025-12-03 13:06:45.905567 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2025-12-03 13:06:45.905700 | controller | Wednesday 03 December 2025 13:06:45 +0000 (0:00:00.030) 0:01:17.298 **** 2025-12-03 13:06:46.282048 | controller | changed: [instance] 2025-12-03 13:06:47.100930 | controller | 2025-12-03 13:06:47.100957 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2025-12-03 13:06:47.100966 | controller | Wednesday 03 December 2025 13:06:46 +0000 (0:00:00.364) 0:01:17.663 **** 2025-12-03 13:06:47.100972 | controller | 2025-12-03 13:06:47.100978 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-12-03 13:06:47.100983 | controller | Wednesday 03 December 2025 13:06:46 +0000 (0:00:00.011) 0:01:17.674 **** 2025-12-03 13:06:47.100992 | controller | changed: [instance] 2025-12-03 13:06:47.454165 | controller | 2025-12-03 13:06:47.454200 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-03 13:06:47.454208 | controller | Wednesday 03 December 2025 13:06:47 +0000 (0:00:00.819) 0:01:18.493 **** 2025-12-03 13:06:47.454218 | controller | changed: [instance] 2025-12-03 13:06:47.454591 | controller | 2025-12-03 13:06:47.793992 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2025-12-03 13:06:47.794024 | controller | Wednesday 03 December 2025 13:06:47 +0000 (0:00:00.353) 0:01:18.847 **** 2025-12-03 13:06:47.794035 | controller | changed: [instance] 2025-12-03 13:06:48.154759 | controller | 2025-12-03 13:06:48.154788 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2025-12-03 13:06:48.154796 | controller | Wednesday 03 December 2025 13:06:47 +0000 (0:00:00.339) 0:01:19.186 **** 2025-12-03 13:06:48.154806 | controller | changed: [instance] 2025-12-03 13:06:48.527104 | controller | 2025-12-03 13:06:48.527130 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2025-12-03 13:06:48.527137 | controller | Wednesday 03 December 2025 13:06:48 +0000 (0:00:00.360) 0:01:19.547 **** 2025-12-03 13:06:48.527147 | controller | changed: [instance] 2025-12-03 13:06:48.586707 | controller | 2025-12-03 13:06:48.586726 | controller | TASK [Build utility records dataset] ******************************************* 2025-12-03 13:06:48.586734 | controller | Wednesday 03 December 2025 13:06:48 +0000 (0:00:00.372) 0:01:19.919 **** 2025-12-03 13:06:48.586743 | controller | 2025-12-03 13:06:48.680739 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-03 13:06:48.680757 | controller | Wednesday 03 December 2025 13:06:48 +0000 (0:00:00.059) 0:01:19.979 **** 2025-12-03 13:06:48.680768 | controller | ok: [instance] 2025-12-03 13:06:48.782285 | controller | 2025-12-03 13:06:48.782331 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-03 13:06:48.782339 | controller | Wednesday 03 December 2025 13:06:48 +0000 (0:00:00.093) 0:01:20.073 **** 2025-12-03 13:06:48.782351 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-12-03 13:06:49.269219 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 13:06:49.269256 | controller | 2025-12-03 13:06:49.269266 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-03 13:06:49.269274 | controller | Wednesday 03 December 2025 13:06:48 +0000 (0:00:00.101) 0:01:20.174 **** 2025-12-03 13:06:49.269286 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-12-03 13:06:49.269317 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-03 13:06:49.269325 | controller | 2025-12-03 13:06:49.269337 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-12-03 13:06:49.269347 | controller | Wednesday 03 December 2025 13:06:49 +0000 (0:00:00.475) 0:01:20.650 **** 2025-12-03 13:06:49.269374 | controller | 2025-12-03 13:06:49.269577 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-03 13:06:49.753434 | controller | Wednesday 03 December 2025 13:06:49 +0000 (0:00:00.010) 0:01:20.661 **** 2025-12-03 13:06:49.753472 | controller | changed: [instance] 2025-12-03 13:06:50.107207 | controller | 2025-12-03 13:06:50.107248 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-03 13:06:50.107258 | controller | Wednesday 03 December 2025 13:06:49 +0000 (0:00:00.484) 0:01:21.146 **** 2025-12-03 13:06:50.107271 | controller | changed: [instance] 2025-12-03 13:06:50.140236 | controller | 2025-12-03 13:06:50.140262 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2025-12-03 13:06:50.140271 | controller | Wednesday 03 December 2025 13:06:50 +0000 (0:00:00.353) 0:01:21.499 **** 2025-12-03 13:06:50.140283 | controller | skipping: [instance] 2025-12-03 13:06:50.140316 | controller | 2025-12-03 13:06:50.140669 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2025-12-03 13:06:50.219983 | controller | Wednesday 03 December 2025 13:06:50 +0000 (0:00:00.033) 0:01:21.533 **** 2025-12-03 13:06:50.220005 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2025-12-03 13:06:50.413056 | controller | 2025-12-03 13:06:50.413075 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2025-12-03 13:06:50.413101 | controller | Wednesday 03 December 2025 13:06:50 +0000 (0:00:00.079) 0:01:21.612 **** 2025-12-03 13:06:50.413111 | controller | ok: [instance] 2025-12-03 13:06:50.433231 | controller | 2025-12-03 13:06:50.433269 | controller | TASK [Deploy CRC if needed] **************************************************** 2025-12-03 13:06:50.433279 | controller | Wednesday 03 December 2025 13:06:50 +0000 (0:00:00.193) 0:01:21.805 **** 2025-12-03 13:06:50.433292 | controller | skipping: [instance] 2025-12-03 13:06:50.433335 | controller | 2025-12-03 13:06:50.433345 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2025-12-03 13:06:50.433355 | controller | Wednesday 03 December 2025 13:06:50 +0000 (0:00:00.020) 0:01:21.826 **** 2025-12-03 13:06:50.783972 | controller | ok: [instance] 2025-12-03 13:06:51.015934 | controller | 2025-12-03 13:06:51.015959 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2025-12-03 13:06:51.015966 | controller | Wednesday 03 December 2025 13:06:50 +0000 (0:00:00.350) 0:01:22.176 **** 2025-12-03 13:06:51.015976 | controller | ok: [instance] 2025-12-03 13:06:51.238997 | controller | 2025-12-03 13:06:51.239023 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2025-12-03 13:06:51.239030 | controller | Wednesday 03 December 2025 13:06:51 +0000 (0:00:00.231) 0:01:22.408 **** 2025-12-03 13:06:51.239040 | controller | ok: [instance] 2025-12-03 13:06:51.459224 | controller | 2025-12-03 13:06:51.459263 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2025-12-03 13:06:51.459273 | controller | Wednesday 03 December 2025 13:06:51 +0000 (0:00:00.223) 0:01:22.631 **** 2025-12-03 13:06:51.459287 | controller | ok: [instance] 2025-12-03 13:06:51.687768 | controller | 2025-12-03 13:06:51.687801 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2025-12-03 13:06:51.687809 | controller | Wednesday 03 December 2025 13:06:51 +0000 (0:00:00.219) 0:01:22.851 **** 2025-12-03 13:06:51.687820 | controller | ok: [instance] 2025-12-03 13:06:51.728098 | controller | 2025-12-03 13:06:51.728126 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-03 13:06:51.728135 | controller | Wednesday 03 December 2025 13:06:51 +0000 (0:00:00.228) 0:01:23.080 **** 2025-12-03 13:06:51.728146 | controller | 2025-12-03 13:06:51.918240 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-12-03 13:06:51.918267 | controller | Wednesday 03 December 2025 13:06:51 +0000 (0:00:00.040) 0:01:23.120 **** 2025-12-03 13:06:51.918280 | controller | ok: [instance] 2025-12-03 13:06:51.940040 | controller | 2025-12-03 13:06:51.940058 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-12-03 13:06:51.940066 | controller | Wednesday 03 December 2025 13:06:51 +0000 (0:00:00.189) 0:01:23.310 **** 2025-12-03 13:06:51.940074 | controller | ok: [instance] 2025-12-03 13:06:51.965067 | controller | 2025-12-03 13:06:51.965103 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-12-03 13:06:51.965113 | controller | Wednesday 03 December 2025 13:06:51 +0000 (0:00:00.021) 0:01:23.332 **** 2025-12-03 13:06:51.965122 | controller | skipping: [instance] 2025-12-03 13:06:52.250748 | controller | 2025-12-03 13:06:52.250778 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2025-12-03 13:06:52.250786 | controller | Wednesday 03 December 2025 13:06:51 +0000 (0:00:00.025) 0:01:23.357 **** 2025-12-03 13:06:52.250796 | controller | ok: [instance] 2025-12-03 13:06:52.471137 | controller | 2025-12-03 13:06:52.471179 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2025-12-03 13:06:52.471193 | controller | Wednesday 03 December 2025 13:06:52 +0000 (0:00:00.285) 0:01:23.643 **** 2025-12-03 13:06:52.471203 | controller | ok: [instance] 2025-12-03 13:06:52.644276 | controller | 2025-12-03 13:06:52.644319 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2025-12-03 13:06:52.644329 | controller | Wednesday 03 December 2025 13:06:52 +0000 (0:00:00.220) 0:01:23.863 **** 2025-12-03 13:06:52.644342 | controller | ok: [instance] 2025-12-03 13:06:52.644363 | controller | 2025-12-03 13:06:52.644380 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2025-12-03 13:06:52.644400 | controller | Wednesday 03 December 2025 13:06:52 +0000 (0:00:00.173) 0:01:24.037 **** 2025-12-03 13:06:52.703168 | controller | 2025-12-03 13:06:52.703300 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-12-03 13:06:52.703447 | controller | Wednesday 03 December 2025 13:06:52 +0000 (0:00:00.058) 0:01:24.096 **** 2025-12-03 13:06:52.748997 | controller | ok: [instance] => changed=false 2025-12-03 13:06:52.926794 | controller | msg: All assertions passed 2025-12-03 13:06:52.926820 | controller | 2025-12-03 13:06:52.926827 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-12-03 13:06:52.926834 | controller | Wednesday 03 December 2025 13:06:52 +0000 (0:00:00.045) 0:01:24.141 **** 2025-12-03 13:06:52.926843 | controller | ok: [instance] 2025-12-03 13:06:53.125533 | controller | 2025-12-03 13:06:53.125568 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-12-03 13:06:53.125576 | controller | Wednesday 03 December 2025 13:06:52 +0000 (0:00:00.177) 0:01:24.319 **** 2025-12-03 13:06:53.125586 | controller | ok: [instance] 2025-12-03 13:06:53.150231 | controller | 2025-12-03 13:06:53.150271 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-12-03 13:06:53.150281 | controller | Wednesday 03 December 2025 13:06:53 +0000 (0:00:00.198) 0:01:24.518 **** 2025-12-03 13:06:53.150295 | controller | ok: [instance] => changed=false 2025-12-03 13:06:53.150327 | controller | msg: All assertions passed 2025-12-03 13:06:53.150335 | controller | 2025-12-03 13:06:53.150344 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-12-03 13:06:53.150387 | controller | Wednesday 03 December 2025 13:06:53 +0000 (0:00:00.024) 0:01:24.543 **** 2025-12-03 13:06:53.335679 | controller | ok: [instance] 2025-12-03 13:06:53.511524 | controller | 2025-12-03 13:06:53.511561 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-12-03 13:06:53.511570 | controller | Wednesday 03 December 2025 13:06:53 +0000 (0:00:00.185) 0:01:24.728 **** 2025-12-03 13:06:53.511581 | controller | ok: [instance] 2025-12-03 13:06:53.560045 | controller | 2025-12-03 13:06:53.560063 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-12-03 13:06:53.560070 | controller | Wednesday 03 December 2025 13:06:53 +0000 (0:00:00.175) 0:01:24.904 **** 2025-12-03 13:06:53.560096 | controller | ok: [instance] 2025-12-03 13:06:53.950247 | controller | 2025-12-03 13:06:53.950283 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2025-12-03 13:06:53.950291 | controller | Wednesday 03 December 2025 13:06:53 +0000 (0:00:00.048) 0:01:24.952 **** 2025-12-03 13:06:53.950307 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2025-12-03 13:06:53.950387 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2025-12-03 13:06:53.950409 | controller | 2025-12-03 13:06:53.950418 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2025-12-03 13:06:53.950429 | controller | Wednesday 03 December 2025 13:06:53 +0000 (0:00:00.389) 0:01:25.342 **** 2025-12-03 13:06:53.969934 | controller | skipping: [instance] 2025-12-03 13:06:53.993612 | controller | 2025-12-03 13:06:53.993631 | controller | TASK [Load the architecture local kustomize patches] *************************** 2025-12-03 13:06:53.993638 | controller | Wednesday 03 December 2025 13:06:53 +0000 (0:00:00.019) 0:01:25.362 **** 2025-12-03 13:06:53.993646 | controller | skipping: [instance] 2025-12-03 13:06:54.162231 | controller | 2025-12-03 13:06:54.162250 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2025-12-03 13:06:54.162258 | controller | Wednesday 03 December 2025 13:06:53 +0000 (0:00:00.023) 0:01:25.386 **** 2025-12-03 13:06:54.162267 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2025-12-03 13:06:54.188282 | controller | 2025-12-03 13:06:54.188329 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2025-12-03 13:06:54.188338 | controller | Wednesday 03 December 2025 13:06:54 +0000 (0:00:00.168) 0:01:25.554 **** 2025-12-03 13:06:54.188351 | controller | skipping: [instance] 2025-12-03 13:06:54.188382 | controller | 2025-12-03 13:06:54.188392 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2025-12-03 13:06:54.188466 | controller | Wednesday 03 December 2025 13:06:54 +0000 (0:00:00.026) 0:01:25.581 **** 2025-12-03 13:06:54.598202 | controller | changed: [instance] 2025-12-03 13:06:54.598256 | controller | 2025-12-03 13:06:54.598517 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2025-12-03 13:06:55.089227 | controller | Wednesday 03 December 2025 13:06:54 +0000 (0:00:00.409) 0:01:25.991 **** 2025-12-03 13:06:55.089275 | controller | changed: [instance] 2025-12-03 13:06:55.089364 | controller | 2025-12-03 13:06:55.089377 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2025-12-03 13:06:55.089388 | controller | Wednesday 03 December 2025 13:06:55 +0000 (0:00:00.479) 0:01:26.470 **** 2025-12-03 13:06:55.089524 | controller | 2025-12-03 13:06:55.089693 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-03 13:06:55.089855 | controller | Wednesday 03 December 2025 13:06:55 +0000 (0:00:00.011) 0:01:26.482 **** 2025-12-03 13:06:55.525681 | controller | changed: [instance] 2025-12-03 13:06:56.344868 | controller | 2025-12-03 13:06:56.344896 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-12-03 13:06:56.344904 | controller | Wednesday 03 December 2025 13:06:55 +0000 (0:00:00.436) 0:01:26.918 **** 2025-12-03 13:06:56.344914 | controller | changed: [instance] 2025-12-03 13:06:56.379531 | controller | 2025-12-03 13:06:56.379561 | controller | TASK [Deploy virtualbmc] ******************************************************* 2025-12-03 13:06:56.379569 | controller | Wednesday 03 December 2025 13:06:56 +0000 (0:00:00.819) 0:01:27.737 **** 2025-12-03 13:06:56.379578 | controller | skipping: [instance] 2025-12-03 13:06:56.410852 | controller | 2025-12-03 13:06:56.410870 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2025-12-03 13:06:56.410877 | controller | Wednesday 03 December 2025 13:06:56 +0000 (0:00:00.034) 0:01:27.772 **** 2025-12-03 13:06:56.410885 | controller | skipping: [instance] 2025-12-03 13:06:56.982152 | controller | 2025-12-03 13:06:56.982194 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2025-12-03 13:06:56.982202 | controller | Wednesday 03 December 2025 13:06:56 +0000 (0:00:00.031) 0:01:27.803 **** 2025-12-03 13:06:56.982213 | controller | changed: [instance] => (item=workload) 2025-12-03 13:06:57.394878 | controller | changed: [instance] => (item=reproducer-inventory) 2025-12-03 13:06:57.394908 | controller | ok: [instance] => (item=volumes) 2025-12-03 13:06:57.394916 | controller | 2025-12-03 13:06:57.394927 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2025-12-03 13:06:57.394934 | controller | Wednesday 03 December 2025 13:06:56 +0000 (0:00:00.570) 0:01:28.374 **** 2025-12-03 13:06:57.394943 | controller | changed: [instance] => (item=workload) 2025-12-03 13:06:57.420398 | controller | changed: [instance] => (item=volumes) 2025-12-03 13:06:57.420420 | controller | 2025-12-03 13:06:57.420428 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2025-12-03 13:06:57.420434 | controller | Wednesday 03 December 2025 13:06:57 +0000 (0:00:00.412) 0:01:28.787 **** 2025-12-03 13:06:57.420443 | controller | skipping: [instance] 2025-12-03 13:06:58.453210 | controller | 2025-12-03 13:06:58.453243 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2025-12-03 13:06:58.453253 | controller | Wednesday 03 December 2025 13:06:57 +0000 (0:00:00.025) 0:01:28.813 **** 2025-12-03 13:06:58.453265 | controller | changed: [instance] => (item=compute) 2025-12-03 13:06:58.453296 | controller | changed: [instance] => (item=controller) 2025-12-03 13:06:58.453659 | controller | changed: [instance] => (item=crc) 2025-12-03 13:06:58.823608 | controller | 2025-12-03 13:06:58.823637 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2025-12-03 13:06:58.823646 | controller | Wednesday 03 December 2025 13:06:58 +0000 (0:00:01.032) 0:01:29.846 **** 2025-12-03 13:06:58.823656 | controller | changed: [instance] 2025-12-03 13:06:58.864169 | controller | 2025-12-03 13:06:58.864207 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2025-12-03 13:06:58.864216 | controller | Wednesday 03 December 2025 13:06:58 +0000 (0:00:00.370) 0:01:30.216 **** 2025-12-03 13:06:58.864225 | controller | skipping: [instance] 2025-12-03 13:06:58.927071 | controller | 2025-12-03 13:06:58.927108 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2025-12-03 13:06:58.927116 | controller | Wednesday 03 December 2025 13:06:58 +0000 (0:00:00.040) 0:01:30.256 **** 2025-12-03 13:06:58.927125 | controller | skipping: [instance] => (item=crc) 2025-12-03 13:06:59.131211 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2025-12-03 13:06:59.131246 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2025-12-03 13:06:59.131256 | controller | 2025-12-03 13:06:59.131264 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-12-03 13:06:59.131271 | controller | Wednesday 03 December 2025 13:06:58 +0000 (0:00:00.062) 0:01:30.319 **** 2025-12-03 13:06:59.131283 | controller | changed: [instance] 2025-12-03 13:06:59.131332 | controller | 2025-12-03 13:06:59.131355 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-12-03 13:06:59.131368 | controller | Wednesday 03 December 2025 13:06:59 +0000 (0:00:00.204) 0:01:30.523 **** 2025-12-03 13:06:59.310634 | controller | ok: [instance] 2025-12-03 13:07:19.835977 | controller | 2025-12-03 13:07:19.836015 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-12-03 13:07:19.836023 | controller | Wednesday 03 December 2025 13:06:59 +0000 (0:00:00.179) 0:01:30.703 **** 2025-12-03 13:07:19.836033 | controller | changed: [instance] 2025-12-03 13:07:20.034237 | controller | 2025-12-03 13:07:20.034276 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-12-03 13:07:20.034285 | controller | Wednesday 03 December 2025 13:07:19 +0000 (0:00:20.525) 0:01:51.228 **** 2025-12-03 13:07:20.034296 | controller | ok: [instance] 2025-12-03 13:07:20.075023 | controller | 2025-12-03 13:07:20.075044 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-12-03 13:07:20.075051 | controller | Wednesday 03 December 2025 13:07:20 +0000 (0:00:00.198) 0:01:51.426 **** 2025-12-03 13:07:20.075061 | controller | ok: [instance] => changed=false 2025-12-03 13:07:20.284240 | controller | msg: All assertions passed 2025-12-03 13:07:20.284275 | controller | 2025-12-03 13:07:20.284285 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-12-03 13:07:20.284293 | controller | Wednesday 03 December 2025 13:07:20 +0000 (0:00:00.040) 0:01:51.467 **** 2025-12-03 13:07:20.284311 | controller | changed: [instance] 2025-12-03 13:07:20.284332 | controller | 2025-12-03 13:07:20.284342 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-12-03 13:07:20.284373 | controller | Wednesday 03 December 2025 13:07:20 +0000 (0:00:00.209) 0:01:51.676 **** 2025-12-03 13:07:20.489178 | controller | ok: [instance] 2025-12-03 13:07:20.489238 | controller | 2025-12-03 13:07:20.489451 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-12-03 13:07:20.686923 | controller | Wednesday 03 December 2025 13:07:20 +0000 (0:00:00.205) 0:01:51.881 **** 2025-12-03 13:07:20.686964 | controller | ok: [instance] 2025-12-03 13:07:20.710051 | controller | 2025-12-03 13:07:20.710095 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-12-03 13:07:20.710107 | controller | Wednesday 03 December 2025 13:07:20 +0000 (0:00:00.197) 0:01:52.079 **** 2025-12-03 13:07:20.710118 | controller | skipping: [instance] 2025-12-03 13:07:20.906255 | controller | 2025-12-03 13:07:20.906287 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-12-03 13:07:20.906297 | controller | Wednesday 03 December 2025 13:07:20 +0000 (0:00:00.023) 0:01:52.102 **** 2025-12-03 13:07:20.906309 | controller | ok: [instance] 2025-12-03 13:07:20.906340 | controller | 2025-12-03 13:07:20.906348 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-12-03 13:07:20.906357 | controller | Wednesday 03 December 2025 13:07:20 +0000 (0:00:00.196) 0:01:52.298 **** 2025-12-03 13:07:20.947817 | controller | ok: [instance] => changed=false 2025-12-03 13:07:21.153741 | controller | msg: All assertions passed 2025-12-03 13:07:21.153781 | controller | 2025-12-03 13:07:21.153791 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-12-03 13:07:21.153798 | controller | Wednesday 03 December 2025 13:07:20 +0000 (0:00:00.041) 0:01:52.340 **** 2025-12-03 13:07:21.153810 | controller | ok: [instance] 2025-12-03 13:07:21.332065 | controller | 2025-12-03 13:07:21.332123 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2025-12-03 13:07:21.332133 | controller | Wednesday 03 December 2025 13:07:21 +0000 (0:00:00.205) 0:01:52.546 **** 2025-12-03 13:07:21.332145 | controller | ok: [instance] 2025-12-03 13:07:21.724244 | controller | 2025-12-03 13:07:21.724279 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2025-12-03 13:07:21.724288 | controller | Wednesday 03 December 2025 13:07:21 +0000 (0:00:00.178) 0:01:52.724 **** 2025-12-03 13:07:21.724301 | controller | changed: [instance] 2025-12-03 13:07:21.899550 | controller | 2025-12-03 13:07:21.899586 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2025-12-03 13:07:21.899595 | controller | Wednesday 03 December 2025 13:07:21 +0000 (0:00:00.392) 0:01:53.116 **** 2025-12-03 13:07:21.899606 | controller | ok: [instance] 2025-12-03 13:07:21.899700 | controller | 2025-12-03 13:07:21.899846 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2025-12-03 13:07:21.899985 | controller | Wednesday 03 December 2025 13:07:21 +0000 (0:00:00.175) 0:01:53.292 **** 2025-12-03 13:07:22.077062 | controller | ok: [instance] 2025-12-03 13:07:22.077155 | controller | 2025-12-03 13:07:22.077258 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2025-12-03 13:07:22.077374 | controller | Wednesday 03 December 2025 13:07:22 +0000 (0:00:00.177) 0:01:53.469 **** 2025-12-03 13:07:22.484553 | controller | changed: [instance] 2025-12-03 13:07:22.484621 | controller | 2025-12-03 13:07:22.484743 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2025-12-03 13:07:22.484863 | controller | Wednesday 03 December 2025 13:07:22 +0000 (0:00:00.407) 0:01:53.877 **** 2025-12-03 13:07:22.505571 | controller | ok: [instance] 2025-12-03 13:07:22.505721 | controller | 2025-12-03 13:07:22.505869 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2025-12-03 13:07:22.506011 | controller | Wednesday 03 December 2025 13:07:22 +0000 (0:00:00.021) 0:01:53.898 **** 2025-12-03 13:07:22.737210 | controller | ok: [instance] 2025-12-03 13:07:23.209142 | controller | 2025-12-03 13:07:23.209178 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2025-12-03 13:07:23.209204 | controller | Wednesday 03 December 2025 13:07:22 +0000 (0:00:00.230) 0:01:54.129 **** 2025-12-03 13:07:23.209217 | controller | ok: [instance] 2025-12-03 13:07:23.209254 | controller | 2025-12-03 13:07:23.209486 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2025-12-03 13:07:23.363167 | controller | Wednesday 03 December 2025 13:07:23 +0000 (0:00:00.472) 0:01:54.602 **** 2025-12-03 13:07:23.363207 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-03 13:07:23.363723 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-03 13:07:23.623201 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-03 13:07:23.623244 | controller | 2025-12-03 13:07:23.623255 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2025-12-03 13:07:23.623262 | controller | Wednesday 03 December 2025 13:07:23 +0000 (0:00:00.153) 0:01:54.756 **** 2025-12-03 13:07:23.623274 | controller | changed: [instance] 2025-12-03 13:07:23.623302 | controller | 2025-12-03 13:07:23.623312 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2025-12-03 13:07:23.623402 | controller | Wednesday 03 December 2025 13:07:23 +0000 (0:00:00.260) 0:01:55.016 **** 2025-12-03 13:07:23.847623 | controller | changed: [instance] 2025-12-03 13:07:24.141249 | controller | 2025-12-03 13:07:24.141291 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2025-12-03 13:07:24.141301 | controller | Wednesday 03 December 2025 13:07:23 +0000 (0:00:00.224) 0:01:55.240 **** 2025-12-03 13:07:24.141313 | controller | changed: [instance] 2025-12-03 13:07:24.141321 | controller | 2025-12-03 13:07:24.141327 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2025-12-03 13:07:24.141336 | controller | Wednesday 03 December 2025 13:07:24 +0000 (0:00:00.293) 0:01:55.533 **** 2025-12-03 13:07:24.170646 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-03 13:07:24.215968 | controller | 2025-12-03 13:07:24.215985 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-03 13:07:24.215993 | controller | Wednesday 03 December 2025 13:07:24 +0000 (0:00:00.029) 0:01:55.563 **** 2025-12-03 13:07:24.216002 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-03 13:07:24.445714 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-03 13:07:24.445742 | controller | 2025-12-03 13:07:24.445750 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 13:07:24.445756 | controller | Wednesday 03 December 2025 13:07:24 +0000 (0:00:00.045) 0:01:55.608 **** 2025-12-03 13:07:24.445766 | controller | ok: [instance] 2025-12-03 13:07:24.490206 | controller | 2025-12-03 13:07:24.490364 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 13:07:24.490375 | controller | Wednesday 03 December 2025 13:07:24 +0000 (0:00:00.229) 0:01:55.838 **** 2025-12-03 13:07:24.490390 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 13:07:24.490435 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 13:07:24.490600 | controller | 2025-12-03 13:07:24.490630 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 13:07:24.718215 | controller | Wednesday 03 December 2025 13:07:24 +0000 (0:00:00.044) 0:01:55.883 **** 2025-12-03 13:07:24.718260 | controller | ok: [instance] 2025-12-03 13:07:24.718476 | controller | 2025-12-03 13:07:24.718508 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 13:07:24.916147 | controller | Wednesday 03 December 2025 13:07:24 +0000 (0:00:00.227) 0:01:56.111 **** 2025-12-03 13:07:24.916186 | controller | ok: [instance] 2025-12-03 13:07:25.203980 | controller | 2025-12-03 13:07:25.204008 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2025-12-03 13:07:25.204016 | controller | Wednesday 03 December 2025 13:07:24 +0000 (0:00:00.197) 0:01:56.308 **** 2025-12-03 13:07:25.204026 | controller | changed: [instance] 2025-12-03 13:07:25.436197 | controller | 2025-12-03 13:07:25.436244 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 13:07:25.436255 | controller | Wednesday 03 December 2025 13:07:25 +0000 (0:00:00.287) 0:01:56.596 **** 2025-12-03 13:07:25.436267 | controller | ok: [instance] 2025-12-03 13:07:25.436297 | controller | 2025-12-03 13:07:25.436305 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 13:07:25.436314 | controller | Wednesday 03 December 2025 13:07:25 +0000 (0:00:00.232) 0:01:56.828 **** 2025-12-03 13:07:25.481442 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 13:07:25.716855 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 13:07:25.716886 | controller | 2025-12-03 13:07:25.716893 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 13:07:25.716900 | controller | Wednesday 03 December 2025 13:07:25 +0000 (0:00:00.045) 0:01:56.874 **** 2025-12-03 13:07:25.716909 | controller | ok: [instance] 2025-12-03 13:07:25.923102 | controller | 2025-12-03 13:07:25.923133 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 13:07:25.923141 | controller | Wednesday 03 December 2025 13:07:25 +0000 (0:00:00.235) 0:01:57.109 **** 2025-12-03 13:07:25.923151 | controller | ok: [instance] 2025-12-03 13:07:26.214185 | controller | 2025-12-03 13:07:26.214214 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2025-12-03 13:07:26.214222 | controller | Wednesday 03 December 2025 13:07:25 +0000 (0:00:00.206) 0:01:57.315 **** 2025-12-03 13:07:26.214245 | controller | changed: [instance] 2025-12-03 13:07:26.235143 | controller | 2025-12-03 13:07:26.235170 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2025-12-03 13:07:26.235178 | controller | Wednesday 03 December 2025 13:07:26 +0000 (0:00:00.291) 0:01:57.606 **** 2025-12-03 13:07:26.235189 | controller | skipping: [instance] 2025-12-03 13:07:26.235585 | controller | 2025-12-03 13:07:26.262218 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2025-12-03 13:07:26.262274 | controller | Wednesday 03 December 2025 13:07:26 +0000 (0:00:00.021) 0:01:57.628 **** 2025-12-03 13:07:26.262289 | controller | skipping: [instance] 2025-12-03 13:07:26.290608 | controller | 2025-12-03 13:07:26.290642 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2025-12-03 13:07:26.290652 | controller | Wednesday 03 December 2025 13:07:26 +0000 (0:00:00.026) 0:01:57.654 **** 2025-12-03 13:07:26.290664 | controller | skipping: [instance] 2025-12-03 13:07:26.316923 | controller | 2025-12-03 13:07:26.316945 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2025-12-03 13:07:26.316953 | controller | Wednesday 03 December 2025 13:07:26 +0000 (0:00:00.028) 0:01:57.683 **** 2025-12-03 13:07:26.316962 | controller | skipping: [instance] 2025-12-03 13:07:26.533002 | controller | 2025-12-03 13:07:26.533031 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-03 13:07:26.533039 | controller | Wednesday 03 December 2025 13:07:26 +0000 (0:00:00.026) 0:01:57.709 **** 2025-12-03 13:07:26.533049 | controller | changed: [instance] 2025-12-03 13:07:26.569786 | controller | 2025-12-03 13:07:26.569810 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-03 13:07:26.569819 | controller | Wednesday 03 December 2025 13:07:26 +0000 (0:00:00.215) 0:01:57.925 **** 2025-12-03 13:07:26.569830 | controller | ok: [instance] 2025-12-03 13:07:26.624244 | controller | 2025-12-03 13:07:26.624284 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-03 13:07:26.624296 | controller | Wednesday 03 December 2025 13:07:26 +0000 (0:00:00.036) 0:01:57.962 **** 2025-12-03 13:07:26.624310 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-12-03 13:07:26.822490 | controller | 2025-12-03 13:07:26.822519 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-12-03 13:07:26.822527 | controller | Wednesday 03 December 2025 13:07:26 +0000 (0:00:00.054) 0:01:58.016 **** 2025-12-03 13:07:26.822537 | controller | ok: [instance] 2025-12-03 13:07:26.884722 | controller | 2025-12-03 13:07:26.884753 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-12-03 13:07:26.884762 | controller | Wednesday 03 December 2025 13:07:26 +0000 (0:00:00.198) 0:01:58.215 **** 2025-12-03 13:07:26.884774 | controller | ok: [instance] 2025-12-03 13:07:26.930211 | controller | 2025-12-03 13:07:26.930247 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-12-03 13:07:26.930257 | controller | Wednesday 03 December 2025 13:07:26 +0000 (0:00:00.061) 0:01:58.277 **** 2025-12-03 13:07:26.930269 | controller | ok: [instance] 2025-12-03 13:07:26.930478 | controller | 2025-12-03 13:07:26.930500 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-12-03 13:07:26.975987 | controller | Wednesday 03 December 2025 13:07:26 +0000 (0:00:00.046) 0:01:58.323 **** 2025-12-03 13:07:26.976008 | controller | skipping: [instance] 2025-12-03 13:07:27.020886 | controller | 2025-12-03 13:07:27.020908 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-12-03 13:07:27.020917 | controller | Wednesday 03 December 2025 13:07:26 +0000 (0:00:00.045) 0:01:58.368 **** 2025-12-03 13:07:27.020927 | controller | skipping: [instance] 2025-12-03 13:07:27.082060 | controller | 2025-12-03 13:07:27.082123 | controller | TASK [Call the config_drive role] ********************************************** 2025-12-03 13:07:27.082141 | controller | Wednesday 03 December 2025 13:07:27 +0000 (0:00:00.044) 0:01:58.413 **** 2025-12-03 13:07:27.082153 | controller | 2025-12-03 13:07:27.487666 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-12-03 13:07:27.487695 | controller | Wednesday 03 December 2025 13:07:27 +0000 (0:00:00.061) 0:01:58.474 **** 2025-12-03 13:07:27.487707 | controller | ok: [instance] => (item=artifacts) 2025-12-03 13:07:28.712762 | controller | ok: [instance] => (item=logs) 2025-12-03 13:07:28.712791 | controller | 2025-12-03 13:07:28.712799 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-12-03 13:07:28.712806 | controller | Wednesday 03 December 2025 13:07:27 +0000 (0:00:00.405) 0:01:58.880 **** 2025-12-03 13:07:28.712815 | controller | ok: [instance] 2025-12-03 13:07:28.928718 | controller | 2025-12-03 13:07:28.928747 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-12-03 13:07:28.928755 | controller | Wednesday 03 December 2025 13:07:28 +0000 (0:00:01.225) 0:02:00.105 **** 2025-12-03 13:07:28.928765 | controller | changed: [instance] 2025-12-03 13:07:29.299166 | controller | 2025-12-03 13:07:29.299200 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-12-03 13:07:29.299210 | controller | Wednesday 03 December 2025 13:07:28 +0000 (0:00:00.216) 0:02:00.321 **** 2025-12-03 13:07:29.299222 | controller | changed: [instance] 2025-12-03 13:07:29.680092 | controller | 2025-12-03 13:07:29.680124 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-12-03 13:07:29.680132 | controller | Wednesday 03 December 2025 13:07:29 +0000 (0:00:00.370) 0:02:00.691 **** 2025-12-03 13:07:29.680143 | controller | changed: [instance] 2025-12-03 13:07:29.723942 | controller | 2025-12-03 13:07:29.723964 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-12-03 13:07:29.723973 | controller | Wednesday 03 December 2025 13:07:29 +0000 (0:00:00.380) 0:02:01.072 **** 2025-12-03 13:07:29.723984 | controller | skipping: [instance] 2025-12-03 13:07:29.924549 | controller | 2025-12-03 13:07:29.924569 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-12-03 13:07:29.924577 | controller | Wednesday 03 December 2025 13:07:29 +0000 (0:00:00.044) 0:02:01.116 **** 2025-12-03 13:07:29.924586 | controller | ok: [instance] 2025-12-03 13:07:29.966913 | controller | 2025-12-03 13:07:29.966930 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-12-03 13:07:29.966942 | controller | Wednesday 03 December 2025 13:07:29 +0000 (0:00:00.200) 0:02:01.317 **** 2025-12-03 13:07:29.966951 | controller | skipping: [instance] 2025-12-03 13:07:30.202064 | controller | 2025-12-03 13:07:30.202109 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-12-03 13:07:30.202117 | controller | Wednesday 03 December 2025 13:07:29 +0000 (0:00:00.042) 0:02:01.359 **** 2025-12-03 13:07:30.202127 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2025-12-03 13:07:30.479879 | controller | changed: [instance] 2025-12-03 13:07:30.479908 | controller | 2025-12-03 13:07:30.479915 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-03 13:07:30.479922 | controller | Wednesday 03 December 2025 13:07:30 +0000 (0:00:00.234) 0:02:01.594 **** 2025-12-03 13:07:30.479931 | controller | changed: [instance] 2025-12-03 13:07:30.525114 | controller | 2025-12-03 13:07:30.525136 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-03 13:07:30.525145 | controller | Wednesday 03 December 2025 13:07:30 +0000 (0:00:00.277) 0:02:01.872 **** 2025-12-03 13:07:30.525156 | controller | skipping: [instance] 2025-12-03 13:07:30.553224 | controller | 2025-12-03 13:07:30.553271 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2025-12-03 13:07:30.553281 | controller | Wednesday 03 December 2025 13:07:30 +0000 (0:00:00.045) 0:02:01.917 **** 2025-12-03 13:07:30.553293 | controller | skipping: [instance] 2025-12-03 13:07:30.553324 | controller | 2025-12-03 13:07:30.553334 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2025-12-03 13:07:30.553439 | controller | Wednesday 03 December 2025 13:07:30 +0000 (0:00:00.028) 0:02:01.946 **** 2025-12-03 13:07:30.799168 | controller | changed: [instance] 2025-12-03 13:07:30.799506 | controller | 2025-12-03 13:07:31.022217 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2025-12-03 13:07:31.022261 | controller | Wednesday 03 December 2025 13:07:30 +0000 (0:00:00.245) 0:02:02.192 **** 2025-12-03 13:07:31.022276 | controller | changed: [instance] 2025-12-03 13:07:31.022307 | controller | 2025-12-03 13:07:31.022317 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2025-12-03 13:07:31.022449 | controller | Wednesday 03 December 2025 13:07:31 +0000 (0:00:00.222) 0:02:02.415 **** 2025-12-03 13:07:31.346256 | controller | changed: [instance] 2025-12-03 13:07:31.346309 | controller | 2025-12-03 13:07:31.346556 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2025-12-03 13:07:31.376227 | controller | Wednesday 03 December 2025 13:07:31 +0000 (0:00:00.323) 0:02:02.739 **** 2025-12-03 13:07:31.376309 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-03 13:07:31.465767 | controller | 2025-12-03 13:07:31.465800 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-03 13:07:31.465808 | controller | Wednesday 03 December 2025 13:07:31 +0000 (0:00:00.029) 0:02:02.768 **** 2025-12-03 13:07:31.465818 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-03 13:07:31.695035 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-03 13:07:31.695066 | controller | 2025-12-03 13:07:31.695095 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 13:07:31.695106 | controller | Wednesday 03 December 2025 13:07:31 +0000 (0:00:00.089) 0:02:02.858 **** 2025-12-03 13:07:31.695116 | controller | ok: [instance] 2025-12-03 13:07:31.741669 | controller | 2025-12-03 13:07:31.741687 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 13:07:31.741695 | controller | Wednesday 03 December 2025 13:07:31 +0000 (0:00:00.229) 0:02:03.087 **** 2025-12-03 13:07:31.741704 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 13:07:31.969840 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 13:07:31.969873 | controller | 2025-12-03 13:07:31.969882 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 13:07:31.969890 | controller | Wednesday 03 December 2025 13:07:31 +0000 (0:00:00.046) 0:02:03.134 **** 2025-12-03 13:07:31.969901 | controller | ok: [instance] 2025-12-03 13:07:32.171647 | controller | 2025-12-03 13:07:32.171683 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 13:07:32.171693 | controller | Wednesday 03 December 2025 13:07:31 +0000 (0:00:00.228) 0:02:03.362 **** 2025-12-03 13:07:32.171704 | controller | ok: [instance] 2025-12-03 13:07:32.461989 | controller | 2025-12-03 13:07:32.462019 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2025-12-03 13:07:32.462027 | controller | Wednesday 03 December 2025 13:07:32 +0000 (0:00:00.201) 0:02:03.564 **** 2025-12-03 13:07:32.462037 | controller | changed: [instance] 2025-12-03 13:07:32.692159 | controller | 2025-12-03 13:07:32.692191 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 13:07:32.692199 | controller | Wednesday 03 December 2025 13:07:32 +0000 (0:00:00.290) 0:02:03.854 **** 2025-12-03 13:07:32.692210 | controller | ok: [instance] 2025-12-03 13:07:32.738631 | controller | 2025-12-03 13:07:32.738658 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 13:07:32.738667 | controller | Wednesday 03 December 2025 13:07:32 +0000 (0:00:00.230) 0:02:04.084 **** 2025-12-03 13:07:32.738679 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 13:07:32.969263 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 13:07:32.969308 | controller | 2025-12-03 13:07:32.969318 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 13:07:32.969326 | controller | Wednesday 03 December 2025 13:07:32 +0000 (0:00:00.046) 0:02:04.131 **** 2025-12-03 13:07:32.969337 | controller | ok: [instance] 2025-12-03 13:07:32.969361 | controller | 2025-12-03 13:07:32.969391 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 13:07:32.969535 | controller | Wednesday 03 December 2025 13:07:32 +0000 (0:00:00.230) 0:02:04.362 **** 2025-12-03 13:07:33.174009 | controller | ok: [instance] 2025-12-03 13:07:33.465832 | controller | 2025-12-03 13:07:33.465863 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2025-12-03 13:07:33.465871 | controller | Wednesday 03 December 2025 13:07:33 +0000 (0:00:00.204) 0:02:04.566 **** 2025-12-03 13:07:33.465881 | controller | changed: [instance] 2025-12-03 13:07:33.486059 | controller | 2025-12-03 13:07:33.486104 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2025-12-03 13:07:33.486117 | controller | Wednesday 03 December 2025 13:07:33 +0000 (0:00:00.291) 0:02:04.858 **** 2025-12-03 13:07:33.486129 | controller | skipping: [instance] 2025-12-03 13:07:33.512731 | controller | 2025-12-03 13:07:33.512751 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2025-12-03 13:07:33.512758 | controller | Wednesday 03 December 2025 13:07:33 +0000 (0:00:00.020) 0:02:04.878 **** 2025-12-03 13:07:33.512767 | controller | skipping: [instance] 2025-12-03 13:07:33.543052 | controller | 2025-12-03 13:07:33.543094 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2025-12-03 13:07:33.543108 | controller | Wednesday 03 December 2025 13:07:33 +0000 (0:00:00.026) 0:02:04.905 **** 2025-12-03 13:07:33.543124 | controller | skipping: [instance] 2025-12-03 13:07:33.568889 | controller | 2025-12-03 13:07:33.568907 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2025-12-03 13:07:33.568915 | controller | Wednesday 03 December 2025 13:07:33 +0000 (0:00:00.030) 0:02:04.935 **** 2025-12-03 13:07:33.568924 | controller | skipping: [instance] 2025-12-03 13:07:33.786756 | controller | 2025-12-03 13:07:33.786785 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-03 13:07:33.786795 | controller | Wednesday 03 December 2025 13:07:33 +0000 (0:00:00.025) 0:02:04.961 **** 2025-12-03 13:07:33.786807 | controller | changed: [instance] 2025-12-03 13:07:33.825181 | controller | 2025-12-03 13:07:33.825216 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-03 13:07:33.825233 | controller | Wednesday 03 December 2025 13:07:33 +0000 (0:00:00.217) 0:02:05.179 **** 2025-12-03 13:07:33.825256 | controller | ok: [instance] 2025-12-03 13:07:33.825287 | controller | 2025-12-03 13:07:33.825297 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-03 13:07:33.825441 | controller | Wednesday 03 December 2025 13:07:33 +0000 (0:00:00.038) 0:02:05.218 **** 2025-12-03 13:07:33.878193 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-12-03 13:07:34.076218 | controller | 2025-12-03 13:07:34.076278 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-12-03 13:07:34.076287 | controller | Wednesday 03 December 2025 13:07:33 +0000 (0:00:00.052) 0:02:05.271 **** 2025-12-03 13:07:34.076298 | controller | ok: [instance] 2025-12-03 13:07:34.076509 | controller | 2025-12-03 13:07:34.076542 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-12-03 13:07:34.138066 | controller | Wednesday 03 December 2025 13:07:34 +0000 (0:00:00.197) 0:02:05.469 **** 2025-12-03 13:07:34.138109 | controller | ok: [instance] 2025-12-03 13:07:34.184193 | controller | 2025-12-03 13:07:34.184239 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-12-03 13:07:34.184259 | controller | Wednesday 03 December 2025 13:07:34 +0000 (0:00:00.061) 0:02:05.530 **** 2025-12-03 13:07:34.184271 | controller | ok: [instance] 2025-12-03 13:07:34.228751 | controller | 2025-12-03 13:07:34.228779 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-12-03 13:07:34.228789 | controller | Wednesday 03 December 2025 13:07:34 +0000 (0:00:00.045) 0:02:05.576 **** 2025-12-03 13:07:34.228801 | controller | skipping: [instance] 2025-12-03 13:07:34.228878 | controller | 2025-12-03 13:07:34.229031 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-12-03 13:07:34.229148 | controller | Wednesday 03 December 2025 13:07:34 +0000 (0:00:00.044) 0:02:05.621 **** 2025-12-03 13:07:34.271577 | controller | skipping: [instance] 2025-12-03 13:07:34.271723 | controller | 2025-12-03 13:07:34.271844 | controller | TASK [Call the config_drive role] ********************************************** 2025-12-03 13:07:34.272017 | controller | Wednesday 03 December 2025 13:07:34 +0000 (0:00:00.042) 0:02:05.664 **** 2025-12-03 13:07:34.332436 | controller | 2025-12-03 13:07:34.332622 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-12-03 13:07:34.332779 | controller | Wednesday 03 December 2025 13:07:34 +0000 (0:00:00.060) 0:02:05.725 **** 2025-12-03 13:07:34.740223 | controller | ok: [instance] => (item=artifacts) 2025-12-03 13:07:34.740305 | controller | ok: [instance] => (item=logs) 2025-12-03 13:07:34.740336 | controller | 2025-12-03 13:07:34.740568 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-12-03 13:07:35.981799 | controller | Wednesday 03 December 2025 13:07:34 +0000 (0:00:00.407) 0:02:06.133 **** 2025-12-03 13:07:35.981834 | controller | ok: [instance] 2025-12-03 13:07:36.196950 | controller | 2025-12-03 13:07:36.196979 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-12-03 13:07:36.196987 | controller | Wednesday 03 December 2025 13:07:35 +0000 (0:00:01.241) 0:02:07.374 **** 2025-12-03 13:07:36.196997 | controller | changed: [instance] 2025-12-03 13:07:36.570064 | controller | 2025-12-03 13:07:36.570110 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-12-03 13:07:36.570119 | controller | Wednesday 03 December 2025 13:07:36 +0000 (0:00:00.215) 0:02:07.589 **** 2025-12-03 13:07:36.570128 | controller | changed: [instance] 2025-12-03 13:07:36.947245 | controller | 2025-12-03 13:07:36.947293 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-12-03 13:07:36.947304 | controller | Wednesday 03 December 2025 13:07:36 +0000 (0:00:00.373) 0:02:07.962 **** 2025-12-03 13:07:36.947315 | controller | changed: [instance] 2025-12-03 13:07:36.991837 | controller | 2025-12-03 13:07:36.991867 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-12-03 13:07:36.991875 | controller | Wednesday 03 December 2025 13:07:36 +0000 (0:00:00.376) 0:02:08.339 **** 2025-12-03 13:07:36.991893 | controller | skipping: [instance] 2025-12-03 13:07:37.199586 | controller | 2025-12-03 13:07:37.199621 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-12-03 13:07:37.199629 | controller | Wednesday 03 December 2025 13:07:36 +0000 (0:00:00.044) 0:02:08.384 **** 2025-12-03 13:07:37.199638 | controller | ok: [instance] 2025-12-03 13:07:37.242127 | controller | 2025-12-03 13:07:37.242155 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-12-03 13:07:37.242162 | controller | Wednesday 03 December 2025 13:07:37 +0000 (0:00:00.207) 0:02:08.592 **** 2025-12-03 13:07:37.242173 | controller | skipping: [instance] 2025-12-03 13:07:37.480682 | controller | 2025-12-03 13:07:37.480714 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-12-03 13:07:37.480722 | controller | Wednesday 03 December 2025 13:07:37 +0000 (0:00:00.042) 0:02:08.634 **** 2025-12-03 13:07:37.480732 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2025-12-03 13:07:37.763705 | controller | changed: [instance] 2025-12-03 13:07:37.763736 | controller | 2025-12-03 13:07:37.763744 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-03 13:07:37.763751 | controller | Wednesday 03 December 2025 13:07:37 +0000 (0:00:00.238) 0:02:08.873 **** 2025-12-03 13:07:37.763760 | controller | changed: [instance] 2025-12-03 13:07:37.809541 | controller | 2025-12-03 13:07:37.809562 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-03 13:07:37.809569 | controller | Wednesday 03 December 2025 13:07:37 +0000 (0:00:00.283) 0:02:09.156 **** 2025-12-03 13:07:37.809578 | controller | skipping: [instance] 2025-12-03 13:07:37.837211 | controller | 2025-12-03 13:07:37.837284 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2025-12-03 13:07:37.837295 | controller | Wednesday 03 December 2025 13:07:37 +0000 (0:00:00.046) 0:02:09.202 **** 2025-12-03 13:07:37.837307 | controller | skipping: [instance] 2025-12-03 13:07:37.837556 | controller | 2025-12-03 13:07:37.837574 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2025-12-03 13:07:37.837585 | controller | Wednesday 03 December 2025 13:07:37 +0000 (0:00:00.027) 0:02:09.230 **** 2025-12-03 13:07:38.084249 | controller | changed: [instance] 2025-12-03 13:07:38.084333 | controller | 2025-12-03 13:07:38.084351 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2025-12-03 13:07:38.084496 | controller | Wednesday 03 December 2025 13:07:38 +0000 (0:00:00.247) 0:02:09.477 **** 2025-12-03 13:07:38.310933 | controller | changed: [instance] 2025-12-03 13:07:38.642860 | controller | 2025-12-03 13:07:38.642892 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2025-12-03 13:07:38.642900 | controller | Wednesday 03 December 2025 13:07:38 +0000 (0:00:00.226) 0:02:09.703 **** 2025-12-03 13:07:38.642910 | controller | changed: [instance] 2025-12-03 13:07:38.671239 | controller | 2025-12-03 13:07:38.671289 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2025-12-03 13:07:38.671299 | controller | Wednesday 03 December 2025 13:07:38 +0000 (0:00:00.331) 0:02:10.035 **** 2025-12-03 13:07:38.671312 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-03 13:07:38.671344 | controller | 2025-12-03 13:07:38.671355 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-03 13:07:38.671447 | controller | Wednesday 03 December 2025 13:07:38 +0000 (0:00:00.028) 0:02:10.064 **** 2025-12-03 13:07:38.716706 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-03 13:07:38.944608 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-03 13:07:38.944634 | controller | 2025-12-03 13:07:38.944643 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 13:07:38.944651 | controller | Wednesday 03 December 2025 13:07:38 +0000 (0:00:00.045) 0:02:10.109 **** 2025-12-03 13:07:38.944669 | controller | ok: [instance] 2025-12-03 13:07:38.989250 | controller | 2025-12-03 13:07:38.989303 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 13:07:38.989313 | controller | Wednesday 03 December 2025 13:07:38 +0000 (0:00:00.227) 0:02:10.337 **** 2025-12-03 13:07:38.989326 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 13:07:38.989360 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 13:07:38.989370 | controller | 2025-12-03 13:07:38.989580 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 13:07:39.223859 | controller | Wednesday 03 December 2025 13:07:38 +0000 (0:00:00.044) 0:02:10.382 **** 2025-12-03 13:07:39.223884 | controller | ok: [instance] 2025-12-03 13:07:39.424160 | controller | 2025-12-03 13:07:39.424191 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 13:07:39.424203 | controller | Wednesday 03 December 2025 13:07:39 +0000 (0:00:00.234) 0:02:10.616 **** 2025-12-03 13:07:39.424214 | controller | ok: [instance] 2025-12-03 13:07:39.424220 | controller | 2025-12-03 13:07:39.424226 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2025-12-03 13:07:39.424233 | controller | Wednesday 03 December 2025 13:07:39 +0000 (0:00:00.200) 0:02:10.816 **** 2025-12-03 13:07:39.710204 | controller | changed: [instance] 2025-12-03 13:07:39.710277 | controller | 2025-12-03 13:07:39.710457 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-03 13:07:39.940299 | controller | Wednesday 03 December 2025 13:07:39 +0000 (0:00:00.286) 0:02:11.103 **** 2025-12-03 13:07:39.940340 | controller | ok: [instance] 2025-12-03 13:07:39.984915 | controller | 2025-12-03 13:07:39.984933 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-03 13:07:39.984941 | controller | Wednesday 03 December 2025 13:07:39 +0000 (0:00:00.229) 0:02:11.332 **** 2025-12-03 13:07:39.984950 | controller | ok: [instance] => (item=cifmw-public) 2025-12-03 13:07:40.217253 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-03 13:07:40.217298 | controller | 2025-12-03 13:07:40.217308 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-03 13:07:40.217316 | controller | Wednesday 03 December 2025 13:07:39 +0000 (0:00:00.044) 0:02:11.377 **** 2025-12-03 13:07:40.217328 | controller | ok: [instance] 2025-12-03 13:07:40.419865 | controller | 2025-12-03 13:07:40.419897 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-03 13:07:40.419905 | controller | Wednesday 03 December 2025 13:07:40 +0000 (0:00:00.232) 0:02:11.610 **** 2025-12-03 13:07:40.419915 | controller | ok: [instance] 2025-12-03 13:07:40.711982 | controller | 2025-12-03 13:07:40.712012 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2025-12-03 13:07:40.712020 | controller | Wednesday 03 December 2025 13:07:40 +0000 (0:00:00.202) 0:02:11.812 **** 2025-12-03 13:07:40.712030 | controller | changed: [instance] 2025-12-03 13:07:40.733775 | controller | 2025-12-03 13:07:40.733798 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2025-12-03 13:07:40.733807 | controller | Wednesday 03 December 2025 13:07:40 +0000 (0:00:00.291) 0:02:12.104 **** 2025-12-03 13:07:40.733819 | controller | skipping: [instance] 2025-12-03 13:07:40.761893 | controller | 2025-12-03 13:07:40.761914 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2025-12-03 13:07:40.761923 | controller | Wednesday 03 December 2025 13:07:40 +0000 (0:00:00.021) 0:02:12.126 **** 2025-12-03 13:07:40.761934 | controller | skipping: [instance] 2025-12-03 13:07:40.791274 | controller | 2025-12-03 13:07:40.791321 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2025-12-03 13:07:40.791331 | controller | Wednesday 03 December 2025 13:07:40 +0000 (0:00:00.028) 0:02:12.154 **** 2025-12-03 13:07:40.791345 | controller | skipping: [instance] 2025-12-03 13:07:40.818546 | controller | 2025-12-03 13:07:40.818568 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2025-12-03 13:07:40.818576 | controller | Wednesday 03 December 2025 13:07:40 +0000 (0:00:00.029) 0:02:12.184 **** 2025-12-03 13:07:40.818585 | controller | skipping: [instance] 2025-12-03 13:07:41.038195 | controller | 2025-12-03 13:07:41.038230 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-03 13:07:41.038241 | controller | Wednesday 03 December 2025 13:07:40 +0000 (0:00:00.027) 0:02:12.211 **** 2025-12-03 13:07:41.038253 | controller | changed: [instance] 2025-12-03 13:07:41.076002 | controller | 2025-12-03 13:07:41.076030 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-03 13:07:41.076038 | controller | Wednesday 03 December 2025 13:07:41 +0000 (0:00:00.219) 0:02:12.431 **** 2025-12-03 13:07:41.076048 | controller | ok: [instance] 2025-12-03 13:07:41.104249 | controller | 2025-12-03 13:07:41.104300 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-03 13:07:41.104310 | controller | Wednesday 03 December 2025 13:07:41 +0000 (0:00:00.037) 0:02:12.468 **** 2025-12-03 13:07:41.104322 | controller | skipping: [instance] 2025-12-03 13:07:41.104606 | controller | 2025-12-03 13:07:41.104639 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-03 13:07:41.132101 | controller | Wednesday 03 December 2025 13:07:41 +0000 (0:00:00.028) 0:02:12.497 **** 2025-12-03 13:07:41.132123 | controller | skipping: [instance] 2025-12-03 13:07:41.177862 | controller | 2025-12-03 13:07:41.177884 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-03 13:07:41.177894 | controller | Wednesday 03 December 2025 13:07:41 +0000 (0:00:00.027) 0:02:12.524 **** 2025-12-03 13:07:41.177909 | controller | skipping: [instance] 2025-12-03 13:07:41.203230 | controller | 2025-12-03 13:07:41.203280 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2025-12-03 13:07:41.203291 | controller | Wednesday 03 December 2025 13:07:41 +0000 (0:00:00.045) 0:02:12.570 **** 2025-12-03 13:07:41.203304 | controller | skipping: [instance] 2025-12-03 13:07:41.266213 | controller | 2025-12-03 13:07:41.266230 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2025-12-03 13:07:41.266238 | controller | Wednesday 03 December 2025 13:07:41 +0000 (0:00:00.025) 0:02:12.596 **** 2025-12-03 13:07:41.266250 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2025-12-03 13:07:41.266386 | controller | 2025-12-03 13:07:41.266533 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2025-12-03 13:07:41.266680 | controller | Wednesday 03 December 2025 13:07:41 +0000 (0:00:00.063) 0:02:12.659 **** 2025-12-03 13:07:41.508635 | controller | ok: [instance] => (item=crc) 2025-12-03 13:07:41.508746 | controller | 2025-12-03 13:07:41.508867 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2025-12-03 13:07:41.508984 | controller | Wednesday 03 December 2025 13:07:41 +0000 (0:00:00.242) 0:02:12.901 **** 2025-12-03 13:07:43.580694 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-03 13:07:43.580896 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-03 13:07:43.581034 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-03 13:07:43.581168 | controller | 2025-12-03 13:07:43.581303 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-03 13:07:43.581408 | controller | Wednesday 03 December 2025 13:07:43 +0000 (0:00:02.071) 0:02:14.973 **** 2025-12-03 13:07:44.149512 | controller | changed: [instance] 2025-12-03 13:07:44.626670 | controller | 2025-12-03 13:07:44.626708 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-03 13:07:44.626717 | controller | Wednesday 03 December 2025 13:07:44 +0000 (0:00:00.568) 0:02:15.542 **** 2025-12-03 13:07:44.626727 | controller | changed: [instance] 2025-12-03 13:07:45.107900 | controller | 2025-12-03 13:07:45.107933 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-03 13:07:45.107946 | controller | Wednesday 03 December 2025 13:07:44 +0000 (0:00:00.477) 0:02:16.019 **** 2025-12-03 13:07:45.107957 | controller | changed: [instance] 2025-12-03 13:07:45.841385 | controller | 2025-12-03 13:07:45.841415 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2025-12-03 13:07:45.841424 | controller | Wednesday 03 December 2025 13:07:45 +0000 (0:00:00.481) 0:02:16.500 **** 2025-12-03 13:07:45.841434 | controller | changed: [instance] => (item=compute-0.utility) 2025-12-03 13:08:05.648382 | controller | changed: [instance] => (item=controller-0.utility) 2025-12-03 13:08:05.648441 | controller | changed: [instance] => (item=crc-0.utility) 2025-12-03 13:08:05.648450 | controller | 2025-12-03 13:08:05.648457 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2025-12-03 13:08:05.648463 | controller | Wednesday 03 December 2025 13:07:45 +0000 (0:00:00.728) 0:02:17.229 **** 2025-12-03 13:08:05.648473 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-12-03 13:08:05.648497 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2025-12-03 13:08:05.648549 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2025-12-03 13:08:05.648654 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2025-12-03 13:08:05.648769 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2025-12-03 13:08:05.649523 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left). 2025-12-03 13:08:05.765420 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j78797638779.21643', 'results_file': '/home/zuul/.ansible_async/j78797638779.21643', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2025-12-03 13:08:05.765463 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j10969661015.21660', 'results_file': '/home/zuul/.ansible_async/j10969661015.21660', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2025-12-03 13:08:05.765471 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j778111819632.21676', 'results_file': '/home/zuul/.ansible_async/j778111819632.21676', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2025-12-03 13:08:05.765478 | controller | 2025-12-03 13:08:05.765484 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2025-12-03 13:08:05.765489 | controller | Wednesday 03 December 2025 13:08:05 +0000 (0:00:19.812) 0:02:37.041 **** 2025-12-03 13:08:05.765501 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-03 13:08:05.788185 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-03 13:08:05.788221 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-03 13:08:05.788229 | controller | 2025-12-03 13:08:05.788235 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-03 13:08:05.788241 | controller | Wednesday 03 December 2025 13:08:05 +0000 (0:00:00.116) 0:02:37.157 **** 2025-12-03 13:08:05.788252 | controller | skipping: [instance] 2025-12-03 13:08:05.788271 | controller | 2025-12-03 13:08:05.788312 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2025-12-03 13:08:05.788426 | controller | Wednesday 03 December 2025 13:08:05 +0000 (0:00:00.023) 0:02:37.181 **** 2025-12-03 13:08:05.826924 | controller | 2025-12-03 13:08:05.827032 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-03 13:08:05.827176 | controller | Wednesday 03 December 2025 13:08:05 +0000 (0:00:00.038) 0:02:37.220 **** 2025-12-03 13:08:05.909156 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-12-03 13:08:05.909242 | controller | 2025-12-03 13:08:05.909349 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-03 13:08:05.909463 | controller | Wednesday 03 December 2025 13:08:05 +0000 (0:00:00.082) 0:02:37.302 **** 2025-12-03 13:08:06.133427 | controller | changed: [instance] 2025-12-03 13:08:06.350103 | controller | 2025-12-03 13:08:06.350143 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-03 13:08:06.350152 | controller | Wednesday 03 December 2025 13:08:06 +0000 (0:00:00.223) 0:02:37.525 **** 2025-12-03 13:08:06.350165 | controller | changed: [instance] 2025-12-03 13:08:06.751527 | controller | 2025-12-03 13:08:06.751559 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2025-12-03 13:08:06.751571 | controller | Wednesday 03 December 2025 13:08:06 +0000 (0:00:00.216) 0:02:37.742 **** 2025-12-03 13:08:06.751582 | controller | changed: [instance] 2025-12-03 13:08:06.778490 | controller | 2025-12-03 13:08:06.778511 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2025-12-03 13:08:06.778519 | controller | Wednesday 03 December 2025 13:08:06 +0000 (0:00:00.401) 0:02:38.144 **** 2025-12-03 13:08:06.778528 | controller | skipping: [instance] 2025-12-03 13:08:06.805487 | controller | 2025-12-03 13:08:06.805508 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-03 13:08:06.805516 | controller | Wednesday 03 December 2025 13:08:06 +0000 (0:00:00.027) 0:02:38.171 **** 2025-12-03 13:08:06.805525 | controller | skipping: [instance] 2025-12-03 13:08:06.805812 | controller | 2025-12-03 13:08:06.805827 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2025-12-03 13:08:06.854213 | controller | Wednesday 03 December 2025 13:08:06 +0000 (0:00:00.027) 0:02:38.198 **** 2025-12-03 13:08:06.854235 | controller | skipping: [instance] 2025-12-03 13:08:06.854392 | controller | 2025-12-03 13:08:06.854491 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2025-12-03 13:08:06.854653 | controller | Wednesday 03 December 2025 13:08:06 +0000 (0:00:00.048) 0:02:38.247 **** 2025-12-03 13:08:06.905729 | controller | skipping: [instance] 2025-12-03 13:08:06.905821 | controller | 2025-12-03 13:08:06.905834 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-03 13:08:06.905990 | controller | Wednesday 03 December 2025 13:08:06 +0000 (0:00:00.051) 0:02:38.298 **** 2025-12-03 13:08:06.933095 | controller | skipping: [instance] 2025-12-03 13:08:06.933172 | controller | 2025-12-03 13:08:06.933182 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2025-12-03 13:08:06.933192 | controller | Wednesday 03 December 2025 13:08:06 +0000 (0:00:00.027) 0:02:38.326 **** 2025-12-03 13:08:06.971069 | controller | 2025-12-03 13:08:06.971177 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-03 13:08:06.971292 | controller | Wednesday 03 December 2025 13:08:06 +0000 (0:00:00.038) 0:02:38.364 **** 2025-12-03 13:08:07.052872 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-12-03 13:08:07.052986 | controller | 2025-12-03 13:08:07.053114 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-03 13:08:07.053268 | controller | Wednesday 03 December 2025 13:08:07 +0000 (0:00:00.081) 0:02:38.445 **** 2025-12-03 13:08:07.266546 | controller | ok: [instance] 2025-12-03 13:08:07.473324 | controller | 2025-12-03 13:08:07.473356 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-03 13:08:07.473376 | controller | Wednesday 03 December 2025 13:08:07 +0000 (0:00:00.213) 0:02:38.659 **** 2025-12-03 13:08:07.473387 | controller | ok: [instance] 2025-12-03 13:08:07.855445 | controller | 2025-12-03 13:08:07.855480 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2025-12-03 13:08:07.855489 | controller | Wednesday 03 December 2025 13:08:07 +0000 (0:00:00.206) 0:02:38.865 **** 2025-12-03 13:08:07.855499 | controller | changed: [instance] 2025-12-03 13:08:07.881196 | controller | 2025-12-03 13:08:07.881229 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2025-12-03 13:08:07.881238 | controller | Wednesday 03 December 2025 13:08:07 +0000 (0:00:00.382) 0:02:39.247 **** 2025-12-03 13:08:07.881248 | controller | skipping: [instance] 2025-12-03 13:08:07.881319 | controller | 2025-12-03 13:08:07.881348 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-03 13:08:07.881360 | controller | Wednesday 03 December 2025 13:08:07 +0000 (0:00:00.026) 0:02:39.274 **** 2025-12-03 13:08:07.909126 | controller | skipping: [instance] 2025-12-03 13:08:09.552582 | controller | 2025-12-03 13:08:09.552612 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2025-12-03 13:08:09.552627 | controller | Wednesday 03 December 2025 13:08:07 +0000 (0:00:00.027) 0:02:39.301 **** 2025-12-03 13:08:09.552638 | controller | changed: [instance -> controller-0.instance] 2025-12-03 13:08:10.698004 | controller | 2025-12-03 13:08:10.698033 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2025-12-03 13:08:10.698041 | controller | Wednesday 03 December 2025 13:08:09 +0000 (0:00:01.643) 0:02:40.945 **** 2025-12-03 13:08:10.698051 | controller | changed: [instance -> controller-0.instance] 2025-12-03 13:08:10.737399 | controller | 2025-12-03 13:08:10.737428 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-03 13:08:10.737436 | controller | Wednesday 03 December 2025 13:08:10 +0000 (0:00:01.145) 0:02:42.090 **** 2025-12-03 13:08:10.737450 | controller | 2025-12-03 13:08:10.948052 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-12-03 13:08:10.948098 | controller | Wednesday 03 December 2025 13:08:10 +0000 (0:00:00.039) 0:02:42.130 **** 2025-12-03 13:08:10.948114 | controller | ok: [instance] 2025-12-03 13:08:10.973877 | controller | 2025-12-03 13:08:10.973898 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-12-03 13:08:10.973906 | controller | Wednesday 03 December 2025 13:08:10 +0000 (0:00:00.210) 0:02:42.340 **** 2025-12-03 13:08:10.973916 | controller | ok: [instance] 2025-12-03 13:08:11.002245 | controller | 2025-12-03 13:08:11.002266 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-12-03 13:08:11.002274 | controller | Wednesday 03 December 2025 13:08:10 +0000 (0:00:00.025) 0:02:42.366 **** 2025-12-03 13:08:11.002284 | controller | skipping: [instance] 2025-12-03 13:08:11.048571 | controller | 2025-12-03 13:08:11.048602 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2025-12-03 13:08:11.048617 | controller | Wednesday 03 December 2025 13:08:10 +0000 (0:00:00.028) 0:02:42.395 **** 2025-12-03 13:08:11.048628 | controller | 2025-12-03 13:08:11.048645 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-03 13:08:11.048652 | controller | Wednesday 03 December 2025 13:08:11 +0000 (0:00:00.046) 0:02:42.441 **** 2025-12-03 13:08:11.135278 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2025-12-03 13:08:11.354939 | controller | 2025-12-03 13:08:11.354978 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-03 13:08:11.354991 | controller | Wednesday 03 December 2025 13:08:11 +0000 (0:00:00.086) 0:02:42.527 **** 2025-12-03 13:08:11.355010 | controller | ok: [instance] 2025-12-03 13:08:11.570321 | controller | 2025-12-03 13:08:11.570366 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-03 13:08:11.570375 | controller | Wednesday 03 December 2025 13:08:11 +0000 (0:00:00.216) 0:02:42.744 **** 2025-12-03 13:08:11.570395 | controller | ok: [instance] 2025-12-03 13:08:11.570510 | controller | 2025-12-03 13:08:11.570521 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2025-12-03 13:08:11.570614 | controller | Wednesday 03 December 2025 13:08:11 +0000 (0:00:00.219) 0:02:42.963 **** 2025-12-03 13:08:11.984484 | controller | changed: [instance] 2025-12-03 13:08:11.984586 | controller | 2025-12-03 13:08:11.984707 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2025-12-03 13:08:11.984804 | controller | Wednesday 03 December 2025 13:08:11 +0000 (0:00:00.413) 0:02:43.376 **** 2025-12-03 13:08:12.954458 | controller | changed: [instance] 2025-12-03 13:08:12.954505 | controller | 2025-12-03 13:08:12.954627 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-03 13:08:12.954731 | controller | Wednesday 03 December 2025 13:08:12 +0000 (0:00:00.970) 0:02:44.347 **** 2025-12-03 13:08:12.982953 | controller | skipping: [instance] 2025-12-03 13:08:12.983042 | controller | 2025-12-03 13:08:12.983171 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2025-12-03 13:08:12.983281 | controller | Wednesday 03 December 2025 13:08:12 +0000 (0:00:00.028) 0:02:44.376 **** 2025-12-03 13:08:13.031057 | controller | skipping: [instance] 2025-12-03 13:08:13.031193 | controller | 2025-12-03 13:08:13.031286 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2025-12-03 13:08:13.031396 | controller | Wednesday 03 December 2025 13:08:13 +0000 (0:00:00.048) 0:02:44.424 **** 2025-12-03 13:08:13.076249 | controller | skipping: [instance] 2025-12-03 13:08:13.130345 | controller | 2025-12-03 13:08:13.130365 | controller | TASK [Create VBMC entity] ****************************************************** 2025-12-03 13:08:13.130373 | controller | Wednesday 03 December 2025 13:08:13 +0000 (0:00:00.044) 0:02:44.468 **** 2025-12-03 13:08:13.130400 | controller | skipping: [instance] => (item=compute-0) 2025-12-03 13:08:13.130419 | controller | skipping: [instance] => (item=controller-0) 2025-12-03 13:08:13.130425 | controller | skipping: [instance] => (item=crc-0) 2025-12-03 13:08:13.130430 | controller | skipping: [instance] 2025-12-03 13:08:13.130436 | controller | 2025-12-03 13:08:13.130443 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2025-12-03 13:08:13.130559 | controller | Wednesday 03 December 2025 13:08:13 +0000 (0:00:00.054) 0:02:44.523 **** 2025-12-03 13:08:13.377404 | controller | ok: [instance] 2025-12-03 13:08:13.377537 | controller | 2025-12-03 13:08:13.377664 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2025-12-03 13:08:13.377783 | controller | Wednesday 03 December 2025 13:08:13 +0000 (0:00:00.247) 0:02:44.770 **** 2025-12-03 13:08:13.751610 | controller | changed: [instance] 2025-12-03 13:08:13.751798 | controller | 2025-12-03 13:08:13.751950 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2025-12-03 13:08:13.752120 | controller | Wednesday 03 December 2025 13:08:13 +0000 (0:00:00.374) 0:02:45.144 **** 2025-12-03 13:08:13.790218 | controller | skipping: [instance] 2025-12-03 13:08:13.790385 | controller | 2025-12-03 13:08:13.790565 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2025-12-03 13:08:13.790702 | controller | Wednesday 03 December 2025 13:08:13 +0000 (0:00:00.038) 0:02:45.183 **** 2025-12-03 13:08:13.825729 | controller | skipping: [instance] 2025-12-03 13:08:13.825892 | controller | 2025-12-03 13:08:13.826052 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2025-12-03 13:08:13.826214 | controller | Wednesday 03 December 2025 13:08:13 +0000 (0:00:00.035) 0:02:45.218 **** 2025-12-03 13:08:13.859201 | controller | skipping: [instance] 2025-12-03 13:08:13.859367 | controller | 2025-12-03 13:08:13.859524 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2025-12-03 13:08:13.859682 | controller | Wednesday 03 December 2025 13:08:13 +0000 (0:00:00.033) 0:02:45.252 **** 2025-12-03 13:08:14.689560 | controller | changed: [instance] 2025-12-03 13:08:14.689759 | controller | 2025-12-03 13:08:14.689912 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2025-12-03 13:08:14.690053 | controller | Wednesday 03 December 2025 13:08:14 +0000 (0:00:00.829) 0:02:46.082 **** 2025-12-03 13:08:15.405167 | controller | changed: [instance] 2025-12-03 13:08:15.405211 | controller | 2025-12-03 13:08:15.405306 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2025-12-03 13:08:15.405418 | controller | Wednesday 03 December 2025 13:08:15 +0000 (0:00:00.714) 0:02:46.797 **** 2025-12-03 13:08:15.450727 | controller | skipping: [instance] 2025-12-03 13:08:15.451059 | controller | 2025-12-03 13:08:15.520218 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2025-12-03 13:08:15.520259 | controller | Wednesday 03 December 2025 13:08:15 +0000 (0:00:00.046) 0:02:46.843 **** 2025-12-03 13:08:15.520273 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2025-12-03 13:08:15.520304 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2025-12-03 13:08:15.520313 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2025-12-03 13:08:15.520320 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2025-12-03 13:08:15.520326 | controller | 2025-12-03 13:08:15.520335 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2025-12-03 13:08:15.520647 | controller | Wednesday 03 December 2025 13:08:15 +0000 (0:00:00.068) 0:02:46.912 **** 2025-12-03 13:08:15.572600 | controller | skipping: [instance] 2025-12-03 13:08:15.572666 | controller | 2025-12-03 13:08:15.572781 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2025-12-03 13:08:15.572884 | controller | Wednesday 03 December 2025 13:08:15 +0000 (0:00:00.052) 0:02:46.965 **** 2025-12-03 13:08:15.613776 | controller | skipping: [instance] 2025-12-03 13:08:15.613854 | controller | 2025-12-03 13:08:15.614454 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2025-12-03 13:08:15.655990 | controller | Wednesday 03 December 2025 13:08:15 +0000 (0:00:00.041) 0:02:47.006 **** 2025-12-03 13:08:15.656012 | controller | skipping: [instance] 2025-12-03 13:08:15.699338 | controller | 2025-12-03 13:08:15.699408 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2025-12-03 13:08:15.699419 | controller | Wednesday 03 December 2025 13:08:15 +0000 (0:00:00.041) 0:02:47.048 **** 2025-12-03 13:08:15.699433 | controller | skipping: [instance] 2025-12-03 13:08:15.699459 | controller | 2025-12-03 13:08:15.699599 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2025-12-03 13:08:15.699624 | controller | Wednesday 03 December 2025 13:08:15 +0000 (0:00:00.043) 0:02:47.092 **** 2025-12-03 13:08:16.326361 | controller | changed: [instance] 2025-12-03 13:08:16.326500 | controller | 2025-12-03 13:08:16.326517 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2025-12-03 13:08:16.326678 | controller | Wednesday 03 December 2025 13:08:16 +0000 (0:00:00.626) 0:02:47.718 **** 2025-12-03 13:08:16.359791 | controller | skipping: [instance] 2025-12-03 13:08:16.392729 | controller | 2025-12-03 13:08:16.392754 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2025-12-03 13:08:16.392762 | controller | Wednesday 03 December 2025 13:08:16 +0000 (0:00:00.033) 0:02:47.752 **** 2025-12-03 13:08:16.392772 | controller | skipping: [instance] 2025-12-03 13:08:16.425390 | controller | 2025-12-03 13:08:16.425496 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2025-12-03 13:08:16.425508 | controller | Wednesday 03 December 2025 13:08:16 +0000 (0:00:00.032) 0:02:47.785 **** 2025-12-03 13:08:16.425544 | controller | skipping: [instance] 2025-12-03 13:08:16.425617 | controller | 2025-12-03 13:08:16.425647 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-12-03 13:08:16.425662 | controller | Wednesday 03 December 2025 13:08:16 +0000 (0:00:00.032) 0:02:47.818 **** 2025-12-03 13:08:16.461859 | controller | skipping: [instance] 2025-12-03 13:08:16.461913 | controller | 2025-12-03 13:08:16.461925 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-12-03 13:08:16.462012 | controller | Wednesday 03 December 2025 13:08:16 +0000 (0:00:00.036) 0:02:47.854 **** 2025-12-03 13:08:16.498328 | controller | skipping: [instance] 2025-12-03 13:08:16.538174 | controller | 2025-12-03 13:08:16.538251 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-12-03 13:08:16.538262 | controller | Wednesday 03 December 2025 13:08:16 +0000 (0:00:00.036) 0:02:47.891 **** 2025-12-03 13:08:16.538275 | controller | skipping: [instance] 2025-12-03 13:08:16.538511 | controller | 2025-12-03 13:08:16.538683 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-12-03 13:08:16.538836 | controller | Wednesday 03 December 2025 13:08:16 +0000 (0:00:00.039) 0:02:47.930 **** 2025-12-03 13:08:16.573630 | controller | skipping: [instance] 2025-12-03 13:08:16.573817 | controller | 2025-12-03 13:08:16.573989 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-12-03 13:08:16.574202 | controller | Wednesday 03 December 2025 13:08:16 +0000 (0:00:00.036) 0:02:47.966 **** 2025-12-03 13:08:16.617733 | controller | skipping: [instance] 2025-12-03 13:08:16.617923 | controller | 2025-12-03 13:08:16.618140 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-12-03 13:08:16.618329 | controller | Wednesday 03 December 2025 13:08:16 +0000 (0:00:00.044) 0:02:48.010 **** 2025-12-03 13:08:16.654350 | controller | skipping: [instance] 2025-12-03 13:08:16.654495 | controller | 2025-12-03 13:08:16.654546 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-12-03 13:08:16.654694 | controller | Wednesday 03 December 2025 13:08:16 +0000 (0:00:00.036) 0:02:48.047 **** 2025-12-03 13:08:16.705927 | controller | skipping: [instance] 2025-12-03 13:08:16.706141 | controller | 2025-12-03 13:08:16.706309 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2025-12-03 13:08:16.706475 | controller | Wednesday 03 December 2025 13:08:16 +0000 (0:00:00.051) 0:02:48.098 **** 2025-12-03 13:08:16.744217 | controller | skipping: [instance] 2025-12-03 13:08:16.744383 | controller | 2025-12-03 13:08:16.744545 | controller | TASK [reproducer : Configure Controller node] ********************************** 2025-12-03 13:08:16.744690 | controller | Wednesday 03 December 2025 13:08:16 +0000 (0:00:00.038) 0:02:48.137 **** 2025-12-03 13:08:16.916007 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2025-12-03 13:08:16.916229 | controller | 2025-12-03 13:08:16.916382 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-12-03 13:08:16.916536 | controller | Wednesday 03 December 2025 13:08:16 +0000 (0:00:00.171) 0:02:48.308 **** 2025-12-03 13:08:18.425784 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-12-03 13:08:18.425835 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-12-03 13:08:18.425843 | controller | 2025-12-03 13:08:18.425850 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-12-03 13:08:18.425859 | controller | Wednesday 03 December 2025 13:08:18 +0000 (0:00:01.509) 0:02:49.818 **** 2025-12-03 13:08:18.446344 | controller | skipping: [instance] 2025-12-03 13:08:18.446380 | controller | 2025-12-03 13:08:18.446389 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-03 13:08:18.446398 | controller | Wednesday 03 December 2025 13:08:18 +0000 (0:00:00.021) 0:02:49.839 **** 2025-12-03 13:08:19.128928 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:08:19.174681 | controller | 2025-12-03 13:08:19.174720 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-03 13:08:19.174735 | controller | Wednesday 03 December 2025 13:08:19 +0000 (0:00:00.681) 0:02:50.520 **** 2025-12-03 13:08:19.174748 | controller | skipping: [instance] 2025-12-03 13:08:19.219294 | controller | 2025-12-03 13:08:19.219321 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-03 13:08:19.219329 | controller | Wednesday 03 December 2025 13:08:19 +0000 (0:00:00.046) 0:02:50.567 **** 2025-12-03 13:08:19.219338 | controller | skipping: [instance] 2025-12-03 13:08:19.264542 | controller | 2025-12-03 13:08:19.264567 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-03 13:08:19.264575 | controller | Wednesday 03 December 2025 13:08:19 +0000 (0:00:00.044) 0:02:50.611 **** 2025-12-03 13:08:19.264585 | controller | skipping: [instance] 2025-12-03 13:08:19.264817 | controller | 2025-12-03 13:08:19.264833 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-03 13:08:20.941098 | controller | Wednesday 03 December 2025 13:08:19 +0000 (0:00:00.045) 0:02:50.657 **** 2025-12-03 13:08:20.941145 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:08:20.941570 | controller | 2025-12-03 13:08:20.987923 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2025-12-03 13:08:20.988009 | controller | Wednesday 03 December 2025 13:08:20 +0000 (0:00:01.676) 0:02:52.333 **** 2025-12-03 13:08:20.988029 | controller | skipping: [instance] 2025-12-03 13:08:21.029191 | controller | 2025-12-03 13:08:21.029235 | controller | TASK [reproducer : Install repos] ********************************************** 2025-12-03 13:08:21.029245 | controller | Wednesday 03 December 2025 13:08:20 +0000 (0:00:00.046) 0:02:52.379 **** 2025-12-03 13:08:21.029256 | controller | skipping: [instance] 2025-12-03 13:08:21.074237 | controller | 2025-12-03 13:08:21.074276 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2025-12-03 13:08:21.074286 | controller | Wednesday 03 December 2025 13:08:21 +0000 (0:00:00.041) 0:02:52.421 **** 2025-12-03 13:08:21.074298 | controller | skipping: [instance] 2025-12-03 13:08:21.117751 | controller | 2025-12-03 13:08:21.117771 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2025-12-03 13:08:21.117779 | controller | Wednesday 03 December 2025 13:08:21 +0000 (0:00:00.045) 0:02:52.466 **** 2025-12-03 13:08:21.117788 | controller | skipping: [instance] 2025-12-03 13:08:22.284107 | controller | 2025-12-03 13:08:22.284141 | controller | TASK [reproducer : Install some tools] ***************************************** 2025-12-03 13:08:22.284149 | controller | Wednesday 03 December 2025 13:08:21 +0000 (0:00:00.043) 0:02:52.510 **** 2025-12-03 13:08:22.284159 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:08:23.414701 | controller | 2025-12-03 13:08:23.414733 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2025-12-03 13:08:23.414741 | controller | Wednesday 03 December 2025 13:08:22 +0000 (0:00:01.166) 0:02:53.676 **** 2025-12-03 13:08:23.414751 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:08:24.089951 | controller | 2025-12-03 13:08:24.089984 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2025-12-03 13:08:24.089992 | controller | Wednesday 03 December 2025 13:08:23 +0000 (0:00:01.130) 0:02:54.807 **** 2025-12-03 13:08:24.090002 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:08:24.090024 | controller | 2025-12-03 13:08:24.090033 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2025-12-03 13:08:24.090189 | controller | Wednesday 03 December 2025 13:08:24 +0000 (0:00:00.675) 0:02:55.482 **** 2025-12-03 13:08:25.150755 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:08:26.213106 | controller | 2025-12-03 13:08:26.213138 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2025-12-03 13:08:26.213146 | controller | Wednesday 03 December 2025 13:08:25 +0000 (0:00:01.060) 0:02:56.543 **** 2025-12-03 13:08:26.213156 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-12-03 13:08:26.895963 | controller | skipping: [instance] => (item=compute-0) 2025-12-03 13:08:26.895995 | controller | skipping: [instance] => (item=controller-0) 2025-12-03 13:08:26.896008 | controller | skipping: [instance] => (item=crc-0) 2025-12-03 13:08:26.896014 | controller | 2025-12-03 13:08:26.896020 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2025-12-03 13:08:26.896026 | controller | Wednesday 03 December 2025 13:08:26 +0000 (0:00:01.062) 0:02:57.605 **** 2025-12-03 13:08:26.896036 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-12-03 13:08:26.896189 | controller | skipping: [instance] => (item=compute-0) 2025-12-03 13:08:26.896210 | controller | skipping: [instance] => (item=controller-0) 2025-12-03 13:08:26.896220 | controller | skipping: [instance] => (item=crc-0) 2025-12-03 13:08:26.896287 | controller | 2025-12-03 13:08:26.896463 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2025-12-03 13:08:28.743273 | controller | Wednesday 03 December 2025 13:08:26 +0000 (0:00:00.683) 0:02:58.288 **** 2025-12-03 13:08:28.743338 | controller | skipping: [instance] => (item=instance) 2025-12-03 13:08:29.342231 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2025-12-03 13:08:29.342265 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-12-03 13:08:29.342272 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2025-12-03 13:08:29.342278 | controller | 2025-12-03 13:08:29.342284 | controller | TASK [reproducer : Create kube directory] ************************************** 2025-12-03 13:08:29.342289 | controller | Wednesday 03 December 2025 13:08:28 +0000 (0:00:01.846) 0:03:00.134 **** 2025-12-03 13:08:29.342299 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:08:29.342324 | controller | 2025-12-03 13:08:29.342332 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2025-12-03 13:08:29.342355 | controller | Wednesday 03 December 2025 13:08:29 +0000 (0:00:00.599) 0:03:00.734 **** 2025-12-03 13:08:30.340190 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:08:30.340526 | controller | 2025-12-03 13:08:31.328351 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2025-12-03 13:08:31.328383 | controller | Wednesday 03 December 2025 13:08:30 +0000 (0:00:00.999) 0:03:01.733 **** 2025-12-03 13:08:31.328395 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:08:31.361905 | controller | 2025-12-03 13:08:31.361938 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2025-12-03 13:08:31.361948 | controller | Wednesday 03 December 2025 13:08:31 +0000 (0:00:00.986) 0:03:02.720 **** 2025-12-03 13:08:31.361964 | controller | skipping: [instance] 2025-12-03 13:08:31.946518 | controller | 2025-12-03 13:08:31.946552 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2025-12-03 13:08:31.946560 | controller | Wednesday 03 December 2025 13:08:31 +0000 (0:00:00.034) 0:03:02.754 **** 2025-12-03 13:08:31.946569 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:08:32.554521 | controller | 2025-12-03 13:08:32.554558 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2025-12-03 13:08:32.554567 | controller | Wednesday 03 December 2025 13:08:31 +0000 (0:00:00.583) 0:03:03.337 **** 2025-12-03 13:08:32.554577 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:08:32.593755 | controller | 2025-12-03 13:08:32.593779 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2025-12-03 13:08:32.593786 | controller | Wednesday 03 December 2025 13:08:32 +0000 (0:00:00.608) 0:03:03.946 **** 2025-12-03 13:08:32.593796 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:08:32.659701 | controller | 2025-12-03 13:08:32.659723 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2025-12-03 13:08:32.659730 | controller | Wednesday 03 December 2025 13:08:32 +0000 (0:00:00.039) 0:03:03.985 **** 2025-12-03 13:08:32.659740 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2025-12-03 13:08:32.660055 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2025-12-03 13:08:32.660069 | controller | 2025-12-03 13:08:32.711829 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-12-03 13:08:32.711847 | controller | Wednesday 03 December 2025 13:08:32 +0000 (0:00:00.064) 0:03:04.050 **** 2025-12-03 13:08:32.711863 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 13:08:32.757790 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2025-12-03 13:08:32.757809 | controller | 2025-12-03 13:08:32.757817 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-12-03 13:08:32.757823 | controller | Wednesday 03 December 2025 13:08:32 +0000 (0:00:00.054) 0:03:04.104 **** 2025-12-03 13:08:32.757831 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 13:08:32.803050 | controller | _secret_file: '' 2025-12-03 13:08:32.803068 | controller | 2025-12-03 13:08:32.803104 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-12-03 13:08:32.803114 | controller | Wednesday 03 December 2025 13:08:32 +0000 (0:00:00.046) 0:03:04.150 **** 2025-12-03 13:08:32.803123 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 13:08:32.848699 | controller | _secret_content: my-default-location-place 2025-12-03 13:08:32.848722 | controller | 2025-12-03 13:08:32.848730 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-12-03 13:08:32.848738 | controller | Wednesday 03 December 2025 13:08:32 +0000 (0:00:00.045) 0:03:04.195 **** 2025-12-03 13:08:32.848748 | controller | skipping: [instance] 2025-12-03 13:08:32.848912 | controller | 2025-12-03 13:08:32.849059 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-12-03 13:08:32.849232 | controller | Wednesday 03 December 2025 13:08:32 +0000 (0:00:00.046) 0:03:04.241 **** 2025-12-03 13:08:32.898894 | controller | skipping: [instance] 2025-12-03 13:08:32.899055 | controller | 2025-12-03 13:08:32.899221 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-12-03 13:08:32.899365 | controller | Wednesday 03 December 2025 13:08:32 +0000 (0:00:00.049) 0:03:04.290 **** 2025-12-03 13:08:32.944576 | controller | skipping: [instance] 2025-12-03 13:08:32.944760 | controller | 2025-12-03 13:08:32.944954 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-12-03 13:08:32.945146 | controller | Wednesday 03 December 2025 13:08:32 +0000 (0:00:00.046) 0:03:04.337 **** 2025-12-03 13:08:33.898629 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:08:33.954240 | controller | 2025-12-03 13:08:33.954259 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-12-03 13:08:33.954268 | controller | Wednesday 03 December 2025 13:08:33 +0000 (0:00:00.950) 0:03:05.288 **** 2025-12-03 13:08:33.954277 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 13:08:34.007075 | controller | _secret_dest: /home/zuul/ipmi-things 2025-12-03 13:08:34.007110 | controller | 2025-12-03 13:08:34.007118 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-12-03 13:08:34.007124 | controller | Wednesday 03 December 2025 13:08:33 +0000 (0:00:00.057) 0:03:05.346 **** 2025-12-03 13:08:34.007133 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 13:08:34.056161 | controller | _secret_file: /tmp/ipmi-things 2025-12-03 13:08:34.056186 | controller | 2025-12-03 13:08:34.056196 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-12-03 13:08:34.056204 | controller | Wednesday 03 December 2025 13:08:34 +0000 (0:00:00.053) 0:03:05.399 **** 2025-12-03 13:08:34.056216 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-03 13:08:34.116654 | controller | _secret_content: '' 2025-12-03 13:08:34.116675 | controller | 2025-12-03 13:08:34.116682 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-12-03 13:08:34.116688 | controller | Wednesday 03 December 2025 13:08:34 +0000 (0:00:00.049) 0:03:05.448 **** 2025-12-03 13:08:34.116706 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2025-12-03 13:08:34.683147 | controller | msg: All assertions passed 2025-12-03 13:08:34.683203 | controller | 2025-12-03 13:08:34.683212 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-12-03 13:08:34.683225 | controller | Wednesday 03 December 2025 13:08:34 +0000 (0:00:00.060) 0:03:05.509 **** 2025-12-03 13:08:34.683238 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:08:35.696708 | controller | 2025-12-03 13:08:35.696738 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-12-03 13:08:35.696746 | controller | Wednesday 03 December 2025 13:08:34 +0000 (0:00:00.565) 0:03:06.075 **** 2025-12-03 13:08:35.696756 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:08:35.749057 | controller | 2025-12-03 13:08:35.749109 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-12-03 13:08:35.749121 | controller | Wednesday 03 December 2025 13:08:35 +0000 (0:00:01.014) 0:03:07.089 **** 2025-12-03 13:08:35.749132 | controller | skipping: [instance] 2025-12-03 13:08:36.305942 | controller | 2025-12-03 13:08:36.306012 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2025-12-03 13:08:36.306022 | controller | Wednesday 03 December 2025 13:08:35 +0000 (0:00:00.052) 0:03:07.141 **** 2025-12-03 13:08:36.306036 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:08:36.895973 | controller | 2025-12-03 13:08:36.896020 | controller | TASK [reproducer : Check if async file is still available] ********************* 2025-12-03 13:08:36.896028 | controller | Wednesday 03 December 2025 13:08:36 +0000 (0:00:00.556) 0:03:07.697 **** 2025-12-03 13:08:36.896041 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:09:49.316857 | controller | 2025-12-03 13:09:49.316891 | controller | TASK [reproducer : Check package install status] ******************************* 2025-12-03 13:09:49.316899 | controller | Wednesday 03 December 2025 13:08:36 +0000 (0:00:00.590) 0:03:08.288 **** 2025-12-03 13:09:49.316910 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2025-12-03 13:09:49.916852 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2025-12-03 13:09:49.916881 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2025-12-03 13:09:49.916888 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2025-12-03 13:09:49.916894 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2025-12-03 13:09:49.916899 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2025-12-03 13:09:49.916905 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2025-12-03 13:09:49.916910 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2025-12-03 13:09:49.916915 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). 2025-12-03 13:09:49.916921 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left). 2025-12-03 13:09:49.916926 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (90 retries left). 2025-12-03 13:09:49.916931 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (89 retries left). 2025-12-03 13:09:49.916936 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (88 retries left). 2025-12-03 13:09:49.916942 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:09:49.916948 | controller | 2025-12-03 13:09:49.916953 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2025-12-03 13:09:49.916959 | controller | Wednesday 03 December 2025 13:09:49 +0000 (0:01:12.419) 0:04:20.708 **** 2025-12-03 13:09:49.916968 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:09:52.742932 | controller | 2025-12-03 13:09:52.742962 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2025-12-03 13:09:52.742970 | controller | Wednesday 03 December 2025 13:09:49 +0000 (0:00:00.601) 0:04:21.309 **** 2025-12-03 13:09:52.742983 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:09:52.789896 | controller | 2025-12-03 13:09:52.789926 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2025-12-03 13:09:52.789934 | controller | Wednesday 03 December 2025 13:09:52 +0000 (0:00:02.825) 0:04:24.135 **** 2025-12-03 13:09:52.789943 | controller | skipping: [instance] 2025-12-03 13:09:52.842507 | controller | 2025-12-03 13:09:52.842534 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2025-12-03 13:09:52.842542 | controller | Wednesday 03 December 2025 13:09:52 +0000 (0:00:00.047) 0:04:24.182 **** 2025-12-03 13:09:52.842555 | controller | skipping: [instance] 2025-12-03 13:09:53.491233 | controller | 2025-12-03 13:09:53.491267 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2025-12-03 13:09:53.491276 | controller | Wednesday 03 December 2025 13:09:52 +0000 (0:00:00.052) 0:04:24.235 **** 2025-12-03 13:09:53.491287 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:09:53.491314 | controller | 2025-12-03 13:09:53.491320 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2025-12-03 13:09:53.491327 | controller | Wednesday 03 December 2025 13:09:53 +0000 (0:00:00.648) 0:04:24.883 **** 2025-12-03 13:09:54.078177 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:09:54.078545 | controller | 2025-12-03 13:09:54.387450 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2025-12-03 13:09:54.387482 | controller | Wednesday 03 December 2025 13:09:54 +0000 (0:00:00.587) 0:04:25.471 **** 2025-12-03 13:09:54.387494 | controller | changed: [instance] 2025-12-03 13:09:54.387662 | controller | 2025-12-03 13:09:54.387686 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2025-12-03 13:09:54.387695 | controller | Wednesday 03 December 2025 13:09:54 +0000 (0:00:00.308) 0:04:25.779 **** 2025-12-03 13:09:55.018001 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:09:56.061148 | controller | 2025-12-03 13:09:56.061178 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2025-12-03 13:09:56.061186 | controller | Wednesday 03 December 2025 13:09:55 +0000 (0:00:00.630) 0:04:26.410 **** 2025-12-03 13:09:56.061196 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:09:56.061517 | controller | 2025-12-03 13:09:56.107131 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-03 13:09:56.107152 | controller | Wednesday 03 December 2025 13:09:56 +0000 (0:00:01.044) 0:04:27.454 **** 2025-12-03 13:09:56.107163 | controller | skipping: [instance] 2025-12-03 13:09:56.107470 | controller | 2025-12-03 13:09:56.150713 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-03 13:09:56.150733 | controller | Wednesday 03 December 2025 13:09:56 +0000 (0:00:00.046) 0:04:27.500 **** 2025-12-03 13:09:56.150743 | controller | skipping: [instance] 2025-12-03 13:09:56.151066 | controller | 2025-12-03 13:09:56.188237 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-03 13:09:56.188256 | controller | Wednesday 03 December 2025 13:09:56 +0000 (0:00:00.043) 0:04:27.543 **** 2025-12-03 13:09:56.188267 | controller | skipping: [instance] 2025-12-03 13:09:56.237999 | controller | 2025-12-03 13:09:56.238018 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2025-12-03 13:09:56.238025 | controller | Wednesday 03 December 2025 13:09:56 +0000 (0:00:00.037) 0:04:27.581 **** 2025-12-03 13:09:56.238034 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:09:56.279122 | controller | 2025-12-03 13:09:56.279141 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2025-12-03 13:09:56.279149 | controller | Wednesday 03 December 2025 13:09:56 +0000 (0:00:00.049) 0:04:27.630 **** 2025-12-03 13:09:56.279164 | controller | skipping: [instance] 2025-12-03 13:09:56.279326 | controller | 2025-12-03 13:09:56.279459 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2025-12-03 13:09:56.279479 | controller | Wednesday 03 December 2025 13:09:56 +0000 (0:00:00.040) 0:04:27.671 **** 2025-12-03 13:09:56.316467 | controller | skipping: [instance] 2025-12-03 13:09:56.352126 | controller | 2025-12-03 13:09:56.352145 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2025-12-03 13:09:56.352153 | controller | Wednesday 03 December 2025 13:09:56 +0000 (0:00:00.037) 0:04:27.709 **** 2025-12-03 13:09:56.352161 | controller | skipping: [instance] 2025-12-03 13:09:56.352326 | controller | 2025-12-03 13:09:56.352339 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2025-12-03 13:09:56.937680 | controller | Wednesday 03 December 2025 13:09:56 +0000 (0:00:00.035) 0:04:27.745 **** 2025-12-03 13:09:56.937716 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:09:57.042423 | controller | 2025-12-03 13:09:57.042454 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2025-12-03 13:09:57.042463 | controller | Wednesday 03 December 2025 13:09:56 +0000 (0:00:00.585) 0:04:28.330 **** 2025-12-03 13:09:57.042473 | controller | skipping: [instance] => (item=secret) 2025-12-03 13:09:58.064435 | controller | skipping: [instance] => (item=configmap) 2025-12-03 13:09:58.064465 | controller | skipping: [instance] => (item=pod) 2025-12-03 13:09:58.064472 | controller | skipping: [instance] => (item=service) 2025-12-03 13:09:58.064478 | controller | skipping: [instance] => (item=route) 2025-12-03 13:09:58.064484 | controller | skipping: [instance] 2025-12-03 13:09:58.064490 | controller | 2025-12-03 13:09:58.064495 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2025-12-03 13:09:58.064501 | controller | Wednesday 03 December 2025 13:09:57 +0000 (0:00:00.104) 0:04:28.434 **** 2025-12-03 13:09:58.064511 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:09:59.053561 | controller | 2025-12-03 13:09:59.053591 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2025-12-03 13:09:59.053599 | controller | Wednesday 03 December 2025 13:09:58 +0000 (0:00:01.022) 0:04:29.456 **** 2025-12-03 13:09:59.053609 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:09:59.090024 | controller | 2025-12-03 13:09:59.090043 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2025-12-03 13:09:59.090051 | controller | Wednesday 03 December 2025 13:09:59 +0000 (0:00:00.989) 0:04:30.446 **** 2025-12-03 13:09:59.090063 | controller | skipping: [instance] 2025-12-03 13:09:59.125133 | controller | 2025-12-03 13:09:59.125153 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2025-12-03 13:09:59.125161 | controller | Wednesday 03 December 2025 13:09:59 +0000 (0:00:00.036) 0:04:30.482 **** 2025-12-03 13:09:59.125169 | controller | skipping: [instance] 2025-12-03 13:09:59.125491 | controller | 2025-12-03 13:09:59.199552 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2025-12-03 13:09:59.199582 | controller | Wednesday 03 December 2025 13:09:59 +0000 (0:00:00.035) 0:04:30.518 **** 2025-12-03 13:09:59.199594 | controller | skipping: [instance] => (item=secret) 2025-12-03 13:09:59.235401 | controller | skipping: [instance] => (item=configmap) 2025-12-03 13:09:59.235420 | controller | skipping: [instance] => (item=service) 2025-12-03 13:09:59.235431 | controller | skipping: [instance] => (item=route) 2025-12-03 13:09:59.235437 | controller | skipping: [instance] 2025-12-03 13:09:59.235443 | controller | 2025-12-03 13:09:59.235449 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2025-12-03 13:09:59.235454 | controller | Wednesday 03 December 2025 13:09:59 +0000 (0:00:00.073) 0:04:30.591 **** 2025-12-03 13:09:59.235463 | controller | skipping: [instance] 2025-12-03 13:10:00.778519 | controller | 2025-12-03 13:10:00.778551 | controller | TASK [podman : Ensure podman is installed] ************************************* 2025-12-03 13:10:00.778559 | controller | Wednesday 03 December 2025 13:09:59 +0000 (0:00:00.036) 0:04:30.628 **** 2025-12-03 13:10:00.778574 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:01.531740 | controller | 2025-12-03 13:10:01.531770 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2025-12-03 13:10:01.531779 | controller | Wednesday 03 December 2025 13:10:00 +0000 (0:00:01.542) 0:04:32.170 **** 2025-12-03 13:10:01.531788 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:01.572469 | controller | 2025-12-03 13:10:01.572493 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2025-12-03 13:10:01.572502 | controller | Wednesday 03 December 2025 13:10:01 +0000 (0:00:00.753) 0:04:32.924 **** 2025-12-03 13:10:01.572511 | controller | skipping: [instance] 2025-12-03 13:10:01.608629 | controller | 2025-12-03 13:10:01.608663 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2025-12-03 13:10:01.608672 | controller | Wednesday 03 December 2025 13:10:01 +0000 (0:00:00.040) 0:04:32.965 **** 2025-12-03 13:10:01.608681 | controller | skipping: [instance] 2025-12-03 13:10:01.651329 | controller | 2025-12-03 13:10:01.651352 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2025-12-03 13:10:01.651360 | controller | Wednesday 03 December 2025 13:10:01 +0000 (0:00:00.036) 0:04:33.001 **** 2025-12-03 13:10:01.651369 | controller | skipping: [instance] 2025-12-03 13:10:12.200096 | controller | 2025-12-03 13:10:12.200350 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2025-12-03 13:10:12.200359 | controller | Wednesday 03 December 2025 13:10:01 +0000 (0:00:00.042) 0:04:33.044 **** 2025-12-03 13:10:12.200370 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:13.564203 | controller | 2025-12-03 13:10:13.564234 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2025-12-03 13:10:13.564242 | controller | Wednesday 03 December 2025 13:10:12 +0000 (0:00:10.548) 0:04:43.592 **** 2025-12-03 13:10:13.564252 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:14.757493 | controller | 2025-12-03 13:10:14.757524 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-12-03 13:10:14.757532 | controller | Wednesday 03 December 2025 13:10:13 +0000 (0:00:01.364) 0:04:44.956 **** 2025-12-03 13:10:14.757542 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-12-03 13:10:14.796475 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-12-03 13:10:14.796503 | controller | 2025-12-03 13:10:14.796511 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2025-12-03 13:10:14.796517 | controller | Wednesday 03 December 2025 13:10:14 +0000 (0:00:01.193) 0:04:46.149 **** 2025-12-03 13:10:14.796526 | controller | skipping: [instance] 2025-12-03 13:10:15.342366 | controller | 2025-12-03 13:10:15.342398 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2025-12-03 13:10:15.342406 | controller | Wednesday 03 December 2025 13:10:14 +0000 (0:00:00.039) 0:04:46.189 **** 2025-12-03 13:10:15.342416 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:15.379069 | controller | 2025-12-03 13:10:15.379110 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2025-12-03 13:10:15.379119 | controller | Wednesday 03 December 2025 13:10:15 +0000 (0:00:00.545) 0:04:46.734 **** 2025-12-03 13:10:15.379129 | controller | skipping: [instance] 2025-12-03 13:10:15.422547 | controller | 2025-12-03 13:10:15.422579 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2025-12-03 13:10:15.422592 | controller | Wednesday 03 December 2025 13:10:15 +0000 (0:00:00.036) 0:04:46.771 **** 2025-12-03 13:10:15.422619 | controller | skipping: [instance] 2025-12-03 13:10:15.464056 | controller | 2025-12-03 13:10:15.464076 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-12-03 13:10:15.464106 | controller | Wednesday 03 December 2025 13:10:15 +0000 (0:00:00.043) 0:04:46.815 **** 2025-12-03 13:10:15.464116 | controller | skipping: [instance] 2025-12-03 13:10:15.507619 | controller | 2025-12-03 13:10:15.507645 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-12-03 13:10:15.507666 | controller | Wednesday 03 December 2025 13:10:15 +0000 (0:00:00.041) 0:04:46.856 **** 2025-12-03 13:10:15.507679 | controller | skipping: [instance] 2025-12-03 13:10:15.507856 | controller | 2025-12-03 13:10:15.508031 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2025-12-03 13:10:15.508194 | controller | Wednesday 03 December 2025 13:10:15 +0000 (0:00:00.039) 0:04:46.896 **** 2025-12-03 13:10:15.636334 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': 'd14e4d0a-012f-4a28-a2ab-d13e01eefa77'}) 2025-12-03 13:10:16.709396 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '09902da2-b52e-4606-9cf8-76244f7e0c23'}) 2025-12-03 13:10:16.709427 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': 'bbf58764-14cd-496d-8efd-2b8b248f90db'}) 2025-12-03 13:10:16.709435 | controller | 2025-12-03 13:10:16.709441 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2025-12-03 13:10:16.709447 | controller | Wednesday 03 December 2025 13:10:15 +0000 (0:00:00.132) 0:04:47.028 **** 2025-12-03 13:10:16.709456 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:16.745461 | controller | 2025-12-03 13:10:16.745484 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2025-12-03 13:10:16.745492 | controller | Wednesday 03 December 2025 13:10:16 +0000 (0:00:01.073) 0:04:48.102 **** 2025-12-03 13:10:16.745501 | controller | skipping: [instance] 2025-12-03 13:10:16.934137 | controller | 2025-12-03 13:10:16.934173 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2025-12-03 13:10:16.934182 | controller | Wednesday 03 December 2025 13:10:16 +0000 (0:00:00.036) 0:04:48.138 **** 2025-12-03 13:10:16.934193 | controller | 2025-12-03 13:10:16.989214 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2025-12-03 13:10:16.989239 | controller | Wednesday 03 December 2025 13:10:16 +0000 (0:00:00.188) 0:04:48.326 **** 2025-12-03 13:10:16.989251 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:17.033145 | controller | 2025-12-03 13:10:17.033170 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-12-03 13:10:17.033179 | controller | Wednesday 03 December 2025 13:10:16 +0000 (0:00:00.055) 0:04:48.382 **** 2025-12-03 13:10:17.033188 | controller | skipping: [instance] 2025-12-03 13:10:17.070728 | controller | 2025-12-03 13:10:17.070753 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-12-03 13:10:17.070761 | controller | Wednesday 03 December 2025 13:10:17 +0000 (0:00:00.043) 0:04:48.426 **** 2025-12-03 13:10:17.070771 | controller | skipping: [instance] 2025-12-03 13:10:18.341121 | controller | 2025-12-03 13:10:18.341155 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2025-12-03 13:10:18.341163 | controller | Wednesday 03 December 2025 13:10:17 +0000 (0:00:00.037) 0:04:48.463 **** 2025-12-03 13:10:18.341173 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:23.061232 | controller | 2025-12-03 13:10:23.061282 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2025-12-03 13:10:23.061294 | controller | Wednesday 03 December 2025 13:10:18 +0000 (0:00:01.270) 0:04:49.733 **** 2025-12-03 13:10:23.061309 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=d14e4d0a-012f-4a28-a2ab-d13e01eefa77) 2025-12-03 13:10:23.061335 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=09902da2-b52e-4606-9cf8-76244f7e0c23) 2025-12-03 13:10:23.061975 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=bbf58764-14cd-496d-8efd-2b8b248f90db) 2025-12-03 13:10:23.160855 | controller | 2025-12-03 13:10:23.160880 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2025-12-03 13:10:23.160888 | controller | Wednesday 03 December 2025 13:10:23 +0000 (0:00:04.720) 0:04:54.454 **** 2025-12-03 13:10:23.160905 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2025-12-03 13:10:23.161004 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2025-12-03 13:10:23.161296 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2025-12-03 13:10:23.161442 | controller | 2025-12-03 13:10:23.161569 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2025-12-03 13:10:23.161683 | controller | Wednesday 03 December 2025 13:10:23 +0000 (0:00:00.099) 0:04:54.553 **** 2025-12-03 13:10:23.368341 | controller | ok: [instance -> localhost] 2025-12-03 13:10:23.368440 | controller | 2025-12-03 13:10:23.368552 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2025-12-03 13:10:23.368670 | controller | Wednesday 03 December 2025 13:10:23 +0000 (0:00:00.207) 0:04:54.761 **** 2025-12-03 13:10:25.269974 | controller | changed: [instance -> localhost] => (item=controller-0) 2025-12-03 13:10:25.270268 | controller | 2025-12-03 13:10:25.270664 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2025-12-03 13:10:25.873066 | controller | Wednesday 03 December 2025 13:10:25 +0000 (0:00:01.901) 0:04:56.662 **** 2025-12-03 13:10:25.873119 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:25.873412 | controller | 2025-12-03 13:10:25.873428 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2025-12-03 13:10:26.616242 | controller | Wednesday 03 December 2025 13:10:25 +0000 (0:00:00.602) 0:04:57.265 **** 2025-12-03 13:10:26.616281 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:27.753372 | controller | 2025-12-03 13:10:27.753406 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2025-12-03 13:10:27.753414 | controller | Wednesday 03 December 2025 13:10:26 +0000 (0:00:00.743) 0:04:58.008 **** 2025-12-03 13:10:27.753425 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:28.402104 | controller | 2025-12-03 13:10:28.402144 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2025-12-03 13:10:28.402153 | controller | Wednesday 03 December 2025 13:10:27 +0000 (0:00:01.137) 0:04:59.145 **** 2025-12-03 13:10:28.402163 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:29.448923 | controller | 2025-12-03 13:10:29.448961 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2025-12-03 13:10:29.448971 | controller | Wednesday 03 December 2025 13:10:28 +0000 (0:00:00.648) 0:04:59.794 **** 2025-12-03 13:10:29.448984 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:30.034420 | controller | 2025-12-03 13:10:30.034453 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2025-12-03 13:10:30.034461 | controller | Wednesday 03 December 2025 13:10:29 +0000 (0:00:01.046) 0:05:00.841 **** 2025-12-03 13:10:30.034471 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:30.602171 | controller | 2025-12-03 13:10:30.602205 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2025-12-03 13:10:30.602213 | controller | Wednesday 03 December 2025 13:10:30 +0000 (0:00:00.585) 0:05:01.427 **** 2025-12-03 13:10:30.602224 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:30.602243 | controller | 2025-12-03 13:10:30.602292 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2025-12-03 13:10:30.602393 | controller | Wednesday 03 December 2025 13:10:30 +0000 (0:00:00.567) 0:05:01.994 **** 2025-12-03 13:10:31.964754 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-12-03 13:10:31.998815 | controller | 2025-12-03 13:10:31.998840 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-03 13:10:31.998850 | controller | Wednesday 03 December 2025 13:10:31 +0000 (0:00:01.362) 0:05:03.357 **** 2025-12-03 13:10:31.998861 | controller | skipping: [instance] 2025-12-03 13:10:32.032572 | controller | 2025-12-03 13:10:32.032590 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-03 13:10:32.032603 | controller | Wednesday 03 December 2025 13:10:31 +0000 (0:00:00.034) 0:05:03.391 **** 2025-12-03 13:10:32.032612 | controller | skipping: [instance] 2025-12-03 13:10:32.068055 | controller | 2025-12-03 13:10:32.068073 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-03 13:10:32.068100 | controller | Wednesday 03 December 2025 13:10:32 +0000 (0:00:00.033) 0:05:03.425 **** 2025-12-03 13:10:32.068113 | controller | skipping: [instance] 2025-12-03 13:10:32.107064 | controller | 2025-12-03 13:10:32.107108 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-03 13:10:32.107121 | controller | Wednesday 03 December 2025 13:10:32 +0000 (0:00:00.035) 0:05:03.461 **** 2025-12-03 13:10:32.107132 | controller | skipping: [instance] 2025-12-03 13:10:32.143957 | controller | 2025-12-03 13:10:32.143975 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-03 13:10:32.143982 | controller | Wednesday 03 December 2025 13:10:32 +0000 (0:00:00.038) 0:05:03.499 **** 2025-12-03 13:10:32.143991 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:32.254613 | controller | 2025-12-03 13:10:32.254637 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-03 13:10:32.254644 | controller | Wednesday 03 December 2025 13:10:32 +0000 (0:00:00.036) 0:05:03.536 **** 2025-12-03 13:10:32.254660 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-12-03 13:10:32.304724 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2025-12-03 13:10:32.304743 | controller | 2025-12-03 13:10:32.304750 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-03 13:10:32.304756 | controller | Wednesday 03 December 2025 13:10:32 +0000 (0:00:00.110) 0:05:03.647 **** 2025-12-03 13:10:32.304769 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2025-12-03 13:10:35.444261 | controller | 2025-12-03 13:10:35.444311 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2025-12-03 13:10:35.444320 | controller | Wednesday 03 December 2025 13:10:32 +0000 (0:00:00.050) 0:05:03.697 **** 2025-12-03 13:10:35.444335 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-12-03 13:10:35.444355 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2025-12-03 13:10:35.444400 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-12-03 13:10:35.444559 | controller | 2025-12-03 13:10:35.444670 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2025-12-03 13:10:35.444781 | controller | Wednesday 03 December 2025 13:10:35 +0000 (0:00:03.139) 0:05:06.837 **** 2025-12-03 13:10:36.462780 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:37.069991 | controller | 2025-12-03 13:10:37.070022 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-03 13:10:37.070030 | controller | Wednesday 03 December 2025 13:10:36 +0000 (0:00:01.018) 0:05:07.855 **** 2025-12-03 13:10:37.070040 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:38.052153 | controller | 2025-12-03 13:10:38.052183 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-03 13:10:38.052196 | controller | Wednesday 03 December 2025 13:10:37 +0000 (0:00:00.606) 0:05:08.462 **** 2025-12-03 13:10:38.052206 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:38.150799 | controller | 2025-12-03 13:10:38.150820 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-03 13:10:38.150827 | controller | Wednesday 03 December 2025 13:10:38 +0000 (0:00:00.982) 0:05:09.444 **** 2025-12-03 13:10:38.150836 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:38.214965 | controller | 2025-12-03 13:10:38.214986 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-03 13:10:38.214994 | controller | Wednesday 03 December 2025 13:10:38 +0000 (0:00:00.098) 0:05:09.543 **** 2025-12-03 13:10:38.215004 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:39.244526 | controller | 2025-12-03 13:10:39.244571 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-03 13:10:39.244579 | controller | Wednesday 03 December 2025 13:10:38 +0000 (0:00:00.064) 0:05:09.607 **** 2025-12-03 13:10:39.244590 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:40.261399 | controller | 2025-12-03 13:10:40.261432 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2025-12-03 13:10:40.261440 | controller | Wednesday 03 December 2025 13:10:39 +0000 (0:00:01.029) 0:05:10.637 **** 2025-12-03 13:10:40.261451 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:46.292399 | controller | 2025-12-03 13:10:46.292470 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2025-12-03 13:10:46.292480 | controller | Wednesday 03 December 2025 13:10:40 +0000 (0:00:01.016) 0:05:11.653 **** 2025-12-03 13:10:46.292495 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2025-12-03 13:10:46.499151 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:46.499222 | controller | 2025-12-03 13:10:46.499231 | controller | TASK [Configure ntp service] *************************************************** 2025-12-03 13:10:46.499238 | controller | Wednesday 03 December 2025 13:10:46 +0000 (0:00:06.030) 0:05:17.684 **** 2025-12-03 13:10:46.499251 | controller | 2025-12-03 13:10:47.455532 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2025-12-03 13:10:47.455564 | controller | Wednesday 03 December 2025 13:10:46 +0000 (0:00:00.206) 0:05:17.891 **** 2025-12-03 13:10:47.455576 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:48.411951 | controller | 2025-12-03 13:10:48.411985 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2025-12-03 13:10:48.411993 | controller | Wednesday 03 December 2025 13:10:47 +0000 (0:00:00.956) 0:05:18.847 **** 2025-12-03 13:10:48.412003 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2025-12-03 13:10:49.327167 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2025-12-03 13:10:49.327198 | controller | 2025-12-03 13:10:49.327207 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2025-12-03 13:10:49.327213 | controller | Wednesday 03 December 2025 13:10:48 +0000 (0:00:00.956) 0:05:19.804 **** 2025-12-03 13:10:49.327223 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:49.327656 | controller | 2025-12-03 13:10:49.943719 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2025-12-03 13:10:49.943754 | controller | Wednesday 03 December 2025 13:10:49 +0000 (0:00:00.915) 0:05:20.720 **** 2025-12-03 13:10:49.943769 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:50.091197 | controller | 2025-12-03 13:10:50.091228 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2025-12-03 13:10:50.091238 | controller | Wednesday 03 December 2025 13:10:49 +0000 (0:00:00.616) 0:05:21.336 **** 2025-12-03 13:10:50.091251 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2025-12-03 13:10:50.528906 | controller | 2025-12-03 13:10:50.528940 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2025-12-03 13:10:50.528948 | controller | Wednesday 03 December 2025 13:10:50 +0000 (0:00:00.147) 0:05:21.483 **** 2025-12-03 13:10:50.528958 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:51.048722 | controller | 2025-12-03 13:10:51.048754 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2025-12-03 13:10:51.048762 | controller | Wednesday 03 December 2025 13:10:50 +0000 (0:00:00.437) 0:05:21.921 **** 2025-12-03 13:10:51.048772 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-12-03 13:10:51.673118 | controller | 2025-12-03 13:10:51.673151 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2025-12-03 13:10:51.673159 | controller | Wednesday 03 December 2025 13:10:51 +0000 (0:00:00.519) 0:05:22.441 **** 2025-12-03 13:10:51.673170 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-03 13:10:52.169399 | controller | 2025-12-03 13:10:52.169432 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2025-12-03 13:10:52.169440 | controller | Wednesday 03 December 2025 13:10:51 +0000 (0:00:00.624) 0:05:23.065 **** 2025-12-03 13:10:52.169454 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-03 13:10:52.221468 | controller | 2025-12-03 13:10:52.221492 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2025-12-03 13:10:52.221512 | controller | Wednesday 03 December 2025 13:10:52 +0000 (0:00:00.496) 0:05:23.562 **** 2025-12-03 13:10:52.221522 | controller | 2025-12-03 13:10:52.649028 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2025-12-03 13:10:52.649059 | controller | Wednesday 03 December 2025 13:10:52 +0000 (0:00:00.052) 0:05:23.614 **** 2025-12-03 13:10:52.649070 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-12-03 13:10:53.370091 | controller | 2025-12-03 13:10:53.370126 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2025-12-03 13:10:53.370134 | controller | Wednesday 03 December 2025 13:10:52 +0000 (0:00:00.427) 0:05:24.041 **** 2025-12-03 13:10:53.370144 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-03 13:10:53.398582 | controller | 2025-12-03 13:10:53.398608 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2025-12-03 13:10:53.398615 | controller | Wednesday 03 December 2025 13:10:53 +0000 (0:00:00.720) 0:05:24.762 **** 2025-12-03 13:10:53.398632 | controller | skipping: [instance] 2025-12-03 13:10:53.433587 | controller | 2025-12-03 13:10:53.433615 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2025-12-03 13:10:53.433624 | controller | Wednesday 03 December 2025 13:10:53 +0000 (0:00:00.028) 0:05:24.791 **** 2025-12-03 13:10:53.433636 | controller | skipping: [instance] 2025-12-03 13:10:53.652504 | controller | 2025-12-03 13:10:53.652535 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2025-12-03 13:10:53.652543 | controller | Wednesday 03 December 2025 13:10:53 +0000 (0:00:00.035) 0:05:24.826 **** 2025-12-03 13:10:53.652553 | controller | changed: [instance] 2025-12-03 13:10:53.725551 | controller | 2025-12-03 13:10:53.725579 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2025-12-03 13:10:53.725588 | controller | Wednesday 03 December 2025 13:10:53 +0000 (0:00:00.218) 0:05:25.045 **** 2025-12-03 13:10:53.725597 | controller | skipping: [instance] => (item=) 2025-12-03 13:10:53.757191 | controller | 2025-12-03 13:10:53.757220 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2025-12-03 13:10:53.757229 | controller | Wednesday 03 December 2025 13:10:53 +0000 (0:00:00.073) 0:05:25.118 **** 2025-12-03 13:10:53.757239 | controller | ok: [instance] 2025-12-03 13:10:53.830231 | controller | 2025-12-03 13:10:53.830254 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-03 13:10:53.830262 | controller | Wednesday 03 December 2025 13:10:53 +0000 (0:00:00.031) 0:05:25.149 **** 2025-12-03 13:10:53.830272 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-12-03 13:10:54.081109 | controller | 2025-12-03 13:10:54.081147 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-03 13:10:54.081155 | controller | Wednesday 03 December 2025 13:10:53 +0000 (0:00:00.073) 0:05:25.223 **** 2025-12-03 13:10:54.081165 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-12-03 13:10:54.130331 | controller | 2025-12-03 13:10:54.130357 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2025-12-03 13:10:54.130365 | controller | Wednesday 03 December 2025 13:10:54 +0000 (0:00:00.250) 0:05:25.473 **** 2025-12-03 13:10:54.130375 | controller | 2025-12-03 13:10:54.199433 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-03 13:10:54.199459 | controller | Wednesday 03 December 2025 13:10:54 +0000 (0:00:00.049) 0:05:25.523 **** 2025-12-03 13:10:54.199471 | controller | ok: [instance] 2025-12-03 13:10:54.256349 | controller | 2025-12-03 13:10:54.256380 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-03 13:10:54.256388 | controller | Wednesday 03 December 2025 13:10:54 +0000 (0:00:00.068) 0:05:25.591 **** 2025-12-03 13:10:54.256398 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-12-03 13:10:54.513890 | controller | 2025-12-03 13:10:54.513919 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-03 13:10:54.513927 | controller | Wednesday 03 December 2025 13:10:54 +0000 (0:00:00.057) 0:05:25.648 **** 2025-12-03 13:10:54.513937 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-12-03 13:10:54.514302 | controller | 2025-12-03 13:10:54.514419 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2025-12-03 13:10:54.514431 | controller | Wednesday 03 December 2025 13:10:54 +0000 (0:00:00.257) 0:05:25.906 **** 2025-12-03 13:10:54.932843 | controller | changed: [instance] 2025-12-03 13:10:55.606443 | controller | 2025-12-03 13:10:55.606475 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-12-03 13:10:55.606507 | controller | Wednesday 03 December 2025 13:10:54 +0000 (0:00:00.405) 0:05:26.312 **** 2025-12-03 13:10:55.606517 | controller | 2025-12-03 13:10:55.606524 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2025-12-03 13:10:55.606531 | controller | Wednesday 03 December 2025 13:10:54 +0000 (0:00:00.012) 0:05:26.324 **** 2025-12-03 13:10:55.606554 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:10:55.990151 | controller | 2025-12-03 13:10:55.990183 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-03 13:10:55.990191 | controller | Wednesday 03 December 2025 13:10:55 +0000 (0:00:00.674) 0:05:26.998 **** 2025-12-03 13:10:55.990202 | controller | changed: [instance] 2025-12-03 13:10:56.159360 | controller | 2025-12-03 13:10:56.159396 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2025-12-03 13:10:56.159404 | controller | Wednesday 03 December 2025 13:10:55 +0000 (0:00:00.383) 0:05:27.382 **** 2025-12-03 13:10:56.159414 | controller | skipping: [instance] => (item=controller-0) 2025-12-03 13:10:57.623190 | controller | skipping: [instance] => (item=crc-0) 2025-12-03 13:10:57.623230 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2025-12-03 13:10:57.623252 | controller | 2025-12-03 13:10:57.623259 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2025-12-03 13:10:57.623265 | controller | Wednesday 03 December 2025 13:10:56 +0000 (0:00:00.168) 0:05:27.551 **** 2025-12-03 13:10:57.623276 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-12-03 13:10:57.623404 | controller | 2025-12-03 13:10:57.623443 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-12-03 13:10:57.642325 | controller | Wednesday 03 December 2025 13:10:57 +0000 (0:00:01.464) 0:05:29.015 **** 2025-12-03 13:10:57.642359 | controller | skipping: [instance] 2025-12-03 13:10:57.642392 | controller | 2025-12-03 13:10:57.642535 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-03 13:10:57.642629 | controller | Wednesday 03 December 2025 13:10:57 +0000 (0:00:00.019) 0:05:29.035 **** 2025-12-03 13:10:58.123237 | controller | ok: [instance -> compute-0(compute-0.instance)] 2025-12-03 13:10:58.123356 | controller | 2025-12-03 13:10:58.123503 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-03 13:10:58.123628 | controller | Wednesday 03 December 2025 13:10:58 +0000 (0:00:00.480) 0:05:29.516 **** 2025-12-03 13:10:58.156295 | controller | skipping: [instance] 2025-12-03 13:10:58.156400 | controller | 2025-12-03 13:10:58.156515 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-03 13:10:58.156625 | controller | Wednesday 03 December 2025 13:10:58 +0000 (0:00:00.033) 0:05:29.549 **** 2025-12-03 13:10:58.189576 | controller | skipping: [instance] 2025-12-03 13:10:58.189733 | controller | 2025-12-03 13:10:58.189878 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-03 13:10:58.190012 | controller | Wednesday 03 December 2025 13:10:58 +0000 (0:00:00.033) 0:05:29.582 **** 2025-12-03 13:10:58.224374 | controller | skipping: [instance] 2025-12-03 13:10:58.224460 | controller | 2025-12-03 13:10:58.224583 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-03 13:10:58.224692 | controller | Wednesday 03 December 2025 13:10:58 +0000 (0:00:00.034) 0:05:29.617 **** 2025-12-03 13:10:59.695150 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-12-03 13:10:59.695341 | controller | 2025-12-03 13:10:59.695367 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2025-12-03 13:10:59.727992 | controller | Wednesday 03 December 2025 13:10:59 +0000 (0:00:01.470) 0:05:31.087 **** 2025-12-03 13:10:59.728026 | controller | skipping: [instance] 2025-12-03 13:10:59.748459 | controller | 2025-12-03 13:10:59.748492 | controller | TASK [reproducer : Create repositories on computes] **************************** 2025-12-03 13:10:59.748501 | controller | Wednesday 03 December 2025 13:10:59 +0000 (0:00:00.032) 0:05:31.120 **** 2025-12-03 13:10:59.748511 | controller | skipping: [instance] 2025-12-03 13:10:59.776790 | controller | 2025-12-03 13:10:59.776820 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2025-12-03 13:10:59.776835 | controller | Wednesday 03 December 2025 13:10:59 +0000 (0:00:00.020) 0:05:31.141 **** 2025-12-03 13:10:59.776845 | controller | skipping: [instance] 2025-12-03 13:10:59.776901 | controller | 2025-12-03 13:10:59.777011 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2025-12-03 13:10:59.777112 | controller | Wednesday 03 December 2025 13:10:59 +0000 (0:00:00.028) 0:05:31.169 **** 2025-12-03 13:10:59.832318 | controller | ok: [instance] 2025-12-03 13:10:59.931697 | controller | 2025-12-03 13:10:59.931728 | controller | TASK [reproducer : Push local code] ******************************************** 2025-12-03 13:10:59.931738 | controller | Wednesday 03 December 2025 13:10:59 +0000 (0:00:00.054) 0:05:31.223 **** 2025-12-03 13:10:59.931751 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2025-12-03 13:10:59.989452 | controller | 2025-12-03 13:10:59.989491 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2025-12-03 13:10:59.989526 | controller | Wednesday 03 December 2025 13:10:59 +0000 (0:00:00.100) 0:05:31.324 **** 2025-12-03 13:10:59.989545 | controller | skipping: [instance] 2025-12-03 13:11:00.029070 | controller | 2025-12-03 13:11:00.029114 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2025-12-03 13:11:00.029122 | controller | Wednesday 03 December 2025 13:10:59 +0000 (0:00:00.057) 0:05:31.382 **** 2025-12-03 13:11:00.029133 | controller | skipping: [instance] 2025-12-03 13:11:00.122591 | controller | 2025-12-03 13:11:00.122621 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2025-12-03 13:11:00.122629 | controller | Wednesday 03 December 2025 13:11:00 +0000 (0:00:00.039) 0:05:31.421 **** 2025-12-03 13:11:00.122640 | controller | skipping: [instance] 2025-12-03 13:11:00.161131 | controller | 2025-12-03 13:11:00.161157 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2025-12-03 13:11:00.161165 | controller | Wednesday 03 December 2025 13:11:00 +0000 (0:00:00.093) 0:05:31.515 **** 2025-12-03 13:11:00.161176 | controller | skipping: [instance] 2025-12-03 13:11:00.195177 | controller | 2025-12-03 13:11:00.195205 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2025-12-03 13:11:00.195224 | controller | Wednesday 03 December 2025 13:11:00 +0000 (0:00:00.038) 0:05:31.554 **** 2025-12-03 13:11:00.195235 | controller | skipping: [instance] 2025-12-03 13:11:00.691848 | controller | 2025-12-03 13:11:00.691897 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2025-12-03 13:11:00.691906 | controller | Wednesday 03 December 2025 13:11:00 +0000 (0:00:00.033) 0:05:31.588 **** 2025-12-03 13:11:00.691920 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2025-12-03 13:11:01.284595 | controller | 2025-12-03 13:11:01.284639 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2025-12-03 13:11:01.284648 | controller | Wednesday 03 December 2025 13:11:00 +0000 (0:00:00.496) 0:05:32.084 **** 2025-12-03 13:11:01.284659 | controller | ok: [instance -> localhost] => (item=ci-framework) 2025-12-03 13:11:01.324989 | controller | 2025-12-03 13:11:01.325028 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2025-12-03 13:11:01.325045 | controller | Wednesday 03 December 2025 13:11:01 +0000 (0:00:00.592) 0:05:32.677 **** 2025-12-03 13:11:01.325058 | controller | skipping: [instance] => (item=ci-framework) 2025-12-03 13:11:01.325095 | controller | skipping: [instance] 2025-12-03 13:11:01.325108 | controller | 2025-12-03 13:11:01.325118 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2025-12-03 13:11:01.325205 | controller | Wednesday 03 December 2025 13:11:01 +0000 (0:00:00.040) 0:05:32.717 **** 2025-12-03 13:11:01.399529 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2025-12-03 13:11:01.399700 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2025-12-03 13:11:01.399795 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2025-12-03 13:11:01.400004 | controller | 2025-12-03 13:11:01.400026 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2025-12-03 13:11:01.900166 | controller | Wednesday 03 December 2025 13:11:01 +0000 (0:00:00.074) 0:05:32.792 **** 2025-12-03 13:11:01.900216 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:01.942486 | controller | 2025-12-03 13:11:01.942521 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2025-12-03 13:11:01.942529 | controller | Wednesday 03 December 2025 13:11:01 +0000 (0:00:00.499) 0:05:33.292 **** 2025-12-03 13:11:01.942540 | controller | skipping: [instance] 2025-12-03 13:11:02.476458 | controller | 2025-12-03 13:11:02.476500 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2025-12-03 13:11:02.476508 | controller | Wednesday 03 December 2025 13:11:01 +0000 (0:00:00.042) 0:05:33.335 **** 2025-12-03 13:11:02.476518 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:02.476544 | controller | 2025-12-03 13:11:02.477164 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2025-12-03 13:11:02.511482 | controller | Wednesday 03 December 2025 13:11:02 +0000 (0:00:00.534) 0:05:33.869 **** 2025-12-03 13:11:02.511517 | controller | skipping: [instance] 2025-12-03 13:11:02.511544 | controller | 2025-12-03 13:11:02.511781 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2025-12-03 13:11:02.946387 | controller | Wednesday 03 December 2025 13:11:02 +0000 (0:00:00.035) 0:05:33.904 **** 2025-12-03 13:11:02.946437 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:02.946550 | controller | 2025-12-03 13:11:02.946578 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2025-12-03 13:11:02.946590 | controller | Wednesday 03 December 2025 13:11:02 +0000 (0:00:00.434) 0:05:34.339 **** 2025-12-03 13:11:05.145643 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:05.948601 | controller | 2025-12-03 13:11:05.948634 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2025-12-03 13:11:05.948642 | controller | Wednesday 03 December 2025 13:11:05 +0000 (0:00:02.198) 0:05:36.538 **** 2025-12-03 13:11:05.948652 | controller | changed: [instance -> localhost] 2025-12-03 13:11:26.095717 | controller | 2025-12-03 13:11:26.095846 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2025-12-03 13:11:26.095859 | controller | Wednesday 03 December 2025 13:11:05 +0000 (0:00:00.802) 0:05:37.341 **** 2025-12-03 13:11:26.095875 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:27.233653 | controller | 2025-12-03 13:11:27.233705 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2025-12-03 13:11:27.233713 | controller | Wednesday 03 December 2025 13:11:26 +0000 (0:00:20.146) 0:05:57.487 **** 2025-12-03 13:11:27.233726 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:27.233831 | controller | 2025-12-03 13:11:27.233844 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2025-12-03 13:11:27.233853 | controller | Wednesday 03 December 2025 13:11:27 +0000 (0:00:01.138) 0:05:58.625 **** 2025-12-03 13:11:27.353287 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2025-12-03 13:11:27.353438 | controller | 2025-12-03 13:11:27.353557 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2025-12-03 13:11:27.353673 | controller | Wednesday 03 December 2025 13:11:27 +0000 (0:00:00.119) 0:05:58.745 **** 2025-12-03 13:11:27.827011 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:27.827225 | controller | 2025-12-03 13:11:27.827241 | controller | TASK [reproducer : Rotate log if present] ************************************** 2025-12-03 13:11:27.827371 | controller | Wednesday 03 December 2025 13:11:27 +0000 (0:00:00.474) 0:05:59.219 **** 2025-12-03 13:11:27.863870 | controller | skipping: [instance] 2025-12-03 13:11:27.863964 | controller | 2025-12-03 13:11:27.864061 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2025-12-03 13:11:27.864221 | controller | Wednesday 03 December 2025 13:11:27 +0000 (0:00:00.037) 0:05:59.256 **** 2025-12-03 13:11:27.927684 | controller | skipping: [instance] 2025-12-03 13:11:27.927790 | controller | 2025-12-03 13:11:27.927925 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2025-12-03 13:11:27.928042 | controller | Wednesday 03 December 2025 13:11:27 +0000 (0:00:00.063) 0:05:59.320 **** 2025-12-03 13:11:28.037230 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:28.037338 | controller | 2025-12-03 13:11:28.037494 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-03 13:11:28.037599 | controller | Wednesday 03 December 2025 13:11:28 +0000 (0:00:00.109) 0:05:59.429 **** 2025-12-03 13:11:28.551998 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:28.552511 | controller | 2025-12-03 13:11:28.592200 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-03 13:11:28.592238 | controller | Wednesday 03 December 2025 13:11:28 +0000 (0:00:00.514) 0:05:59.944 **** 2025-12-03 13:11:28.592260 | controller | skipping: [instance] 2025-12-03 13:11:28.592282 | controller | 2025-12-03 13:11:28.592289 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-03 13:11:28.592297 | controller | Wednesday 03 December 2025 13:11:28 +0000 (0:00:00.039) 0:05:59.983 **** 2025-12-03 13:11:28.640472 | controller | skipping: [instance] 2025-12-03 13:11:28.640575 | controller | 2025-12-03 13:11:28.640698 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-03 13:11:28.640847 | controller | Wednesday 03 December 2025 13:11:28 +0000 (0:00:00.048) 0:06:00.032 **** 2025-12-03 13:11:28.682538 | controller | skipping: [instance] 2025-12-03 13:11:28.682891 | controller | 2025-12-03 13:11:28.682936 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-03 13:11:30.225793 | controller | Wednesday 03 December 2025 13:11:28 +0000 (0:00:00.042) 0:06:00.075 **** 2025-12-03 13:11:30.225836 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:30.225866 | controller | 2025-12-03 13:11:30.226117 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-12-03 13:11:31.570915 | controller | Wednesday 03 December 2025 13:11:30 +0000 (0:00:01.543) 0:06:01.618 **** 2025-12-03 13:11:31.570956 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 13:11:32.485634 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 13:11:32.485674 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 13:11:32.485682 | controller | changed: [instance -> controller-0] 2025-12-03 13:11:32.485688 | controller | 2025-12-03 13:11:32.485695 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-12-03 13:11:32.485700 | controller | Wednesday 03 December 2025 13:11:31 +0000 (0:00:01.344) 0:06:02.963 **** 2025-12-03 13:11:32.485728 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:33.768706 | controller | 2025-12-03 13:11:33.768739 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-12-03 13:11:33.768747 | controller | Wednesday 03 December 2025 13:11:32 +0000 (0:00:00.915) 0:06:03.878 **** 2025-12-03 13:11:33.768758 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:41.570650 | controller | 2025-12-03 13:11:41.570689 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-12-03 13:11:41.570704 | controller | Wednesday 03 December 2025 13:11:33 +0000 (0:00:01.283) 0:06:05.161 **** 2025-12-03 13:11:41.570715 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:42.509726 | controller | 2025-12-03 13:11:42.509759 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-12-03 13:11:42.509768 | controller | Wednesday 03 December 2025 13:11:41 +0000 (0:00:07.801) 0:06:12.963 **** 2025-12-03 13:11:42.509778 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:42.547662 | controller | 2025-12-03 13:11:42.547687 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-12-03 13:11:42.547695 | controller | Wednesday 03 December 2025 13:11:42 +0000 (0:00:00.939) 0:06:13.902 **** 2025-12-03 13:11:42.547705 | controller | skipping: [instance] 2025-12-03 13:11:43.652202 | controller | 2025-12-03 13:11:43.652237 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-12-03 13:11:43.652245 | controller | Wednesday 03 December 2025 13:11:42 +0000 (0:00:00.038) 0:06:13.940 **** 2025-12-03 13:11:43.652255 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:43.708165 | controller | 2025-12-03 13:11:43.708191 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-12-03 13:11:43.708199 | controller | Wednesday 03 December 2025 13:11:43 +0000 (0:00:01.104) 0:06:15.044 **** 2025-12-03 13:11:43.708215 | controller | skipping: [instance] 2025-12-03 13:11:43.708232 | controller | 2025-12-03 13:11:43.708240 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-12-03 13:11:43.708350 | controller | Wednesday 03 December 2025 13:11:43 +0000 (0:00:00.056) 0:06:15.101 **** 2025-12-03 13:11:43.764499 | controller | skipping: [instance] 2025-12-03 13:11:43.764586 | controller | 2025-12-03 13:11:43.764693 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-12-03 13:11:43.764795 | controller | Wednesday 03 December 2025 13:11:43 +0000 (0:00:00.056) 0:06:15.157 **** 2025-12-03 13:11:43.821020 | controller | skipping: [instance] 2025-12-03 13:11:43.821110 | controller | 2025-12-03 13:11:43.821207 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-12-03 13:11:43.821310 | controller | Wednesday 03 December 2025 13:11:43 +0000 (0:00:00.056) 0:06:15.214 **** 2025-12-03 13:11:44.647015 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:44.647072 | controller | 2025-12-03 13:11:44.647182 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-12-03 13:11:44.647279 | controller | Wednesday 03 December 2025 13:11:44 +0000 (0:00:00.825) 0:06:16.039 **** 2025-12-03 13:11:45.507859 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:45.507934 | controller | 2025-12-03 13:11:45.508045 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-12-03 13:11:45.508178 | controller | Wednesday 03 December 2025 13:11:45 +0000 (0:00:00.860) 0:06:16.900 **** 2025-12-03 13:11:45.546917 | controller | skipping: [instance] 2025-12-03 13:11:45.547008 | controller | 2025-12-03 13:11:45.547174 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-12-03 13:11:45.547268 | controller | Wednesday 03 December 2025 13:11:45 +0000 (0:00:00.039) 0:06:16.940 **** 2025-12-03 13:11:45.586063 | controller | skipping: [instance] 2025-12-03 13:11:45.586171 | controller | 2025-12-03 13:11:45.586273 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-12-03 13:11:45.586385 | controller | Wednesday 03 December 2025 13:11:45 +0000 (0:00:00.039) 0:06:16.979 **** 2025-12-03 13:11:45.624896 | controller | skipping: [instance] 2025-12-03 13:11:45.624983 | controller | 2025-12-03 13:11:45.625110 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-12-03 13:11:45.625212 | controller | Wednesday 03 December 2025 13:11:45 +0000 (0:00:00.038) 0:06:17.018 **** 2025-12-03 13:11:45.673666 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:45.673757 | controller | 2025-12-03 13:11:45.673860 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-12-03 13:11:45.673962 | controller | Wednesday 03 December 2025 13:11:45 +0000 (0:00:00.048) 0:06:17.066 **** 2025-12-03 13:11:45.711037 | controller | skipping: [instance] 2025-12-03 13:11:45.711157 | controller | 2025-12-03 13:11:45.711265 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-12-03 13:11:45.711379 | controller | Wednesday 03 December 2025 13:11:45 +0000 (0:00:00.037) 0:06:17.104 **** 2025-12-03 13:11:45.748187 | controller | skipping: [instance] 2025-12-03 13:11:45.748278 | controller | 2025-12-03 13:11:45.748417 | controller | TASK [Download the RPM] ******************************************************** 2025-12-03 13:11:45.748504 | controller | Wednesday 03 December 2025 13:11:45 +0000 (0:00:00.036) 0:06:17.141 **** 2025-12-03 13:11:45.784860 | controller | skipping: [instance] 2025-12-03 13:11:45.784937 | controller | 2025-12-03 13:11:45.785048 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-12-03 13:11:45.785176 | controller | Wednesday 03 December 2025 13:11:45 +0000 (0:00:00.036) 0:06:17.177 **** 2025-12-03 13:11:45.821398 | controller | skipping: [instance] 2025-12-03 13:11:45.821487 | controller | 2025-12-03 13:11:45.821592 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-12-03 13:11:45.821693 | controller | Wednesday 03 December 2025 13:11:45 +0000 (0:00:00.036) 0:06:17.214 **** 2025-12-03 13:11:45.856713 | controller | skipping: [instance] 2025-12-03 13:11:45.856796 | controller | 2025-12-03 13:11:45.856913 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-12-03 13:11:45.857014 | controller | Wednesday 03 December 2025 13:11:45 +0000 (0:00:00.035) 0:06:17.249 **** 2025-12-03 13:11:45.894734 | controller | skipping: [instance] 2025-12-03 13:11:45.894864 | controller | 2025-12-03 13:11:45.894981 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-12-03 13:11:45.895106 | controller | Wednesday 03 December 2025 13:11:45 +0000 (0:00:00.038) 0:06:17.287 **** 2025-12-03 13:11:45.931373 | controller | skipping: [instance] 2025-12-03 13:11:45.931473 | controller | 2025-12-03 13:11:45.931592 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-12-03 13:11:45.931694 | controller | Wednesday 03 December 2025 13:11:45 +0000 (0:00:00.036) 0:06:17.324 **** 2025-12-03 13:11:46.364285 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:46.364378 | controller | 2025-12-03 13:11:46.364505 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-12-03 13:11:46.364609 | controller | Wednesday 03 December 2025 13:11:46 +0000 (0:00:00.432) 0:06:17.757 **** 2025-12-03 13:11:46.420022 | controller | skipping: [instance] 2025-12-03 13:11:46.420066 | controller | 2025-12-03 13:11:46.420090 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-12-03 13:11:46.420218 | controller | Wednesday 03 December 2025 13:11:46 +0000 (0:00:00.055) 0:06:17.812 **** 2025-12-03 13:11:46.477424 | controller | skipping: [instance] 2025-12-03 13:11:46.477542 | controller | 2025-12-03 13:11:46.477647 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-12-03 13:11:46.477753 | controller | Wednesday 03 December 2025 13:11:46 +0000 (0:00:00.057) 0:06:17.870 **** 2025-12-03 13:11:46.516464 | controller | skipping: [instance] 2025-12-03 13:11:46.516570 | controller | 2025-12-03 13:11:46.516684 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-12-03 13:11:46.516776 | controller | Wednesday 03 December 2025 13:11:46 +0000 (0:00:00.039) 0:06:17.909 **** 2025-12-03 13:11:46.571213 | controller | skipping: [instance] 2025-12-03 13:11:46.571306 | controller | 2025-12-03 13:11:46.571444 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-12-03 13:11:46.571564 | controller | Wednesday 03 December 2025 13:11:46 +0000 (0:00:00.054) 0:06:17.964 **** 2025-12-03 13:11:46.628199 | controller | skipping: [instance] 2025-12-03 13:11:46.628293 | controller | 2025-12-03 13:11:46.628425 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-12-03 13:11:46.628552 | controller | Wednesday 03 December 2025 13:11:46 +0000 (0:00:00.056) 0:06:18.021 **** 2025-12-03 13:11:46.683608 | controller | skipping: [instance] 2025-12-03 13:11:46.683691 | controller | 2025-12-03 13:11:46.683803 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-12-03 13:11:46.683905 | controller | Wednesday 03 December 2025 13:11:46 +0000 (0:00:00.055) 0:06:18.076 **** 2025-12-03 13:11:46.741118 | controller | skipping: [instance] 2025-12-03 13:11:46.741238 | controller | 2025-12-03 13:11:46.741369 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-12-03 13:11:46.741498 | controller | Wednesday 03 December 2025 13:11:46 +0000 (0:00:00.057) 0:06:18.133 **** 2025-12-03 13:11:46.795943 | controller | skipping: [instance] 2025-12-03 13:11:46.796056 | controller | 2025-12-03 13:11:46.796193 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-12-03 13:11:46.796299 | controller | Wednesday 03 December 2025 13:11:46 +0000 (0:00:00.054) 0:06:18.188 **** 2025-12-03 13:11:47.353295 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:47.353370 | controller | 2025-12-03 13:11:47.353512 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-12-03 13:11:47.353607 | controller | Wednesday 03 December 2025 13:11:47 +0000 (0:00:00.557) 0:06:18.746 **** 2025-12-03 13:11:48.353801 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 13:11:48.353858 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 13:11:48.353981 | controller | changed: [instance -> controller-0] 2025-12-03 13:11:48.354064 | controller | 2025-12-03 13:11:48.354191 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-12-03 13:11:48.354285 | controller | Wednesday 03 December 2025 13:11:48 +0000 (0:00:01.000) 0:06:19.746 **** 2025-12-03 13:11:49.036525 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:49.036601 | controller | 2025-12-03 13:11:49.036720 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-12-03 13:11:49.036808 | controller | Wednesday 03 December 2025 13:11:49 +0000 (0:00:00.682) 0:06:20.429 **** 2025-12-03 13:11:49.561836 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:49.561909 | controller | 2025-12-03 13:11:49.562035 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-12-03 13:11:49.562175 | controller | Wednesday 03 December 2025 13:11:49 +0000 (0:00:00.525) 0:06:20.954 **** 2025-12-03 13:11:49.621737 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 13:11:49.621874 | controller | ok: [instance -> controller-0] 2025-12-03 13:11:49.622002 | controller | 2025-12-03 13:11:49.622189 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-12-03 13:11:49.622305 | controller | Wednesday 03 December 2025 13:11:49 +0000 (0:00:00.059) 0:06:21.014 **** 2025-12-03 13:11:49.664656 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:11:49.664749 | controller | 2025-12-03 13:11:49.664853 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-12-03 13:11:49.664977 | controller | Wednesday 03 December 2025 13:11:49 +0000 (0:00:00.042) 0:06:21.057 **** 2025-12-03 13:12:21.615366 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:21.615424 | controller | 2025-12-03 13:12:21.615494 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-12-03 13:12:21.615600 | controller | Wednesday 03 December 2025 13:12:21 +0000 (0:00:31.950) 0:06:53.008 **** 2025-12-03 13:12:22.117771 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:22.117863 | controller | 2025-12-03 13:12:22.117957 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-12-03 13:12:22.118064 | controller | Wednesday 03 December 2025 13:12:22 +0000 (0:00:00.502) 0:06:53.510 **** 2025-12-03 13:12:22.580912 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:22.580998 | controller | 2025-12-03 13:12:22.581106 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-12-03 13:12:22.581214 | controller | Wednesday 03 December 2025 13:12:22 +0000 (0:00:00.463) 0:06:53.973 **** 2025-12-03 13:12:28.683043 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:28.683122 | controller | 2025-12-03 13:12:28.683243 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-12-03 13:12:28.683354 | controller | Wednesday 03 December 2025 13:12:28 +0000 (0:00:06.102) 0:07:00.075 **** 2025-12-03 13:12:28.735568 | controller | skipping: [instance] 2025-12-03 13:12:28.735687 | controller | 2025-12-03 13:12:28.735700 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-12-03 13:12:28.735830 | controller | Wednesday 03 December 2025 13:12:28 +0000 (0:00:00.052) 0:07:00.128 **** 2025-12-03 13:12:29.378645 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:29.861913 | controller | 2025-12-03 13:12:29.861947 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-12-03 13:12:29.861955 | controller | Wednesday 03 December 2025 13:12:29 +0000 (0:00:00.642) 0:07:00.771 **** 2025-12-03 13:12:29.861965 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:29.901877 | controller | 2025-12-03 13:12:29.901907 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-12-03 13:12:29.901916 | controller | Wednesday 03 December 2025 13:12:29 +0000 (0:00:00.483) 0:07:01.254 **** 2025-12-03 13:12:29.901926 | controller | skipping: [instance] 2025-12-03 13:12:29.942805 | controller | 2025-12-03 13:12:29.942834 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-12-03 13:12:29.942843 | controller | Wednesday 03 December 2025 13:12:29 +0000 (0:00:00.040) 0:07:01.294 **** 2025-12-03 13:12:29.942852 | controller | skipping: [instance] 2025-12-03 13:12:29.982640 | controller | 2025-12-03 13:12:29.982670 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-12-03 13:12:29.982679 | controller | Wednesday 03 December 2025 13:12:29 +0000 (0:00:00.040) 0:07:01.335 **** 2025-12-03 13:12:29.982689 | controller | skipping: [instance] 2025-12-03 13:12:30.026695 | controller | 2025-12-03 13:12:30.026729 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-12-03 13:12:30.026737 | controller | Wednesday 03 December 2025 13:12:29 +0000 (0:00:00.039) 0:07:01.375 **** 2025-12-03 13:12:30.026747 | controller | skipping: [instance] 2025-12-03 13:12:30.067771 | controller | 2025-12-03 13:12:30.067803 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-12-03 13:12:30.067811 | controller | Wednesday 03 December 2025 13:12:30 +0000 (0:00:00.041) 0:07:01.417 **** 2025-12-03 13:12:30.067821 | controller | skipping: [instance] 2025-12-03 13:12:30.113350 | controller | 2025-12-03 13:12:30.113385 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-12-03 13:12:30.113393 | controller | Wednesday 03 December 2025 13:12:30 +0000 (0:00:00.041) 0:07:01.458 **** 2025-12-03 13:12:30.113403 | controller | skipping: [instance] 2025-12-03 13:12:32.650824 | controller | 2025-12-03 13:12:32.650859 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-12-03 13:12:32.650867 | controller | Wednesday 03 December 2025 13:12:30 +0000 (0:00:00.047) 0:07:01.505 **** 2025-12-03 13:12:32.650884 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 13:12:32.811819 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 13:12:32.811852 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 13:12:32.811864 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 13:12:32.811870 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 13:12:32.811875 | controller | changed: [instance -> controller-0] 2025-12-03 13:12:32.811881 | controller | 2025-12-03 13:12:32.811887 | controller | TASK [Prepare install_yamls make targets] ************************************** 2025-12-03 13:12:32.811893 | controller | Wednesday 03 December 2025 13:12:32 +0000 (0:00:02.536) 0:07:04.042 **** 2025-12-03 13:12:32.811902 | controller | 2025-12-03 13:12:34.315618 | controller | TASK [install_yamls : Ensure directories exist] ******************************** 2025-12-03 13:12:34.315651 | controller | Wednesday 03 December 2025 13:12:32 +0000 (0:00:00.161) 0:07:04.204 **** 2025-12-03 13:12:34.315663 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 13:12:34.384944 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 13:12:34.384985 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 13:12:34.384994 | controller | changed: [instance -> controller-0] 2025-12-03 13:12:34.385029 | controller | 2025-12-03 13:12:34.385040 | controller | TASK [Create variables with local repos based on Zuul items] ******************* 2025-12-03 13:12:34.385049 | controller | Wednesday 03 December 2025 13:12:34 +0000 (0:00:01.502) 0:07:05.707 **** 2025-12-03 13:12:34.385059 | controller | 2025-12-03 13:12:34.439305 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] *********** 2025-12-03 13:12:34.439357 | controller | Wednesday 03 December 2025 13:12:34 +0000 (0:00:00.069) 0:07:05.777 **** 2025-12-03 13:12:34.439371 | controller | skipping: [instance] 2025-12-03 13:12:34.499166 | controller | 2025-12-03 13:12:34.499205 | controller | TASK [install_yamls : Print helpful data for debugging] ************************ 2025-12-03 13:12:34.499214 | controller | Wednesday 03 December 2025 13:12:34 +0000 (0:00:00.050) 0:07:05.827 **** 2025-12-03 13:12:34.499224 | controller | skipping: [instance] 2025-12-03 13:12:34.584126 | controller | 2025-12-03 13:12:34.584165 | controller | TASK [Customize install_yamls devsetup vars if needed] ************************* 2025-12-03 13:12:34.584178 | controller | Wednesday 03 December 2025 13:12:34 +0000 (0:00:00.060) 0:07:05.888 **** 2025-12-03 13:12:34.584193 | controller | 2025-12-03 13:12:34.633572 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-03 13:12:34.633610 | controller | Wednesday 03 December 2025 13:12:34 +0000 (0:00:00.088) 0:07:05.976 **** 2025-12-03 13:12:34.633626 | controller | skipping: [instance] 2025-12-03 13:12:34.677637 | controller | 2025-12-03 13:12:34.677674 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-03 13:12:34.677686 | controller | Wednesday 03 December 2025 13:12:34 +0000 (0:00:00.046) 0:07:06.022 **** 2025-12-03 13:12:34.677698 | controller | skipping: [instance] 2025-12-03 13:12:34.677881 | controller | 2025-12-03 13:12:34.678072 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-03 13:12:34.678274 | controller | Wednesday 03 December 2025 13:12:34 +0000 (0:00:00.047) 0:07:06.070 **** 2025-12-03 13:12:34.725173 | controller | skipping: [instance] 2025-12-03 13:12:34.725395 | controller | 2025-12-03 13:12:34.725603 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] *** 2025-12-03 13:12:34.725807 | controller | Wednesday 03 December 2025 13:12:34 +0000 (0:00:00.047) 0:07:06.118 **** 2025-12-03 13:12:34.776556 | controller | skipping: [instance] 2025-12-03 13:12:34.968839 | controller | 2025-12-03 13:12:34.968878 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ******** 2025-12-03 13:12:34.968887 | controller | Wednesday 03 December 2025 13:12:34 +0000 (0:00:00.050) 0:07:06.168 **** 2025-12-03 13:12:34.968900 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-03 13:12:35.064919 | controller | ok: [instance -> controller-0] 2025-12-03 13:12:35.064953 | controller | 2025-12-03 13:12:35.064962 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] *** 2025-12-03 13:12:35.064968 | controller | Wednesday 03 December 2025 13:12:34 +0000 (0:00:00.185) 0:07:06.354 **** 2025-12-03 13:12:35.064978 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:36.575956 | controller | 2025-12-03 13:12:36.575988 | controller | TASK [install_yamls : Get environment structure] ******************************* 2025-12-03 13:12:36.575997 | controller | Wednesday 03 December 2025 13:12:35 +0000 (0:00:00.098) 0:07:06.452 **** 2025-12-03 13:12:36.576007 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:36.626835 | controller | 2025-12-03 13:12:36.626865 | controller | TASK [install_yamls : Ensure Output directory exists] ************************** 2025-12-03 13:12:36.626874 | controller | Wednesday 03 December 2025 13:12:36 +0000 (0:00:01.515) 0:07:07.968 **** 2025-12-03 13:12:36.626884 | controller | skipping: [instance] 2025-12-03 13:12:36.698189 | controller | 2025-12-03 13:12:36.698212 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] *** 2025-12-03 13:12:36.698274 | controller | Wednesday 03 December 2025 13:12:36 +0000 (0:00:00.050) 0:07:08.019 **** 2025-12-03 13:12:36.698285 | controller | skipping: [instance] 2025-12-03 13:12:36.749728 | controller | 2025-12-03 13:12:36.749763 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] *** 2025-12-03 13:12:36.749777 | controller | Wednesday 03 December 2025 13:12:36 +0000 (0:00:00.071) 0:07:08.090 **** 2025-12-03 13:12:36.749788 | controller | skipping: [instance] 2025-12-03 13:12:36.959945 | controller | 2025-12-03 13:12:36.959968 | controller | TASK [install_yamls : Set install_yamls default values] ************************ 2025-12-03 13:12:36.959976 | controller | Wednesday 03 December 2025 13:12:36 +0000 (0:00:00.047) 0:07:08.138 **** 2025-12-03 13:12:36.959986 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:37.020057 | controller | 2025-12-03 13:12:37.020093 | controller | TASK [install_yamls : Show the env structure] ********************************** 2025-12-03 13:12:37.020105 | controller | Wednesday 03 December 2025 13:12:36 +0000 (0:00:00.213) 0:07:08.351 **** 2025-12-03 13:12:37.020115 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:37.104909 | controller | 2025-12-03 13:12:37.104935 | controller | TASK [install_yamls : Show the env structure defaults] ************************* 2025-12-03 13:12:37.104944 | controller | Wednesday 03 December 2025 13:12:37 +0000 (0:00:00.060) 0:07:08.412 **** 2025-12-03 13:12:37.104957 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:37.818719 | controller | 2025-12-03 13:12:37.818754 | controller | TASK [install_yamls : Generate make targets] *********************************** 2025-12-03 13:12:37.818763 | controller | Wednesday 03 December 2025 13:12:37 +0000 (0:00:00.081) 0:07:08.494 **** 2025-12-03 13:12:37.818774 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:37.895346 | controller | 2025-12-03 13:12:37.895421 | controller | TASK [install_yamls : Debug generate_make module] ****************************** 2025-12-03 13:12:37.895430 | controller | Wednesday 03 December 2025 13:12:37 +0000 (0:00:00.716) 0:07:09.210 **** 2025-12-03 13:12:37.895441 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:39.027884 | controller | 2025-12-03 13:12:39.027922 | controller | TASK [install_yamls : Create the install_yamls parameters file] **************** 2025-12-03 13:12:39.027931 | controller | Wednesday 03 December 2025 13:12:37 +0000 (0:00:00.076) 0:07:09.287 **** 2025-12-03 13:12:39.027948 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:39.088431 | controller | 2025-12-03 13:12:39.088462 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] *** 2025-12-03 13:12:39.088474 | controller | Wednesday 03 December 2025 13:12:39 +0000 (0:00:01.132) 0:07:10.419 **** 2025-12-03 13:12:39.088485 | controller | skipping: [instance] 2025-12-03 13:12:39.999402 | controller | 2025-12-03 13:12:39.999434 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-12-03 13:12:39.999442 | controller | Wednesday 03 December 2025 13:12:39 +0000 (0:00:00.060) 0:07:10.480 **** 2025-12-03 13:12:39.999453 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:40.063502 | controller | 2025-12-03 13:12:40.063534 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-12-03 13:12:40.063548 | controller | Wednesday 03 December 2025 13:12:39 +0000 (0:00:00.911) 0:07:11.391 **** 2025-12-03 13:12:40.063562 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:41.170794 | controller | 2025-12-03 13:12:41.170834 | controller | TASK [cifmw_setup : Create artifacts with custom params] *********************** 2025-12-03 13:12:41.170842 | controller | Wednesday 03 December 2025 13:12:40 +0000 (0:00:00.064) 0:07:11.455 **** 2025-12-03 13:12:41.170853 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:41.698493 | controller | 2025-12-03 13:12:41.698533 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] ******* 2025-12-03 13:12:41.698547 | controller | Wednesday 03 December 2025 13:12:41 +0000 (0:00:01.107) 0:07:12.563 **** 2025-12-03 13:12:41.698558 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:41.891453 | controller | 2025-12-03 13:12:41.891491 | controller | TASK [Configure CRC network if needed] ***************************************** 2025-12-03 13:12:41.891500 | controller | Wednesday 03 December 2025 13:12:41 +0000 (0:00:00.527) 0:07:13.090 **** 2025-12-03 13:12:41.891520 | controller | 2025-12-03 13:12:43.311287 | controller | TASK [openshift_setup : Gather network.operator info] ************************** 2025-12-03 13:12:43.311328 | controller | Wednesday 03 December 2025 13:12:41 +0000 (0:00:00.193) 0:07:13.283 **** 2025-12-03 13:12:43.311341 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:45.116367 | controller | 2025-12-03 13:12:45.116410 | controller | TASK [openshift_setup : Patch network operator] ******************************** 2025-12-03 13:12:45.116420 | controller | Wednesday 03 December 2025 13:12:43 +0000 (0:00:01.419) 0:07:14.703 **** 2025-12-03 13:12:45.116431 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-03 13:12:45.149897 | controller | 2025-12-03 13:12:45.149930 | controller | TASK [Ensure OCP cluster is stable] ******************************************** 2025-12-03 13:12:45.149942 | controller | Wednesday 03 December 2025 13:12:45 +0000 (0:00:01.805) 0:07:16.508 **** 2025-12-03 13:12:45.149955 | controller | skipping: [instance] 2025-12-03 13:12:45.196856 | controller | 2025-12-03 13:12:45.196877 | controller | TASK [reproducer : Emulate CI job] ********************************************* 2025-12-03 13:12:45.196885 | controller | Wednesday 03 December 2025 13:12:45 +0000 (0:00:00.033) 0:07:16.542 **** 2025-12-03 13:12:45.196961 | controller | skipping: [instance] 2025-12-03 13:12:45.237061 | controller | 2025-12-03 13:12:45.237099 | controller | TASK [reproducer : Currently reproducer vars] ********************************** 2025-12-03 13:12:45.237111 | controller | Wednesday 03 December 2025 13:12:45 +0000 (0:00:00.047) 0:07:16.589 **** 2025-12-03 13:12:45.237121 | controller | fatal: [instance -> controller-0]: FAILED! => 2025-12-03 13:12:45.251327 | controller | msg: |- 2025-12-03 13:12:45.251372 | controller | The task includes an option with an undefined variable. The error was: 'cifmw_deploy_reproducer_env' is undefined. 'cifmw_deploy_reproducer_env' is undefined 2025-12-03 13:12:45.251380 | controller | 2025-12-03 13:12:45.251386 | controller | The error appears to be in '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/main.yml': line 366, column 7, but may 2025-12-03 13:12:45.251397 | controller | be elsewhere in the file depending on the exact syntax problem. 2025-12-03 13:12:45.251403 | controller | 2025-12-03 13:12:45.251409 | controller | The offending line appears to be: 2025-12-03 13:12:45.251414 | controller | 2025-12-03 13:12:45.251420 | controller | 2025-12-03 13:12:45.251425 | controller | - name: Currently reproducer vars 2025-12-03 13:12:45.251431 | controller | ^ here 2025-12-03 13:12:45.251439 | controller | 2025-12-03 13:12:45.553168 | controller | TASK [Create dnsmasq dir] ****************************************************** 2025-12-03 13:12:45.553211 | controller | Wednesday 03 December 2025 13:12:45 +0000 (0:00:00.050) 0:07:16.640 **** 2025-12-03 13:12:45.553224 | controller | changed: [instance] 2025-12-03 13:12:45.553259 | controller | 2025-12-03 13:12:45.553423 | controller | TASK [Get journalctl in a file] ************************************************ 2025-12-03 13:12:45.553556 | controller | Wednesday 03 December 2025 13:12:45 +0000 (0:00:00.303) 0:07:16.943 **** 2025-12-03 13:12:45.807292 | controller | changed: [instance] 2025-12-03 13:12:46.257166 | controller | 2025-12-03 13:12:46.257207 | controller | TASK [Dump journalctl output] ************************************************** 2025-12-03 13:12:46.257218 | controller | Wednesday 03 December 2025 13:12:45 +0000 (0:00:00.255) 0:07:17.199 **** 2025-12-03 13:12:46.257229 | controller | changed: [instance] 2025-12-03 13:12:46.844733 | controller | 2025-12-03 13:12:46.844775 | controller | TASK [Copy all dnsmasq config] ************************************************* 2025-12-03 13:12:46.844788 | controller | Wednesday 03 December 2025 13:12:46 +0000 (0:00:00.449) 0:07:17.649 **** 2025-12-03 13:12:46.844803 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-12-03 13:12:47.126688 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2025-12-03 13:12:47.126731 | controller | 2025-12-03 13:12:47.126740 | controller | TASK [Create log directory] **************************************************** 2025-12-03 13:12:47.126746 | controller | Wednesday 03 December 2025 13:12:46 +0000 (0:00:00.583) 0:07:18.232 **** 2025-12-03 13:12:47.126765 | controller | changed: [instance] 2025-12-03 13:12:48.204929 | controller | 2025-12-03 13:12:48.204971 | controller | TASK [Sync logs from controller-0] ********************************************* 2025-12-03 13:12:48.204985 | controller | Wednesday 03 December 2025 13:12:47 +0000 (0:00:00.281) 0:07:18.513 **** 2025-12-03 13:12:48.204995 | controller | changed: [instance] 2025-12-03 13:12:48.330865 | controller | 2025-12-03 13:12:48.330912 | controller | PLAY RECAP ********************************************************************* 2025-12-03 13:12:48.330922 | controller | instance : ok=542 changed=210 unreachable=0 failed=1 skipped=224 rescued=0 ignored=0 2025-12-03 13:12:48.330928 | controller | 2025-12-03 13:12:48.330934 | controller | Wednesday 03 December 2025 13:12:48 +0000 (0:00:01.078) 0:07:19.592 **** 2025-12-03 13:12:48.330939 | controller | =============================================================================== 2025-12-03 13:12:48.330944 | controller | reproducer : Check package install status ------------------------------ 72.42s 2025-12-03 13:12:48.330950 | controller | ci_setup : Install needed packages ------------------------------------- 31.95s 2025-12-03 13:12:48.330955 | controller | libvirt_manager : Download base image ---------------------------------- 20.53s 2025-12-03 13:12:48.330960 | controller | reproducer : Install collections on controller-0 ----------------------- 20.15s 2025-12-03 13:12:48.330966 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.81s 2025-12-03 13:12:48.330971 | controller | libvirt_manager : Install packages required for using KVM -------------- 11.39s 2025-12-03 13:12:48.330976 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.55s 2025-12-03 13:12:48.330981 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.80s 2025-12-03 13:12:48.330986 | controller | ci_setup : Install openshift client ------------------------------------- 6.10s 2025-12-03 13:12:48.330992 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.03s 2025-12-03 13:12:48.330997 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.03s 2025-12-03 13:12:48.331002 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 4.72s 2025-12-03 13:12:48.331008 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.81s 2025-12-03 13:12:48.331013 | controller | networking_mapper : Gather the facts ------------------------------------ 3.14s 2025-12-03 13:12:48.331018 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.14s 2025-12-03 13:12:48.331024 | controller | sushy_emulator : Install required packages ------------------------------ 2.83s 2025-12-03 13:12:48.331033 | controller | ci_setup : Manage directories ------------------------------------------- 2.54s 2025-12-03 13:12:48.331040 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.20s 2025-12-03 13:12:48.331045 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.08s 2025-12-03 13:12:48.331051 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s 2025-12-03 13:12:48.331061 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml'] 2025-12-03 13:12:48.331579 | controller | WARNING An error occurred during the test sequence action: 'converge'. Cleaning up. 2025-12-03 13:12:48.341430 | controller | INFO Running crc_layout > cleanup 2025-12-03 13:12:48.342003 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-03 13:12:48.355907 | controller | INFO Running crc_layout > destroy 2025-12-03 13:12:48.356413 | controller | WARNING Skipping, instances are delegated. 2025-12-03 13:12:48.356847 | controller | INFO Pruning extra files from scenario ephemeral directory 2025-12-03 13:12:48.359006 | controller | INFO Writing /tmp/report.html report. 2025-12-03 13:12:48.838996 | [controller] Waiting on logger 2025-12-03 13:12:53.963260 | [controller] Waiting on logger 2025-12-03 13:13:04.395154 | [controller] Waiting on logger 2025-12-03 13:13:14.827130 | [controller] Waiting on logger 2025-12-03 13:13:18.480245 | [Zuul] Log Stream did not terminate 2025-12-03 13:13:18.480494 | controller | ERROR 2025-12-03 13:13:18.480595 | controller | { 2025-12-03 13:13:18.480634 | controller | "delta": "0:08:57.359460", 2025-12-03 13:13:18.480658 | controller | "end": "2025-12-03 13:12:48.437898", 2025-12-03 13:13:18.480676 | controller | "msg": "non-zero return code", 2025-12-03 13:13:18.480757 | controller | "rc": 1, 2025-12-03 13:13:18.480784 | controller | "start": "2025-12-03 13:03:51.078438" 2025-12-03 13:13:18.480802 | controller | } failure 2025-12-03 13:13:18.783142 | 2025-12-03 13:13:18.783229 | PLAY RECAP 2025-12-03 13:13:18.783270 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0 2025-12-03 13:13:18.783291 | 2025-12-03 13:13:18.850415 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-12-03 13:13:18.851196 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-12-03 13:13:19.372870 | 2025-12-03 13:13:19.372968 | PLAY [Run ci/playbooks/collect-logs.yml] 2025-12-03 13:13:19.393056 | 2025-12-03 13:13:19.393143 | TASK [Filter out host if needed] 2025-12-03 13:13:19.401593 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2025-12-03 13:13:19.406024 | 2025-12-03 13:13:19.406091 | TASK [Ensure file is present] 2025-12-03 13:13:19.932933 | controller | ok 2025-12-03 13:13:19.938524 | 2025-12-03 13:13:19.938596 | TASK [Manage molecule report file] 2025-12-03 13:13:19.959149 | [controller] Waiting on logger 2025-12-03 13:13:29.291110 | [controller] Waiting on logger 2025-12-03 13:13:39.723284 | [controller] Waiting on logger 2025-12-03 13:13:49.067302 | [controller] Waiting on logger 2025-12-03 13:13:50.463537 | [Zuul] Log Stream did not terminate 2025-12-03 13:13:50.463771 | controller | changed 2025-12-03 13:13:50.468929 | 2025-12-03 13:13:50.468990 | TASK [Check if we get ci-framework-data basedir] 2025-12-03 13:13:50.862383 | controller | ok 2025-12-03 13:13:50.867501 | 2025-12-03 13:13:50.867564 | TASK [Create ci-framework-data log directory for zuul] 2025-12-03 13:13:51.282561 | controller | changed 2025-12-03 13:13:51.288169 | 2025-12-03 13:13:51.288235 | TASK [Copy ci-framework interesting files] 2025-12-03 13:13:51.308520 | [controller] Waiting on logger 2025-12-03 13:14:03.787283 | [controller] Waiting on logger 2025-12-03 13:14:13.131311 | [controller] Waiting on logger 2025-12-03 13:14:21.631435 | [Zuul] Log Stream did not terminate 2025-12-03 13:14:21.631646 | controller | changed 2025-12-03 13:14:21.636729 | 2025-12-03 13:14:21.636799 | TASK [Get SELinux listing] 2025-12-03 13:14:23.563420 | [controller] Waiting on logger 2025-12-03 13:14:26.658166 | controller | changed 2025-12-03 13:14:26.663643 | 2025-12-03 13:14:26.663735 | TASK [Generate log index] 2025-12-03 13:14:28.386555 | controller | changed 2025-12-03 13:14:28.391604 | 2025-12-03 13:14:28.391670 | TASK [Get some env related data] 2025-12-03 13:14:31.499306 | [controller] Waiting on logger 2025-12-03 13:14:34.955252 | [controller] Waiting on logger 2025-12-03 13:14:46.027197 | [controller] Waiting on logger 2025-12-03 13:14:56.459281 | [controller] Waiting on logger 2025-12-03 13:15:00.246411 | [Zuul] Log Stream did not terminate 2025-12-03 13:15:00.246611 | controller | changed 2025-12-03 13:15:00.251607 | 2025-12-03 13:15:00.251673 | TASK [Generate list of logs to collect in home directory] 2025-12-03 13:15:00.665024 | controller | ok: All paths examined 2025-12-03 13:15:00.670365 | 2025-12-03 13:15:00.670433 | LOOP [Copy logs from home directory] 2025-12-03 13:15:01.281195 | controller | changed: 2025-12-03 13:15:01.281401 | controller | { 2025-12-03 13:15:01.281430 | controller | "atime": 1763989167.9348345, 2025-12-03 13:15:01.281450 | controller | "ctime": 1763990251.6129293, 2025-12-03 13:15:01.281467 | controller | "dev": 64513, 2025-12-03 13:15:01.281484 | controller | "gid": 1000, 2025-12-03 13:15:01.281550 | controller | "gr_name": "zuul", 2025-12-03 13:15:01.281572 | controller | "inode": 5131423, 2025-12-03 13:15:01.281590 | controller | "isblk": false, 2025-12-03 13:15:01.281607 | controller | "ischr": false, 2025-12-03 13:15:01.281623 | controller | "isdir": false, 2025-12-03 13:15:01.281639 | controller | "isfifo": false, 2025-12-03 13:15:01.281659 | controller | "isgid": false, 2025-12-03 13:15:01.281674 | controller | "islnk": false, 2025-12-03 13:15:01.281688 | controller | "isreg": true, 2025-12-03 13:15:01.281785 | controller | "issock": false, 2025-12-03 13:15:01.281812 | controller | "isuid": false, 2025-12-03 13:15:01.281830 | controller | "mode": "0644", 2025-12-03 13:15:01.281847 | controller | "mtime": 1763990251.6129293, 2025-12-03 13:15:01.281862 | controller | "nlink": 1, 2025-12-03 13:15:01.281879 | controller | "path": "/home/zuul/crc-setup.log", 2025-12-03 13:15:01.281894 | controller | "pw_name": "zuul", 2025-12-03 13:15:01.281908 | controller | "rgrp": true, 2025-12-03 13:15:01.281921 | controller | "roth": true, 2025-12-03 13:15:01.281935 | controller | "rusr": true, 2025-12-03 13:15:01.281948 | controller | "size": 4108, 2025-12-03 13:15:01.281961 | controller | "uid": 1000, 2025-12-03 13:15:01.281975 | controller | "wgrp": false, 2025-12-03 13:15:01.281988 | controller | "woth": false, 2025-12-03 13:15:01.282002 | controller | "wusr": true, 2025-12-03 13:15:01.282014 | controller | "xgrp": false, 2025-12-03 13:15:01.282027 | controller | "xoth": false, 2025-12-03 13:15:01.282040 | controller | "xusr": false 2025-12-03 13:15:01.282053 | controller | } 2025-12-03 13:15:01.843749 | controller | changed: 2025-12-03 13:15:01.843823 | controller | { 2025-12-03 13:15:01.843849 | controller | "atime": 1763990253.7119775, 2025-12-03 13:15:01.843868 | controller | "ctime": 1763991032.5164254, 2025-12-03 13:15:01.843884 | controller | "dev": 64513, 2025-12-03 13:15:01.843900 | controller | "gid": 1000, 2025-12-03 13:15:01.843916 | controller | "gr_name": "zuul", 2025-12-03 13:15:01.843931 | controller | "inode": 5131425, 2025-12-03 13:15:01.843946 | controller | "isblk": false, 2025-12-03 13:15:01.843961 | controller | "ischr": false, 2025-12-03 13:15:01.843976 | controller | "isdir": false, 2025-12-03 13:15:01.843990 | controller | "isfifo": false, 2025-12-03 13:15:01.844004 | controller | "isgid": false, 2025-12-03 13:15:01.844018 | controller | "islnk": false, 2025-12-03 13:15:01.844031 | controller | "isreg": true, 2025-12-03 13:15:01.844043 | controller | "issock": false, 2025-12-03 13:15:01.844056 | controller | "isuid": false, 2025-12-03 13:15:01.844068 | controller | "mode": "0644", 2025-12-03 13:15:01.844080 | controller | "mtime": 1763991032.5164254, 2025-12-03 13:15:01.844094 | controller | "nlink": 1, 2025-12-03 13:15:01.844107 | controller | "path": "/home/zuul/crc-start.log", 2025-12-03 13:15:01.844121 | controller | "pw_name": "zuul", 2025-12-03 13:15:01.844147 | controller | "rgrp": true, 2025-12-03 13:15:01.844162 | controller | "roth": true, 2025-12-03 13:15:01.844176 | controller | "rusr": true, 2025-12-03 13:15:01.844189 | controller | "size": 4428, 2025-12-03 13:15:01.844202 | controller | "uid": 1000, 2025-12-03 13:15:01.844215 | controller | "wgrp": false, 2025-12-03 13:15:01.844228 | controller | "woth": false, 2025-12-03 13:15:01.844241 | controller | "wusr": true, 2025-12-03 13:15:01.844253 | controller | "xgrp": false, 2025-12-03 13:15:01.844266 | controller | "xoth": false, 2025-12-03 13:15:01.844278 | controller | "xusr": false 2025-12-03 13:15:01.844293 | controller | } 2025-12-03 13:15:02.406816 | controller | changed: 2025-12-03 13:15:02.406900 | controller | { 2025-12-03 13:15:02.406924 | controller | "atime": 1764767012.1768084, 2025-12-03 13:15:02.406943 | controller | "ctime": 1764767028.5813332, 2025-12-03 13:15:02.406959 | controller | "dev": 64513, 2025-12-03 13:15:02.406974 | controller | "gid": 1000, 2025-12-03 13:15:02.406989 | controller | "gr_name": "zuul", 2025-12-03 13:15:02.407004 | controller | "inode": 4751296, 2025-12-03 13:15:02.407019 | controller | "isblk": false, 2025-12-03 13:15:02.407033 | controller | "ischr": false, 2025-12-03 13:15:02.407048 | controller | "isdir": false, 2025-12-03 13:15:02.407064 | controller | "isfifo": false, 2025-12-03 13:15:02.407084 | controller | "isgid": false, 2025-12-03 13:15:02.407099 | controller | "islnk": false, 2025-12-03 13:15:02.407114 | controller | "isreg": true, 2025-12-03 13:15:02.407128 | controller | "issock": false, 2025-12-03 13:15:02.407156 | controller | "isuid": false, 2025-12-03 13:15:02.407171 | controller | "mode": "0644", 2025-12-03 13:15:02.407187 | controller | "mtime": 1764767028.5813332, 2025-12-03 13:15:02.407201 | controller | "nlink": 1, 2025-12-03 13:15:02.407216 | controller | "path": "/home/zuul/ansible.log", 2025-12-03 13:15:02.407231 | controller | "pw_name": "zuul", 2025-12-03 13:15:02.407246 | controller | "rgrp": true, 2025-12-03 13:15:02.407261 | controller | "roth": true, 2025-12-03 13:15:02.407275 | controller | "rusr": true, 2025-12-03 13:15:02.407289 | controller | "size": 6749, 2025-12-03 13:15:02.407303 | controller | "uid": 1000, 2025-12-03 13:15:02.407316 | controller | "wgrp": false, 2025-12-03 13:15:02.407329 | controller | "woth": false, 2025-12-03 13:15:02.407342 | controller | "wusr": true, 2025-12-03 13:15:02.407355 | controller | "xgrp": false, 2025-12-03 13:15:02.407368 | controller | "xoth": false, 2025-12-03 13:15:02.407380 | controller | "xusr": false 2025-12-03 13:15:02.407393 | controller | } 2025-12-03 13:15:02.416057 | 2025-12-03 13:15:02.416177 | TASK [Copy crio stats log file] 2025-12-03 13:15:02.429862 | controller | skipping: Conditional result was False 2025-12-03 13:15:02.435282 | 2025-12-03 13:15:02.435346 | TASK [Get SELinux related data] 2025-12-03 13:15:05.547338 | [controller] Waiting on logger 2025-12-03 13:15:08.939320 | [controller] Waiting on logger 2025-12-03 13:15:21.662222 | controller | ERROR 2025-12-03 13:15:21.662401 | controller | { 2025-12-03 13:15:21.662432 | controller | "delta": "0:00:00.010923", 2025-12-03 13:15:21.662452 | controller | "end": "2025-12-03 13:15:02.763992", 2025-12-03 13:15:21.662468 | controller | "msg": "non-zero return code", 2025-12-03 13:15:21.662485 | controller | "rc": 1, 2025-12-03 13:15:21.662502 | controller | "start": "2025-12-03 13:15:02.753069" 2025-12-03 13:15:21.662516 | controller | } 2025-12-03 13:15:21.662537 | controller | ERROR: Ignoring Errors 2025-12-03 13:15:21.667518 | 2025-12-03 13:15:21.667583 | TASK [Create system configuration directory] 2025-12-03 13:15:21.938973 | controller | changed 2025-12-03 13:15:21.944737 | 2025-12-03 13:15:21.944826 | TASK [Get some of the system configurations] 2025-12-03 13:15:21.968012 | [controller] Waiting on logger 2025-12-03 13:15:32.363337 | [controller] Waiting on logger 2025-12-03 13:15:42.795262 | [controller] Waiting on logger 2025-12-03 13:15:52.139227 | [controller] Waiting on logger 2025-12-03 13:15:52.256045 | [Zuul] Log Stream did not terminate 2025-12-03 13:15:52.256327 | controller | changed 2025-12-03 13:15:52.261829 | 2025-12-03 13:15:52.261894 | TASK [Copy generated documentation if available] 2025-12-03 13:15:52.275030 | controller | skipping: Conditional result was False 2025-12-03 13:15:52.280504 | 2025-12-03 13:15:52.280570 | TASK [Copy generated AsciiDoc documentation if available] 2025-12-03 13:15:52.293693 | controller | skipping: Conditional result was False 2025-12-03 13:15:52.298965 | 2025-12-03 13:15:52.299026 | TASK [Compress logs bigger than 2MB] 2025-12-03 13:15:55.403228 | [controller] Waiting on logger 2025-12-03 13:16:01.660430 | controller | changed 2025-12-03 13:16:01.668540 | 2025-12-03 13:16:01.668747 | TASK [Copy files from workspace on node] 2025-12-03 13:16:01.689906 | controller | ok 2025-12-03 13:16:01.713408 | 2025-12-03 13:16:01.713489 | TASK [fetch-output : Set log path for multiple nodes] 2025-12-03 13:16:01.738357 | controller | skipping: Conditional result was False 2025-12-03 13:16:01.744411 | 2025-12-03 13:16:01.744489 | TASK [fetch-output : Set log path for single node] 2025-12-03 13:16:01.773112 | controller | ok 2025-12-03 13:16:01.778251 | 2025-12-03 13:16:01.778323 | LOOP [fetch-output : Ensure local output dirs] 2025-12-03 13:16:01.991401 | controller -> localhost | ok: "/var/lib/zuul/builds/1245cf0cec5a44359e24afa34990e190/work/logs" 2025-12-03 13:16:01.991945 | controller -> localhost | changed: All items complete 2025-12-03 13:16:01.991994 | 2025-12-03 13:16:02.191505 | controller -> localhost | changed: "/var/lib/zuul/builds/1245cf0cec5a44359e24afa34990e190/work/artifacts" 2025-12-03 13:16:02.367932 | controller -> localhost | changed: "/var/lib/zuul/builds/1245cf0cec5a44359e24afa34990e190/work/docs" 2025-12-03 13:16:02.379028 | 2025-12-03 13:16:02.379227 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-12-03 13:16:03.053843 | controller | changed: 2025-12-03 13:16:03.054206 | controller | .d..t...... ./ 2025-12-03 13:16:03.054244 | controller | >f+++++++++ README.html 2025-12-03 13:16:03.054269 | controller | >f+++++++++ ansible-execution.log 2025-12-03 13:16:03.054291 | controller | >f+++++++++ ansible.log 2025-12-03 13:16:03.054311 | controller | >f+++++++++ crc-setup.log 2025-12-03 13:16:03.054330 | controller | >f+++++++++ crc-start.log 2025-12-03 13:16:03.054348 | controller | >f+++++++++ dmesg.log 2025-12-03 13:16:03.054365 | controller | >f+++++++++ installed-pkgs.log 2025-12-03 13:16:03.054382 | controller | >f+++++++++ python.log 2025-12-03 13:16:03.054399 | controller | >f+++++++++ registries.conf 2025-12-03 13:16:03.054416 | controller | >f+++++++++ report.html 2025-12-03 13:16:03.054433 | controller | >f+++++++++ selinux-denials.log 2025-12-03 13:16:03.054450 | controller | >f+++++++++ selinux-listing.log 2025-12-03 13:16:03.054468 | controller | cd+++++++++ ci-framework-data/ 2025-12-03 13:16:03.054485 | controller | cd+++++++++ ci-framework-data/artifacts/ 2025-12-03 13:16:03.054503 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2025-12-03 13:16:03.054520 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2025-12-03 13:16:03.054537 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2025-12-03 13:16:03.054554 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2025-12-03 13:16:03.054571 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2025-12-03 13:16:03.054587 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2025-12-03 13:16:03.054603 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2025-12-03 13:16:03.054619 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2025-12-03 13:16:03.054635 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2025-12-03 13:16:03.054652 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2025-12-03 13:16:03.054667 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2025-12-03 13:16:03.054683 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2025-12-03 13:16:03.054721 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2025-12-03 13:16:03.054743 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:59:b6:e2 2025-12-03 13:16:03.054762 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:36:fc:85 2025-12-03 13:16:03.054779 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:82:63:29 2025-12-03 13:16:03.054796 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:28:9c:45 2025-12-03 13:16:03.054813 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:ef:a8:1b 2025-12-03 13:16:03.054830 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:36:3a:5e 2025-12-03 13:16:03.054846 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2025-12-03 13:16:03.054863 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2025-12-03 13:16:03.054880 | controller | cd+++++++++ ci-framework-data/logs/ 2025-12-03 13:16:03.054906 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2025-12-03 13:16:03.054924 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2025-12-03 13:16:03.054942 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2025-12-03 13:16:03.054958 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2025-12-03 13:16:03.054974 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2025-12-03 13:16:03.054991 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2025-12-03 13:16:03.055008 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2025-12-03 13:16:03.055025 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/ 2025-12-03 13:16:03.055041 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/ 2025-12-03 13:16:03.055057 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/ 2025-12-03 13:16:03.055073 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/ 2025-12-03 13:16:03.055091 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml 2025-12-03 13:16:03.055109 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml 2025-12-03 13:16:03.055125 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/ 2025-12-03 13:16:03.055153 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2025-12-03 13:16:03.055172 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo 2025-12-03 13:16:03.055190 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5 2025-12-03 13:16:03.055207 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2025-12-03 13:16:03.055224 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2025-12-03 13:16:03.055242 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2025-12-03 13:16:03.055258 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2025-12-03 13:16:03.055274 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/ 2025-12-03 13:16:03.055291 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2025-12-03 13:16:03.055309 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2025-12-03 13:16:03.055325 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2025-12-03 13:16:03.055341 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2025-12-03 13:16:03.055358 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/ 2025-12-03 13:16:03.055375 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2025-12-03 13:16:03.055392 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2025-12-03 13:16:03.055408 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2025-12-03 13:16:03.055432 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2025-12-03 13:16:03.055449 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2025-12-03 13:16:03.055468 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2025-12-03 13:16:03.055483 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2025-12-03 13:16:03.055500 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/ 2025-12-03 13:16:03.055516 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2025-12-03 13:16:03.055532 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2025-12-03 13:16:03.055549 | controller | cd+++++++++ registries.conf.d/ 2025-12-03 13:16:03.055565 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2025-12-03 13:16:03.055581 | controller | cd+++++++++ system-config/ 2025-12-03 13:16:03.055596 | controller | cd+++++++++ system-config/libvirt/ 2025-12-03 13:16:03.055616 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2025-12-03 13:16:03.055633 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2025-12-03 13:16:03.055648 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2025-12-03 13:16:03.055663 | controller | >f+++++++++ system-config/libvirt/network.conf 2025-12-03 13:16:03.055678 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2025-12-03 13:16:03.055714 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2025-12-03 13:16:03.055740 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2025-12-03 13:16:03.055759 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2025-12-03 13:16:03.055776 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2025-12-03 13:16:03.055792 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2025-12-03 13:16:03.055808 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2025-12-03 13:16:03.055824 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2025-12-03 13:16:03.055840 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2025-12-03 13:16:03.055856 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2025-12-03 13:16:03.055871 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2025-12-03 13:16:03.055886 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2025-12-03 13:16:03.505827 | controller | changed: .d..t...... ./ 2025-12-03 13:16:03.966225 | controller | changed: .d..t...... ./ 2025-12-03 13:16:03.983992 | 2025-12-03 13:16:03.984159 | TASK [Return artifact to Zuul] 2025-12-03 13:16:04.014098 | controller | ok 2025-12-03 13:16:04.037726 | 2025-12-03 13:16:04.037826 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2025-12-03 13:16:04.037942 | 2025-12-03 13:16:04.037969 | PLAY RECAP 2025-12-03 13:16:04.038009 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2025-12-03 13:16:04.038029 | 2025-12-03 13:16:04.131488 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-12-03 13:16:04.132293 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-12-03 13:16:04.685239 | 2025-12-03 13:16:04.685385 | PLAY [all] 2025-12-03 13:16:04.704767 | 2025-12-03 13:16:04.704844 | TASK [include_role : fetch-output] 2025-12-03 13:16:04.746082 | controller | ok 2025-12-03 13:16:04.763429 | 2025-12-03 13:16:04.763507 | TASK [fetch-output : Set log path for multiple nodes] 2025-12-03 13:16:04.812002 | controller | skipping: Conditional result was False 2025-12-03 13:16:04.819433 | 2025-12-03 13:16:04.819517 | TASK [fetch-output : Set log path for single node] 2025-12-03 13:16:04.860884 | controller | ok 2025-12-03 13:16:04.866000 | 2025-12-03 13:16:04.866079 | LOOP [fetch-output : Ensure local output dirs] 2025-12-03 13:16:05.247926 | controller -> localhost | ok: "/var/lib/zuul/builds/1245cf0cec5a44359e24afa34990e190/work/logs" 2025-12-03 13:16:05.438012 | controller -> localhost | ok: "/var/lib/zuul/builds/1245cf0cec5a44359e24afa34990e190/work/artifacts" 2025-12-03 13:16:05.648629 | controller -> localhost | ok: "/var/lib/zuul/builds/1245cf0cec5a44359e24afa34990e190/work/docs" 2025-12-03 13:16:05.660640 | 2025-12-03 13:16:05.660787 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-12-03 13:16:06.320976 | controller | ok 2025-12-03 13:16:06.321193 | controller | ok: All items complete 2025-12-03 13:16:06.321223 | 2025-12-03 13:16:06.774962 | controller | ok 2025-12-03 13:16:07.229476 | controller | ok 2025-12-03 13:16:07.249256 | 2025-12-03 13:16:07.249379 | TASK [include_role : fetch-output-openshift] 2025-12-03 13:16:07.264316 | controller | skipping: Conditional result was False 2025-12-03 13:16:07.269903 | 2025-12-03 13:16:07.269973 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2025-12-03 13:16:07.610404 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006307 2025-12-03 13:16:07.801624 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006768 2025-12-03 13:16:07.833939 | 2025-12-03 13:16:07.834070 | PLAY [all] 2025-12-03 13:16:07.848070 | 2025-12-03 13:16:07.848150 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2025-12-03 13:16:08.360072 | controller | changed 2025-12-03 13:16:08.382224 | 2025-12-03 13:16:08.382290 | PLAY RECAP 2025-12-03 13:16:08.382342 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2025-12-03 13:16:08.382368 | 2025-12-03 13:16:08.485791 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-12-03 13:16:08.486479 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2025-12-03 13:16:09.067444 | 2025-12-03 13:16:09.067598 | PLAY [localhost] 2025-12-03 13:16:09.086089 | 2025-12-03 13:16:09.086222 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2025-12-03 13:16:09.448973 | localhost | changed 2025-12-03 13:16:09.462215 | 2025-12-03 13:16:09.462485 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2025-12-03 13:16:09.510982 | localhost | ok 2025-12-03 13:16:09.533924 | 2025-12-03 13:16:09.534050 | TASK [add-fileserver : Create SSH private key tempfile] 2025-12-03 13:16:09.888381 | localhost | changed 2025-12-03 13:16:09.894886 | 2025-12-03 13:16:09.894962 | TASK [add-fileserver : Create SSH private key from secret] 2025-12-03 13:16:10.469981 | localhost | changed 2025-12-03 13:16:10.474962 | 2025-12-03 13:16:10.475028 | TASK [add-fileserver : Add fileserver ssh key] 2025-12-03 13:16:10.807413 | localhost | Identity added: /var/lib/zuul/builds/1245cf0cec5a44359e24afa34990e190/work/tmp/ansible.u5d_drbh (/var/lib/zuul/builds/1245cf0cec5a44359e24afa34990e190/work/tmp/ansible.u5d_drbh) 2025-12-03 13:16:10.807599 | localhost | ok: Runtime: 0:00:00.006545 2025-12-03 13:16:10.812090 | 2025-12-03 13:16:10.812178 | TASK [add-fileserver : Remove SSH private key from disk] 2025-12-03 13:16:11.032503 | localhost | ok: Runtime: 0:00:00.004497 2025-12-03 13:16:11.037183 | 2025-12-03 13:16:11.037254 | TASK [add-fileserver : Add fileserver to inventory] 2025-12-03 13:16:11.086092 | localhost | changed 2025-12-03 13:16:11.090160 | 2025-12-03 13:16:11.090228 | TASK [add-fileserver : Add fileserver server to known hosts] 2025-12-03 13:16:11.431471 | localhost | changed 2025-12-03 13:16:11.451183 | 2025-12-03 13:16:11.451267 | PLAY [localhost] 2025-12-03 13:16:11.462426 | 2025-12-03 13:16:11.462487 | TASK [Generate bulk log download script] 2025-12-03 13:16:11.483999 | localhost | ok 2025-12-03 13:16:11.497631 | 2025-12-03 13:16:11.497787 | TASK [local-log-download : Check API endpoint is defined] 2025-12-03 13:16:11.528968 | localhost | ok: All assertions passed 2025-12-03 13:16:11.533854 | 2025-12-03 13:16:11.533921 | TASK [local-log-download : Create download script] 2025-12-03 13:16:11.894250 | localhost -> localhost | changed 2025-12-03 13:16:11.904004 | 2025-12-03 13:16:11.904089 | TASK [Register quick-download link] 2025-12-03 13:16:11.924561 | localhost | ok 2025-12-03 13:16:11.979784 | 2025-12-03 13:16:11.979893 | PLAY [logserver.rdoproject.org] 2025-12-03 13:16:11.990098 | 2025-12-03 13:16:11.990175 | TASK [Set zuul-log-path fact] 2025-12-03 13:16:12.008504 | logserver.rdoproject.org | ok 2025-12-03 13:16:12.018812 | 2025-12-03 13:16:12.018900 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-12-03 13:16:12.047690 | logserver.rdoproject.org | ok 2025-12-03 13:16:12.053159 | 2025-12-03 13:16:12.053225 | TASK [upload-logs : Create log directories] 2025-12-03 13:16:13.887039 | logserver.rdoproject.org | changed 2025-12-03 13:16:13.890496 | 2025-12-03 13:16:13.890564 | TASK [upload-logs : Ensure logs are readable before uploading] 2025-12-03 13:16:14.106510 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.005378 2025-12-03 13:16:14.111259 | 2025-12-03 13:16:14.111327 | TASK [upload-logs : Upload logs to log server] 2025-12-03 13:16:15.590746 | logserver.rdoproject.org | Output suppressed because no_log was given 2025-12-03 13:16:15.593538 | 2025-12-03 13:16:15.593604 | LOOP [upload-logs : Compress console log and json output] 2025-12-03 13:16:15.630692 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-03 13:16:15.638737 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-03 13:16:15.651055 | 2025-12-03 13:16:15.651123 | LOOP [upload-logs : Upload compressed console log and json output] 2025-12-03 13:16:15.685469 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-03 13:16:15.685739 | 2025-12-03 13:16:15.689675 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-03 13:16:15.699947 | 2025-12-03 13:16:15.700075 | LOOP [upload-logs : Upload console log and json output]