2025-12-01 11:00:38.610944 | Job console starting... 2025-12-01 11:00:38.850315 | Updating repositories 2025-12-01 11:00:39.565122 | Preparing job workspace 2025-12-01 11:00:58.277238 | Running Ansible setup... 2025-12-01 11:01:07.108254 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-12-01 11:01:10.150121 | 2025-12-01 11:01:10.150225 | PLAY [localhost] 2025-12-01 11:01:10.205958 | 2025-12-01 11:01:10.208477 | TASK [Gathering Facts] 2025-12-01 11:01:13.261586 | localhost | ok 2025-12-01 11:01:13.295252 | 2025-12-01 11:01:13.295360 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2025-12-01 11:01:14.547784 | localhost -> localhost | changed 2025-12-01 11:01:14.554139 | 2025-12-01 11:01:14.554208 | TASK [log-inventory : Copy ansible inventory to logs dir] 2025-12-01 11:01:17.695604 | localhost -> localhost | changed 2025-12-01 11:01:17.706516 | 2025-12-01 11:01:17.706599 | TASK [Setup log path fact] 2025-12-01 11:01:17.783072 | localhost | ok 2025-12-01 11:01:17.816930 | 2025-12-01 11:01:17.817025 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-12-01 11:01:17.914498 | localhost | ok 2025-12-01 11:01:17.940240 | 2025-12-01 11:01:17.940447 | TASK [emit-job-header : Print job information] 2025-12-01 11:01:18.037484 | # Job Information 2025-12-01 11:01:18.037693 | Ansible Version: 2.15.12 2025-12-01 11:01:18.037731 | Job: cifmw-molecule-reproducer 2025-12-01 11:01:18.037755 | Pipeline: github-check 2025-12-01 11:01:18.037782 | Executor: ibm-bm4-ze.softwarefactory-project.io 2025-12-01 11:01:18.037803 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3505 2025-12-01 11:01:18.037823 | Log URL (when completed): https://logserver.rdoproject.org/88b/rdoproject.org/88ba13a085da4704a580dd4e573ec413/ 2025-12-01 11:01:18.037842 | Event ID: c7559b00-cea4-11f0-8bbe-0b02e3b2e2af 2025-12-01 11:01:18.046875 | 2025-12-01 11:01:18.048122 | LOOP [emit-job-header : Print node information] 2025-12-01 11:01:18.262590 | localhost | ok: 2025-12-01 11:01:18.262797 | localhost | # Node Information 2025-12-01 11:01:18.262829 | localhost | Inventory Hostname: controller 2025-12-01 11:01:18.262856 | localhost | Hostname: np0005540990 2025-12-01 11:01:18.262880 | localhost | Username: zuul 2025-12-01 11:01:18.262902 | localhost | Distro: CentOS 9 2025-12-01 11:01:18.262957 | localhost | Provider: ibm-bm4-nodepool 2025-12-01 11:01:18.262981 | localhost | Region: regionOne 2025-12-01 11:01:18.263001 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm 2025-12-01 11:01:18.263021 | localhost | Product Name: OpenStack Compute 2025-12-01 11:01:18.263039 | localhost | Interface IP: 192.168.26.110 2025-12-01 11:01:18.354413 | 2025-12-01 11:01:18.354511 | PLAY [all] 2025-12-01 11:01:18.371362 | 2025-12-01 11:01:18.371440 | TASK [Gather network facts] 2025-12-01 11:01:18.916610 | controller | ok 2025-12-01 11:01:18.950515 | 2025-12-01 11:01:18.950678 | TASK [include_role : start-zuul-console] 2025-12-01 11:01:19.002638 | controller | ok 2025-12-01 11:01:19.024064 | 2025-12-01 11:01:19.034410 | TASK [start-zuul-console : Start zuul_console daemon.] 2025-12-01 11:01:19.754993 | controller | ok 2025-12-01 11:01:19.796307 | 2025-12-01 11:01:19.796410 | TASK [include_role : add-build-sshkey] 2025-12-01 11:01:19.846587 | controller | ok 2025-12-01 11:01:19.881472 | 2025-12-01 11:01:19.881579 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2025-12-01 11:01:20.597549 | controller -> localhost | ok 2025-12-01 11:01:20.608297 | 2025-12-01 11:01:20.608407 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2025-12-01 11:01:20.725484 | controller | ok 2025-12-01 11:01:20.780952 | controller | included: /var/lib/zuul/builds/88ba13a085da4704a580dd4e573ec413/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2025-12-01 11:01:20.812492 | 2025-12-01 11:01:20.812588 | TASK [add-build-sshkey : Create Temp SSH key] 2025-12-01 11:01:23.248987 | controller -> localhost | Generating public/private rsa key pair. 2025-12-01 11:01:23.249176 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/88ba13a085da4704a580dd4e573ec413/work/88ba13a085da4704a580dd4e573ec413_id_rsa. 2025-12-01 11:01:23.249212 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/88ba13a085da4704a580dd4e573ec413/work/88ba13a085da4704a580dd4e573ec413_id_rsa.pub. 2025-12-01 11:01:23.249238 | controller -> localhost | The key fingerprint is: 2025-12-01 11:01:23.249259 | controller -> localhost | SHA256:0xJftgePo6HmtAvgY+SrquXbYgEIR1v0hsk1czY7f6s zuul-build-sshkey 2025-12-01 11:01:23.249282 | controller -> localhost | The key's randomart image is: 2025-12-01 11:01:23.249302 | controller -> localhost | +---[RSA 3072]----+ 2025-12-01 11:01:23.249322 | controller -> localhost | | ...o + + | 2025-12-01 11:01:23.249341 | controller -> localhost | |. .+ = = o | 2025-12-01 11:01:23.249359 | controller -> localhost | |o.. + o + + | 2025-12-01 11:01:23.249379 | controller -> localhost | |o . * o = | 2025-12-01 11:01:23.249397 | controller -> localhost | | . o S = = o | 2025-12-01 11:01:23.249415 | controller -> localhost | | .+ . + + + | 2025-12-01 11:01:23.249432 | controller -> localhost | | ..= . + . . | 2025-12-01 11:01:23.249450 | controller -> localhost | | ooo o = . . | 2025-12-01 11:01:23.249467 | controller -> localhost | |+o++o +.E | 2025-12-01 11:01:23.249484 | controller -> localhost | +----[SHA256]-----+ 2025-12-01 11:01:23.249530 | controller -> localhost | ok: Runtime: 0:00:01.008770 2025-12-01 11:01:23.257020 | 2025-12-01 11:01:23.257110 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2025-12-01 11:01:23.356145 | controller | ok 2025-12-01 11:01:23.395275 | controller | included: /var/lib/zuul/builds/88ba13a085da4704a580dd4e573ec413/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2025-12-01 11:01:23.433626 | 2025-12-01 11:01:23.433724 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2025-12-01 11:01:23.540845 | controller | skipping: Conditional result was False 2025-12-01 11:01:23.546693 | 2025-12-01 11:01:23.546795 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2025-12-01 11:01:24.626030 | controller | changed 2025-12-01 11:01:24.630861 | 2025-12-01 11:01:24.630940 | TASK [add-build-sshkey : Make sure user has a .ssh] 2025-12-01 11:01:24.974343 | controller | ok 2025-12-01 11:01:24.984419 | 2025-12-01 11:01:24.984492 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2025-12-01 11:01:26.309450 | controller | changed 2025-12-01 11:01:26.314424 | 2025-12-01 11:01:26.314503 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2025-12-01 11:01:27.663038 | controller | changed 2025-12-01 11:01:27.671746 | 2025-12-01 11:01:27.671813 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2025-12-01 11:01:27.810584 | controller | skipping: Conditional result was False 2025-12-01 11:01:27.817068 | 2025-12-01 11:01:27.817138 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2025-12-01 11:01:29.182790 | controller -> localhost | changed 2025-12-01 11:01:29.194030 | 2025-12-01 11:01:29.194102 | TASK [add-build-sshkey : Add back temp key] 2025-12-01 11:01:30.420152 | controller -> localhost | Identity added: /var/lib/zuul/builds/88ba13a085da4704a580dd4e573ec413/work/88ba13a085da4704a580dd4e573ec413_id_rsa (zuul-build-sshkey) 2025-12-01 11:01:30.420399 | controller -> localhost | ok: Runtime: 0:00:00.045197 2025-12-01 11:01:30.426329 | 2025-12-01 11:01:30.426404 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2025-12-01 11:01:31.070785 | controller | ok 2025-12-01 11:01:31.076325 | 2025-12-01 11:01:31.076407 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2025-12-01 11:01:31.179122 | controller | skipping: Conditional result was False 2025-12-01 11:01:31.188818 | 2025-12-01 11:01:31.188883 | TASK [include_role : validate-host] 2025-12-01 11:01:31.249655 | controller | ok 2025-12-01 11:01:31.326597 | 2025-12-01 11:01:31.326700 | TASK [validate-host : Define zuul_info_dir fact] 2025-12-01 11:01:31.451524 | controller | ok 2025-12-01 11:01:31.457837 | 2025-12-01 11:01:31.458093 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2025-12-01 11:01:32.106144 | controller -> localhost | ok 2025-12-01 11:01:32.112186 | 2025-12-01 11:01:32.112275 | TASK [validate-host : Collect information about the host] 2025-12-01 11:01:32.896825 | controller | ok 2025-12-01 11:01:32.924093 | 2025-12-01 11:01:32.924200 | TASK [validate-host : Sanitize hostname] 2025-12-01 11:01:33.118992 | controller | ok 2025-12-01 11:01:33.129023 | 2025-12-01 11:01:33.129110 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2025-12-01 11:01:34.706377 | controller -> localhost | changed 2025-12-01 11:01:34.712430 | 2025-12-01 11:01:34.712524 | TASK [validate-host : Collect information about zuul worker] 2025-12-01 11:01:35.825024 | controller | ok 2025-12-01 11:01:35.834937 | 2025-12-01 11:01:35.835026 | TASK [validate-host : Write out all zuul information for each host] 2025-12-01 11:01:37.361483 | controller -> localhost | changed 2025-12-01 11:01:37.376010 | 2025-12-01 11:01:37.376100 | TASK [include_role : prepare-workspace-openshift] 2025-12-01 11:01:37.481117 | controller | skipping: Conditional result was False 2025-12-01 11:01:37.487539 | 2025-12-01 11:01:37.487642 | TASK [include_role : remove-zuul-sshkey] 2025-12-01 11:01:37.565275 | controller | skipping: Conditional result was False 2025-12-01 11:01:37.572880 | 2025-12-01 11:01:37.572986 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2025-12-01 11:01:37.930336 | controller | ok: "logs" 2025-12-01 11:01:37.930568 | controller | ok: All items complete 2025-12-01 11:01:37.930599 | 2025-12-01 11:01:38.166190 | controller | ok: "artifacts" 2025-12-01 11:01:38.403659 | controller | ok: "docs" 2025-12-01 11:01:38.420062 | 2025-12-01 11:01:38.420181 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2025-12-01 11:01:38.807316 | controller | changed: "logs" 2025-12-01 11:01:39.069097 | controller | changed: "artifacts" 2025-12-01 11:01:39.292786 | controller | changed: "docs" 2025-12-01 11:01:39.375375 | 2025-12-01 11:01:39.375463 | PLAY RECAP 2025-12-01 11:01:39.375510 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-12-01 11:01:39.375541 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-12-01 11:01:39.375577 | 2025-12-01 11:01:39.752351 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-12-01 11:01:39.753050 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-12-01 11:01:41.693281 | 2025-12-01 11:01:41.693404 | PLAY [all] 2025-12-01 11:01:41.748872 | 2025-12-01 11:01:41.764806 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-12-01 11:01:41.995300 | controller | ok 2025-12-01 11:01:42.003846 | 2025-12-01 11:01:42.003988 | TASK [mirror-info-fork : Create /etc/ci] 2025-12-01 11:01:42.809719 | controller | changed 2025-12-01 11:01:42.819002 | 2025-12-01 11:01:42.819093 | TASK [mirror-info-fork : Install ci_mirror script] 2025-12-01 11:01:44.905035 | controller | changed 2025-12-01 11:01:44.951689 | 2025-12-01 11:01:44.951785 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2025-12-01 11:01:45.606759 | controller | changed: 2025-12-01 11:01:45.606953 | controller | { 2025-12-01 11:01:45.606994 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2025-12-01 11:01:45.607028 | controller | } 2025-12-01 11:01:45.899521 | controller | changed: 2025-12-01 11:01:45.899607 | controller | { 2025-12-01 11:01:45.899637 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2025-12-01 11:01:45.899660 | controller | } 2025-12-01 11:01:46.196333 | controller | changed: 2025-12-01 11:01:46.196431 | controller | { 2025-12-01 11:01:46.196461 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2025-12-01 11:01:46.196483 | controller | } 2025-12-01 11:01:46.503233 | controller | changed: 2025-12-01 11:01:46.503328 | controller | { 2025-12-01 11:01:46.503358 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2025-12-01 11:01:46.503381 | controller | } 2025-12-01 11:01:46.820822 | controller | changed: 2025-12-01 11:01:46.820952 | controller | { 2025-12-01 11:01:46.820990 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2025-12-01 11:01:46.821014 | controller | } 2025-12-01 11:01:47.122176 | controller | changed: 2025-12-01 11:01:47.122275 | controller | { 2025-12-01 11:01:47.122306 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2025-12-01 11:01:47.122329 | controller | } 2025-12-01 11:01:47.414157 | controller | changed: 2025-12-01 11:01:47.414238 | controller | { 2025-12-01 11:01:47.414267 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2025-12-01 11:01:47.414291 | controller | } 2025-12-01 11:01:47.874226 | controller | changed: 2025-12-01 11:01:47.874311 | controller | { 2025-12-01 11:01:47.874341 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2025-12-01 11:01:47.874364 | controller | } 2025-12-01 11:01:47.996967 | controller | changed: 2025-12-01 11:01:47.997086 | controller | { 2025-12-01 11:01:47.997119 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2025-12-01 11:01:47.997143 | controller | } 2025-12-01 11:01:48.275744 | controller | changed: 2025-12-01 11:01:48.275831 | controller | { 2025-12-01 11:01:48.275858 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2025-12-01 11:01:48.275878 | controller | } 2025-12-01 11:01:48.572666 | controller | changed: 2025-12-01 11:01:48.572747 | controller | { 2025-12-01 11:01:48.572776 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2025-12-01 11:01:48.572798 | controller | } 2025-12-01 11:01:48.879398 | controller | changed: 2025-12-01 11:01:48.879485 | controller | { 2025-12-01 11:01:48.879516 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2025-12-01 11:01:48.879539 | controller | } 2025-12-01 11:01:49.174377 | controller | changed: 2025-12-01 11:01:49.174464 | controller | { 2025-12-01 11:01:49.174493 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGpU/BepK3qX0NRf5Np+dOBDqzQEefhNrw2DCZaH3uWW rebtoor@monolith" 2025-12-01 11:01:49.174516 | controller | } 2025-12-01 11:01:49.463951 | controller | changed: 2025-12-01 11:01:49.464038 | controller | { 2025-12-01 11:01:49.464067 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2025-12-01 11:01:49.464090 | controller | } 2025-12-01 11:01:49.783332 | controller | changed: 2025-12-01 11:01:49.783423 | controller | { 2025-12-01 11:01:49.783450 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2025-12-01 11:01:49.783471 | controller | } 2025-12-01 11:01:50.077698 | controller | changed: 2025-12-01 11:01:50.077802 | controller | { 2025-12-01 11:01:50.077832 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2025-12-01 11:01:50.077861 | controller | } 2025-12-01 11:01:50.382520 | controller | changed: 2025-12-01 11:01:50.382616 | controller | { 2025-12-01 11:01:50.382647 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2025-12-01 11:01:50.382670 | controller | } 2025-12-01 11:01:50.697734 | controller | changed: 2025-12-01 11:01:50.697938 | controller | { 2025-12-01 11:01:50.699071 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2025-12-01 11:01:50.699111 | controller | } 2025-12-01 11:01:51.002713 | controller | changed: 2025-12-01 11:01:51.002808 | controller | { 2025-12-01 11:01:51.002834 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2025-12-01 11:01:51.002856 | controller | } 2025-12-01 11:01:51.292971 | controller | changed: 2025-12-01 11:01:51.293050 | controller | { 2025-12-01 11:01:51.293078 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2025-12-01 11:01:51.293102 | controller | } 2025-12-01 11:01:51.581168 | controller | changed: 2025-12-01 11:01:51.581241 | controller | { 2025-12-01 11:01:51.581281 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2025-12-01 11:01:51.581305 | controller | } 2025-12-01 11:01:51.885278 | controller | changed: 2025-12-01 11:01:51.885359 | controller | { 2025-12-01 11:01:51.885388 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2025-12-01 11:01:51.885410 | controller | } 2025-12-01 11:01:52.196769 | controller | changed: 2025-12-01 11:01:52.196858 | controller | { 2025-12-01 11:01:52.196886 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2025-12-01 11:01:52.196925 | controller | } 2025-12-01 11:01:52.502944 | controller | changed: 2025-12-01 11:01:52.503120 | controller | { 2025-12-01 11:01:52.503271 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2025-12-01 11:01:52.503299 | controller | } 2025-12-01 11:01:52.794157 | controller | changed: 2025-12-01 11:01:52.794350 | controller | { 2025-12-01 11:01:52.794387 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2025-12-01 11:01:52.794411 | controller | } 2025-12-01 11:01:53.083109 | controller | changed: 2025-12-01 11:01:53.083199 | controller | { 2025-12-01 11:01:53.083227 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2025-12-01 11:01:53.083248 | controller | } 2025-12-01 11:01:53.142353 | 2025-12-01 11:01:53.142455 | TASK [Set timezone to UTC] 2025-12-01 11:01:53.793586 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2025-12-01 11:01:53.817950 | 2025-12-01 11:01:53.818049 | TASK [Create nodepool directory] 2025-12-01 11:01:54.100623 | controller | changed 2025-12-01 11:01:54.125323 | 2025-12-01 11:01:54.125424 | TASK [Create nodepool sub_nodes file] 2025-12-01 11:01:55.191430 | controller | changed 2025-12-01 11:01:55.196459 | 2025-12-01 11:01:55.196555 | TASK [Create nodepool sub_nodes_private file] 2025-12-01 11:01:56.198062 | controller | changed 2025-12-01 11:01:56.203448 | 2025-12-01 11:01:56.203513 | LOOP [Populate nodepool sub_nodes file] 2025-12-01 11:01:56.310314 | 2025-12-01 11:01:56.310527 | LOOP [Populate nodepool sub_nodes_private file] 2025-12-01 11:01:56.366169 | 2025-12-01 11:01:56.366318 | TASK [Create nodepool primary file] 2025-12-01 11:01:56.400883 | controller | skipping: Conditional result was False 2025-12-01 11:01:56.406853 | 2025-12-01 11:01:56.406940 | TASK [Create nodepool node_private for this node] 2025-12-01 11:01:57.459677 | controller | changed 2025-12-01 11:01:57.465524 | 2025-12-01 11:01:57.465605 | LOOP [Copy ssh keys to nodepool directory] 2025-12-01 11:01:57.950453 | controller | ok: Item: id_rsa Runtime: 0:00:00.004462 2025-12-01 11:01:57.950650 | 2025-12-01 11:01:58.167472 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.004253 2025-12-01 11:01:58.175226 | 2025-12-01 11:01:58.175329 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2025-12-01 11:01:59.256358 | controller | changed 2025-12-01 11:01:59.263308 | 2025-12-01 11:01:59.263392 | TASK [Validate sudoers config after edits] 2025-12-01 11:01:59.613599 | controller | /etc/sudoers: parsed OK 2025-12-01 11:01:59.613652 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2025-12-01 11:01:59.613663 | controller | /etc/sudoers.d/zuul: parsed OK 2025-12-01 11:01:59.613670 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2025-12-01 11:01:59.806188 | controller | ok: Runtime: 0:00:00.005124 2025-12-01 11:01:59.813491 | 2025-12-01 11:01:59.813575 | TASK [Show the environment passed in to job shell scripts] 2025-12-01 11:02:00.222287 | controller | SHELL=/bin/bash 2025-12-01 11:02:00.222330 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2025-12-01 11:02:00.222340 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2025-12-01 11:02:00.222346 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/23/3523/9dca7030e1689ab350d0cc525f1944d26503b3cc^openstack-k8s-operators/ci-framework:main:refs/changes/05/3505/4fd568413e9fbcb9b5c62cc50f536ea9eafcd481 2025-12-01 11:02:00.222354 | controller | PWD=/home/zuul 2025-12-01 11:02:00.222360 | controller | ZUUL_PIPELINE=github-check 2025-12-01 11:02:00.222365 | controller | LOGNAME=zuul 2025-12-01 11:02:00.222370 | controller | XDG_SESSION_TYPE=tty 2025-12-01 11:02:00.222375 | controller | _=/usr/bin/env 2025-12-01 11:02:00.222431 | controller | MOTD_SHOWN=pam 2025-12-01 11:02:00.222440 | controller | HOME=/home/zuul 2025-12-01 11:02:00.222445 | controller | LANG=en_US.UTF-8 2025-12-01 11:02:00.222451 | controller | SSH_CONNECTION=192.168.26.12 49500 192.168.26.110 22 2025-12-01 11:02:00.222456 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2025-12-01 11:02:00.222462 | controller | ZUUL_CHANGE_IDS=3523,9dca7030e1689ab350d0cc525f1944d26503b3cc 3505,4fd568413e9fbcb9b5c62cc50f536ea9eafcd481 2025-12-01 11:02:00.222467 | controller | WORKSPACE=/home/zuul/workspace 2025-12-01 11:02:00.222472 | controller | XDG_SESSION_CLASS=user 2025-12-01 11:02:00.222478 | controller | SELINUX_ROLE_REQUESTED= 2025-12-01 11:02:00.222483 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2025-12-01 11:02:00.222488 | controller | USER=zuul 2025-12-01 11:02:00.222494 | controller | ZUUL_VOTING=True 2025-12-01 11:02:00.222499 | controller | BUILD_TIMEOUT=5400000 2025-12-01 11:02:00.222504 | controller | SELINUX_USE_CURRENT_RANGE= 2025-12-01 11:02:00.222509 | controller | SHLVL=1 2025-12-01 11:02:00.222514 | controller | ZUUL_PATCHSET=4fd568413e9fbcb9b5c62cc50f536ea9eafcd481 2025-12-01 11:02:00.222520 | controller | XDG_SESSION_ID=1 2025-12-01 11:02:00.222525 | controller | ZUUL_BRANCH=main 2025-12-01 11:02:00.222530 | controller | XDG_RUNTIME_DIR=/run/user/1000 2025-12-01 11:02:00.222536 | controller | SSH_CLIENT=192.168.26.12 49500 22 2025-12-01 11:02:00.222541 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2025-12-01 11:02:00.222546 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2025-12-01 11:02:00.222551 | controller | which_declare=declare -f 2025-12-01 11:02:00.222557 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2025-12-01 11:02:00.222562 | controller | SELINUX_LEVEL_REQUESTED= 2025-12-01 11:02:00.222568 | controller | ZUUL_CHANGE=3505 2025-12-01 11:02:00.222573 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2025-12-01 11:02:00.222578 | controller | ZUUL_UUID=88ba13a085da4704a580dd4e573ec413 2025-12-01 11:02:00.222583 | controller | BASH_FUNC_which%%=() { ( alias; 2025-12-01 11:02:00.222590 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2025-12-01 11:02:00.222596 | controller | } 2025-12-01 11:02:00.394112 | controller | ok: Runtime: 0:00:00.006466 2025-12-01 11:02:00.401818 | 2025-12-01 11:02:00.401983 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2025-12-01 11:02:00.416301 | controller | skipping: Conditional result was False 2025-12-01 11:02:00.453032 | 2025-12-01 11:02:00.453129 | TASK [Symlink /home/zuul-worker/workspace] 2025-12-01 11:02:00.979810 | controller | skipping: Conditional result was False 2025-12-01 11:02:00.987363 | 2025-12-01 11:02:00.987435 | TASK [Ensure legacy workspace directory] 2025-12-01 11:02:01.299121 | controller | changed 2025-12-01 11:02:01.370495 | 2025-12-01 11:02:01.370630 | PLAY RECAP 2025-12-01 11:02:01.370685 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-12-01 11:02:01.370712 | 2025-12-01 11:02:01.544029 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-12-01 11:02:01.544734 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-12-01 11:02:02.451654 | 2025-12-01 11:02:02.451759 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2025-12-01 11:02:02.494781 | 2025-12-01 11:02:02.494863 | TASK [Create zuul-output directory] 2025-12-01 11:02:03.007289 | controller | changed 2025-12-01 11:02:03.017676 | 2025-12-01 11:02:03.017774 | TASK [Slurp Zuul inventory test] 2025-12-01 11:02:03.455886 | controller -> localhost | ok 2025-12-01 11:02:03.463663 | 2025-12-01 11:02:03.463754 | TASK [Save zuul inventory] 2025-12-01 11:02:05.077705 | controller | changed 2025-12-01 11:02:05.082898 | 2025-12-01 11:02:05.082992 | TASK [Save zuul vars without the change_message] 2025-12-01 11:02:06.207628 | controller | changed 2025-12-01 11:02:06.267534 | 2025-12-01 11:02:06.267623 | PLAY RECAP 2025-12-01 11:02:06.267670 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-12-01 11:02:06.267694 | 2025-12-01 11:02:06.466806 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-12-01 11:02:06.467533 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-12-01 11:02:07.448632 | 2025-12-01 11:02:07.448759 | PLAY [Run ci/playbooks/molecule-prepare.yml] 2025-12-01 11:02:07.479625 | 2025-12-01 11:02:07.479759 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh] 2025-12-01 11:02:07.530598 | controller | ok 2025-12-01 11:02:07.584126 | 2025-12-01 11:02:07.584272 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-12-01 11:02:07.709622 | controller | skipping: Conditional result was False 2025-12-01 11:02:07.715442 | 2025-12-01 11:02:07.715535 | TASK [mirror-info-fork : Create /etc/ci] 2025-12-01 11:02:08.194328 | controller | ok 2025-12-01 11:02:08.200385 | 2025-12-01 11:02:08.200466 | TASK [mirror-info-fork : Install ci_mirror script] 2025-12-01 11:02:09.355935 | controller | ok 2025-12-01 11:02:09.376015 | 2025-12-01 11:02:09.376096 | TASK [Prepare workspace] 2025-12-01 11:02:09.415224 | controller | ok 2025-12-01 11:02:09.432814 | 2025-12-01 11:02:09.432883 | TASK [prepare-workspace : Start zuul_console daemon.] 2025-12-01 11:02:09.933179 | controller | ok 2025-12-01 11:02:09.940081 | 2025-12-01 11:02:09.940210 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2025-12-01 11:02:12.910297 | controller | Output suppressed because no_log was given 2025-12-01 11:02:12.919772 | 2025-12-01 11:02:12.919851 | LOOP [Create zuul-output directory] 2025-12-01 11:02:13.167973 | controller | changed: "/home/zuul/ci-framework-data/logs" 2025-12-01 11:02:13.393458 | controller | ok: "/home/zuul/zuul-output/logs" 2025-12-01 11:02:13.403771 | 2025-12-01 11:02:13.403897 | TASK [Install required packages] 2025-12-01 11:02:29.756790 | controller | ok: Nothing to do 2025-12-01 11:02:29.762883 | 2025-12-01 11:02:29.762974 | TASK [Install venv] 2025-12-01 11:03:30.236508 | controller | changed 2025-12-01 11:03:30.262760 | 2025-12-01 11:03:30.262962 | PLAY RECAP 2025-12-01 11:03:30.263026 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-12-01 11:03:30.263054 | 2025-12-01 11:03:30.343877 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main] 2025-12-01 11:03:30.344706 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-12-01 11:03:30.860219 | 2025-12-01 11:03:30.860315 | PLAY [Run ci/playbooks/molecule-test.yml] 2025-12-01 11:03:30.880389 | 2025-12-01 11:03:30.880461 | TASK [Gather required facts] 2025-12-01 11:03:31.436706 | controller | ok 2025-12-01 11:03:31.441900 | 2025-12-01 11:03:31.442022 | TASK [Load environment var if instructed to] 2025-12-01 11:03:31.465796 | controller | skipping: Conditional result was False 2025-12-01 11:03:31.471429 | 2025-12-01 11:03:31.471498 | TASK [Ensure group_vars dir exists] 2025-12-01 11:03:31.854265 | controller | ok 2025-12-01 11:03:31.859364 | 2025-12-01 11:03:31.859431 | TASK [Print related variables] 2025-12-01 11:03:31.888055 | controller | ok: 2025-12-01 11:03:31.888171 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml 2025-12-01 11:03:31.888202 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer 2025-12-01 11:03:31.893022 | 2025-12-01 11:03:31.893086 | TASK [Run molecule] 2025-12-01 11:03:32.975516 | controller | INFO Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml 2025-12-01 11:03:33.259679 | controller | INFO Performing prerun with role_name_check=0... 2025-12-01 11:03:53.662809 | controller | WARNING Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-01 11:03:53.663255 | controller | WARNING Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-01 11:03:53.663713 | controller | WARNING Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-01 11:03:53.664173 | controller | WARNING Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-01 11:03:53.664652 | controller | WARNING Another version of 'cifmw.general' 1.0.0+3fae496b was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+3fae496b (/home/zuul/.ansible/collections/ansible_collections). 2025-12-01 11:03:53.665090 | controller | WARNING Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-01 11:03:53.665547 | controller | WARNING Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-01 11:03:53.665972 | controller | WARNING Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-01 11:03:53.666410 | controller | WARNING Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-01 11:03:53.666841 | controller | WARNING Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-01 11:03:53.667284 | controller | WARNING Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-01 11:03:53.667723 | controller | WARNING Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-01 11:03:53.668167 | controller | WARNING Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-01 11:03:53.668606 | controller | WARNING Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-01 11:03:53.669054 | controller | WARNING Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections). 2025-12-01 11:03:53.678412 | controller | INFO Running crc_layout > prepare 2025-12-01 11:03:54.418610 | controller | 2025-12-01 11:03:54.418671 | controller | PLAY [Prepare] ***************************************************************** 2025-12-01 11:03:54.418780 | controller | 2025-12-01 11:03:54.418871 | controller | TASK [Gathering Facts] ********************************************************* 2025-12-01 11:03:54.418969 | controller | Monday 01 December 2025 11:03:54 +0000 (0:00:00.020) 0:00:00.020 ******* 2025-12-01 11:03:55.249714 | controller | ok: [instance] 2025-12-01 11:03:55.249754 | controller | 2025-12-01 11:03:55.249889 | controller | TASK [Create custom basedir] *************************************************** 2025-12-01 11:03:55.249961 | controller | Monday 01 December 2025 11:03:55 +0000 (0:00:00.831) 0:00:00.852 ******* 2025-12-01 11:03:55.565277 | controller | changed: [instance] 2025-12-01 11:03:55.565322 | controller | 2025-12-01 11:03:55.565528 | controller | TASK [test_deps : Gather facts if they don't exist] **************************** 2025-12-01 11:03:55.565634 | controller | Monday 01 December 2025 11:03:55 +0000 (0:00:00.315) 0:00:01.168 ******* 2025-12-01 11:03:55.583092 | controller | skipping: [instance] 2025-12-01 11:03:55.583185 | controller | 2025-12-01 11:03:55.583322 | controller | TASK [test_deps : Gather variables for each operating system] ****************** 2025-12-01 11:03:55.583494 | controller | Monday 01 December 2025 11:03:55 +0000 (0:00:00.018) 0:00:01.186 ******* 2025-12-01 11:03:55.624349 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml) 2025-12-01 11:03:55.624401 | controller | 2025-12-01 11:03:55.624556 | controller | TASK [test_deps : Detect mirrors file] ***************************************** 2025-12-01 11:03:55.624656 | controller | Monday 01 December 2025 11:03:55 +0000 (0:00:00.041) 0:00:01.227 ******* 2025-12-01 11:03:55.909710 | controller | ok: [instance] 2025-12-01 11:03:55.909786 | controller | 2025-12-01 11:03:55.909899 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] *********** 2025-12-01 11:03:55.910009 | controller | Monday 01 December 2025 11:03:55 +0000 (0:00:00.285) 0:00:01.512 ******* 2025-12-01 11:03:56.122728 | controller | ok: [instance] 2025-12-01 11:03:56.122820 | controller | 2025-12-01 11:03:56.122933 | controller | TASK [test_deps : Disable ubi 9 repos] ***************************************** 2025-12-01 11:03:56.123041 | controller | Monday 01 December 2025 11:03:56 +0000 (0:00:00.212) 0:00:01.725 ******* 2025-12-01 11:03:56.828318 | controller | ok: [instance] => (item=ubi-9-appstream) 2025-12-01 11:03:56.828404 | controller | ok: [instance] => (item=ubi-9-baseos) 2025-12-01 11:03:56.828532 | controller | ok: [instance] => (item=ubi-9-codeready-builder) 2025-12-01 11:03:56.828637 | controller | 2025-12-01 11:03:56.828768 | controller | TASK [Deploy repo-setup] ******************************************************* 2025-12-01 11:03:56.828861 | controller | Monday 01 December 2025 11:03:56 +0000 (0:00:00.706) 0:00:02.431 ******* 2025-12-01 11:03:56.890268 | controller | 2025-12-01 11:03:56.890365 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-12-01 11:03:56.890488 | controller | Monday 01 December 2025 11:03:56 +0000 (0:00:00.062) 0:00:02.493 ******* 2025-12-01 11:03:56.909122 | controller | skipping: [instance] 2025-12-01 11:03:56.909165 | controller | 2025-12-01 11:03:56.909340 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-12-01 11:03:56.909447 | controller | Monday 01 December 2025 11:03:56 +0000 (0:00:00.018) 0:00:02.512 ******* 2025-12-01 11:03:56.940048 | controller | skipping: [instance] 2025-12-01 11:03:56.940146 | controller | 2025-12-01 11:03:56.940327 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-12-01 11:03:56.940424 | controller | Monday 01 December 2025 11:03:56 +0000 (0:00:00.030) 0:00:02.543 ******* 2025-12-01 11:03:56.959252 | controller | skipping: [instance] 2025-12-01 11:03:56.959331 | controller | 2025-12-01 11:03:56.959500 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-12-01 11:03:56.959598 | controller | Monday 01 December 2025 11:03:56 +0000 (0:00:00.019) 0:00:02.562 ******* 2025-12-01 11:03:56.977882 | controller | skipping: [instance] 2025-12-01 11:03:56.977956 | controller | 2025-12-01 11:03:56.978076 | controller | TASK [repo_setup : Ensure directories are present] ***************************** 2025-12-01 11:03:56.978221 | controller | Monday 01 December 2025 11:03:56 +0000 (0:00:00.018) 0:00:02.580 ******* 2025-12-01 11:03:57.518377 | controller | changed: [instance] => (item=tmp) 2025-12-01 11:03:57.518423 | controller | changed: [instance] => (item=artifacts/repositories) 2025-12-01 11:03:57.518563 | controller | changed: [instance] => (item=venv/repo_setup) 2025-12-01 11:03:57.518617 | controller | 2025-12-01 11:03:57.518733 | controller | TASK [repo_setup : Make sure git-core package is installed] ******************** 2025-12-01 11:03:57.518827 | controller | Monday 01 December 2025 11:03:57 +0000 (0:00:00.540) 0:00:03.121 ******* 2025-12-01 11:03:58.336618 | controller | ok: [instance] 2025-12-01 11:03:58.336677 | controller | 2025-12-01 11:03:58.336952 | controller | TASK [repo_setup : Get repo-setup repository] ********************************** 2025-12-01 11:03:59.411082 | controller | Monday 01 December 2025 11:03:58 +0000 (0:00:00.818) 0:00:03.939 ******* 2025-12-01 11:03:59.411119 | controller | changed: [instance] 2025-12-01 11:04:07.236249 | controller | 2025-12-01 11:04:07.236285 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************ 2025-12-01 11:04:07.236295 | controller | Monday 01 December 2025 11:03:59 +0000 (0:00:01.074) 0:00:05.013 ******* 2025-12-01 11:04:07.236307 | controller | changed: [instance] 2025-12-01 11:04:07.236694 | controller | 2025-12-01 11:04:07.236728 | controller | TASK [repo_setup : Install repo-setup package] ********************************* 2025-12-01 11:04:08.010240 | controller | Monday 01 December 2025 11:04:07 +0000 (0:00:07.825) 0:00:12.839 ******* 2025-12-01 11:04:08.010299 | controller | changed: [instance] 2025-12-01 11:04:08.032139 | controller | 2025-12-01 11:04:08.032172 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] *** 2025-12-01 11:04:08.032180 | controller | Monday 01 December 2025 11:04:08 +0000 (0:00:00.773) 0:00:13.612 ******* 2025-12-01 11:04:08.032190 | controller | skipping: [instance] 2025-12-01 11:04:08.846137 | controller | 2025-12-01 11:04:08.846166 | controller | TASK [repo_setup : Run repo-setup] ********************************************* 2025-12-01 11:04:08.846174 | controller | Monday 01 December 2025 11:04:08 +0000 (0:00:00.022) 0:00:13.635 ******* 2025-12-01 11:04:08.846185 | controller | changed: [instance] 2025-12-01 11:04:08.846393 | controller | 2025-12-01 11:04:08.846432 | controller | TASK [repo_setup : Get component repo] ***************************************** 2025-12-01 11:04:08.882045 | controller | Monday 01 December 2025 11:04:08 +0000 (0:00:00.813) 0:00:14.449 ******* 2025-12-01 11:04:08.882081 | controller | skipping: [instance] 2025-12-01 11:04:08.917933 | controller | 2025-12-01 11:04:08.917951 | controller | TASK [repo_setup : Rename component repo] ************************************** 2025-12-01 11:04:08.917959 | controller | Monday 01 December 2025 11:04:08 +0000 (0:00:00.036) 0:00:14.485 ******* 2025-12-01 11:04:08.917967 | controller | skipping: [instance] 2025-12-01 11:04:08.954561 | controller | 2025-12-01 11:04:08.954579 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] ******* 2025-12-01 11:04:08.954587 | controller | Monday 01 December 2025 11:04:08 +0000 (0:00:00.035) 0:00:14.521 ******* 2025-12-01 11:04:08.954599 | controller | skipping: [instance] 2025-12-01 11:04:09.486176 | controller | 2025-12-01 11:04:09.486206 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************ 2025-12-01 11:04:09.486214 | controller | Monday 01 December 2025 11:04:08 +0000 (0:00:00.036) 0:00:14.557 ******* 2025-12-01 11:04:09.486224 | controller | changed: [instance] 2025-12-01 11:04:09.929936 | controller | 2025-12-01 11:04:09.929970 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] ******************* 2025-12-01 11:04:09.929978 | controller | Monday 01 December 2025 11:04:09 +0000 (0:00:00.531) 0:00:15.089 ******* 2025-12-01 11:04:09.929988 | controller | changed: [instance] 2025-12-01 11:04:09.958190 | controller | 2025-12-01 11:04:09.958226 | controller | TASK [repo_setup : Dump current-podified hash] ********************************* 2025-12-01 11:04:09.958236 | controller | Monday 01 December 2025 11:04:09 +0000 (0:00:00.443) 0:00:15.532 ******* 2025-12-01 11:04:09.958256 | controller | skipping: [instance] 2025-12-01 11:04:09.958323 | controller | 2025-12-01 11:04:09.958345 | controller | TASK [repo_setup : Slurp current podified hash] ******************************** 2025-12-01 11:04:09.958358 | controller | Monday 01 December 2025 11:04:09 +0000 (0:00:00.028) 0:00:15.561 ******* 2025-12-01 11:04:09.985851 | controller | skipping: [instance] 2025-12-01 11:04:10.015719 | controller | 2025-12-01 11:04:10.015741 | controller | TASK [repo_setup : Update the value of full_hash] ****************************** 2025-12-01 11:04:10.015751 | controller | Monday 01 December 2025 11:04:09 +0000 (0:00:00.027) 0:00:15.589 ******* 2025-12-01 11:04:10.015761 | controller | skipping: [instance] 2025-12-01 11:04:10.053984 | controller | 2025-12-01 11:04:10.054003 | controller | TASK [repo_setup : Export hashes facts for further use] ************************ 2025-12-01 11:04:10.054010 | controller | Monday 01 December 2025 11:04:10 +0000 (0:00:00.029) 0:00:15.618 ******* 2025-12-01 11:04:10.054019 | controller | ok: [instance] 2025-12-01 11:04:10.082276 | controller | 2025-12-01 11:04:10.082311 | controller | TASK [repo_setup : Create download directory] ********************************** 2025-12-01 11:04:10.082320 | controller | Monday 01 December 2025 11:04:10 +0000 (0:00:00.038) 0:00:15.657 ******* 2025-12-01 11:04:10.082334 | controller | skipping: [instance] 2025-12-01 11:04:10.082364 | controller | 2025-12-01 11:04:10.082372 | controller | TASK [repo_setup : Print the URL to request] *********************************** 2025-12-01 11:04:10.082381 | controller | Monday 01 December 2025 11:04:10 +0000 (0:00:00.028) 0:00:15.685 ******* 2025-12-01 11:04:10.132054 | controller | skipping: [instance] 2025-12-01 11:04:10.159085 | controller | 2025-12-01 11:04:10.159109 | controller | TASK [Download the RPM] ******************************************************** 2025-12-01 11:04:10.159119 | controller | Monday 01 December 2025 11:04:10 +0000 (0:00:00.049) 0:00:15.735 ******* 2025-12-01 11:04:10.159131 | controller | skipping: [instance] 2025-12-01 11:04:10.159324 | controller | 2025-12-01 11:04:10.159501 | controller | TASK [repo_setup : Install RHOS Release tool] ********************************** 2025-12-01 11:04:10.159667 | controller | Monday 01 December 2025 11:04:10 +0000 (0:00:00.027) 0:00:15.762 ******* 2025-12-01 11:04:10.185828 | controller | skipping: [instance] 2025-12-01 11:04:10.186013 | controller | 2025-12-01 11:04:10.186214 | controller | TASK [repo_setup : Get rhos-release tool version] ****************************** 2025-12-01 11:04:10.186361 | controller | Monday 01 December 2025 11:04:10 +0000 (0:00:00.026) 0:00:15.789 ******* 2025-12-01 11:04:10.212240 | controller | skipping: [instance] 2025-12-01 11:04:10.212428 | controller | 2025-12-01 11:04:10.212642 | controller | TASK [repo_setup : Print rhos-release tool version] **************************** 2025-12-01 11:04:10.212811 | controller | Monday 01 December 2025 11:04:10 +0000 (0:00:00.026) 0:00:15.815 ******* 2025-12-01 11:04:10.241752 | controller | skipping: [instance] 2025-12-01 11:04:10.241934 | controller | 2025-12-01 11:04:10.242157 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] *** 2025-12-01 11:04:10.242308 | controller | Monday 01 December 2025 11:04:10 +0000 (0:00:00.029) 0:00:15.845 ******* 2025-12-01 11:04:10.267462 | controller | skipping: [instance] 2025-12-01 11:04:10.267646 | controller | 2025-12-01 11:04:10.267819 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] *************************** 2025-12-01 11:04:10.267993 | controller | Monday 01 December 2025 11:04:10 +0000 (0:00:00.025) 0:00:15.871 ******* 2025-12-01 11:04:10.453963 | controller | ok: [instance] 2025-12-01 11:04:10.659759 | controller | 2025-12-01 11:04:10.659789 | controller | TASK [repo_setup : Use RDO proxy mirrors] ************************************** 2025-12-01 11:04:10.659798 | controller | Monday 01 December 2025 11:04:10 +0000 (0:00:00.185) 0:00:16.056 ******* 2025-12-01 11:04:10.659808 | controller | changed: [instance] 2025-12-01 11:04:10.880903 | controller | 2025-12-01 11:04:10.880936 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] *** 2025-12-01 11:04:10.880944 | controller | Monday 01 December 2025 11:04:10 +0000 (0:00:00.205) 0:00:16.262 ******* 2025-12-01 11:04:10.880953 | controller | changed: [instance] 2025-12-01 11:04:10.901828 | controller | 2025-12-01 11:04:10.901854 | controller | TASK [repo_setup : Check for gating.repo file on content provider] ************* 2025-12-01 11:04:10.901870 | controller | Monday 01 December 2025 11:04:10 +0000 (0:00:00.221) 0:00:16.483 ******* 2025-12-01 11:04:10.901881 | controller | skipping: [instance] 2025-12-01 11:04:10.923146 | controller | 2025-12-01 11:04:10.923178 | controller | TASK [repo_setup : Populate gating repo from content provider ip] ************** 2025-12-01 11:04:10.923186 | controller | Monday 01 December 2025 11:04:10 +0000 (0:00:00.021) 0:00:16.505 ******* 2025-12-01 11:04:10.923196 | controller | skipping: [instance] 2025-12-01 11:04:10.923230 | controller | 2025-12-01 11:04:10.923238 | controller | TASK [repo_setup : Check for DLRN repo at the destination] ********************* 2025-12-01 11:04:10.923245 | controller | Monday 01 December 2025 11:04:10 +0000 (0:00:00.021) 0:00:16.526 ******* 2025-12-01 11:04:10.945682 | controller | skipping: [instance] 2025-12-01 11:04:10.966861 | controller | 2025-12-01 11:04:10.966880 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] *** 2025-12-01 11:04:10.966888 | controller | Monday 01 December 2025 11:04:10 +0000 (0:00:00.022) 0:00:16.548 ******* 2025-12-01 11:04:10.966897 | controller | skipping: [instance] 2025-12-01 11:04:10.988236 | controller | 2025-12-01 11:04:10.988341 | controller | TASK [repo_setup : Check for DLRN component repo] ****************************** 2025-12-01 11:04:10.988352 | controller | Monday 01 December 2025 11:04:10 +0000 (0:00:00.021) 0:00:16.570 ******* 2025-12-01 11:04:10.988366 | controller | skipping: [instance] 2025-12-01 11:04:10.988400 | controller | 2025-12-01 11:04:10.988411 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] *** 2025-12-01 11:04:10.988461 | controller | Monday 01 December 2025 11:04:10 +0000 (0:00:00.021) 0:00:16.591 ******* 2025-12-01 11:04:11.016285 | controller | skipping: [instance] 2025-12-01 11:04:11.016470 | controller | 2025-12-01 11:04:11.016644 | controller | TASK [test_deps : Look for redhat-release rpm] ********************************* 2025-12-01 11:04:11.016792 | controller | Monday 01 December 2025 11:04:11 +0000 (0:00:00.028) 0:00:16.619 ******* 2025-12-01 11:04:11.045741 | controller | skipping: [instance] 2025-12-01 11:04:11.045901 | controller | 2025-12-01 11:04:11.046045 | controller | TASK [test_deps : Remove redhat-release] *************************************** 2025-12-01 11:04:11.046223 | controller | Monday 01 December 2025 11:04:11 +0000 (0:00:00.029) 0:00:16.649 ******* 2025-12-01 11:04:11.075840 | controller | skipping: [instance] 2025-12-01 11:04:11.076026 | controller | 2025-12-01 11:04:11.076245 | controller | TASK [test_deps : Install centos-stream-release] ******************************* 2025-12-01 11:04:11.076420 | controller | Monday 01 December 2025 11:04:11 +0000 (0:00:00.030) 0:00:16.679 ******* 2025-12-01 11:04:11.105786 | controller | skipping: [instance] 2025-12-01 11:04:11.105951 | controller | 2025-12-01 11:04:11.106126 | controller | TASK [test_deps : Install additional packages] ********************************* 2025-12-01 11:04:11.106280 | controller | Monday 01 December 2025 11:04:11 +0000 (0:00:00.029) 0:00:16.709 ******* 2025-12-01 11:04:11.134516 | controller | skipping: [instance] 2025-12-01 11:04:11.134705 | controller | 2025-12-01 11:04:11.134878 | controller | TASK [test_deps : Install selinux python libs] ********************************* 2025-12-01 11:04:11.135028 | controller | Monday 01 December 2025 11:04:11 +0000 (0:00:00.028) 0:00:16.738 ******* 2025-12-01 11:04:58.356884 | controller | ok: [instance] 2025-12-01 11:04:59.602164 | controller | 2025-12-01 11:04:59.602197 | controller | TASK [test_deps : Install python yaml libs] ************************************ 2025-12-01 11:04:59.602205 | controller | Monday 01 December 2025 11:04:58 +0000 (0:00:47.221) 0:01:03.959 ******* 2025-12-01 11:04:59.602215 | controller | ok: [instance] 2025-12-01 11:04:59.602252 | controller | 2025-12-01 11:04:59.602521 | controller | TASK [test_deps : Install extra packages] ************************************** 2025-12-01 11:04:59.635704 | controller | Monday 01 December 2025 11:04:59 +0000 (0:00:01.245) 0:01:05.205 ******* 2025-12-01 11:04:59.635729 | controller | skipping: [instance] 2025-12-01 11:04:59.676657 | controller | 2025-12-01 11:04:59.676679 | controller | TASK [ci_setup : Gather variables for each operating system] ******************* 2025-12-01 11:04:59.676689 | controller | Monday 01 December 2025 11:04:59 +0000 (0:00:00.033) 0:01:05.238 ******* 2025-12-01 11:04:59.676700 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2025-12-01 11:04:59.696137 | controller | 2025-12-01 11:04:59.696169 | controller | TASK [ci_setup : List packages to install] ************************************* 2025-12-01 11:04:59.696183 | controller | Monday 01 December 2025 11:04:59 +0000 (0:00:00.040) 0:01:05.279 ******* 2025-12-01 11:04:59.696193 | controller | ok: [instance] => 2025-12-01 11:04:59.696550 | controller | cifmw_ci_setup_packages: 2025-12-01 11:04:59.696568 | controller | - bash-completion 2025-12-01 11:04:59.696575 | controller | - ca-certificates 2025-12-01 11:04:59.696580 | controller | - git-core 2025-12-01 11:04:59.696586 | controller | - make 2025-12-01 11:04:59.696592 | controller | - tar 2025-12-01 11:04:59.696597 | controller | - tmux 2025-12-01 11:04:59.696605 | controller | - python3-pip 2025-12-01 11:05:10.862848 | controller | 2025-12-01 11:05:10.862879 | controller | TASK [ci_setup : Install needed packages] ************************************** 2025-12-01 11:05:10.862887 | controller | Monday 01 December 2025 11:04:59 +0000 (0:00:00.019) 0:01:05.298 ******* 2025-12-01 11:05:10.862898 | controller | changed: [instance] 2025-12-01 11:05:10.862961 | controller | 2025-12-01 11:05:10.862999 | controller | TASK [ci_setup : Gather version of openshift client] *************************** 2025-12-01 11:05:11.470334 | controller | Monday 01 December 2025 11:05:10 +0000 (0:00:11.167) 0:01:16.465 ******* 2025-12-01 11:05:11.470369 | controller | ok: [instance] 2025-12-01 11:05:11.470543 | controller | 2025-12-01 11:05:11.470562 | controller | TASK [ci_setup : Ensure openshift client install path is present] ************** 2025-12-01 11:05:11.672213 | controller | Monday 01 December 2025 11:05:11 +0000 (0:00:00.607) 0:01:17.073 ******* 2025-12-01 11:05:11.672263 | controller | changed: [instance] 2025-12-01 11:05:11.672286 | controller | 2025-12-01 11:05:11.672375 | controller | TASK [ci_setup : Install openshift client] ************************************* 2025-12-01 11:05:11.672478 | controller | Monday 01 December 2025 11:05:11 +0000 (0:00:00.201) 0:01:17.275 ******* 2025-12-01 11:05:17.723199 | controller | changed: [instance] 2025-12-01 11:05:17.723257 | controller | 2025-12-01 11:05:17.723477 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] ********************** 2025-12-01 11:05:17.768205 | controller | Monday 01 December 2025 11:05:17 +0000 (0:00:06.050) 0:01:23.326 ******* 2025-12-01 11:05:17.768247 | controller | ok: [instance] 2025-12-01 11:05:17.768465 | controller | 2025-12-01 11:05:17.768490 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-12-01 11:05:18.036490 | controller | Monday 01 December 2025 11:05:17 +0000 (0:00:00.045) 0:01:23.371 ******* 2025-12-01 11:05:18.036522 | controller | changed: [instance] 2025-12-01 11:05:18.312867 | controller | 2025-12-01 11:05:18.312901 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************ 2025-12-01 11:05:18.312909 | controller | Monday 01 December 2025 11:05:18 +0000 (0:00:00.268) 0:01:23.639 ******* 2025-12-01 11:05:18.312919 | controller | changed: [instance] 2025-12-01 11:05:18.353235 | controller | 2025-12-01 11:05:18.353301 | controller | TASK [ci_setup : Check rhsm status] ******************************************** 2025-12-01 11:05:18.353312 | controller | Monday 01 December 2025 11:05:18 +0000 (0:00:00.276) 0:01:23.915 ******* 2025-12-01 11:05:18.353330 | controller | skipping: [instance] 2025-12-01 11:05:18.370720 | controller | 2025-12-01 11:05:18.370751 | controller | TASK [ci_setup : Gather the repos to be enabled] ******************************* 2025-12-01 11:05:18.370759 | controller | Monday 01 December 2025 11:05:18 +0000 (0:00:00.040) 0:01:23.956 ******* 2025-12-01 11:05:18.370769 | controller | skipping: [instance] 2025-12-01 11:05:18.388052 | controller | 2025-12-01 11:05:18.388091 | controller | TASK [ci_setup : Enabling the required repositories.] ************************** 2025-12-01 11:05:18.388100 | controller | Monday 01 December 2025 11:05:18 +0000 (0:00:00.017) 0:01:23.973 ******* 2025-12-01 11:05:18.388109 | controller | skipping: [instance] 2025-12-01 11:05:18.404511 | controller | 2025-12-01 11:05:18.404535 | controller | TASK [ci_setup : Get current /etc/redhat-release] ****************************** 2025-12-01 11:05:18.404545 | controller | Monday 01 December 2025 11:05:18 +0000 (0:00:00.017) 0:01:23.991 ******* 2025-12-01 11:05:18.404556 | controller | skipping: [instance] 2025-12-01 11:05:18.421202 | controller | 2025-12-01 11:05:18.421237 | controller | TASK [ci_setup : Print current /etc/redhat-release] **************************** 2025-12-01 11:05:18.421258 | controller | Monday 01 December 2025 11:05:18 +0000 (0:00:00.016) 0:01:24.007 ******* 2025-12-01 11:05:18.421271 | controller | skipping: [instance] 2025-12-01 11:05:18.441946 | controller | 2025-12-01 11:05:18.441974 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] ********* 2025-12-01 11:05:18.441982 | controller | Monday 01 December 2025 11:05:18 +0000 (0:00:00.016) 0:01:24.024 ******* 2025-12-01 11:05:18.441991 | controller | skipping: [instance] 2025-12-01 11:05:19.402525 | controller | 2025-12-01 11:05:19.402640 | controller | TASK [ci_setup : Manage directories] ******************************************* 2025-12-01 11:05:19.402649 | controller | Monday 01 December 2025 11:05:18 +0000 (0:00:00.020) 0:01:24.045 ******* 2025-12-01 11:05:19.402671 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr) 2025-12-01 11:05:19.402836 | controller | changed: [instance] => (item=/opt/basedir/logs) 2025-12-01 11:05:19.402844 | controller | ok: [instance] => (item=/opt/basedir/tmp) 2025-12-01 11:05:19.402858 | controller | changed: [instance] => (item=/opt/basedir/volumes) 2025-12-01 11:05:19.402953 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters) 2025-12-01 11:05:19.402970 | controller | 2025-12-01 11:05:19.402977 | controller | TASK [Create secret file] ****************************************************** 2025-12-01 11:05:19.402986 | controller | Monday 01 December 2025 11:05:19 +0000 (0:00:00.960) 0:01:25.005 ******* 2025-12-01 11:05:19.736220 | controller | changed: [instance] 2025-12-01 11:05:19.737135 | controller | 2025-12-01 11:05:19.737165 | controller | PLAY RECAP ********************************************************************* 2025-12-01 11:05:19.737180 | controller | instance : ok=31 changed=17 unreachable=0 failed=0 skipped=36 rescued=0 ignored=0 2025-12-01 11:05:19.737186 | controller | 2025-12-01 11:05:19.737191 | controller | Monday 01 December 2025 11:05:19 +0000 (0:00:00.333) 0:01:25.338 ******* 2025-12-01 11:05:19.737197 | controller | =============================================================================== 2025-12-01 11:05:19.737207 | controller | test_deps : Install selinux python libs -------------------------------- 47.22s 2025-12-01 11:05:19.737228 | controller | ci_setup : Install needed packages ------------------------------------- 11.17s 2025-12-01 11:05:19.737234 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.83s 2025-12-01 11:05:19.737240 | controller | ci_setup : Install openshift client ------------------------------------- 6.05s 2025-12-01 11:05:19.737245 | controller | test_deps : Install python yaml libs ------------------------------------ 1.25s 2025-12-01 11:05:19.737250 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.07s 2025-12-01 11:05:19.737255 | controller | ci_setup : Manage directories ------------------------------------------- 0.96s 2025-12-01 11:05:19.737259 | controller | Gathering Facts --------------------------------------------------------- 0.83s 2025-12-01 11:05:19.737264 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.82s 2025-12-01 11:05:19.737270 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.81s 2025-12-01 11:05:19.737277 | controller | repo_setup : Install repo-setup package --------------------------------- 0.77s 2025-12-01 11:05:19.737295 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.71s 2025-12-01 11:05:19.738040 | controller | ci_setup : Gather version of openshift client --------------------------- 0.61s 2025-12-01 11:05:19.790485 | controller | repo_setup : Ensure directories are present ----------------------------- 0.54s 2025-12-01 11:05:19.790516 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.53s 2025-12-01 11:05:19.790525 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.44s 2025-12-01 11:05:19.790530 | controller | Create secret file ------------------------------------------------------ 0.33s 2025-12-01 11:05:19.790535 | controller | Create custom basedir --------------------------------------------------- 0.32s 2025-12-01 11:05:19.790541 | controller | test_deps : Detect mirrors file ----------------------------------------- 0.29s 2025-12-01 11:05:19.790552 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.28s 2025-12-01 11:05:19.790562 | controller | INFO Running crc_layout > converge 2025-12-01 11:05:20.382903 | controller | 2025-12-01 11:05:20.383125 | controller | PLAY [Converge] **************************************************************** 2025-12-01 11:05:20.383273 | controller | 2025-12-01 11:05:20.383415 | controller | TASK [Gathering Facts] ********************************************************* 2025-12-01 11:05:20.383559 | controller | Monday 01 December 2025 11:05:20 +0000 (0:00:00.027) 0:00:00.028 ******* 2025-12-01 11:05:21.184089 | controller | ok: [instance] 2025-12-01 11:05:21.232999 | controller | 2025-12-01 11:05:21.233021 | controller | TASK [Load networking definition from scenario file] *************************** 2025-12-01 11:05:21.233031 | controller | Monday 01 December 2025 11:05:21 +0000 (0:00:00.801) 0:00:00.829 ******* 2025-12-01 11:05:21.233042 | controller | ok: [instance] 2025-12-01 11:05:23.069130 | controller | 2025-12-01 11:05:23.069164 | controller | TASK [discover_latest_image : Get latest image] ******************************** 2025-12-01 11:05:23.069172 | controller | Monday 01 December 2025 11:05:21 +0000 (0:00:00.049) 0:00:00.878 ******* 2025-12-01 11:05:23.069182 | controller | changed: [instance] 2025-12-01 11:05:23.096187 | controller | 2025-12-01 11:05:23.096222 | controller | TASK [discover_latest_image : Export facts accordingly] ************************ 2025-12-01 11:05:23.096238 | controller | Monday 01 December 2025 11:05:23 +0000 (0:00:01.835) 0:00:02.714 ******* 2025-12-01 11:05:23.096252 | controller | ok: [instance] 2025-12-01 11:05:23.096282 | controller | 2025-12-01 11:05:23.096293 | controller | TASK [reproducer : Load CI job environment] ************************************ 2025-12-01 11:05:23.096369 | controller | Monday 01 December 2025 11:05:23 +0000 (0:00:00.027) 0:00:02.741 ******* 2025-12-01 11:05:23.117597 | controller | skipping: [instance] 2025-12-01 11:05:23.167543 | controller | 2025-12-01 11:05:23.167564 | controller | TASK [Build final libvirt layout] ********************************************** 2025-12-01 11:05:23.167574 | controller | Monday 01 December 2025 11:05:23 +0000 (0:00:00.021) 0:00:02.762 ******* 2025-12-01 11:05:23.167585 | controller | 2025-12-01 11:05:23.250206 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] *********** 2025-12-01 11:05:23.250236 | controller | Monday 01 December 2025 11:05:23 +0000 (0:00:00.049) 0:00:02.812 ******* 2025-12-01 11:05:23.250250 | controller | ok: [instance] 2025-12-01 11:05:23.250606 | controller | 2025-12-01 11:05:23.310591 | controller | TASK [libvirt_manager : Patch the layout if needed] **************************** 2025-12-01 11:05:23.310610 | controller | Monday 01 December 2025 11:05:23 +0000 (0:00:00.082) 0:00:02.895 ******* 2025-12-01 11:05:23.310621 | controller | skipping: [instance] 2025-12-01 11:05:23.337199 | controller | 2025-12-01 11:05:23.337226 | controller | TASK [reproducer : Assert no conflicting parameters were passed] *************** 2025-12-01 11:05:23.337236 | controller | Monday 01 December 2025 11:05:23 +0000 (0:00:00.060) 0:00:02.955 ******* 2025-12-01 11:05:23.337248 | controller | ok: [instance] 2025-12-01 11:05:23.360760 | controller | 2025-12-01 11:05:23.360783 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] *** 2025-12-01 11:05:23.360792 | controller | Monday 01 December 2025 11:05:23 +0000 (0:00:00.026) 0:00:02.982 ******* 2025-12-01 11:05:23.360804 | controller | ok: [instance] => changed=false 2025-12-01 11:05:23.360990 | controller | msg: All assertions passed 2025-12-01 11:05:23.361183 | controller | 2025-12-01 11:05:23.361360 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************ 2025-12-01 11:05:23.361497 | controller | Monday 01 December 2025 11:05:23 +0000 (0:00:00.023) 0:00:03.006 ******* 2025-12-01 11:05:23.404773 | controller | ok: [instance] 2025-12-01 11:05:23.404928 | controller | 2025-12-01 11:05:23.405100 | controller | TASK [reproducer : Ensure directories are present] ***************************** 2025-12-01 11:05:23.405252 | controller | Monday 01 December 2025 11:05:23 +0000 (0:00:00.043) 0:00:03.050 ******* 2025-12-01 11:05:23.880156 | controller | ok: [instance] => (item=artifacts) 2025-12-01 11:05:23.880204 | controller | ok: [instance] => (item=logs) 2025-12-01 11:05:23.880214 | controller | 2025-12-01 11:05:23.880444 | controller | TASK [Bootstrap libvirt if needed] ********************************************* 2025-12-01 11:05:23.955869 | controller | Monday 01 December 2025 11:05:23 +0000 (0:00:00.474) 0:00:03.525 ******* 2025-12-01 11:05:23.955895 | controller | 2025-12-01 11:05:24.152659 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************ 2025-12-01 11:05:24.152687 | controller | Monday 01 December 2025 11:05:23 +0000 (0:00:00.075) 0:00:03.601 ******* 2025-12-01 11:05:24.152700 | controller | ok: [instance] 2025-12-01 11:05:24.433287 | controller | 2025-12-01 11:05:24.433311 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] ************* 2025-12-01 11:05:24.433318 | controller | Monday 01 December 2025 11:05:24 +0000 (0:00:00.196) 0:00:03.797 ******* 2025-12-01 11:05:24.433328 | controller | changed: [instance] 2025-12-01 11:05:24.719812 | controller | 2025-12-01 11:05:24.719844 | controller | TASK [libvirt_manager : Check if KVM is enabled] ******************************* 2025-12-01 11:05:24.719852 | controller | Monday 01 December 2025 11:05:24 +0000 (0:00:00.280) 0:00:04.078 ******* 2025-12-01 11:05:24.719862 | controller | ok: [instance] 2025-12-01 11:05:24.748812 | controller | 2025-12-01 11:05:24.748830 | controller | TASK [libvirt_manager : Fail if KVM not enabled] ******************************* 2025-12-01 11:05:24.748838 | controller | Monday 01 December 2025 11:05:24 +0000 (0:00:00.286) 0:00:04.364 ******* 2025-12-01 11:05:24.748847 | controller | skipping: [instance] 2025-12-01 11:05:24.767053 | controller | 2025-12-01 11:05:24.767085 | controller | TASK [libvirt_manager : Check if VMX virtualization] *************************** 2025-12-01 11:05:24.767093 | controller | Monday 01 December 2025 11:05:24 +0000 (0:00:00.029) 0:00:04.394 ******* 2025-12-01 11:05:24.767102 | controller | skipping: [instance] 2025-12-01 11:05:24.787855 | controller | 2025-12-01 11:05:24.787874 | controller | TASK [libvirt_manager : Check if SVM virtualization] *************************** 2025-12-01 11:05:24.787883 | controller | Monday 01 December 2025 11:05:24 +0000 (0:00:00.018) 0:00:04.412 ******* 2025-12-01 11:05:24.787893 | controller | ok: [instance] 2025-12-01 11:05:24.816250 | controller | 2025-12-01 11:05:24.816291 | controller | TASK [libvirt_manager : Enable VMX virtualization] ***************************** 2025-12-01 11:05:24.816309 | controller | Monday 01 December 2025 11:05:24 +0000 (0:00:00.020) 0:00:04.433 ******* 2025-12-01 11:05:24.816322 | controller | skipping: [instance] 2025-12-01 11:05:24.816356 | controller | 2025-12-01 11:05:24.816366 | controller | TASK [libvirt_manager : Install packages required for using KVM] *************** 2025-12-01 11:05:36.709724 | controller | Monday 01 December 2025 11:05:24 +0000 (0:00:00.028) 0:00:04.461 ******* 2025-12-01 11:05:36.709762 | controller | changed: [instance] 2025-12-01 11:05:36.917787 | controller | 2025-12-01 11:05:36.917819 | controller | TASK [libvirt_manager : Create rules.d polkit folder] ************************** 2025-12-01 11:05:36.917827 | controller | Monday 01 December 2025 11:05:36 +0000 (0:00:11.893) 0:00:16.354 ******* 2025-12-01 11:05:36.917837 | controller | changed: [instance] 2025-12-01 11:05:36.917859 | controller | 2025-12-01 11:05:36.917867 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] ********************* 2025-12-01 11:05:36.917990 | controller | Monday 01 December 2025 11:05:36 +0000 (0:00:00.208) 0:00:16.563 ******* 2025-12-01 11:05:37.404034 | controller | changed: [instance] 2025-12-01 11:05:37.981891 | controller | 2025-12-01 11:05:37.981924 | controller | TASK [libvirt_manager : Restart service polkit service] ************************ 2025-12-01 11:05:37.981934 | controller | Monday 01 December 2025 11:05:37 +0000 (0:00:00.486) 0:00:17.049 ******* 2025-12-01 11:05:37.981946 | controller | changed: [instance] 2025-12-01 11:05:38.182251 | controller | 2025-12-01 11:05:38.182285 | controller | TASK [libvirt_manager : Remove directory for service override] ***************** 2025-12-01 11:05:38.182295 | controller | Monday 01 December 2025 11:05:37 +0000 (0:00:00.577) 0:00:17.626 ******* 2025-12-01 11:05:38.182307 | controller | ok: [instance] 2025-12-01 11:05:38.838014 | controller | 2025-12-01 11:05:38.838057 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] *** 2025-12-01 11:05:38.838105 | controller | Monday 01 December 2025 11:05:38 +0000 (0:00:00.200) 0:00:17.827 ******* 2025-12-01 11:05:38.838118 | controller | ok: [instance] 2025-12-01 11:05:38.838145 | controller | 2025-12-01 11:05:38.838380 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************ 2025-12-01 11:05:39.730968 | controller | Monday 01 December 2025 11:05:38 +0000 (0:00:00.656) 0:00:18.483 ******* 2025-12-01 11:05:39.731004 | controller | changed: [instance] 2025-12-01 11:05:39.814214 | controller | 2025-12-01 11:05:39.814250 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] **** 2025-12-01 11:05:39.814261 | controller | Monday 01 December 2025 11:05:39 +0000 (0:00:00.892) 0:00:19.376 ******* 2025-12-01 11:05:39.814274 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu) 2025-12-01 11:05:39.814306 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface) 2025-12-01 11:05:39.814314 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network) 2025-12-01 11:05:39.814321 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev) 2025-12-01 11:05:39.814330 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter) 2025-12-01 11:05:39.814873 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret) 2025-12-01 11:05:40.145696 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage) 2025-12-01 11:05:40.145727 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy) 2025-12-01 11:05:40.145735 | controller | 2025-12-01 11:05:40.145741 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] ********* 2025-12-01 11:05:40.145747 | controller | Monday 01 December 2025 11:05:39 +0000 (0:00:00.083) 0:00:19.459 ******* 2025-12-01 11:05:40.145757 | controller | ok: [instance] 2025-12-01 11:05:40.468089 | controller | 2025-12-01 11:05:40.468138 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] ********** 2025-12-01 11:05:40.468147 | controller | Monday 01 December 2025 11:05:40 +0000 (0:00:00.331) 0:00:19.790 ******* 2025-12-01 11:05:40.468157 | controller | ok: [instance] 2025-12-01 11:05:40.788029 | controller | 2025-12-01 11:05:40.788076 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] ************** 2025-12-01 11:05:40.788088 | controller | Monday 01 December 2025 11:05:40 +0000 (0:00:00.322) 0:00:20.113 ******* 2025-12-01 11:05:40.788099 | controller | ok: [instance] 2025-12-01 11:05:41.110196 | controller | 2025-12-01 11:05:41.110231 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] **** 2025-12-01 11:05:41.110241 | controller | Monday 01 December 2025 11:05:40 +0000 (0:00:00.319) 0:00:20.433 ******* 2025-12-01 11:05:41.110253 | controller | ok: [instance] 2025-12-01 11:05:41.110471 | controller | 2025-12-01 11:05:41.110504 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] ***** 2025-12-01 11:05:41.431649 | controller | Monday 01 December 2025 11:05:41 +0000 (0:00:00.322) 0:00:20.755 ******* 2025-12-01 11:05:41.431688 | controller | ok: [instance] 2025-12-01 11:05:41.756173 | controller | 2025-12-01 11:05:41.756203 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] ********* 2025-12-01 11:05:41.756212 | controller | Monday 01 December 2025 11:05:41 +0000 (0:00:00.321) 0:00:21.076 ******* 2025-12-01 11:05:41.756222 | controller | ok: [instance] 2025-12-01 11:05:41.756246 | controller | 2025-12-01 11:05:41.756255 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ****** 2025-12-01 11:05:41.756424 | controller | Monday 01 December 2025 11:05:41 +0000 (0:00:00.324) 0:00:21.401 ******* 2025-12-01 11:05:42.080218 | controller | ok: [instance] 2025-12-01 11:05:42.080268 | controller | 2025-12-01 11:05:42.080503 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] ******* 2025-12-01 11:05:42.397023 | controller | Monday 01 December 2025 11:05:42 +0000 (0:00:00.324) 0:00:21.725 ******* 2025-12-01 11:05:42.397088 | controller | ok: [instance] 2025-12-01 11:05:42.716209 | controller | 2025-12-01 11:05:42.716243 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] *********** 2025-12-01 11:05:42.716253 | controller | Monday 01 December 2025 11:05:42 +0000 (0:00:00.316) 0:00:22.042 ******* 2025-12-01 11:05:42.716265 | controller | ok: [instance] 2025-12-01 11:05:42.716273 | controller | 2025-12-01 11:05:42.716280 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ****** 2025-12-01 11:05:42.716288 | controller | Monday 01 December 2025 11:05:42 +0000 (0:00:00.319) 0:00:22.361 ******* 2025-12-01 11:05:43.035161 | controller | ok: [instance] 2025-12-01 11:05:43.035208 | controller | 2025-12-01 11:05:43.035216 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] ******* 2025-12-01 11:05:43.035224 | controller | Monday 01 December 2025 11:05:43 +0000 (0:00:00.318) 0:00:22.680 ******* 2025-12-01 11:05:43.357271 | controller | ok: [instance] 2025-12-01 11:05:43.677977 | controller | 2025-12-01 11:05:43.678011 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] *********** 2025-12-01 11:05:43.678020 | controller | Monday 01 December 2025 11:05:43 +0000 (0:00:00.322) 0:00:23.002 ******* 2025-12-01 11:05:43.678032 | controller | ok: [instance] 2025-12-01 11:05:43.999327 | controller | 2025-12-01 11:05:43.999356 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] ***** 2025-12-01 11:05:43.999364 | controller | Monday 01 December 2025 11:05:43 +0000 (0:00:00.320) 0:00:23.322 ******* 2025-12-01 11:05:43.999374 | controller | ok: [instance] 2025-12-01 11:05:44.321151 | controller | 2025-12-01 11:05:44.321186 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ****** 2025-12-01 11:05:44.321212 | controller | Monday 01 December 2025 11:05:43 +0000 (0:00:00.321) 0:00:23.644 ******* 2025-12-01 11:05:44.321223 | controller | ok: [instance] 2025-12-01 11:05:44.321479 | controller | 2025-12-01 11:05:44.321516 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] ********** 2025-12-01 11:05:44.644802 | controller | Monday 01 December 2025 11:05:44 +0000 (0:00:00.321) 0:00:23.966 ******* 2025-12-01 11:05:44.644842 | controller | ok: [instance] 2025-12-01 11:05:44.968189 | controller | 2025-12-01 11:05:44.968243 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] ******* 2025-12-01 11:05:44.968253 | controller | Monday 01 December 2025 11:05:44 +0000 (0:00:00.323) 0:00:24.289 ******* 2025-12-01 11:05:44.968265 | controller | ok: [instance] 2025-12-01 11:05:44.968273 | controller | 2025-12-01 11:05:44.968288 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ******** 2025-12-01 11:05:44.968297 | controller | Monday 01 December 2025 11:05:44 +0000 (0:00:00.323) 0:00:24.613 ******* 2025-12-01 11:05:45.290749 | controller | ok: [instance] 2025-12-01 11:05:45.608163 | controller | 2025-12-01 11:05:45.608197 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************ 2025-12-01 11:05:45.608206 | controller | Monday 01 December 2025 11:05:45 +0000 (0:00:00.322) 0:00:24.935 ******* 2025-12-01 11:05:45.608216 | controller | ok: [instance] 2025-12-01 11:05:45.931016 | controller | 2025-12-01 11:05:45.931047 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ****** 2025-12-01 11:05:45.931054 | controller | Monday 01 December 2025 11:05:45 +0000 (0:00:00.317) 0:00:25.253 ******* 2025-12-01 11:05:45.931077 | controller | ok: [instance] 2025-12-01 11:05:45.931115 | controller | 2025-12-01 11:05:45.931409 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] ******* 2025-12-01 11:05:46.249192 | controller | Monday 01 December 2025 11:05:45 +0000 (0:00:00.323) 0:00:25.576 ******* 2025-12-01 11:05:46.249248 | controller | ok: [instance] 2025-12-01 11:05:46.576143 | controller | 2025-12-01 11:05:46.576174 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] *********** 2025-12-01 11:05:46.576183 | controller | Monday 01 December 2025 11:05:46 +0000 (0:00:00.317) 0:00:25.894 ******* 2025-12-01 11:05:46.576194 | controller | ok: [instance] 2025-12-01 11:05:46.576370 | controller | 2025-12-01 11:05:46.576390 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ******** 2025-12-01 11:05:46.906191 | controller | Monday 01 December 2025 11:05:46 +0000 (0:00:00.327) 0:00:26.221 ******* 2025-12-01 11:05:46.906263 | controller | ok: [instance] 2025-12-01 11:05:46.906295 | controller | 2025-12-01 11:05:46.906476 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] ********* 2025-12-01 11:05:47.230186 | controller | Monday 01 December 2025 11:05:46 +0000 (0:00:00.330) 0:00:26.551 ******* 2025-12-01 11:05:47.230221 | controller | ok: [instance] 2025-12-01 11:05:47.230247 | controller | 2025-12-01 11:05:47.230272 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] ************* 2025-12-01 11:05:47.230281 | controller | Monday 01 December 2025 11:05:47 +0000 (0:00:00.323) 0:00:26.875 ******* 2025-12-01 11:05:47.547120 | controller | ok: [instance] 2025-12-01 11:05:47.566896 | controller | 2025-12-01 11:05:47.566921 | controller | TASK [libvirt_manager : Manage service for older releases] ********************* 2025-12-01 11:05:47.566929 | controller | Monday 01 December 2025 11:05:47 +0000 (0:00:00.316) 0:00:27.192 ******* 2025-12-01 11:05:47.566938 | controller | skipping: [instance] 2025-12-01 11:05:47.862214 | controller | 2025-12-01 11:05:47.862249 | controller | TASK [libvirt_manager : Get libvirt group users] ******************************* 2025-12-01 11:05:47.862259 | controller | Monday 01 December 2025 11:05:47 +0000 (0:00:00.019) 0:00:27.212 ******* 2025-12-01 11:05:47.862284 | controller | ok: [instance] 2025-12-01 11:05:47.862337 | controller | 2025-12-01 11:05:47.862366 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] *************** 2025-12-01 11:05:47.862380 | controller | Monday 01 December 2025 11:05:47 +0000 (0:00:00.295) 0:00:27.507 ******* 2025-12-01 11:05:48.213664 | controller | ok: [instance] 2025-12-01 11:05:48.499036 | controller | 2025-12-01 11:05:48.499089 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] *** 2025-12-01 11:05:48.499102 | controller | Monday 01 December 2025 11:05:48 +0000 (0:00:00.351) 0:00:27.858 ******* 2025-12-01 11:05:48.499114 | controller | changed: [instance] 2025-12-01 11:05:48.763118 | controller | 2025-12-01 11:05:48.763147 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] ********* 2025-12-01 11:05:48.763154 | controller | Monday 01 December 2025 11:05:48 +0000 (0:00:00.285) 0:00:28.144 ******* 2025-12-01 11:05:48.763165 | controller | [WARNING]: Reset is not implemented for this connection 2025-12-01 11:05:48.773171 | controller | changed: [instance] 2025-12-01 11:05:48.773533 | controller | 2025-12-01 11:05:48.773549 | controller | TASK [libvirt_manager : Ensure we reload user env] ***************************** 2025-12-01 11:05:48.773559 | controller | Monday 01 December 2025 11:05:48 +0000 (0:00:00.258) 0:00:28.402 ******* 2025-12-01 11:05:48.846581 | controller | 2025-12-01 11:05:48.846603 | controller | TASK [reproducer : Deploy networks in libvirt] ********************************* 2025-12-01 11:05:48.846612 | controller | Monday 01 December 2025 11:05:48 +0000 (0:00:00.015) 0:00:28.418 ******* 2025-12-01 11:05:48.846623 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance 2025-12-01 11:05:48.890034 | controller | 2025-12-01 11:05:48.890056 | controller | TASK [reproducer : Ensure networks are consistent] ***************************** 2025-12-01 11:05:48.890090 | controller | Monday 01 December 2025 11:05:48 +0000 (0:00:00.073) 0:00:28.491 ******* 2025-12-01 11:05:48.890106 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance 2025-12-01 11:05:48.937108 | controller | 2025-12-01 11:05:48.937129 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************ 2025-12-01 11:05:48.937136 | controller | Monday 01 December 2025 11:05:48 +0000 (0:00:00.043) 0:00:28.535 ******* 2025-12-01 11:05:48.937146 | controller | ok: [instance] => (item=compute) 2025-12-01 11:05:48.937655 | controller | ok: [instance] => (item=controller) 2025-12-01 11:05:48.978095 | controller | ok: [instance] => (item=crc) 2025-12-01 11:05:48.978120 | controller | 2025-12-01 11:05:48.978128 | controller | TASK [reproducer : Ensure all standard attached networks are defined] ********** 2025-12-01 11:05:48.978134 | controller | Monday 01 December 2025 11:05:48 +0000 (0:00:00.047) 0:00:28.582 ******* 2025-12-01 11:05:48.978143 | controller | ok: [instance] 2025-12-01 11:05:48.978262 | controller | 2025-12-01 11:05:48.978454 | controller | TASK [reproducer : Ensure we don't have extra network defined] ***************** 2025-12-01 11:05:48.978586 | controller | Monday 01 December 2025 11:05:48 +0000 (0:00:00.041) 0:00:28.623 ******* 2025-12-01 11:05:49.018902 | controller | ok: [instance] => changed=false 2025-12-01 11:05:49.019039 | controller | msg: All assertions passed 2025-12-01 11:05:49.019179 | controller | 2025-12-01 11:05:49.019316 | controller | TASK [Ensure we get latest OCP config] ***************************************** 2025-12-01 11:05:49.019450 | controller | Monday 01 December 2025 11:05:49 +0000 (0:00:00.040) 0:00:28.664 ******* 2025-12-01 11:05:49.061593 | controller | 2025-12-01 11:05:49.061764 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] ***** 2025-12-01 11:05:49.061917 | controller | Monday 01 December 2025 11:05:49 +0000 (0:00:00.042) 0:00:28.707 ******* 2025-12-01 11:05:49.135971 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'}) 2025-12-01 11:05:49.136087 | controller | ok: [instance] => (item={}) 2025-12-01 11:05:49.136278 | controller | 2025-12-01 11:05:49.136389 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] **************** 2025-12-01 11:05:49.136502 | controller | Monday 01 December 2025 11:05:49 +0000 (0:00:00.074) 0:00:28.781 ******* 2025-12-01 11:05:49.152886 | controller | skipping: [instance] 2025-12-01 11:05:49.153025 | controller | 2025-12-01 11:05:49.153198 | controller | TASK [devscripts : Ensure output directory exists] ***************************** 2025-12-01 11:05:49.153368 | controller | Monday 01 December 2025 11:05:49 +0000 (0:00:00.016) 0:00:28.798 ******* 2025-12-01 11:05:49.370577 | controller | ok: [instance] 2025-12-01 11:05:49.370724 | controller | 2025-12-01 11:05:49.370885 | controller | TASK [devscripts : Output built config for easier debugging] ******************* 2025-12-01 11:05:49.371029 | controller | Monday 01 December 2025 11:05:49 +0000 (0:00:00.217) 0:00:29.016 ******* 2025-12-01 11:05:49.721171 | controller | changed: [instance] 2025-12-01 11:05:50.454218 | controller | 2025-12-01 11:05:50.454251 | controller | TASK [ci_network : Remove the local dns configuration] ************************* 2025-12-01 11:05:50.454261 | controller | Monday 01 December 2025 11:05:49 +0000 (0:00:00.349) 0:00:29.366 ******* 2025-12-01 11:05:50.454273 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf) 2025-12-01 11:05:50.454302 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf) 2025-12-01 11:05:50.454310 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf) 2025-12-01 11:05:50.454319 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf) 2025-12-01 11:05:50.454631 | controller | 2025-12-01 11:05:50.480093 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] ************** 2025-12-01 11:05:50.480116 | controller | Monday 01 December 2025 11:05:50 +0000 (0:00:00.733) 0:00:30.099 ******* 2025-12-01 11:05:50.480129 | controller | skipping: [instance] 2025-12-01 11:05:50.842180 | controller | 2025-12-01 11:05:50.842214 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] ********* 2025-12-01 11:05:50.842224 | controller | Monday 01 December 2025 11:05:50 +0000 (0:00:00.025) 0:00:30.125 ******* 2025-12-01 11:05:50.842236 | controller | changed: [instance] 2025-12-01 11:05:50.842264 | controller | 2025-12-01 11:05:50.842290 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ****************** 2025-12-01 11:05:50.842728 | controller | Monday 01 December 2025 11:05:50 +0000 (0:00:00.353) 0:00:30.478 ******* 2025-12-01 11:05:51.276208 | controller | 2025-12-01 11:05:51.276246 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-01 11:05:51.276255 | controller | Monday 01 December 2025 11:05:50 +0000 (0:00:00.008) 0:00:30.487 ******* 2025-12-01 11:05:51.276273 | controller | changed: [instance] 2025-12-01 11:05:51.350690 | controller | 2025-12-01 11:05:51.350724 | controller | TASK [Ensure no default networks exists] *************************************** 2025-12-01 11:05:51.350734 | controller | Monday 01 December 2025 11:05:51 +0000 (0:00:00.433) 0:00:30.921 ******* 2025-12-01 11:05:51.350746 | controller | 2025-12-01 11:05:52.510162 | controller | TASK [libvirt_manager : Deactivate crc] **************************************** 2025-12-01 11:05:52.510212 | controller | Monday 01 December 2025 11:05:51 +0000 (0:00:00.074) 0:00:30.995 ******* 2025-12-01 11:05:52.510229 | controller | ok: [instance] 2025-12-01 11:05:52.510271 | controller | 2025-12-01 11:05:52.510486 | controller | TASK [libvirt_manager : Removing crc] ****************************************** 2025-12-01 11:05:52.750644 | controller | Monday 01 December 2025 11:05:52 +0000 (0:00:01.159) 0:00:32.155 ******* 2025-12-01 11:05:52.750680 | controller | ok: [instance] 2025-12-01 11:05:53.256005 | controller | 2025-12-01 11:05:53.256035 | controller | TASK [libvirt_manager : Deactivate default] ************************************ 2025-12-01 11:05:53.256043 | controller | Monday 01 December 2025 11:05:52 +0000 (0:00:00.240) 0:00:32.395 ******* 2025-12-01 11:05:53.256053 | controller | ok: [instance] 2025-12-01 11:05:53.489090 | controller | 2025-12-01 11:05:53.489119 | controller | TASK [libvirt_manager : Removing default] ************************************** 2025-12-01 11:05:53.489127 | controller | Monday 01 December 2025 11:05:53 +0000 (0:00:00.505) 0:00:32.901 ******* 2025-12-01 11:05:53.489137 | controller | ok: [instance] 2025-12-01 11:05:54.724193 | controller | 2025-12-01 11:05:54.724229 | controller | TASK [reproducer : Ensure firewalld is installed] ****************************** 2025-12-01 11:05:54.724238 | controller | Monday 01 December 2025 11:05:53 +0000 (0:00:00.232) 0:00:33.134 ******* 2025-12-01 11:05:54.724250 | controller | ok: [instance] 2025-12-01 11:05:54.724276 | controller | 2025-12-01 11:05:54.724284 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************ 2025-12-01 11:05:54.724419 | controller | Monday 01 December 2025 11:05:54 +0000 (0:00:01.235) 0:00:34.369 ******* 2025-12-01 11:05:55.039160 | controller | ok: [instance] 2025-12-01 11:05:55.039205 | controller | 2025-12-01 11:05:55.039444 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] *********************** 2025-12-01 11:05:55.350148 | controller | Monday 01 December 2025 11:05:55 +0000 (0:00:00.315) 0:00:34.684 ******* 2025-12-01 11:05:55.350193 | controller | changed: [instance] 2025-12-01 11:05:55.655597 | controller | 2025-12-01 11:05:55.655633 | controller | TASK [reproducer : Ensure IP forwarding is enabled] **************************** 2025-12-01 11:05:55.655643 | controller | Monday 01 December 2025 11:05:55 +0000 (0:00:00.310) 0:00:34.995 ******* 2025-12-01 11:05:55.655653 | controller | changed: [instance] 2025-12-01 11:05:56.232155 | controller | 2025-12-01 11:05:56.232186 | controller | TASK [reproducer : Ensure the required parameters are loaded] ****************** 2025-12-01 11:05:56.232194 | controller | Monday 01 December 2025 11:05:55 +0000 (0:00:00.305) 0:00:35.300 ******* 2025-12-01 11:05:56.232204 | controller | changed: [instance] => (item=arptables) 2025-12-01 11:05:56.232227 | controller | changed: [instance] => (item=iptables) 2025-12-01 11:05:56.232590 | controller | changed: [instance] => (item=ip6tables) 2025-12-01 11:05:56.553122 | controller | 2025-12-01 11:05:56.553153 | controller | TASK [reproducer : Ensure firewall service is enabled and started] ************* 2025-12-01 11:05:56.553161 | controller | Monday 01 December 2025 11:05:56 +0000 (0:00:00.576) 0:00:35.877 ******* 2025-12-01 11:05:56.553178 | controller | ok: [instance] 2025-12-01 11:05:56.646183 | controller | 2025-12-01 11:05:56.646209 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] ************* 2025-12-01 11:05:56.646219 | controller | Monday 01 December 2025 11:05:56 +0000 (0:00:00.320) 0:00:36.198 ******* 2025-12-01 11:05:56.646230 | controller | ok: [instance] 2025-12-01 11:05:56.690731 | controller | 2025-12-01 11:05:56.690754 | controller | TASK [Ensure the required network configurations are applied] ****************** 2025-12-01 11:05:56.690763 | controller | Monday 01 December 2025 11:05:56 +0000 (0:00:00.093) 0:00:36.291 ******* 2025-12-01 11:05:56.690774 | controller | 2025-12-01 11:05:56.716202 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] *** 2025-12-01 11:05:56.716245 | controller | Monday 01 December 2025 11:05:56 +0000 (0:00:00.044) 0:00:36.336 ******* 2025-12-01 11:05:56.716261 | controller | skipping: [instance] 2025-12-01 11:05:56.716292 | controller | 2025-12-01 11:05:56.716302 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ****** 2025-12-01 11:05:56.716396 | controller | Monday 01 December 2025 11:05:56 +0000 (0:00:00.025) 0:00:36.361 ******* 2025-12-01 11:05:56.739675 | controller | skipping: [instance] 2025-12-01 11:05:56.762541 | controller | 2025-12-01 11:05:56.762560 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-01 11:05:56.762568 | controller | Monday 01 December 2025 11:05:56 +0000 (0:00:00.023) 0:00:36.384 ******* 2025-12-01 11:05:56.762577 | controller | skipping: [instance] 2025-12-01 11:05:56.789230 | controller | 2025-12-01 11:05:56.789252 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ****** 2025-12-01 11:05:56.789261 | controller | Monday 01 December 2025 11:05:56 +0000 (0:00:00.022) 0:00:36.407 ******* 2025-12-01 11:05:56.789272 | controller | skipping: [instance] 2025-12-01 11:05:56.789443 | controller | 2025-12-01 11:05:56.789602 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] ********************** 2025-12-01 11:05:56.789744 | controller | Monday 01 December 2025 11:05:56 +0000 (0:00:00.027) 0:00:36.434 ******* 2025-12-01 11:05:56.828654 | controller | ok: [instance] 2025-12-01 11:05:56.828843 | controller | 2025-12-01 11:05:56.829023 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] *** 2025-12-01 11:05:56.829232 | controller | Monday 01 December 2025 11:05:56 +0000 (0:00:00.039) 0:00:36.474 ******* 2025-12-01 11:05:56.862547 | controller | skipping: [instance] 2025-12-01 11:05:56.862733 | controller | 2025-12-01 11:05:56.862916 | controller | TASK [ci_nmstate : Get k8s nodes] ********************************************** 2025-12-01 11:05:56.863113 | controller | Monday 01 December 2025 11:05:56 +0000 (0:00:00.033) 0:00:36.508 ******* 2025-12-01 11:05:56.885590 | controller | skipping: [instance] 2025-12-01 11:05:56.885746 | controller | 2025-12-01 11:05:56.885890 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ******** 2025-12-01 11:05:56.886028 | controller | Monday 01 December 2025 11:05:56 +0000 (0:00:00.023) 0:00:36.531 ******* 2025-12-01 11:05:56.945521 | controller | ok: [instance] 2025-12-01 11:05:56.945698 | controller | 2025-12-01 11:05:56.945852 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] ************************* 2025-12-01 11:05:56.945991 | controller | Monday 01 December 2025 11:05:56 +0000 (0:00:00.059) 0:00:36.591 ******* 2025-12-01 11:05:56.968240 | controller | skipping: [instance] 2025-12-01 11:05:56.968440 | controller | 2025-12-01 11:05:56.968627 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] ********************* 2025-12-01 11:05:56.968781 | controller | Monday 01 December 2025 11:05:56 +0000 (0:00:00.022) 0:00:36.613 ******* 2025-12-01 11:05:57.016343 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost) 2025-12-01 11:05:57.016546 | controller | 2025-12-01 11:05:57.016723 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-12-01 11:05:57.016869 | controller | Monday 01 December 2025 11:05:57 +0000 (0:00:00.048) 0:00:36.661 ******* 2025-12-01 11:05:57.363610 | controller | ok: [instance -> localhost] 2025-12-01 11:06:03.368433 | controller | 2025-12-01 11:06:03.368465 | controller | TASK [ci_nmstate : Install required packages on localhost] ********************* 2025-12-01 11:06:03.368473 | controller | Monday 01 December 2025 11:05:57 +0000 (0:00:00.346) 0:00:37.008 ******* 2025-12-01 11:06:03.368483 | controller | changed: [instance -> localhost] 2025-12-01 11:06:03.572704 | controller | 2025-12-01 11:06:03.572734 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-12-01 11:06:03.572742 | controller | Monday 01 December 2025 11:06:03 +0000 (0:00:06.004) 0:00:43.013 ******* 2025-12-01 11:06:03.572752 | controller | changed: [instance] 2025-12-01 11:06:03.937235 | controller | 2025-12-01 11:06:03.937270 | controller | TASK [ci_nmstate : Save nmstate state for localhost] *************************** 2025-12-01 11:06:03.937280 | controller | Monday 01 December 2025 11:06:03 +0000 (0:00:00.204) 0:00:43.217 ******* 2025-12-01 11:06:03.937300 | controller | changed: [instance] 2025-12-01 11:06:03.937322 | controller | 2025-12-01 11:06:03.937332 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] ********************* 2025-12-01 11:06:03.937363 | controller | Monday 01 December 2025 11:06:03 +0000 (0:00:00.364) 0:00:43.582 ******* 2025-12-01 11:06:05.555575 | controller | changed: [instance -> localhost] 2025-12-01 11:06:05.915284 | controller | 2025-12-01 11:06:05.915322 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ****************** 2025-12-01 11:06:05.915331 | controller | Monday 01 December 2025 11:06:05 +0000 (0:00:01.618) 0:00:45.200 ******* 2025-12-01 11:06:05.915342 | controller | changed: [instance] 2025-12-01 11:06:05.947744 | controller | 2025-12-01 11:06:05.947767 | controller | TASK [reproducer : Select right domain] **************************************** 2025-12-01 11:06:05.947776 | controller | Monday 01 December 2025 11:06:05 +0000 (0:00:00.359) 0:00:45.560 ******* 2025-12-01 11:06:05.947788 | controller | ok: [instance] 2025-12-01 11:06:06.083392 | controller | 2025-12-01 11:06:06.083415 | controller | TASK [Create the virtual networks] ********************************************* 2025-12-01 11:06:06.083425 | controller | Monday 01 December 2025 11:06:05 +0000 (0:00:00.032) 0:00:45.592 ******* 2025-12-01 11:06:06.083436 | controller | 2025-12-01 11:06:06.105217 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ******************** 2025-12-01 11:06:06.105259 | controller | Monday 01 December 2025 11:06:06 +0000 (0:00:00.135) 0:00:45.728 ******* 2025-12-01 11:06:06.105276 | controller | ok: [instance] 2025-12-01 11:06:06.105284 | controller | 2025-12-01 11:06:06.105293 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] ******* 2025-12-01 11:06:06.300138 | controller | Monday 01 December 2025 11:06:06 +0000 (0:00:00.021) 0:00:45.750 ******* 2025-12-01 11:06:06.300173 | controller | ok: [instance] 2025-12-01 11:06:06.342713 | controller | 2025-12-01 11:06:06.342731 | controller | TASK [libvirt_manager : Load file if exists] *********************************** 2025-12-01 11:06:06.342738 | controller | Monday 01 December 2025 11:06:06 +0000 (0:00:00.194) 0:00:45.945 ******* 2025-12-01 11:06:06.342747 | controller | skipping: [instance] 2025-12-01 11:06:06.377841 | controller | 2025-12-01 11:06:06.377859 | controller | TASK [libvirt_manager : Update fact with existing content] ********************* 2025-12-01 11:06:06.377867 | controller | Monday 01 December 2025 11:06:06 +0000 (0:00:00.042) 0:00:45.987 ******* 2025-12-01 11:06:06.377875 | controller | skipping: [instance] 2025-12-01 11:06:06.435345 | controller | 2025-12-01 11:06:06.435369 | controller | TASK [libvirt_manager : Generate VM list] ************************************** 2025-12-01 11:06:06.435378 | controller | Monday 01 December 2025 11:06:06 +0000 (0:00:00.035) 0:00:46.022 ******* 2025-12-01 11:06:06.435388 | controller | ok: [instance] 2025-12-01 11:06:06.565194 | controller | 2025-12-01 11:06:06.565231 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] ********************* 2025-12-01 11:06:06.565241 | controller | Monday 01 December 2025 11:06:06 +0000 (0:00:00.057) 0:00:46.080 ******* 2025-12-01 11:06:06.565254 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-01 11:06:06.565286 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-01 11:06:06.565294 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-01 11:06:06.565303 | controller | 2025-12-01 11:06:06.565477 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] ********************** 2025-12-01 11:06:06.604558 | controller | Monday 01 December 2025 11:06:06 +0000 (0:00:00.129) 0:00:46.210 ******* 2025-12-01 11:06:06.604615 | controller | skipping: [instance] 2025-12-01 11:06:06.957525 | controller | 2025-12-01 11:06:06.957553 | controller | TASK [libvirt_manager : Dump MAC mapping] ************************************** 2025-12-01 11:06:06.957562 | controller | Monday 01 December 2025 11:06:06 +0000 (0:00:00.039) 0:00:46.249 ******* 2025-12-01 11:06:06.957572 | controller | changed: [instance] 2025-12-01 11:06:06.957602 | controller | 2025-12-01 11:06:06.957611 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] *********************** 2025-12-01 11:06:06.957634 | controller | Monday 01 December 2025 11:06:06 +0000 (0:00:00.353) 0:00:46.602 ******* 2025-12-01 11:06:07.076808 | controller | changed: [instance] => (item=Adding compute-0 to computes) 2025-12-01 11:06:07.100163 | controller | changed: [instance] => (item=Adding controller-0 to controllers) 2025-12-01 11:06:07.100207 | controller | changed: [instance] => (item=Adding crc-0 to ocps) 2025-12-01 11:06:07.100217 | controller | 2025-12-01 11:06:07.100225 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-01 11:06:07.100232 | controller | Monday 01 December 2025 11:06:07 +0000 (0:00:00.119) 0:00:46.721 ******* 2025-12-01 11:06:07.100245 | controller | skipping: [instance] 2025-12-01 11:06:07.123129 | controller | 2025-12-01 11:06:07.123154 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-01 11:06:07.123165 | controller | Monday 01 December 2025 11:06:07 +0000 (0:00:00.023) 0:00:46.745 ******* 2025-12-01 11:06:07.123178 | controller | skipping: [instance] 2025-12-01 11:06:07.123524 | controller | 2025-12-01 11:06:07.147925 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-01 11:06:07.147948 | controller | Monday 01 December 2025 11:06:07 +0000 (0:00:00.023) 0:00:46.768 ******* 2025-12-01 11:06:07.147961 | controller | skipping: [instance] 2025-12-01 11:06:07.171528 | controller | 2025-12-01 11:06:07.171550 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-01 11:06:07.171559 | controller | Monday 01 December 2025 11:06:07 +0000 (0:00:00.024) 0:00:46.793 ******* 2025-12-01 11:06:07.171570 | controller | skipping: [instance] 2025-12-01 11:06:07.189476 | controller | 2025-12-01 11:06:07.189497 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-01 11:06:07.189506 | controller | Monday 01 December 2025 11:06:07 +0000 (0:00:00.023) 0:00:46.816 ******* 2025-12-01 11:06:07.189517 | controller | ok: [instance] 2025-12-01 11:06:07.189710 | controller | 2025-12-01 11:06:07.189889 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-01 11:06:07.190081 | controller | Monday 01 December 2025 11:06:07 +0000 (0:00:00.018) 0:00:46.835 ******* 2025-12-01 11:06:07.267427 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-12-01 11:06:07.267659 | controller | 2025-12-01 11:06:07.267842 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-01 11:06:07.268019 | controller | Monday 01 December 2025 11:06:07 +0000 (0:00:00.077) 0:00:46.912 ******* 2025-12-01 11:06:07.285187 | controller | skipping: [instance] 2025-12-01 11:06:07.285372 | controller | 2025-12-01 11:06:07.285518 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-01 11:06:07.285672 | controller | Monday 01 December 2025 11:06:07 +0000 (0:00:00.017) 0:00:46.930 ******* 2025-12-01 11:06:07.487142 | controller | changed: [instance] 2025-12-01 11:06:07.487190 | controller | 2025-12-01 11:06:07.487200 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-01 11:06:07.487354 | controller | Monday 01 December 2025 11:06:07 +0000 (0:00:00.201) 0:00:47.132 ******* 2025-12-01 11:06:07.888637 | controller | changed: [instance] 2025-12-01 11:06:07.949719 | controller | 2025-12-01 11:06:07.949746 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-01 11:06:07.949754 | controller | Monday 01 December 2025 11:06:07 +0000 (0:00:00.400) 0:00:47.533 ******* 2025-12-01 11:06:07.949764 | controller | ok: [instance] 2025-12-01 11:06:07.980744 | controller | 2025-12-01 11:06:07.980762 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-01 11:06:07.980770 | controller | Monday 01 December 2025 11:06:07 +0000 (0:00:00.061) 0:00:47.594 ******* 2025-12-01 11:06:07.980778 | controller | ok: [instance] 2025-12-01 11:06:08.369980 | controller | 2025-12-01 11:06:08.370013 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-01 11:06:08.370021 | controller | Monday 01 December 2025 11:06:07 +0000 (0:00:00.031) 0:00:47.625 ******* 2025-12-01 11:06:08.370032 | controller | changed: [instance] 2025-12-01 11:06:08.458701 | controller | 2025-12-01 11:06:08.458734 | controller | TASK [libvirt_manager : Manage networks if needed] ***************************** 2025-12-01 11:06:08.458742 | controller | Monday 01 December 2025 11:06:08 +0000 (0:00:00.388) 0:00:48.014 ******* 2025-12-01 11:06:08.458752 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance 2025-12-01 11:06:08.516840 | controller | 2025-12-01 11:06:08.516865 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] *** 2025-12-01 11:06:08.516880 | controller | Monday 01 December 2025 11:06:08 +0000 (0:00:00.089) 0:00:48.103 ******* 2025-12-01 11:06:08.516890 | controller | ok: [instance] => (item=public) 2025-12-01 11:06:08.988699 | controller | ok: [instance] => (item=osp_trunk) 2025-12-01 11:06:08.988730 | controller | 2025-12-01 11:06:08.988738 | controller | TASK [libvirt_manager : Ensure networks are defined] *************************** 2025-12-01 11:06:08.988744 | controller | Monday 01 December 2025 11:06:08 +0000 (0:00:00.058) 0:00:48.161 ******* 2025-12-01 11:06:08.988754 | controller | changed: [instance] => (item=cifmw-public) 2025-12-01 11:06:09.646153 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-01 11:06:09.646184 | controller | 2025-12-01 11:06:09.646192 | controller | TASK [libvirt_manager : Ensure networks are created/started] ******************* 2025-12-01 11:06:09.646199 | controller | Monday 01 December 2025 11:06:08 +0000 (0:00:00.471) 0:00:48.633 ******* 2025-12-01 11:06:09.646208 | controller | ok: [instance] => (item=cifmw-public) 2025-12-01 11:06:09.646466 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-01 11:06:09.646478 | controller | 2025-12-01 11:06:09.646487 | controller | TASK [libvirt_manager : Ensure networks are active] **************************** 2025-12-01 11:06:10.101952 | controller | Monday 01 December 2025 11:06:09 +0000 (0:00:00.658) 0:00:49.291 ******* 2025-12-01 11:06:10.101988 | controller | ok: [instance] => (item=cifmw-public) 2025-12-01 11:06:10.547211 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-01 11:06:10.547246 | controller | 2025-12-01 11:06:10.547256 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ****************** 2025-12-01 11:06:10.547263 | controller | Monday 01 December 2025 11:06:10 +0000 (0:00:00.455) 0:00:49.746 ******* 2025-12-01 11:06:10.547283 | controller | changed: [instance] => (item=cifmw-public) 2025-12-01 11:06:10.607201 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-01 11:06:10.607237 | controller | 2025-12-01 11:06:10.607247 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] ********** 2025-12-01 11:06:10.607254 | controller | Monday 01 December 2025 11:06:10 +0000 (0:00:00.445) 0:00:50.192 ******* 2025-12-01 11:06:10.607266 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance 2025-12-01 11:06:10.607296 | controller | 2025-12-01 11:06:10.607306 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] *********************** 2025-12-01 11:06:10.607332 | controller | Monday 01 December 2025 11:06:10 +0000 (0:00:00.060) 0:00:50.252 ******* 2025-12-01 11:06:10.825247 | controller | ok: [instance] 2025-12-01 11:06:10.825282 | controller | 2025-12-01 11:06:10.825290 | controller | TASK [libvirt_manager : Fetch bridges ports link info] ************************* 2025-12-01 11:06:10.825299 | controller | Monday 01 December 2025 11:06:10 +0000 (0:00:00.217) 0:00:50.470 ******* 2025-12-01 11:06:11.219323 | controller | ok: [instance] => (item=cifmw-public) 2025-12-01 11:06:11.219438 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-01 11:06:11.219472 | controller | 2025-12-01 11:06:11.219483 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************ 2025-12-01 11:06:11.219685 | controller | Monday 01 December 2025 11:06:11 +0000 (0:00:00.394) 0:00:50.864 ******* 2025-12-01 11:06:11.288757 | controller | 2025-12-01 11:06:11.326254 | controller | TASK [ci_nmstate : Ensure we have needed facts] ******************************** 2025-12-01 11:06:11.326297 | controller | Monday 01 December 2025 11:06:11 +0000 (0:00:00.069) 0:00:50.933 ******* 2025-12-01 11:06:11.326312 | controller | skipping: [instance] 2025-12-01 11:06:12.602566 | controller | 2025-12-01 11:06:12.602596 | controller | TASK [ci_nmstate : Install required packages on instance] ********************** 2025-12-01 11:06:12.602604 | controller | Monday 01 December 2025 11:06:11 +0000 (0:00:00.037) 0:00:50.971 ******* 2025-12-01 11:06:12.602614 | controller | ok: [instance] 2025-12-01 11:06:12.803926 | controller | 2025-12-01 11:06:12.803957 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] ******************* 2025-12-01 11:06:12.803965 | controller | Monday 01 December 2025 11:06:12 +0000 (0:00:01.276) 0:00:52.247 ******* 2025-12-01 11:06:12.803975 | controller | ok: [instance] 2025-12-01 11:06:13.183845 | controller | 2025-12-01 11:06:13.183871 | controller | TASK [ci_nmstate : Save nmstate state for instance] **************************** 2025-12-01 11:06:13.183879 | controller | Monday 01 December 2025 11:06:12 +0000 (0:00:00.201) 0:00:52.449 ******* 2025-12-01 11:06:13.183889 | controller | changed: [instance] 2025-12-01 11:06:14.889286 | controller | 2025-12-01 11:06:14.889361 | controller | TASK [ci_nmstate : Apply the desidered state on instance] ********************** 2025-12-01 11:06:14.889374 | controller | Monday 01 December 2025 11:06:13 +0000 (0:00:00.379) 0:00:52.829 ******* 2025-12-01 11:06:14.889393 | controller | changed: [instance] 2025-12-01 11:06:14.889421 | controller | 2025-12-01 11:06:14.889432 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] ******************* 2025-12-01 11:06:15.248729 | controller | Monday 01 December 2025 11:06:14 +0000 (0:00:01.705) 0:00:54.534 ******* 2025-12-01 11:06:15.248833 | controller | changed: [instance] 2025-12-01 11:06:15.248857 | controller | 2025-12-01 11:06:15.248865 | controller | TASK [Create extra network configuration] ************************************** 2025-12-01 11:06:15.281732 | controller | Monday 01 December 2025 11:06:15 +0000 (0:00:00.359) 0:00:54.894 ******* 2025-12-01 11:06:15.281829 | controller | skipping: [instance] 2025-12-01 11:06:15.281865 | controller | 2025-12-01 11:06:15.282085 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] ************** 2025-12-01 11:06:15.282146 | controller | Monday 01 December 2025 11:06:15 +0000 (0:00:00.033) 0:00:54.927 ******* 2025-12-01 11:06:15.319215 | controller | skipping: [instance] 2025-12-01 11:06:15.319451 | controller | 2025-12-01 11:06:15.319481 | controller | TASK [libvirt_manager : Refresh networking facts on host] ********************** 2025-12-01 11:06:15.786202 | controller | Monday 01 December 2025 11:06:15 +0000 (0:00:00.036) 0:00:54.964 ******* 2025-12-01 11:06:15.786244 | controller | ok: [instance] 2025-12-01 11:06:15.941709 | controller | 2025-12-01 11:06:15.941764 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] ********** 2025-12-01 11:06:15.941774 | controller | Monday 01 December 2025 11:06:15 +0000 (0:00:00.466) 0:00:55.431 ******* 2025-12-01 11:06:15.941786 | controller | ok: [instance] => (item=cifmw-public) 2025-12-01 11:06:17.201138 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-01 11:06:17.201181 | controller | 2025-12-01 11:06:17.201191 | controller | TASK [dnsmasq : Install needed packages] *************************************** 2025-12-01 11:06:17.201199 | controller | Monday 01 December 2025 11:06:15 +0000 (0:00:00.155) 0:00:55.586 ******* 2025-12-01 11:06:17.201212 | controller | ok: [instance] 2025-12-01 11:06:21.086176 | controller | 2025-12-01 11:06:21.086210 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ****** 2025-12-01 11:06:21.086219 | controller | Monday 01 December 2025 11:06:17 +0000 (0:00:01.259) 0:00:56.845 ******* 2025-12-01 11:06:21.086229 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'}) 2025-12-01 11:06:21.086254 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'}) 2025-12-01 11:06:21.086608 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'}) 2025-12-01 11:06:21.324991 | controller | 2025-12-01 11:06:21.325025 | controller | TASK [dnsmasq : Manage configuration directory] ******************************** 2025-12-01 11:06:21.325035 | controller | Monday 01 December 2025 11:06:21 +0000 (0:00:03.885) 0:01:00.731 ******* 2025-12-01 11:06:21.325047 | controller | changed: [instance] 2025-12-01 11:06:21.720658 | controller | 2025-12-01 11:06:21.720692 | controller | TASK [dnsmasq : Manage systemd unit file] ************************************** 2025-12-01 11:06:21.720702 | controller | Monday 01 December 2025 11:06:21 +0000 (0:00:00.238) 0:01:00.969 ******* 2025-12-01 11:06:21.720714 | controller | changed: [instance] 2025-12-01 11:06:22.143904 | controller | 2025-12-01 11:06:22.143935 | controller | TASK [dnsmasq : Manage base configuration file] ******************************** 2025-12-01 11:06:22.143943 | controller | Monday 01 December 2025 11:06:21 +0000 (0:00:00.395) 0:01:01.365 ******* 2025-12-01 11:06:22.143953 | controller | changed: [instance] 2025-12-01 11:06:22.183991 | controller | 2025-12-01 11:06:22.184017 | controller | TASK [dnsmasq : Render listener configuration] ********************************* 2025-12-01 11:06:22.184025 | controller | Monday 01 December 2025 11:06:22 +0000 (0:00:00.422) 0:01:01.788 ******* 2025-12-01 11:06:22.184035 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance 2025-12-01 11:06:22.612582 | controller | 2025-12-01 11:06:22.612617 | controller | TASK [dnsmasq : Create listener configuration file] **************************** 2025-12-01 11:06:22.612627 | controller | Monday 01 December 2025 11:06:22 +0000 (0:00:00.040) 0:01:01.829 ******* 2025-12-01 11:06:22.612639 | controller | changed: [instance] 2025-12-01 11:06:22.640217 | controller | 2025-12-01 11:06:22.640240 | controller | TASK [dnsmasq : Remove listener configuration file] **************************** 2025-12-01 11:06:22.640250 | controller | Monday 01 December 2025 11:06:22 +0000 (0:00:00.428) 0:01:02.257 ******* 2025-12-01 11:06:22.640261 | controller | skipping: [instance] 2025-12-01 11:06:22.681223 | controller | 2025-12-01 11:06:22.681252 | controller | TASK [dnsmasq : Render dns configuration] ************************************** 2025-12-01 11:06:22.681263 | controller | Monday 01 December 2025 11:06:22 +0000 (0:00:00.027) 0:01:02.285 ******* 2025-12-01 11:06:22.681275 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance 2025-12-01 11:06:23.087481 | controller | 2025-12-01 11:06:23.087517 | controller | TASK [dnsmasq : Create dns configuration file] ********************************* 2025-12-01 11:06:23.087527 | controller | Monday 01 December 2025 11:06:22 +0000 (0:00:00.041) 0:01:02.326 ******* 2025-12-01 11:06:23.087540 | controller | changed: [instance] 2025-12-01 11:06:23.087695 | controller | 2025-12-01 11:06:23.087867 | controller | TASK [dnsmasq : Remove dns configuration file] ********************************* 2025-12-01 11:06:23.088008 | controller | Monday 01 December 2025 11:06:23 +0000 (0:00:00.406) 0:01:02.732 ******* 2025-12-01 11:06:23.113874 | controller | skipping: [instance] 2025-12-01 11:06:23.114093 | controller | 2025-12-01 11:06:23.114298 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] *** 2025-12-01 11:06:23.114471 | controller | Monday 01 December 2025 11:06:23 +0000 (0:00:00.026) 0:01:02.759 ******* 2025-12-01 11:06:23.361718 | controller | ok: [instance] => (item=127.0.0.2) 2025-12-01 11:06:24.120214 | controller | 2025-12-01 11:06:24.120274 | controller | TASK [dnsmasq : Enable and start service] ************************************** 2025-12-01 11:06:24.120293 | controller | Monday 01 December 2025 11:06:23 +0000 (0:00:00.247) 0:01:03.006 ******* 2025-12-01 11:06:24.120308 | controller | changed: [instance] 2025-12-01 11:06:24.120341 | controller | 2025-12-01 11:06:24.120350 | controller | TASK [dnsmasq : Stop service] ************************************************** 2025-12-01 11:06:24.120540 | controller | Monday 01 December 2025 11:06:24 +0000 (0:00:00.758) 0:01:03.765 ******* 2025-12-01 11:06:24.144272 | controller | skipping: [instance] 2025-12-01 11:06:24.192205 | controller | 2025-12-01 11:06:24.192237 | controller | TASK [dnsmasq : Remove unit file] ********************************************** 2025-12-01 11:06:24.192248 | controller | Monday 01 December 2025 11:06:24 +0000 (0:00:00.024) 0:01:03.789 ******* 2025-12-01 11:06:24.192261 | controller | skipping: [instance] 2025-12-01 11:06:24.224193 | controller | 2025-12-01 11:06:24.224219 | controller | TASK [dnsmasq : Remove main configuration files] ******************************* 2025-12-01 11:06:24.224229 | controller | Monday 01 December 2025 11:06:24 +0000 (0:00:00.047) 0:01:03.837 ******* 2025-12-01 11:06:24.224241 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-12-01 11:06:24.224261 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d) 2025-12-01 11:06:24.224268 | controller | skipping: [instance] 2025-12-01 11:06:24.224275 | controller | 2025-12-01 11:06:24.224294 | controller | TASK [Create dnsmasq networks] ************************************************* 2025-12-01 11:06:24.224327 | controller | Monday 01 December 2025 11:06:24 +0000 (0:00:00.031) 0:01:03.869 ******* 2025-12-01 11:06:24.343976 | controller | 2025-12-01 11:06:24.375323 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-12-01 11:06:24.375357 | controller | Monday 01 December 2025 11:06:24 +0000 (0:00:00.119) 0:01:03.989 ******* 2025-12-01 11:06:24.375371 | controller | ok: [instance] => changed=false 2025-12-01 11:06:24.375558 | controller | msg: All assertions passed 2025-12-01 11:06:24.375723 | controller | 2025-12-01 11:06:24.375909 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-12-01 11:06:24.376094 | controller | Monday 01 December 2025 11:06:24 +0000 (0:00:00.031) 0:01:04.020 ******* 2025-12-01 11:06:24.415044 | controller | ok: [instance] => changed=false 2025-12-01 11:06:24.415245 | controller | msg: All assertions passed 2025-12-01 11:06:24.415383 | controller | 2025-12-01 11:06:24.415522 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-12-01 11:06:24.415654 | controller | Monday 01 December 2025 11:06:24 +0000 (0:00:00.039) 0:01:04.060 ******* 2025-12-01 11:06:24.935176 | controller | changed: [instance] 2025-12-01 11:06:24.935229 | controller | 2025-12-01 11:06:24.935246 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-12-01 11:06:24.935262 | controller | Monday 01 December 2025 11:06:24 +0000 (0:00:00.519) 0:01:04.580 ******* 2025-12-01 11:06:24.964725 | controller | skipping: [instance] 2025-12-01 11:06:24.995839 | controller | 2025-12-01 11:06:24.995880 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-12-01 11:06:24.995890 | controller | Monday 01 December 2025 11:06:24 +0000 (0:00:00.029) 0:01:04.609 ******* 2025-12-01 11:06:24.995901 | controller | skipping: [instance] 2025-12-01 11:06:25.029685 | controller | 2025-12-01 11:06:25.029703 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************ 2025-12-01 11:06:25.029711 | controller | Monday 01 December 2025 11:06:24 +0000 (0:00:00.031) 0:01:04.641 ******* 2025-12-01 11:06:25.029724 | controller | ok: [instance] => changed=false 2025-12-01 11:06:25.069291 | controller | msg: All assertions passed 2025-12-01 11:06:25.069360 | controller | 2025-12-01 11:06:25.069372 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] ******************* 2025-12-01 11:06:25.069381 | controller | Monday 01 December 2025 11:06:25 +0000 (0:00:00.033) 0:01:04.674 ******* 2025-12-01 11:06:25.069398 | controller | ok: [instance] => changed=false 2025-12-01 11:06:25.069443 | controller | msg: All assertions passed 2025-12-01 11:06:25.069464 | controller | 2025-12-01 11:06:25.069487 | controller | TASK [dnsmasq : Create network] ************************************************ 2025-12-01 11:06:25.069613 | controller | Monday 01 December 2025 11:06:25 +0000 (0:00:00.039) 0:01:04.714 ******* 2025-12-01 11:06:25.560827 | controller | changed: [instance] 2025-12-01 11:06:25.585270 | controller | 2025-12-01 11:06:25.585334 | controller | TASK [dnsmasq : Remove network] ************************************************ 2025-12-01 11:06:25.585346 | controller | Monday 01 December 2025 11:06:25 +0000 (0:00:00.491) 0:01:05.205 ******* 2025-12-01 11:06:25.585363 | controller | skipping: [instance] 2025-12-01 11:06:25.614178 | controller | 2025-12-01 11:06:25.614202 | controller | TASK [dnsmasq : Remove dhcp host files] **************************************** 2025-12-01 11:06:25.614212 | controller | Monday 01 December 2025 11:06:25 +0000 (0:00:00.024) 0:01:05.230 ******* 2025-12-01 11:06:25.614223 | controller | skipping: [instance] 2025-12-01 11:06:25.614231 | controller | 2025-12-01 11:06:25.614238 | controller | TASK [Deploy radvd for IPv6 router advertisements] ***************************** 2025-12-01 11:06:25.614248 | controller | Monday 01 December 2025 11:06:25 +0000 (0:00:00.028) 0:01:05.259 ******* 2025-12-01 11:06:25.649619 | controller | skipping: [instance] 2025-12-01 11:06:26.179243 | controller | 2025-12-01 11:06:26.179274 | controller | TASK [libvirt_manager : Ensure network is in correct zone] ********************* 2025-12-01 11:06:26.179283 | controller | Monday 01 December 2025 11:06:25 +0000 (0:00:00.035) 0:01:05.294 ******* 2025-12-01 11:06:26.179293 | controller | changed: [instance] => (item=cifmw-public) 2025-12-01 11:06:26.179587 | controller | changed: [instance] => (item=cifmw-osp_trunk) 2025-12-01 11:06:26.217038 | controller | 2025-12-01 11:06:26.217080 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-01 11:06:26.217094 | controller | Monday 01 December 2025 11:06:26 +0000 (0:00:00.529) 0:01:05.824 ******* 2025-12-01 11:06:26.217106 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public) 2025-12-01 11:06:26.553104 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk) 2025-12-01 11:06:26.553136 | controller | 2025-12-01 11:06:26.553144 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-01 11:06:26.553151 | controller | Monday 01 December 2025 11:06:26 +0000 (0:00:00.037) 0:01:05.862 ******* 2025-12-01 11:06:26.553161 | controller | ok: [instance] 2025-12-01 11:06:26.589982 | controller | 2025-12-01 11:06:26.590012 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-12-01 11:06:26.590021 | controller | Monday 01 December 2025 11:06:26 +0000 (0:00:00.336) 0:01:06.198 ******* 2025-12-01 11:06:26.590031 | controller | ok: [instance] 2025-12-01 11:06:26.802492 | controller | 2025-12-01 11:06:26.802525 | controller | TASK [libvirt_manager : Extract IP address from network bridges] *************** 2025-12-01 11:06:26.802533 | controller | Monday 01 December 2025 11:06:26 +0000 (0:00:00.037) 0:01:06.235 ******* 2025-12-01 11:06:26.802543 | controller | ok: [instance] 2025-12-01 11:06:26.842827 | controller | 2025-12-01 11:06:26.842862 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] *** 2025-12-01 11:06:26.842870 | controller | Monday 01 December 2025 11:06:26 +0000 (0:00:00.212) 0:01:06.447 ******* 2025-12-01 11:06:26.842892 | controller | ok: [instance] 2025-12-01 11:06:27.208571 | controller | 2025-12-01 11:06:27.208609 | controller | TASK [libvirt_manager : Output _network_data] ********************************** 2025-12-01 11:06:27.208618 | controller | Monday 01 December 2025 11:06:26 +0000 (0:00:00.040) 0:01:06.487 ******* 2025-12-01 11:06:27.208636 | controller | changed: [instance] 2025-12-01 11:06:27.582207 | controller | 2025-12-01 11:06:27.582264 | controller | TASK [libvirt_manager : Output pub_net] **************************************** 2025-12-01 11:06:27.582275 | controller | Monday 01 December 2025 11:06:27 +0000 (0:00:00.365) 0:01:06.853 ******* 2025-12-01 11:06:27.582289 | controller | changed: [instance] 2025-12-01 11:06:27.582335 | controller | 2025-12-01 11:06:27.582425 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ****************** 2025-12-01 11:06:27.582460 | controller | Monday 01 December 2025 11:06:27 +0000 (0:00:00.373) 0:01:07.227 ******* 2025-12-01 11:06:27.985227 | controller | changed: [instance] 2025-12-01 11:06:28.093246 | controller | 2025-12-01 11:06:28.093317 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ******************** 2025-12-01 11:06:28.093328 | controller | Monday 01 December 2025 11:06:27 +0000 (0:00:00.402) 0:01:07.629 ******* 2025-12-01 11:06:28.093346 | controller | ok: [instance] 2025-12-01 11:06:28.093432 | controller | 2025-12-01 11:06:28.093484 | controller | TASK [libvirt_manager : Save networking_mapper patch] ************************** 2025-12-01 11:06:28.455567 | controller | Monday 01 December 2025 11:06:28 +0000 (0:00:00.108) 0:01:07.738 ******* 2025-12-01 11:06:28.455612 | controller | changed: [instance] 2025-12-01 11:06:28.489206 | controller | 2025-12-01 11:06:28.489246 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-01 11:06:28.489257 | controller | Monday 01 December 2025 11:06:28 +0000 (0:00:00.361) 0:01:08.100 ******* 2025-12-01 11:06:28.489270 | controller | skipping: [instance] 2025-12-01 11:06:28.525234 | controller | 2025-12-01 11:06:28.525261 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-01 11:06:28.525269 | controller | Monday 01 December 2025 11:06:28 +0000 (0:00:00.034) 0:01:08.134 ******* 2025-12-01 11:06:28.525280 | controller | skipping: [instance] 2025-12-01 11:06:28.554549 | controller | 2025-12-01 11:06:28.554572 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-01 11:06:28.554582 | controller | Monday 01 December 2025 11:06:28 +0000 (0:00:00.036) 0:01:08.170 ******* 2025-12-01 11:06:28.554592 | controller | skipping: [instance] 2025-12-01 11:06:28.583021 | controller | 2025-12-01 11:06:28.583044 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-01 11:06:28.583053 | controller | Monday 01 December 2025 11:06:28 +0000 (0:00:00.029) 0:01:08.199 ******* 2025-12-01 11:06:28.583084 | controller | skipping: [instance] 2025-12-01 11:06:28.604741 | controller | 2025-12-01 11:06:28.604763 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-01 11:06:28.604781 | controller | Monday 01 December 2025 11:06:28 +0000 (0:00:00.028) 0:01:08.228 ******* 2025-12-01 11:06:28.604792 | controller | ok: [instance] 2025-12-01 11:06:28.693699 | controller | 2025-12-01 11:06:28.693728 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-01 11:06:28.693738 | controller | Monday 01 December 2025 11:06:28 +0000 (0:00:00.021) 0:01:08.250 ******* 2025-12-01 11:06:28.693753 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}}) 2025-12-01 11:06:28.693985 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-12-01 11:06:28.694185 | controller | 2025-12-01 11:06:28.694341 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-01 11:06:28.694476 | controller | Monday 01 December 2025 11:06:28 +0000 (0:00:00.089) 0:01:08.339 ******* 2025-12-01 11:06:28.724344 | controller | skipping: [instance] 2025-12-01 11:06:28.724525 | controller | 2025-12-01 11:06:28.724701 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-01 11:06:28.724868 | controller | Monday 01 December 2025 11:06:28 +0000 (0:00:00.030) 0:01:08.369 ******* 2025-12-01 11:06:28.968169 | controller | ok: [instance] 2025-12-01 11:06:28.968513 | controller | 2025-12-01 11:06:29.401704 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-01 11:06:29.401736 | controller | Monday 01 December 2025 11:06:28 +0000 (0:00:00.243) 0:01:08.613 ******* 2025-12-01 11:06:29.401748 | controller | changed: [instance] 2025-12-01 11:06:29.476323 | controller | 2025-12-01 11:06:29.476409 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-01 11:06:29.476421 | controller | Monday 01 December 2025 11:06:29 +0000 (0:00:00.433) 0:01:09.046 ******* 2025-12-01 11:06:29.476442 | controller | ok: [instance] 2025-12-01 11:06:29.476518 | controller | 2025-12-01 11:06:29.476566 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-01 11:06:29.523965 | controller | Monday 01 December 2025 11:06:29 +0000 (0:00:00.074) 0:01:09.121 ******* 2025-12-01 11:06:29.523997 | controller | ok: [instance] 2025-12-01 11:06:29.995224 | controller | 2025-12-01 11:06:29.995272 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-01 11:06:29.995283 | controller | Monday 01 December 2025 11:06:29 +0000 (0:00:00.047) 0:01:09.169 ******* 2025-12-01 11:06:29.995297 | controller | changed: [instance] 2025-12-01 11:06:29.995328 | controller | 2025-12-01 11:06:29.995338 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] *** 2025-12-01 11:06:29.995415 | controller | Monday 01 December 2025 11:06:29 +0000 (0:00:00.471) 0:01:09.640 ******* 2025-12-01 11:06:30.030270 | controller | ok: [instance] 2025-12-01 11:06:30.052844 | controller | 2025-12-01 11:06:30.052867 | controller | TASK [libvirt_manager : Unset patch] ******************************************* 2025-12-01 11:06:30.052875 | controller | Monday 01 December 2025 11:06:30 +0000 (0:00:00.034) 0:01:09.675 ******* 2025-12-01 11:06:30.052885 | controller | ok: [instance] 2025-12-01 11:06:30.075730 | controller | 2025-12-01 11:06:30.075752 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] **************** 2025-12-01 11:06:30.075761 | controller | Monday 01 December 2025 11:06:30 +0000 (0:00:00.022) 0:01:09.698 ******* 2025-12-01 11:06:30.075772 | controller | ok: [instance] 2025-12-01 11:06:30.154561 | controller | 2025-12-01 11:06:30.154580 | controller | TASK [libvirt_manager : Reserve IPs on networks] ******************************* 2025-12-01 11:06:30.154587 | controller | Monday 01 December 2025 11:06:30 +0000 (0:00:00.022) 0:01:09.720 ******* 2025-12-01 11:06:30.154597 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane) 2025-12-01 11:06:30.371281 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi) 2025-12-01 11:06:30.371331 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage) 2025-12-01 11:06:30.371340 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant) 2025-12-01 11:06:30.371347 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external) 2025-12-01 11:06:30.371354 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt) 2025-12-01 11:06:30.371361 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public) 2025-12-01 11:06:30.371368 | controller | 2025-12-01 11:06:30.371375 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-01 11:06:30.371383 | controller | Monday 01 December 2025 11:06:30 +0000 (0:00:00.078) 0:01:09.799 ******* 2025-12-01 11:06:30.371396 | controller | ok: [instance] => (item=compute-0 - ctlplane) 2025-12-01 11:06:30.371512 | controller | ok: [instance] => (item=controller-0 - ctlplane) 2025-12-01 11:06:30.371522 | controller | ok: [instance] => (item=crc-0 - ctlplane) 2025-12-01 11:06:30.371528 | controller | 2025-12-01 11:06:30.371533 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-01 11:06:30.371541 | controller | Monday 01 December 2025 11:06:30 +0000 (0:00:00.217) 0:01:10.016 ******* 2025-12-01 11:06:30.471678 | controller | skipping: [instance] => (item=compute-0 - internalapi) 2025-12-01 11:06:30.471816 | controller | skipping: [instance] => (item=controller-0 - internalapi) 2025-12-01 11:06:30.471991 | controller | skipping: [instance] => (item=crc-0 - internalapi) 2025-12-01 11:06:30.472207 | controller | skipping: [instance] 2025-12-01 11:06:30.472321 | controller | 2025-12-01 11:06:30.472457 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-01 11:06:30.472581 | controller | Monday 01 December 2025 11:06:30 +0000 (0:00:00.100) 0:01:10.117 ******* 2025-12-01 11:06:30.576425 | controller | skipping: [instance] => (item=compute-0 - storage) 2025-12-01 11:06:30.576692 | controller | skipping: [instance] => (item=controller-0 - storage) 2025-12-01 11:06:30.576916 | controller | skipping: [instance] => (item=crc-0 - storage) 2025-12-01 11:06:30.577037 | controller | skipping: [instance] 2025-12-01 11:06:30.577185 | controller | 2025-12-01 11:06:30.577283 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-01 11:06:30.577388 | controller | Monday 01 December 2025 11:06:30 +0000 (0:00:00.104) 0:01:10.221 ******* 2025-12-01 11:06:30.665452 | controller | skipping: [instance] => (item=compute-0 - tenant) 2025-12-01 11:06:30.665575 | controller | skipping: [instance] => (item=controller-0 - tenant) 2025-12-01 11:06:30.665718 | controller | skipping: [instance] => (item=crc-0 - tenant) 2025-12-01 11:06:30.665902 | controller | skipping: [instance] 2025-12-01 11:06:30.665998 | controller | 2025-12-01 11:06:30.666175 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-01 11:06:30.666264 | controller | Monday 01 December 2025 11:06:30 +0000 (0:00:00.089) 0:01:10.310 ******* 2025-12-01 11:06:30.753322 | controller | skipping: [instance] => (item=compute-0 - external) 2025-12-01 11:06:30.753429 | controller | skipping: [instance] => (item=controller-0 - external) 2025-12-01 11:06:30.753556 | controller | skipping: [instance] => (item=crc-0 - external) 2025-12-01 11:06:30.753672 | controller | skipping: [instance] 2025-12-01 11:06:30.753775 | controller | 2025-12-01 11:06:30.753881 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-01 11:06:30.754025 | controller | Monday 01 December 2025 11:06:30 +0000 (0:00:00.087) 0:01:10.398 ******* 2025-12-01 11:06:30.841856 | controller | skipping: [instance] => (item=compute-0 - storagemgmt) 2025-12-01 11:06:30.842100 | controller | skipping: [instance] => (item=controller-0 - storagemgmt) 2025-12-01 11:06:30.842354 | controller | skipping: [instance] => (item=crc-0 - storagemgmt) 2025-12-01 11:06:30.842482 | controller | skipping: [instance] 2025-12-01 11:06:30.842589 | controller | 2025-12-01 11:06:30.842715 | controller | TASK [libvirt_manager : Loop on host IPs] ************************************** 2025-12-01 11:06:30.842829 | controller | Monday 01 December 2025 11:06:30 +0000 (0:00:00.088) 0:01:10.487 ******* 2025-12-01 11:06:30.988125 | controller | ok: [instance] => (item=compute-0 - public) 2025-12-01 11:06:30.988311 | controller | ok: [instance] => (item=controller-0 - public) 2025-12-01 11:06:30.988544 | controller | ok: [instance] => (item=crc-0 - public) 2025-12-01 11:06:30.988731 | controller | 2025-12-01 11:06:30.988848 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ****************************** 2025-12-01 11:06:30.988959 | controller | Monday 01 December 2025 11:06:30 +0000 (0:00:00.146) 0:01:10.633 ******* 2025-12-01 11:06:31.107982 | controller | 2025-12-01 11:06:31.108118 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************ 2025-12-01 11:06:31.108279 | controller | Monday 01 December 2025 11:06:31 +0000 (0:00:00.119) 0:01:10.753 ******* 2025-12-01 11:06:31.155433 | controller | ok: [instance] 2025-12-01 11:06:31.155573 | controller | 2025-12-01 11:06:31.155723 | controller | TASK [dnsmasq : Assert we have needed host data] ******************************* 2025-12-01 11:06:31.155864 | controller | Monday 01 December 2025 11:06:31 +0000 (0:00:00.047) 0:01:10.801 ******* 2025-12-01 11:06:31.258830 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:2d:1f:82', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-12-01 11:06:31.258961 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:eb:c8:42', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-12-01 11:06:31.259182 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:4c:38:df', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-12-01 11:06:31.259286 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:6d:ef:15', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-12-01 11:06:31.259404 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:a2:57:54', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-12-01 11:06:31.259544 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:49:3e:1e', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-12-01 11:06:31.259651 | controller | 2025-12-01 11:06:31.259765 | controller | TASK [dnsmasq : Ensure networks exists] **************************************** 2025-12-01 11:06:31.259882 | controller | Monday 01 December 2025 11:06:31 +0000 (0:00:00.103) 0:01:10.904 ******* 2025-12-01 11:06:31.314292 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk) 2025-12-01 11:06:31.314426 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public) 2025-12-01 11:06:31.314530 | controller | 2025-12-01 11:06:31.314649 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-12-01 11:06:31.314763 | controller | Monday 01 December 2025 11:06:31 +0000 (0:00:00.055) 0:01:10.959 ******* 2025-12-01 11:06:31.500259 | controller | ok: [instance] 2025-12-01 11:06:31.500314 | controller | 2025-12-01 11:06:31.500322 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-12-01 11:06:31.500338 | controller | Monday 01 December 2025 11:06:31 +0000 (0:00:00.185) 0:01:11.145 ******* 2025-12-01 11:06:31.526676 | controller | ok: [instance] 2025-12-01 11:06:31.710189 | controller | 2025-12-01 11:06:31.710232 | controller | TASK [dnsmasq : Check network file status] ************************************* 2025-12-01 11:06:31.710241 | controller | Monday 01 December 2025 11:06:31 +0000 (0:00:00.026) 0:01:11.172 ******* 2025-12-01 11:06:31.710253 | controller | ok: [instance] 2025-12-01 11:06:31.710280 | controller | 2025-12-01 11:06:31.710687 | controller | TASK [dnsmasq : Assert network exists] ***************************************** 2025-12-01 11:06:31.736631 | controller | Monday 01 December 2025 11:06:31 +0000 (0:00:00.183) 0:01:11.355 ******* 2025-12-01 11:06:31.736658 | controller | ok: [instance] 2025-12-01 11:06:31.759701 | controller | 2025-12-01 11:06:31.759723 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] **************************** 2025-12-01 11:06:31.759733 | controller | Monday 01 December 2025 11:06:31 +0000 (0:00:00.026) 0:01:11.381 ******* 2025-12-01 11:06:31.759744 | controller | ok: [instance] 2025-12-01 11:06:31.943228 | controller | 2025-12-01 11:06:31.943274 | controller | TASK [dnsmasq : Compute entry] ************************************************* 2025-12-01 11:06:31.943284 | controller | Monday 01 December 2025 11:06:31 +0000 (0:00:00.023) 0:01:11.404 ******* 2025-12-01 11:06:31.943298 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:2d:1f:82', 'ips': ['192.168.140.100', ''], 'tag': 'compute'}) 2025-12-01 11:06:31.943330 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:eb:c8:42', 'ips': ['192.168.140.9', ''], 'tag': 'controller'}) 2025-12-01 11:06:31.943338 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:4c:38:df', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'}) 2025-12-01 11:06:31.943345 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:6d:ef:15', 'ips': ['192.168.101.100', ''], 'tag': 'compute'}) 2025-12-01 11:06:31.943351 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:a2:57:54', 'ips': ['192.168.101.9', ''], 'tag': 'controller'}) 2025-12-01 11:06:31.943361 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:49:3e:1e', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'}) 2025-12-01 11:06:31.943534 | controller | 2025-12-01 11:06:31.943556 | controller | TASK [dnsmasq : Create add/remove sets] **************************************** 2025-12-01 11:06:31.985237 | controller | Monday 01 December 2025 11:06:31 +0000 (0:00:00.183) 0:01:11.588 ******* 2025-12-01 11:06:31.985278 | controller | ok: [instance] 2025-12-01 11:06:34.042053 | controller | 2025-12-01 11:06:34.042098 | controller | TASK [dnsmasq : Add DHCP entries] ********************************************** 2025-12-01 11:06:34.042106 | controller | Monday 01 December 2025 11:06:31 +0000 (0:00:00.042) 0:01:11.630 ******* 2025-12-01 11:06:34.042117 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:2d:1f:82', 'entry': 'set:compute,52:54:00:2d:1f:82,192.168.140.100,compute-0', 'state': 'present'}) 2025-12-01 11:06:34.072020 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:eb:c8:42', 'entry': 'set:controller,52:54:01:eb:c8:42,192.168.140.9,controller-0', 'state': 'present'}) 2025-12-01 11:06:34.072039 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:4c:38:df', 'entry': 'set:ocp,52:54:02:4c:38:df,192.168.140.10,crc-0', 'state': 'present'}) 2025-12-01 11:06:34.072048 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:6d:ef:15', 'entry': 'set:compute,52:54:00:6d:ef:15,192.168.101.100,compute-0', 'state': 'present'}) 2025-12-01 11:06:34.072055 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:a2:57:54', 'entry': 'set:controller,52:54:01:a2:57:54,192.168.101.9,controller-0', 'state': 'present'}) 2025-12-01 11:06:34.072085 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:49:3e:1e', 'entry': 'set:ocp,52:54:02:49:3e:1e,192.168.101.10,crc-0', 'state': 'present'}) 2025-12-01 11:06:34.072099 | controller | 2025-12-01 11:06:34.072106 | controller | TASK [dnsmasq : Remove DHCP entries] ******************************************* 2025-12-01 11:06:34.072118 | controller | Monday 01 December 2025 11:06:34 +0000 (0:00:02.055) 0:01:13.686 ******* 2025-12-01 11:06:34.072128 | controller | skipping: [instance] 2025-12-01 11:06:34.304247 | controller | 2025-12-01 11:06:34.304290 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] *********** 2025-12-01 11:06:34.304304 | controller | Monday 01 December 2025 11:06:34 +0000 (0:00:00.031) 0:01:13.717 ******* 2025-12-01 11:06:34.304320 | controller | ok: [instance] => (item=compute-0) 2025-12-01 11:06:34.436618 | controller | ok: [instance] => (item=controller-0) 2025-12-01 11:06:34.436653 | controller | ok: [instance] => (item=crc-0) 2025-12-01 11:06:34.436663 | controller | 2025-12-01 11:06:34.436671 | controller | TASK [Inject VMs in the .utility zone] ***************************************** 2025-12-01 11:06:34.436679 | controller | Monday 01 December 2025 11:06:34 +0000 (0:00:00.231) 0:01:13.948 ******* 2025-12-01 11:06:34.436690 | controller | 2025-12-01 11:06:34.483125 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-01 11:06:34.483153 | controller | Monday 01 December 2025 11:06:34 +0000 (0:00:00.133) 0:01:14.081 ******* 2025-12-01 11:06:34.483167 | controller | ok: [instance] 2025-12-01 11:06:34.688680 | controller | 2025-12-01 11:06:34.688702 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-01 11:06:34.688712 | controller | Monday 01 December 2025 11:06:34 +0000 (0:00:00.046) 0:01:14.128 ******* 2025-12-01 11:06:34.688723 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-01 11:06:34.688914 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-01 11:06:34.689131 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-12-01 11:06:34.689312 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-12-01 11:06:34.689482 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-12-01 11:06:34.689656 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-12-01 11:06:34.689808 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-12-01 11:06:34.689954 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-01 11:06:34.690140 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-01 11:06:34.690297 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-12-01 11:06:34.690435 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-01 11:06:34.690571 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-01 11:06:34.690703 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-12-01 11:06:34.690836 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-12-01 11:06:34.690976 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-12-01 11:06:34.691152 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-12-01 11:06:34.691281 | controller | 2025-12-01 11:06:34.691409 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-01 11:06:34.691537 | controller | Monday 01 December 2025 11:06:34 +0000 (0:00:00.205) 0:01:14.334 ******* 2025-12-01 11:06:37.953260 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-01 11:06:37.953331 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'}) 2025-12-01 11:06:37.953342 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'}) 2025-12-01 11:06:37.953350 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'}) 2025-12-01 11:06:37.953357 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'}) 2025-12-01 11:06:37.953367 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'}) 2025-12-01 11:06:37.954660 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'}) 2025-12-01 11:06:37.974688 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-01 11:06:37.974712 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-01 11:06:37.974722 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'}) 2025-12-01 11:06:37.974730 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-01 11:06:37.974738 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'}) 2025-12-01 11:06:37.974745 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'}) 2025-12-01 11:06:37.974752 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'}) 2025-12-01 11:06:37.974760 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'}) 2025-12-01 11:06:37.974767 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'}) 2025-12-01 11:06:37.974774 | controller | 2025-12-01 11:06:37.974782 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] **************** 2025-12-01 11:06:37.974790 | controller | Monday 01 December 2025 11:06:37 +0000 (0:00:03.263) 0:01:17.597 ******* 2025-12-01 11:06:37.974801 | controller | ok: [instance] 2025-12-01 11:06:38.021986 | controller | 2025-12-01 11:06:38.022014 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] ************** 2025-12-01 11:06:38.022023 | controller | Monday 01 December 2025 11:06:37 +0000 (0:00:00.021) 0:01:17.619 ******* 2025-12-01 11:06:38.022035 | controller | skipping: [instance] => (item=compute) 2025-12-01 11:06:38.054180 | controller | skipping: [instance] => (item=controller) 2025-12-01 11:06:38.054202 | controller | skipping: [instance] => (item=crc) 2025-12-01 11:06:38.054211 | controller | skipping: [instance] 2025-12-01 11:06:38.054219 | controller | 2025-12-01 11:06:38.054226 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] ******* 2025-12-01 11:06:38.054234 | controller | Monday 01 December 2025 11:06:38 +0000 (0:00:00.046) 0:01:17.666 ******* 2025-12-01 11:06:38.054245 | controller | skipping: [instance] 2025-12-01 11:06:38.054423 | controller | 2025-12-01 11:06:38.054611 | controller | TASK [libvirt_manager : Ensure some domains are local] ************************* 2025-12-01 11:06:38.054796 | controller | Monday 01 December 2025 11:06:38 +0000 (0:00:00.032) 0:01:17.699 ******* 2025-12-01 11:06:38.439932 | controller | changed: [instance] 2025-12-01 11:06:39.233501 | controller | 2025-12-01 11:06:39.233529 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************ 2025-12-01 11:06:39.233537 | controller | Monday 01 December 2025 11:06:38 +0000 (0:00:00.374) 0:01:18.074 ******* 2025-12-01 11:06:39.233543 | controller | 2025-12-01 11:06:39.233549 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-12-01 11:06:39.233554 | controller | Monday 01 December 2025 11:06:38 +0000 (0:00:00.010) 0:01:18.084 ******* 2025-12-01 11:06:39.233564 | controller | changed: [instance] 2025-12-01 11:06:39.588850 | controller | 2025-12-01 11:06:39.588879 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-01 11:06:39.588888 | controller | Monday 01 December 2025 11:06:39 +0000 (0:00:00.793) 0:01:18.878 ******* 2025-12-01 11:06:39.588898 | controller | changed: [instance] 2025-12-01 11:06:39.925725 | controller | 2025-12-01 11:06:39.925755 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] ************************************* 2025-12-01 11:06:39.925763 | controller | Monday 01 December 2025 11:06:39 +0000 (0:00:00.355) 0:01:19.234 ******* 2025-12-01 11:06:39.925773 | controller | changed: [instance] 2025-12-01 11:06:40.285236 | controller | 2025-12-01 11:06:40.285277 | controller | TASK [reproducer : Delegate our domains to our own instance] ******************* 2025-12-01 11:06:40.285287 | controller | Monday 01 December 2025 11:06:39 +0000 (0:00:00.336) 0:01:19.570 ******* 2025-12-01 11:06:40.285300 | controller | changed: [instance] 2025-12-01 11:06:40.661929 | controller | 2025-12-01 11:06:40.661959 | controller | TASK [reproducer : Ensure "utility" domain is local] *************************** 2025-12-01 11:06:40.661967 | controller | Monday 01 December 2025 11:06:40 +0000 (0:00:00.359) 0:01:19.930 ******* 2025-12-01 11:06:40.661982 | controller | changed: [instance] 2025-12-01 11:06:40.693918 | controller | 2025-12-01 11:06:40.693943 | controller | TASK [Build utility records dataset] ******************************************* 2025-12-01 11:06:40.693953 | controller | Monday 01 December 2025 11:06:40 +0000 (0:00:00.376) 0:01:20.307 ******* 2025-12-01 11:06:40.693963 | controller | 2025-12-01 11:06:40.787233 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-01 11:06:40.787279 | controller | Monday 01 December 2025 11:06:40 +0000 (0:00:00.032) 0:01:20.339 ******* 2025-12-01 11:06:40.787299 | controller | ok: [instance] 2025-12-01 11:06:40.787352 | controller | 2025-12-01 11:06:40.787499 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-01 11:06:40.787520 | controller | Monday 01 December 2025 11:06:40 +0000 (0:00:00.093) 0:01:20.432 ******* 2025-12-01 11:06:40.887767 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-12-01 11:06:41.368941 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-01 11:06:41.368970 | controller | 2025-12-01 11:06:41.368978 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-01 11:06:41.368984 | controller | Monday 01 December 2025 11:06:40 +0000 (0:00:00.100) 0:01:20.532 ******* 2025-12-01 11:06:41.368998 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'}) 2025-12-01 11:06:41.840143 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'}) 2025-12-01 11:06:41.840175 | controller | 2025-12-01 11:06:41.840183 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-12-01 11:06:41.840189 | controller | Monday 01 December 2025 11:06:41 +0000 (0:00:00.469) 0:01:21.002 ******* 2025-12-01 11:06:41.840194 | controller | 2025-12-01 11:06:41.840200 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-01 11:06:41.840205 | controller | Monday 01 December 2025 11:06:41 +0000 (0:00:00.010) 0:01:21.013 ******* 2025-12-01 11:06:41.840215 | controller | changed: [instance] 2025-12-01 11:06:41.840241 | controller | 2025-12-01 11:06:41.840491 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-01 11:06:42.193183 | controller | Monday 01 December 2025 11:06:41 +0000 (0:00:00.471) 0:01:21.485 ******* 2025-12-01 11:06:42.193222 | controller | changed: [instance] 2025-12-01 11:06:42.193256 | controller | 2025-12-01 11:06:42.193267 | controller | TASK [reproducer : Bootstrap nat64 if needed] ********************************** 2025-12-01 11:06:42.193407 | controller | Monday 01 December 2025 11:06:42 +0000 (0:00:00.353) 0:01:21.838 ******* 2025-12-01 11:06:42.226038 | controller | skipping: [instance] 2025-12-01 11:06:42.305183 | controller | 2025-12-01 11:06:42.305213 | controller | TASK [reproducer : Deploy CRC if needed] *************************************** 2025-12-01 11:06:42.305224 | controller | Monday 01 December 2025 11:06:42 +0000 (0:00:00.032) 0:01:21.871 ******* 2025-12-01 11:06:42.305236 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance 2025-12-01 11:06:42.305257 | controller | 2025-12-01 11:06:42.305265 | controller | TASK [reproducer : Check for CRC availability in known path] ******************* 2025-12-01 11:06:42.305274 | controller | Monday 01 December 2025 11:06:42 +0000 (0:00:00.079) 0:01:21.950 ******* 2025-12-01 11:06:42.495992 | controller | ok: [instance] 2025-12-01 11:06:42.515577 | controller | 2025-12-01 11:06:42.515598 | controller | TASK [Deploy CRC if needed] **************************************************** 2025-12-01 11:06:42.515608 | controller | Monday 01 December 2025 11:06:42 +0000 (0:00:00.190) 0:01:22.141 ******* 2025-12-01 11:06:42.515619 | controller | skipping: [instance] 2025-12-01 11:06:42.868143 | controller | 2025-12-01 11:06:42.868173 | controller | TASK [rhol_crc : Stop CRC VM] ************************************************** 2025-12-01 11:06:42.868181 | controller | Monday 01 December 2025 11:06:42 +0000 (0:00:00.019) 0:01:22.160 ******* 2025-12-01 11:06:42.868191 | controller | ok: [instance] 2025-12-01 11:06:43.094772 | controller | 2025-12-01 11:06:43.094802 | controller | TASK [rhol_crc : Undefine CRC VM] ********************************************** 2025-12-01 11:06:43.094810 | controller | Monday 01 December 2025 11:06:42 +0000 (0:00:00.352) 0:01:22.513 ******* 2025-12-01 11:06:43.094820 | controller | ok: [instance] 2025-12-01 11:06:43.311139 | controller | 2025-12-01 11:06:43.311172 | controller | TASK [rhol_crc : Destroy CRC network] ****************************************** 2025-12-01 11:06:43.311181 | controller | Monday 01 December 2025 11:06:43 +0000 (0:00:00.226) 0:01:22.739 ******* 2025-12-01 11:06:43.311191 | controller | ok: [instance] 2025-12-01 11:06:43.524977 | controller | 2025-12-01 11:06:43.525003 | controller | TASK [rhol_crc : Undefine CRC network] ***************************************** 2025-12-01 11:06:43.525011 | controller | Monday 01 December 2025 11:06:43 +0000 (0:00:00.216) 0:01:22.956 ******* 2025-12-01 11:06:43.525021 | controller | ok: [instance] 2025-12-01 11:06:43.525052 | controller | 2025-12-01 11:06:43.525201 | controller | TASK [rhol_crc : Destroy default network] ************************************** 2025-12-01 11:06:43.525324 | controller | Monday 01 December 2025 11:06:43 +0000 (0:00:00.214) 0:01:23.170 ******* 2025-12-01 11:06:43.750215 | controller | ok: [instance] 2025-12-01 11:06:43.750248 | controller | 2025-12-01 11:06:43.750257 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-01 11:06:43.750274 | controller | Monday 01 December 2025 11:06:43 +0000 (0:00:00.224) 0:01:23.395 ******* 2025-12-01 11:06:43.789185 | controller | 2025-12-01 11:06:43.979513 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-12-01 11:06:43.979540 | controller | Monday 01 December 2025 11:06:43 +0000 (0:00:00.039) 0:01:23.434 ******* 2025-12-01 11:06:43.979552 | controller | ok: [instance] 2025-12-01 11:06:44.001629 | controller | 2025-12-01 11:06:44.001647 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-12-01 11:06:44.001654 | controller | Monday 01 December 2025 11:06:43 +0000 (0:00:00.190) 0:01:23.624 ******* 2025-12-01 11:06:44.001663 | controller | ok: [instance] 2025-12-01 11:06:44.026237 | controller | 2025-12-01 11:06:44.026278 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-12-01 11:06:44.026288 | controller | Monday 01 December 2025 11:06:43 +0000 (0:00:00.022) 0:01:23.646 ******* 2025-12-01 11:06:44.026301 | controller | skipping: [instance] 2025-12-01 11:06:44.026337 | controller | 2025-12-01 11:06:44.026348 | controller | TASK [reproducer : Slurp ssh key for CRC access] ******************************* 2025-12-01 11:06:44.026428 | controller | Monday 01 December 2025 11:06:44 +0000 (0:00:00.024) 0:01:23.671 ******* 2025-12-01 11:06:44.311242 | controller | ok: [instance] 2025-12-01 11:06:44.311343 | controller | 2025-12-01 11:06:44.311363 | controller | TASK [reproducer : Get kubeconfig file from crc directory] ********************* 2025-12-01 11:06:44.562495 | controller | Monday 01 December 2025 11:06:44 +0000 (0:00:00.284) 0:01:23.956 ******* 2025-12-01 11:06:44.562531 | controller | ok: [instance] 2025-12-01 11:06:44.734754 | controller | 2025-12-01 11:06:44.734783 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] ************* 2025-12-01 11:06:44.734791 | controller | Monday 01 December 2025 11:06:44 +0000 (0:00:00.251) 0:01:24.207 ******* 2025-12-01 11:06:44.734801 | controller | ok: [instance] 2025-12-01 11:06:44.792028 | controller | 2025-12-01 11:06:44.792051 | controller | TASK [Ensure we expose openshift_login related facts] ************************** 2025-12-01 11:06:44.792075 | controller | Monday 01 December 2025 11:06:44 +0000 (0:00:00.172) 0:01:24.379 ******* 2025-12-01 11:06:44.792088 | controller | 2025-12-01 11:06:44.835980 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-12-01 11:06:44.836005 | controller | Monday 01 December 2025 11:06:44 +0000 (0:00:00.057) 0:01:24.437 ******* 2025-12-01 11:06:44.836018 | controller | ok: [instance] => changed=false 2025-12-01 11:06:45.015781 | controller | msg: All assertions passed 2025-12-01 11:06:45.015805 | controller | 2025-12-01 11:06:45.015813 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-12-01 11:06:45.015820 | controller | Monday 01 December 2025 11:06:44 +0000 (0:00:00.043) 0:01:24.481 ******* 2025-12-01 11:06:45.015829 | controller | ok: [instance] 2025-12-01 11:06:45.205796 | controller | 2025-12-01 11:06:45.205822 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-12-01 11:06:45.205831 | controller | Monday 01 December 2025 11:06:45 +0000 (0:00:00.179) 0:01:24.661 ******* 2025-12-01 11:06:45.205841 | controller | ok: [instance] 2025-12-01 11:06:45.231209 | controller | 2025-12-01 11:06:45.231244 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-12-01 11:06:45.231254 | controller | Monday 01 December 2025 11:06:45 +0000 (0:00:00.189) 0:01:24.851 ******* 2025-12-01 11:06:45.231267 | controller | ok: [instance] => changed=false 2025-12-01 11:06:45.231299 | controller | msg: All assertions passed 2025-12-01 11:06:45.231306 | controller | 2025-12-01 11:06:45.231315 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-12-01 11:06:45.231427 | controller | Monday 01 December 2025 11:06:45 +0000 (0:00:00.025) 0:01:24.876 ******* 2025-12-01 11:06:45.418555 | controller | ok: [instance] 2025-12-01 11:06:45.595228 | controller | 2025-12-01 11:06:45.595264 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-12-01 11:06:45.595273 | controller | Monday 01 December 2025 11:06:45 +0000 (0:00:00.187) 0:01:25.063 ******* 2025-12-01 11:06:45.595286 | controller | ok: [instance] 2025-12-01 11:06:45.595303 | controller | 2025-12-01 11:06:45.595310 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-12-01 11:06:45.595319 | controller | Monday 01 December 2025 11:06:45 +0000 (0:00:00.176) 0:01:25.240 ******* 2025-12-01 11:06:45.644689 | controller | ok: [instance] 2025-12-01 11:06:46.034885 | controller | 2025-12-01 11:06:46.034914 | controller | TASK [reproducer : Remove CRC managed zone delegation] ************************* 2025-12-01 11:06:46.034923 | controller | Monday 01 December 2025 11:06:45 +0000 (0:00:00.049) 0:01:25.290 ******* 2025-12-01 11:06:46.034933 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf) 2025-12-01 11:06:46.054797 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf) 2025-12-01 11:06:46.054818 | controller | 2025-12-01 11:06:46.054826 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************ 2025-12-01 11:06:46.054833 | controller | Monday 01 December 2025 11:06:46 +0000 (0:00:00.389) 0:01:25.679 ******* 2025-12-01 11:06:46.054844 | controller | skipping: [instance] 2025-12-01 11:06:46.079223 | controller | 2025-12-01 11:06:46.079265 | controller | TASK [Load the architecture local kustomize patches] *************************** 2025-12-01 11:06:46.079275 | controller | Monday 01 December 2025 11:06:46 +0000 (0:00:00.020) 0:01:25.700 ******* 2025-12-01 11:06:46.079289 | controller | skipping: [instance] 2025-12-01 11:06:46.214542 | controller | 2025-12-01 11:06:46.214567 | controller | TASK [reproducer : Consume libvirt_manager] ************************************ 2025-12-01 11:06:46.214575 | controller | Monday 01 December 2025 11:06:46 +0000 (0:00:00.024) 0:01:25.724 ******* 2025-12-01 11:06:46.214585 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance 2025-12-01 11:06:46.240210 | controller | 2025-12-01 11:06:46.240240 | controller | TASK [libvirt_manager : Import layout generator if needed] ********************* 2025-12-01 11:06:46.240250 | controller | Monday 01 December 2025 11:06:46 +0000 (0:00:00.135) 0:01:25.859 ******* 2025-12-01 11:06:46.240261 | controller | skipping: [instance] 2025-12-01 11:06:46.240294 | controller | 2025-12-01 11:06:46.240302 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] ***************** 2025-12-01 11:06:46.240310 | controller | Monday 01 December 2025 11:06:46 +0000 (0:00:00.025) 0:01:25.885 ******* 2025-12-01 11:06:46.654158 | controller | changed: [instance] 2025-12-01 11:06:46.654229 | controller | 2025-12-01 11:06:46.654494 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] **************** 2025-12-01 11:06:47.169144 | controller | Monday 01 December 2025 11:06:46 +0000 (0:00:00.414) 0:01:26.299 ******* 2025-12-01 11:06:47.169202 | controller | changed: [instance] 2025-12-01 11:06:47.169247 | controller | 2025-12-01 11:06:47.169257 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] ************************** 2025-12-01 11:06:47.169264 | controller | Monday 01 December 2025 11:06:47 +0000 (0:00:00.503) 0:01:26.802 ******* 2025-12-01 11:06:47.169273 | controller | 2025-12-01 11:06:47.169494 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] ************************** 2025-12-01 11:06:47.588668 | controller | Monday 01 December 2025 11:06:47 +0000 (0:00:00.011) 0:01:26.814 ******* 2025-12-01 11:06:47.588708 | controller | changed: [instance] 2025-12-01 11:06:47.588792 | controller | 2025-12-01 11:06:47.588819 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] ************************** 2025-12-01 11:06:47.588832 | controller | Monday 01 December 2025 11:06:47 +0000 (0:00:00.419) 0:01:27.233 ******* 2025-12-01 11:06:48.412183 | controller | changed: [instance] 2025-12-01 11:06:48.412258 | controller | 2025-12-01 11:06:48.412271 | controller | TASK [Deploy virtualbmc] ******************************************************* 2025-12-01 11:06:48.412397 | controller | Monday 01 December 2025 11:06:48 +0000 (0:00:00.823) 0:01:28.057 ******* 2025-12-01 11:06:48.445157 | controller | skipping: [instance] 2025-12-01 11:06:48.445436 | controller | 2025-12-01 11:06:48.445463 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] *********** 2025-12-01 11:06:48.477663 | controller | Monday 01 December 2025 11:06:48 +0000 (0:00:00.033) 0:01:28.090 ******* 2025-12-01 11:06:48.477691 | controller | skipping: [instance] 2025-12-01 11:06:49.041329 | controller | 2025-12-01 11:06:49.041362 | controller | TASK [libvirt_manager : Create needed workload directory] ********************** 2025-12-01 11:06:49.041370 | controller | Monday 01 December 2025 11:06:48 +0000 (0:00:00.032) 0:01:28.122 ******* 2025-12-01 11:06:49.041380 | controller | changed: [instance] => (item=workload) 2025-12-01 11:06:49.455174 | controller | changed: [instance] => (item=reproducer-inventory) 2025-12-01 11:06:49.455210 | controller | ok: [instance] => (item=volumes) 2025-12-01 11:06:49.455230 | controller | 2025-12-01 11:06:49.455239 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] ********************** 2025-12-01 11:06:49.455246 | controller | Monday 01 December 2025 11:06:49 +0000 (0:00:00.563) 0:01:28.685 ******* 2025-12-01 11:06:49.455259 | controller | changed: [instance] => (item=workload) 2025-12-01 11:06:49.479772 | controller | changed: [instance] => (item=volumes) 2025-12-01 11:06:49.479811 | controller | 2025-12-01 11:06:49.479821 | controller | TASK [libvirt_manager : Generate networking data] ****************************** 2025-12-01 11:06:49.479829 | controller | Monday 01 December 2025 11:06:49 +0000 (0:00:00.414) 0:01:29.100 ******* 2025-12-01 11:06:49.479841 | controller | skipping: [instance] 2025-12-01 11:06:50.507206 | controller | 2025-12-01 11:06:50.507253 | controller | TASK [libvirt_manager : Create group inventories] ****************************** 2025-12-01 11:06:50.507264 | controller | Monday 01 December 2025 11:06:49 +0000 (0:00:00.024) 0:01:29.125 ******* 2025-12-01 11:06:50.507281 | controller | changed: [instance] => (item=compute) 2025-12-01 11:06:50.507315 | controller | changed: [instance] => (item=controller) 2025-12-01 11:06:50.507767 | controller | changed: [instance] => (item=crc) 2025-12-01 11:06:50.875958 | controller | 2025-12-01 11:06:50.875989 | controller | TASK [libvirt_manager : Create "all" group inventory file] ********************* 2025-12-01 11:06:50.875997 | controller | Monday 01 December 2025 11:06:50 +0000 (0:00:01.027) 0:01:30.152 ******* 2025-12-01 11:06:50.876007 | controller | changed: [instance] 2025-12-01 11:06:50.915860 | controller | 2025-12-01 11:06:50.915880 | controller | TASK [libvirt_manager : Ensure storage pool is present.] *********************** 2025-12-01 11:06:50.915887 | controller | Monday 01 December 2025 11:06:50 +0000 (0:00:00.368) 0:01:30.521 ******* 2025-12-01 11:06:50.915896 | controller | skipping: [instance] 2025-12-01 11:06:50.978932 | controller | 2025-12-01 11:06:50.978950 | controller | TASK [libvirt_manager : Ensure images are present] ***************************** 2025-12-01 11:06:50.978957 | controller | Monday 01 December 2025 11:06:50 +0000 (0:00:00.040) 0:01:30.561 ******* 2025-12-01 11:06:50.978967 | controller | skipping: [instance] => (item=crc) 2025-12-01 11:06:51.185140 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute) 2025-12-01 11:06:51.185181 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller) 2025-12-01 11:06:51.185192 | controller | 2025-12-01 11:06:51.185200 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-12-01 11:06:51.185208 | controller | Monday 01 December 2025 11:06:50 +0000 (0:00:00.062) 0:01:30.623 ******* 2025-12-01 11:06:51.185222 | controller | changed: [instance] 2025-12-01 11:06:51.363907 | controller | 2025-12-01 11:06:51.363936 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-12-01 11:06:51.363945 | controller | Monday 01 December 2025 11:06:51 +0000 (0:00:00.206) 0:01:30.830 ******* 2025-12-01 11:06:51.363955 | controller | ok: [instance] 2025-12-01 11:07:12.910766 | controller | 2025-12-01 11:07:12.910799 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-12-01 11:07:12.910807 | controller | Monday 01 December 2025 11:06:51 +0000 (0:00:00.178) 0:01:31.008 ******* 2025-12-01 11:07:12.910818 | controller | changed: [instance] 2025-12-01 11:07:13.109156 | controller | 2025-12-01 11:07:13.109184 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-12-01 11:07:13.109193 | controller | Monday 01 December 2025 11:07:12 +0000 (0:00:21.546) 0:01:52.555 ******* 2025-12-01 11:07:13.109202 | controller | ok: [instance] 2025-12-01 11:07:13.151218 | controller | 2025-12-01 11:07:13.151257 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-12-01 11:07:13.151273 | controller | Monday 01 December 2025 11:07:13 +0000 (0:00:00.198) 0:01:52.754 ******* 2025-12-01 11:07:13.151287 | controller | ok: [instance] => changed=false 2025-12-01 11:07:13.359578 | controller | msg: All assertions passed 2025-12-01 11:07:13.359609 | controller | 2025-12-01 11:07:13.359617 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-12-01 11:07:13.359624 | controller | Monday 01 December 2025 11:07:13 +0000 (0:00:00.042) 0:01:52.796 ******* 2025-12-01 11:07:13.359634 | controller | changed: [instance] 2025-12-01 11:07:13.565160 | controller | 2025-12-01 11:07:13.565196 | controller | TASK [libvirt_manager : Ensure directory exists] ******************************* 2025-12-01 11:07:13.565206 | controller | Monday 01 December 2025 11:07:13 +0000 (0:00:00.208) 0:01:53.004 ******* 2025-12-01 11:07:13.565219 | controller | ok: [instance] 2025-12-01 11:07:13.565247 | controller | 2025-12-01 11:07:13.565257 | controller | TASK [libvirt_manager : Check if base image exists] **************************** 2025-12-01 11:07:13.565369 | controller | Monday 01 December 2025 11:07:13 +0000 (0:00:00.205) 0:01:53.210 ******* 2025-12-01 11:07:13.761711 | controller | ok: [instance] 2025-12-01 11:07:13.784923 | controller | 2025-12-01 11:07:13.784946 | controller | TASK [libvirt_manager : Download base image] *********************************** 2025-12-01 11:07:13.784955 | controller | Monday 01 December 2025 11:07:13 +0000 (0:00:00.196) 0:01:53.406 ******* 2025-12-01 11:07:13.784966 | controller | skipping: [instance] 2025-12-01 11:07:13.981231 | controller | 2025-12-01 11:07:13.981273 | controller | TASK [libvirt_manager : Check image] ******************************************* 2025-12-01 11:07:13.981283 | controller | Monday 01 December 2025 11:07:13 +0000 (0:00:00.023) 0:01:53.430 ******* 2025-12-01 11:07:13.981296 | controller | ok: [instance] 2025-12-01 11:07:13.981318 | controller | 2025-12-01 11:07:13.981328 | controller | TASK [libvirt_manager : Assert image status] *********************************** 2025-12-01 11:07:13.981390 | controller | Monday 01 December 2025 11:07:13 +0000 (0:00:00.196) 0:01:53.626 ******* 2025-12-01 11:07:14.023180 | controller | ok: [instance] => changed=false 2025-12-01 11:07:14.023240 | controller | msg: All assertions passed 2025-12-01 11:07:14.023253 | controller | 2025-12-01 11:07:14.023449 | controller | TASK [libvirt_manager : Ensure image access rights] **************************** 2025-12-01 11:07:14.234861 | controller | Monday 01 December 2025 11:07:14 +0000 (0:00:00.042) 0:01:53.668 ******* 2025-12-01 11:07:14.234903 | controller | ok: [instance] 2025-12-01 11:07:14.417212 | controller | 2025-12-01 11:07:14.417250 | controller | TASK [libvirt_manager : Get ssh key state] ************************************* 2025-12-01 11:07:14.417261 | controller | Monday 01 December 2025 11:07:14 +0000 (0:00:00.211) 0:01:53.879 ******* 2025-12-01 11:07:14.417275 | controller | ok: [instance] 2025-12-01 11:07:14.815042 | controller | 2025-12-01 11:07:14.815102 | controller | TASK [libvirt_manager : Create temporary ssh keypair] ************************** 2025-12-01 11:07:14.815113 | controller | Monday 01 December 2025 11:07:14 +0000 (0:00:00.182) 0:01:54.062 ******* 2025-12-01 11:07:14.815125 | controller | changed: [instance] 2025-12-01 11:07:14.991178 | controller | 2025-12-01 11:07:14.991212 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************ 2025-12-01 11:07:14.991223 | controller | Monday 01 December 2025 11:07:14 +0000 (0:00:00.397) 0:01:54.460 ******* 2025-12-01 11:07:14.991235 | controller | ok: [instance] 2025-12-01 11:07:14.991265 | controller | 2025-12-01 11:07:14.991275 | controller | TASK [libvirt_manager : Slurp private key for later use] *********************** 2025-12-01 11:07:14.991377 | controller | Monday 01 December 2025 11:07:14 +0000 (0:00:00.176) 0:01:54.636 ******* 2025-12-01 11:07:15.168693 | controller | ok: [instance] 2025-12-01 11:07:15.573947 | controller | 2025-12-01 11:07:15.573981 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] *** 2025-12-01 11:07:15.573989 | controller | Monday 01 December 2025 11:07:15 +0000 (0:00:00.177) 0:01:54.813 ******* 2025-12-01 11:07:15.573999 | controller | changed: [instance] 2025-12-01 11:07:15.594930 | controller | 2025-12-01 11:07:15.594949 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] ************** 2025-12-01 11:07:15.594956 | controller | Monday 01 December 2025 11:07:15 +0000 (0:00:00.405) 0:01:55.219 ******* 2025-12-01 11:07:15.594970 | controller | ok: [instance] 2025-12-01 11:07:15.818208 | controller | 2025-12-01 11:07:15.818242 | controller | TASK [libvirt_manager : List existing networks] ******************************** 2025-12-01 11:07:15.818252 | controller | Monday 01 December 2025 11:07:15 +0000 (0:00:00.021) 0:01:55.240 ******* 2025-12-01 11:07:15.818264 | controller | ok: [instance] 2025-12-01 11:07:15.818433 | controller | 2025-12-01 11:07:15.818460 | controller | TASK [libvirt_manager : Gather pool fact] ************************************** 2025-12-01 11:07:16.296712 | controller | Monday 01 December 2025 11:07:15 +0000 (0:00:00.223) 0:01:55.463 ******* 2025-12-01 11:07:16.296747 | controller | ok: [instance] 2025-12-01 11:07:16.422247 | controller | 2025-12-01 11:07:16.422294 | controller | TASK [libvirt_manager : Create and run VMs] ************************************ 2025-12-01 11:07:16.422308 | controller | Monday 01 December 2025 11:07:16 +0000 (0:00:00.478) 0:01:55.941 ******* 2025-12-01 11:07:16.422326 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-01 11:07:16.422374 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-01 11:07:16.422391 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-01 11:07:16.422603 | controller | 2025-12-01 11:07:16.422640 | controller | TASK [libvirt_manager : Create VM image for compute-0] ************************* 2025-12-01 11:07:16.684091 | controller | Monday 01 December 2025 11:07:16 +0000 (0:00:00.125) 0:01:56.067 ******* 2025-12-01 11:07:16.684130 | controller | changed: [instance] 2025-12-01 11:07:16.904847 | controller | 2025-12-01 11:07:16.904880 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ******** 2025-12-01 11:07:16.904890 | controller | Monday 01 December 2025 11:07:16 +0000 (0:00:00.261) 0:01:56.328 ******* 2025-12-01 11:07:16.904902 | controller | changed: [instance] 2025-12-01 11:07:17.194487 | controller | 2025-12-01 11:07:17.194521 | controller | TASK [libvirt_manager : Define VMs for type compute-0] ************************* 2025-12-01 11:07:17.194531 | controller | Monday 01 December 2025 11:07:16 +0000 (0:00:00.221) 0:01:56.549 ******* 2025-12-01 11:07:17.194558 | controller | changed: [instance] 2025-12-01 11:07:17.223664 | controller | 2025-12-01 11:07:17.223689 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] *********** 2025-12-01 11:07:17.223699 | controller | Monday 01 December 2025 11:07:17 +0000 (0:00:00.289) 0:01:56.839 ******* 2025-12-01 11:07:17.223710 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-01 11:07:17.268968 | controller | 2025-12-01 11:07:17.268987 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-01 11:07:17.268994 | controller | Monday 01 December 2025 11:07:17 +0000 (0:00:00.029) 0:01:56.868 ******* 2025-12-01 11:07:17.269004 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-01 11:07:17.500218 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-01 11:07:17.500252 | controller | 2025-12-01 11:07:17.500262 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-01 11:07:17.500269 | controller | Monday 01 December 2025 11:07:17 +0000 (0:00:00.045) 0:01:56.914 ******* 2025-12-01 11:07:17.500282 | controller | ok: [instance] 2025-12-01 11:07:17.500314 | controller | 2025-12-01 11:07:17.500324 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-01 11:07:17.500354 | controller | Monday 01 December 2025 11:07:17 +0000 (0:00:00.231) 0:01:57.145 ******* 2025-12-01 11:07:17.545011 | controller | ok: [instance] => (item=cifmw-public) 2025-12-01 11:07:17.775848 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-01 11:07:17.775885 | controller | 2025-12-01 11:07:17.775893 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-01 11:07:17.775900 | controller | Monday 01 December 2025 11:07:17 +0000 (0:00:00.044) 0:01:57.190 ******* 2025-12-01 11:07:17.775910 | controller | ok: [instance] 2025-12-01 11:07:17.976893 | controller | 2025-12-01 11:07:17.976932 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-01 11:07:17.976942 | controller | Monday 01 December 2025 11:07:17 +0000 (0:00:00.230) 0:01:57.420 ******* 2025-12-01 11:07:17.976954 | controller | ok: [instance] 2025-12-01 11:07:18.267626 | controller | 2025-12-01 11:07:18.267666 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************ 2025-12-01 11:07:18.267675 | controller | Monday 01 December 2025 11:07:17 +0000 (0:00:00.200) 0:01:57.621 ******* 2025-12-01 11:07:18.267685 | controller | changed: [instance] 2025-12-01 11:07:18.491111 | controller | 2025-12-01 11:07:18.491147 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-01 11:07:18.491157 | controller | Monday 01 December 2025 11:07:18 +0000 (0:00:00.290) 0:01:57.912 ******* 2025-12-01 11:07:18.491169 | controller | ok: [instance] 2025-12-01 11:07:18.535864 | controller | 2025-12-01 11:07:18.535889 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-01 11:07:18.535898 | controller | Monday 01 December 2025 11:07:18 +0000 (0:00:00.223) 0:01:58.136 ******* 2025-12-01 11:07:18.535909 | controller | ok: [instance] => (item=cifmw-public) 2025-12-01 11:07:18.761778 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-01 11:07:18.761810 | controller | 2025-12-01 11:07:18.761818 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-01 11:07:18.761824 | controller | Monday 01 December 2025 11:07:18 +0000 (0:00:00.044) 0:01:58.180 ******* 2025-12-01 11:07:18.761835 | controller | ok: [instance] 2025-12-01 11:07:18.965528 | controller | 2025-12-01 11:07:18.965571 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-01 11:07:18.965580 | controller | Monday 01 December 2025 11:07:18 +0000 (0:00:00.225) 0:01:58.406 ******* 2025-12-01 11:07:18.965591 | controller | ok: [instance] 2025-12-01 11:07:19.287180 | controller | 2025-12-01 11:07:19.287222 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] ********* 2025-12-01 11:07:19.287232 | controller | Monday 01 December 2025 11:07:18 +0000 (0:00:00.203) 0:01:58.610 ******* 2025-12-01 11:07:19.287244 | controller | changed: [instance] 2025-12-01 11:07:19.287272 | controller | 2025-12-01 11:07:19.287283 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] ***** 2025-12-01 11:07:19.287418 | controller | Monday 01 December 2025 11:07:19 +0000 (0:00:00.321) 0:01:58.932 ******* 2025-12-01 11:07:19.308870 | controller | skipping: [instance] 2025-12-01 11:07:19.340076 | controller | 2025-12-01 11:07:19.340108 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ******** 2025-12-01 11:07:19.340117 | controller | Monday 01 December 2025 11:07:19 +0000 (0:00:00.021) 0:01:58.954 ******* 2025-12-01 11:07:19.340127 | controller | skipping: [instance] 2025-12-01 11:07:19.368775 | controller | 2025-12-01 11:07:19.368806 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] ************** 2025-12-01 11:07:19.368815 | controller | Monday 01 December 2025 11:07:19 +0000 (0:00:00.030) 0:01:58.984 ******* 2025-12-01 11:07:19.368826 | controller | skipping: [instance] 2025-12-01 11:07:19.395006 | controller | 2025-12-01 11:07:19.395031 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] *********************** 2025-12-01 11:07:19.395039 | controller | Monday 01 December 2025 11:07:19 +0000 (0:00:00.028) 0:01:59.013 ******* 2025-12-01 11:07:19.395049 | controller | skipping: [instance] 2025-12-01 11:07:19.614183 | controller | 2025-12-01 11:07:19.614216 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-01 11:07:19.614227 | controller | Monday 01 December 2025 11:07:19 +0000 (0:00:00.026) 0:01:59.040 ******* 2025-12-01 11:07:19.614239 | controller | changed: [instance] 2025-12-01 11:07:19.614271 | controller | 2025-12-01 11:07:19.614281 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-01 11:07:19.614437 | controller | Monday 01 December 2025 11:07:19 +0000 (0:00:00.219) 0:01:59.259 ******* 2025-12-01 11:07:19.691512 | controller | ok: [instance] 2025-12-01 11:07:19.747183 | controller | 2025-12-01 11:07:19.747217 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-01 11:07:19.747227 | controller | Monday 01 December 2025 11:07:19 +0000 (0:00:00.077) 0:01:59.336 ******* 2025-12-01 11:07:19.747245 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-12-01 11:07:19.747276 | controller | 2025-12-01 11:07:19.747286 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-12-01 11:07:19.747417 | controller | Monday 01 December 2025 11:07:19 +0000 (0:00:00.055) 0:01:59.392 ******* 2025-12-01 11:07:19.946730 | controller | ok: [instance] 2025-12-01 11:07:20.009190 | controller | 2025-12-01 11:07:20.009227 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-12-01 11:07:20.009236 | controller | Monday 01 December 2025 11:07:19 +0000 (0:00:00.199) 0:01:59.591 ******* 2025-12-01 11:07:20.009246 | controller | ok: [instance] 2025-12-01 11:07:20.009272 | controller | 2025-12-01 11:07:20.009280 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-12-01 11:07:20.009355 | controller | Monday 01 December 2025 11:07:20 +0000 (0:00:00.062) 0:01:59.654 ******* 2025-12-01 11:07:20.055188 | controller | ok: [instance] 2025-12-01 11:07:20.055249 | controller | 2025-12-01 11:07:20.055261 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-12-01 11:07:20.055271 | controller | Monday 01 December 2025 11:07:20 +0000 (0:00:00.045) 0:01:59.700 ******* 2025-12-01 11:07:20.098175 | controller | skipping: [instance] 2025-12-01 11:07:20.098362 | controller | 2025-12-01 11:07:20.098383 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-12-01 11:07:20.143209 | controller | Monday 01 December 2025 11:07:20 +0000 (0:00:00.043) 0:01:59.743 ******* 2025-12-01 11:07:20.143240 | controller | skipping: [instance] 2025-12-01 11:07:20.203793 | controller | 2025-12-01 11:07:20.203823 | controller | TASK [Call the config_drive role] ********************************************** 2025-12-01 11:07:20.203838 | controller | Monday 01 December 2025 11:07:20 +0000 (0:00:00.044) 0:01:59.788 ******* 2025-12-01 11:07:20.203849 | controller | 2025-12-01 11:07:20.203875 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-12-01 11:07:20.204014 | controller | Monday 01 December 2025 11:07:20 +0000 (0:00:00.060) 0:01:59.849 ******* 2025-12-01 11:07:20.618185 | controller | ok: [instance] => (item=artifacts) 2025-12-01 11:07:20.618287 | controller | ok: [instance] => (item=logs) 2025-12-01 11:07:20.618308 | controller | 2025-12-01 11:07:20.618316 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-12-01 11:07:20.618326 | controller | Monday 01 December 2025 11:07:20 +0000 (0:00:00.413) 0:02:00.263 ******* 2025-12-01 11:07:21.858850 | controller | ok: [instance] 2025-12-01 11:07:22.080852 | controller | 2025-12-01 11:07:22.080873 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-12-01 11:07:22.080881 | controller | Monday 01 December 2025 11:07:21 +0000 (0:00:01.240) 0:02:01.503 ******* 2025-12-01 11:07:22.080890 | controller | changed: [instance] 2025-12-01 11:07:22.457185 | controller | 2025-12-01 11:07:22.457223 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-12-01 11:07:22.457233 | controller | Monday 01 December 2025 11:07:22 +0000 (0:00:00.222) 0:02:01.726 ******* 2025-12-01 11:07:22.457246 | controller | changed: [instance] 2025-12-01 11:07:22.457275 | controller | 2025-12-01 11:07:22.457503 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-12-01 11:07:22.839756 | controller | Monday 01 December 2025 11:07:22 +0000 (0:00:00.376) 0:02:02.102 ******* 2025-12-01 11:07:22.839793 | controller | changed: [instance] 2025-12-01 11:07:22.884770 | controller | 2025-12-01 11:07:22.884786 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-12-01 11:07:22.884793 | controller | Monday 01 December 2025 11:07:22 +0000 (0:00:00.382) 0:02:02.484 ******* 2025-12-01 11:07:22.884807 | controller | skipping: [instance] 2025-12-01 11:07:23.086734 | controller | 2025-12-01 11:07:23.086764 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-12-01 11:07:23.086774 | controller | Monday 01 December 2025 11:07:22 +0000 (0:00:00.045) 0:02:02.530 ******* 2025-12-01 11:07:23.086782 | controller | ok: [instance] 2025-12-01 11:07:23.131584 | controller | 2025-12-01 11:07:23.131613 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-12-01 11:07:23.131621 | controller | Monday 01 December 2025 11:07:23 +0000 (0:00:00.201) 0:02:02.731 ******* 2025-12-01 11:07:23.131630 | controller | skipping: [instance] 2025-12-01 11:07:23.367194 | controller | 2025-12-01 11:07:23.367233 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-12-01 11:07:23.367243 | controller | Monday 01 December 2025 11:07:23 +0000 (0:00:00.044) 0:02:02.776 ******* 2025-12-01 11:07:23.367256 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log 2025-12-01 11:07:23.367277 | controller | changed: [instance] 2025-12-01 11:07:23.367285 | controller | 2025-12-01 11:07:23.367299 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-01 11:07:23.648194 | controller | Monday 01 December 2025 11:07:23 +0000 (0:00:00.235) 0:02:03.012 ******* 2025-12-01 11:07:23.648236 | controller | changed: [instance] 2025-12-01 11:07:23.648265 | controller | 2025-12-01 11:07:23.648274 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-01 11:07:23.648385 | controller | Monday 01 December 2025 11:07:23 +0000 (0:00:00.281) 0:02:03.293 ******* 2025-12-01 11:07:23.694987 | controller | skipping: [instance] 2025-12-01 11:07:23.723185 | controller | 2025-12-01 11:07:23.723208 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ******************** 2025-12-01 11:07:23.723217 | controller | Monday 01 December 2025 11:07:23 +0000 (0:00:00.046) 0:02:03.340 ******* 2025-12-01 11:07:23.723228 | controller | skipping: [instance] 2025-12-01 11:07:23.968649 | controller | 2025-12-01 11:07:23.968676 | controller | TASK [libvirt_manager : Create VM image for controller-0] ********************** 2025-12-01 11:07:23.968685 | controller | Monday 01 December 2025 11:07:23 +0000 (0:00:00.028) 0:02:03.368 ******* 2025-12-01 11:07:23.968694 | controller | changed: [instance] 2025-12-01 11:07:24.194756 | controller | 2025-12-01 11:07:24.194785 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] ***** 2025-12-01 11:07:24.194793 | controller | Monday 01 December 2025 11:07:23 +0000 (0:00:00.245) 0:02:03.613 ******* 2025-12-01 11:07:24.194803 | controller | changed: [instance] 2025-12-01 11:07:24.490749 | controller | 2025-12-01 11:07:24.490779 | controller | TASK [libvirt_manager : Define VMs for type controller-0] ********************** 2025-12-01 11:07:24.490788 | controller | Monday 01 December 2025 11:07:24 +0000 (0:00:00.226) 0:02:03.839 ******* 2025-12-01 11:07:24.490798 | controller | changed: [instance] 2025-12-01 11:07:24.519791 | controller | 2025-12-01 11:07:24.519808 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ******** 2025-12-01 11:07:24.519815 | controller | Monday 01 December 2025 11:07:24 +0000 (0:00:00.295) 0:02:04.135 ******* 2025-12-01 11:07:24.519828 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-01 11:07:24.564745 | controller | 2025-12-01 11:07:24.564765 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-01 11:07:24.564773 | controller | Monday 01 December 2025 11:07:24 +0000 (0:00:00.029) 0:02:04.165 ******* 2025-12-01 11:07:24.564784 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-01 11:07:24.793995 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-01 11:07:24.794026 | controller | 2025-12-01 11:07:24.794036 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-01 11:07:24.794043 | controller | Monday 01 December 2025 11:07:24 +0000 (0:00:00.044) 0:02:04.209 ******* 2025-12-01 11:07:24.794082 | controller | ok: [instance] 2025-12-01 11:07:24.838917 | controller | 2025-12-01 11:07:24.838939 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-01 11:07:24.838949 | controller | Monday 01 December 2025 11:07:24 +0000 (0:00:00.229) 0:02:04.439 ******* 2025-12-01 11:07:24.838960 | controller | ok: [instance] => (item=cifmw-public) 2025-12-01 11:07:25.072185 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-01 11:07:25.072219 | controller | 2025-12-01 11:07:25.072228 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-01 11:07:25.072237 | controller | Monday 01 December 2025 11:07:24 +0000 (0:00:00.044) 0:02:04.484 ******* 2025-12-01 11:07:25.072249 | controller | ok: [instance] 2025-12-01 11:07:25.072279 | controller | 2025-12-01 11:07:25.072290 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-01 11:07:25.072404 | controller | Monday 01 December 2025 11:07:25 +0000 (0:00:00.233) 0:02:04.717 ******* 2025-12-01 11:07:25.273727 | controller | ok: [instance] 2025-12-01 11:07:25.562191 | controller | 2025-12-01 11:07:25.562227 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] ********* 2025-12-01 11:07:25.562237 | controller | Monday 01 December 2025 11:07:25 +0000 (0:00:00.201) 0:02:04.918 ******* 2025-12-01 11:07:25.562249 | controller | changed: [instance] 2025-12-01 11:07:25.790517 | controller | 2025-12-01 11:07:25.790548 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-01 11:07:25.790556 | controller | Monday 01 December 2025 11:07:25 +0000 (0:00:00.288) 0:02:05.207 ******* 2025-12-01 11:07:25.790566 | controller | ok: [instance] 2025-12-01 11:07:25.834145 | controller | 2025-12-01 11:07:25.834175 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-01 11:07:25.834183 | controller | Monday 01 December 2025 11:07:25 +0000 (0:00:00.228) 0:02:05.435 ******* 2025-12-01 11:07:25.834194 | controller | ok: [instance] => (item=cifmw-public) 2025-12-01 11:07:25.834219 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-01 11:07:25.834495 | controller | 2025-12-01 11:07:26.065128 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-01 11:07:26.065164 | controller | Monday 01 December 2025 11:07:25 +0000 (0:00:00.044) 0:02:05.479 ******* 2025-12-01 11:07:26.065182 | controller | ok: [instance] 2025-12-01 11:07:26.269523 | controller | 2025-12-01 11:07:26.269553 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-01 11:07:26.269561 | controller | Monday 01 December 2025 11:07:26 +0000 (0:00:00.230) 0:02:05.710 ******* 2025-12-01 11:07:26.269572 | controller | ok: [instance] 2025-12-01 11:07:26.560719 | controller | 2025-12-01 11:07:26.560749 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ****** 2025-12-01 11:07:26.560758 | controller | Monday 01 December 2025 11:07:26 +0000 (0:00:00.204) 0:02:05.914 ******* 2025-12-01 11:07:26.560768 | controller | changed: [instance] 2025-12-01 11:07:26.581793 | controller | 2025-12-01 11:07:26.581810 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] *** 2025-12-01 11:07:26.581818 | controller | Monday 01 December 2025 11:07:26 +0000 (0:00:00.291) 0:02:06.205 ******* 2025-12-01 11:07:26.581826 | controller | skipping: [instance] 2025-12-01 11:07:26.611027 | controller | 2025-12-01 11:07:26.611049 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] ***** 2025-12-01 11:07:26.611079 | controller | Monday 01 December 2025 11:07:26 +0000 (0:00:00.021) 0:02:06.227 ******* 2025-12-01 11:07:26.611095 | controller | skipping: [instance] 2025-12-01 11:07:26.640179 | controller | 2025-12-01 11:07:26.640206 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] *********** 2025-12-01 11:07:26.640216 | controller | Monday 01 December 2025 11:07:26 +0000 (0:00:00.029) 0:02:06.256 ******* 2025-12-01 11:07:26.640227 | controller | skipping: [instance] 2025-12-01 11:07:26.666419 | controller | 2025-12-01 11:07:26.666442 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ******************** 2025-12-01 11:07:26.666452 | controller | Monday 01 December 2025 11:07:26 +0000 (0:00:00.029) 0:02:06.285 ******* 2025-12-01 11:07:26.666468 | controller | skipping: [instance] 2025-12-01 11:07:26.666501 | controller | 2025-12-01 11:07:26.666520 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-01 11:07:26.666532 | controller | Monday 01 December 2025 11:07:26 +0000 (0:00:00.026) 0:02:06.311 ******* 2025-12-01 11:07:26.880160 | controller | changed: [instance] 2025-12-01 11:07:26.880216 | controller | 2025-12-01 11:07:26.880228 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-01 11:07:26.880317 | controller | Monday 01 December 2025 11:07:26 +0000 (0:00:00.213) 0:02:06.525 ******* 2025-12-01 11:07:26.917656 | controller | ok: [instance] 2025-12-01 11:07:26.970738 | controller | 2025-12-01 11:07:26.970760 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-01 11:07:26.970770 | controller | Monday 01 December 2025 11:07:26 +0000 (0:00:00.037) 0:02:06.562 ******* 2025-12-01 11:07:26.970781 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance 2025-12-01 11:07:27.167129 | controller | 2025-12-01 11:07:27.167160 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] *************** 2025-12-01 11:07:27.167168 | controller | Monday 01 December 2025 11:07:26 +0000 (0:00:00.053) 0:02:06.616 ******* 2025-12-01 11:07:27.167178 | controller | ok: [instance] 2025-12-01 11:07:27.167527 | controller | 2025-12-01 11:07:27.263631 | controller | TASK [libvirt_manager : Define the default users for the vm] ******************* 2025-12-01 11:07:27.263679 | controller | Monday 01 December 2025 11:07:27 +0000 (0:00:00.196) 0:02:06.812 ******* 2025-12-01 11:07:27.263693 | controller | ok: [instance] 2025-12-01 11:07:27.310659 | controller | 2025-12-01 11:07:27.310692 | controller | TASK [libvirt_manager : Define the user data] ********************************** 2025-12-01 11:07:27.310702 | controller | Monday 01 December 2025 11:07:27 +0000 (0:00:00.096) 0:02:06.908 ******* 2025-12-01 11:07:27.310713 | controller | ok: [instance] 2025-12-01 11:07:27.353756 | controller | 2025-12-01 11:07:27.353779 | controller | TASK [libvirt_manager : Define the network config for all vms] ***************** 2025-12-01 11:07:27.353788 | controller | Monday 01 December 2025 11:07:27 +0000 (0:00:00.047) 0:02:06.955 ******* 2025-12-01 11:07:27.353799 | controller | skipping: [instance] 2025-12-01 11:07:27.398765 | controller | 2025-12-01 11:07:27.398788 | controller | TASK [libvirt_manager : Define the network config for each vm] ***************** 2025-12-01 11:07:27.398797 | controller | Monday 01 December 2025 11:07:27 +0000 (0:00:00.043) 0:02:06.999 ******* 2025-12-01 11:07:27.398808 | controller | skipping: [instance] 2025-12-01 11:07:27.537541 | controller | 2025-12-01 11:07:27.537559 | controller | TASK [Call the config_drive role] ********************************************** 2025-12-01 11:07:27.537567 | controller | Monday 01 December 2025 11:07:27 +0000 (0:00:00.044) 0:02:07.044 ******* 2025-12-01 11:07:27.537580 | controller | 2025-12-01 11:07:27.992186 | controller | TASK [config_drive : Ensure needed directories exist] ************************** 2025-12-01 11:07:27.992222 | controller | Monday 01 December 2025 11:07:27 +0000 (0:00:00.138) 0:02:07.182 ******* 2025-12-01 11:07:27.992237 | controller | ok: [instance] => (item=artifacts) 2025-12-01 11:07:29.253135 | controller | ok: [instance] => (item=logs) 2025-12-01 11:07:29.253167 | controller | 2025-12-01 11:07:29.253175 | controller | TASK [config_drive : Install required RPM packages] **************************** 2025-12-01 11:07:29.253182 | controller | Monday 01 December 2025 11:07:27 +0000 (0:00:00.454) 0:02:07.636 ******* 2025-12-01 11:07:29.253192 | controller | ok: [instance] 2025-12-01 11:07:29.253222 | controller | 2025-12-01 11:07:29.253230 | controller | TASK [config_drive : Crate config drive instance directory] ******************** 2025-12-01 11:07:29.253335 | controller | Monday 01 December 2025 11:07:29 +0000 (0:00:01.261) 0:02:08.898 ******* 2025-12-01 11:07:29.486751 | controller | changed: [instance] 2025-12-01 11:07:29.900162 | controller | 2025-12-01 11:07:29.900199 | controller | TASK [config_drive : Generate meta-data] *************************************** 2025-12-01 11:07:29.900207 | controller | Monday 01 December 2025 11:07:29 +0000 (0:00:00.233) 0:02:09.131 ******* 2025-12-01 11:07:29.900218 | controller | changed: [instance] 2025-12-01 11:07:30.291197 | controller | 2025-12-01 11:07:30.291232 | controller | TASK [config_drive : Generate user-data] *************************************** 2025-12-01 11:07:30.291251 | controller | Monday 01 December 2025 11:07:29 +0000 (0:00:00.413) 0:02:09.545 ******* 2025-12-01 11:07:30.291263 | controller | changed: [instance] 2025-12-01 11:07:30.291293 | controller | 2025-12-01 11:07:30.291303 | controller | TASK [config_drive : Generate network-data] ************************************ 2025-12-01 11:07:30.291413 | controller | Monday 01 December 2025 11:07:30 +0000 (0:00:00.391) 0:02:09.936 ******* 2025-12-01 11:07:30.339609 | controller | skipping: [instance] 2025-12-01 11:07:30.552629 | controller | 2025-12-01 11:07:30.552652 | controller | TASK [config_drive : Check ISO availability] *********************************** 2025-12-01 11:07:30.552660 | controller | Monday 01 December 2025 11:07:30 +0000 (0:00:00.048) 0:02:09.984 ******* 2025-12-01 11:07:30.552670 | controller | ok: [instance] 2025-12-01 11:07:30.598566 | controller | 2025-12-01 11:07:30.598584 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************ 2025-12-01 11:07:30.598592 | controller | Monday 01 December 2025 11:07:30 +0000 (0:00:00.213) 0:02:10.197 ******* 2025-12-01 11:07:30.598601 | controller | skipping: [instance] 2025-12-01 11:07:30.841697 | controller | 2025-12-01 11:07:30.841718 | controller | TASK [config_drive : Generate nocloud iso image] ******************************* 2025-12-01 11:07:30.841725 | controller | Monday 01 December 2025 11:07:30 +0000 (0:00:00.045) 0:02:10.243 ******* 2025-12-01 11:07:30.841735 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log 2025-12-01 11:07:31.128654 | controller | changed: [instance] 2025-12-01 11:07:31.128694 | controller | 2025-12-01 11:07:31.128702 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-01 11:07:31.128709 | controller | Monday 01 December 2025 11:07:30 +0000 (0:00:00.243) 0:02:10.486 ******* 2025-12-01 11:07:31.128718 | controller | changed: [instance] 2025-12-01 11:07:31.179659 | controller | 2025-12-01 11:07:31.179692 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-01 11:07:31.179701 | controller | Monday 01 December 2025 11:07:31 +0000 (0:00:00.286) 0:02:10.773 ******* 2025-12-01 11:07:31.179711 | controller | skipping: [instance] 2025-12-01 11:07:31.210089 | controller | 2025-12-01 11:07:31.210125 | controller | TASK [libvirt_manager : Configure boot order for controller-0] ***************** 2025-12-01 11:07:31.210135 | controller | Monday 01 December 2025 11:07:31 +0000 (0:00:00.051) 0:02:10.824 ******* 2025-12-01 11:07:31.210146 | controller | skipping: [instance] 2025-12-01 11:07:31.466491 | controller | 2025-12-01 11:07:31.466524 | controller | TASK [libvirt_manager : Create VM image for crc-0] ***************************** 2025-12-01 11:07:31.466534 | controller | Monday 01 December 2025 11:07:31 +0000 (0:00:00.030) 0:02:10.855 ******* 2025-12-01 11:07:31.466546 | controller | changed: [instance] 2025-12-01 11:07:31.697982 | controller | 2025-12-01 11:07:31.698003 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************ 2025-12-01 11:07:31.698012 | controller | Monday 01 December 2025 11:07:31 +0000 (0:00:00.256) 0:02:11.111 ******* 2025-12-01 11:07:31.698020 | controller | changed: [instance] 2025-12-01 11:07:31.997030 | controller | 2025-12-01 11:07:31.997074 | controller | TASK [libvirt_manager : Define VMs for type crc-0] ***************************** 2025-12-01 11:07:31.997086 | controller | Monday 01 December 2025 11:07:31 +0000 (0:00:00.231) 0:02:11.343 ******* 2025-12-01 11:07:31.997100 | controller | changed: [instance] 2025-12-01 11:07:32.028802 | controller | 2025-12-01 11:07:32.028833 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] *************** 2025-12-01 11:07:32.028846 | controller | Monday 01 December 2025 11:07:31 +0000 (0:00:00.298) 0:02:11.642 ******* 2025-12-01 11:07:32.028861 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance 2025-12-01 11:07:32.075827 | controller | 2025-12-01 11:07:32.075845 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] **************** 2025-12-01 11:07:32.075853 | controller | Monday 01 December 2025 11:07:32 +0000 (0:00:00.031) 0:02:11.673 ******* 2025-12-01 11:07:32.075862 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public) 2025-12-01 11:07:32.313204 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk) 2025-12-01 11:07:32.313240 | controller | 2025-12-01 11:07:32.313250 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-01 11:07:32.313257 | controller | Monday 01 December 2025 11:07:32 +0000 (0:00:00.047) 0:02:11.721 ******* 2025-12-01 11:07:32.313270 | controller | ok: [instance] 2025-12-01 11:07:32.359180 | controller | 2025-12-01 11:07:32.359205 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-01 11:07:32.359215 | controller | Monday 01 December 2025 11:07:32 +0000 (0:00:00.237) 0:02:11.958 ******* 2025-12-01 11:07:32.359226 | controller | ok: [instance] => (item=cifmw-public) 2025-12-01 11:07:32.359425 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-01 11:07:32.359452 | controller | 2025-12-01 11:07:32.359466 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-01 11:07:32.602146 | controller | Monday 01 December 2025 11:07:32 +0000 (0:00:00.045) 0:02:12.004 ******* 2025-12-01 11:07:32.602178 | controller | ok: [instance] 2025-12-01 11:07:32.811579 | controller | 2025-12-01 11:07:32.811604 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-01 11:07:32.811612 | controller | Monday 01 December 2025 11:07:32 +0000 (0:00:00.242) 0:02:12.247 ******* 2025-12-01 11:07:32.811626 | controller | ok: [instance] 2025-12-01 11:07:33.102855 | controller | 2025-12-01 11:07:33.102884 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] **************** 2025-12-01 11:07:33.102893 | controller | Monday 01 December 2025 11:07:32 +0000 (0:00:00.209) 0:02:12.456 ******* 2025-12-01 11:07:33.102903 | controller | changed: [instance] 2025-12-01 11:07:33.350078 | controller | 2025-12-01 11:07:33.350108 | controller | TASK [libvirt_manager : Get virtual network information] *********************** 2025-12-01 11:07:33.350116 | controller | Monday 01 December 2025 11:07:33 +0000 (0:00:00.291) 0:02:12.747 ******* 2025-12-01 11:07:33.350126 | controller | ok: [instance] 2025-12-01 11:07:33.395836 | controller | 2025-12-01 11:07:33.395853 | controller | TASK [libvirt_manager : Create network to bridge mapping] ********************** 2025-12-01 11:07:33.395860 | controller | Monday 01 December 2025 11:07:33 +0000 (0:00:00.247) 0:02:12.995 ******* 2025-12-01 11:07:33.395868 | controller | ok: [instance] => (item=cifmw-public) 2025-12-01 11:07:33.634552 | controller | ok: [instance] => (item=cifmw-osp_trunk) 2025-12-01 11:07:33.634574 | controller | 2025-12-01 11:07:33.634582 | controller | TASK [libvirt_manager : Dump domain xml] *************************************** 2025-12-01 11:07:33.634588 | controller | Monday 01 December 2025 11:07:33 +0000 (0:00:00.045) 0:02:13.040 ******* 2025-12-01 11:07:33.634597 | controller | ok: [instance] 2025-12-01 11:07:33.842256 | controller | 2025-12-01 11:07:33.842293 | controller | TASK [libvirt_manager : Extract networks from XML] ***************************** 2025-12-01 11:07:33.842303 | controller | Monday 01 December 2025 11:07:33 +0000 (0:00:00.238) 0:02:13.279 ******* 2025-12-01 11:07:33.842316 | controller | ok: [instance] 2025-12-01 11:07:34.134631 | controller | 2025-12-01 11:07:34.134659 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] ************* 2025-12-01 11:07:34.134669 | controller | Monday 01 December 2025 11:07:33 +0000 (0:00:00.207) 0:02:13.487 ******* 2025-12-01 11:07:34.134681 | controller | changed: [instance] 2025-12-01 11:07:34.156157 | controller | 2025-12-01 11:07:34.156180 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] ********* 2025-12-01 11:07:34.156190 | controller | Monday 01 December 2025 11:07:34 +0000 (0:00:00.292) 0:02:13.779 ******* 2025-12-01 11:07:34.156201 | controller | skipping: [instance] 2025-12-01 11:07:34.156235 | controller | 2025-12-01 11:07:34.156251 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************ 2025-12-01 11:07:34.156261 | controller | Monday 01 December 2025 11:07:34 +0000 (0:00:00.021) 0:02:13.801 ******* 2025-12-01 11:07:34.183867 | controller | skipping: [instance] 2025-12-01 11:07:34.211640 | controller | 2025-12-01 11:07:34.211662 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ****************** 2025-12-01 11:07:34.211676 | controller | Monday 01 December 2025 11:07:34 +0000 (0:00:00.027) 0:02:13.829 ******* 2025-12-01 11:07:34.211687 | controller | skipping: [instance] 2025-12-01 11:07:34.238213 | controller | 2025-12-01 11:07:34.238237 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] *************************** 2025-12-01 11:07:34.238257 | controller | Monday 01 December 2025 11:07:34 +0000 (0:00:00.027) 0:02:13.856 ******* 2025-12-01 11:07:34.238269 | controller | skipping: [instance] 2025-12-01 11:07:35.458768 | controller | 2025-12-01 11:07:35.458799 | controller | TASK [libvirt_manager : Get VM UUID] ******************************************* 2025-12-01 11:07:35.458807 | controller | Monday 01 December 2025 11:07:34 +0000 (0:00:00.026) 0:02:13.883 ******* 2025-12-01 11:07:35.458818 | controller | changed: [instance] 2025-12-01 11:07:35.496814 | controller | 2025-12-01 11:07:35.496832 | controller | TASK [libvirt_manager : Inject UUID in dataset] ******************************** 2025-12-01 11:07:35.496840 | controller | Monday 01 December 2025 11:07:35 +0000 (0:00:01.220) 0:02:15.103 ******* 2025-12-01 11:07:35.496849 | controller | ok: [instance] 2025-12-01 11:07:35.524948 | controller | 2025-12-01 11:07:35.524971 | controller | TASK [libvirt_manager : Create cloud-init ISO] ********************************* 2025-12-01 11:07:35.524980 | controller | Monday 01 December 2025 11:07:35 +0000 (0:00:00.038) 0:02:15.142 ******* 2025-12-01 11:07:35.524991 | controller | skipping: [instance] 2025-12-01 11:07:35.552954 | controller | 2025-12-01 11:07:35.552972 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] *********************** 2025-12-01 11:07:35.552979 | controller | Monday 01 December 2025 11:07:35 +0000 (0:00:00.028) 0:02:15.170 ******* 2025-12-01 11:07:35.552988 | controller | skipping: [instance] 2025-12-01 11:07:35.599832 | controller | 2025-12-01 11:07:35.599850 | controller | TASK [libvirt_manager : Attach additional devices if specified] **************** 2025-12-01 11:07:35.599858 | controller | Monday 01 December 2025 11:07:35 +0000 (0:00:00.027) 0:02:15.198 ******* 2025-12-01 11:07:35.599866 | controller | skipping: [instance] 2025-12-01 11:07:35.627303 | controller | 2025-12-01 11:07:35.627404 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************ 2025-12-01 11:07:35.627414 | controller | Monday 01 December 2025 11:07:35 +0000 (0:00:00.046) 0:02:15.245 ******* 2025-12-01 11:07:35.627435 | controller | skipping: [instance] 2025-12-01 11:07:35.627741 | controller | 2025-12-01 11:07:35.627783 | controller | TASK [libvirt_manager : Start (power-on) VMs] ********************************** 2025-12-01 11:07:35.627818 | controller | Monday 01 December 2025 11:07:35 +0000 (0:00:00.027) 0:02:15.272 ******* 2025-12-01 11:07:35.691020 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance 2025-12-01 11:07:35.691176 | controller | 2025-12-01 11:07:35.691347 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] ***************** 2025-12-01 11:07:35.691540 | controller | Monday 01 December 2025 11:07:35 +0000 (0:00:00.064) 0:02:15.336 ******* 2025-12-01 11:07:35.935184 | controller | ok: [instance] => (item=crc) 2025-12-01 11:07:35.935222 | controller | 2025-12-01 11:07:35.935232 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] ********************** 2025-12-01 11:07:35.935243 | controller | Monday 01 December 2025 11:07:35 +0000 (0:00:00.243) 0:02:15.580 ******* 2025-12-01 11:07:38.006020 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-01 11:07:38.852038 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-01 11:07:38.852086 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-01 11:07:38.852098 | controller | 2025-12-01 11:07:38.852105 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-01 11:07:38.852111 | controller | Monday 01 December 2025 11:07:38 +0000 (0:00:02.070) 0:02:17.650 ******* 2025-12-01 11:07:38.852126 | controller | changed: [instance] 2025-12-01 11:07:39.638342 | controller | 2025-12-01 11:07:39.638376 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-01 11:07:39.638384 | controller | Monday 01 December 2025 11:07:38 +0000 (0:00:00.846) 0:02:18.497 ******* 2025-12-01 11:07:39.638394 | controller | changed: [instance] 2025-12-01 11:07:40.472803 | controller | 2025-12-01 11:07:40.472838 | controller | TASK [libvirt_manager : Start vm] ********************************************** 2025-12-01 11:07:40.472846 | controller | Monday 01 December 2025 11:07:39 +0000 (0:00:00.786) 0:02:19.283 ******* 2025-12-01 11:07:40.472856 | controller | changed: [instance] 2025-12-01 11:07:41.217544 | controller | 2025-12-01 11:07:41.217575 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] *************************** 2025-12-01 11:07:41.217583 | controller | Monday 01 December 2025 11:07:40 +0000 (0:00:00.834) 0:02:20.117 ******* 2025-12-01 11:07:41.217593 | controller | changed: [instance] => (item=compute-0.utility) 2025-12-01 11:08:00.987033 | controller | changed: [instance] => (item=controller-0.utility) 2025-12-01 11:08:00.987089 | controller | changed: [instance] => (item=crc-0.utility) 2025-12-01 11:08:00.987100 | controller | 2025-12-01 11:08:00.987107 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] **************************** 2025-12-01 11:08:00.987113 | controller | Monday 01 December 2025 11:07:41 +0000 (0:00:00.739) 0:02:20.857 ******* 2025-12-01 11:08:00.987123 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-12-01 11:08:01.104397 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left). 2025-12-01 11:08:01.104456 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left). 2025-12-01 11:08:01.104465 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left). 2025-12-01 11:08:01.104470 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left). 2025-12-01 11:08:01.104476 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j37430944535.24265', 'results_file': '/home/zuul/.ansible_async/j37430944535.24265', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'}) 2025-12-01 11:08:01.104488 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left). 2025-12-01 11:08:01.104493 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j581423247039.24282', 'results_file': '/home/zuul/.ansible_async/j581423247039.24282', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'}) 2025-12-01 11:08:01.104499 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j132837616171.24298', 'results_file': '/home/zuul/.ansible_async/j132837616171.24298', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'}) 2025-12-01 11:08:01.104504 | controller | 2025-12-01 11:08:01.104510 | controller | TASK [libvirt_manager : Configure managed VMs] ********************************* 2025-12-01 11:08:01.104515 | controller | Monday 01 December 2025 11:08:00 +0000 (0:00:19.773) 0:02:40.631 ******* 2025-12-01 11:08:01.104528 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'}) 2025-12-01 11:08:01.104864 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'}) 2025-12-01 11:08:01.128327 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'}) 2025-12-01 11:08:01.128356 | controller | 2025-12-01 11:08:01.128364 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-01 11:08:01.128375 | controller | Monday 01 December 2025 11:08:01 +0000 (0:00:00.118) 0:02:40.749 ******* 2025-12-01 11:08:01.128384 | controller | skipping: [instance] 2025-12-01 11:08:01.165435 | controller | 2025-12-01 11:08:01.165474 | controller | TASK [Push ssh jumper/configuration for compute-0] ***************************** 2025-12-01 11:08:01.165482 | controller | Monday 01 December 2025 11:08:01 +0000 (0:00:00.023) 0:02:40.773 ******* 2025-12-01 11:08:01.165493 | controller | 2025-12-01 11:08:01.250928 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-01 11:08:01.250970 | controller | Monday 01 December 2025 11:08:01 +0000 (0:00:00.037) 0:02:40.810 ******* 2025-12-01 11:08:01.251010 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-12-01 11:08:01.251031 | controller | 2025-12-01 11:08:01.251147 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-01 11:08:01.251260 | controller | Monday 01 December 2025 11:08:01 +0000 (0:00:00.085) 0:02:40.896 ******* 2025-12-01 11:08:01.478630 | controller | changed: [instance] 2025-12-01 11:08:01.478747 | controller | 2025-12-01 11:08:01.478760 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-01 11:08:01.478855 | controller | Monday 01 December 2025 11:08:01 +0000 (0:00:00.227) 0:02:41.123 ******* 2025-12-01 11:08:01.689471 | controller | changed: [instance] 2025-12-01 11:08:01.689524 | controller | 2025-12-01 11:08:01.689639 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] ******************* 2025-12-01 11:08:01.689737 | controller | Monday 01 December 2025 11:08:01 +0000 (0:00:00.211) 0:02:41.334 ******* 2025-12-01 11:08:02.087952 | controller | changed: [instance] 2025-12-01 11:08:02.114520 | controller | 2025-12-01 11:08:02.114558 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ****************** 2025-12-01 11:08:02.114566 | controller | Monday 01 December 2025 11:08:02 +0000 (0:00:00.398) 0:02:41.732 ******* 2025-12-01 11:08:02.114577 | controller | skipping: [instance] 2025-12-01 11:08:02.140875 | controller | 2025-12-01 11:08:02.140910 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-01 11:08:02.140925 | controller | Monday 01 December 2025 11:08:02 +0000 (0:00:00.026) 0:02:41.759 ******* 2025-12-01 11:08:02.140937 | controller | skipping: [instance] 2025-12-01 11:08:02.140955 | controller | 2025-12-01 11:08:02.141084 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] ***************** 2025-12-01 11:08:02.141204 | controller | Monday 01 December 2025 11:08:02 +0000 (0:00:00.026) 0:02:41.786 ******* 2025-12-01 11:08:02.188500 | controller | skipping: [instance] 2025-12-01 11:08:02.235144 | controller | 2025-12-01 11:08:02.235190 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ****************** 2025-12-01 11:08:02.235199 | controller | Monday 01 December 2025 11:08:02 +0000 (0:00:00.047) 0:02:41.833 ******* 2025-12-01 11:08:02.235212 | controller | skipping: [instance] 2025-12-01 11:08:02.261222 | controller | 2025-12-01 11:08:02.261257 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-01 11:08:02.261266 | controller | Monday 01 December 2025 11:08:02 +0000 (0:00:00.046) 0:02:41.880 ******* 2025-12-01 11:08:02.261277 | controller | skipping: [instance] 2025-12-01 11:08:02.300234 | controller | 2025-12-01 11:08:02.300269 | controller | TASK [Push ssh jumper/configuration for controller-0] ************************** 2025-12-01 11:08:02.300278 | controller | Monday 01 December 2025 11:08:02 +0000 (0:00:00.025) 0:02:41.906 ******* 2025-12-01 11:08:02.300289 | controller | 2025-12-01 11:08:02.300361 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-01 11:08:02.300483 | controller | Monday 01 December 2025 11:08:02 +0000 (0:00:00.039) 0:02:41.945 ******* 2025-12-01 11:08:02.381929 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'}) 2025-12-01 11:08:02.382147 | controller | 2025-12-01 11:08:02.382305 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-01 11:08:02.382445 | controller | Monday 01 December 2025 11:08:02 +0000 (0:00:00.081) 0:02:42.027 ******* 2025-12-01 11:08:02.605685 | controller | ok: [instance] 2025-12-01 11:08:02.817144 | controller | 2025-12-01 11:08:02.817179 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-01 11:08:02.817187 | controller | Monday 01 December 2025 11:08:02 +0000 (0:00:00.223) 0:02:42.250 ******* 2025-12-01 11:08:02.817199 | controller | ok: [instance] 2025-12-01 11:08:02.817219 | controller | 2025-12-01 11:08:02.817266 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] **************** 2025-12-01 11:08:02.817371 | controller | Monday 01 December 2025 11:08:02 +0000 (0:00:00.211) 0:02:42.462 ******* 2025-12-01 11:08:03.206900 | controller | changed: [instance] 2025-12-01 11:08:03.206954 | controller | 2025-12-01 11:08:03.207117 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] *************** 2025-12-01 11:08:03.207238 | controller | Monday 01 December 2025 11:08:03 +0000 (0:00:00.389) 0:02:42.852 ******* 2025-12-01 11:08:03.231877 | controller | skipping: [instance] 2025-12-01 11:08:03.231963 | controller | 2025-12-01 11:08:03.232103 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-01 11:08:03.232208 | controller | Monday 01 December 2025 11:08:03 +0000 (0:00:00.025) 0:02:42.877 ******* 2025-12-01 11:08:03.265242 | controller | skipping: [instance] 2025-12-01 11:08:03.265343 | controller | 2025-12-01 11:08:03.265462 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] ************** 2025-12-01 11:08:03.265562 | controller | Monday 01 December 2025 11:08:03 +0000 (0:00:00.033) 0:02:42.910 ******* 2025-12-01 11:08:04.823622 | controller | changed: [instance -> controller-0.instance] 2025-12-01 11:08:04.823915 | controller | 2025-12-01 11:08:06.003547 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] *************** 2025-12-01 11:08:06.003583 | controller | Monday 01 December 2025 11:08:04 +0000 (0:00:01.558) 0:02:44.468 ******* 2025-12-01 11:08:06.003596 | controller | changed: [instance -> controller-0.instance] 2025-12-01 11:08:06.057997 | controller | 2025-12-01 11:08:06.058135 | controller | TASK [Check if new ssh keypair exists] ***************************************** 2025-12-01 11:08:06.058158 | controller | Monday 01 December 2025 11:08:06 +0000 (0:00:01.179) 0:02:45.648 ******* 2025-12-01 11:08:06.058176 | controller | 2025-12-01 11:08:06.058208 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ****************** 2025-12-01 11:08:06.294096 | controller | Monday 01 December 2025 11:08:06 +0000 (0:00:00.054) 0:02:45.703 ******* 2025-12-01 11:08:06.294163 | controller | ok: [instance] 2025-12-01 11:08:06.294193 | controller | 2025-12-01 11:08:06.294300 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ****************** 2025-12-01 11:08:06.294312 | controller | Monday 01 December 2025 11:08:06 +0000 (0:00:00.236) 0:02:45.939 ******* 2025-12-01 11:08:06.322457 | controller | ok: [instance] 2025-12-01 11:08:06.322521 | controller | 2025-12-01 11:08:06.322648 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] ********* 2025-12-01 11:08:06.322768 | controller | Monday 01 December 2025 11:08:06 +0000 (0:00:00.028) 0:02:45.968 ******* 2025-12-01 11:08:06.355490 | controller | skipping: [instance] 2025-12-01 11:08:06.355577 | controller | 2025-12-01 11:08:06.355689 | controller | TASK [Push ssh jumper/configuration for crc-0] ********************************* 2025-12-01 11:08:06.355798 | controller | Monday 01 December 2025 11:08:06 +0000 (0:00:00.033) 0:02:46.001 ******* 2025-12-01 11:08:06.402533 | controller | 2025-12-01 11:08:06.402620 | controller | TASK [ssh_jumper : Create ssh-jumper entries] ********************************** 2025-12-01 11:08:06.402748 | controller | Monday 01 December 2025 11:08:06 +0000 (0:00:00.047) 0:02:46.048 ******* 2025-12-01 11:08:06.489336 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'}) 2025-12-01 11:08:06.489391 | controller | 2025-12-01 11:08:06.489456 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] ******* 2025-12-01 11:08:06.489562 | controller | Monday 01 December 2025 11:08:06 +0000 (0:00:00.086) 0:02:46.134 ******* 2025-12-01 11:08:06.744470 | controller | ok: [instance] 2025-12-01 11:08:06.744566 | controller | 2025-12-01 11:08:06.744578 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] *** 2025-12-01 11:08:06.744605 | controller | Monday 01 December 2025 11:08:06 +0000 (0:00:00.254) 0:02:46.389 ******* 2025-12-01 11:08:06.971354 | controller | ok: [instance] 2025-12-01 11:08:06.971427 | controller | 2025-12-01 11:08:06.971535 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] *********************** 2025-12-01 11:08:06.971550 | controller | Monday 01 December 2025 11:08:06 +0000 (0:00:00.226) 0:02:46.616 ******* 2025-12-01 11:08:07.402238 | controller | changed: [instance] 2025-12-01 11:08:07.402290 | controller | 2025-12-01 11:08:07.402381 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] ********************** 2025-12-01 11:08:07.402484 | controller | Monday 01 December 2025 11:08:07 +0000 (0:00:00.430) 0:02:47.047 ******* 2025-12-01 11:08:08.231866 | controller | changed: [instance] 2025-12-01 11:08:08.231929 | controller | 2025-12-01 11:08:08.232027 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] ********* 2025-12-01 11:08:08.232230 | controller | Monday 01 December 2025 11:08:08 +0000 (0:00:00.829) 0:02:47.877 ******* 2025-12-01 11:08:08.262290 | controller | skipping: [instance] 2025-12-01 11:08:08.262372 | controller | 2025-12-01 11:08:08.262480 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] ********************* 2025-12-01 11:08:08.262583 | controller | Monday 01 December 2025 11:08:08 +0000 (0:00:00.030) 0:02:47.907 ******* 2025-12-01 11:08:08.316870 | controller | skipping: [instance] 2025-12-01 11:08:08.316945 | controller | 2025-12-01 11:08:08.317100 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] ********************** 2025-12-01 11:08:08.317324 | controller | Monday 01 December 2025 11:08:08 +0000 (0:00:00.054) 0:02:47.962 ******* 2025-12-01 11:08:08.365036 | controller | skipping: [instance] 2025-12-01 11:08:08.365189 | controller | 2025-12-01 11:08:08.365276 | controller | TASK [Create VBMC entity] ****************************************************** 2025-12-01 11:08:08.365390 | controller | Monday 01 December 2025 11:08:08 +0000 (0:00:00.048) 0:02:48.010 ******* 2025-12-01 11:08:08.420851 | controller | skipping: [instance] => (item=compute-0) 2025-12-01 11:08:08.420929 | controller | skipping: [instance] => (item=controller-0) 2025-12-01 11:08:08.421034 | controller | skipping: [instance] => (item=crc-0) 2025-12-01 11:08:08.421190 | controller | skipping: [instance] 2025-12-01 11:08:08.421287 | controller | 2025-12-01 11:08:08.421381 | controller | TASK [libvirt_manager : List running virtual machines.] ************************ 2025-12-01 11:08:08.421482 | controller | Monday 01 December 2025 11:08:08 +0000 (0:00:00.055) 0:02:48.066 ******* 2025-12-01 11:08:08.664432 | controller | ok: [instance] 2025-12-01 11:08:08.664489 | controller | 2025-12-01 11:08:08.664613 | controller | TASK [libvirt_manager : Dump UUIDs] ******************************************** 2025-12-01 11:08:08.664712 | controller | Monday 01 December 2025 11:08:08 +0000 (0:00:00.243) 0:02:48.309 ******* 2025-12-01 11:08:09.050021 | controller | changed: [instance] 2025-12-01 11:08:09.051553 | controller | 2025-12-01 11:08:09.084766 | controller | TASK [Ensure fresh vbmc listing] *********************************************** 2025-12-01 11:08:09.084791 | controller | Monday 01 December 2025 11:08:09 +0000 (0:00:00.385) 0:02:48.695 ******* 2025-12-01 11:08:09.084804 | controller | skipping: [instance] 2025-12-01 11:08:09.118474 | controller | 2025-12-01 11:08:09.118499 | controller | TASK [libvirt_manager : Update vbmc related fact] ****************************** 2025-12-01 11:08:09.118508 | controller | Monday 01 December 2025 11:08:09 +0000 (0:00:00.034) 0:02:48.730 ******* 2025-12-01 11:08:09.118524 | controller | skipping: [instance] 2025-12-01 11:08:09.153108 | controller | 2025-12-01 11:08:09.153136 | controller | TASK [libvirt_manager : Dump vbmc known hosts] ********************************* 2025-12-01 11:08:09.153144 | controller | Monday 01 December 2025 11:08:09 +0000 (0:00:00.033) 0:02:48.763 ******* 2025-12-01 11:08:09.153155 | controller | skipping: [instance] 2025-12-01 11:08:09.855712 | controller | 2025-12-01 11:08:09.855746 | controller | TASK [libvirt_manager : Copy authorized_keys] ********************************** 2025-12-01 11:08:09.855755 | controller | Monday 01 December 2025 11:08:09 +0000 (0:00:00.034) 0:02:48.798 ******* 2025-12-01 11:08:09.855767 | controller | changed: [instance] 2025-12-01 11:08:10.453695 | controller | 2025-12-01 11:08:10.453734 | controller | TASK [libvirt_manager : Enable root access on CRC] ***************************** 2025-12-01 11:08:10.453742 | controller | Monday 01 December 2025 11:08:09 +0000 (0:00:00.702) 0:02:49.500 ******* 2025-12-01 11:08:10.453754 | controller | changed: [instance] 2025-12-01 11:08:10.453798 | controller | 2025-12-01 11:08:10.453872 | controller | TASK [reproducer : Get deployed VM group inventories] ************************** 2025-12-01 11:08:10.453960 | controller | Monday 01 December 2025 11:08:10 +0000 (0:00:00.598) 0:02:50.099 ******* 2025-12-01 11:08:10.494137 | controller | skipping: [instance] 2025-12-01 11:08:10.494343 | controller | 2025-12-01 11:08:10.494364 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] ************* 2025-12-01 11:08:10.554661 | controller | Monday 01 December 2025 11:08:10 +0000 (0:00:00.040) 0:02:50.139 ******* 2025-12-01 11:08:10.554695 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance) 2025-12-01 11:08:10.554960 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0) 2025-12-01 11:08:10.554983 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0) 2025-12-01 11:08:10.555202 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0) 2025-12-01 11:08:10.555221 | controller | 2025-12-01 11:08:10.555231 | controller | TASK [reproducer : Gather inventories from instance] *************************** 2025-12-01 11:08:10.599137 | controller | Monday 01 December 2025 11:08:10 +0000 (0:00:00.059) 0:02:50.199 ******* 2025-12-01 11:08:10.599167 | controller | skipping: [instance] 2025-12-01 11:08:10.599358 | controller | 2025-12-01 11:08:10.599370 | controller | TASK [reproducer : Gather inventories from compute-0] ************************** 2025-12-01 11:08:10.635160 | controller | Monday 01 December 2025 11:08:10 +0000 (0:00:00.045) 0:02:50.244 ******* 2025-12-01 11:08:10.635198 | controller | skipping: [instance] 2025-12-01 11:08:10.635239 | controller | 2025-12-01 11:08:10.635417 | controller | TASK [reproducer : Gather inventories from controller-0] *********************** 2025-12-01 11:08:10.670693 | controller | Monday 01 December 2025 11:08:10 +0000 (0:00:00.036) 0:02:50.280 ******* 2025-12-01 11:08:10.670739 | controller | skipping: [instance] 2025-12-01 11:08:10.670957 | controller | 2025-12-01 11:08:10.706613 | controller | TASK [reproducer : Gather inventories from crc-0] ****************************** 2025-12-01 11:08:10.706641 | controller | Monday 01 December 2025 11:08:10 +0000 (0:00:00.035) 0:02:50.316 ******* 2025-12-01 11:08:10.706654 | controller | skipping: [instance] 2025-12-01 11:08:10.706765 | controller | 2025-12-01 11:08:10.706880 | controller | TASK [reproducer : Push generated inventory from hypervisor] ******************* 2025-12-01 11:08:10.707004 | controller | Monday 01 December 2025 11:08:10 +0000 (0:00:00.035) 0:02:50.352 ******* 2025-12-01 11:08:11.315214 | controller | changed: [instance] 2025-12-01 11:08:11.347503 | controller | 2025-12-01 11:08:11.347534 | controller | TASK [reproducer : Slurp devscripts private key] ******************************* 2025-12-01 11:08:11.347543 | controller | Monday 01 December 2025 11:08:11 +0000 (0:00:00.608) 0:02:50.960 ******* 2025-12-01 11:08:11.347554 | controller | skipping: [instance] 2025-12-01 11:08:11.377545 | controller | 2025-12-01 11:08:11.377573 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] ***************** 2025-12-01 11:08:11.377586 | controller | Monday 01 December 2025 11:08:11 +0000 (0:00:00.032) 0:02:50.992 ******* 2025-12-01 11:08:11.377597 | controller | skipping: [instance] 2025-12-01 11:08:11.411473 | controller | 2025-12-01 11:08:11.411502 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] ********* 2025-12-01 11:08:11.411511 | controller | Monday 01 December 2025 11:08:11 +0000 (0:00:00.030) 0:02:51.022 ******* 2025-12-01 11:08:11.411522 | controller | skipping: [instance] 2025-12-01 11:08:11.444740 | controller | 2025-12-01 11:08:11.444766 | controller | TASK [openshift_login : Assert we have needed parameters] ********************** 2025-12-01 11:08:11.444783 | controller | Monday 01 December 2025 11:08:11 +0000 (0:00:00.033) 0:02:51.056 ******* 2025-12-01 11:08:11.444795 | controller | skipping: [instance] 2025-12-01 11:08:11.444847 | controller | 2025-12-01 11:08:11.444859 | controller | TASK [openshift_login : Stat kubeconfig] *************************************** 2025-12-01 11:08:11.444982 | controller | Monday 01 December 2025 11:08:11 +0000 (0:00:00.033) 0:02:51.090 ******* 2025-12-01 11:08:11.480813 | controller | skipping: [instance] 2025-12-01 11:08:11.480896 | controller | 2025-12-01 11:08:11.481028 | controller | TASK [openshift_login : Stat kubeadmin] **************************************** 2025-12-01 11:08:11.481183 | controller | Monday 01 December 2025 11:08:11 +0000 (0:00:00.036) 0:02:51.126 ******* 2025-12-01 11:08:11.514142 | controller | skipping: [instance] 2025-12-01 11:08:11.516464 | controller | 2025-12-01 11:08:11.546383 | controller | TASK [openshift_login : Assert files exist] ************************************ 2025-12-01 11:08:11.546406 | controller | Monday 01 December 2025 11:08:11 +0000 (0:00:00.033) 0:02:51.159 ******* 2025-12-01 11:08:11.546417 | controller | skipping: [instance] 2025-12-01 11:08:11.546476 | controller | 2025-12-01 11:08:11.546583 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] ********** 2025-12-01 11:08:11.546692 | controller | Monday 01 December 2025 11:08:11 +0000 (0:00:00.032) 0:02:51.191 ******* 2025-12-01 11:08:11.578105 | controller | skipping: [instance] 2025-12-01 11:08:11.578214 | controller | 2025-12-01 11:08:11.578328 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] **************** 2025-12-01 11:08:11.578434 | controller | Monday 01 December 2025 11:08:11 +0000 (0:00:00.031) 0:02:51.223 ******* 2025-12-01 11:08:11.609952 | controller | skipping: [instance] 2025-12-01 11:08:11.610048 | controller | 2025-12-01 11:08:11.610214 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ******** 2025-12-01 11:08:11.610318 | controller | Monday 01 December 2025 11:08:11 +0000 (0:00:00.031) 0:02:51.255 ******* 2025-12-01 11:08:11.659508 | controller | skipping: [instance] 2025-12-01 11:08:11.659615 | controller | 2025-12-01 11:08:11.659719 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] ********************* 2025-12-01 11:08:11.659821 | controller | Monday 01 December 2025 11:08:11 +0000 (0:00:00.049) 0:02:51.304 ******* 2025-12-01 11:08:11.690875 | controller | skipping: [instance] 2025-12-01 11:08:11.690979 | controller | 2025-12-01 11:08:11.691126 | controller | TASK [reproducer : Configure Controller node] ********************************** 2025-12-01 11:08:11.691238 | controller | Monday 01 December 2025 11:08:11 +0000 (0:00:00.031) 0:02:51.336 ******* 2025-12-01 11:08:11.848202 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance 2025-12-01 11:08:11.848274 | controller | 2025-12-01 11:08:11.848390 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-12-01 11:08:11.848492 | controller | Monday 01 December 2025 11:08:11 +0000 (0:00:00.157) 0:02:51.493 ******* 2025-12-01 11:08:13.089865 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-12-01 11:08:13.089936 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-12-01 11:08:13.090042 | controller | 2025-12-01 11:08:13.090189 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-12-01 11:08:13.090305 | controller | Monday 01 December 2025 11:08:13 +0000 (0:00:01.241) 0:02:52.735 ******* 2025-12-01 11:08:13.107921 | controller | skipping: [instance] 2025-12-01 11:08:13.108003 | controller | 2025-12-01 11:08:13.108143 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-01 11:08:13.108258 | controller | Monday 01 December 2025 11:08:13 +0000 (0:00:00.018) 0:02:52.753 ******* 2025-12-01 11:08:13.682393 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:08:13.682459 | controller | 2025-12-01 11:08:13.682569 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-01 11:08:13.682679 | controller | Monday 01 December 2025 11:08:13 +0000 (0:00:00.574) 0:02:53.327 ******* 2025-12-01 11:08:13.714852 | controller | skipping: [instance] 2025-12-01 11:08:13.714956 | controller | 2025-12-01 11:08:13.715128 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-01 11:08:13.715252 | controller | Monday 01 December 2025 11:08:13 +0000 (0:00:00.032) 0:02:53.360 ******* 2025-12-01 11:08:13.747344 | controller | skipping: [instance] 2025-12-01 11:08:13.747443 | controller | 2025-12-01 11:08:13.747568 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-01 11:08:13.747689 | controller | Monday 01 December 2025 11:08:13 +0000 (0:00:00.032) 0:02:53.393 ******* 2025-12-01 11:08:13.779725 | controller | skipping: [instance] 2025-12-01 11:08:13.779809 | controller | 2025-12-01 11:08:13.779913 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-01 11:08:13.780013 | controller | Monday 01 December 2025 11:08:13 +0000 (0:00:00.032) 0:02:53.425 ******* 2025-12-01 11:08:15.342397 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:08:15.342451 | controller | 2025-12-01 11:08:15.342715 | controller | TASK [reproducer : Get rhos-release] ******************************************* 2025-12-01 11:08:15.374899 | controller | Monday 01 December 2025 11:08:15 +0000 (0:00:01.562) 0:02:54.987 ******* 2025-12-01 11:08:15.374933 | controller | skipping: [instance] 2025-12-01 11:08:15.407230 | controller | 2025-12-01 11:08:15.407268 | controller | TASK [reproducer : Install repos] ********************************************** 2025-12-01 11:08:15.407278 | controller | Monday 01 December 2025 11:08:15 +0000 (0:00:00.032) 0:02:55.020 ******* 2025-12-01 11:08:15.407290 | controller | skipping: [instance] 2025-12-01 11:08:15.407326 | controller | 2025-12-01 11:08:15.407336 | controller | TASK [reproducer : Run custom commands after rhos-release setup] *************** 2025-12-01 11:08:15.407414 | controller | Monday 01 December 2025 11:08:15 +0000 (0:00:00.032) 0:02:55.052 ******* 2025-12-01 11:08:15.439671 | controller | skipping: [instance] 2025-12-01 11:08:15.471192 | controller | 2025-12-01 11:08:15.471222 | controller | TASK [reproducer : Create bundle for CRC] ************************************** 2025-12-01 11:08:15.471232 | controller | Monday 01 December 2025 11:08:15 +0000 (0:00:00.032) 0:02:55.084 ******* 2025-12-01 11:08:15.471244 | controller | skipping: [instance] 2025-12-01 11:08:15.471278 | controller | 2025-12-01 11:08:15.471288 | controller | TASK [reproducer : Install some tools] ***************************************** 2025-12-01 11:08:15.471428 | controller | Monday 01 December 2025 11:08:15 +0000 (0:00:00.031) 0:02:55.116 ******* 2025-12-01 11:08:16.513221 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:08:16.513332 | controller | 2025-12-01 11:08:16.513353 | controller | TASK [reproducer : Inject command aliases for faster debugging] **************** 2025-12-01 11:08:16.513366 | controller | Monday 01 December 2025 11:08:16 +0000 (0:00:01.041) 0:02:56.158 ******* 2025-12-01 11:08:17.592159 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:08:17.592351 | controller | 2025-12-01 11:08:17.592386 | controller | TASK [reproducer : Build job inventory for hook usage] ************************* 2025-12-01 11:08:18.219047 | controller | Monday 01 December 2025 11:08:17 +0000 (0:00:01.079) 0:02:57.237 ******* 2025-12-01 11:08:18.219112 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:08:19.207050 | controller | 2025-12-01 11:08:19.207107 | controller | TASK [reproducer : Push the MAC mapping data] ********************************** 2025-12-01 11:08:19.207116 | controller | Monday 01 December 2025 11:08:18 +0000 (0:00:00.626) 0:02:57.864 ******* 2025-12-01 11:08:19.207137 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:08:20.300727 | controller | 2025-12-01 11:08:20.300766 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] *************************** 2025-12-01 11:08:20.300777 | controller | Monday 01 December 2025 11:08:19 +0000 (0:00:00.988) 0:02:58.852 ******* 2025-12-01 11:08:20.300790 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-12-01 11:08:21.021151 | controller | skipping: [instance] => (item=compute-0) 2025-12-01 11:08:21.021183 | controller | skipping: [instance] => (item=controller-0) 2025-12-01 11:08:21.021191 | controller | skipping: [instance] => (item=crc-0) 2025-12-01 11:08:21.021197 | controller | 2025-12-01 11:08:21.021203 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] ***************** 2025-12-01 11:08:21.021209 | controller | Monday 01 December 2025 11:08:20 +0000 (0:00:01.093) 0:02:59.945 ******* 2025-12-01 11:08:21.021222 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance) 2025-12-01 11:08:21.021587 | controller | skipping: [instance] => (item=compute-0) 2025-12-01 11:08:21.021599 | controller | skipping: [instance] => (item=controller-0) 2025-12-01 11:08:21.021606 | controller | skipping: [instance] => (item=crc-0) 2025-12-01 11:08:21.021614 | controller | 2025-12-01 11:08:22.830132 | controller | TASK [reproducer : Inject SSH configuration] *********************************** 2025-12-01 11:08:22.830173 | controller | Monday 01 December 2025 11:08:21 +0000 (0:00:00.720) 0:03:00.666 ******* 2025-12-01 11:08:22.830186 | controller | skipping: [instance] => (item=instance) 2025-12-01 11:08:23.428222 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0) 2025-12-01 11:08:23.428255 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-12-01 11:08:23.428263 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0) 2025-12-01 11:08:23.428268 | controller | 2025-12-01 11:08:23.428274 | controller | TASK [reproducer : Create kube directory] ************************************** 2025-12-01 11:08:23.428280 | controller | Monday 01 December 2025 11:08:22 +0000 (0:00:01.808) 0:03:02.475 ******* 2025-12-01 11:08:23.428290 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:08:24.393922 | controller | 2025-12-01 11:08:24.393954 | controller | TASK [reproducer : Inject kubeconfig content] ********************************** 2025-12-01 11:08:24.393963 | controller | Monday 01 December 2025 11:08:23 +0000 (0:00:00.598) 0:03:03.073 ******* 2025-12-01 11:08:24.393973 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:08:25.339589 | controller | 2025-12-01 11:08:25.339619 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************ 2025-12-01 11:08:25.339627 | controller | Monday 01 December 2025 11:08:24 +0000 (0:00:00.965) 0:03:04.039 ******* 2025-12-01 11:08:25.339638 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:08:25.371731 | controller | 2025-12-01 11:08:25.371760 | controller | TASK [reproducer : Inject devscripts private key if set] *********************** 2025-12-01 11:08:25.371769 | controller | Monday 01 December 2025 11:08:25 +0000 (0:00:00.945) 0:03:04.984 ******* 2025-12-01 11:08:25.371779 | controller | skipping: [instance] 2025-12-01 11:08:25.968143 | controller | 2025-12-01 11:08:25.968175 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ****************************** 2025-12-01 11:08:25.968195 | controller | Monday 01 December 2025 11:08:25 +0000 (0:00:00.032) 0:03:05.017 ******* 2025-12-01 11:08:25.968206 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:08:26.578082 | controller | 2025-12-01 11:08:26.578114 | controller | TASK [manage_secrets : Ensure directory tree exist] **************************** 2025-12-01 11:08:26.578123 | controller | Monday 01 December 2025 11:08:25 +0000 (0:00:00.596) 0:03:05.613 ******* 2025-12-01 11:08:26.578134 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:08:26.618794 | controller | 2025-12-01 11:08:26.618826 | controller | TASK [manage_secrets : Assert we get needed data] ****************************** 2025-12-01 11:08:26.618835 | controller | Monday 01 December 2025 11:08:26 +0000 (0:00:00.610) 0:03:06.223 ******* 2025-12-01 11:08:26.618845 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:08:26.687003 | controller | 2025-12-01 11:08:26.687033 | controller | TASK [manage_secrets : Push reproducer secrets] ******************************** 2025-12-01 11:08:26.687042 | controller | Monday 01 December 2025 11:08:26 +0000 (0:00:00.040) 0:03:06.263 ******* 2025-12-01 11:08:26.687052 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'}) 2025-12-01 11:08:26.744701 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'}) 2025-12-01 11:08:26.744731 | controller | 2025-12-01 11:08:26.744739 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-12-01 11:08:26.744745 | controller | Monday 01 December 2025 11:08:26 +0000 (0:00:00.067) 0:03:06.331 ******* 2025-12-01 11:08:26.744755 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-01 11:08:26.799963 | controller | _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt 2025-12-01 11:08:26.799993 | controller | 2025-12-01 11:08:26.800001 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-12-01 11:08:26.800007 | controller | Monday 01 December 2025 11:08:26 +0000 (0:00:00.057) 0:03:06.389 ******* 2025-12-01 11:08:26.800017 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-01 11:08:26.850424 | controller | _secret_file: '' 2025-12-01 11:08:26.850457 | controller | 2025-12-01 11:08:26.850465 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-12-01 11:08:26.850472 | controller | Monday 01 December 2025 11:08:26 +0000 (0:00:00.055) 0:03:06.444 ******* 2025-12-01 11:08:26.850482 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-01 11:08:26.901227 | controller | _secret_content: my-default-location-place 2025-12-01 11:08:26.901256 | controller | 2025-12-01 11:08:26.901264 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-12-01 11:08:26.901270 | controller | Monday 01 December 2025 11:08:26 +0000 (0:00:00.050) 0:03:06.495 ******* 2025-12-01 11:08:26.901280 | controller | skipping: [instance] 2025-12-01 11:08:26.953311 | controller | 2025-12-01 11:08:26.953340 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-12-01 11:08:26.953349 | controller | Monday 01 December 2025 11:08:26 +0000 (0:00:00.051) 0:03:06.546 ******* 2025-12-01 11:08:26.953359 | controller | skipping: [instance] 2025-12-01 11:08:27.003902 | controller | 2025-12-01 11:08:27.003931 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-12-01 11:08:27.003939 | controller | Monday 01 December 2025 11:08:26 +0000 (0:00:00.052) 0:03:06.598 ******* 2025-12-01 11:08:27.003954 | controller | skipping: [instance] 2025-12-01 11:08:28.099962 | controller | 2025-12-01 11:08:28.099996 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-12-01 11:08:28.100005 | controller | Monday 01 December 2025 11:08:27 +0000 (0:00:00.050) 0:03:06.649 ******* 2025-12-01 11:08:28.100015 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:08:28.160832 | controller | 2025-12-01 11:08:28.160863 | controller | TASK [manage_secrets : Debug _secret_dest] ************************************* 2025-12-01 11:08:28.160871 | controller | Monday 01 December 2025 11:08:28 +0000 (0:00:01.095) 0:03:07.744 ******* 2025-12-01 11:08:28.160881 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-01 11:08:28.217195 | controller | _secret_dest: /home/zuul/ipmi-things 2025-12-01 11:08:28.217262 | controller | 2025-12-01 11:08:28.217271 | controller | TASK [manage_secrets : Debug _secret_file] ************************************* 2025-12-01 11:08:28.217277 | controller | Monday 01 December 2025 11:08:28 +0000 (0:00:00.060) 0:03:07.805 ******* 2025-12-01 11:08:28.217288 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-01 11:08:28.217626 | controller | _secret_file: /tmp/ipmi-things 2025-12-01 11:08:28.218032 | controller | 2025-12-01 11:08:28.218429 | controller | TASK [manage_secrets : Debug _secret_content] ********************************** 2025-12-01 11:08:28.218828 | controller | Monday 01 December 2025 11:08:28 +0000 (0:00:00.055) 0:03:07.861 ******* 2025-12-01 11:08:28.280012 | controller | ok: [instance -> controller-0(controller-0.instance)] => 2025-12-01 11:08:28.338397 | controller | _secret_content: '' 2025-12-01 11:08:28.338427 | controller | 2025-12-01 11:08:28.338442 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] ******************* 2025-12-01 11:08:28.338449 | controller | Monday 01 December 2025 11:08:28 +0000 (0:00:00.062) 0:03:07.924 ******* 2025-12-01 11:08:28.338459 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false 2025-12-01 11:08:28.935703 | controller | msg: All assertions passed 2025-12-01 11:08:28.935740 | controller | 2025-12-01 11:08:28.935748 | controller | TASK [manage_secrets : Check if pull secret src file exists] ******************* 2025-12-01 11:08:28.935755 | controller | Monday 01 December 2025 11:08:28 +0000 (0:00:00.058) 0:03:07.982 ******* 2025-12-01 11:08:28.935765 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:08:29.930527 | controller | 2025-12-01 11:08:29.930560 | controller | TASK [manage_secrets : Copy file to location] ********************************** 2025-12-01 11:08:29.930568 | controller | Monday 01 December 2025 11:08:28 +0000 (0:00:00.597) 0:03:08.580 ******* 2025-12-01 11:08:29.930578 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:08:29.986409 | controller | 2025-12-01 11:08:29.986432 | controller | TASK [manage_secrets : Create file from content] ******************************* 2025-12-01 11:08:29.986499 | controller | Monday 01 December 2025 11:08:29 +0000 (0:00:00.994) 0:03:09.575 ******* 2025-12-01 11:08:29.986512 | controller | skipping: [instance] 2025-12-01 11:08:29.986818 | controller | 2025-12-01 11:08:29.986834 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] ********************************** 2025-12-01 11:08:30.591425 | controller | Monday 01 December 2025 11:08:29 +0000 (0:00:00.055) 0:03:09.631 ******* 2025-12-01 11:08:30.591472 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:08:31.247148 | controller | 2025-12-01 11:08:31.247181 | controller | TASK [reproducer : Check if async file is still available] ********************* 2025-12-01 11:08:31.247190 | controller | Monday 01 December 2025 11:08:30 +0000 (0:00:00.605) 0:03:10.236 ******* 2025-12-01 11:08:31.247201 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:27.404189 | controller | 2025-12-01 11:09:27.404238 | controller | TASK [reproducer : Check package install status] ******************************* 2025-12-01 11:09:27.404247 | controller | Monday 01 December 2025 11:08:31 +0000 (0:00:00.655) 0:03:10.892 ******* 2025-12-01 11:09:27.404258 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left). 2025-12-01 11:09:28.153266 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left). 2025-12-01 11:09:28.153297 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left). 2025-12-01 11:09:28.153305 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left). 2025-12-01 11:09:28.153311 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left). 2025-12-01 11:09:28.153316 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left). 2025-12-01 11:09:28.153321 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left). 2025-12-01 11:09:28.153327 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left). 2025-12-01 11:09:28.153332 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left). 2025-12-01 11:09:28.153337 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left). 2025-12-01 11:09:28.153348 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:28.153355 | controller | 2025-12-01 11:09:28.153361 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] *************** 2025-12-01 11:09:28.153366 | controller | Monday 01 December 2025 11:09:27 +0000 (0:00:56.155) 0:04:07.047 ******* 2025-12-01 11:09:28.153381 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:31.306620 | controller | 2025-12-01 11:09:31.306727 | controller | TASK [sushy_emulator : Install required packages] ****************************** 2025-12-01 11:09:31.306737 | controller | Monday 01 December 2025 11:09:28 +0000 (0:00:00.748) 0:04:07.796 ******* 2025-12-01 11:09:31.306758 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:31.359587 | controller | 2025-12-01 11:09:31.359662 | controller | TASK [sushy_emulator : Get ingresses domain] *********************************** 2025-12-01 11:09:31.359673 | controller | Monday 01 December 2025 11:09:31 +0000 (0:00:03.151) 0:04:10.947 ******* 2025-12-01 11:09:31.359687 | controller | skipping: [instance] 2025-12-01 11:09:31.408776 | controller | 2025-12-01 11:09:31.408806 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] ********************* 2025-12-01 11:09:31.408814 | controller | Monday 01 December 2025 11:09:31 +0000 (0:00:00.054) 0:04:11.002 ******* 2025-12-01 11:09:31.408825 | controller | skipping: [instance] 2025-12-01 11:09:32.189900 | controller | 2025-12-01 11:09:32.189930 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] ********************** 2025-12-01 11:09:32.189939 | controller | Monday 01 December 2025 11:09:31 +0000 (0:00:00.051) 0:04:11.054 ******* 2025-12-01 11:09:32.189950 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:32.884723 | controller | 2025-12-01 11:09:32.884757 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ******************** 2025-12-01 11:09:32.884766 | controller | Monday 01 December 2025 11:09:32 +0000 (0:00:00.780) 0:04:11.834 ******* 2025-12-01 11:09:32.884776 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:33.207576 | controller | 2025-12-01 11:09:33.207606 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] ******************************* 2025-12-01 11:09:33.207614 | controller | Monday 01 December 2025 11:09:32 +0000 (0:00:00.694) 0:04:12.529 ******* 2025-12-01 11:09:33.207625 | controller | changed: [instance] 2025-12-01 11:09:34.033681 | controller | 2025-12-01 11:09:34.033711 | controller | TASK [sushy_emulator : Run ssh-keyscan] **************************************** 2025-12-01 11:09:34.033719 | controller | Monday 01 December 2025 11:09:33 +0000 (0:00:00.322) 0:04:12.852 ******* 2025-12-01 11:09:34.033729 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:35.216532 | controller | 2025-12-01 11:09:35.216572 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************ 2025-12-01 11:09:35.216581 | controller | Monday 01 December 2025 11:09:34 +0000 (0:00:00.826) 0:04:13.678 ******* 2025-12-01 11:09:35.216591 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:35.271560 | controller | 2025-12-01 11:09:35.271580 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-01 11:09:35.271588 | controller | Monday 01 December 2025 11:09:35 +0000 (0:00:01.182) 0:04:14.861 ******* 2025-12-01 11:09:35.271597 | controller | skipping: [instance] 2025-12-01 11:09:35.324534 | controller | 2025-12-01 11:09:35.324558 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-01 11:09:35.324566 | controller | Monday 01 December 2025 11:09:35 +0000 (0:00:00.055) 0:04:14.916 ******* 2025-12-01 11:09:35.324574 | controller | skipping: [instance] 2025-12-01 11:09:35.369282 | controller | 2025-12-01 11:09:35.369303 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] *** 2025-12-01 11:09:35.369311 | controller | Monday 01 December 2025 11:09:35 +0000 (0:00:00.052) 0:04:14.969 ******* 2025-12-01 11:09:35.369320 | controller | skipping: [instance] 2025-12-01 11:09:35.425144 | controller | 2025-12-01 11:09:35.425172 | controller | TASK [sushy_emulator : Generate list of filtered VMs] ************************** 2025-12-01 11:09:35.425183 | controller | Monday 01 December 2025 11:09:35 +0000 (0:00:00.044) 0:04:15.014 ******* 2025-12-01 11:09:35.425195 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:35.467542 | controller | 2025-12-01 11:09:35.467571 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] *************************** 2025-12-01 11:09:35.467588 | controller | Monday 01 December 2025 11:09:35 +0000 (0:00:00.055) 0:04:15.070 ******* 2025-12-01 11:09:35.467601 | controller | skipping: [instance] 2025-12-01 11:09:35.523090 | controller | 2025-12-01 11:09:35.523110 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ******** 2025-12-01 11:09:35.523118 | controller | Monday 01 December 2025 11:09:35 +0000 (0:00:00.042) 0:04:15.112 ******* 2025-12-01 11:09:35.523127 | controller | skipping: [instance] 2025-12-01 11:09:35.563458 | controller | 2025-12-01 11:09:35.563480 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] *************** 2025-12-01 11:09:35.563488 | controller | Monday 01 December 2025 11:09:35 +0000 (0:00:00.055) 0:04:15.168 ******* 2025-12-01 11:09:35.563496 | controller | skipping: [instance] 2025-12-01 11:09:36.293441 | controller | 2025-12-01 11:09:36.293474 | controller | TASK [sushy_emulator : Generate htpasswd string] ******************************* 2025-12-01 11:09:36.293482 | controller | Monday 01 December 2025 11:09:35 +0000 (0:00:00.040) 0:04:15.208 ******* 2025-12-01 11:09:36.293497 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:36.405083 | controller | 2025-12-01 11:09:36.405113 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] ********************* 2025-12-01 11:09:36.405121 | controller | Monday 01 December 2025 11:09:36 +0000 (0:00:00.727) 0:04:15.936 ******* 2025-12-01 11:09:36.405132 | controller | skipping: [instance] => (item=secret) 2025-12-01 11:09:37.574189 | controller | skipping: [instance] => (item=configmap) 2025-12-01 11:09:37.574227 | controller | skipping: [instance] => (item=pod) 2025-12-01 11:09:37.574235 | controller | skipping: [instance] => (item=service) 2025-12-01 11:09:37.574241 | controller | skipping: [instance] => (item=route) 2025-12-01 11:09:37.574246 | controller | skipping: [instance] 2025-12-01 11:09:37.574253 | controller | 2025-12-01 11:09:37.574259 | controller | TASK [sushy_emulator : Write sushy emulator config] **************************** 2025-12-01 11:09:37.574265 | controller | Monday 01 December 2025 11:09:36 +0000 (0:00:00.112) 0:04:16.049 ******* 2025-12-01 11:09:37.574274 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:38.685485 | controller | 2025-12-01 11:09:38.685517 | controller | TASK [sushy_emulator : Write htpasswd string to file] ************************** 2025-12-01 11:09:38.685526 | controller | Monday 01 December 2025 11:09:37 +0000 (0:00:01.169) 0:04:17.218 ******* 2025-12-01 11:09:38.685537 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:38.725192 | controller | 2025-12-01 11:09:38.725222 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ******************** 2025-12-01 11:09:38.725231 | controller | Monday 01 December 2025 11:09:38 +0000 (0:00:01.111) 0:04:18.330 ******* 2025-12-01 11:09:38.725241 | controller | skipping: [instance] 2025-12-01 11:09:38.761923 | controller | 2025-12-01 11:09:38.761958 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] *** 2025-12-01 11:09:38.761966 | controller | Monday 01 December 2025 11:09:38 +0000 (0:00:00.039) 0:04:18.370 ******* 2025-12-01 11:09:38.761977 | controller | skipping: [instance] 2025-12-01 11:09:38.849555 | controller | 2025-12-01 11:09:38.849580 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] ************************* 2025-12-01 11:09:38.849588 | controller | Monday 01 December 2025 11:09:38 +0000 (0:00:00.036) 0:04:18.406 ******* 2025-12-01 11:09:38.849598 | controller | skipping: [instance] => (item=secret) 2025-12-01 11:09:38.892260 | controller | skipping: [instance] => (item=configmap) 2025-12-01 11:09:38.892287 | controller | skipping: [instance] => (item=service) 2025-12-01 11:09:38.892295 | controller | skipping: [instance] => (item=route) 2025-12-01 11:09:38.892300 | controller | skipping: [instance] 2025-12-01 11:09:38.892307 | controller | 2025-12-01 11:09:38.892313 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] ********************** 2025-12-01 11:09:38.892318 | controller | Monday 01 December 2025 11:09:38 +0000 (0:00:00.084) 0:04:18.491 ******* 2025-12-01 11:09:38.892328 | controller | skipping: [instance] 2025-12-01 11:09:40.585388 | controller | 2025-12-01 11:09:40.585430 | controller | TASK [podman : Ensure podman is installed] ************************************* 2025-12-01 11:09:40.585438 | controller | Monday 01 December 2025 11:09:38 +0000 (0:00:00.046) 0:04:18.537 ******* 2025-12-01 11:09:40.585454 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:41.477466 | controller | 2025-12-01 11:09:41.477500 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] ********************* 2025-12-01 11:09:41.477508 | controller | Monday 01 December 2025 11:09:40 +0000 (0:00:01.692) 0:04:20.230 ******* 2025-12-01 11:09:41.477518 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:41.536648 | controller | 2025-12-01 11:09:41.536692 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] ******************* 2025-12-01 11:09:41.536703 | controller | Monday 01 December 2025 11:09:41 +0000 (0:00:00.892) 0:04:21.122 ******* 2025-12-01 11:09:41.536731 | controller | skipping: [instance] 2025-12-01 11:09:41.586073 | controller | 2025-12-01 11:09:41.586099 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] ******************* 2025-12-01 11:09:41.586108 | controller | Monday 01 December 2025 11:09:41 +0000 (0:00:00.059) 0:04:21.181 ******* 2025-12-01 11:09:41.586118 | controller | skipping: [instance] 2025-12-01 11:09:41.638217 | controller | 2025-12-01 11:09:41.638243 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] *** 2025-12-01 11:09:41.638251 | controller | Monday 01 December 2025 11:09:41 +0000 (0:00:00.049) 0:04:21.231 ******* 2025-12-01 11:09:41.638260 | controller | skipping: [instance] 2025-12-01 11:09:52.790543 | controller | 2025-12-01 11:09:52.790586 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ******************** 2025-12-01 11:09:52.790595 | controller | Monday 01 December 2025 11:09:41 +0000 (0:00:00.051) 0:04:21.283 ******* 2025-12-01 11:09:52.790606 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:54.288168 | controller | 2025-12-01 11:09:54.288212 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] ************** 2025-12-01 11:09:54.288221 | controller | Monday 01 December 2025 11:09:52 +0000 (0:00:11.151) 0:04:32.435 ******* 2025-12-01 11:09:54.288233 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:54.288512 | controller | 2025-12-01 11:09:54.288526 | controller | TASK [reproducer : Ensure directories exist] *********************************** 2025-12-01 11:09:55.591109 | controller | Monday 01 December 2025 11:09:54 +0000 (0:00:01.497) 0:04:33.933 ******* 2025-12-01 11:09:55.591194 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters) 2025-12-01 11:09:55.632082 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts) 2025-12-01 11:09:55.632112 | controller | 2025-12-01 11:09:55.632121 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] ************* 2025-12-01 11:09:55.632137 | controller | Monday 01 December 2025 11:09:55 +0000 (0:00:01.302) 0:04:35.235 ******* 2025-12-01 11:09:55.632148 | controller | skipping: [instance] 2025-12-01 11:09:56.348804 | controller | 2025-12-01 11:09:56.348868 | controller | TASK [reproducer : Check if baremetal-info.yml exists] ************************* 2025-12-01 11:09:56.348878 | controller | Monday 01 December 2025 11:09:55 +0000 (0:00:00.041) 0:04:35.277 ******* 2025-12-01 11:09:56.348893 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:56.388817 | controller | 2025-12-01 11:09:56.388873 | controller | TASK [reproducer : Get content of baremetal-info file] ************************* 2025-12-01 11:09:56.388886 | controller | Monday 01 December 2025 11:09:56 +0000 (0:00:00.716) 0:04:35.993 ******* 2025-12-01 11:09:56.388902 | controller | skipping: [instance] 2025-12-01 11:09:56.432712 | controller | 2025-12-01 11:09:56.432757 | controller | TASK [reproducer : Interpret remote file content as yaml] ********************** 2025-12-01 11:09:56.432779 | controller | Monday 01 December 2025 11:09:56 +0000 (0:00:00.040) 0:04:36.033 ******* 2025-12-01 11:09:56.432791 | controller | skipping: [instance] 2025-12-01 11:09:56.478052 | controller | 2025-12-01 11:09:56.478097 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-12-01 11:09:56.478107 | controller | Monday 01 December 2025 11:09:56 +0000 (0:00:00.044) 0:04:36.077 ******* 2025-12-01 11:09:56.478119 | controller | skipping: [instance] 2025-12-01 11:09:56.516352 | controller | 2025-12-01 11:09:56.516381 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] *** 2025-12-01 11:09:56.516391 | controller | Monday 01 December 2025 11:09:56 +0000 (0:00:00.045) 0:04:36.123 ******* 2025-12-01 11:09:56.516404 | controller | skipping: [instance] 2025-12-01 11:09:56.650288 | controller | 2025-12-01 11:09:56.650312 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] ***************** 2025-12-01 11:09:56.650320 | controller | Monday 01 December 2025 11:09:56 +0000 (0:00:00.038) 0:04:36.161 ******* 2025-12-01 11:09:56.650331 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '06ec68da-8ea6-4c5b-a5da-561ae984cb6a'}) 2025-12-01 11:09:57.952240 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '38fd879c-0f9c-4fe8-b373-47f62f3ba462'}) 2025-12-01 11:09:57.952539 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '87647e6f-bf72-4fe3-be76-2fc4f170480b'}) 2025-12-01 11:09:57.952553 | controller | 2025-12-01 11:09:57.952560 | controller | TASK [reproducer : Output baremetal info file] ********************************* 2025-12-01 11:09:57.952567 | controller | Monday 01 December 2025 11:09:56 +0000 (0:00:00.133) 0:04:36.295 ******* 2025-12-01 11:09:57.952583 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:57.994816 | controller | 2025-12-01 11:09:57.994860 | controller | TASK [reproducer : Output ironic_nodes to file] ******************************** 2025-12-01 11:09:57.994870 | controller | Monday 01 December 2025 11:09:57 +0000 (0:00:01.300) 0:04:37.595 ******* 2025-12-01 11:09:57.994884 | controller | skipping: [instance] 2025-12-01 11:09:58.136275 | controller | 2025-12-01 11:09:58.136340 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] ******************* 2025-12-01 11:09:58.136349 | controller | Monday 01 December 2025 11:09:57 +0000 (0:00:00.044) 0:04:37.639 ******* 2025-12-01 11:09:58.136364 | controller | 2025-12-01 11:09:58.191525 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] *** 2025-12-01 11:09:58.191569 | controller | Monday 01 December 2025 11:09:58 +0000 (0:00:00.141) 0:04:37.781 ******* 2025-12-01 11:09:58.191599 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:58.238311 | controller | 2025-12-01 11:09:58.238347 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-12-01 11:09:58.238356 | controller | Monday 01 December 2025 11:09:58 +0000 (0:00:00.055) 0:04:37.836 ******* 2025-12-01 11:09:58.238369 | controller | skipping: [instance] 2025-12-01 11:09:58.278243 | controller | 2025-12-01 11:09:58.278274 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] *** 2025-12-01 11:09:58.278282 | controller | Monday 01 December 2025 11:09:58 +0000 (0:00:00.046) 0:04:37.883 ******* 2025-12-01 11:09:58.278295 | controller | skipping: [instance] 2025-12-01 11:09:58.278438 | controller | 2025-12-01 11:09:58.278588 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] *** 2025-12-01 11:09:58.278767 | controller | Monday 01 December 2025 11:09:58 +0000 (0:00:00.040) 0:04:37.923 ******* 2025-12-01 11:09:59.832053 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:09:59.832438 | controller | 2025-12-01 11:09:59.832531 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] *** 2025-12-01 11:09:59.832693 | controller | Monday 01 December 2025 11:09:59 +0000 (0:00:01.552) 0:04:39.476 ******* 2025-12-01 11:10:05.266788 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=06ec68da-8ea6-4c5b-a5da-561ae984cb6a) 2025-12-01 11:10:05.364079 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=38fd879c-0f9c-4fe8-b373-47f62f3ba462) 2025-12-01 11:10:05.364127 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=87647e6f-bf72-4fe3-be76-2fc4f170480b) 2025-12-01 11:10:05.364136 | controller | 2025-12-01 11:10:05.364143 | controller | TASK [sushy_emulator : Verify baremetal VM power status] *********************** 2025-12-01 11:10:05.364164 | controller | Monday 01 December 2025 11:10:05 +0000 (0:00:05.434) 0:04:44.911 ******* 2025-12-01 11:10:05.364177 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0) 2025-12-01 11:10:05.585964 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0) 2025-12-01 11:10:05.586007 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0) 2025-12-01 11:10:05.586016 | controller | 2025-12-01 11:10:05.586022 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] ********** 2025-12-01 11:10:05.586028 | controller | Monday 01 December 2025 11:10:05 +0000 (0:00:00.097) 0:04:45.008 ******* 2025-12-01 11:10:05.586044 | controller | ok: [instance -> localhost] 2025-12-01 11:10:07.870052 | controller | 2025-12-01 11:10:07.870114 | controller | TASK [reproducer : Sync local repositories to other hosts if present] ********** 2025-12-01 11:10:07.870125 | controller | Monday 01 December 2025 11:10:05 +0000 (0:00:00.221) 0:04:45.230 ******* 2025-12-01 11:10:07.870138 | controller | changed: [instance -> localhost] => (item=controller-0) 2025-12-01 11:10:08.524634 | controller | 2025-12-01 11:10:08.524671 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] **** 2025-12-01 11:10:08.524679 | controller | Monday 01 December 2025 11:10:07 +0000 (0:00:02.284) 0:04:47.514 ******* 2025-12-01 11:10:08.524690 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:09.297525 | controller | 2025-12-01 11:10:09.297558 | controller | TASK [reproducer : Install ansible dependencies] ******************************* 2025-12-01 11:10:09.297567 | controller | Monday 01 December 2025 11:10:08 +0000 (0:00:00.654) 0:04:48.169 ******* 2025-12-01 11:10:09.297578 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:10.366382 | controller | 2025-12-01 11:10:10.366417 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] *** 2025-12-01 11:10:10.366425 | controller | Monday 01 December 2025 11:10:09 +0000 (0:00:00.772) 0:04:48.941 ******* 2025-12-01 11:10:10.366437 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:10.981765 | controller | 2025-12-01 11:10:10.981805 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] **** 2025-12-01 11:10:10.981814 | controller | Monday 01 December 2025 11:10:10 +0000 (0:00:01.069) 0:04:50.011 ******* 2025-12-01 11:10:10.981826 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:12.061492 | controller | 2025-12-01 11:10:12.061529 | controller | TASK [reproducer : Inject local environment parameters] ************************ 2025-12-01 11:10:12.061538 | controller | Monday 01 December 2025 11:10:10 +0000 (0:00:00.615) 0:04:50.626 ******* 2025-12-01 11:10:12.061548 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:12.697499 | controller | 2025-12-01 11:10:12.697542 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] *** 2025-12-01 11:10:12.697551 | controller | Monday 01 December 2025 11:10:12 +0000 (0:00:01.079) 0:04:51.706 ******* 2025-12-01 11:10:12.697562 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:12.697581 | controller | 2025-12-01 11:10:12.697657 | controller | TASK [reproducer : Get interfaces-info content] ******************************** 2025-12-01 11:10:12.697773 | controller | Monday 01 December 2025 11:10:12 +0000 (0:00:00.636) 0:04:52.342 ******* 2025-12-01 11:10:13.308742 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:13.308814 | controller | 2025-12-01 11:10:13.308964 | controller | TASK [reproducer : Wait for OCP nodes to be ready] ***************************** 2025-12-01 11:10:13.309135 | controller | Monday 01 December 2025 11:10:13 +0000 (0:00:00.611) 0:04:52.953 ******* 2025-12-01 11:10:14.724795 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-12-01 11:10:14.724885 | controller | 2025-12-01 11:10:14.725009 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ****** 2025-12-01 11:10:14.725144 | controller | Monday 01 December 2025 11:10:14 +0000 (0:00:01.416) 0:04:54.369 ******* 2025-12-01 11:10:14.762386 | controller | skipping: [instance] 2025-12-01 11:10:14.762465 | controller | 2025-12-01 11:10:14.762582 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************ 2025-12-01 11:10:14.762698 | controller | Monday 01 December 2025 11:10:14 +0000 (0:00:00.037) 0:04:54.407 ******* 2025-12-01 11:10:14.797140 | controller | skipping: [instance] 2025-12-01 11:10:14.797243 | controller | 2025-12-01 11:10:14.797253 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************ 2025-12-01 11:10:14.797263 | controller | Monday 01 December 2025 11:10:14 +0000 (0:00:00.034) 0:04:54.442 ******* 2025-12-01 11:10:14.832574 | controller | skipping: [instance] 2025-12-01 11:10:14.870078 | controller | 2025-12-01 11:10:14.870102 | controller | TASK [networking_mapper : Load the interfaces info from file] ****************** 2025-12-01 11:10:14.870110 | controller | Monday 01 December 2025 11:10:14 +0000 (0:00:00.035) 0:04:54.477 ******* 2025-12-01 11:10:14.870120 | controller | skipping: [instance] 2025-12-01 11:10:14.908353 | controller | 2025-12-01 11:10:14.908380 | controller | TASK [networking_mapper : Ensure local fact is empty] ************************** 2025-12-01 11:10:14.908389 | controller | Monday 01 December 2025 11:10:14 +0000 (0:00:00.037) 0:04:54.515 ******* 2025-12-01 11:10:14.908399 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:15.068001 | controller | 2025-12-01 11:10:15.068033 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] *** 2025-12-01 11:10:15.068042 | controller | Monday 01 December 2025 11:10:14 +0000 (0:00:00.038) 0:04:54.553 ******* 2025-12-01 11:10:15.068055 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}}) 2025-12-01 11:10:15.118893 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={}) 2025-12-01 11:10:15.118915 | controller | 2025-12-01 11:10:15.118922 | controller | TASK [networking_mapper : Gather facts if requested] *************************** 2025-12-01 11:10:15.118931 | controller | Monday 01 December 2025 11:10:15 +0000 (0:00:00.159) 0:04:54.712 ******* 2025-12-01 11:10:15.118946 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance 2025-12-01 11:10:18.527201 | controller | 2025-12-01 11:10:18.527255 | controller | TASK [networking_mapper : Gather the facts] ************************************ 2025-12-01 11:10:18.527264 | controller | Monday 01 December 2025 11:10:15 +0000 (0:00:00.051) 0:04:54.764 ******* 2025-12-01 11:10:18.527279 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0) 2025-12-01 11:10:18.527499 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0) 2025-12-01 11:10:18.527538 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0) 2025-12-01 11:10:18.527546 | controller | 2025-12-01 11:10:18.527559 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] *** 2025-12-01 11:10:19.595190 | controller | Monday 01 December 2025 11:10:18 +0000 (0:00:03.408) 0:04:58.172 ******* 2025-12-01 11:10:19.595233 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:19.595273 | controller | 2025-12-01 11:10:19.595338 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] ***************** 2025-12-01 11:10:19.595442 | controller | Monday 01 December 2025 11:10:19 +0000 (0:00:01.068) 0:04:59.240 ******* 2025-12-01 11:10:20.076944 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:20.077005 | controller | 2025-12-01 11:10:20.077135 | controller | TASK [networking_mapper : Write the Networking Definition to file] ************* 2025-12-01 11:10:20.077244 | controller | Monday 01 December 2025 11:10:20 +0000 (0:00:00.481) 0:04:59.722 ******* 2025-12-01 11:10:21.066187 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:21.147450 | controller | 2025-12-01 11:10:21.147485 | controller | TASK [networking_mapper : Call the networking mapper] ************************** 2025-12-01 11:10:21.147494 | controller | Monday 01 December 2025 11:10:21 +0000 (0:00:00.988) 0:05:00.711 ******* 2025-12-01 11:10:21.147504 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:21.202513 | controller | 2025-12-01 11:10:21.202548 | controller | TASK [networking_mapper : Set networking mapper facts] ************************* 2025-12-01 11:10:21.202556 | controller | Monday 01 December 2025 11:10:21 +0000 (0:00:00.081) 0:05:00.792 ******* 2025-12-01 11:10:21.202566 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:22.201011 | controller | 2025-12-01 11:10:22.201045 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] *** 2025-12-01 11:10:22.201053 | controller | Monday 01 December 2025 11:10:21 +0000 (0:00:00.055) 0:05:00.847 ******* 2025-12-01 11:10:22.201084 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:23.240407 | controller | 2025-12-01 11:10:23.240440 | controller | TASK [reproducer : Inject CRC ssh key] ***************************************** 2025-12-01 11:10:23.240449 | controller | Monday 01 December 2025 11:10:22 +0000 (0:00:00.996) 0:05:01.844 ******* 2025-12-01 11:10:23.240459 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:29.250426 | controller | 2025-12-01 11:10:29.250459 | controller | TASK [reproducer : Ensure we have all dependencies installed] ****************** 2025-12-01 11:10:29.250468 | controller | Monday 01 December 2025 11:10:23 +0000 (0:00:01.040) 0:05:02.885 ******* 2025-12-01 11:10:29.250478 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left). 2025-12-01 11:10:29.462116 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:29.462158 | controller | 2025-12-01 11:10:29.462167 | controller | TASK [Configure ntp service] *************************************************** 2025-12-01 11:10:29.462173 | controller | Monday 01 December 2025 11:10:29 +0000 (0:00:06.009) 0:05:08.895 ******* 2025-12-01 11:10:29.462183 | controller | 2025-12-01 11:10:30.446657 | controller | TASK [cifmw_ntp : Install chrony] ********************************************** 2025-12-01 11:10:30.446695 | controller | Monday 01 December 2025 11:10:29 +0000 (0:00:00.211) 0:05:09.106 ******* 2025-12-01 11:10:30.446715 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:31.479441 | controller | 2025-12-01 11:10:31.479479 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] ************************* 2025-12-01 11:10:31.479487 | controller | Monday 01 December 2025 11:10:30 +0000 (0:00:00.984) 0:05:10.091 ******* 2025-12-01 11:10:31.479498 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True}) 2025-12-01 11:10:32.438522 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'}) 2025-12-01 11:10:32.438556 | controller | 2025-12-01 11:10:32.438564 | controller | TASK [cifmw_ntp : Render chrony extra config file] ***************************** 2025-12-01 11:10:32.438570 | controller | Monday 01 December 2025 11:10:31 +0000 (0:00:01.032) 0:05:11.124 ******* 2025-12-01 11:10:32.438580 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:33.120189 | controller | 2025-12-01 11:10:33.120228 | controller | TASK [cifmw_ntp : Enable chrony service] *************************************** 2025-12-01 11:10:33.120236 | controller | Monday 01 December 2025 11:10:32 +0000 (0:00:00.959) 0:05:12.083 ******* 2025-12-01 11:10:33.120247 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:33.294614 | controller | 2025-12-01 11:10:33.294642 | controller | TASK [reproducer : Configure CRC node if available] **************************** 2025-12-01 11:10:33.294651 | controller | Monday 01 December 2025 11:10:33 +0000 (0:00:00.681) 0:05:12.764 ******* 2025-12-01 11:10:33.294668 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance 2025-12-01 11:10:33.779487 | controller | 2025-12-01 11:10:33.779523 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] *** 2025-12-01 11:10:33.779532 | controller | Monday 01 December 2025 11:10:33 +0000 (0:00:00.174) 0:05:12.939 ******* 2025-12-01 11:10:33.779542 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:34.300384 | controller | 2025-12-01 11:10:34.300426 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ******************** 2025-12-01 11:10:34.300435 | controller | Monday 01 December 2025 11:10:33 +0000 (0:00:00.485) 0:05:13.424 ******* 2025-12-01 11:10:34.300446 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-12-01 11:10:35.030732 | controller | 2025-12-01 11:10:35.030774 | controller | TASK [reproducer : Configure local DNS for CRC pod] **************************** 2025-12-01 11:10:35.030782 | controller | Monday 01 December 2025 11:10:34 +0000 (0:00:00.520) 0:05:13.944 ******* 2025-12-01 11:10:35.030792 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-01 11:10:35.632560 | controller | 2025-12-01 11:10:35.632594 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] *************** 2025-12-01 11:10:35.632603 | controller | Monday 01 December 2025 11:10:35 +0000 (0:00:00.730) 0:05:14.675 ******* 2025-12-01 11:10:35.632613 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-01 11:10:35.684519 | controller | 2025-12-01 11:10:35.684544 | controller | TASK [Restart DNS in CRC VM] *************************************************** 2025-12-01 11:10:35.684552 | controller | Monday 01 December 2025 11:10:35 +0000 (0:00:00.601) 0:05:15.277 ******* 2025-12-01 11:10:35.684562 | controller | 2025-12-01 11:10:36.199517 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] *************** 2025-12-01 11:10:36.199550 | controller | Monday 01 December 2025 11:10:35 +0000 (0:00:00.052) 0:05:15.329 ******* 2025-12-01 11:10:36.199563 | controller | ok: [instance -> crc-0(crc-0.instance)] 2025-12-01 11:10:37.018604 | controller | 2025-12-01 11:10:37.018637 | controller | TASK [openshift_setup : Restart dnsmasq service if used] *********************** 2025-12-01 11:10:37.018645 | controller | Monday 01 December 2025 11:10:36 +0000 (0:00:00.514) 0:05:15.844 ******* 2025-12-01 11:10:37.018656 | controller | changed: [instance -> crc-0(crc-0.instance)] 2025-12-01 11:10:37.048127 | controller | 2025-12-01 11:10:37.048154 | controller | TASK [openshift_setup : Stop dnsmasq] ****************************************** 2025-12-01 11:10:37.048162 | controller | Monday 01 December 2025 11:10:37 +0000 (0:00:00.819) 0:05:16.663 ******* 2025-12-01 11:10:37.048179 | controller | skipping: [instance] 2025-12-01 11:10:37.048392 | controller | 2025-12-01 11:10:37.048406 | controller | TASK [openshift_setup : Start dnsmasq] ***************************************** 2025-12-01 11:10:37.087574 | controller | Monday 01 December 2025 11:10:37 +0000 (0:00:00.030) 0:05:16.693 ******* 2025-12-01 11:10:37.087599 | controller | skipping: [instance] 2025-12-01 11:10:37.335470 | controller | 2025-12-01 11:10:37.335503 | controller | TASK [reproducer : Remove entry from /etc/hosts] ******************************* 2025-12-01 11:10:37.335511 | controller | Monday 01 December 2025 11:10:37 +0000 (0:00:00.039) 0:05:16.732 ******* 2025-12-01 11:10:37.335521 | controller | changed: [instance] 2025-12-01 11:10:37.427375 | controller | 2025-12-01 11:10:37.427399 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] ********************** 2025-12-01 11:10:37.427407 | controller | Monday 01 December 2025 11:10:37 +0000 (0:00:00.247) 0:05:16.980 ******* 2025-12-01 11:10:37.427417 | controller | skipping: [instance] => (item=) 2025-12-01 11:10:37.466077 | controller | 2025-12-01 11:10:37.466118 | controller | TASK [dnsmasq : Assert we have needed address data] **************************** 2025-12-01 11:10:37.466128 | controller | Monday 01 December 2025 11:10:37 +0000 (0:00:00.092) 0:05:17.072 ******* 2025-12-01 11:10:37.466140 | controller | ok: [instance] 2025-12-01 11:10:37.547357 | controller | 2025-12-01 11:10:37.547391 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-01 11:10:37.547401 | controller | Monday 01 December 2025 11:10:37 +0000 (0:00:00.038) 0:05:17.110 ******* 2025-12-01 11:10:37.547413 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-12-01 11:10:37.844419 | controller | 2025-12-01 11:10:37.844468 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-01 11:10:37.844477 | controller | Monday 01 December 2025 11:10:37 +0000 (0:00:00.081) 0:05:17.192 ******* 2025-12-01 11:10:37.844492 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'}) 2025-12-01 11:10:37.891906 | controller | 2025-12-01 11:10:37.891937 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************ 2025-12-01 11:10:37.891946 | controller | Monday 01 December 2025 11:10:37 +0000 (0:00:00.296) 0:05:17.489 ******* 2025-12-01 11:10:37.891957 | controller | 2025-12-01 11:10:37.968337 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************ 2025-12-01 11:10:37.968387 | controller | Monday 01 December 2025 11:10:37 +0000 (0:00:00.047) 0:05:17.537 ******* 2025-12-01 11:10:37.968408 | controller | ok: [instance] 2025-12-01 11:10:38.039676 | controller | 2025-12-01 11:10:38.039705 | controller | TASK [dnsmasq : Assert each address element have needed data] ****************** 2025-12-01 11:10:38.039713 | controller | Monday 01 December 2025 11:10:37 +0000 (0:00:00.076) 0:05:17.613 ******* 2025-12-01 11:10:38.039725 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-12-01 11:10:38.374421 | controller | 2025-12-01 11:10:38.374465 | controller | TASK [dnsmasq : Add/Remove address] ******************************************** 2025-12-01 11:10:38.374473 | controller | Monday 01 December 2025 11:10:38 +0000 (0:00:00.071) 0:05:17.684 ******* 2025-12-01 11:10:38.374485 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'}) 2025-12-01 11:10:38.834793 | controller | 2025-12-01 11:10:38.834851 | controller | TASK [reproducer : Ensure "testing" domain is "local"] ************************* 2025-12-01 11:10:38.834860 | controller | Monday 01 December 2025 11:10:38 +0000 (0:00:00.334) 0:05:18.019 ******* 2025-12-01 11:10:38.834874 | controller | changed: [instance] 2025-12-01 11:10:39.662262 | controller | 2025-12-01 11:10:39.662307 | controller | TASK [reproducer : Flush handlers] ********************************************* 2025-12-01 11:10:39.662316 | controller | Monday 01 December 2025 11:10:38 +0000 (0:00:00.442) 0:05:18.461 ******* 2025-12-01 11:10:39.662322 | controller | 2025-12-01 11:10:39.662328 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] *********************************** 2025-12-01 11:10:39.662343 | controller | Monday 01 December 2025 11:10:38 +0000 (0:00:00.012) 0:05:18.473 ******* 2025-12-01 11:10:39.662355 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:40.107013 | controller | 2025-12-01 11:10:40.107087 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************ 2025-12-01 11:10:40.107102 | controller | Monday 01 December 2025 11:10:39 +0000 (0:00:00.833) 0:05:19.306 ******* 2025-12-01 11:10:40.107117 | controller | changed: [instance] 2025-12-01 11:10:40.299119 | controller | 2025-12-01 11:10:40.299166 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] **************** 2025-12-01 11:10:40.299175 | controller | Monday 01 December 2025 11:10:40 +0000 (0:00:00.444) 0:05:19.751 ******* 2025-12-01 11:10:40.299189 | controller | skipping: [instance] => (item=controller-0) 2025-12-01 11:10:41.852904 | controller | skipping: [instance] => (item=crc-0) 2025-12-01 11:10:41.852949 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0) 2025-12-01 11:10:41.852958 | controller | 2025-12-01 11:10:41.852964 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] ************** 2025-12-01 11:10:41.852971 | controller | Monday 01 December 2025 11:10:40 +0000 (0:00:00.192) 0:05:19.943 ******* 2025-12-01 11:10:41.852984 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-12-01 11:10:41.852990 | controller | 2025-12-01 11:10:41.852996 | controller | TASK [reproducer : Tweak dnf configuration] ************************************ 2025-12-01 11:10:41.853014 | controller | Monday 01 December 2025 11:10:41 +0000 (0:00:01.554) 0:05:21.497 ******* 2025-12-01 11:10:41.877665 | controller | skipping: [instance] 2025-12-01 11:10:42.447235 | controller | 2025-12-01 11:10:42.447280 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-01 11:10:42.447290 | controller | Monday 01 December 2025 11:10:41 +0000 (0:00:00.024) 0:05:21.522 ******* 2025-12-01 11:10:42.447304 | controller | ok: [instance -> compute-0(compute-0.instance)] 2025-12-01 11:10:42.447342 | controller | 2025-12-01 11:10:42.447352 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-01 11:10:42.447502 | controller | Monday 01 December 2025 11:10:42 +0000 (0:00:00.569) 0:05:22.092 ******* 2025-12-01 11:10:42.484833 | controller | skipping: [instance] 2025-12-01 11:10:42.524561 | controller | 2025-12-01 11:10:42.524606 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-01 11:10:42.524615 | controller | Monday 01 December 2025 11:10:42 +0000 (0:00:00.037) 0:05:22.129 ******* 2025-12-01 11:10:42.524626 | controller | skipping: [instance] 2025-12-01 11:10:42.565101 | controller | 2025-12-01 11:10:42.565134 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-01 11:10:42.565142 | controller | Monday 01 December 2025 11:10:42 +0000 (0:00:00.039) 0:05:22.169 ******* 2025-12-01 11:10:42.565153 | controller | skipping: [instance] 2025-12-01 11:10:44.150348 | controller | 2025-12-01 11:10:44.150391 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-01 11:10:44.150400 | controller | Monday 01 December 2025 11:10:42 +0000 (0:00:00.039) 0:05:22.209 ******* 2025-12-01 11:10:44.150411 | controller | changed: [instance -> compute-0(compute-0.instance)] 2025-12-01 11:10:44.150480 | controller | 2025-12-01 11:10:44.150516 | controller | TASK [reproducer : Get rhos-release and setup repos] *************************** 2025-12-01 11:10:44.150652 | controller | Monday 01 December 2025 11:10:44 +0000 (0:00:01.585) 0:05:23.795 ******* 2025-12-01 11:10:44.186122 | controller | skipping: [instance] 2025-12-01 11:10:44.186227 | controller | 2025-12-01 11:10:44.186370 | controller | TASK [reproducer : Create repositories on computes] **************************** 2025-12-01 11:10:44.186469 | controller | Monday 01 December 2025 11:10:44 +0000 (0:00:00.036) 0:05:23.831 ******* 2025-12-01 11:10:44.206882 | controller | skipping: [instance] 2025-12-01 11:10:44.206988 | controller | 2025-12-01 11:10:44.207122 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] ********************* 2025-12-01 11:10:44.207233 | controller | Monday 01 December 2025 11:10:44 +0000 (0:00:00.020) 0:05:23.852 ******* 2025-12-01 11:10:44.236201 | controller | skipping: [instance] 2025-12-01 11:10:44.236308 | controller | 2025-12-01 11:10:44.236435 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] ******* 2025-12-01 11:10:44.236567 | controller | Monday 01 December 2025 11:10:44 +0000 (0:00:00.029) 0:05:23.881 ******* 2025-12-01 11:10:44.293883 | controller | ok: [instance] 2025-12-01 11:10:44.293985 | controller | 2025-12-01 11:10:44.294162 | controller | TASK [reproducer : Push local code] ******************************************** 2025-12-01 11:10:44.294264 | controller | Monday 01 December 2025 11:10:44 +0000 (0:00:00.057) 0:05:23.939 ******* 2025-12-01 11:10:44.395102 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance 2025-12-01 11:10:44.395289 | controller | 2025-12-01 11:10:44.395417 | controller | TASK [reproducer : Check if repository directories already exist] ************** 2025-12-01 11:10:44.395570 | controller | Monday 01 December 2025 11:10:44 +0000 (0:00:00.100) 0:05:24.040 ******* 2025-12-01 11:10:44.433287 | controller | skipping: [instance] 2025-12-01 11:10:44.433375 | controller | 2025-12-01 11:10:44.433486 | controller | TASK [reproducer : Ensure we are not in the job_id branch] ********************* 2025-12-01 11:10:44.433596 | controller | Monday 01 December 2025 11:10:44 +0000 (0:00:00.038) 0:05:24.078 ******* 2025-12-01 11:10:44.478974 | controller | skipping: [instance] 2025-12-01 11:10:44.479148 | controller | 2025-12-01 11:10:44.479261 | controller | TASK [reproducer : Fetch zuul.items repositories] ****************************** 2025-12-01 11:10:44.479416 | controller | Monday 01 December 2025 11:10:44 +0000 (0:00:00.045) 0:05:24.123 ******* 2025-12-01 11:10:44.518872 | controller | skipping: [instance] 2025-12-01 11:10:44.519087 | controller | 2025-12-01 11:10:44.519373 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] ********** 2025-12-01 11:10:44.563389 | controller | Monday 01 December 2025 11:10:44 +0000 (0:00:00.040) 0:05:24.164 ******* 2025-12-01 11:10:44.563423 | controller | skipping: [instance] 2025-12-01 11:10:44.563488 | controller | 2025-12-01 11:10:44.563606 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] *** 2025-12-01 11:10:44.563712 | controller | Monday 01 December 2025 11:10:44 +0000 (0:00:00.044) 0:05:24.208 ******* 2025-12-01 11:10:44.604830 | controller | skipping: [instance] 2025-12-01 11:10:44.604921 | controller | 2025-12-01 11:10:44.605048 | controller | TASK [reproducer : Create target directories beforehand] *********************** 2025-12-01 11:10:44.605177 | controller | Monday 01 December 2025 11:10:44 +0000 (0:00:00.041) 0:05:24.250 ******* 2025-12-01 11:10:45.163493 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators) 2025-12-01 11:10:45.163556 | controller | 2025-12-01 11:10:45.163691 | controller | TASK [reproducer : Sync local repositories to ansible controller] ************** 2025-12-01 11:10:45.163815 | controller | Monday 01 December 2025 11:10:45 +0000 (0:00:00.558) 0:05:24.808 ******* 2025-12-01 11:10:45.750418 | controller | ok: [instance -> localhost] => (item=ci-framework) 2025-12-01 11:10:45.750476 | controller | 2025-12-01 11:10:45.750591 | controller | TASK [reproducer : Sync remote repositories] *********************************** 2025-12-01 11:10:45.750686 | controller | Monday 01 December 2025 11:10:45 +0000 (0:00:00.586) 0:05:25.395 ******* 2025-12-01 11:10:45.795197 | controller | skipping: [instance] => (item=ci-framework) 2025-12-01 11:10:45.795298 | controller | skipping: [instance] 2025-12-01 11:10:45.795385 | controller | 2025-12-01 11:10:45.795497 | controller | TASK [reproducer : Ensure default repositories are present] ******************** 2025-12-01 11:10:45.795577 | controller | Monday 01 December 2025 11:10:45 +0000 (0:00:00.045) 0:05:25.440 ******* 2025-12-01 11:10:45.938292 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework) 2025-12-01 11:10:45.938397 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls) 2025-12-01 11:10:45.938484 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture) 2025-12-01 11:10:45.938586 | controller | 2025-12-01 11:10:45.938681 | controller | TASK [reproducer : Check repository availability: ci-framework] **************** 2025-12-01 11:10:45.938784 | controller | Monday 01 December 2025 11:10:45 +0000 (0:00:00.143) 0:05:25.583 ******* 2025-12-01 11:10:46.455545 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:46.455605 | controller | 2025-12-01 11:10:46.455740 | controller | TASK [reproducer : Clone repository if needed: ci-framework] ******************* 2025-12-01 11:10:46.455848 | controller | Monday 01 December 2025 11:10:46 +0000 (0:00:00.516) 0:05:26.100 ******* 2025-12-01 11:10:46.514327 | controller | skipping: [instance] 2025-12-01 11:10:46.514414 | controller | 2025-12-01 11:10:46.514513 | controller | TASK [reproducer : Check repository availability: install_yamls] *************** 2025-12-01 11:10:46.514623 | controller | Monday 01 December 2025 11:10:46 +0000 (0:00:00.059) 0:05:26.159 ******* 2025-12-01 11:10:47.011322 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:47.011427 | controller | 2025-12-01 11:10:47.011543 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ****************** 2025-12-01 11:10:47.011653 | controller | Monday 01 December 2025 11:10:47 +0000 (0:00:00.496) 0:05:26.656 ******* 2025-12-01 11:10:47.050921 | controller | skipping: [instance] 2025-12-01 11:10:47.051005 | controller | 2025-12-01 11:10:47.051183 | controller | TASK [reproducer : Check repository availability: architecture] **************** 2025-12-01 11:10:47.051276 | controller | Monday 01 December 2025 11:10:47 +0000 (0:00:00.039) 0:05:26.696 ******* 2025-12-01 11:10:47.512348 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:47.512749 | controller | 2025-12-01 11:10:49.818380 | controller | TASK [reproducer : Clone repository if needed: architecture] ******************* 2025-12-01 11:10:49.818440 | controller | Monday 01 December 2025 11:10:47 +0000 (0:00:00.460) 0:05:27.157 ******* 2025-12-01 11:10:49.818457 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:10:49.818545 | controller | 2025-12-01 11:10:49.818557 | controller | TASK [reproducer : Install collections on controller-0] ************************ 2025-12-01 11:10:49.818657 | controller | Monday 01 December 2025 11:10:49 +0000 (0:00:02.306) 0:05:29.463 ******* 2025-12-01 11:11:09.008348 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:11:09.008397 | controller | 2025-12-01 11:11:09.008535 | controller | TASK [reproducer : Inject CI Framework motd] *********************************** 2025-12-01 11:11:09.008655 | controller | Monday 01 December 2025 11:11:08 +0000 (0:00:19.183) 0:05:48.647 ******* 2025-12-01 11:11:10.011630 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:11:10.011957 | controller | 2025-12-01 11:11:10.119422 | controller | TASK [reproducer : Rotate some logs] ******************************************* 2025-12-01 11:11:10.119459 | controller | Monday 01 December 2025 11:11:10 +0000 (0:00:01.009) 0:05:49.657 ******* 2025-12-01 11:11:10.119473 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log) 2025-12-01 11:11:10.560800 | controller | 2025-12-01 11:11:10.560834 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] ********************* 2025-12-01 11:11:10.560842 | controller | Monday 01 December 2025 11:11:10 +0000 (0:00:00.107) 0:05:49.764 ******* 2025-12-01 11:11:10.560853 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:11:10.599570 | controller | 2025-12-01 11:11:10.599596 | controller | TASK [reproducer : Rotate log if present] ************************************** 2025-12-01 11:11:10.599604 | controller | Monday 01 December 2025 11:11:10 +0000 (0:00:00.440) 0:05:50.205 ******* 2025-12-01 11:11:10.599614 | controller | skipping: [instance] 2025-12-01 11:11:10.644728 | controller | 2025-12-01 11:11:10.644756 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] *********************** 2025-12-01 11:11:10.644766 | controller | Monday 01 December 2025 11:11:10 +0000 (0:00:00.039) 0:05:50.244 ******* 2025-12-01 11:11:10.644777 | controller | skipping: [instance] 2025-12-01 11:11:10.735191 | controller | 2025-12-01 11:11:10.735223 | controller | TASK [cifmw_setup : Get customized parameters] ********************************* 2025-12-01 11:11:10.735230 | controller | Monday 01 December 2025 11:11:10 +0000 (0:00:00.045) 0:05:50.289 ******* 2025-12-01 11:11:10.735240 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:11:10.735263 | controller | 2025-12-01 11:11:10.735270 | controller | TASK [install_ca : Ensure target directory exists] ***************************** 2025-12-01 11:11:10.735277 | controller | Monday 01 December 2025 11:11:10 +0000 (0:00:00.090) 0:05:50.380 ******* 2025-12-01 11:11:11.213217 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:11:11.213271 | controller | 2025-12-01 11:11:11.213412 | controller | TASK [install_ca : Install internal CA from url] ******************************* 2025-12-01 11:11:11.213506 | controller | Monday 01 December 2025 11:11:11 +0000 (0:00:00.478) 0:05:50.858 ******* 2025-12-01 11:11:11.252631 | controller | skipping: [instance] 2025-12-01 11:11:11.252736 | controller | 2025-12-01 11:11:11.252875 | controller | TASK [install_ca : Install custom CA bundle from inline] *********************** 2025-12-01 11:11:11.252982 | controller | Monday 01 December 2025 11:11:11 +0000 (0:00:00.039) 0:05:50.898 ******* 2025-12-01 11:11:11.293984 | controller | skipping: [instance] 2025-12-01 11:11:11.294077 | controller | 2025-12-01 11:11:11.294098 | controller | TASK [install_ca : Install custom CA bundle from file] ************************* 2025-12-01 11:11:11.294250 | controller | Monday 01 December 2025 11:11:11 +0000 (0:00:00.041) 0:05:50.939 ******* 2025-12-01 11:11:11.334450 | controller | skipping: [instance] 2025-12-01 11:11:12.764653 | controller | 2025-12-01 11:11:12.764685 | controller | TASK [install_ca : Update ca bundle] ******************************************* 2025-12-01 11:11:12.764693 | controller | Monday 01 December 2025 11:11:11 +0000 (0:00:00.040) 0:05:50.979 ******* 2025-12-01 11:11:12.764703 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:11:13.347623 | controller | 2025-12-01 11:11:13.347654 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ******** 2025-12-01 11:11:13.347667 | controller | Monday 01 December 2025 11:11:12 +0000 (0:00:01.429) 0:05:52.409 ******* 2025-12-01 11:11:13.347677 | controller | ok: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:11:14.318889 | controller | 2025-12-01 11:11:14.318923 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ****** 2025-12-01 11:11:14.318931 | controller | Monday 01 December 2025 11:11:13 +0000 (0:00:00.583) 0:05:52.992 ******* 2025-12-01 11:11:14.318942 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-01 11:11:14.999576 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None) 2025-12-01 11:11:14.999617 | controller | changed: [instance -> controller-0] 2025-12-01 11:11:14.999625 | controller | 2025-12-01 11:11:14.999641 | controller | TASK [repo_setup : Cleanup existing metadata] ********************************** 2025-12-01 11:11:14.999646 | controller | Monday 01 December 2025 11:11:14 +0000 (0:00:00.970) 0:05:53.963 ******* 2025-12-01 11:11:14.999658 | controller | changed: [instance -> controller-0(controller-0.instance)] 2025-12-01 11:11:14.999677 | controller | 2025-12-01 11:11:14.999774 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] ********* 2025-12-01 11:11:14.999934 | controller | Monday 01 December 2025 11:11:14 +0000 (0:00:00.681) 0:05:54.644 ******* 2025-12-01 11:11:15.483939 | controller | fatal: [instance -> controller-0(controller-0.instance)]: FAILED! => changed=false 2025-12-01 11:11:15.492751 | controller | censored: 'the output has been hidden due to the fact that ''no_log: true'' was specified for this result' 2025-12-01 11:11:15.492777 | controller | 2025-12-01 11:11:15.689730 | controller | TASK [Create dnsmasq dir] ****************************************************** 2025-12-01 11:11:15.689769 | controller | Monday 01 December 2025 11:11:15 +0000 (0:00:00.493) 0:05:55.138 ******* 2025-12-01 11:11:15.689784 | controller | changed: [instance] 2025-12-01 11:11:15.689814 | controller | 2025-12-01 11:11:15.689821 | controller | TASK [Get journalctl in a file] ************************************************ 2025-12-01 11:11:15.689829 | controller | Monday 01 December 2025 11:11:15 +0000 (0:00:00.196) 0:05:55.334 ******* 2025-12-01 11:11:15.904713 | controller | changed: [instance] 2025-12-01 11:11:15.904819 | controller | 2025-12-01 11:11:15.904952 | controller | TASK [Dump journalctl output] ************************************************** 2025-12-01 11:11:15.905050 | controller | Monday 01 December 2025 11:11:15 +0000 (0:00:00.215) 0:05:55.550 ******* 2025-12-01 11:11:16.285740 | controller | changed: [instance] 2025-12-01 11:11:16.285808 | controller | 2025-12-01 11:11:16.285937 | controller | TASK [Copy all dnsmasq config] ************************************************* 2025-12-01 11:11:16.286042 | controller | Monday 01 December 2025 11:11:16 +0000 (0:00:00.380) 0:05:55.931 ******* 2025-12-01 11:11:16.780319 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf) 2025-12-01 11:11:16.780370 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/) 2025-12-01 11:11:16.780381 | controller | 2025-12-01 11:11:16.780478 | controller | TASK [Create log directory] **************************************************** 2025-12-01 11:11:16.780579 | controller | Monday 01 December 2025 11:11:16 +0000 (0:00:00.494) 0:05:56.425 ******* 2025-12-01 11:11:16.981608 | controller | changed: [instance] 2025-12-01 11:11:16.981696 | controller | 2025-12-01 11:11:16.981814 | controller | TASK [Sync logs from controller-0] ********************************************* 2025-12-01 11:11:16.981967 | controller | Monday 01 December 2025 11:11:16 +0000 (0:00:00.201) 0:05:56.627 ******* 2025-12-01 11:11:17.846031 | controller | changed: [instance] 2025-12-01 11:11:17.846629 | controller | 2025-12-01 11:11:17.846683 | controller | PLAY RECAP ********************************************************************* 2025-12-01 11:11:17.846692 | controller | instance : ok=492 changed=182 unreachable=0 failed=1 skipped=183 rescued=0 ignored=0 2025-12-01 11:11:17.846698 | controller | 2025-12-01 11:11:17.846704 | controller | Monday 01 December 2025 11:11:17 +0000 (0:00:00.862) 0:05:57.490 ******* 2025-12-01 11:11:17.846712 | controller | =============================================================================== 2025-12-01 11:11:17.846735 | controller | reproducer : Check package install status ------------------------------ 56.16s 2025-12-01 11:11:17.846933 | controller | libvirt_manager : Download base image ---------------------------------- 21.55s 2025-12-01 11:11:17.847120 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.77s 2025-12-01 11:11:17.847136 | controller | reproducer : Install collections on controller-0 ----------------------- 19.18s 2025-12-01 11:11:17.847926 | controller | libvirt_manager : Install packages required for using KVM -------------- 11.89s 2025-12-01 11:11:17.847941 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 11.15s 2025-12-01 11:11:17.848560 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.01s 2025-12-01 11:11:17.848593 | controller | ci_nmstate : Install required packages on localhost --------------------- 6.00s 2025-12-01 11:11:17.848605 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 5.43s 2025-12-01 11:11:17.848612 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.89s 2025-12-01 11:11:17.848617 | controller | networking_mapper : Gather the facts ------------------------------------ 3.41s 2025-12-01 11:11:17.848624 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.26s 2025-12-01 11:11:17.848629 | controller | sushy_emulator : Install required packages ------------------------------ 3.15s 2025-12-01 11:11:17.848634 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.31s 2025-12-01 11:11:17.848644 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.28s 2025-12-01 11:11:17.962888 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s 2025-12-01 11:11:17.962920 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.06s 2025-12-01 11:11:17.962928 | controller | discover_latest_image : Get latest image -------------------------------- 1.84s 2025-12-01 11:11:17.962933 | controller | reproducer : Inject SSH configuration ----------------------------------- 1.81s 2025-12-01 11:11:17.962939 | controller | ci_nmstate : Apply the desidered state on instance ---------------------- 1.71s 2025-12-01 11:11:17.962955 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml'] 2025-12-01 11:11:17.963462 | controller | WARNING An error occurred during the test sequence action: 'converge'. Cleaning up. 2025-12-01 11:11:17.972209 | controller | INFO Running crc_layout > cleanup 2025-12-01 11:11:17.972671 | controller | WARNING Skipping, cleanup playbook not configured. 2025-12-01 11:11:17.980370 | controller | INFO Running crc_layout > destroy 2025-12-01 11:11:17.980730 | controller | WARNING Skipping, instances are delegated. 2025-12-01 11:11:17.981082 | controller | INFO Pruning extra files from scenario ephemeral directory 2025-12-01 11:11:17.982827 | controller | INFO Writing /tmp/report.html report. 2025-12-01 11:11:18.465897 | [controller] Waiting on logger 2025-12-01 11:11:23.634480 | [controller] Waiting on logger 2025-12-01 11:11:34.066357 | [controller] Waiting on logger 2025-12-01 11:11:44.498416 | [controller] Waiting on logger 2025-12-01 11:11:48.077046 | [Zuul] Log Stream did not terminate 2025-12-01 11:11:48.077357 | controller | ERROR 2025-12-01 11:11:48.077491 | controller | { 2025-12-01 11:11:48.077524 | controller | "delta": "0:07:45.745533", 2025-12-01 11:11:48.077545 | controller | "end": "2025-12-01 11:11:18.046307", 2025-12-01 11:11:48.077563 | controller | "msg": "non-zero return code", 2025-12-01 11:11:48.077580 | controller | "rc": 1, 2025-12-01 11:11:48.077596 | controller | "start": "2025-12-01 11:03:32.300774" 2025-12-01 11:11:48.077612 | controller | } failure 2025-12-01 11:11:48.125231 | 2025-12-01 11:11:48.125284 | PLAY RECAP 2025-12-01 11:11:48.125323 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0 2025-12-01 11:11:48.125345 | 2025-12-01 11:11:48.191464 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main] 2025-12-01 11:11:48.192224 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-12-01 11:11:48.708281 | 2025-12-01 11:11:48.708416 | PLAY [Run ci/playbooks/collect-logs.yml] 2025-12-01 11:11:48.728418 | 2025-12-01 11:11:48.728491 | TASK [Filter out host if needed] 2025-12-01 11:11:48.736895 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2025-12-01 11:11:48.741458 | 2025-12-01 11:11:48.741526 | TASK [Ensure file is present] 2025-12-01 11:11:49.134497 | controller | ok 2025-12-01 11:11:49.141017 | 2025-12-01 11:11:49.141086 | TASK [Manage molecule report file] 2025-12-01 11:11:49.164522 | [controller] Waiting on logger 2025-12-01 11:11:58.550790 | [controller] Waiting on logger 2025-12-01 11:12:08.946434 | [controller] Waiting on logger 2025-12-01 11:12:19.378410 | [controller] Waiting on logger 2025-12-01 11:12:19.514024 | [Zuul] Log Stream did not terminate 2025-12-01 11:12:19.514145 | controller | changed 2025-12-01 11:12:19.519227 | 2025-12-01 11:12:19.519291 | TASK [Check if we get ci-framework-data basedir] 2025-12-01 11:12:19.771251 | controller | ok 2025-12-01 11:12:19.776226 | 2025-12-01 11:12:19.776289 | TASK [Create ci-framework-data log directory for zuul] 2025-12-01 11:12:20.128260 | controller | changed 2025-12-01 11:12:20.133275 | 2025-12-01 11:12:20.133339 | TASK [Copy ci-framework interesting files] 2025-12-01 11:12:25.159212 | controller | changed 2025-12-01 11:12:25.164445 | 2025-12-01 11:12:25.164508 | TASK [Get SELinux listing] 2025-12-01 11:12:25.186435 | [controller] Waiting on logger 2025-12-01 11:12:32.818495 | [controller] Waiting on logger 2025-12-01 11:12:46.899231 | [controller] Waiting on logger 2025-12-01 11:12:53.490620 | [controller] Waiting on logger 2025-12-01 11:12:55.434358 | [Zuul] Log Stream did not terminate 2025-12-01 11:12:55.434587 | controller | changed 2025-12-01 11:12:55.440515 | 2025-12-01 11:12:55.440582 | TASK [Generate log index] 2025-12-01 11:12:56.564080 | controller | changed 2025-12-01 11:12:56.569017 | 2025-12-01 11:12:56.569087 | TASK [Get some env related data] 2025-12-01 11:12:56.593234 | [controller] Waiting on logger 2025-12-01 11:13:09.042607 | [controller] Waiting on logger 2025-12-01 11:13:19.474425 | [controller] Waiting on logger 2025-12-01 11:13:27.755369 | [Zuul] Log Stream did not terminate 2025-12-01 11:13:27.755650 | controller | changed 2025-12-01 11:13:27.761202 | 2025-12-01 11:13:27.761262 | TASK [Generate list of logs to collect in home directory] 2025-12-01 11:13:28.146721 | controller | ok: All paths examined 2025-12-01 11:13:28.151944 | 2025-12-01 11:13:28.152005 | LOOP [Copy logs from home directory] 2025-12-01 11:13:28.693425 | controller | changed: 2025-12-01 11:13:28.693662 | controller | { 2025-12-01 11:13:28.693700 | controller | "atime": 1743544925.4788878, 2025-12-01 11:13:28.693727 | controller | "ctime": 1743545329.1409318, 2025-12-01 11:13:28.693751 | controller | "dev": 64513, 2025-12-01 11:13:28.693772 | controller | "gid": 1000, 2025-12-01 11:13:28.693792 | controller | "gr_name": "zuul", 2025-12-01 11:13:28.693811 | controller | "inode": 4518807, 2025-12-01 11:13:28.693831 | controller | "isblk": false, 2025-12-01 11:13:28.693960 | controller | "ischr": false, 2025-12-01 11:13:28.693998 | controller | "isdir": false, 2025-12-01 11:13:28.694019 | controller | "isfifo": false, 2025-12-01 11:13:28.694035 | controller | "isgid": false, 2025-12-01 11:13:28.694051 | controller | "islnk": false, 2025-12-01 11:13:28.694067 | controller | "isreg": true, 2025-12-01 11:13:28.694082 | controller | "issock": false, 2025-12-01 11:13:28.694097 | controller | "isuid": false, 2025-12-01 11:13:28.694114 | controller | "mode": "0644", 2025-12-01 11:13:28.694129 | controller | "mtime": 1743545329.1409318, 2025-12-01 11:13:28.694143 | controller | "nlink": 1, 2025-12-01 11:13:28.694157 | controller | "path": "/home/zuul/crc-setup.log", 2025-12-01 11:13:28.694171 | controller | "pw_name": "zuul", 2025-12-01 11:13:28.694184 | controller | "rgrp": true, 2025-12-01 11:13:28.694197 | controller | "roth": true, 2025-12-01 11:13:28.694210 | controller | "rusr": true, 2025-12-01 11:13:28.694224 | controller | "size": 4108, 2025-12-01 11:13:28.694238 | controller | "uid": 1000, 2025-12-01 11:13:28.694252 | controller | "wgrp": false, 2025-12-01 11:13:28.694266 | controller | "woth": false, 2025-12-01 11:13:28.694279 | controller | "wusr": true, 2025-12-01 11:13:28.694293 | controller | "xgrp": false, 2025-12-01 11:13:28.694305 | controller | "xoth": false, 2025-12-01 11:13:28.694318 | controller | "xusr": false 2025-12-01 11:13:28.694331 | controller | } 2025-12-01 11:13:28.818395 | [controller] Waiting on logger 2025-12-01 11:13:29.190628 | controller | changed: 2025-12-01 11:13:29.190726 | controller | { 2025-12-01 11:13:29.190751 | controller | "atime": 1743545331.0429637, 2025-12-01 11:13:29.190771 | controller | "ctime": 1743545842.0111232, 2025-12-01 11:13:29.190788 | controller | "dev": 64513, 2025-12-01 11:13:29.190805 | controller | "gid": 1000, 2025-12-01 11:13:29.190821 | controller | "gr_name": "zuul", 2025-12-01 11:13:29.190836 | controller | "inode": 4194437, 2025-12-01 11:13:29.190852 | controller | "isblk": false, 2025-12-01 11:13:29.190867 | controller | "ischr": false, 2025-12-01 11:13:29.190883 | controller | "isdir": false, 2025-12-01 11:13:29.190897 | controller | "isfifo": false, 2025-12-01 11:13:29.190933 | controller | "isgid": false, 2025-12-01 11:13:29.190954 | controller | "islnk": false, 2025-12-01 11:13:29.190970 | controller | "isreg": true, 2025-12-01 11:13:29.190985 | controller | "issock": false, 2025-12-01 11:13:29.191000 | controller | "isuid": false, 2025-12-01 11:13:29.191014 | controller | "mode": "0644", 2025-12-01 11:13:29.191028 | controller | "mtime": 1743545842.0111232, 2025-12-01 11:13:29.191044 | controller | "nlink": 1, 2025-12-01 11:13:29.191059 | controller | "path": "/home/zuul/crc-start.log", 2025-12-01 11:13:29.191074 | controller | "pw_name": "zuul", 2025-12-01 11:13:29.191088 | controller | "rgrp": true, 2025-12-01 11:13:29.191102 | controller | "roth": true, 2025-12-01 11:13:29.191116 | controller | "rusr": true, 2025-12-01 11:13:29.191130 | controller | "size": 4023, 2025-12-01 11:13:29.191144 | controller | "uid": 1000, 2025-12-01 11:13:29.191157 | controller | "wgrp": false, 2025-12-01 11:13:29.191170 | controller | "woth": false, 2025-12-01 11:13:29.191183 | controller | "wusr": true, 2025-12-01 11:13:29.191196 | controller | "xgrp": false, 2025-12-01 11:13:29.191208 | controller | "xoth": false, 2025-12-01 11:13:29.191221 | controller | "xusr": false 2025-12-01 11:13:29.191234 | controller | } 2025-12-01 11:13:29.715631 | controller | changed: 2025-12-01 11:13:29.715730 | controller | { 2025-12-01 11:13:29.715757 | controller | "atime": 1764586992.5074568, 2025-12-01 11:13:29.715776 | controller | "ctime": 1764587009.8035154, 2025-12-01 11:13:29.715792 | controller | "dev": 64513, 2025-12-01 11:13:29.715808 | controller | "gid": 1000, 2025-12-01 11:13:29.715824 | controller | "gr_name": "zuul", 2025-12-01 11:13:29.715839 | controller | "inode": 4233427, 2025-12-01 11:13:29.715859 | controller | "isblk": false, 2025-12-01 11:13:29.715875 | controller | "ischr": false, 2025-12-01 11:13:29.715891 | controller | "isdir": false, 2025-12-01 11:13:29.715924 | controller | "isfifo": false, 2025-12-01 11:13:29.715947 | controller | "isgid": false, 2025-12-01 11:13:29.715963 | controller | "islnk": false, 2025-12-01 11:13:29.715977 | controller | "isreg": true, 2025-12-01 11:13:29.715992 | controller | "issock": false, 2025-12-01 11:13:29.716006 | controller | "isuid": false, 2025-12-01 11:13:29.716019 | controller | "mode": "0644", 2025-12-01 11:13:29.716032 | controller | "mtime": 1764587009.8035154, 2025-12-01 11:13:29.716046 | controller | "nlink": 1, 2025-12-01 11:13:29.716060 | controller | "path": "/home/zuul/ansible.log", 2025-12-01 11:13:29.716074 | controller | "pw_name": "zuul", 2025-12-01 11:13:29.716088 | controller | "rgrp": true, 2025-12-01 11:13:29.716102 | controller | "roth": true, 2025-12-01 11:13:29.716115 | controller | "rusr": true, 2025-12-01 11:13:29.716129 | controller | "size": 6749, 2025-12-01 11:13:29.716143 | controller | "uid": 1000, 2025-12-01 11:13:29.716157 | controller | "wgrp": false, 2025-12-01 11:13:29.716171 | controller | "woth": false, 2025-12-01 11:13:29.716186 | controller | "wusr": true, 2025-12-01 11:13:29.716200 | controller | "xgrp": false, 2025-12-01 11:13:29.716214 | controller | "xoth": false, 2025-12-01 11:13:29.716227 | controller | "xusr": false 2025-12-01 11:13:29.716241 | controller | } 2025-12-01 11:13:29.727933 | 2025-12-01 11:13:29.728056 | TASK [Copy crio stats log file] 2025-12-01 11:13:29.741234 | controller | skipping: Conditional result was False 2025-12-01 11:13:29.746577 | 2025-12-01 11:13:29.746641 | TASK [Get SELinux related data] 2025-12-01 11:13:29.766967 | [controller] Waiting on logger 2025-12-01 11:13:47.468669 | [controller] Waiting on logger 2025-12-01 11:13:56.850343 | [controller] Waiting on logger 2025-12-01 11:14:00.048225 | [Zuul] Log Stream did not terminate 2025-12-01 11:14:00.048552 | controller | ERROR 2025-12-01 11:14:00.048671 | controller | { 2025-12-01 11:14:00.048711 | controller | "delta": "0:00:00.009437", 2025-12-01 11:14:00.048736 | controller | "end": "2025-12-01 11:13:30.028196", 2025-12-01 11:14:00.048756 | controller | "msg": "non-zero return code", 2025-12-01 11:14:00.048773 | controller | "rc": 1, 2025-12-01 11:14:00.048791 | controller | "start": "2025-12-01 11:13:30.018759" 2025-12-01 11:14:00.048806 | controller | } 2025-12-01 11:14:00.048830 | controller | ERROR: Ignoring Errors 2025-12-01 11:14:00.054152 | 2025-12-01 11:14:00.054210 | TASK [Create system configuration directory] 2025-12-01 11:14:00.296366 | controller | changed 2025-12-01 11:14:00.301395 | 2025-12-01 11:14:00.301460 | TASK [Get some of the system configurations] 2025-12-01 11:14:01.330385 | [controller] Waiting on logger 2025-12-01 11:14:14.514260 | [controller] Waiting on logger 2025-12-01 11:14:19.954713 | [controller] Waiting on logger 2025-12-01 11:14:30.604646 | [Zuul] Log Stream did not terminate 2025-12-01 11:14:30.604843 | controller | changed 2025-12-01 11:14:30.609874 | 2025-12-01 11:14:30.609958 | TASK [Copy generated documentation if available] 2025-12-01 11:14:30.624064 | controller | skipping: Conditional result was False 2025-12-01 11:14:30.629456 | 2025-12-01 11:14:30.629530 | TASK [Copy generated AsciiDoc documentation if available] 2025-12-01 11:14:30.642987 | controller | skipping: Conditional result was False 2025-12-01 11:14:30.647940 | 2025-12-01 11:14:30.648004 | TASK [Compress logs bigger than 2MB] 2025-12-01 11:14:30.667400 | [controller] Waiting on logger 2025-12-01 11:14:41.074509 | [controller] Waiting on logger 2025-12-01 11:14:51.506771 | [controller] Waiting on logger 2025-12-01 11:15:00.850449 | [controller] Waiting on logger 2025-12-01 11:15:00.957999 | [Zuul] Log Stream did not terminate 2025-12-01 11:15:00.958169 | controller | changed 2025-12-01 11:15:00.964299 | 2025-12-01 11:15:00.964384 | TASK [Copy files from workspace on node] 2025-12-01 11:15:00.983212 | controller | ok 2025-12-01 11:15:01.004762 | 2025-12-01 11:15:01.004831 | TASK [fetch-output : Set log path for multiple nodes] 2025-12-01 11:15:01.018334 | controller | skipping: Conditional result was False 2025-12-01 11:15:01.023982 | 2025-12-01 11:15:01.024048 | TASK [fetch-output : Set log path for single node] 2025-12-01 11:15:01.052516 | controller | ok 2025-12-01 11:15:01.057243 | 2025-12-01 11:15:01.057306 | LOOP [fetch-output : Ensure local output dirs] 2025-12-01 11:15:01.250250 | controller -> localhost | ok: "/var/lib/zuul/builds/88ba13a085da4704a580dd4e573ec413/work/logs" 2025-12-01 11:15:01.250495 | controller -> localhost | changed: All items complete 2025-12-01 11:15:01.250531 | 2025-12-01 11:15:01.428879 | controller -> localhost | changed: "/var/lib/zuul/builds/88ba13a085da4704a580dd4e573ec413/work/artifacts" 2025-12-01 11:15:01.603567 | controller -> localhost | changed: "/var/lib/zuul/builds/88ba13a085da4704a580dd4e573ec413/work/docs" 2025-12-01 11:15:01.614809 | 2025-12-01 11:15:01.614895 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-12-01 11:15:02.286752 | controller | changed: 2025-12-01 11:15:02.286971 | controller | .d..t...... ./ 2025-12-01 11:15:02.287003 | controller | >f+++++++++ README.html 2025-12-01 11:15:02.287024 | controller | >f+++++++++ ansible-execution.log 2025-12-01 11:15:02.287043 | controller | >f+++++++++ ansible.log 2025-12-01 11:15:02.287060 | controller | >f+++++++++ crc-setup.log 2025-12-01 11:15:02.287077 | controller | >f+++++++++ crc-start.log 2025-12-01 11:15:02.287093 | controller | >f+++++++++ dmesg.log 2025-12-01 11:15:02.287109 | controller | >f+++++++++ installed-pkgs.log 2025-12-01 11:15:02.287125 | controller | >f+++++++++ python.log 2025-12-01 11:15:02.287140 | controller | >f+++++++++ registries.conf 2025-12-01 11:15:02.287155 | controller | >f+++++++++ report.html 2025-12-01 11:15:02.287169 | controller | >f+++++++++ selinux-denials.log 2025-12-01 11:15:02.287183 | controller | >f+++++++++ selinux-listing.log 2025-12-01 11:15:02.287197 | controller | cd+++++++++ ci-framework-data/ 2025-12-01 11:15:02.287210 | controller | cd+++++++++ ci-framework-data/artifacts/ 2025-12-01 11:15:02.287225 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2025-12-01 11:15:02.287239 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/ 2025-12-01 11:15:02.287253 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf 2025-12-01 11:15:02.287267 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf 2025-12-01 11:15:02.287281 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf 2025-12-01 11:15:02.287295 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf 2025-12-01 11:15:02.287310 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf 2025-12-01 11:15:02.287325 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log 2025-12-01 11:15:02.287339 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf 2025-12-01 11:15:02.287353 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf 2025-12-01 11:15:02.287378 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf 2025-12-01 11:15:02.287393 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf 2025-12-01 11:15:02.287406 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/ 2025-12-01 11:15:02.287420 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:2d:1f:82 2025-12-01 11:15:02.287434 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:eb:c8:42 2025-12-01 11:15:02.287449 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:4c:38:df 2025-12-01 11:15:02.287464 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:6d:ef:15 2025-12-01 11:15:02.287483 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:a2:57:54 2025-12-01 11:15:02.287498 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:49:3e:1e 2025-12-01 11:15:02.287512 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2025-12-01 11:15:02.287526 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2025-12-01 11:15:02.287541 | controller | cd+++++++++ ci-framework-data/logs/ 2025-12-01 11:15:02.287555 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log 2025-12-01 11:15:02.287568 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ 2025-12-01 11:15:02.287582 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log 2025-12-01 11:15:02.287595 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/ 2025-12-01 11:15:02.287608 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/ 2025-12-01 11:15:02.287623 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml 2025-12-01 11:15:02.287640 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml 2025-12-01 11:15:02.287655 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/ 2025-12-01 11:15:02.287668 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd 2025-12-01 11:15:02.287682 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf 2025-12-01 11:15:02.287696 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts 2025-12-01 11:15:02.287710 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/ 2025-12-01 11:15:02.287724 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml 2025-12-01 11:15:02.287739 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml 2025-12-01 11:15:02.287753 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml 2025-12-01 11:15:02.287768 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml 2025-12-01 11:15:02.287781 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/ 2025-12-01 11:15:02.287795 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt 2025-12-01 11:15:02.287810 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/ 2025-12-01 11:15:02.287824 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd 2025-12-01 11:15:02.287838 | controller | cd+++++++++ registries.conf.d/ 2025-12-01 11:15:02.287852 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2025-12-01 11:15:02.287866 | controller | cd+++++++++ system-config/ 2025-12-01 11:15:02.287879 | controller | cd+++++++++ system-config/libvirt/ 2025-12-01 11:15:02.287893 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2025-12-01 11:15:02.287923 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2025-12-01 11:15:02.287946 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf 2025-12-01 11:15:02.287963 | controller | >f+++++++++ system-config/libvirt/network.conf 2025-12-01 11:15:02.287977 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf 2025-12-01 11:15:02.287991 | controller | >f+++++++++ system-config/libvirt/qemu.conf 2025-12-01 11:15:02.288005 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf 2025-12-01 11:15:02.288020 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf 2025-12-01 11:15:02.288037 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf 2025-12-01 11:15:02.288052 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf 2025-12-01 11:15:02.288065 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf 2025-12-01 11:15:02.288079 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf 2025-12-01 11:15:02.288092 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf 2025-12-01 11:15:02.288105 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf 2025-12-01 11:15:02.288118 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf 2025-12-01 11:15:02.288131 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf 2025-12-01 11:15:02.739565 | controller | changed: .d..t...... ./ 2025-12-01 11:15:03.182712 | controller | changed: .d..t...... ./ 2025-12-01 11:15:03.200002 | 2025-12-01 11:15:03.200067 | TASK [Return artifact to Zuul] 2025-12-01 11:15:03.227595 | controller | ok 2025-12-01 11:15:03.244191 | 2025-12-01 11:15:03.244243 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2025-12-01 11:15:03.244335 | 2025-12-01 11:15:03.244370 | PLAY RECAP 2025-12-01 11:15:03.244405 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1 2025-12-01 11:15:03.244426 | 2025-12-01 11:15:03.317750 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-12-01 11:15:03.318535 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-12-01 11:15:03.805850 | 2025-12-01 11:15:03.805958 | PLAY [all] 2025-12-01 11:15:03.822897 | 2025-12-01 11:15:03.822980 | TASK [include_role : fetch-output] 2025-12-01 11:15:03.850944 | controller | ok 2025-12-01 11:15:03.866963 | 2025-12-01 11:15:03.867048 | TASK [fetch-output : Set log path for multiple nodes] 2025-12-01 11:15:03.900230 | controller | skipping: Conditional result was False 2025-12-01 11:15:03.905486 | 2025-12-01 11:15:03.905555 | TASK [fetch-output : Set log path for single node] 2025-12-01 11:15:03.933006 | controller | ok 2025-12-01 11:15:03.937524 | 2025-12-01 11:15:03.937595 | LOOP [fetch-output : Ensure local output dirs] 2025-12-01 11:15:04.241102 | controller -> localhost | ok: "/var/lib/zuul/builds/88ba13a085da4704a580dd4e573ec413/work/logs" 2025-12-01 11:15:04.422962 | controller -> localhost | ok: "/var/lib/zuul/builds/88ba13a085da4704a580dd4e573ec413/work/artifacts" 2025-12-01 11:15:04.593819 | controller -> localhost | ok: "/var/lib/zuul/builds/88ba13a085da4704a580dd4e573ec413/work/docs" 2025-12-01 11:15:04.604387 | 2025-12-01 11:15:04.604457 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-12-01 11:15:05.201838 | controller | ok 2025-12-01 11:15:05.202061 | controller | ok: All items complete 2025-12-01 11:15:05.202093 | 2025-12-01 11:15:05.639551 | controller | ok 2025-12-01 11:15:06.108004 | controller | ok 2025-12-01 11:15:06.128393 | 2025-12-01 11:15:06.128509 | TASK [include_role : fetch-output-openshift] 2025-12-01 11:15:06.142629 | controller | skipping: Conditional result was False 2025-12-01 11:15:06.148455 | 2025-12-01 11:15:06.148527 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2025-12-01 11:15:06.480729 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.005888 2025-12-01 11:15:06.665551 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.006908 2025-12-01 11:15:06.692476 | 2025-12-01 11:15:06.692578 | PLAY [all] 2025-12-01 11:15:06.706124 | 2025-12-01 11:15:06.706195 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2025-12-01 11:15:07.191036 | controller | changed 2025-12-01 11:15:07.212428 | 2025-12-01 11:15:07.212493 | PLAY RECAP 2025-12-01 11:15:07.212537 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2025-12-01 11:15:07.212560 | 2025-12-01 11:15:07.283521 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master] 2025-12-01 11:15:07.284257 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master] 2025-12-01 11:15:07.832110 | 2025-12-01 11:15:07.832223 | PLAY [localhost] 2025-12-01 11:15:07.849389 | 2025-12-01 11:15:07.849469 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2025-12-01 11:15:08.150960 | localhost | changed 2025-12-01 11:15:08.155479 | 2025-12-01 11:15:08.155561 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2025-12-01 11:15:08.183311 | localhost | ok 2025-12-01 11:15:08.191185 | 2025-12-01 11:15:08.191255 | TASK [add-fileserver : Create SSH private key tempfile] 2025-12-01 11:15:08.483100 | localhost | changed 2025-12-01 11:15:08.488856 | 2025-12-01 11:15:08.488961 | TASK [add-fileserver : Create SSH private key from secret] 2025-12-01 11:15:09.003281 | localhost | changed 2025-12-01 11:15:09.008328 | 2025-12-01 11:15:09.008424 | TASK [add-fileserver : Add fileserver ssh key] 2025-12-01 11:15:09.319418 | localhost | Identity added: /var/lib/zuul/builds/88ba13a085da4704a580dd4e573ec413/work/tmp/ansible.trvzwt9s (/var/lib/zuul/builds/88ba13a085da4704a580dd4e573ec413/work/tmp/ansible.trvzwt9s) 2025-12-01 11:15:09.319609 | localhost | ok: Runtime: 0:00:00.006034 2025-12-01 11:15:09.323712 | 2025-12-01 11:15:09.323781 | TASK [add-fileserver : Remove SSH private key from disk] 2025-12-01 11:15:09.543396 | localhost | ok: Runtime: 0:00:00.004369 2025-12-01 11:15:09.547684 | 2025-12-01 11:15:09.547750 | TASK [add-fileserver : Add fileserver to inventory] 2025-12-01 11:15:09.595512 | localhost | changed 2025-12-01 11:15:09.600483 | 2025-12-01 11:15:09.600551 | TASK [add-fileserver : Add fileserver server to known hosts] 2025-12-01 11:15:09.901783 | localhost | changed 2025-12-01 11:15:09.920729 | 2025-12-01 11:15:09.920790 | PLAY [localhost] 2025-12-01 11:15:09.931987 | 2025-12-01 11:15:09.932052 | TASK [Generate bulk log download script] 2025-12-01 11:15:09.950197 | localhost | ok 2025-12-01 11:15:09.961487 | 2025-12-01 11:15:09.961556 | TASK [local-log-download : Check API endpoint is defined] 2025-12-01 11:15:09.988736 | localhost | ok: All assertions passed 2025-12-01 11:15:09.993114 | 2025-12-01 11:15:09.993185 | TASK [local-log-download : Create download script] 2025-12-01 11:15:10.330696 | localhost -> localhost | changed 2025-12-01 11:15:10.338579 | 2025-12-01 11:15:10.338638 | TASK [Register quick-download link] 2025-12-01 11:15:10.355299 | localhost | ok 2025-12-01 11:15:10.390853 | 2025-12-01 11:15:10.390948 | PLAY [logserver.rdoproject.org] 2025-12-01 11:15:10.400352 | 2025-12-01 11:15:10.400429 | TASK [Set zuul-log-path fact] 2025-12-01 11:15:10.416405 | logserver.rdoproject.org | ok 2025-12-01 11:15:10.425271 | 2025-12-01 11:15:10.425341 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-12-01 11:15:10.451381 | logserver.rdoproject.org | ok 2025-12-01 11:15:10.456620 | 2025-12-01 11:15:10.456687 | TASK [upload-logs : Create log directories] 2025-12-01 11:15:12.119765 | logserver.rdoproject.org | changed 2025-12-01 11:15:12.122654 | 2025-12-01 11:15:12.122714 | TASK [upload-logs : Ensure logs are readable before uploading] 2025-12-01 11:15:12.329532 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.005065 2025-12-01 11:15:12.334025 | 2025-12-01 11:15:12.334088 | TASK [upload-logs : Upload logs to log server] 2025-12-01 11:15:13.872231 | logserver.rdoproject.org | Output suppressed because no_log was given 2025-12-01 11:15:13.874970 | 2025-12-01 11:15:13.875031 | LOOP [upload-logs : Compress console log and json output] 2025-12-01 11:15:13.912647 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-01 11:15:13.920724 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-01 11:15:13.932215 | 2025-12-01 11:15:13.932279 | LOOP [upload-logs : Upload compressed console log and json output] 2025-12-01 11:15:13.965306 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-01 11:15:13.965520 | 2025-12-01 11:15:13.968652 | logserver.rdoproject.org | skipping: Conditional result was False 2025-12-01 11:15:13.979397 | 2025-12-01 11:15:13.979465 | LOOP [upload-logs : Upload console log and json output]