2025-12-03 10:46:13.799771 | Job console starting...
2025-12-03 10:46:14.036340 | Updating repositories
2025-12-03 10:46:14.798487 | Preparing job workspace
2025-12-03 10:46:22.618759 | Running Ansible setup...
2025-12-03 10:46:26.110393 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2025-12-03 10:46:26.581528 | 
2025-12-03 10:46:26.581628 | PLAY [localhost]
2025-12-03 10:46:26.589708 | 
2025-12-03 10:46:26.589792 | TASK [Gathering Facts]
2025-12-03 10:46:27.343244 | localhost | ok
2025-12-03 10:46:27.355819 | 
2025-12-03 10:46:27.355892 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2025-12-03 10:46:27.643430 | localhost -> localhost | changed
2025-12-03 10:46:27.648414 | 
2025-12-03 10:46:27.648481 | TASK [log-inventory : Copy ansible inventory to logs dir]
2025-12-03 10:46:28.299464 | localhost -> localhost | changed
2025-12-03 10:46:28.308250 | 
2025-12-03 10:46:28.308347 | TASK [Setup log path fact]
2025-12-03 10:46:28.325099 | localhost | ok
2025-12-03 10:46:28.335068 | 
2025-12-03 10:46:28.335128 | TASK [set-zuul-log-path-fact : Set log path for a build]
2025-12-03 10:46:28.352113 | localhost | ok
2025-12-03 10:46:28.361903 | 
2025-12-03 10:46:28.361982 | TASK [emit-job-header : Print job information]
2025-12-03 10:46:28.388541 | # Job Information
2025-12-03 10:46:28.388641 | Ansible Version: 2.15.12
2025-12-03 10:46:28.388668 | Job: cifmw-molecule-reproducer
2025-12-03 10:46:28.388688 | Pipeline: github-check
2025-12-03 10:46:28.388707 | Executor: ibm-bm4-ze.softwarefactory-project.io
2025-12-03 10:46:28.388733 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3505
2025-12-03 10:46:28.388753 | Log URL (when completed): https://logserver.rdoproject.org/448/rdoproject.org/448b5a8453c048dc8ef3fd38808b6ca9/
2025-12-03 10:46:28.388771 | Event ID: 27356460-d035-11f0-9350-febaaeb06b60
2025-12-03 10:46:28.392318 | 
2025-12-03 10:46:28.392377 | LOOP [emit-job-header : Print node information]
2025-12-03 10:46:28.470876 | localhost | ok:
2025-12-03 10:46:28.471103 | localhost | # Node Information
2025-12-03 10:46:28.471135 | localhost | Inventory Hostname: controller
2025-12-03 10:46:28.471163 | localhost | Hostname: np0005543615
2025-12-03 10:46:28.471183 | localhost | Username: zuul
2025-12-03 10:46:28.471202 | localhost | Distro: CentOS 9
2025-12-03 10:46:28.471219 | localhost | Provider: ibm-bm4-nodepool
2025-12-03 10:46:28.471235 | localhost | Region: regionOne
2025-12-03 10:46:28.471251 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm
2025-12-03 10:46:28.471267 | localhost | Product Name: OpenStack Compute
2025-12-03 10:46:28.471282 | localhost | Interface IP: 192.168.26.47
2025-12-03 10:46:28.493380 | 
2025-12-03 10:46:28.493446 | PLAY [all]
2025-12-03 10:46:28.499347 | 
2025-12-03 10:46:28.499405 | TASK [Gather network facts]
2025-12-03 10:46:28.904475 | controller | ok
2025-12-03 10:46:28.918749 | 
2025-12-03 10:46:28.918809 | TASK [include_role : start-zuul-console]
2025-12-03 10:46:28.935625 | controller | ok
2025-12-03 10:46:28.946777 | 
2025-12-03 10:46:28.946840 | TASK [start-zuul-console : Start zuul_console daemon.]
2025-12-03 10:46:29.318475 | controller | ok
2025-12-03 10:46:29.326812 | 
2025-12-03 10:46:29.326883 | TASK [include_role : add-build-sshkey]
2025-12-03 10:46:29.344432 | controller | ok
2025-12-03 10:46:29.355893 | 
2025-12-03 10:46:29.355984 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2025-12-03 10:46:29.531173 | controller -> localhost | ok
2025-12-03 10:46:29.536270 | 
2025-12-03 10:46:29.536333 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2025-12-03 10:46:29.554973 | controller | ok
2025-12-03 10:46:29.566542 | controller | included: /var/lib/zuul/builds/448b5a8453c048dc8ef3fd38808b6ca9/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2025-12-03 10:46:29.571527 | 
2025-12-03 10:46:29.571587 | TASK [add-build-sshkey : Create Temp SSH key]
2025-12-03 10:46:30.030274 | controller -> localhost | Generating public/private rsa key pair.
2025-12-03 10:46:30.030424 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/448b5a8453c048dc8ef3fd38808b6ca9/work/448b5a8453c048dc8ef3fd38808b6ca9_id_rsa.
2025-12-03 10:46:30.030455 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/448b5a8453c048dc8ef3fd38808b6ca9/work/448b5a8453c048dc8ef3fd38808b6ca9_id_rsa.pub.
2025-12-03 10:46:30.030477 | controller -> localhost | The key fingerprint is:
2025-12-03 10:46:30.030497 | controller -> localhost | SHA256:yeCelDyKX7ylszOaUngn+bRHTR7c6BOaRazNoYvogjc zuul-build-sshkey
2025-12-03 10:46:30.030516 | controller -> localhost | The key's randomart image is:
2025-12-03 10:46:30.030534 | controller -> localhost | +---[RSA 3072]----+
2025-12-03 10:46:30.030551 | controller -> localhost | |         .       |
2025-12-03 10:46:30.030568 | controller -> localhost | |          +      |
2025-12-03 10:46:30.030586 | controller -> localhost | |      .  B +     |
2025-12-03 10:46:30.030603 | controller -> localhost | |     o +o.X .    |
2025-12-03 10:46:30.030620 | controller -> localhost | |   . o*.SX o     |
2025-12-03 10:46:30.030636 | controller -> localhost | |  ..*=+o= =      |
2025-12-03 10:46:30.030652 | controller -> localhost | | ..+.==o.  .     |
2025-12-03 10:46:30.030668 | controller -> localhost | |. E..o*+.        |
2025-12-03 10:46:30.030685 | controller -> localhost | | . ++.+*         |
2025-12-03 10:46:30.030700 | controller -> localhost | +----[SHA256]-----+
2025-12-03 10:46:30.030751 | controller -> localhost | ok: Runtime: 0:00:00.152441
2025-12-03 10:46:30.035950 | 
2025-12-03 10:46:30.036007 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2025-12-03 10:46:30.052971 | controller | ok
2025-12-03 10:46:30.062091 | controller | included: /var/lib/zuul/builds/448b5a8453c048dc8ef3fd38808b6ca9/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2025-12-03 10:46:30.069128 | 
2025-12-03 10:46:30.069189 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2025-12-03 10:46:30.082431 | controller | skipping: Conditional result was False
2025-12-03 10:46:30.087482 | 
2025-12-03 10:46:30.087541 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2025-12-03 10:46:30.521956 | controller | changed
2025-12-03 10:46:30.526201 | 
2025-12-03 10:46:30.526260 | TASK [add-build-sshkey : Make sure user has a .ssh]
2025-12-03 10:46:30.777562 | controller | ok
2025-12-03 10:46:30.782280 | 
2025-12-03 10:46:30.782342 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2025-12-03 10:46:31.873433 | controller | changed
2025-12-03 10:46:31.878422 | 
2025-12-03 10:46:31.878494 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2025-12-03 10:46:32.940302 | controller | changed
2025-12-03 10:46:32.949780 | 
2025-12-03 10:46:32.949845 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2025-12-03 10:46:32.963426 | controller | skipping: Conditional result was False
2025-12-03 10:46:32.968433 | 
2025-12-03 10:46:32.968494 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2025-12-03 10:46:33.254531 | controller -> localhost | changed
2025-12-03 10:46:33.263409 | 
2025-12-03 10:46:33.263467 | TASK [add-build-sshkey : Add back temp key]
2025-12-03 10:46:33.468634 | controller -> localhost | Identity added: /var/lib/zuul/builds/448b5a8453c048dc8ef3fd38808b6ca9/work/448b5a8453c048dc8ef3fd38808b6ca9_id_rsa (zuul-build-sshkey)
2025-12-03 10:46:33.468789 | controller -> localhost | ok: Runtime: 0:00:00.006081
2025-12-03 10:46:33.473635 | 
2025-12-03 10:46:33.473691 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2025-12-03 10:46:33.814729 | controller | ok
2025-12-03 10:46:33.820234 | 
2025-12-03 10:46:33.820305 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2025-12-03 10:46:33.844054 | controller | skipping: Conditional result was False
2025-12-03 10:46:33.852454 | 
2025-12-03 10:46:33.852512 | TASK [include_role : validate-host]
2025-12-03 10:46:33.869845 | controller | ok
2025-12-03 10:46:33.886325 | 
2025-12-03 10:46:33.886385 | TASK [validate-host : Define zuul_info_dir fact]
2025-12-03 10:46:33.913540 | controller | ok
2025-12-03 10:46:33.917791 | 
2025-12-03 10:46:33.917852 | TASK [validate-host : Ensure Zuul Ansible directory exists]
2025-12-03 10:46:34.113018 | controller -> localhost | ok
2025-12-03 10:46:34.118292 | 
2025-12-03 10:46:34.118369 | TASK [validate-host : Collect information about the host]
2025-12-03 10:46:34.804427 | controller | ok
2025-12-03 10:46:34.811539 | 
2025-12-03 10:46:34.811594 | TASK [validate-host : Sanitize hostname]
2025-12-03 10:46:34.849109 | controller | ok
2025-12-03 10:46:34.853378 | 
2025-12-03 10:46:34.853446 | TASK [validate-host : Write out all ansible variables/facts known for each host]
2025-12-03 10:46:35.190551 | controller -> localhost | changed
2025-12-03 10:46:35.195605 | 
2025-12-03 10:46:35.195665 | TASK [validate-host : Collect information about zuul worker]
2025-12-03 10:46:35.555045 | controller | ok
2025-12-03 10:46:35.559490 | 
2025-12-03 10:46:35.559557 | TASK [validate-host : Write out all zuul information for each host]
2025-12-03 10:46:35.891435 | controller -> localhost | changed
2025-12-03 10:46:35.900645 | 
2025-12-03 10:46:35.900707 | TASK [include_role : prepare-workspace-openshift]
2025-12-03 10:46:35.913907 | controller | skipping: Conditional result was False
2025-12-03 10:46:35.918435 | 
2025-12-03 10:46:35.918494 | TASK [include_role : remove-zuul-sshkey]
2025-12-03 10:46:35.931512 | controller | skipping: Conditional result was False
2025-12-03 10:46:35.936025 | 
2025-12-03 10:46:35.936087 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2025-12-03 10:46:36.186855 | controller | ok: "logs"
2025-12-03 10:46:36.187101 | controller | ok: All items complete
2025-12-03 10:46:36.187135 | 
2025-12-03 10:46:36.415413 | controller | ok: "artifacts"
2025-12-03 10:46:36.643974 | controller | ok: "docs"
2025-12-03 10:46:36.656639 | 
2025-12-03 10:46:36.656737 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2025-12-03 10:46:36.900525 | controller | changed: "logs"
2025-12-03 10:46:37.131253 | controller | changed: "artifacts"
2025-12-03 10:46:37.363427 | controller | changed: "docs"
2025-12-03 10:46:37.394157 | 
2025-12-03 10:46:37.394243 | PLAY RECAP
2025-12-03 10:46:37.394287 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2025-12-03 10:46:37.394315 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2025-12-03 10:46:37.394335 | 
2025-12-03 10:46:37.467475 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2025-12-03 10:46:37.468188 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2025-12-03 10:46:37.974591 | 
2025-12-03 10:46:37.974706 | PLAY [all]
2025-12-03 10:46:37.993803 | 
2025-12-03 10:46:37.993879 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2025-12-03 10:46:38.042296 | controller | ok
2025-12-03 10:46:38.046815 | 
2025-12-03 10:46:38.046894 | TASK [mirror-info-fork : Create /etc/ci]
2025-12-03 10:46:38.409878 | controller | changed
2025-12-03 10:46:38.415298 | 
2025-12-03 10:46:38.415367 | TASK [mirror-info-fork : Install ci_mirror script]
2025-12-03 10:46:39.567711 | controller | changed
2025-12-03 10:46:39.576750 | 
2025-12-03 10:46:39.576816 | LOOP [add-authorized-keys : Enable access via build key on all nodes]
2025-12-03 10:46:39.983875 | controller | changed:
2025-12-03 10:46:39.984036 | controller | {
2025-12-03 10:46:39.984066 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com"
2025-12-03 10:46:39.984097 | controller | }
2025-12-03 10:46:40.258573 | controller | changed:
2025-12-03 10:46:40.258648 | controller | {
2025-12-03 10:46:40.258680 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com"
2025-12-03 10:46:40.258721 | controller | }
2025-12-03 10:46:40.531630 | controller | changed:
2025-12-03 10:46:40.531701 | controller | {
2025-12-03 10:46:40.531734 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com"
2025-12-03 10:46:40.531755 | controller | }
2025-12-03 10:46:40.803374 | controller | changed:
2025-12-03 10:46:40.803453 | controller | {
2025-12-03 10:46:40.803479 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com"
2025-12-03 10:46:40.803499 | controller | }
2025-12-03 10:46:41.071340 | controller | changed:
2025-12-03 10:46:41.071419 | controller | {
2025-12-03 10:46:41.071447 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com"
2025-12-03 10:46:41.071467 | controller | }
2025-12-03 10:46:41.342711 | controller | changed:
2025-12-03 10:46:41.342798 | controller | {
2025-12-03 10:46:41.342825 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com"
2025-12-03 10:46:41.342845 | controller | }
2025-12-03 10:46:41.617165 | controller | changed:
2025-12-03 10:46:41.617227 | controller | {
2025-12-03 10:46:41.617251 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen"
2025-12-03 10:46:41.617271 | controller | }
2025-12-03 10:46:41.889166 | controller | changed:
2025-12-03 10:46:41.889222 | controller | {
2025-12-03 10:46:41.889250 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora"
2025-12-03 10:46:41.889272 | controller | }
2025-12-03 10:46:42.155024 | controller | changed:
2025-12-03 10:46:42.155100 | controller | {
2025-12-03 10:46:42.155128 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner"
2025-12-03 10:46:42.155149 | controller | }
2025-12-03 10:46:42.444017 | controller | changed:
2025-12-03 10:46:42.444095 | controller | {
2025-12-03 10:46:42.444121 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com"
2025-12-03 10:46:42.444142 | controller | }
2025-12-03 10:46:42.697543 | controller | changed:
2025-12-03 10:46:42.697603 | controller | {
2025-12-03 10:46:42.697629 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com"
2025-12-03 10:46:42.697648 | controller | }
2025-12-03 10:46:42.969819 | controller | changed:
2025-12-03 10:46:42.969903 | controller | {
2025-12-03 10:46:42.969956 | controller |   "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com"
2025-12-03 10:46:42.969982 | controller | }
2025-12-03 10:46:43.240604 | controller | changed:
2025-12-03 10:46:43.240665 | controller | {
2025-12-03 10:46:43.240689 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGpU/BepK3qX0NRf5Np+dOBDqzQEefhNrw2DCZaH3uWW rebtoor@monolith"
2025-12-03 10:46:43.240708 | controller | }
2025-12-03 10:46:43.510451 | controller | changed:
2025-12-03 10:46:43.510540 | controller | {
2025-12-03 10:46:43.510571 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel"
2025-12-03 10:46:43.510597 | controller | }
2025-12-03 10:46:43.774317 | controller | changed:
2025-12-03 10:46:43.774373 | controller | {
2025-12-03 10:46:43.774405 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux"
2025-12-03 10:46:43.774430 | controller | }
2025-12-03 10:46:44.044165 | controller | changed:
2025-12-03 10:46:44.044237 | controller | {
2025-12-03 10:46:44.044262 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr"
2025-12-03 10:46:44.044279 | controller | }
2025-12-03 10:46:44.308930 | controller | changed:
2025-12-03 10:46:44.309013 | controller | {
2025-12-03 10:46:44.309040 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com"
2025-12-03 10:46:44.309062 | controller | }
2025-12-03 10:46:44.579881 | controller | changed:
2025-12-03 10:46:44.579989 | controller | {
2025-12-03 10:46:44.580018 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb"
2025-12-03 10:46:44.580046 | controller | }
2025-12-03 10:46:44.861967 | controller | changed:
2025-12-03 10:46:44.862074 | controller | {
2025-12-03 10:46:44.862105 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9"
2025-12-03 10:46:44.862126 | controller | }
2025-12-03 10:46:45.129056 | controller | changed:
2025-12-03 10:46:45.129145 | controller | {
2025-12-03 10:46:45.129175 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora"
2025-12-03 10:46:45.129199 | controller | }
2025-12-03 10:46:45.400037 | controller | changed:
2025-12-03 10:46:45.400083 | controller | {
2025-12-03 10:46:45.400107 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac"
2025-12-03 10:46:45.400124 | controller | }
2025-12-03 10:46:45.665245 | controller | changed:
2025-12-03 10:46:45.665355 | controller | {
2025-12-03 10:46:45.665385 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop"
2025-12-03 10:46:45.665408 | controller | }
2025-12-03 10:46:45.930309 | controller | changed:
2025-12-03 10:46:45.930358 | controller | {
2025-12-03 10:46:45.930384 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com"
2025-12-03 10:46:45.930406 | controller | }
2025-12-03 10:46:46.201319 | controller | changed:
2025-12-03 10:46:46.201394 | controller | {
2025-12-03 10:46:46.201420 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com"
2025-12-03 10:46:46.201440 | controller | }
2025-12-03 10:46:46.479888 | controller | changed:
2025-12-03 10:46:46.480038 | controller | {
2025-12-03 10:46:46.480073 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com"
2025-12-03 10:46:46.480097 | controller | }
2025-12-03 10:46:46.754013 | controller | changed:
2025-12-03 10:46:46.754201 | controller | {
2025-12-03 10:46:46.754237 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono"
2025-12-03 10:46:46.754261 | controller | }
2025-12-03 10:46:46.779074 | 
2025-12-03 10:46:46.779174 | TASK [Set timezone to UTC]
2025-12-03 10:46:47.253675 | controller | changed: executed `/bin/timedatectl set-timezone UTC`
2025-12-03 10:46:47.258291 | 
2025-12-03 10:46:47.258357 | TASK [Create nodepool directory]
2025-12-03 10:46:47.499542 | controller | changed
2025-12-03 10:46:47.504790 | 
2025-12-03 10:46:47.504858 | TASK [Create nodepool sub_nodes file]
2025-12-03 10:46:48.374706 | controller | changed
2025-12-03 10:46:48.379652 | 
2025-12-03 10:46:48.379738 | TASK [Create nodepool sub_nodes_private file]
2025-12-03 10:46:49.289546 | controller | changed
2025-12-03 10:46:49.294561 | 
2025-12-03 10:46:49.294622 | LOOP [Populate nodepool sub_nodes file]
2025-12-03 10:46:49.323290 | 
2025-12-03 10:46:49.323407 | LOOP [Populate nodepool sub_nodes_private file]
2025-12-03 10:46:49.352051 | 
2025-12-03 10:46:49.352213 | TASK [Create nodepool primary file]
2025-12-03 10:46:49.375531 | controller | skipping: Conditional result was False
2025-12-03 10:46:49.380641 | 
2025-12-03 10:46:49.380714 | TASK [Create nodepool node_private for this node]
2025-12-03 10:46:50.393317 | controller | changed
2025-12-03 10:46:50.400048 | 
2025-12-03 10:46:50.400132 | LOOP [Copy ssh keys to nodepool directory]
2025-12-03 10:46:50.765901 | controller | ok: Item: id_rsa Runtime: 0:00:00.004361
2025-12-03 10:46:50.766110 | 
2025-12-03 10:46:51.000144 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.004567
2025-12-03 10:46:51.005660 | 
2025-12-03 10:46:51.005738 | TASK [Add sudoers role for zuul-sudo-grep.sh]
2025-12-03 10:46:51.946634 | controller | changed
2025-12-03 10:46:51.955132 | 
2025-12-03 10:46:51.955253 | TASK [Validate sudoers config after edits]
2025-12-03 10:46:52.217754 | controller | /etc/sudoers: parsed OK
2025-12-03 10:46:52.217823 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK
2025-12-03 10:46:52.217902 | controller | /etc/sudoers.d/zuul: parsed OK
2025-12-03 10:46:52.217917 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK
2025-12-03 10:46:52.480235 | controller | ok: Runtime: 0:00:00.005824
2025-12-03 10:46:52.484997 | 
2025-12-03 10:46:52.485054 | TASK [Show the environment passed in to job shell scripts]
2025-12-03 10:46:52.730552 | controller | SHELL=/bin/bash
2025-12-03 10:46:52.730609 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework
2025-12-03 10:46:52.730620 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework
2025-12-03 10:46:52.730626 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/23/3523/b0014b650b386b32f65c1992c615d20c5b09b079^openstack-k8s-operators/ci-framework:main:refs/changes/05/3505/edf63985bae1ea7b1cbf7ba50e5ec63d0c6ccb34
2025-12-03 10:46:52.730634 | controller | PWD=/home/zuul
2025-12-03 10:46:52.730640 | controller | ZUUL_PIPELINE=github-check
2025-12-03 10:46:52.730645 | controller | LOGNAME=zuul
2025-12-03 10:46:52.730650 | controller | XDG_SESSION_TYPE=tty
2025-12-03 10:46:52.730655 | controller | _=/usr/bin/env
2025-12-03 10:46:52.730660 | controller | MOTD_SHOWN=pam
2025-12-03 10:46:52.730665 | controller | HOME=/home/zuul
2025-12-03 10:46:52.730670 | controller | LANG=en_US.UTF-8
2025-12-03 10:46:52.730675 | controller | SSH_CONNECTION=192.168.26.12 39626 192.168.26.47 22
2025-12-03 10:46:52.730680 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET
2025-12-03 10:46:52.730686 | controller | ZUUL_CHANGE_IDS=3523,b0014b650b386b32f65c1992c615d20c5b09b079 3505,edf63985bae1ea7b1cbf7ba50e5ec63d0c6ccb34
2025-12-03 10:46:52.730691 | controller | WORKSPACE=/home/zuul/workspace
2025-12-03 10:46:52.730696 | controller | XDG_SESSION_CLASS=user
2025-12-03 10:46:52.730701 | controller | SELINUX_ROLE_REQUESTED=
2025-12-03 10:46:52.730707 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s
2025-12-03 10:46:52.730712 | controller | USER=zuul
2025-12-03 10:46:52.730717 | controller | ZUUL_VOTING=True
2025-12-03 10:46:52.730722 | controller | BUILD_TIMEOUT=5400000
2025-12-03 10:46:52.730727 | controller | SELINUX_USE_CURRENT_RANGE=
2025-12-03 10:46:52.730732 | controller | SHLVL=1
2025-12-03 10:46:52.730737 | controller | ZUUL_PATCHSET=edf63985bae1ea7b1cbf7ba50e5ec63d0c6ccb34
2025-12-03 10:46:52.730742 | controller | XDG_SESSION_ID=1
2025-12-03 10:46:52.730748 | controller | ZUUL_BRANCH=main
2025-12-03 10:46:52.730753 | controller | XDG_RUNTIME_DIR=/run/user/1000
2025-12-03 10:46:52.730758 | controller | SSH_CLIENT=192.168.26.12 39626 22
2025-12-03 10:46:52.730763 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/
2025-12-03 10:46:52.730768 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima:
2025-12-03 10:46:52.730773 | controller | which_declare=declare -f
2025-12-03 10:46:52.730779 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
2025-12-03 10:46:52.730784 | controller | SELINUX_LEVEL_REQUESTED=
2025-12-03 10:46:52.730789 | controller | ZUUL_CHANGE=3505
2025-12-03 10:46:52.730794 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus
2025-12-03 10:46:52.730799 | controller | ZUUL_UUID=448b5a8453c048dc8ef3fd38808b6ca9
2025-12-03 10:46:52.730806 | controller | BASH_FUNC_which%%=() {  ( alias;
2025-12-03 10:46:52.730811 | controller |  eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@
2025-12-03 10:46:52.730816 | controller | }
2025-12-03 10:46:53.010737 | controller | ok: Runtime: 0:00:00.005400
2025-12-03 10:46:53.016453 | 
2025-12-03 10:46:53.016530 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars]
2025-12-03 10:46:53.030781 | controller | skipping: Conditional result was False
2025-12-03 10:46:53.037019 | 
2025-12-03 10:46:53.037086 | TASK [Symlink /home/zuul-worker/workspace]
2025-12-03 10:46:53.563240 | controller | skipping: Conditional result was False
2025-12-03 10:46:53.587421 | 
2025-12-03 10:46:53.587502 | TASK [Ensure legacy workspace directory]
2025-12-03 10:46:53.829007 | controller | changed
2025-12-03 10:46:53.846275 | 
2025-12-03 10:46:53.846329 | PLAY RECAP
2025-12-03 10:46:53.846374 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2025-12-03 10:46:53.846398 | 
2025-12-03 10:46:53.915108 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2025-12-03 10:46:53.915812 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2025-12-03 10:46:54.400985 | 
2025-12-03 10:46:54.401087 | PLAY [Run ci/playbooks/dump_zuul_data.yml]
2025-12-03 10:46:54.420397 | 
2025-12-03 10:46:54.420469 | TASK [Create zuul-output directory]
2025-12-03 10:46:54.774197 | controller | changed
2025-12-03 10:46:54.780062 | 
2025-12-03 10:46:54.780188 | TASK [Slurp Zuul inventory test]
2025-12-03 10:46:55.037266 | controller -> localhost | ok
2025-12-03 10:46:55.043067 | 
2025-12-03 10:46:55.043137 | TASK [Save zuul inventory]
2025-12-03 10:46:56.129478 | controller | changed
2025-12-03 10:46:56.134313 | 
2025-12-03 10:46:56.134378 | TASK [Save zuul vars without the change_message]
2025-12-03 10:46:57.087350 | controller | changed
2025-12-03 10:46:57.104724 | 
2025-12-03 10:46:57.104785 | PLAY RECAP
2025-12-03 10:46:57.104828 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2025-12-03 10:46:57.104849 | 
2025-12-03 10:46:57.169523 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2025-12-03 10:46:57.170237 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2025-12-03 10:46:57.670694 | 
2025-12-03 10:46:57.670804 | PLAY [Run ci/playbooks/molecule-prepare.yml]
2025-12-03 10:46:57.689710 | 
2025-12-03 10:46:57.689784 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh]
2025-12-03 10:46:57.708424 | controller | ok
2025-12-03 10:46:57.724648 | 
2025-12-03 10:46:57.724725 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2025-12-03 10:46:57.748669 | controller | skipping: Conditional result was False
2025-12-03 10:46:57.754190 | 
2025-12-03 10:46:57.754255 | TASK [mirror-info-fork : Create /etc/ci]
2025-12-03 10:46:58.116846 | controller | ok
2025-12-03 10:46:58.122174 | 
2025-12-03 10:46:58.122244 | TASK [mirror-info-fork : Install ci_mirror script]
2025-12-03 10:46:58.983756 | controller | ok
2025-12-03 10:46:58.993278 | 
2025-12-03 10:46:58.993341 | TASK [Prepare workspace]
2025-12-03 10:46:59.010839 | controller | ok
2025-12-03 10:46:59.026631 | 
2025-12-03 10:46:59.026694 | TASK [prepare-workspace : Start zuul_console daemon.]
2025-12-03 10:46:59.349739 | controller | ok
2025-12-03 10:46:59.355419 | 
2025-12-03 10:46:59.355481 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2025-12-03 10:47:01.604810 | controller | Output suppressed because no_log was given
2025-12-03 10:47:01.614255 | 
2025-12-03 10:47:01.614319 | LOOP [Create zuul-output directory]
2025-12-03 10:47:01.863329 | controller | changed: "/home/zuul/ci-framework-data/logs"
2025-12-03 10:47:02.073227 | controller | ok: "/home/zuul/zuul-output/logs"
2025-12-03 10:47:02.080922 | 
2025-12-03 10:47:02.081029 | TASK [Install required packages]
2025-12-03 10:47:28.663570 | controller | ok: Nothing to do
2025-12-03 10:47:28.668051 | 
2025-12-03 10:47:28.668109 | TASK [Install venv]
2025-12-03 10:48:25.686405 | controller | changed
2025-12-03 10:48:25.726390 | 
2025-12-03 10:48:25.726458 | PLAY RECAP
2025-12-03 10:48:25.726495 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2025-12-03 10:48:25.726515 | 
2025-12-03 10:48:25.782555 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2025-12-03 10:48:25.783399 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2025-12-03 10:48:26.264132 | 
2025-12-03 10:48:26.264224 | PLAY [Run ci/playbooks/molecule-test.yml]
2025-12-03 10:48:26.283027 | 
2025-12-03 10:48:26.283099 | TASK [Gather required facts]
2025-12-03 10:48:26.788693 | controller | ok
2025-12-03 10:48:26.793622 | 
2025-12-03 10:48:26.793692 | TASK [Load environment var if instructed to]
2025-12-03 10:48:26.817507 | controller | skipping: Conditional result was False
2025-12-03 10:48:26.822292 | 
2025-12-03 10:48:26.822358 | TASK [Ensure group_vars dir exists]
2025-12-03 10:48:27.175310 | controller | ok
2025-12-03 10:48:27.180960 | 
2025-12-03 10:48:27.181022 | TASK [Print related variables]
2025-12-03 10:48:27.208758 | controller | ok:
2025-12-03 10:48:27.208870 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml
2025-12-03 10:48:27.208898 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer
2025-12-03 10:48:27.213093 | 
2025-12-03 10:48:27.213154 | TASK [Run molecule]
2025-12-03 10:48:28.167467 | controller | INFO     Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml
2025-12-03 10:48:28.438918 | controller | INFO     Performing prerun with role_name_check=0...
2025-12-03 10:48:44.444891 | controller | WARNING  Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections).
2025-12-03 10:48:44.445398 | controller | WARNING  Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-12-03 10:48:44.445868 | controller | WARNING  Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections).
2025-12-03 10:48:44.446303 | controller | WARNING  Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections).
2025-12-03 10:48:44.446801 | controller | WARNING  Another version of 'cifmw.general' 1.0.0+fb0ab6e5 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+fb0ab6e5 (/home/zuul/.ansible/collections/ansible_collections).
2025-12-03 10:48:44.447242 | controller | WARNING  Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections).
2025-12-03 10:48:44.447695 | controller | WARNING  Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections).
2025-12-03 10:48:44.448139 | controller | WARNING  Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections).
2025-12-03 10:48:44.448590 | controller | WARNING  Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-12-03 10:48:44.449023 | controller | WARNING  Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-12-03 10:48:44.449464 | controller | WARNING  Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections).
2025-12-03 10:48:44.449910 | controller | WARNING  Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-12-03 10:48:44.450348 | controller | WARNING  Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-12-03 10:48:44.450804 | controller | WARNING  Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2025-12-03 10:48:44.451235 | controller | WARNING  Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections).
2025-12-03 10:48:44.459901 | controller | INFO     Running crc_layout > prepare
2025-12-03 10:48:45.084875 | controller |
2025-12-03 10:48:45.085087 | controller | PLAY [Prepare] *****************************************************************
2025-12-03 10:48:45.085204 | controller |
2025-12-03 10:48:45.085368 | controller | TASK [Gathering Facts] *********************************************************
2025-12-03 10:48:45.085537 | controller | Wednesday 03 December 2025  10:48:45 +0000 (0:00:00.018)       0:00:00.018 ****
2025-12-03 10:48:45.894624 | controller | ok: [instance]
2025-12-03 10:48:45.894783 | controller |
2025-12-03 10:48:45.894973 | controller | TASK [Create custom basedir] ***************************************************
2025-12-03 10:48:45.895159 | controller | Wednesday 03 December 2025  10:48:45 +0000 (0:00:00.810)       0:00:00.828 ****
2025-12-03 10:48:46.189501 | controller | changed: [instance]
2025-12-03 10:48:46.189616 | controller |
2025-12-03 10:48:46.189742 | controller | TASK [test_deps : Gather facts if they don't exist] ****************************
2025-12-03 10:48:46.189867 | controller | Wednesday 03 December 2025  10:48:46 +0000 (0:00:00.295)       0:00:01.123 ****
2025-12-03 10:48:46.207098 | controller | skipping: [instance]
2025-12-03 10:48:46.207201 | controller |
2025-12-03 10:48:46.207360 | controller | TASK [test_deps : Gather variables for each operating system] ******************
2025-12-03 10:48:46.207499 | controller | Wednesday 03 December 2025  10:48:46 +0000 (0:00:00.017)       0:00:01.141 ****
2025-12-03 10:48:46.247081 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml)
2025-12-03 10:48:46.247199 | controller |
2025-12-03 10:48:46.247343 | controller | TASK [test_deps : Detect mirrors file] *****************************************
2025-12-03 10:48:46.247495 | controller | Wednesday 03 December 2025  10:48:46 +0000 (0:00:00.039)       0:00:01.181 ****
2025-12-03 10:48:46.508136 | controller | ok: [instance]
2025-12-03 10:48:46.508285 | controller |
2025-12-03 10:48:46.508536 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] ***********
2025-12-03 10:48:46.508665 | controller | Wednesday 03 December 2025  10:48:46 +0000 (0:00:00.260)       0:00:01.442 ****
2025-12-03 10:48:46.703036 | controller | ok: [instance]
2025-12-03 10:48:46.703215 | controller |
2025-12-03 10:48:46.703446 | controller | TASK [test_deps : Disable ubi 9 repos] *****************************************
2025-12-03 10:48:46.703656 | controller | Wednesday 03 December 2025  10:48:46 +0000 (0:00:00.194)       0:00:01.637 ****
2025-12-03 10:48:47.399538 | controller | ok: [instance] => (item=ubi-9-appstream)
2025-12-03 10:48:47.399634 | controller | ok: [instance] => (item=ubi-9-baseos)
2025-12-03 10:48:47.399745 | controller | ok: [instance] => (item=ubi-9-codeready-builder)
2025-12-03 10:48:47.399854 | controller |
2025-12-03 10:48:47.399955 | controller | TASK [Deploy repo-setup] *******************************************************
2025-12-03 10:48:47.400082 | controller | Wednesday 03 December 2025  10:48:47 +0000 (0:00:00.696)       0:00:02.333 ****
2025-12-03 10:48:47.457318 | controller |
2025-12-03 10:48:47.457592 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2025-12-03 10:48:47.457707 | controller | Wednesday 03 December 2025  10:48:47 +0000 (0:00:00.057)       0:00:02.391 ****
2025-12-03 10:48:47.973408 | controller | changed: [instance] => (item=tmp)
2025-12-03 10:48:47.973497 | controller | changed: [instance] => (item=artifacts/repositories)
2025-12-03 10:48:47.973619 | controller | changed: [instance] => (item=venv/repo_setup)
2025-12-03 10:48:47.973713 | controller |
2025-12-03 10:48:47.973815 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2025-12-03 10:48:47.973910 | controller | Wednesday 03 December 2025  10:48:47 +0000 (0:00:00.515)       0:00:02.907 ****
2025-12-03 10:48:48.769063 | controller | ok: [instance]
2025-12-03 10:48:48.769117 | controller |
2025-12-03 10:48:48.769376 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2025-12-03 10:48:49.788345 | controller | Wednesday 03 December 2025  10:48:48 +0000 (0:00:00.795)       0:00:03.703 ****
2025-12-03 10:48:49.788386 | controller | changed: [instance]
2025-12-03 10:48:57.220584 | controller |
2025-12-03 10:48:57.220654 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2025-12-03 10:48:57.220668 | controller | Wednesday 03 December 2025  10:48:49 +0000 (0:00:01.019)       0:00:04.722 ****
2025-12-03 10:48:57.220685 | controller | changed: [instance]
2025-12-03 10:48:57.889828 | controller |
2025-12-03 10:48:57.889862 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2025-12-03 10:48:57.889872 | controller | Wednesday 03 December 2025  10:48:57 +0000 (0:00:07.431)       0:00:12.154 ****
2025-12-03 10:48:57.889883 | controller | changed: [instance]
2025-12-03 10:48:57.911439 | controller |
2025-12-03 10:48:57.911481 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2025-12-03 10:48:57.911489 | controller | Wednesday 03 December 2025  10:48:57 +0000 (0:00:00.669)       0:00:12.823 ****
2025-12-03 10:48:57.911499 | controller | skipping: [instance]
2025-12-03 10:48:57.911528 | controller |
2025-12-03 10:48:57.911848 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2025-12-03 10:48:58.684422 | controller | Wednesday 03 December 2025  10:48:57 +0000 (0:00:00.021)       0:00:12.845 ****
2025-12-03 10:48:58.684460 | controller | changed: [instance]
2025-12-03 10:48:58.721045 | controller |
2025-12-03 10:48:58.721086 | controller | TASK [repo_setup : Get component repo] *****************************************
2025-12-03 10:48:58.721096 | controller | Wednesday 03 December 2025  10:48:58 +0000 (0:00:00.772)       0:00:13.617 ****
2025-12-03 10:48:58.721110 | controller | skipping: [instance]
2025-12-03 10:48:58.754285 | controller |
2025-12-03 10:48:58.754372 | controller | TASK [repo_setup : Rename component repo] **************************************
2025-12-03 10:48:58.754391 | controller | Wednesday 03 December 2025  10:48:58 +0000 (0:00:00.036)       0:00:13.654 ****
2025-12-03 10:48:58.754409 | controller | skipping: [instance]
2025-12-03 10:48:58.789051 | controller |
2025-12-03 10:48:58.789067 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2025-12-03 10:48:58.789074 | controller | Wednesday 03 December 2025  10:48:58 +0000 (0:00:00.033)       0:00:13.688 ****
2025-12-03 10:48:58.789083 | controller | skipping: [instance]
2025-12-03 10:49:00.319260 | controller |
2025-12-03 10:49:00.319286 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2025-12-03 10:49:00.319293 | controller | Wednesday 03 December 2025  10:48:58 +0000 (0:00:00.034)       0:00:13.723 ****
2025-12-03 10:49:00.319311 | controller | changed: [instance]
2025-12-03 10:49:00.744506 | controller |
2025-12-03 10:49:00.744530 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2025-12-03 10:49:00.744538 | controller | Wednesday 03 December 2025  10:49:00 +0000 (0:00:01.530)       0:00:15.253 ****
2025-12-03 10:49:00.744548 | controller | changed: [instance]
2025-12-03 10:49:00.776827 | controller |
2025-12-03 10:49:00.776911 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2025-12-03 10:49:00.776925 | controller | Wednesday 03 December 2025  10:49:00 +0000 (0:00:00.425)       0:00:15.678 ****
2025-12-03 10:49:00.776946 | controller | skipping: [instance]
2025-12-03 10:49:00.804459 | controller |
2025-12-03 10:49:00.804487 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2025-12-03 10:49:00.804497 | controller | Wednesday 03 December 2025  10:49:00 +0000 (0:00:00.031)       0:00:15.710 ****
2025-12-03 10:49:00.804510 | controller | skipping: [instance]
2025-12-03 10:49:00.832458 | controller |
2025-12-03 10:49:00.832480 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2025-12-03 10:49:00.832489 | controller | Wednesday 03 December 2025  10:49:00 +0000 (0:00:00.028)       0:00:15.738 ****
2025-12-03 10:49:00.832500 | controller | skipping: [instance]
2025-12-03 10:49:00.832507 | controller |
2025-12-03 10:49:00.832513 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2025-12-03 10:49:00.832522 | controller | Wednesday 03 December 2025  10:49:00 +0000 (0:00:00.027)       0:00:15.766 ****
2025-12-03 10:49:00.867888 | controller | ok: [instance]
2025-12-03 10:49:00.895462 | controller |
2025-12-03 10:49:00.895511 | controller | TASK [repo_setup : Create download directory] **********************************
2025-12-03 10:49:00.895521 | controller | Wednesday 03 December 2025  10:49:00 +0000 (0:00:00.035)       0:00:15.802 ****
2025-12-03 10:49:00.895543 | controller | skipping: [instance]
2025-12-03 10:49:00.895576 | controller |
2025-12-03 10:49:00.895805 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2025-12-03 10:49:00.921446 | controller | Wednesday 03 December 2025  10:49:00 +0000 (0:00:00.027)       0:00:15.829 ****
2025-12-03 10:49:00.921485 | controller | skipping: [instance]
2025-12-03 10:49:00.921724 | controller |
2025-12-03 10:49:00.921858 | controller | TASK [Download the RPM] ********************************************************
2025-12-03 10:49:00.921984 | controller | Wednesday 03 December 2025  10:49:00 +0000 (0:00:00.026)       0:00:15.855 ****
2025-12-03 10:49:00.948121 | controller | skipping: [instance]
2025-12-03 10:49:00.948456 | controller |
2025-12-03 10:49:00.948724 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2025-12-03 10:49:00.948863 | controller | Wednesday 03 December 2025  10:49:00 +0000 (0:00:00.026)       0:00:15.882 ****
2025-12-03 10:49:00.974385 | controller | skipping: [instance]
2025-12-03 10:49:00.974681 | controller |
2025-12-03 10:49:00.974876 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2025-12-03 10:49:00.975003 | controller | Wednesday 03 December 2025  10:49:00 +0000 (0:00:00.026)       0:00:15.908 ****
2025-12-03 10:49:01.001606 | controller | skipping: [instance]
2025-12-03 10:49:01.001878 | controller |
2025-12-03 10:49:01.002009 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2025-12-03 10:49:01.002135 | controller | Wednesday 03 December 2025  10:49:00 +0000 (0:00:00.027)       0:00:15.936 ****
2025-12-03 10:49:01.061920 | controller | skipping: [instance]
2025-12-03 10:49:01.062106 | controller |
2025-12-03 10:49:01.062288 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2025-12-03 10:49:01.062510 | controller | Wednesday 03 December 2025  10:49:01 +0000 (0:00:00.060)       0:00:15.996 ****
2025-12-03 10:49:01.089081 | controller | skipping: [instance]
2025-12-03 10:49:01.089416 | controller |
2025-12-03 10:49:01.089692 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2025-12-03 10:49:01.089941 | controller | Wednesday 03 December 2025  10:49:01 +0000 (0:00:00.026)       0:00:16.023 ****
2025-12-03 10:49:01.270387 | controller | ok: [instance]
2025-12-03 10:49:01.270553 | controller |
2025-12-03 10:49:01.270700 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2025-12-03 10:49:01.270867 | controller | Wednesday 03 December 2025  10:49:01 +0000 (0:00:00.181)       0:00:16.204 ****
2025-12-03 10:49:01.478946 | controller | changed: [instance]
2025-12-03 10:49:01.695373 | controller |
2025-12-03 10:49:01.695395 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2025-12-03 10:49:01.695403 | controller | Wednesday 03 December 2025  10:49:01 +0000 (0:00:00.208)       0:00:16.413 ****
2025-12-03 10:49:01.695413 | controller | changed: [instance]
2025-12-03 10:49:01.718173 | controller |
2025-12-03 10:49:01.718190 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2025-12-03 10:49:01.718196 | controller | Wednesday 03 December 2025  10:49:01 +0000 (0:00:00.216)       0:00:16.629 ****
2025-12-03 10:49:01.718205 | controller | skipping: [instance]
2025-12-03 10:49:01.743095 | controller |
2025-12-03 10:49:01.743127 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2025-12-03 10:49:01.743140 | controller | Wednesday 03 December 2025  10:49:01 +0000 (0:00:00.022)       0:00:16.652 ****
2025-12-03 10:49:01.743156 | controller | skipping: [instance]
2025-12-03 10:49:01.764141 | controller |
2025-12-03 10:49:01.764161 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2025-12-03 10:49:01.764170 | controller | Wednesday 03 December 2025  10:49:01 +0000 (0:00:00.024)       0:00:16.676 ****
2025-12-03 10:49:01.764180 | controller | skipping: [instance]
2025-12-03 10:49:01.787753 | controller |
2025-12-03 10:49:01.787776 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2025-12-03 10:49:01.787785 | controller | Wednesday 03 December 2025  10:49:01 +0000 (0:00:00.021)       0:00:16.698 ****
2025-12-03 10:49:01.787796 | controller | skipping: [instance]
2025-12-03 10:49:01.810225 | controller |
2025-12-03 10:49:01.810257 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2025-12-03 10:49:01.810281 | controller | Wednesday 03 December 2025  10:49:01 +0000 (0:00:00.023)       0:00:16.721 ****
2025-12-03 10:49:01.810313 | controller | skipping: [instance]
2025-12-03 10:49:01.831564 | controller |
2025-12-03 10:49:01.831596 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] ***
2025-12-03 10:49:01.831610 | controller | Wednesday 03 December 2025  10:49:01 +0000 (0:00:00.022)       0:00:16.744 ****
2025-12-03 10:49:01.831631 | controller | skipping: [instance]
2025-12-03 10:49:01.831778 | controller |
2025-12-03 10:49:01.831910 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2025-12-03 10:49:01.832040 | controller | Wednesday 03 December 2025  10:49:01 +0000 (0:00:00.021)       0:00:16.765 ****
2025-12-03 10:49:01.849019 | controller | skipping: [instance]
2025-12-03 10:49:01.849311 | controller |
2025-12-03 10:49:01.849538 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2025-12-03 10:49:01.849673 | controller | Wednesday 03 December 2025  10:49:01 +0000 (0:00:00.017)       0:00:16.783 ****
2025-12-03 10:49:01.879243 | controller | skipping: [instance]
2025-12-03 10:49:01.879522 | controller |
2025-12-03 10:49:01.879672 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2025-12-03 10:49:01.879818 | controller | Wednesday 03 December 2025  10:49:01 +0000 (0:00:00.030)       0:00:16.813 ****
2025-12-03 10:49:01.897659 | controller | skipping: [instance]
2025-12-03 10:49:01.897936 | controller |
2025-12-03 10:49:01.898193 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2025-12-03 10:49:01.898492 | controller | Wednesday 03 December 2025  10:49:01 +0000 (0:00:00.018)       0:00:16.832 ****
2025-12-03 10:49:01.921060 | controller | skipping: [instance]
2025-12-03 10:49:01.921399 | controller |
2025-12-03 10:49:01.921631 | controller | TASK [test_deps : Look for redhat-release rpm] *********************************
2025-12-03 10:49:01.921760 | controller | Wednesday 03 December 2025  10:49:01 +0000 (0:00:00.023)       0:00:16.855 ****
2025-12-03 10:49:01.954772 | controller | skipping: [instance]
2025-12-03 10:49:01.955049 | controller |
2025-12-03 10:49:01.955359 | controller | TASK [test_deps : Remove redhat-release] ***************************************
2025-12-03 10:49:01.955626 | controller | Wednesday 03 December 2025  10:49:01 +0000 (0:00:00.033)       0:00:16.889 ****
2025-12-03 10:49:01.984192 | controller | skipping: [instance]
2025-12-03 10:49:01.984534 | controller |
2025-12-03 10:49:01.984752 | controller | TASK [test_deps : Install centos-stream-release] *******************************
2025-12-03 10:49:01.984888 | controller | Wednesday 03 December 2025  10:49:01 +0000 (0:00:00.029)       0:00:16.918 ****
2025-12-03 10:49:02.012749 | controller | skipping: [instance]
2025-12-03 10:49:02.012890 | controller |
2025-12-03 10:49:02.013020 | controller | TASK [test_deps : Install additional packages] *********************************
2025-12-03 10:49:02.013152 | controller | Wednesday 03 December 2025  10:49:02 +0000 (0:00:00.028)       0:00:16.947 ****
2025-12-03 10:49:02.041726 | controller | skipping: [instance]
2025-12-03 10:49:02.041911 | controller |
2025-12-03 10:49:02.042042 | controller | TASK [test_deps : Install selinux python libs] *********************************
2025-12-03 10:49:02.042168 | controller | Wednesday 03 December 2025  10:49:02 +0000 (0:00:00.028)       0:00:16.976 ****
2025-12-03 10:49:52.139455 | controller | ok: [instance]
2025-12-03 10:49:53.260292 | controller |
2025-12-03 10:49:53.260324 | controller | TASK [test_deps : Install python yaml libs] ************************************
2025-12-03 10:49:53.260350 | controller | Wednesday 03 December 2025  10:49:52 +0000 (0:00:50.097)       0:01:07.073 ****
2025-12-03 10:49:53.260360 | controller | ok: [instance]
2025-12-03 10:49:53.290507 | controller |
2025-12-03 10:49:53.290549 | controller | TASK [test_deps : Install extra packages] **************************************
2025-12-03 10:49:53.290563 | controller | Wednesday 03 December 2025  10:49:53 +0000 (0:00:01.121)       0:01:08.194 ****
2025-12-03 10:49:53.290579 | controller | skipping: [instance]
2025-12-03 10:49:53.290611 | controller |
2025-12-03 10:49:53.290622 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2025-12-03 10:49:53.290634 | controller | Wednesday 03 December 2025  10:49:53 +0000 (0:00:00.030)       0:01:08.224 ****
2025-12-03 10:49:53.330760 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml)
2025-12-03 10:49:53.349451 | controller |
2025-12-03 10:49:53.349472 | controller | TASK [ci_setup : List packages to install] *************************************
2025-12-03 10:49:53.349481 | controller | Wednesday 03 December 2025  10:49:53 +0000 (0:00:00.040)       0:01:08.265 ****
2025-12-03 10:49:53.349491 | controller | ok: [instance] =>
2025-12-03 10:49:53.350165 | controller |   cifmw_ci_setup_packages:
2025-12-03 10:49:53.350190 | controller |   - bash-completion
2025-12-03 10:49:53.350197 | controller |   - ca-certificates
2025-12-03 10:49:53.350207 | controller |   - git-core
2025-12-03 10:50:01.070005 | controller |   - make
2025-12-03 10:50:01.070037 | controller |   - tar
2025-12-03 10:50:01.070053 | controller |   - tmux
2025-12-03 10:50:01.070059 | controller |   - python3-pip
2025-12-03 10:50:01.070065 | controller |
2025-12-03 10:50:01.070071 | controller | TASK [ci_setup : Install needed packages] **************************************
2025-12-03 10:50:01.070077 | controller | Wednesday 03 December 2025  10:49:53 +0000 (0:00:00.018)       0:01:08.283 ****
2025-12-03 10:50:01.070086 | controller | changed: [instance]
2025-12-03 10:50:01.635547 | controller |
2025-12-03 10:50:01.635578 | controller | TASK [ci_setup : Gather version of openshift client] ***************************
2025-12-03 10:50:01.635587 | controller | Wednesday 03 December 2025  10:50:01 +0000 (0:00:07.720)       0:01:16.004 ****
2025-12-03 10:50:01.635598 | controller | ok: [instance]
2025-12-03 10:50:01.835112 | controller |
2025-12-03 10:50:01.835143 | controller | TASK [ci_setup : Ensure openshift client install path is present] **************
2025-12-03 10:50:01.835152 | controller | Wednesday 03 December 2025  10:50:01 +0000 (0:00:00.565)       0:01:16.569 ****
2025-12-03 10:50:01.835162 | controller | changed: [instance]
2025-12-03 10:50:01.835185 | controller |
2025-12-03 10:50:01.835194 | controller | TASK [ci_setup : Install openshift client] *************************************
2025-12-03 10:50:01.835350 | controller | Wednesday 03 December 2025  10:50:01 +0000 (0:00:00.199)       0:01:16.769 ****
2025-12-03 10:50:07.722424 | controller | changed: [instance]
2025-12-03 10:50:07.722471 | controller |
2025-12-03 10:50:07.722482 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
2025-12-03 10:50:07.722583 | controller | Wednesday 03 December 2025  10:50:07 +0000 (0:00:05.887)       0:01:22.656 ****
2025-12-03 10:50:07.757426 | controller | ok: [instance]
2025-12-03 10:50:07.757574 | controller |
2025-12-03 10:50:07.757606 | controller | TASK [ci_setup : Create completion file] ***************************************
2025-12-03 10:50:08.040444 | controller | Wednesday 03 December 2025  10:50:07 +0000 (0:00:00.035)       0:01:22.691 ****
2025-12-03 10:50:08.040497 | controller | changed: [instance]
2025-12-03 10:50:08.308837 | controller |
2025-12-03 10:50:08.308872 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************
2025-12-03 10:50:08.308881 | controller | Wednesday 03 December 2025  10:50:08 +0000 (0:00:00.282)       0:01:22.974 ****
2025-12-03 10:50:08.308891 | controller | changed: [instance]
2025-12-03 10:50:08.326180 | controller |
2025-12-03 10:50:08.326205 | controller | TASK [ci_setup : Check rhsm status] ********************************************
2025-12-03 10:50:08.326212 | controller | Wednesday 03 December 2025  10:50:08 +0000 (0:00:00.268)       0:01:23.242 ****
2025-12-03 10:50:08.326222 | controller | skipping: [instance]
2025-12-03 10:50:08.342409 | controller |
2025-12-03 10:50:08.342435 | controller | TASK [ci_setup : Gather the repos to be enabled] *******************************
2025-12-03 10:50:08.342444 | controller | Wednesday 03 December 2025  10:50:08 +0000 (0:00:00.017)       0:01:23.260 ****
2025-12-03 10:50:08.342455 | controller | skipping: [instance]
2025-12-03 10:50:08.358439 | controller |
2025-12-03 10:50:08.358468 | controller | TASK [ci_setup : Enabling the required repositories.] **************************
2025-12-03 10:50:08.358478 | controller | Wednesday 03 December 2025  10:50:08 +0000 (0:00:00.016)       0:01:23.276 ****
2025-12-03 10:50:08.358490 | controller | skipping: [instance]
2025-12-03 10:50:08.358498 | controller |
2025-12-03 10:50:08.358504 | controller | TASK [ci_setup : Get current /etc/redhat-release] ******************************
2025-12-03 10:50:08.358513 | controller | Wednesday 03 December 2025  10:50:08 +0000 (0:00:00.016)       0:01:23.292 ****
2025-12-03 10:50:08.374840 | controller | skipping: [instance]
2025-12-03 10:50:08.391791 | controller |
2025-12-03 10:50:08.391815 | controller | TASK [ci_setup : Print current /etc/redhat-release] ****************************
2025-12-03 10:50:08.391832 | controller | Wednesday 03 December 2025  10:50:08 +0000 (0:00:00.016)       0:01:23.309 ****
2025-12-03 10:50:08.391845 | controller | skipping: [instance]
2025-12-03 10:50:08.412310 | controller |
2025-12-03 10:50:08.412341 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
2025-12-03 10:50:08.412351 | controller | Wednesday 03 December 2025  10:50:08 +0000 (0:00:00.016)       0:01:23.326 ****
2025-12-03 10:50:08.412360 | controller | skipping: [instance]
2025-12-03 10:50:09.361475 | controller |
2025-12-03 10:50:09.361514 | controller | TASK [ci_setup : Manage directories] *******************************************
2025-12-03 10:50:09.361524 | controller | Wednesday 03 December 2025  10:50:08 +0000 (0:00:00.020)       0:01:23.346 ****
2025-12-03 10:50:09.361537 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr)
2025-12-03 10:50:09.361570 | controller | changed: [instance] => (item=/opt/basedir/logs)
2025-12-03 10:50:09.361579 | controller | ok: [instance] => (item=/opt/basedir/tmp)
2025-12-03 10:50:09.361587 | controller | changed: [instance] => (item=/opt/basedir/volumes)
2025-12-03 10:50:09.361598 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters)
2025-12-03 10:50:09.361607 | controller |
2025-12-03 10:50:09.361616 | controller | TASK [Create secret file] ******************************************************
2025-12-03 10:50:09.361626 | controller | Wednesday 03 December 2025  10:50:09 +0000 (0:00:00.948)       0:01:24.295 ****
2025-12-03 10:50:09.676475 | controller | changed: [instance]
2025-12-03 10:50:09.676557 | controller |
2025-12-03 10:50:09.676579 | controller | PLAY RECAP *********************************************************************
2025-12-03 10:50:09.676592 | controller | instance                   : ok=31   changed=17   unreachable=0    failed=0    skipped=36   rescued=0    ignored=0
2025-12-03 10:50:09.676600 | controller |
2025-12-03 10:50:09.676608 | controller | Wednesday 03 December 2025  10:50:09 +0000 (0:00:00.314)       0:01:24.610 ****
2025-12-03 10:50:09.676630 | controller | ===============================================================================
2025-12-03 10:50:09.676637 | controller | test_deps : Install selinux python libs -------------------------------- 50.10s
2025-12-03 10:50:09.677453 | controller | ci_setup : Install needed packages -------------------------------------- 7.72s
2025-12-03 10:50:09.677558 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.43s
2025-12-03 10:50:09.677569 | controller | ci_setup : Install openshift client ------------------------------------- 5.89s
2025-12-03 10:50:09.677575 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 1.53s
2025-12-03 10:50:09.677580 | controller | test_deps : Install python yaml libs ------------------------------------ 1.12s
2025-12-03 10:50:09.677586 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.02s
2025-12-03 10:50:09.677591 | controller | ci_setup : Manage directories ------------------------------------------- 0.95s
2025-12-03 10:50:09.677599 | controller | Gathering Facts --------------------------------------------------------- 0.81s
2025-12-03 10:50:09.678628 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.80s
2025-12-03 10:50:09.728936 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.77s
2025-12-03 10:50:09.728957 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.70s
2025-12-03 10:50:09.728964 | controller | repo_setup : Install repo-setup package --------------------------------- 0.67s
2025-12-03 10:50:09.728969 | controller | ci_setup : Gather version of openshift client --------------------------- 0.57s
2025-12-03 10:50:09.728974 | controller | repo_setup : Ensure directories are present ----------------------------- 0.52s
2025-12-03 10:50:09.728978 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.43s
2025-12-03 10:50:09.728983 | controller | Create secret file ------------------------------------------------------ 0.31s
2025-12-03 10:50:09.728988 | controller | Create custom basedir --------------------------------------------------- 0.30s
2025-12-03 10:50:09.728994 | controller | ci_setup : Create completion file --------------------------------------- 0.28s
2025-12-03 10:50:09.729003 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.27s
2025-12-03 10:50:09.729012 | controller | INFO     Running crc_layout > converge
2025-12-03 10:50:10.272870 | controller |
2025-12-03 10:50:10.273072 | controller | PLAY [Converge] ****************************************************************
2025-12-03 10:50:10.273201 | controller |
2025-12-03 10:50:10.273350 | controller | TASK [Gathering Facts] *********************************************************
2025-12-03 10:50:10.273495 | controller | Wednesday 03 December 2025  10:50:10 +0000 (0:00:00.024)       0:00:00.024 ****
2025-12-03 10:50:11.055365 | controller | ok: [instance]
2025-12-03 10:50:11.078528 | controller |
2025-12-03 10:50:11.078569 | controller | TASK [Load networking definition from scenario file] ***************************
2025-12-03 10:50:11.078583 | controller | Wednesday 03 December 2025  10:50:11 +0000 (0:00:00.782)       0:00:00.807 ****
2025-12-03 10:50:11.078599 | controller | ok: [instance]
2025-12-03 10:50:11.078817 | controller |
2025-12-03 10:50:11.078846 | controller | TASK [discover_latest_image : Get latest image] ********************************
2025-12-03 10:50:12.710607 | controller | Wednesday 03 December 2025  10:50:11 +0000 (0:00:00.023)       0:00:00.830 ****
2025-12-03 10:50:12.710644 | controller | changed: [instance]
2025-12-03 10:50:12.735905 | controller |
2025-12-03 10:50:12.735924 | controller | TASK [discover_latest_image : Export facts accordingly] ************************
2025-12-03 10:50:12.735932 | controller | Wednesday 03 December 2025  10:50:12 +0000 (0:00:01.632)       0:00:02.462 ****
2025-12-03 10:50:12.735942 | controller | ok: [instance]
2025-12-03 10:50:12.769500 | controller |
2025-12-03 10:50:12.769540 | controller | TASK [reproducer : Load CI job environment] ************************************
2025-12-03 10:50:12.769553 | controller | Wednesday 03 December 2025  10:50:12 +0000 (0:00:00.025)       0:00:02.488 ****
2025-12-03 10:50:12.769570 | controller | skipping: [instance]
2025-12-03 10:50:12.815471 | controller |
2025-12-03 10:50:12.815492 | controller | TASK [Build final libvirt layout] **********************************************
2025-12-03 10:50:12.815501 | controller | Wednesday 03 December 2025  10:50:12 +0000 (0:00:00.033)       0:00:02.521 ****
2025-12-03 10:50:12.815511 | controller |
2025-12-03 10:50:12.892159 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] ***********
2025-12-03 10:50:12.892180 | controller | Wednesday 03 December 2025  10:50:12 +0000 (0:00:00.045)       0:00:02.567 ****
2025-12-03 10:50:12.892190 | controller | ok: [instance]
2025-12-03 10:50:12.948771 | controller |
2025-12-03 10:50:12.948804 | controller | TASK [libvirt_manager : Patch the layout if needed] ****************************
2025-12-03 10:50:12.948817 | controller | Wednesday 03 December 2025  10:50:12 +0000 (0:00:00.076)       0:00:02.644 ****
2025-12-03 10:50:12.948830 | controller | skipping: [instance]
2025-12-03 10:50:12.948964 | controller |
2025-12-03 10:50:12.949113 | controller | TASK [reproducer : Assert no conflicting parameters were passed] ***************
2025-12-03 10:50:12.949244 | controller | Wednesday 03 December 2025  10:50:12 +0000 (0:00:00.056)       0:00:02.701 ****
2025-12-03 10:50:12.975471 | controller | ok: [instance]
2025-12-03 10:50:12.975754 | controller |
2025-12-03 10:50:12.975939 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] ***
2025-12-03 10:50:12.976094 | controller | Wednesday 03 December 2025  10:50:12 +0000 (0:00:00.026)       0:00:02.727 ****
2025-12-03 10:50:12.998857 | controller | ok: [instance] => changed=false
2025-12-03 10:50:12.999057 | controller |   msg: All assertions passed
2025-12-03 10:50:12.999187 | controller |
2025-12-03 10:50:12.999324 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************
2025-12-03 10:50:12.999504 | controller | Wednesday 03 December 2025  10:50:12 +0000 (0:00:00.023)       0:00:02.751 ****
2025-12-03 10:50:13.038522 | controller | ok: [instance]
2025-12-03 10:50:13.038800 | controller |
2025-12-03 10:50:13.039078 | controller | TASK [reproducer : Ensure directories are present] *****************************
2025-12-03 10:50:13.039375 | controller | Wednesday 03 December 2025  10:50:13 +0000 (0:00:00.039)       0:00:02.790 ****
2025-12-03 10:50:13.466462 | controller | ok: [instance] => (item=artifacts)
2025-12-03 10:50:13.466598 | controller | ok: [instance] => (item=logs)
2025-12-03 10:50:13.466623 | controller |
2025-12-03 10:50:13.466631 | controller | TASK [Bootstrap libvirt if needed] *********************************************
2025-12-03 10:50:13.466647 | controller | Wednesday 03 December 2025  10:50:13 +0000 (0:00:00.427)       0:00:03.218 ****
2025-12-03 10:50:13.537879 | controller |
2025-12-03 10:50:13.723734 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************
2025-12-03 10:50:13.723753 | controller | Wednesday 03 December 2025  10:50:13 +0000 (0:00:00.071)       0:00:03.290 ****
2025-12-03 10:50:13.723763 | controller | ok: [instance]
2025-12-03 10:50:13.723937 | controller |
2025-12-03 10:50:13.723951 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] *************
2025-12-03 10:50:13.970416 | controller | Wednesday 03 December 2025  10:50:13 +0000 (0:00:00.185)       0:00:03.476 ****
2025-12-03 10:50:13.970454 | controller | changed: [instance]
2025-12-03 10:50:13.970494 | controller |
2025-12-03 10:50:13.970719 | controller | TASK [libvirt_manager : Check if KVM is enabled] *******************************
2025-12-03 10:50:14.241486 | controller | Wednesday 03 December 2025  10:50:13 +0000 (0:00:00.246)       0:00:03.722 ****
2025-12-03 10:50:14.241529 | controller | ok: [instance]
2025-12-03 10:50:14.269765 | controller |
2025-12-03 10:50:14.269791 | controller | TASK [libvirt_manager : Fail if KVM not enabled] *******************************
2025-12-03 10:50:14.269799 | controller | Wednesday 03 December 2025  10:50:14 +0000 (0:00:00.270)       0:00:03.993 ****
2025-12-03 10:50:14.269808 | controller | skipping: [instance]
2025-12-03 10:50:14.287414 | controller |
2025-12-03 10:50:14.287449 | controller | TASK [libvirt_manager : Check if VMX virtualization] ***************************
2025-12-03 10:50:14.287457 | controller | Wednesday 03 December 2025  10:50:14 +0000 (0:00:00.028)       0:00:04.022 ****
2025-12-03 10:50:14.287467 | controller | skipping: [instance]
2025-12-03 10:50:14.287492 | controller |
2025-12-03 10:50:14.287772 | controller | TASK [libvirt_manager : Check if SVM virtualization] ***************************
2025-12-03 10:50:14.308493 | controller | Wednesday 03 December 2025  10:50:14 +0000 (0:00:00.017)       0:00:04.040 ****
2025-12-03 10:50:14.308536 | controller | ok: [instance]
2025-12-03 10:50:14.308583 | controller |
2025-12-03 10:50:14.308599 | controller | TASK [libvirt_manager : Enable VMX virtualization] *****************************
2025-12-03 10:50:14.308743 | controller | Wednesday 03 December 2025  10:50:14 +0000 (0:00:00.020)       0:00:04.060 ****
2025-12-03 10:50:14.336819 | controller | skipping: [instance]
2025-12-03 10:50:25.170171 | controller |
2025-12-03 10:50:25.170208 | controller | TASK [libvirt_manager : Install packages required for using KVM] ***************
2025-12-03 10:50:25.170217 | controller | Wednesday 03 December 2025  10:50:14 +0000 (0:00:00.028)       0:00:04.088 ****
2025-12-03 10:50:25.170227 | controller | changed: [instance]
2025-12-03 10:50:25.170547 | controller |
2025-12-03 10:50:25.376418 | controller | TASK [libvirt_manager : Create rules.d polkit folder] **************************
2025-12-03 10:50:25.376447 | controller | Wednesday 03 December 2025  10:50:25 +0000 (0:00:10.833)       0:00:14.922 ****
2025-12-03 10:50:25.376459 | controller | changed: [instance]
2025-12-03 10:50:25.376495 | controller |
2025-12-03 10:50:25.376709 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] *********************
2025-12-03 10:50:25.376808 | controller | Wednesday 03 December 2025  10:50:25 +0000 (0:00:00.206)       0:00:15.128 ****
2025-12-03 10:50:25.855731 | controller | changed: [instance]
2025-12-03 10:50:25.856005 | controller |
2025-12-03 10:50:26.421399 | controller | TASK [libvirt_manager : Restart service polkit service] ************************
2025-12-03 10:50:26.421431 | controller | Wednesday 03 December 2025  10:50:25 +0000 (0:00:00.479)       0:00:15.608 ****
2025-12-03 10:50:26.421442 | controller | changed: [instance]
2025-12-03 10:50:26.421468 | controller |
2025-12-03 10:50:26.421691 | controller | TASK [libvirt_manager : Remove directory for service override] *****************
2025-12-03 10:50:26.612599 | controller | Wednesday 03 December 2025  10:50:26 +0000 (0:00:00.565)       0:00:16.173 ****
2025-12-03 10:50:26.612624 | controller | ok: [instance]
2025-12-03 10:50:27.231287 | controller |
2025-12-03 10:50:27.231323 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] ***
2025-12-03 10:50:27.231369 | controller | Wednesday 03 December 2025  10:50:26 +0000 (0:00:00.191)       0:00:16.364 ****
2025-12-03 10:50:27.231386 | controller | ok: [instance]
2025-12-03 10:50:28.104829 | controller |
2025-12-03 10:50:28.104861 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************
2025-12-03 10:50:28.104875 | controller | Wednesday 03 December 2025  10:50:27 +0000 (0:00:00.618)       0:00:16.982 ****
2025-12-03 10:50:28.104885 | controller | changed: [instance]
2025-12-03 10:50:28.183473 | controller |
2025-12-03 10:50:28.183508 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] ****
2025-12-03 10:50:28.183518 | controller | Wednesday 03 December 2025  10:50:28 +0000 (0:00:00.873)       0:00:17.856 ****
2025-12-03 10:50:28.183530 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu)
2025-12-03 10:50:28.183562 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface)
2025-12-03 10:50:28.183570 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network)
2025-12-03 10:50:28.183577 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev)
2025-12-03 10:50:28.183584 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter)
2025-12-03 10:50:28.183590 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret)
2025-12-03 10:50:28.183597 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage)
2025-12-03 10:50:28.183605 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy)
2025-12-03 10:50:28.183632 | controller |
2025-12-03 10:50:28.183823 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] *********
2025-12-03 10:50:28.503219 | controller | Wednesday 03 December 2025  10:50:28 +0000 (0:00:00.078)       0:00:17.935 ****
2025-12-03 10:50:28.503243 | controller | ok: [instance]
2025-12-03 10:50:28.799254 | controller |
2025-12-03 10:50:28.799272 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] **********
2025-12-03 10:50:28.799279 | controller | Wednesday 03 December 2025  10:50:28 +0000 (0:00:00.320)       0:00:18.255 ****
2025-12-03 10:50:28.799288 | controller | ok: [instance]
2025-12-03 10:50:29.109014 | controller |
2025-12-03 10:50:29.109052 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] **************
2025-12-03 10:50:29.109061 | controller | Wednesday 03 December 2025  10:50:28 +0000 (0:00:00.296)       0:00:18.551 ****
2025-12-03 10:50:29.109070 | controller | ok: [instance]
2025-12-03 10:50:29.407251 | controller |
2025-12-03 10:50:29.407281 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] ****
2025-12-03 10:50:29.407289 | controller | Wednesday 03 December 2025  10:50:29 +0000 (0:00:00.309)       0:00:18.861 ****
2025-12-03 10:50:29.407299 | controller | ok: [instance]
2025-12-03 10:50:29.710267 | controller |
2025-12-03 10:50:29.710293 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] *****
2025-12-03 10:50:29.710301 | controller | Wednesday 03 December 2025  10:50:29 +0000 (0:00:00.298)       0:00:19.159 ****
2025-12-03 10:50:29.710311 | controller | ok: [instance]
2025-12-03 10:50:30.016200 | controller |
2025-12-03 10:50:30.016235 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] *********
2025-12-03 10:50:30.016243 | controller | Wednesday 03 December 2025  10:50:29 +0000 (0:00:00.303)       0:00:19.462 ****
2025-12-03 10:50:30.016254 | controller | ok: [instance]
2025-12-03 10:50:30.314443 | controller |
2025-12-03 10:50:30.314478 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ******
2025-12-03 10:50:30.314486 | controller | Wednesday 03 December 2025  10:50:30 +0000 (0:00:00.305)       0:00:19.768 ****
2025-12-03 10:50:30.314497 | controller | ok: [instance]
2025-12-03 10:50:30.618383 | controller |
2025-12-03 10:50:30.618414 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] *******
2025-12-03 10:50:30.618421 | controller | Wednesday 03 December 2025  10:50:30 +0000 (0:00:00.298)       0:00:20.066 ****
2025-12-03 10:50:30.618438 | controller | ok: [instance]
2025-12-03 10:50:30.917399 | controller |
2025-12-03 10:50:30.917427 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] ***********
2025-12-03 10:50:30.917434 | controller | Wednesday 03 December 2025  10:50:30 +0000 (0:00:00.303)       0:00:20.370 ****
2025-12-03 10:50:30.917444 | controller | ok: [instance]
2025-12-03 10:50:30.917466 | controller |
2025-12-03 10:50:30.917576 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ******
2025-12-03 10:50:30.917696 | controller | Wednesday 03 December 2025  10:50:30 +0000 (0:00:00.299)       0:00:20.669 ****
2025-12-03 10:50:31.215404 | controller | ok: [instance]
2025-12-03 10:50:31.215449 | controller |
2025-12-03 10:50:31.215689 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] *******
2025-12-03 10:50:31.513869 | controller | Wednesday 03 December 2025  10:50:31 +0000 (0:00:00.297)       0:00:20.967 ****
2025-12-03 10:50:31.513906 | controller | ok: [instance]
2025-12-03 10:50:31.810953 | controller |
2025-12-03 10:50:31.810988 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] ***********
2025-12-03 10:50:31.810996 | controller | Wednesday 03 December 2025  10:50:31 +0000 (0:00:00.298)       0:00:21.265 ****
2025-12-03 10:50:31.811007 | controller | ok: [instance]
2025-12-03 10:50:32.114356 | controller |
2025-12-03 10:50:32.114387 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] *****
2025-12-03 10:50:32.114395 | controller | Wednesday 03 December 2025  10:50:31 +0000 (0:00:00.297)       0:00:21.562 ****
2025-12-03 10:50:32.114406 | controller | ok: [instance]
2025-12-03 10:50:32.426199 | controller |
2025-12-03 10:50:32.426235 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ******
2025-12-03 10:50:32.426244 | controller | Wednesday 03 December 2025  10:50:32 +0000 (0:00:00.303)       0:00:21.866 ****
2025-12-03 10:50:32.426257 | controller | ok: [instance]
2025-12-03 10:50:32.745222 | controller |
2025-12-03 10:50:32.745251 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] **********
2025-12-03 10:50:32.745259 | controller | Wednesday 03 December 2025  10:50:32 +0000 (0:00:00.311)       0:00:22.178 ****
2025-12-03 10:50:32.745268 | controller | ok: [instance]
2025-12-03 10:50:33.050415 | controller |
2025-12-03 10:50:33.050452 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] *******
2025-12-03 10:50:33.050460 | controller | Wednesday 03 December 2025  10:50:32 +0000 (0:00:00.319)       0:00:22.497 ****
2025-12-03 10:50:33.050472 | controller | ok: [instance]
2025-12-03 10:50:33.050504 | controller |
2025-12-03 10:50:33.050519 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ********
2025-12-03 10:50:33.050612 | controller | Wednesday 03 December 2025  10:50:33 +0000 (0:00:00.305)       0:00:22.802 ****
2025-12-03 10:50:33.355925 | controller | ok: [instance]
2025-12-03 10:50:33.659293 | controller |
2025-12-03 10:50:33.659342 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************
2025-12-03 10:50:33.659354 | controller | Wednesday 03 December 2025  10:50:33 +0000 (0:00:00.305)       0:00:23.107 ****
2025-12-03 10:50:33.659365 | controller | ok: [instance]
2025-12-03 10:50:33.956996 | controller |
2025-12-03 10:50:33.957020 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ******
2025-12-03 10:50:33.957027 | controller | Wednesday 03 December 2025  10:50:33 +0000 (0:00:00.303)       0:00:23.411 ****
2025-12-03 10:50:33.957046 | controller | ok: [instance]
2025-12-03 10:50:34.271416 | controller |
2025-12-03 10:50:34.271449 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] *******
2025-12-03 10:50:34.271459 | controller | Wednesday 03 December 2025  10:50:33 +0000 (0:00:00.298)       0:00:23.709 ****
2025-12-03 10:50:34.271471 | controller | ok: [instance]
2025-12-03 10:50:34.271497 | controller |
2025-12-03 10:50:34.271508 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] ***********
2025-12-03 10:50:34.271584 | controller | Wednesday 03 December 2025  10:50:34 +0000 (0:00:00.314)       0:00:24.023 ****
2025-12-03 10:50:34.596253 | controller | ok: [instance]
2025-12-03 10:50:34.913284 | controller |
2025-12-03 10:50:34.913314 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ********
2025-12-03 10:50:34.913321 | controller | Wednesday 03 December 2025  10:50:34 +0000 (0:00:00.324)       0:00:24.348 ****
2025-12-03 10:50:34.913353 | controller | ok: [instance]
2025-12-03 10:50:35.229386 | controller |
2025-12-03 10:50:35.229417 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] *********
2025-12-03 10:50:35.229424 | controller | Wednesday 03 December 2025  10:50:34 +0000 (0:00:00.317)       0:00:24.665 ****
2025-12-03 10:50:35.229435 | controller | ok: [instance]
2025-12-03 10:50:35.541474 | controller |
2025-12-03 10:50:35.541503 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] *************
2025-12-03 10:50:35.541510 | controller | Wednesday 03 December 2025  10:50:35 +0000 (0:00:00.315)       0:00:24.981 ****
2025-12-03 10:50:35.541520 | controller | ok: [instance]
2025-12-03 10:50:35.561936 | controller |
2025-12-03 10:50:35.561953 | controller | TASK [libvirt_manager : Manage service for older releases] *********************
2025-12-03 10:50:35.561960 | controller | Wednesday 03 December 2025  10:50:35 +0000 (0:00:00.312)       0:00:25.293 ****
2025-12-03 10:50:35.561969 | controller | skipping: [instance]
2025-12-03 10:50:35.859989 | controller |
2025-12-03 10:50:35.860017 | controller | TASK [libvirt_manager : Get libvirt group users] *******************************
2025-12-03 10:50:35.860024 | controller | Wednesday 03 December 2025  10:50:35 +0000 (0:00:00.020)       0:00:25.314 ****
2025-12-03 10:50:35.860033 | controller | ok: [instance]
2025-12-03 10:50:36.221680 | controller |
2025-12-03 10:50:36.221708 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] ***************
2025-12-03 10:50:36.221716 | controller | Wednesday 03 December 2025  10:50:35 +0000 (0:00:00.297)       0:00:25.612 ****
2025-12-03 10:50:36.221726 | controller | ok: [instance]
2025-12-03 10:50:36.528024 | controller |
2025-12-03 10:50:36.528064 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] ***
2025-12-03 10:50:36.528072 | controller | Wednesday 03 December 2025  10:50:36 +0000 (0:00:00.361)       0:00:25.973 ****
2025-12-03 10:50:36.528082 | controller | changed: [instance]
2025-12-03 10:50:36.808579 | controller |
2025-12-03 10:50:36.808618 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] *********
2025-12-03 10:50:36.808632 | controller | Wednesday 03 December 2025  10:50:36 +0000 (0:00:00.306)       0:00:26.279 ****
2025-12-03 10:50:36.808648 | controller | [WARNING]: Reset is not implemented for this connection
2025-12-03 10:50:36.817495 | controller | changed: [instance]
2025-12-03 10:50:36.817538 | controller |
2025-12-03 10:50:36.817550 | controller | TASK [libvirt_manager : Ensure we reload user env] *****************************
2025-12-03 10:50:36.817994 | controller | Wednesday 03 December 2025  10:50:36 +0000 (0:00:00.275)       0:00:26.555 ****
2025-12-03 10:50:36.890515 | controller |
2025-12-03 10:50:36.890547 | controller | TASK [reproducer : Deploy networks in libvirt] *********************************
2025-12-03 10:50:36.890560 | controller | Wednesday 03 December 2025  10:50:36 +0000 (0:00:00.014)       0:00:26.569 ****
2025-12-03 10:50:36.890575 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance
2025-12-03 10:50:36.890885 | controller |
2025-12-03 10:50:36.890905 | controller | TASK [reproducer : Ensure networks are consistent] *****************************
2025-12-03 10:50:36.931456 | controller | Wednesday 03 December 2025  10:50:36 +0000 (0:00:00.072)       0:00:26.642 ****
2025-12-03 10:50:36.931485 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance
2025-12-03 10:50:36.931687 | controller |
2025-12-03 10:50:36.931707 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2025-12-03 10:50:37.015460 | controller | Wednesday 03 December 2025  10:50:36 +0000 (0:00:00.041)       0:00:26.683 ****
2025-12-03 10:50:37.015484 | controller | ok: [instance] => (item=compute)
2025-12-03 10:50:37.015513 | controller | ok: [instance] => (item=controller)
2025-12-03 10:50:37.015520 | controller | ok: [instance] => (item=crc)
2025-12-03 10:50:37.015526 | controller |
2025-12-03 10:50:37.015534 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2025-12-03 10:50:37.015591 | controller | Wednesday 03 December 2025  10:50:37 +0000 (0:00:00.083)       0:00:26.767 ****
2025-12-03 10:50:37.057349 | controller | ok: [instance]
2025-12-03 10:50:37.097869 | controller |
2025-12-03 10:50:37.097885 | controller | TASK [reproducer : Ensure we don't have extra network defined] *****************
2025-12-03 10:50:37.097897 | controller | Wednesday 03 December 2025  10:50:37 +0000 (0:00:00.041)       0:00:26.809 ****
2025-12-03 10:50:37.097905 | controller | ok: [instance] => changed=false
2025-12-03 10:50:37.098059 | controller |   msg: All assertions passed
2025-12-03 10:50:37.098186 | controller |
2025-12-03 10:50:37.098312 | controller | TASK [Ensure we get latest OCP config] *****************************************
2025-12-03 10:50:37.098461 | controller | Wednesday 03 December 2025  10:50:37 +0000 (0:00:00.040)       0:00:26.850 ****
2025-12-03 10:50:37.137200 | controller |
2025-12-03 10:50:37.137536 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] *****
2025-12-03 10:50:37.137746 | controller | Wednesday 03 December 2025  10:50:37 +0000 (0:00:00.039)       0:00:26.889 ****
2025-12-03 10:50:37.207420 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.0', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'})
2025-12-03 10:50:37.207724 | controller | ok: [instance] => (item={})
2025-12-03 10:50:37.207873 | controller |
2025-12-03 10:50:37.207999 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] ****************
2025-12-03 10:50:37.208137 | controller | Wednesday 03 December 2025  10:50:37 +0000 (0:00:00.070)       0:00:26.959 ****
2025-12-03 10:50:37.225130 | controller | skipping: [instance]
2025-12-03 10:50:37.225317 | controller |
2025-12-03 10:50:37.225539 | controller | TASK [devscripts : Ensure output directory exists] *****************************
2025-12-03 10:50:37.225714 | controller | Wednesday 03 December 2025  10:50:37 +0000 (0:00:00.017)       0:00:26.977 ****
2025-12-03 10:50:37.433661 | controller | ok: [instance]
2025-12-03 10:50:37.757756 | controller |
2025-12-03 10:50:37.757785 | controller | TASK [devscripts : Output built config for easier debugging] *******************
2025-12-03 10:50:37.757792 | controller | Wednesday 03 December 2025  10:50:37 +0000 (0:00:00.208)       0:00:27.185 ****
2025-12-03 10:50:37.757802 | controller | changed: [instance]
2025-12-03 10:50:38.458404 | controller |
2025-12-03 10:50:38.458434 | controller | TASK [ci_network : Remove the local dns configuration] *************************
2025-12-03 10:50:38.458442 | controller | Wednesday 03 December 2025  10:50:37 +0000 (0:00:00.324)       0:00:27.509 ****
2025-12-03 10:50:38.458452 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf)
2025-12-03 10:50:38.458813 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf)
2025-12-03 10:50:38.458830 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf)
2025-12-03 10:50:38.458840 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf)
2025-12-03 10:50:38.485530 | controller |
2025-12-03 10:50:38.485581 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] **************
2025-12-03 10:50:38.485594 | controller | Wednesday 03 December 2025  10:50:38 +0000 (0:00:00.700)       0:00:28.210 ****
2025-12-03 10:50:38.485612 | controller | skipping: [instance]
2025-12-03 10:50:38.485623 | controller |
2025-12-03 10:50:38.485633 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] *********
2025-12-03 10:50:38.485645 | controller | Wednesday 03 December 2025  10:50:38 +0000 (0:00:00.027)       0:00:28.237 ****
2025-12-03 10:50:38.836524 | controller | changed: [instance]
2025-12-03 10:50:38.836603 | controller |
2025-12-03 10:50:38.836617 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ******************
2025-12-03 10:50:38.836632 | controller | Wednesday 03 December 2025  10:50:38 +0000 (0:00:00.342)       0:00:28.580 ****
2025-12-03 10:50:38.836669 | controller |
2025-12-03 10:50:38.836883 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2025-12-03 10:50:39.248181 | controller | Wednesday 03 December 2025  10:50:38 +0000 (0:00:00.008)       0:00:28.588 ****
2025-12-03 10:50:39.248229 | controller | changed: [instance]
2025-12-03 10:50:39.321483 | controller |
2025-12-03 10:50:39.321522 | controller | TASK [Ensure no default networks exists] ***************************************
2025-12-03 10:50:39.321536 | controller | Wednesday 03 December 2025  10:50:39 +0000 (0:00:00.411)       0:00:29.000 ****
2025-12-03 10:50:39.321549 | controller |
2025-12-03 10:50:39.321582 | controller | TASK [libvirt_manager : Deactivate crc] ****************************************
2025-12-03 10:50:39.321698 | controller | Wednesday 03 December 2025  10:50:39 +0000 (0:00:00.073)       0:00:29.073 ****
2025-12-03 10:50:40.472452 | controller | ok: [instance]
2025-12-03 10:50:40.472536 | controller |
2025-12-03 10:50:40.472600 | controller | TASK [libvirt_manager : Removing crc] ******************************************
2025-12-03 10:50:40.472748 | controller | Wednesday 03 December 2025  10:50:40 +0000 (0:00:01.150)       0:00:30.224 ****
2025-12-03 10:50:40.694492 | controller | ok: [instance]
2025-12-03 10:50:40.694601 | controller |
2025-12-03 10:50:40.694632 | controller | TASK [libvirt_manager : Deactivate default] ************************************
2025-12-03 10:50:40.694644 | controller | Wednesday 03 December 2025  10:50:40 +0000 (0:00:00.222)       0:00:30.446 ****
2025-12-03 10:50:41.200234 | controller | ok: [instance]
2025-12-03 10:50:41.417417 | controller |
2025-12-03 10:50:41.417461 | controller | TASK [libvirt_manager : Removing default] **************************************
2025-12-03 10:50:41.417473 | controller | Wednesday 03 December 2025  10:50:41 +0000 (0:00:00.505)       0:00:30.952 ****
2025-12-03 10:50:41.417489 | controller | ok: [instance]
2025-12-03 10:50:42.540400 | controller |
2025-12-03 10:50:42.540430 | controller | TASK [reproducer : Ensure firewalld is installed] ******************************
2025-12-03 10:50:42.540437 | controller | Wednesday 03 December 2025  10:50:41 +0000 (0:00:00.217)       0:00:31.169 ****
2025-12-03 10:50:42.540447 | controller | ok: [instance]
2025-12-03 10:50:42.540469 | controller |
2025-12-03 10:50:42.540655 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************
2025-12-03 10:50:42.833262 | controller | Wednesday 03 December 2025  10:50:42 +0000 (0:00:01.123)       0:00:32.292 ****
2025-12-03 10:50:42.833301 | controller | ok: [instance]
2025-12-03 10:50:43.125686 | controller |
2025-12-03 10:50:43.125717 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] ***********************
2025-12-03 10:50:43.125725 | controller | Wednesday 03 December 2025  10:50:42 +0000 (0:00:00.292)       0:00:32.585 ****
2025-12-03 10:50:43.125735 | controller | changed: [instance]
2025-12-03 10:50:43.417408 | controller |
2025-12-03 10:50:43.417457 | controller | TASK [reproducer : Ensure IP forwarding is enabled] ****************************
2025-12-03 10:50:43.417466 | controller | Wednesday 03 December 2025  10:50:43 +0000 (0:00:00.292)       0:00:32.877 ****
2025-12-03 10:50:43.417477 | controller | changed: [instance]
2025-12-03 10:50:43.959476 | controller |
2025-12-03 10:50:43.959508 | controller | TASK [reproducer : Ensure the required parameters are loaded] ******************
2025-12-03 10:50:43.959519 | controller | Wednesday 03 December 2025  10:50:43 +0000 (0:00:00.291)       0:00:33.169 ****
2025-12-03 10:50:43.959535 | controller | changed: [instance] => (item=arptables)
2025-12-03 10:50:43.959581 | controller | changed: [instance] => (item=iptables)
2025-12-03 10:50:43.959595 | controller | changed: [instance] => (item=ip6tables)
2025-12-03 10:50:43.959889 | controller |
2025-12-03 10:50:44.271950 | controller | TASK [reproducer : Ensure firewall service is enabled and started] *************
2025-12-03 10:50:44.271983 | controller | Wednesday 03 December 2025  10:50:43 +0000 (0:00:00.542)       0:00:33.711 ****
2025-12-03 10:50:44.271997 | controller | ok: [instance]
2025-12-03 10:50:44.358029 | controller |
2025-12-03 10:50:44.358099 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] *************
2025-12-03 10:50:44.358109 | controller | Wednesday 03 December 2025  10:50:44 +0000 (0:00:00.312)       0:00:34.024 ****
2025-12-03 10:50:44.358122 | controller | ok: [instance]
2025-12-03 10:50:44.398432 | controller |
2025-12-03 10:50:44.398454 | controller | TASK [Ensure the required network configurations are applied] ******************
2025-12-03 10:50:44.398463 | controller | Wednesday 03 December 2025  10:50:44 +0000 (0:00:00.085)       0:00:34.110 ****
2025-12-03 10:50:44.398473 | controller |
2025-12-03 10:50:44.398520 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] ***
2025-12-03 10:50:44.398544 | controller | Wednesday 03 December 2025  10:50:44 +0000 (0:00:00.040)       0:00:34.150 ****
2025-12-03 10:50:44.421508 | controller | skipping: [instance]
2025-12-03 10:50:44.445040 | controller |
2025-12-03 10:50:44.445076 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ******
2025-12-03 10:50:44.445084 | controller | Wednesday 03 December 2025  10:50:44 +0000 (0:00:00.022)       0:00:34.173 ****
2025-12-03 10:50:44.445095 | controller | skipping: [instance]
2025-12-03 10:50:44.467378 | controller |
2025-12-03 10:50:44.467422 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2025-12-03 10:50:44.467430 | controller | Wednesday 03 December 2025  10:50:44 +0000 (0:00:00.023)       0:00:34.197 ****
2025-12-03 10:50:44.467442 | controller | skipping: [instance]
2025-12-03 10:50:44.493586 | controller |
2025-12-03 10:50:44.493625 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ******
2025-12-03 10:50:44.493633 | controller | Wednesday 03 December 2025  10:50:44 +0000 (0:00:00.022)       0:00:34.219 ****
2025-12-03 10:50:44.493645 | controller | skipping: [instance]
2025-12-03 10:50:44.493716 | controller |
2025-12-03 10:50:44.493830 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] **********************
2025-12-03 10:50:44.493939 | controller | Wednesday 03 December 2025  10:50:44 +0000 (0:00:00.026)       0:00:34.246 ****
2025-12-03 10:50:44.530071 | controller | ok: [instance]
2025-12-03 10:50:44.530229 | controller |
2025-12-03 10:50:44.530392 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] ***
2025-12-03 10:50:44.530544 | controller | Wednesday 03 December 2025  10:50:44 +0000 (0:00:00.036)       0:00:34.282 ****
2025-12-03 10:50:44.561429 | controller | skipping: [instance]
2025-12-03 10:50:44.561579 | controller |
2025-12-03 10:50:44.561719 | controller | TASK [ci_nmstate : Get k8s nodes] **********************************************
2025-12-03 10:50:44.561825 | controller | Wednesday 03 December 2025  10:50:44 +0000 (0:00:00.031)       0:00:34.313 ****
2025-12-03 10:50:44.582357 | controller | skipping: [instance]
2025-12-03 10:50:44.582526 | controller |
2025-12-03 10:50:44.582673 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ********
2025-12-03 10:50:44.582791 | controller | Wednesday 03 December 2025  10:50:44 +0000 (0:00:00.021)       0:00:34.334 ****
2025-12-03 10:50:44.636509 | controller | ok: [instance]
2025-12-03 10:50:44.636675 | controller |
2025-12-03 10:50:44.636828 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] *************************
2025-12-03 10:50:44.636961 | controller | Wednesday 03 December 2025  10:50:44 +0000 (0:00:00.054)       0:00:34.389 ****
2025-12-03 10:50:44.659896 | controller | skipping: [instance]
2025-12-03 10:50:44.659934 | controller |
2025-12-03 10:50:44.659943 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] *********************
2025-12-03 10:50:44.659956 | controller | Wednesday 03 December 2025  10:50:44 +0000 (0:00:00.023)       0:00:34.412 ****
2025-12-03 10:50:44.706752 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost)
2025-12-03 10:50:44.706961 | controller |
2025-12-03 10:50:44.707064 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2025-12-03 10:50:44.707189 | controller | Wednesday 03 December 2025  10:50:44 +0000 (0:00:00.046)       0:00:34.458 ****
2025-12-03 10:50:45.019603 | controller | ok: [instance -> localhost]
2025-12-03 10:50:45.019681 | controller |
2025-12-03 10:50:45.019839 | controller | TASK [ci_nmstate : Install required packages on localhost] *********************
2025-12-03 10:50:45.019929 | controller | Wednesday 03 December 2025  10:50:45 +0000 (0:00:00.312)       0:00:34.771 ****
2025-12-03 10:50:50.146854 | controller | changed: [instance -> localhost]
2025-12-03 10:50:50.336173 | controller |
2025-12-03 10:50:50.336213 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2025-12-03 10:50:50.336220 | controller | Wednesday 03 December 2025  10:50:50 +0000 (0:00:05.127)       0:00:39.898 ****
2025-12-03 10:50:50.336231 | controller | changed: [instance]
2025-12-03 10:50:50.672382 | controller |
2025-12-03 10:50:50.672411 | controller | TASK [ci_nmstate : Save nmstate state for localhost] ***************************
2025-12-03 10:50:50.672419 | controller | Wednesday 03 December 2025  10:50:50 +0000 (0:00:00.189)       0:00:40.088 ****
2025-12-03 10:50:50.672435 | controller | changed: [instance]
2025-12-03 10:50:52.248405 | controller |
2025-12-03 10:50:52.248435 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] *********************
2025-12-03 10:50:52.248443 | controller | Wednesday 03 December 2025  10:50:50 +0000 (0:00:00.336)       0:00:40.424 ****
2025-12-03 10:50:52.248453 | controller | changed: [instance -> localhost]
2025-12-03 10:50:52.248478 | controller |
2025-12-03 10:50:52.248677 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ******************
2025-12-03 10:50:52.575395 | controller | Wednesday 03 December 2025  10:50:52 +0000 (0:00:01.576)       0:00:42.000 ****
2025-12-03 10:50:52.575426 | controller | changed: [instance]
2025-12-03 10:50:52.575523 | controller |
2025-12-03 10:50:52.575552 | controller | TASK [reproducer : Select right domain] ****************************************
2025-12-03 10:50:52.575564 | controller | Wednesday 03 December 2025  10:50:52 +0000 (0:00:00.327)       0:00:42.327 ****
2025-12-03 10:50:52.604394 | controller | ok: [instance]
2025-12-03 10:50:52.604737 | controller |
2025-12-03 10:50:52.713406 | controller | TASK [Create the virtual networks] *********************************************
2025-12-03 10:50:52.713443 | controller | Wednesday 03 December 2025  10:50:52 +0000 (0:00:00.029)       0:00:42.356 ****
2025-12-03 10:50:52.713457 | controller |
2025-12-03 10:50:52.713606 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ********************
2025-12-03 10:50:52.713622 | controller | Wednesday 03 December 2025  10:50:52 +0000 (0:00:00.108)       0:00:42.465 ****
2025-12-03 10:50:52.731250 | controller | ok: [instance]
2025-12-03 10:50:52.911110 | controller |
2025-12-03 10:50:52.911148 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] *******
2025-12-03 10:50:52.911157 | controller | Wednesday 03 December 2025  10:50:52 +0000 (0:00:00.017)       0:00:42.483 ****
2025-12-03 10:50:52.911169 | controller | ok: [instance]
2025-12-03 10:50:52.938992 | controller |
2025-12-03 10:50:52.939015 | controller | TASK [libvirt_manager : Load file if exists] ***********************************
2025-12-03 10:50:52.939024 | controller | Wednesday 03 December 2025  10:50:52 +0000 (0:00:00.179)       0:00:42.662 ****
2025-12-03 10:50:52.939034 | controller | skipping: [instance]
2025-12-03 10:50:52.965156 | controller |
2025-12-03 10:50:52.965183 | controller | TASK [libvirt_manager : Update fact with existing content] *********************
2025-12-03 10:50:52.965192 | controller | Wednesday 03 December 2025  10:50:52 +0000 (0:00:00.028)       0:00:42.691 ****
2025-12-03 10:50:52.965203 | controller | skipping: [instance]
2025-12-03 10:50:52.965407 | controller |
2025-12-03 10:50:52.965589 | controller | TASK [libvirt_manager : Generate VM list] **************************************
2025-12-03 10:50:52.965726 | controller | Wednesday 03 December 2025  10:50:52 +0000 (0:00:00.026)       0:00:42.717 ****
2025-12-03 10:50:53.014362 | controller | ok: [instance]
2025-12-03 10:50:53.014535 | controller |
2025-12-03 10:50:53.014692 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] *********************
2025-12-03 10:50:53.014841 | controller | Wednesday 03 December 2025  10:50:53 +0000 (0:00:00.049)       0:00:42.766 ****
2025-12-03 10:50:53.154866 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'})
2025-12-03 10:50:53.155053 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'})
2025-12-03 10:50:53.155217 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'})
2025-12-03 10:50:53.155378 | controller |
2025-12-03 10:50:53.155535 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] **********************
2025-12-03 10:50:53.155673 | controller | Wednesday 03 December 2025  10:50:53 +0000 (0:00:00.140)       0:00:42.907 ****
2025-12-03 10:50:53.187734 | controller | skipping: [instance]
2025-12-03 10:50:53.187895 | controller |
2025-12-03 10:50:53.188038 | controller | TASK [libvirt_manager : Dump MAC mapping] **************************************
2025-12-03 10:50:53.188191 | controller | Wednesday 03 December 2025  10:50:53 +0000 (0:00:00.032)       0:00:42.940 ****
2025-12-03 10:50:53.517483 | controller | changed: [instance]
2025-12-03 10:50:53.517542 | controller |
2025-12-03 10:50:53.517554 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] ***********************
2025-12-03 10:50:53.517648 | controller | Wednesday 03 December 2025  10:50:53 +0000 (0:00:00.329)       0:00:43.269 ****
2025-12-03 10:50:53.603492 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes)
2025-12-03 10:50:53.603541 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers)
2025-12-03 10:50:53.603550 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps)
2025-12-03 10:50:53.603559 | controller |
2025-12-03 10:50:53.603752 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2025-12-03 10:50:53.654446 | controller | Wednesday 03 December 2025  10:50:53 +0000 (0:00:00.085)       0:00:43.355 ****
2025-12-03 10:50:53.654481 | controller | changed: [instance]
2025-12-03 10:50:53.654521 | controller |
2025-12-03 10:50:53.654531 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2025-12-03 10:50:53.654654 | controller | Wednesday 03 December 2025  10:50:53 +0000 (0:00:00.051)       0:00:43.406 ****
2025-12-03 10:50:53.923298 | controller | changed: [instance]
2025-12-03 10:50:54.127844 | controller |
2025-12-03 10:50:54.127876 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2025-12-03 10:50:54.127884 | controller | Wednesday 03 December 2025  10:50:53 +0000 (0:00:00.268)       0:00:43.675 ****
2025-12-03 10:50:54.127894 | controller | changed: [instance]
2025-12-03 10:50:54.177499 | controller |
2025-12-03 10:50:54.177532 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2025-12-03 10:50:54.177541 | controller | Wednesday 03 December 2025  10:50:54 +0000 (0:00:00.204)       0:00:43.879 ****
2025-12-03 10:50:54.177552 | controller | changed: [instance]
2025-12-03 10:50:54.177587 | controller |
2025-12-03 10:50:54.177595 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2025-12-03 10:50:54.177604 | controller | Wednesday 03 December 2025  10:50:54 +0000 (0:00:00.049)       0:00:43.929 ****
2025-12-03 10:50:54.374416 | controller | changed: [instance]
2025-12-03 10:50:54.374470 | controller |
2025-12-03 10:50:54.374697 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2025-12-03 10:50:54.582701 | controller | Wednesday 03 December 2025  10:50:54 +0000 (0:00:00.196)       0:00:44.126 ****
2025-12-03 10:50:54.582732 | controller | changed: [instance]
2025-12-03 10:50:54.635505 | controller |
2025-12-03 10:50:54.635526 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2025-12-03 10:50:54.635535 | controller | Wednesday 03 December 2025  10:50:54 +0000 (0:00:00.208)       0:00:44.334 ****
2025-12-03 10:50:54.635544 | controller | changed: [instance]
2025-12-03 10:50:54.827904 | controller |
2025-12-03 10:50:54.827928 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2025-12-03 10:50:54.827936 | controller | Wednesday 03 December 2025  10:50:54 +0000 (0:00:00.052)       0:00:44.387 ****
2025-12-03 10:50:54.827945 | controller | changed: [instance]
2025-12-03 10:50:55.037725 | controller |
2025-12-03 10:50:55.037757 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2025-12-03 10:50:55.037764 | controller | Wednesday 03 December 2025  10:50:54 +0000 (0:00:00.192)       0:00:44.580 ****
2025-12-03 10:50:55.037774 | controller | changed: [instance]
2025-12-03 10:50:55.231076 | controller |
2025-12-03 10:50:55.231108 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ********************
2025-12-03 10:50:55.231116 | controller | Wednesday 03 December 2025  10:50:55 +0000 (0:00:00.209)       0:00:44.789 ****
2025-12-03 10:50:55.231126 | controller | ok: [instance]
2025-12-03 10:50:55.725349 | controller |
2025-12-03 10:50:55.725379 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ******************
2025-12-03 10:50:55.725387 | controller | Wednesday 03 December 2025  10:50:55 +0000 (0:00:00.193)       0:00:44.982 ****
2025-12-03 10:50:55.725397 | controller | changed: [instance]
2025-12-03 10:50:55.749097 | controller |
2025-12-03 10:50:55.749119 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2025-12-03 10:50:55.749126 | controller | Wednesday 03 December 2025  10:50:55 +0000 (0:00:00.494)       0:00:45.477 ****
2025-12-03 10:50:55.749140 | controller | skipping: [instance]
2025-12-03 10:50:55.772459 | controller |
2025-12-03 10:50:55.772498 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2025-12-03 10:50:55.772509 | controller | Wednesday 03 December 2025  10:50:55 +0000 (0:00:00.024)       0:00:45.501 ****
2025-12-03 10:50:55.772522 | controller | skipping: [instance]
2025-12-03 10:50:55.772555 | controller |
2025-12-03 10:50:55.772567 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2025-12-03 10:50:55.772652 | controller | Wednesday 03 December 2025  10:50:55 +0000 (0:00:00.023)       0:00:45.524 ****
2025-12-03 10:50:55.796043 | controller | skipping: [instance]
2025-12-03 10:50:55.818536 | controller |
2025-12-03 10:50:55.818565 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2025-12-03 10:50:55.818575 | controller | Wednesday 03 December 2025  10:50:55 +0000 (0:00:00.023)       0:00:45.548 ****
2025-12-03 10:50:55.818587 | controller | skipping: [instance]
2025-12-03 10:50:55.838021 | controller |
2025-12-03 10:50:55.838049 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2025-12-03 10:50:55.838056 | controller | Wednesday 03 December 2025  10:50:55 +0000 (0:00:00.022)       0:00:45.570 ****
2025-12-03 10:50:55.838078 | controller | ok: [instance]
2025-12-03 10:50:55.913127 | controller |
2025-12-03 10:50:55.913156 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2025-12-03 10:50:55.913166 | controller | Wednesday 03 December 2025  10:50:55 +0000 (0:00:00.019)       0:00:45.590 ****
2025-12-03 10:50:55.913181 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2025-12-03 10:50:55.913352 | controller |
2025-12-03 10:50:55.913514 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2025-12-03 10:50:55.913658 | controller | Wednesday 03 December 2025  10:50:55 +0000 (0:00:00.074)       0:00:45.664 ****
2025-12-03 10:50:55.930906 | controller | skipping: [instance]
2025-12-03 10:50:55.931101 | controller |
2025-12-03 10:50:55.931260 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2025-12-03 10:50:55.931413 | controller | Wednesday 03 December 2025  10:50:55 +0000 (0:00:00.018)       0:00:45.683 ****
2025-12-03 10:50:56.137483 | controller | changed: [instance]
2025-12-03 10:50:56.137544 | controller |
2025-12-03 10:50:56.137777 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2025-12-03 10:50:56.535481 | controller | Wednesday 03 December 2025  10:50:56 +0000 (0:00:00.206)       0:00:45.889 ****
2025-12-03 10:50:56.535529 | controller | changed: [instance]
2025-12-03 10:50:56.535560 | controller |
2025-12-03 10:50:56.535571 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2025-12-03 10:50:56.535604 | controller | Wednesday 03 December 2025  10:50:56 +0000 (0:00:00.397)       0:00:46.287 ****
2025-12-03 10:50:56.593286 | controller | ok: [instance]
2025-12-03 10:50:56.625163 | controller |
2025-12-03 10:50:56.625185 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2025-12-03 10:50:56.625194 | controller | Wednesday 03 December 2025  10:50:56 +0000 (0:00:00.057)       0:00:46.345 ****
2025-12-03 10:50:56.625204 | controller | ok: [instance]
2025-12-03 10:50:56.990782 | controller |
2025-12-03 10:50:56.990814 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2025-12-03 10:50:56.990824 | controller | Wednesday 03 December 2025  10:50:56 +0000 (0:00:00.032)       0:00:46.377 ****
2025-12-03 10:50:56.990836 | controller | changed: [instance]
2025-12-03 10:50:57.069303 | controller |
2025-12-03 10:50:57.069355 | controller | TASK [libvirt_manager : Manage networks if needed] *****************************
2025-12-03 10:50:57.069365 | controller | Wednesday 03 December 2025  10:50:56 +0000 (0:00:00.365)       0:00:46.742 ****
2025-12-03 10:50:57.069376 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance
2025-12-03 10:50:57.117463 | controller |
2025-12-03 10:50:57.117486 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] ***
2025-12-03 10:50:57.117494 | controller | Wednesday 03 December 2025  10:50:57 +0000 (0:00:00.078)       0:00:46.821 ****
2025-12-03 10:50:57.117505 | controller | ok: [instance] => (item=public)
2025-12-03 10:50:57.555042 | controller | ok: [instance] => (item=osp_trunk)
2025-12-03 10:50:57.555079 | controller |
2025-12-03 10:50:57.555087 | controller | TASK [libvirt_manager : Ensure networks are defined] ***************************
2025-12-03 10:50:57.555093 | controller | Wednesday 03 December 2025  10:50:57 +0000 (0:00:00.047)       0:00:46.869 ****
2025-12-03 10:50:57.555103 | controller | changed: [instance] => (item=cifmw-public)
2025-12-03 10:50:57.555134 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2025-12-03 10:50:57.555463 | controller |
2025-12-03 10:50:57.555495 | controller | TASK [libvirt_manager : Ensure networks are created/started] *******************
2025-12-03 10:50:57.555507 | controller | Wednesday 03 December 2025  10:50:57 +0000 (0:00:00.437)       0:00:47.307 ****
2025-12-03 10:50:58.119408 | controller | ok: [instance] => (item=cifmw-public)
2025-12-03 10:50:58.119454 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-12-03 10:50:58.119464 | controller |
2025-12-03 10:50:58.119645 | controller | TASK [libvirt_manager : Ensure networks are active] ****************************
2025-12-03 10:50:58.547435 | controller | Wednesday 03 December 2025  10:50:58 +0000 (0:00:00.563)       0:00:47.871 ****
2025-12-03 10:50:58.547474 | controller | ok: [instance] => (item=cifmw-public)
2025-12-03 10:50:58.965046 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-12-03 10:50:58.965095 | controller |
2025-12-03 10:50:58.965103 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ******************
2025-12-03 10:50:58.965109 | controller | Wednesday 03 December 2025  10:50:58 +0000 (0:00:00.427)       0:00:48.299 ****
2025-12-03 10:50:58.965119 | controller | changed: [instance] => (item=cifmw-public)
2025-12-03 10:50:59.024210 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2025-12-03 10:50:59.024236 | controller |
2025-12-03 10:50:59.024243 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] **********
2025-12-03 10:50:59.024249 | controller | Wednesday 03 December 2025  10:50:58 +0000 (0:00:00.417)       0:00:48.716 ****
2025-12-03 10:50:59.024263 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance
2025-12-03 10:50:59.205015 | controller |
2025-12-03 10:50:59.205044 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] ***********************
2025-12-03 10:50:59.205052 | controller | Wednesday 03 December 2025  10:50:59 +0000 (0:00:00.059)       0:00:48.776 ****
2025-12-03 10:50:59.205062 | controller | ok: [instance]
2025-12-03 10:50:59.573153 | controller |
2025-12-03 10:50:59.573182 | controller | TASK [libvirt_manager : Fetch bridges ports link info] *************************
2025-12-03 10:50:59.573190 | controller | Wednesday 03 December 2025  10:50:59 +0000 (0:00:00.180)       0:00:48.957 ****
2025-12-03 10:50:59.573200 | controller | ok: [instance] => (item=cifmw-public)
2025-12-03 10:50:59.640491 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-12-03 10:50:59.640531 | controller |
2025-12-03 10:50:59.640540 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************
2025-12-03 10:50:59.640548 | controller | Wednesday 03 December 2025  10:50:59 +0000 (0:00:00.367)       0:00:49.325 ****
2025-12-03 10:50:59.640560 | controller |
2025-12-03 10:50:59.640645 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2025-12-03 10:50:59.640681 | controller | Wednesday 03 December 2025  10:50:59 +0000 (0:00:00.067)       0:00:49.392 ****
2025-12-03 10:50:59.677123 | controller | skipping: [instance]
2025-12-03 10:51:00.840436 | controller |
2025-12-03 10:51:00.840475 | controller | TASK [ci_nmstate : Install required packages on instance] **********************
2025-12-03 10:51:00.840483 | controller | Wednesday 03 December 2025  10:50:59 +0000 (0:00:00.036)       0:00:49.429 ****
2025-12-03 10:51:00.840494 | controller | ok: [instance]
2025-12-03 10:51:00.840546 | controller |
2025-12-03 10:51:00.840575 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2025-12-03 10:51:00.840586 | controller | Wednesday 03 December 2025  10:51:00 +0000 (0:00:01.163)       0:00:50.592 ****
2025-12-03 10:51:01.028039 | controller | ok: [instance]
2025-12-03 10:51:01.376839 | controller |
2025-12-03 10:51:01.376870 | controller | TASK [ci_nmstate : Save nmstate state for instance] ****************************
2025-12-03 10:51:01.376878 | controller | Wednesday 03 December 2025  10:51:01 +0000 (0:00:00.187)       0:00:50.780 ****
2025-12-03 10:51:01.376888 | controller | changed: [instance]
2025-12-03 10:51:02.999220 | controller |
2025-12-03 10:51:02.999251 | controller | TASK [ci_nmstate : Apply the desidered state on instance] **********************
2025-12-03 10:51:02.999259 | controller | Wednesday 03 December 2025  10:51:01 +0000 (0:00:00.348)       0:00:51.128 ****
2025-12-03 10:51:02.999269 | controller | changed: [instance]
2025-12-03 10:51:03.347395 | controller |
2025-12-03 10:51:03.347426 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] *******************
2025-12-03 10:51:03.347434 | controller | Wednesday 03 December 2025  10:51:02 +0000 (0:00:01.622)       0:00:52.751 ****
2025-12-03 10:51:03.347444 | controller | changed: [instance]
2025-12-03 10:51:03.347468 | controller |
2025-12-03 10:51:03.347476 | controller | TASK [Create extra network configuration] **************************************
2025-12-03 10:51:03.347601 | controller | Wednesday 03 December 2025  10:51:03 +0000 (0:00:00.348)       0:00:53.099 ****
2025-12-03 10:51:03.377437 | controller | skipping: [instance]
2025-12-03 10:51:03.377784 | controller |
2025-12-03 10:51:03.404803 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] **************
2025-12-03 10:51:03.404823 | controller | Wednesday 03 December 2025  10:51:03 +0000 (0:00:00.030)       0:00:53.129 ****
2025-12-03 10:51:03.404836 | controller | skipping: [instance]
2025-12-03 10:51:03.825483 | controller |
2025-12-03 10:51:03.825508 | controller | TASK [libvirt_manager : Refresh networking facts on host] **********************
2025-12-03 10:51:03.825516 | controller | Wednesday 03 December 2025  10:51:03 +0000 (0:00:00.027)       0:00:53.156 ****
2025-12-03 10:51:03.825525 | controller | ok: [instance]
2025-12-03 10:51:03.826641 | controller |
2025-12-03 10:51:03.827035 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] **********
2025-12-03 10:51:03.827053 | controller | Wednesday 03 December 2025  10:51:03 +0000 (0:00:00.420)       0:00:53.577 ****
2025-12-03 10:51:03.965197 | controller | ok: [instance] => (item=cifmw-public)
2025-12-03 10:51:05.093468 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-12-03 10:51:05.093514 | controller |
2025-12-03 10:51:05.093527 | controller | TASK [dnsmasq : Install needed packages] ***************************************
2025-12-03 10:51:05.093538 | controller | Wednesday 03 December 2025  10:51:03 +0000 (0:00:00.139)       0:00:53.717 ****
2025-12-03 10:51:05.093556 | controller | ok: [instance]
2025-12-03 10:51:05.093598 | controller |
2025-12-03 10:51:05.093612 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ******
2025-12-03 10:51:05.093672 | controller | Wednesday 03 December 2025  10:51:05 +0000 (0:00:01.128)       0:00:54.845 ****
2025-12-03 10:51:08.631462 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'})
2025-12-03 10:51:08.631538 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'})
2025-12-03 10:51:08.631564 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'})
2025-12-03 10:51:08.631842 | controller |
2025-12-03 10:51:08.838052 | controller | TASK [dnsmasq : Manage configuration directory] ********************************
2025-12-03 10:51:08.838071 | controller | Wednesday 03 December 2025  10:51:08 +0000 (0:00:03.538)       0:00:58.383 ****
2025-12-03 10:51:08.838081 | controller | changed: [instance]
2025-12-03 10:51:09.179457 | controller |
2025-12-03 10:51:09.179492 | controller | TASK [dnsmasq : Manage systemd unit file] **************************************
2025-12-03 10:51:09.179502 | controller | Wednesday 03 December 2025  10:51:08 +0000 (0:00:00.206)       0:00:58.590 ****
2025-12-03 10:51:09.179514 | controller | changed: [instance]
2025-12-03 10:51:09.179536 | controller |
2025-12-03 10:51:09.179544 | controller | TASK [dnsmasq : Manage base configuration file] ********************************
2025-12-03 10:51:09.179553 | controller | Wednesday 03 December 2025  10:51:09 +0000 (0:00:00.341)       0:00:58.931 ****
2025-12-03 10:51:09.553935 | controller | changed: [instance]
2025-12-03 10:51:09.585209 | controller |
2025-12-03 10:51:09.585230 | controller | TASK [dnsmasq : Render listener configuration] *********************************
2025-12-03 10:51:09.585238 | controller | Wednesday 03 December 2025  10:51:09 +0000 (0:00:00.374)       0:00:59.305 ****
2025-12-03 10:51:09.585248 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance
2025-12-03 10:51:09.961790 | controller |
2025-12-03 10:51:09.961821 | controller | TASK [dnsmasq : Create listener configuration file] ****************************
2025-12-03 10:51:09.961829 | controller | Wednesday 03 December 2025  10:51:09 +0000 (0:00:00.031)       0:00:59.337 ****
2025-12-03 10:51:09.961839 | controller | changed: [instance]
2025-12-03 10:51:09.979472 | controller |
2025-12-03 10:51:09.979491 | controller | TASK [dnsmasq : Remove listener configuration file] ****************************
2025-12-03 10:51:09.979499 | controller | Wednesday 03 December 2025  10:51:09 +0000 (0:00:00.376)       0:00:59.713 ****
2025-12-03 10:51:09.979508 | controller | skipping: [instance]
2025-12-03 10:51:10.010673 | controller |
2025-12-03 10:51:10.010717 | controller | TASK [dnsmasq : Render dns configuration] **************************************
2025-12-03 10:51:10.010731 | controller | Wednesday 03 December 2025  10:51:09 +0000 (0:00:00.017)       0:00:59.731 ****
2025-12-03 10:51:10.010749 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance
2025-12-03 10:51:10.368860 | controller |
2025-12-03 10:51:10.368890 | controller | TASK [dnsmasq : Create dns configuration file] *********************************
2025-12-03 10:51:10.368898 | controller | Wednesday 03 December 2025  10:51:10 +0000 (0:00:00.030)       0:00:59.762 ****
2025-12-03 10:51:10.368908 | controller | changed: [instance]
2025-12-03 10:51:10.390067 | controller |
2025-12-03 10:51:10.390104 | controller | TASK [dnsmasq : Remove dns configuration file] *********************************
2025-12-03 10:51:10.390114 | controller | Wednesday 03 December 2025  10:51:10 +0000 (0:00:00.358)       0:01:00.120 ****
2025-12-03 10:51:10.390126 | controller | skipping: [instance]
2025-12-03 10:51:10.599937 | controller |
2025-12-03 10:51:10.599965 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] ***
2025-12-03 10:51:10.599973 | controller | Wednesday 03 December 2025  10:51:10 +0000 (0:00:00.021)       0:01:00.142 ****
2025-12-03 10:51:10.599989 | controller | ok: [instance] => (item=127.0.0.2)
2025-12-03 10:51:11.264460 | controller |
2025-12-03 10:51:11.264496 | controller | TASK [dnsmasq : Enable and start service] **************************************
2025-12-03 10:51:11.264506 | controller | Wednesday 03 December 2025  10:51:10 +0000 (0:00:00.209)       0:01:00.351 ****
2025-12-03 10:51:11.264518 | controller | changed: [instance]
2025-12-03 10:51:11.264580 | controller |
2025-12-03 10:51:11.264613 | controller | TASK [dnsmasq : Stop service] **************************************************
2025-12-03 10:51:11.264626 | controller | Wednesday 03 December 2025  10:51:11 +0000 (0:00:00.664)       0:01:01.016 ****
2025-12-03 10:51:11.283482 | controller | skipping: [instance]
2025-12-03 10:51:11.300954 | controller |
2025-12-03 10:51:11.300980 | controller | TASK [dnsmasq : Remove unit file] **********************************************
2025-12-03 10:51:11.300989 | controller | Wednesday 03 December 2025  10:51:11 +0000 (0:00:00.019)       0:01:01.035 ****
2025-12-03 10:51:11.301001 | controller | skipping: [instance]
2025-12-03 10:51:11.330488 | controller |
2025-12-03 10:51:11.330532 | controller | TASK [dnsmasq : Remove main configuration files] *******************************
2025-12-03 10:51:11.330545 | controller | Wednesday 03 December 2025  10:51:11 +0000 (0:00:00.017)       0:01:01.053 ****
2025-12-03 10:51:11.330560 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2025-12-03 10:51:11.330604 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d)
2025-12-03 10:51:11.331014 | controller | skipping: [instance]
2025-12-03 10:51:11.446362 | controller |
2025-12-03 10:51:11.446385 | controller | TASK [Create dnsmasq networks] *************************************************
2025-12-03 10:51:11.446393 | controller | Wednesday 03 December 2025  10:51:11 +0000 (0:00:00.029)       0:01:01.082 ****
2025-12-03 10:51:11.446402 | controller |
2025-12-03 10:51:11.478436 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2025-12-03 10:51:11.478466 | controller | Wednesday 03 December 2025  10:51:11 +0000 (0:00:00.115)       0:01:01.198 ****
2025-12-03 10:51:11.478477 | controller | ok: [instance] => changed=false
2025-12-03 10:51:11.516932 | controller |   msg: All assertions passed
2025-12-03 10:51:11.516961 | controller |
2025-12-03 10:51:11.516971 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2025-12-03 10:51:11.516979 | controller | Wednesday 03 December 2025  10:51:11 +0000 (0:00:00.032)       0:01:01.230 ****
2025-12-03 10:51:11.516990 | controller | ok: [instance] => changed=false
2025-12-03 10:51:11.517045 | controller |   msg: All assertions passed
2025-12-03 10:51:11.517210 | controller |
2025-12-03 10:51:11.517300 | controller | TASK [dnsmasq : Create network] ************************************************
2025-12-03 10:51:11.517481 | controller | Wednesday 03 December 2025  10:51:11 +0000 (0:00:00.038)       0:01:01.269 ****
2025-12-03 10:51:11.935827 | controller | changed: [instance]
2025-12-03 10:51:11.935867 | controller |
2025-12-03 10:51:11.935880 | controller | TASK [dnsmasq : Remove network] ************************************************
2025-12-03 10:51:11.935895 | controller | Wednesday 03 December 2025  10:51:11 +0000 (0:00:00.418)       0:01:01.687 ****
2025-12-03 10:51:11.954788 | controller | skipping: [instance]
2025-12-03 10:51:11.979215 | controller |
2025-12-03 10:51:11.979237 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2025-12-03 10:51:11.979246 | controller | Wednesday 03 December 2025  10:51:11 +0000 (0:00:00.019)       0:01:01.707 ****
2025-12-03 10:51:11.979256 | controller | skipping: [instance]
2025-12-03 10:51:12.008222 | controller |
2025-12-03 10:51:12.008242 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2025-12-03 10:51:12.008251 | controller | Wednesday 03 December 2025  10:51:11 +0000 (0:00:00.024)       0:01:01.731 ****
2025-12-03 10:51:12.008261 | controller | ok: [instance] => changed=false
2025-12-03 10:51:12.044514 | controller |   msg: All assertions passed
2025-12-03 10:51:12.044556 | controller |
2025-12-03 10:51:12.044568 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2025-12-03 10:51:12.044577 | controller | Wednesday 03 December 2025  10:51:12 +0000 (0:00:00.028)       0:01:01.760 ****
2025-12-03 10:51:12.044590 | controller | ok: [instance] => changed=false
2025-12-03 10:51:12.044624 | controller |   msg: All assertions passed
2025-12-03 10:51:12.044640 | controller |
2025-12-03 10:51:12.044650 | controller | TASK [dnsmasq : Create network] ************************************************
2025-12-03 10:51:12.044724 | controller | Wednesday 03 December 2025  10:51:12 +0000 (0:00:00.036)       0:01:01.796 ****
2025-12-03 10:51:12.469277 | controller | changed: [instance]
2025-12-03 10:51:12.487392 | controller |
2025-12-03 10:51:12.487414 | controller | TASK [dnsmasq : Remove network] ************************************************
2025-12-03 10:51:12.487424 | controller | Wednesday 03 December 2025  10:51:12 +0000 (0:00:00.424)       0:01:02.221 ****
2025-12-03 10:51:12.487435 | controller | skipping: [instance]
2025-12-03 10:51:12.487460 | controller |
2025-12-03 10:51:12.487470 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2025-12-03 10:51:12.487590 | controller | Wednesday 03 December 2025  10:51:12 +0000 (0:00:00.018)       0:01:02.239 ****
2025-12-03 10:51:12.511211 | controller | skipping: [instance]
2025-12-03 10:51:12.542519 | controller |
2025-12-03 10:51:12.542554 | controller | TASK [Deploy radvd for IPv6 router advertisements] *****************************
2025-12-03 10:51:12.542564 | controller | Wednesday 03 December 2025  10:51:12 +0000 (0:00:00.023)       0:01:02.263 ****
2025-12-03 10:51:12.542576 | controller | skipping: [instance]
2025-12-03 10:51:13.032957 | controller |
2025-12-03 10:51:13.032991 | controller | TASK [libvirt_manager : Ensure network is in correct zone] *********************
2025-12-03 10:51:13.033001 | controller | Wednesday 03 December 2025  10:51:12 +0000 (0:00:00.031)       0:01:02.294 ****
2025-12-03 10:51:13.033021 | controller | changed: [instance] => (item=cifmw-public)
2025-12-03 10:51:13.033044 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2025-12-03 10:51:13.033149 | controller |
2025-12-03 10:51:13.033258 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2025-12-03 10:51:13.033390 | controller | Wednesday 03 December 2025  10:51:13 +0000 (0:00:00.490)       0:01:02.785 ****
2025-12-03 10:51:13.068524 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public)
2025-12-03 10:51:13.068636 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk)
2025-12-03 10:51:13.068737 | controller |
2025-12-03 10:51:13.068956 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2025-12-03 10:51:13.400198 | controller | Wednesday 03 December 2025  10:51:13 +0000 (0:00:00.035)       0:01:02.821 ****
2025-12-03 10:51:13.400232 | controller | ok: [instance]
2025-12-03 10:51:13.437405 | controller |
2025-12-03 10:51:13.437435 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2025-12-03 10:51:13.437443 | controller | Wednesday 03 December 2025  10:51:13 +0000 (0:00:00.331)       0:01:03.152 ****
2025-12-03 10:51:13.437454 | controller | ok: [instance]
2025-12-03 10:51:13.636404 | controller |
2025-12-03 10:51:13.636435 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2025-12-03 10:51:13.636443 | controller | Wednesday 03 December 2025  10:51:13 +0000 (0:00:00.037)       0:01:03.189 ****
2025-12-03 10:51:13.636453 | controller | ok: [instance]
2025-12-03 10:51:13.670085 | controller |
2025-12-03 10:51:13.670120 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2025-12-03 10:51:13.670130 | controller | Wednesday 03 December 2025  10:51:13 +0000 (0:00:00.198)       0:01:03.388 ****
2025-12-03 10:51:13.670141 | controller | ok: [instance]
2025-12-03 10:51:14.006846 | controller |
2025-12-03 10:51:14.006874 | controller | TASK [libvirt_manager : Output _network_data] **********************************
2025-12-03 10:51:14.006881 | controller | Wednesday 03 December 2025  10:51:13 +0000 (0:00:00.033)       0:01:03.422 ****
2025-12-03 10:51:14.006891 | controller | changed: [instance]
2025-12-03 10:51:14.343026 | controller |
2025-12-03 10:51:14.343052 | controller | TASK [libvirt_manager : Output pub_net] ****************************************
2025-12-03 10:51:14.343060 | controller | Wednesday 03 December 2025  10:51:14 +0000 (0:00:00.336)       0:01:03.758 ****
2025-12-03 10:51:14.343069 | controller | changed: [instance]
2025-12-03 10:51:14.673432 | controller |
2025-12-03 10:51:14.673466 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ******************
2025-12-03 10:51:14.673482 | controller | Wednesday 03 December 2025  10:51:14 +0000 (0:00:00.336)       0:01:04.095 ****
2025-12-03 10:51:14.673495 | controller | changed: [instance]
2025-12-03 10:51:14.765470 | controller |
2025-12-03 10:51:14.765527 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ********************
2025-12-03 10:51:14.765539 | controller | Wednesday 03 December 2025  10:51:14 +0000 (0:00:00.330)       0:01:04.425 ****
2025-12-03 10:51:14.765554 | controller | ok: [instance]
2025-12-03 10:51:15.080576 | controller |
2025-12-03 10:51:15.080628 | controller | TASK [libvirt_manager : Save networking_mapper patch] **************************
2025-12-03 10:51:15.080642 | controller | Wednesday 03 December 2025  10:51:14 +0000 (0:00:00.092)       0:01:04.517 ****
2025-12-03 10:51:15.080660 | controller | changed: [instance]
2025-12-03 10:51:15.104535 | controller |
2025-12-03 10:51:15.104573 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2025-12-03 10:51:15.104582 | controller | Wednesday 03 December 2025  10:51:15 +0000 (0:00:00.315)       0:01:04.832 ****
2025-12-03 10:51:15.104593 | controller | skipping: [instance]
2025-12-03 10:51:15.129946 | controller |
2025-12-03 10:51:15.129969 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2025-12-03 10:51:15.129978 | controller | Wednesday 03 December 2025  10:51:15 +0000 (0:00:00.023)       0:01:04.856 ****
2025-12-03 10:51:15.129989 | controller | skipping: [instance]
2025-12-03 10:51:15.153976 | controller |
2025-12-03 10:51:15.153997 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2025-12-03 10:51:15.154004 | controller | Wednesday 03 December 2025  10:51:15 +0000 (0:00:00.025)       0:01:04.882 ****
2025-12-03 10:51:15.154014 | controller | skipping: [instance]
2025-12-03 10:51:15.178456 | controller |
2025-12-03 10:51:15.178479 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2025-12-03 10:51:15.178489 | controller | Wednesday 03 December 2025  10:51:15 +0000 (0:00:00.024)       0:01:04.906 ****
2025-12-03 10:51:15.178500 | controller | skipping: [instance]
2025-12-03 10:51:15.197927 | controller |
2025-12-03 10:51:15.197942 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2025-12-03 10:51:15.197948 | controller | Wednesday 03 December 2025  10:51:15 +0000 (0:00:00.024)       0:01:04.930 ****
2025-12-03 10:51:15.197955 | controller | ok: [instance]
2025-12-03 10:51:15.306443 | controller |
2025-12-03 10:51:15.306476 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2025-12-03 10:51:15.306484 | controller | Wednesday 03 December 2025  10:51:15 +0000 (0:00:00.019)       0:01:04.950 ****
2025-12-03 10:51:15.306497 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2025-12-03 10:51:15.306532 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}})
2025-12-03 10:51:15.306543 | controller |
2025-12-03 10:51:15.306754 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2025-12-03 10:51:15.326397 | controller | Wednesday 03 December 2025  10:51:15 +0000 (0:00:00.108)       0:01:05.058 ****
2025-12-03 10:51:15.326421 | controller | skipping: [instance]
2025-12-03 10:51:15.522761 | controller |
2025-12-03 10:51:15.522778 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2025-12-03 10:51:15.522785 | controller | Wednesday 03 December 2025  10:51:15 +0000 (0:00:00.020)       0:01:05.078 ****
2025-12-03 10:51:15.522793 | controller | ok: [instance]
2025-12-03 10:51:15.906472 | controller |
2025-12-03 10:51:15.906507 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2025-12-03 10:51:15.906516 | controller | Wednesday 03 December 2025  10:51:15 +0000 (0:00:00.196)       0:01:05.275 ****
2025-12-03 10:51:15.906528 | controller | changed: [instance]
2025-12-03 10:51:15.906557 | controller |
2025-12-03 10:51:15.906565 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2025-12-03 10:51:15.906573 | controller | Wednesday 03 December 2025  10:51:15 +0000 (0:00:00.383)       0:01:05.658 ****
2025-12-03 10:51:15.969750 | controller | ok: [instance]
2025-12-03 10:51:15.999824 | controller |
2025-12-03 10:51:15.999845 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2025-12-03 10:51:15.999853 | controller | Wednesday 03 December 2025  10:51:15 +0000 (0:00:00.063)       0:01:05.721 ****
2025-12-03 10:51:15.999863 | controller | ok: [instance]
2025-12-03 10:51:16.430924 | controller |
2025-12-03 10:51:16.430949 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2025-12-03 10:51:16.430957 | controller | Wednesday 03 December 2025  10:51:15 +0000 (0:00:00.030)       0:01:05.751 ****
2025-12-03 10:51:16.430966 | controller | changed: [instance]
2025-12-03 10:51:16.461458 | controller |
2025-12-03 10:51:16.461479 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] ***
2025-12-03 10:51:16.461488 | controller | Wednesday 03 December 2025  10:51:16 +0000 (0:00:00.431)       0:01:06.183 ****
2025-12-03 10:51:16.461498 | controller | ok: [instance]
2025-12-03 10:51:16.461516 | controller |
2025-12-03 10:51:16.461523 | controller | TASK [libvirt_manager : Unset patch] *******************************************
2025-12-03 10:51:16.461531 | controller | Wednesday 03 December 2025  10:51:16 +0000 (0:00:00.030)       0:01:06.213 ****
2025-12-03 10:51:16.480128 | controller | ok: [instance]
2025-12-03 10:51:16.498216 | controller |
2025-12-03 10:51:16.498247 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] ****************
2025-12-03 10:51:16.498255 | controller | Wednesday 03 December 2025  10:51:16 +0000 (0:00:00.018)       0:01:06.232 ****
2025-12-03 10:51:16.498263 | controller | ok: [instance]
2025-12-03 10:51:16.569553 | controller |
2025-12-03 10:51:16.569592 | controller | TASK [libvirt_manager : Reserve IPs on networks] *******************************
2025-12-03 10:51:16.569601 | controller | Wednesday 03 December 2025  10:51:16 +0000 (0:00:00.018)       0:01:06.250 ****
2025-12-03 10:51:16.569614 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane)
2025-12-03 10:51:16.569686 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi)
2025-12-03 10:51:16.569698 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage)
2025-12-03 10:51:16.569705 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant)
2025-12-03 10:51:16.569711 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external)
2025-12-03 10:51:16.569720 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt)
2025-12-03 10:51:16.569796 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public)
2025-12-03 10:51:16.569895 | controller |
2025-12-03 10:51:16.569999 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-12-03 10:51:16.570105 | controller | Wednesday 03 December 2025  10:51:16 +0000 (0:00:00.071)       0:01:06.321 ****
2025-12-03 10:51:16.706977 | controller | ok: [instance] => (item=compute-0 - ctlplane)
2025-12-03 10:51:16.707123 | controller | ok: [instance] => (item=controller-0 - ctlplane)
2025-12-03 10:51:16.707284 | controller | ok: [instance] => (item=crc-0 - ctlplane)
2025-12-03 10:51:16.707439 | controller |
2025-12-03 10:51:16.707586 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-12-03 10:51:16.707692 | controller | Wednesday 03 December 2025  10:51:16 +0000 (0:00:00.137)       0:01:06.459 ****
2025-12-03 10:51:16.791062 | controller | skipping: [instance] => (item=compute-0 - internalapi)
2025-12-03 10:51:16.791198 | controller | skipping: [instance] => (item=controller-0 - internalapi)
2025-12-03 10:51:16.791310 | controller | skipping: [instance] => (item=crc-0 - internalapi)
2025-12-03 10:51:16.791438 | controller | skipping: [instance]
2025-12-03 10:51:16.791544 | controller |
2025-12-03 10:51:16.791650 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-12-03 10:51:16.791763 | controller | Wednesday 03 December 2025  10:51:16 +0000 (0:00:00.084)       0:01:06.543 ****
2025-12-03 10:51:16.873052 | controller | skipping: [instance] => (item=compute-0 - storage)
2025-12-03 10:51:16.873228 | controller | skipping: [instance] => (item=controller-0 - storage)
2025-12-03 10:51:16.873394 | controller | skipping: [instance] => (item=crc-0 - storage)
2025-12-03 10:51:16.873541 | controller | skipping: [instance]
2025-12-03 10:51:16.873669 | controller |
2025-12-03 10:51:16.873805 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-12-03 10:51:16.873921 | controller | Wednesday 03 December 2025  10:51:16 +0000 (0:00:00.082)       0:01:06.625 ****
2025-12-03 10:51:16.957157 | controller | skipping: [instance] => (item=compute-0 - tenant)
2025-12-03 10:51:16.957312 | controller | skipping: [instance] => (item=controller-0 - tenant)
2025-12-03 10:51:16.957497 | controller | skipping: [instance] => (item=crc-0 - tenant)
2025-12-03 10:51:16.957680 | controller | skipping: [instance]
2025-12-03 10:51:16.957795 | controller |
2025-12-03 10:51:16.957928 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-12-03 10:51:16.958050 | controller | Wednesday 03 December 2025  10:51:16 +0000 (0:00:00.084)       0:01:06.709 ****
2025-12-03 10:51:17.042233 | controller | skipping: [instance] => (item=compute-0 - external)
2025-12-03 10:51:17.042409 | controller | skipping: [instance] => (item=controller-0 - external)
2025-12-03 10:51:17.042563 | controller | skipping: [instance] => (item=crc-0 - external)
2025-12-03 10:51:17.042702 | controller | skipping: [instance]
2025-12-03 10:51:17.042829 | controller |
2025-12-03 10:51:17.042968 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-12-03 10:51:17.043112 | controller | Wednesday 03 December 2025  10:51:17 +0000 (0:00:00.085)       0:01:06.794 ****
2025-12-03 10:51:17.125634 | controller | skipping: [instance] => (item=compute-0 - storagemgmt)
2025-12-03 10:51:17.125772 | controller | skipping: [instance] => (item=controller-0 - storagemgmt)
2025-12-03 10:51:17.125958 | controller | skipping: [instance] => (item=crc-0 - storagemgmt)
2025-12-03 10:51:17.126071 | controller | skipping: [instance]
2025-12-03 10:51:17.126216 | controller |
2025-12-03 10:51:17.126367 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2025-12-03 10:51:17.126486 | controller | Wednesday 03 December 2025  10:51:17 +0000 (0:00:00.083)       0:01:06.878 ****
2025-12-03 10:51:17.267351 | controller | ok: [instance] => (item=compute-0 - public)
2025-12-03 10:51:17.267544 | controller | ok: [instance] => (item=controller-0 - public)
2025-12-03 10:51:17.267699 | controller | ok: [instance] => (item=crc-0 - public)
2025-12-03 10:51:17.267767 | controller |
2025-12-03 10:51:17.267930 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ******************************
2025-12-03 10:51:17.268002 | controller | Wednesday 03 December 2025  10:51:17 +0000 (0:00:00.141)       0:01:07.019 ****
2025-12-03 10:51:17.380059 | controller |
2025-12-03 10:51:17.380182 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************
2025-12-03 10:51:17.380358 | controller | Wednesday 03 December 2025  10:51:17 +0000 (0:00:00.112)       0:01:07.132 ****
2025-12-03 10:51:17.420727 | controller | ok: [instance]
2025-12-03 10:51:17.420846 | controller |
2025-12-03 10:51:17.420974 | controller | TASK [dnsmasq : Assert we have needed host data] *******************************
2025-12-03 10:51:17.421090 | controller | Wednesday 03 December 2025  10:51:17 +0000 (0:00:00.040)       0:01:07.173 ****
2025-12-03 10:51:17.524839 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:17:fc:59', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2025-12-03 10:51:17.525070 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:5c:a8:7e', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2025-12-03 10:51:17.525256 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:89:90:d0', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2025-12-03 10:51:17.525494 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:7e:31:96', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2025-12-03 10:51:17.525625 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:f7:f1:6d', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2025-12-03 10:51:17.525738 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:55:33:0d', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2025-12-03 10:51:17.525833 | controller |
2025-12-03 10:51:17.525936 | controller | TASK [dnsmasq : Ensure networks exists] ****************************************
2025-12-03 10:51:17.526031 | controller | Wednesday 03 December 2025  10:51:17 +0000 (0:00:00.104)       0:01:07.277 ****
2025-12-03 10:51:17.574282 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk)
2025-12-03 10:51:17.574461 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public)
2025-12-03 10:51:17.574545 | controller |
2025-12-03 10:51:17.574649 | controller | TASK [dnsmasq : Check network file status] *************************************
2025-12-03 10:51:17.574753 | controller | Wednesday 03 December 2025  10:51:17 +0000 (0:00:00.049)       0:01:07.326 ****
2025-12-03 10:51:17.748468 | controller | ok: [instance]
2025-12-03 10:51:17.748535 | controller |
2025-12-03 10:51:17.748547 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2025-12-03 10:51:17.748558 | controller | Wednesday 03 December 2025  10:51:17 +0000 (0:00:00.173)       0:01:07.500 ****
2025-12-03 10:51:17.772512 | controller | ok: [instance]
2025-12-03 10:51:17.772578 | controller |
2025-12-03 10:51:17.772593 | controller | TASK [dnsmasq : Check network file status] *************************************
2025-12-03 10:51:17.772714 | controller | Wednesday 03 December 2025  10:51:17 +0000 (0:00:00.024)       0:01:07.524 ****
2025-12-03 10:51:17.941286 | controller | ok: [instance]
2025-12-03 10:51:17.964492 | controller |
2025-12-03 10:51:17.964529 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2025-12-03 10:51:17.964540 | controller | Wednesday 03 December 2025  10:51:17 +0000 (0:00:00.168)       0:01:07.693 ****
2025-12-03 10:51:17.964554 | controller | ok: [instance]
2025-12-03 10:51:17.984374 | controller |
2025-12-03 10:51:17.984405 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] ****************************
2025-12-03 10:51:17.984414 | controller | Wednesday 03 December 2025  10:51:17 +0000 (0:00:00.023)       0:01:07.716 ****
2025-12-03 10:51:17.984424 | controller | ok: [instance]
2025-12-03 10:51:18.154126 | controller |
2025-12-03 10:51:18.154147 | controller | TASK [dnsmasq : Compute entry] *************************************************
2025-12-03 10:51:18.154154 | controller | Wednesday 03 December 2025  10:51:17 +0000 (0:00:00.019)       0:01:07.736 ****
2025-12-03 10:51:18.154164 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:17:fc:59', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2025-12-03 10:51:18.191728 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:5c:a8:7e', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2025-12-03 10:51:18.191746 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:89:90:d0', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2025-12-03 10:51:18.191754 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:7e:31:96', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2025-12-03 10:51:18.191760 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:f7:f1:6d', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2025-12-03 10:51:18.191765 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:55:33:0d', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2025-12-03 10:51:18.191771 | controller |
2025-12-03 10:51:18.191777 | controller | TASK [dnsmasq : Create add/remove sets] ****************************************
2025-12-03 10:51:18.191782 | controller | Wednesday 03 December 2025  10:51:18 +0000 (0:00:00.169)       0:01:07.905 ****
2025-12-03 10:51:18.191790 | controller | ok: [instance]
2025-12-03 10:51:20.148491 | controller |
2025-12-03 10:51:20.148530 | controller | TASK [dnsmasq : Add DHCP entries] **********************************************
2025-12-03 10:51:20.148542 | controller | Wednesday 03 December 2025  10:51:18 +0000 (0:00:00.038)       0:01:07.944 ****
2025-12-03 10:51:20.148556 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:17:fc:59', 'entry': 'set:compute,52:54:00:17:fc:59,192.168.140.100,compute-0', 'state': 'present'})
2025-12-03 10:51:20.169470 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:5c:a8:7e', 'entry': 'set:controller,52:54:01:5c:a8:7e,192.168.140.9,controller-0', 'state': 'present'})
2025-12-03 10:51:20.169505 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:89:90:d0', 'entry': 'set:ocp,52:54:02:89:90:d0,192.168.140.10,crc-0', 'state': 'present'})
2025-12-03 10:51:20.169515 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:7e:31:96', 'entry': 'set:compute,52:54:00:7e:31:96,192.168.101.100,compute-0', 'state': 'present'})
2025-12-03 10:51:20.169522 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:f7:f1:6d', 'entry': 'set:controller,52:54:01:f7:f1:6d,192.168.101.9,controller-0', 'state': 'present'})
2025-12-03 10:51:20.169529 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:55:33:0d', 'entry': 'set:ocp,52:54:02:55:33:0d,192.168.101.10,crc-0', 'state': 'present'})
2025-12-03 10:51:20.169535 | controller |
2025-12-03 10:51:20.169543 | controller | TASK [dnsmasq : Remove DHCP entries] *******************************************
2025-12-03 10:51:20.169550 | controller | Wednesday 03 December 2025  10:51:20 +0000 (0:00:01.955)       0:01:09.899 ****
2025-12-03 10:51:20.169562 | controller | skipping: [instance]
2025-12-03 10:51:20.169595 | controller |
2025-12-03 10:51:20.169703 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] ***********
2025-12-03 10:51:20.169739 | controller | Wednesday 03 December 2025  10:51:20 +0000 (0:00:00.021)       0:01:09.921 ****
2025-12-03 10:51:20.373255 | controller | ok: [instance] => (item=compute-0)
2025-12-03 10:51:20.484390 | controller | ok: [instance] => (item=controller-0)
2025-12-03 10:51:20.484411 | controller | ok: [instance] => (item=crc-0)
2025-12-03 10:51:20.484420 | controller |
2025-12-03 10:51:20.484427 | controller | TASK [Inject VMs in the .utility zone] *****************************************
2025-12-03 10:51:20.484433 | controller | Wednesday 03 December 2025  10:51:20 +0000 (0:00:00.203)       0:01:10.125 ****
2025-12-03 10:51:20.484443 | controller |
2025-12-03 10:51:20.575153 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2025-12-03 10:51:20.575169 | controller | Wednesday 03 December 2025  10:51:20 +0000 (0:00:00.111)       0:01:10.236 ****
2025-12-03 10:51:20.575179 | controller | ok: [instance]
2025-12-03 10:51:20.778577 | controller |
2025-12-03 10:51:20.778621 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2025-12-03 10:51:20.778631 | controller | Wednesday 03 December 2025  10:51:20 +0000 (0:00:00.090)       0:01:10.327 ****
2025-12-03 10:51:20.778645 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2025-12-03 10:51:20.778679 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2025-12-03 10:51:20.778688 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2025-12-03 10:51:20.778695 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2025-12-03 10:51:20.778702 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2025-12-03 10:51:20.778708 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2025-12-03 10:51:20.778715 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2025-12-03 10:51:20.778722 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-12-03 10:51:20.778728 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-12-03 10:51:20.778735 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2025-12-03 10:51:20.778745 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2025-12-03 10:51:20.778771 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2025-12-03 10:51:20.779414 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2025-12-03 10:51:20.779451 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2025-12-03 10:51:20.779460 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2025-12-03 10:51:20.779466 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2025-12-03 10:51:20.779476 | controller |
2025-12-03 10:51:20.779481 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2025-12-03 10:51:20.779490 | controller | Wednesday 03 December 2025  10:51:20 +0000 (0:00:00.202)       0:01:10.529 ****
2025-12-03 10:51:23.781582 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2025-12-03 10:51:23.781640 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2025-12-03 10:51:23.781655 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2025-12-03 10:51:23.781663 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2025-12-03 10:51:23.781670 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2025-12-03 10:51:23.781677 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2025-12-03 10:51:23.781684 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2025-12-03 10:51:23.781690 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-12-03 10:51:23.781697 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-12-03 10:51:23.781703 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2025-12-03 10:51:23.781710 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2025-12-03 10:51:23.781720 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2025-12-03 10:51:23.781747 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2025-12-03 10:51:23.782357 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2025-12-03 10:51:23.801014 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2025-12-03 10:51:23.801039 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2025-12-03 10:51:23.801049 | controller |
2025-12-03 10:51:23.801059 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] ****************
2025-12-03 10:51:23.801066 | controller | Wednesday 03 December 2025  10:51:23 +0000 (0:00:03.003)       0:01:13.532 ****
2025-12-03 10:51:23.801079 | controller | ok: [instance]
2025-12-03 10:51:23.843496 | controller |
2025-12-03 10:51:23.843537 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] **************
2025-12-03 10:51:23.843547 | controller | Wednesday 03 December 2025  10:51:23 +0000 (0:00:00.020)       0:01:13.553 ****
2025-12-03 10:51:23.843558 | controller | skipping: [instance] => (item=compute)
2025-12-03 10:51:23.843591 | controller | skipping: [instance] => (item=controller)
2025-12-03 10:51:23.844165 | controller | skipping: [instance] => (item=crc)
2025-12-03 10:51:23.873957 | controller | skipping: [instance]
2025-12-03 10:51:23.873985 | controller |
2025-12-03 10:51:23.873995 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] *******
2025-12-03 10:51:23.874003 | controller | Wednesday 03 December 2025  10:51:23 +0000 (0:00:00.042)       0:01:13.595 ****
2025-12-03 10:51:23.874015 | controller | skipping: [instance]
2025-12-03 10:51:24.262476 | controller |
2025-12-03 10:51:24.262510 | controller | TASK [libvirt_manager : Ensure some domains are local] *************************
2025-12-03 10:51:24.262519 | controller | Wednesday 03 December 2025  10:51:23 +0000 (0:00:00.030)       0:01:13.626 ****
2025-12-03 10:51:24.262531 | controller | changed: [instance]
2025-12-03 10:51:24.262562 | controller |
2025-12-03 10:51:24.262569 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************
2025-12-03 10:51:24.262577 | controller | Wednesday 03 December 2025  10:51:24 +0000 (0:00:00.378)       0:01:14.004 ****
2025-12-03 10:51:24.263021 | controller |
2025-12-03 10:51:25.051301 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2025-12-03 10:51:25.051349 | controller | Wednesday 03 December 2025  10:51:24 +0000 (0:00:00.010)       0:01:14.014 ****
2025-12-03 10:51:25.051367 | controller | changed: [instance]
2025-12-03 10:51:25.401424 | controller |
2025-12-03 10:51:25.401457 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2025-12-03 10:51:25.401466 | controller | Wednesday 03 December 2025  10:51:25 +0000 (0:00:00.789)       0:01:14.803 ****
2025-12-03 10:51:25.401478 | controller | changed: [instance]
2025-12-03 10:51:25.744447 | controller |
2025-12-03 10:51:25.744474 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] *************************************
2025-12-03 10:51:25.744482 | controller | Wednesday 03 December 2025  10:51:25 +0000 (0:00:00.349)       0:01:15.153 ****
2025-12-03 10:51:25.744491 | controller | changed: [instance]
2025-12-03 10:51:25.744521 | controller |
2025-12-03 10:51:25.744771 | controller | TASK [reproducer : Delegate our domains to our own instance] *******************
2025-12-03 10:51:26.095276 | controller | Wednesday 03 December 2025  10:51:25 +0000 (0:00:00.343)       0:01:15.496 ****
2025-12-03 10:51:26.095307 | controller | changed: [instance]
2025-12-03 10:51:26.454868 | controller |
2025-12-03 10:51:26.454899 | controller | TASK [reproducer : Ensure "utility" domain is local] ***************************
2025-12-03 10:51:26.454907 | controller | Wednesday 03 December 2025  10:51:26 +0000 (0:00:00.350)       0:01:15.847 ****
2025-12-03 10:51:26.454917 | controller | changed: [instance]
2025-12-03 10:51:26.486452 | controller |
2025-12-03 10:51:26.486494 | controller | TASK [Build utility records dataset] *******************************************
2025-12-03 10:51:26.486505 | controller | Wednesday 03 December 2025  10:51:26 +0000 (0:00:00.359)       0:01:16.206 ****
2025-12-03 10:51:26.486519 | controller |
2025-12-03 10:51:26.486554 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2025-12-03 10:51:26.486584 | controller | Wednesday 03 December 2025  10:51:26 +0000 (0:00:00.032)       0:01:16.239 ****
2025-12-03 10:51:26.573829 | controller | ok: [instance]
2025-12-03 10:51:26.669479 | controller |
2025-12-03 10:51:26.669510 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2025-12-03 10:51:26.669518 | controller | Wednesday 03 December 2025  10:51:26 +0000 (0:00:00.086)       0:01:16.325 ****
2025-12-03 10:51:26.669528 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2025-12-03 10:51:27.129462 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-12-03 10:51:27.129497 | controller |
2025-12-03 10:51:27.129507 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2025-12-03 10:51:27.129515 | controller | Wednesday 03 December 2025  10:51:26 +0000 (0:00:00.095)       0:01:16.421 ****
2025-12-03 10:51:27.129528 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2025-12-03 10:51:27.129557 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2025-12-03 10:51:27.129566 | controller |
2025-12-03 10:51:27.129578 | controller | TASK [reproducer : Flush handlers] *********************************************
2025-12-03 10:51:27.129592 | controller | Wednesday 03 December 2025  10:51:27 +0000 (0:00:00.449)       0:01:16.870 ****
2025-12-03 10:51:27.129850 | controller |
2025-12-03 10:51:27.581628 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2025-12-03 10:51:27.581660 | controller | Wednesday 03 December 2025  10:51:27 +0000 (0:00:00.010)       0:01:16.881 ****
2025-12-03 10:51:27.581672 | controller | changed: [instance]
2025-12-03 10:51:27.923136 | controller |
2025-12-03 10:51:27.923166 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2025-12-03 10:51:27.923173 | controller | Wednesday 03 December 2025  10:51:27 +0000 (0:00:00.451)       0:01:17.333 ****
2025-12-03 10:51:27.923183 | controller | changed: [instance]
2025-12-03 10:51:27.953432 | controller |
2025-12-03 10:51:27.953458 | controller | TASK [reproducer : Bootstrap nat64 if needed] **********************************
2025-12-03 10:51:27.953468 | controller | Wednesday 03 December 2025  10:51:27 +0000 (0:00:00.341)       0:01:17.675 ****
2025-12-03 10:51:27.953479 | controller | skipping: [instance]
2025-12-03 10:51:27.953512 | controller |
2025-12-03 10:51:27.953710 | controller | TASK [reproducer : Deploy CRC if needed] ***************************************
2025-12-03 10:51:28.025783 | controller | Wednesday 03 December 2025  10:51:27 +0000 (0:00:00.030)       0:01:17.705 ****
2025-12-03 10:51:28.025807 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance
2025-12-03 10:51:28.209428 | controller |
2025-12-03 10:51:28.209452 | controller | TASK [reproducer : Check for CRC availability in known path] *******************
2025-12-03 10:51:28.209462 | controller | Wednesday 03 December 2025  10:51:28 +0000 (0:00:00.072)       0:01:17.778 ****
2025-12-03 10:51:28.209473 | controller | ok: [instance]
2025-12-03 10:51:28.209504 | controller |
2025-12-03 10:51:28.209684 | controller | TASK [Deploy CRC if needed] ****************************************************
2025-12-03 10:51:28.229257 | controller | Wednesday 03 December 2025  10:51:28 +0000 (0:00:00.183)       0:01:17.961 ****
2025-12-03 10:51:28.229278 | controller | skipping: [instance]
2025-12-03 10:51:28.562910 | controller |
2025-12-03 10:51:28.562941 | controller | TASK [rhol_crc : Stop CRC VM] **************************************************
2025-12-03 10:51:28.562949 | controller | Wednesday 03 December 2025  10:51:28 +0000 (0:00:00.019)       0:01:17.981 ****
2025-12-03 10:51:28.562960 | controller | ok: [instance]
2025-12-03 10:51:28.792928 | controller |
2025-12-03 10:51:28.792955 | controller | TASK [rhol_crc : Undefine CRC VM] **********************************************
2025-12-03 10:51:28.792962 | controller | Wednesday 03 December 2025  10:51:28 +0000 (0:00:00.333)       0:01:18.314 ****
2025-12-03 10:51:28.792971 | controller | ok: [instance]
2025-12-03 10:51:29.001453 | controller |
2025-12-03 10:51:29.001484 | controller | TASK [rhol_crc : Destroy CRC network] ******************************************
2025-12-03 10:51:29.001492 | controller | Wednesday 03 December 2025  10:51:28 +0000 (0:00:00.230)       0:01:18.545 ****
2025-12-03 10:51:29.001502 | controller | ok: [instance]
2025-12-03 10:51:29.001527 | controller |
2025-12-03 10:51:29.001535 | controller | TASK [rhol_crc : Undefine CRC network] *****************************************
2025-12-03 10:51:29.001663 | controller | Wednesday 03 December 2025  10:51:28 +0000 (0:00:00.208)       0:01:18.753 ****
2025-12-03 10:51:29.212472 | controller | ok: [instance]
2025-12-03 10:51:29.427426 | controller |
2025-12-03 10:51:29.427461 | controller | TASK [rhol_crc : Destroy default network] **************************************
2025-12-03 10:51:29.427472 | controller | Wednesday 03 December 2025  10:51:29 +0000 (0:00:00.211)       0:01:18.964 ****
2025-12-03 10:51:29.427486 | controller | ok: [instance]
2025-12-03 10:51:29.427528 | controller |
2025-12-03 10:51:29.427833 | controller | TASK [Check if new ssh keypair exists] *****************************************
2025-12-03 10:51:29.468486 | controller | Wednesday 03 December 2025  10:51:29 +0000 (0:00:00.215)       0:01:19.179 ****
2025-12-03 10:51:29.468529 | controller |
2025-12-03 10:51:29.468565 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2025-12-03 10:51:29.468725 | controller | Wednesday 03 December 2025  10:51:29 +0000 (0:00:00.040)       0:01:19.220 ****
2025-12-03 10:51:29.661977 | controller | ok: [instance]
2025-12-03 10:51:29.685419 | controller |
2025-12-03 10:51:29.685455 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2025-12-03 10:51:29.685465 | controller | Wednesday 03 December 2025  10:51:29 +0000 (0:00:00.193)       0:01:19.413 ****
2025-12-03 10:51:29.685477 | controller | ok: [instance]
2025-12-03 10:51:29.709064 | controller |
2025-12-03 10:51:29.709110 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2025-12-03 10:51:29.709142 | controller | Wednesday 03 December 2025  10:51:29 +0000 (0:00:00.023)       0:01:19.437 ****
2025-12-03 10:51:29.709166 | controller | skipping: [instance]
2025-12-03 10:51:29.709265 | controller |
2025-12-03 10:51:29.709294 | controller | TASK [reproducer : Slurp ssh key for CRC access] *******************************
2025-12-03 10:51:29.709311 | controller | Wednesday 03 December 2025  10:51:29 +0000 (0:00:00.023)       0:01:19.461 ****
2025-12-03 10:51:29.947406 | controller | ok: [instance]
2025-12-03 10:51:29.947515 | controller |
2025-12-03 10:51:29.947538 | controller | TASK [reproducer : Get kubeconfig file from crc directory] *********************
2025-12-03 10:51:29.947549 | controller | Wednesday 03 December 2025  10:51:29 +0000 (0:00:00.238)       0:01:19.699 ****
2025-12-03 10:51:30.157799 | controller | ok: [instance]
2025-12-03 10:51:30.324401 | controller |
2025-12-03 10:51:30.324434 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] *************
2025-12-03 10:51:30.324442 | controller | Wednesday 03 December 2025  10:51:30 +0000 (0:00:00.210)       0:01:19.909 ****
2025-12-03 10:51:30.324451 | controller | ok: [instance]
2025-12-03 10:51:30.377386 | controller |
2025-12-03 10:51:30.377418 | controller | TASK [Ensure we expose openshift_login related facts] **************************
2025-12-03 10:51:30.377430 | controller | Wednesday 03 December 2025  10:51:30 +0000 (0:00:00.166)       0:01:20.076 ****
2025-12-03 10:51:30.377444 | controller |
2025-12-03 10:51:30.418210 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2025-12-03 10:51:30.418230 | controller | Wednesday 03 December 2025  10:51:30 +0000 (0:00:00.053)       0:01:20.129 ****
2025-12-03 10:51:30.418242 | controller | ok: [instance] => changed=false
2025-12-03 10:51:30.585402 | controller |   msg: All assertions passed
2025-12-03 10:51:30.585434 | controller |
2025-12-03 10:51:30.585441 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2025-12-03 10:51:30.585447 | controller | Wednesday 03 December 2025  10:51:30 +0000 (0:00:00.040)       0:01:20.170 ****
2025-12-03 10:51:30.585457 | controller | ok: [instance]
2025-12-03 10:51:30.585484 | controller |
2025-12-03 10:51:30.585746 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2025-12-03 10:51:30.761343 | controller | Wednesday 03 December 2025  10:51:30 +0000 (0:00:00.167)       0:01:20.337 ****
2025-12-03 10:51:30.761372 | controller | ok: [instance]
2025-12-03 10:51:30.784469 | controller |
2025-12-03 10:51:30.784491 | controller | TASK [openshift_login : Assert files exist] ************************************
2025-12-03 10:51:30.784500 | controller | Wednesday 03 December 2025  10:51:30 +0000 (0:00:00.175)       0:01:20.513 ****
2025-12-03 10:51:30.784510 | controller | ok: [instance] => changed=false
2025-12-03 10:51:30.784791 | controller |   msg: All assertions passed
2025-12-03 10:51:30.784812 | controller |
2025-12-03 10:51:30.961448 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2025-12-03 10:51:30.961485 | controller | Wednesday 03 December 2025  10:51:30 +0000 (0:00:00.023)       0:01:20.536 ****
2025-12-03 10:51:30.961499 | controller | ok: [instance]
2025-12-03 10:51:31.126305 | controller |
2025-12-03 10:51:31.126357 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2025-12-03 10:51:31.126369 | controller | Wednesday 03 December 2025  10:51:30 +0000 (0:00:00.176)       0:01:20.713 ****
2025-12-03 10:51:31.126381 | controller | ok: [instance]
2025-12-03 10:51:31.172249 | controller |
2025-12-03 10:51:31.172266 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2025-12-03 10:51:31.172272 | controller | Wednesday 03 December 2025  10:51:31 +0000 (0:00:00.164)       0:01:20.878 ****
2025-12-03 10:51:31.172280 | controller | ok: [instance]
2025-12-03 10:51:31.535590 | controller |
2025-12-03 10:51:31.535614 | controller | TASK [reproducer : Remove CRC managed zone delegation] *************************
2025-12-03 10:51:31.535622 | controller | Wednesday 03 December 2025  10:51:31 +0000 (0:00:00.045)       0:01:20.924 ****
2025-12-03 10:51:31.535637 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf)
2025-12-03 10:51:31.554725 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf)
2025-12-03 10:51:31.554747 | controller |
2025-12-03 10:51:31.554754 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************
2025-12-03 10:51:31.554759 | controller | Wednesday 03 December 2025  10:51:31 +0000 (0:00:00.363)       0:01:21.287 ****
2025-12-03 10:51:31.554767 | controller | skipping: [instance]
2025-12-03 10:51:31.577818 | controller |
2025-12-03 10:51:31.577836 | controller | TASK [Load the architecture local kustomize patches] ***************************
2025-12-03 10:51:31.577843 | controller | Wednesday 03 December 2025  10:51:31 +0000 (0:00:00.019)       0:01:21.307 ****
2025-12-03 10:51:31.577851 | controller | skipping: [instance]
2025-12-03 10:51:31.704139 | controller |
2025-12-03 10:51:31.704156 | controller | TASK [reproducer : Consume libvirt_manager] ************************************
2025-12-03 10:51:31.704163 | controller | Wednesday 03 December 2025  10:51:31 +0000 (0:00:00.023)       0:01:21.330 ****
2025-12-03 10:51:31.704171 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance
2025-12-03 10:51:31.729028 | controller |
2025-12-03 10:51:31.729065 | controller | TASK [libvirt_manager : Import layout generator if needed] *********************
2025-12-03 10:51:31.729085 | controller | Wednesday 03 December 2025  10:51:31 +0000 (0:00:00.126)       0:01:21.456 ****
2025-12-03 10:51:31.729103 | controller | skipping: [instance]
2025-12-03 10:51:32.115450 | controller |
2025-12-03 10:51:32.115487 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] *****************
2025-12-03 10:51:32.115498 | controller | Wednesday 03 December 2025  10:51:31 +0000 (0:00:00.024)       0:01:21.480 ****
2025-12-03 10:51:32.115512 | controller | changed: [instance]
2025-12-03 10:51:32.602409 | controller |
2025-12-03 10:51:32.602447 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] ****************
2025-12-03 10:51:32.602455 | controller | Wednesday 03 December 2025  10:51:32 +0000 (0:00:00.386)       0:01:21.867 ****
2025-12-03 10:51:32.602465 | controller | changed: [instance]
2025-12-03 10:51:32.602482 | controller |
2025-12-03 10:51:32.602489 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] **************************
2025-12-03 10:51:32.602839 | controller | Wednesday 03 December 2025  10:51:32 +0000 (0:00:00.476)       0:01:22.344 ****
2025-12-03 10:51:33.013287 | controller |
2025-12-03 10:51:33.013321 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2025-12-03 10:51:33.013347 | controller | Wednesday 03 December 2025  10:51:32 +0000 (0:00:00.010)       0:01:22.354 ****
2025-12-03 10:51:33.013362 | controller | changed: [instance]
2025-12-03 10:51:33.793267 | controller |
2025-12-03 10:51:33.793301 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2025-12-03 10:51:33.793309 | controller | Wednesday 03 December 2025  10:51:33 +0000 (0:00:00.410)       0:01:22.765 ****
2025-12-03 10:51:33.793319 | controller | changed: [instance]
2025-12-03 10:51:33.825810 | controller |
2025-12-03 10:51:33.825834 | controller | TASK [Deploy virtualbmc] *******************************************************
2025-12-03 10:51:33.825842 | controller | Wednesday 03 December 2025  10:51:33 +0000 (0:00:00.780)       0:01:23.545 ****
2025-12-03 10:51:33.825852 | controller | skipping: [instance]
2025-12-03 10:51:33.856192 | controller |
2025-12-03 10:51:33.856214 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] ***********
2025-12-03 10:51:33.856221 | controller | Wednesday 03 December 2025  10:51:33 +0000 (0:00:00.032)       0:01:23.578 ****
2025-12-03 10:51:33.856230 | controller | skipping: [instance]
2025-12-03 10:51:34.405413 | controller |
2025-12-03 10:51:34.405527 | controller | TASK [libvirt_manager : Create needed workload directory] **********************
2025-12-03 10:51:34.405537 | controller | Wednesday 03 December 2025  10:51:33 +0000 (0:00:00.030)       0:01:23.608 ****
2025-12-03 10:51:34.405550 | controller | changed: [instance] => (item=workload)
2025-12-03 10:51:34.405585 | controller | changed: [instance] => (item=reproducer-inventory)
2025-12-03 10:51:34.405592 | controller | ok: [instance] => (item=volumes)
2025-12-03 10:51:34.405602 | controller |
2025-12-03 10:51:34.405614 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] **********************
2025-12-03 10:51:34.405621 | controller | Wednesday 03 December 2025  10:51:34 +0000 (0:00:00.548)       0:01:24.157 ****
2025-12-03 10:51:34.803227 | controller | changed: [instance] => (item=workload)
2025-12-03 10:51:34.829019 | controller | changed: [instance] => (item=volumes)
2025-12-03 10:51:34.829043 | controller |
2025-12-03 10:51:34.829050 | controller | TASK [libvirt_manager : Generate networking data] ******************************
2025-12-03 10:51:34.829056 | controller | Wednesday 03 December 2025  10:51:34 +0000 (0:00:00.397)       0:01:24.555 ****
2025-12-03 10:51:34.829064 | controller | skipping: [instance]
2025-12-03 10:51:35.808393 | controller |
2025-12-03 10:51:35.808424 | controller | TASK [libvirt_manager : Create group inventories] ******************************
2025-12-03 10:51:35.808432 | controller | Wednesday 03 December 2025  10:51:34 +0000 (0:00:00.026)       0:01:24.581 ****
2025-12-03 10:51:35.808442 | controller | changed: [instance] => (item=compute)
2025-12-03 10:51:35.808938 | controller | changed: [instance] => (item=controller)
2025-12-03 10:51:36.170481 | controller | changed: [instance] => (item=crc)
2025-12-03 10:51:36.170517 | controller |
2025-12-03 10:51:36.170528 | controller | TASK [libvirt_manager : Create "all" group inventory file] *********************
2025-12-03 10:51:36.170536 | controller | Wednesday 03 December 2025  10:51:35 +0000 (0:00:00.979)       0:01:25.560 ****
2025-12-03 10:51:36.170548 | controller | changed: [instance]
2025-12-03 10:51:36.170581 | controller |
2025-12-03 10:51:36.170592 | controller | TASK [libvirt_manager : Ensure storage pool is present.] ***********************
2025-12-03 10:51:36.170620 | controller | Wednesday 03 December 2025  10:51:36 +0000 (0:00:00.361)       0:01:25.922 ****
2025-12-03 10:51:36.209104 | controller | skipping: [instance]
2025-12-03 10:51:36.275485 | controller |
2025-12-03 10:51:36.275539 | controller | TASK [libvirt_manager : Ensure images are present] *****************************
2025-12-03 10:51:36.275553 | controller | Wednesday 03 December 2025  10:51:36 +0000 (0:00:00.038)       0:01:25.961 ****
2025-12-03 10:51:36.275572 | controller | skipping: [instance] => (item=crc)
2025-12-03 10:51:36.482846 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute)
2025-12-03 10:51:36.482878 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller)
2025-12-03 10:51:36.482886 | controller |
2025-12-03 10:51:36.482892 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2025-12-03 10:51:36.482898 | controller | Wednesday 03 December 2025  10:51:36 +0000 (0:00:00.065)       0:01:26.027 ****
2025-12-03 10:51:36.482911 | controller | changed: [instance]
2025-12-03 10:51:36.651493 | controller |
2025-12-03 10:51:36.651530 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2025-12-03 10:51:36.651540 | controller | Wednesday 03 December 2025  10:51:36 +0000 (0:00:00.207)       0:01:26.235 ****
2025-12-03 10:51:36.651553 | controller | ok: [instance]
2025-12-03 10:51:57.020608 | controller |
2025-12-03 10:51:57.020645 | controller | TASK [libvirt_manager : Download base image] ***********************************
2025-12-03 10:51:57.020653 | controller | Wednesday 03 December 2025  10:51:36 +0000 (0:00:00.168)       0:01:26.403 ****
2025-12-03 10:51:57.020663 | controller | changed: [instance]
2025-12-03 10:51:57.221013 | controller |
2025-12-03 10:51:57.221033 | controller | TASK [libvirt_manager : Check image] *******************************************
2025-12-03 10:51:57.221040 | controller | Wednesday 03 December 2025  10:51:57 +0000 (0:00:20.368)       0:01:46.772 ****
2025-12-03 10:51:57.221049 | controller | ok: [instance]
2025-12-03 10:51:57.264316 | controller |
2025-12-03 10:51:57.264356 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2025-12-03 10:51:57.264365 | controller | Wednesday 03 December 2025  10:51:57 +0000 (0:00:00.200)       0:01:46.973 ****
2025-12-03 10:51:57.264375 | controller | ok: [instance] => changed=false
2025-12-03 10:51:57.462865 | controller |   msg: All assertions passed
2025-12-03 10:51:57.462882 | controller |
2025-12-03 10:51:57.462889 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2025-12-03 10:51:57.462894 | controller | Wednesday 03 December 2025  10:51:57 +0000 (0:00:00.043)       0:01:47.016 ****
2025-12-03 10:51:57.462907 | controller | changed: [instance]
2025-12-03 10:51:57.662201 | controller |
2025-12-03 10:51:57.662224 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2025-12-03 10:51:57.662231 | controller | Wednesday 03 December 2025  10:51:57 +0000 (0:00:00.198)       0:01:47.215 ****
2025-12-03 10:51:57.662240 | controller | ok: [instance]
2025-12-03 10:51:57.852469 | controller |
2025-12-03 10:51:57.852506 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2025-12-03 10:51:57.852515 | controller | Wednesday 03 December 2025  10:51:57 +0000 (0:00:00.199)       0:01:47.414 ****
2025-12-03 10:51:57.852526 | controller | ok: [instance]
2025-12-03 10:51:57.876170 | controller |
2025-12-03 10:51:57.876200 | controller | TASK [libvirt_manager : Download base image] ***********************************
2025-12-03 10:51:57.876210 | controller | Wednesday 03 December 2025  10:51:57 +0000 (0:00:00.190)       0:01:47.604 ****
2025-12-03 10:51:57.876224 | controller | skipping: [instance]
2025-12-03 10:51:58.075424 | controller |
2025-12-03 10:51:58.075446 | controller | TASK [libvirt_manager : Check image] *******************************************
2025-12-03 10:51:58.075453 | controller | Wednesday 03 December 2025  10:51:57 +0000 (0:00:00.023)       0:01:47.628 ****
2025-12-03 10:51:58.075462 | controller | ok: [instance]
2025-12-03 10:51:58.118136 | controller |
2025-12-03 10:51:58.118164 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2025-12-03 10:51:58.118171 | controller | Wednesday 03 December 2025  10:51:58 +0000 (0:00:00.199)       0:01:47.827 ****
2025-12-03 10:51:58.118180 | controller | ok: [instance] => changed=false
2025-12-03 10:51:58.318850 | controller |   msg: All assertions passed
2025-12-03 10:51:58.318869 | controller |
2025-12-03 10:51:58.318876 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2025-12-03 10:51:58.318882 | controller | Wednesday 03 December 2025  10:51:58 +0000 (0:00:00.042)       0:01:47.869 ****
2025-12-03 10:51:58.318891 | controller | ok: [instance]
2025-12-03 10:51:58.494190 | controller |
2025-12-03 10:51:58.494208 | controller | TASK [libvirt_manager : Get ssh key state] *************************************
2025-12-03 10:51:58.494215 | controller | Wednesday 03 December 2025  10:51:58 +0000 (0:00:00.201)       0:01:48.071 ****
2025-12-03 10:51:58.494223 | controller | ok: [instance]
2025-12-03 10:51:58.872502 | controller |
2025-12-03 10:51:58.872548 | controller | TASK [libvirt_manager : Create temporary ssh keypair] **************************
2025-12-03 10:51:58.872557 | controller | Wednesday 03 December 2025  10:51:58 +0000 (0:00:00.175)       0:01:48.246 ****
2025-12-03 10:51:58.872570 | controller | changed: [instance]
2025-12-03 10:51:58.872599 | controller |
2025-12-03 10:51:58.872608 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************
2025-12-03 10:51:59.041886 | controller | Wednesday 03 December 2025  10:51:58 +0000 (0:00:00.378)       0:01:48.624 ****
2025-12-03 10:51:59.041910 | controller | ok: [instance]
2025-12-03 10:51:59.207434 | controller |
2025-12-03 10:51:59.207470 | controller | TASK [libvirt_manager : Slurp private key for later use] ***********************
2025-12-03 10:51:59.207478 | controller | Wednesday 03 December 2025  10:51:59 +0000 (0:00:00.169)       0:01:48.793 ****
2025-12-03 10:51:59.207489 | controller | ok: [instance]
2025-12-03 10:51:59.207547 | controller |
2025-12-03 10:51:59.207567 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] ***
2025-12-03 10:51:59.207581 | controller | Wednesday 03 December 2025  10:51:59 +0000 (0:00:00.165)       0:01:48.959 ****
2025-12-03 10:51:59.583171 | controller | changed: [instance]
2025-12-03 10:51:59.604486 | controller |
2025-12-03 10:51:59.604525 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] **************
2025-12-03 10:51:59.604535 | controller | Wednesday 03 December 2025  10:51:59 +0000 (0:00:00.375)       0:01:49.335 ****
2025-12-03 10:51:59.604548 | controller | ok: [instance]
2025-12-03 10:51:59.831215 | controller |
2025-12-03 10:51:59.831236 | controller | TASK [libvirt_manager : List existing networks] ********************************
2025-12-03 10:51:59.831244 | controller | Wednesday 03 December 2025  10:51:59 +0000 (0:00:00.021)       0:01:49.356 ****
2025-12-03 10:51:59.831253 | controller | ok: [instance]
2025-12-03 10:52:00.281834 | controller |
2025-12-03 10:52:00.281863 | controller | TASK [libvirt_manager : Gather pool fact] **************************************
2025-12-03 10:52:00.281874 | controller | Wednesday 03 December 2025  10:51:59 +0000 (0:00:00.226)       0:01:49.583 ****
2025-12-03 10:52:00.281884 | controller | ok: [instance]
2025-12-03 10:52:00.396586 | controller |
2025-12-03 10:52:00.396634 | controller | TASK [libvirt_manager : Create and run VMs] ************************************
2025-12-03 10:52:00.396648 | controller | Wednesday 03 December 2025  10:52:00 +0000 (0:00:00.450)       0:01:50.033 ****
2025-12-03 10:52:00.396666 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2025-12-03 10:52:00.396710 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2025-12-03 10:52:00.396722 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2025-12-03 10:52:00.396732 | controller |
2025-12-03 10:52:00.396744 | controller | TASK [libvirt_manager : Create VM image for compute-0] *************************
2025-12-03 10:52:00.647468 | controller | Wednesday 03 December 2025  10:52:00 +0000 (0:00:00.114)       0:01:50.148 ****
2025-12-03 10:52:00.647537 | controller | changed: [instance]
2025-12-03 10:52:00.861423 | controller |
2025-12-03 10:52:00.861455 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ********
2025-12-03 10:52:00.861463 | controller | Wednesday 03 December 2025  10:52:00 +0000 (0:00:00.250)       0:01:50.399 ****
2025-12-03 10:52:00.861473 | controller | changed: [instance]
2025-12-03 10:52:00.861496 | controller |
2025-12-03 10:52:00.861503 | controller | TASK [libvirt_manager : Define VMs for type compute-0] *************************
2025-12-03 10:52:00.861577 | controller | Wednesday 03 December 2025  10:52:00 +0000 (0:00:00.214)       0:01:50.613 ****
2025-12-03 10:52:01.173409 | controller | changed: [instance]
2025-12-03 10:52:01.173458 | controller |
2025-12-03 10:52:01.173726 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] ***********
2025-12-03 10:52:01.209262 | controller | Wednesday 03 December 2025  10:52:01 +0000 (0:00:00.312)       0:01:50.925 ****
2025-12-03 10:52:01.209299 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2025-12-03 10:52:01.265015 | controller |
2025-12-03 10:52:01.265039 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2025-12-03 10:52:01.265047 | controller | Wednesday 03 December 2025  10:52:01 +0000 (0:00:00.034)       0:01:50.960 ****
2025-12-03 10:52:01.265057 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2025-12-03 10:52:01.505061 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2025-12-03 10:52:01.505089 | controller |
2025-12-03 10:52:01.505097 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-12-03 10:52:01.505105 | controller | Wednesday 03 December 2025  10:52:01 +0000 (0:00:00.055)       0:01:51.015 ****
2025-12-03 10:52:01.505114 | controller | ok: [instance]
2025-12-03 10:52:01.551499 | controller |
2025-12-03 10:52:01.551544 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-12-03 10:52:01.551558 | controller | Wednesday 03 December 2025  10:52:01 +0000 (0:00:00.241)       0:01:51.256 ****
2025-12-03 10:52:01.551576 | controller | ok: [instance] => (item=cifmw-public)
2025-12-03 10:52:01.551619 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-12-03 10:52:01.551800 | controller |
2025-12-03 10:52:01.551819 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-12-03 10:52:01.778223 | controller | Wednesday 03 December 2025  10:52:01 +0000 (0:00:00.047)       0:01:51.303 ****
2025-12-03 10:52:01.778264 | controller | ok: [instance]
2025-12-03 10:52:01.978251 | controller |
2025-12-03 10:52:01.978268 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-12-03 10:52:01.978279 | controller | Wednesday 03 December 2025  10:52:01 +0000 (0:00:00.226)       0:01:51.530 ****
2025-12-03 10:52:01.978287 | controller | ok: [instance]
2025-12-03 10:52:02.268038 | controller |
2025-12-03 10:52:02.268064 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************
2025-12-03 10:52:02.268072 | controller | Wednesday 03 December 2025  10:52:01 +0000 (0:00:00.200)       0:01:51.730 ****
2025-12-03 10:52:02.268082 | controller | changed: [instance]
2025-12-03 10:52:02.498715 | controller |
2025-12-03 10:52:02.498735 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-12-03 10:52:02.498743 | controller | Wednesday 03 December 2025  10:52:02 +0000 (0:00:00.289)       0:01:52.020 ****
2025-12-03 10:52:02.498755 | controller | ok: [instance]
2025-12-03 10:52:02.544835 | controller |
2025-12-03 10:52:02.544852 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-12-03 10:52:02.544859 | controller | Wednesday 03 December 2025  10:52:02 +0000 (0:00:00.230)       0:01:52.250 ****
2025-12-03 10:52:02.544867 | controller | ok: [instance] => (item=cifmw-public)
2025-12-03 10:52:02.768444 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-12-03 10:52:02.768473 | controller |
2025-12-03 10:52:02.768483 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-12-03 10:52:02.768490 | controller | Wednesday 03 December 2025  10:52:02 +0000 (0:00:00.045)       0:01:52.296 ****
2025-12-03 10:52:02.768502 | controller | ok: [instance]
2025-12-03 10:52:02.963693 | controller |
2025-12-03 10:52:02.963711 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-12-03 10:52:02.963717 | controller | Wednesday 03 December 2025  10:52:02 +0000 (0:00:00.223)       0:01:52.520 ****
2025-12-03 10:52:02.963725 | controller | ok: [instance]
2025-12-03 10:52:03.253958 | controller |
2025-12-03 10:52:03.253978 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] *********
2025-12-03 10:52:03.253985 | controller | Wednesday 03 December 2025  10:52:02 +0000 (0:00:00.195)       0:01:52.716 ****
2025-12-03 10:52:03.253993 | controller | changed: [instance]
2025-12-03 10:52:03.276929 | controller |
2025-12-03 10:52:03.276947 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] *****
2025-12-03 10:52:03.276954 | controller | Wednesday 03 December 2025  10:52:03 +0000 (0:00:00.290)       0:01:53.006 ****
2025-12-03 10:52:03.276962 | controller | skipping: [instance]
2025-12-03 10:52:03.305428 | controller |
2025-12-03 10:52:03.305464 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ********
2025-12-03 10:52:03.305480 | controller | Wednesday 03 December 2025  10:52:03 +0000 (0:00:00.022)       0:01:53.029 ****
2025-12-03 10:52:03.305491 | controller | skipping: [instance]
2025-12-03 10:52:03.305686 | controller |
2025-12-03 10:52:03.305713 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] **************
2025-12-03 10:52:03.333463 | controller | Wednesday 03 December 2025  10:52:03 +0000 (0:00:00.028)       0:01:53.057 ****
2025-12-03 10:52:03.333500 | controller | skipping: [instance]
2025-12-03 10:52:03.359250 | controller |
2025-12-03 10:52:03.359273 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] ***********************
2025-12-03 10:52:03.359282 | controller | Wednesday 03 December 2025  10:52:03 +0000 (0:00:00.027)       0:01:53.085 ****
2025-12-03 10:52:03.359292 | controller | skipping: [instance]
2025-12-03 10:52:03.570124 | controller |
2025-12-03 10:52:03.570142 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2025-12-03 10:52:03.570149 | controller | Wednesday 03 December 2025  10:52:03 +0000 (0:00:00.025)       0:01:53.111 ****
2025-12-03 10:52:03.570168 | controller | changed: [instance]
2025-12-03 10:52:03.607424 | controller |
2025-12-03 10:52:03.607448 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2025-12-03 10:52:03.607456 | controller | Wednesday 03 December 2025  10:52:03 +0000 (0:00:00.210)       0:01:53.322 ****
2025-12-03 10:52:03.607468 | controller | ok: [instance]
2025-12-03 10:52:03.607495 | controller |
2025-12-03 10:52:03.607505 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2025-12-03 10:52:03.607577 | controller | Wednesday 03 December 2025  10:52:03 +0000 (0:00:00.037)       0:01:53.359 ****
2025-12-03 10:52:03.662521 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2025-12-03 10:52:03.662639 | controller |
2025-12-03 10:52:03.662658 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2025-12-03 10:52:03.853212 | controller | Wednesday 03 December 2025  10:52:03 +0000 (0:00:00.054)       0:01:53.414 ****
2025-12-03 10:52:03.853245 | controller | ok: [instance]
2025-12-03 10:52:03.914457 | controller |
2025-12-03 10:52:03.914488 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2025-12-03 10:52:03.914497 | controller | Wednesday 03 December 2025  10:52:03 +0000 (0:00:00.190)       0:01:53.605 ****
2025-12-03 10:52:03.914509 | controller | ok: [instance]
2025-12-03 10:52:03.914537 | controller |
2025-12-03 10:52:03.914546 | controller | TASK [libvirt_manager : Define the user data] **********************************
2025-12-03 10:52:03.914608 | controller | Wednesday 03 December 2025  10:52:03 +0000 (0:00:00.061)       0:01:53.666 ****
2025-12-03 10:52:03.959557 | controller | ok: [instance]
2025-12-03 10:52:03.959715 | controller |
2025-12-03 10:52:03.959742 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2025-12-03 10:52:03.959759 | controller | Wednesday 03 December 2025  10:52:03 +0000 (0:00:00.044)       0:01:53.711 ****
2025-12-03 10:52:04.003291 | controller | skipping: [instance]
2025-12-03 10:52:04.044497 | controller |
2025-12-03 10:52:04.044533 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2025-12-03 10:52:04.044553 | controller | Wednesday 03 December 2025  10:52:04 +0000 (0:00:00.043)       0:01:53.755 ****
2025-12-03 10:52:04.044570 | controller | skipping: [instance]
2025-12-03 10:52:04.101885 | controller |
2025-12-03 10:52:04.101918 | controller | TASK [Call the config_drive role] **********************************************
2025-12-03 10:52:04.101931 | controller | Wednesday 03 December 2025  10:52:04 +0000 (0:00:00.040)       0:01:53.796 ****
2025-12-03 10:52:04.101946 | controller |
2025-12-03 10:52:04.484880 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2025-12-03 10:52:04.484907 | controller | Wednesday 03 December 2025  10:52:04 +0000 (0:00:00.057)       0:01:53.853 ****
2025-12-03 10:52:04.484919 | controller | ok: [instance] => (item=artifacts)
2025-12-03 10:52:05.606057 | controller | ok: [instance] => (item=logs)
2025-12-03 10:52:05.606093 | controller |
2025-12-03 10:52:05.606101 | controller | TASK [config_drive : Install required RPM packages] ****************************
2025-12-03 10:52:05.606108 | controller | Wednesday 03 December 2025  10:52:04 +0000 (0:00:00.382)       0:01:54.236 ****
2025-12-03 10:52:05.606118 | controller | ok: [instance]
2025-12-03 10:52:05.814449 | controller |
2025-12-03 10:52:05.814472 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2025-12-03 10:52:05.814481 | controller | Wednesday 03 December 2025  10:52:05 +0000 (0:00:01.121)       0:01:55.358 ****
2025-12-03 10:52:05.814492 | controller | changed: [instance]
2025-12-03 10:52:05.814684 | controller |
2025-12-03 10:52:05.814702 | controller | TASK [config_drive : Generate meta-data] ***************************************
2025-12-03 10:52:06.163191 | controller | Wednesday 03 December 2025  10:52:05 +0000 (0:00:00.208)       0:01:55.566 ****
2025-12-03 10:52:06.163211 | controller | changed: [instance]
2025-12-03 10:52:06.521185 | controller |
2025-12-03 10:52:06.521215 | controller | TASK [config_drive : Generate user-data] ***************************************
2025-12-03 10:52:06.521222 | controller | Wednesday 03 December 2025  10:52:06 +0000 (0:00:00.348)       0:01:55.915 ****
2025-12-03 10:52:06.521231 | controller | changed: [instance]
2025-12-03 10:52:06.566687 | controller |
2025-12-03 10:52:06.566704 | controller | TASK [config_drive : Generate network-data] ************************************
2025-12-03 10:52:06.566711 | controller | Wednesday 03 December 2025  10:52:06 +0000 (0:00:00.357)       0:01:56.273 ****
2025-12-03 10:52:06.566719 | controller | skipping: [instance]
2025-12-03 10:52:06.766442 | controller |
2025-12-03 10:52:06.766478 | controller | TASK [config_drive : Check ISO availability] ***********************************
2025-12-03 10:52:06.766488 | controller | Wednesday 03 December 2025  10:52:06 +0000 (0:00:00.045)       0:01:56.319 ****
2025-12-03 10:52:06.766500 | controller | ok: [instance]
2025-12-03 10:52:06.809233 | controller |
2025-12-03 10:52:06.809258 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2025-12-03 10:52:06.809271 | controller | Wednesday 03 December 2025  10:52:06 +0000 (0:00:00.199)       0:01:56.518 ****
2025-12-03 10:52:06.809281 | controller | skipping: [instance]
2025-12-03 10:52:07.042655 | controller |
2025-12-03 10:52:07.042679 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2025-12-03 10:52:07.042688 | controller | Wednesday 03 December 2025  10:52:06 +0000 (0:00:00.042)       0:01:56.561 ****
2025-12-03 10:52:07.042699 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log
2025-12-03 10:52:07.311899 | controller | changed: [instance]
2025-12-03 10:52:07.311921 | controller |
2025-12-03 10:52:07.311929 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2025-12-03 10:52:07.311935 | controller | Wednesday 03 December 2025  10:52:07 +0000 (0:00:00.233)       0:01:56.794 ****
2025-12-03 10:52:07.311944 | controller | changed: [instance]
2025-12-03 10:52:07.358057 | controller |
2025-12-03 10:52:07.358090 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2025-12-03 10:52:07.358098 | controller | Wednesday 03 December 2025  10:52:07 +0000 (0:00:00.269)       0:01:57.064 ****
2025-12-03 10:52:07.358109 | controller | skipping: [instance]
2025-12-03 10:52:07.387512 | controller |
2025-12-03 10:52:07.387558 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ********************
2025-12-03 10:52:07.387568 | controller | Wednesday 03 December 2025  10:52:07 +0000 (0:00:00.046)       0:01:57.110 ****
2025-12-03 10:52:07.387582 | controller | skipping: [instance]
2025-12-03 10:52:07.635454 | controller |
2025-12-03 10:52:07.635492 | controller | TASK [libvirt_manager : Create VM image for controller-0] **********************
2025-12-03 10:52:07.635502 | controller | Wednesday 03 December 2025  10:52:07 +0000 (0:00:00.029)       0:01:57.139 ****
2025-12-03 10:52:07.635515 | controller | changed: [instance]
2025-12-03 10:52:07.635557 | controller |
2025-12-03 10:52:07.635568 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] *****
2025-12-03 10:52:07.635595 | controller | Wednesday 03 December 2025  10:52:07 +0000 (0:00:00.248)       0:01:57.387 ****
2025-12-03 10:52:07.852454 | controller | changed: [instance]
2025-12-03 10:52:07.852552 | controller |
2025-12-03 10:52:07.852577 | controller | TASK [libvirt_manager : Define VMs for type controller-0] **********************
2025-12-03 10:52:07.852589 | controller | Wednesday 03 December 2025  10:52:07 +0000 (0:00:00.216)       0:01:57.604 ****
2025-12-03 10:52:08.131827 | controller | changed: [instance]
2025-12-03 10:52:08.161009 | controller |
2025-12-03 10:52:08.161034 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ********
2025-12-03 10:52:08.161046 | controller | Wednesday 03 December 2025  10:52:08 +0000 (0:00:00.279)       0:01:57.883 ****
2025-12-03 10:52:08.161060 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2025-12-03 10:52:08.204522 | controller |
2025-12-03 10:52:08.204568 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2025-12-03 10:52:08.204581 | controller | Wednesday 03 December 2025  10:52:08 +0000 (0:00:00.029)       0:01:57.913 ****
2025-12-03 10:52:08.204598 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2025-12-03 10:52:08.204640 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2025-12-03 10:52:08.204658 | controller |
2025-12-03 10:52:08.204670 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-12-03 10:52:08.429095 | controller | Wednesday 03 December 2025  10:52:08 +0000 (0:00:00.043)       0:01:57.956 ****
2025-12-03 10:52:08.429121 | controller | ok: [instance]
2025-12-03 10:52:08.475255 | controller |
2025-12-03 10:52:08.475277 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-12-03 10:52:08.475286 | controller | Wednesday 03 December 2025  10:52:08 +0000 (0:00:00.224)       0:01:58.181 ****
2025-12-03 10:52:08.475297 | controller | ok: [instance] => (item=cifmw-public)
2025-12-03 10:52:08.704419 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-12-03 10:52:08.704457 | controller |
2025-12-03 10:52:08.704468 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-12-03 10:52:08.704476 | controller | Wednesday 03 December 2025  10:52:08 +0000 (0:00:00.046)       0:01:58.227 ****
2025-12-03 10:52:08.704488 | controller | ok: [instance]
2025-12-03 10:52:08.704521 | controller |
2025-12-03 10:52:08.704811 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-12-03 10:52:08.899137 | controller | Wednesday 03 December 2025  10:52:08 +0000 (0:00:00.229)       0:01:58.456 ****
2025-12-03 10:52:08.899159 | controller | ok: [instance]
2025-12-03 10:52:09.160911 | controller |
2025-12-03 10:52:09.160930 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] *********
2025-12-03 10:52:09.160938 | controller | Wednesday 03 December 2025  10:52:08 +0000 (0:00:00.193)       0:01:58.649 ****
2025-12-03 10:52:09.160947 | controller | changed: [instance]
2025-12-03 10:52:09.383506 | controller |
2025-12-03 10:52:09.383553 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-12-03 10:52:09.383567 | controller | Wednesday 03 December 2025  10:52:09 +0000 (0:00:00.263)       0:01:58.913 ****
2025-12-03 10:52:09.383585 | controller | ok: [instance]
2025-12-03 10:52:09.425905 | controller |
2025-12-03 10:52:09.425933 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-12-03 10:52:09.425941 | controller | Wednesday 03 December 2025  10:52:09 +0000 (0:00:00.222)       0:01:59.135 ****
2025-12-03 10:52:09.425951 | controller | ok: [instance] => (item=cifmw-public)
2025-12-03 10:52:09.649738 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-12-03 10:52:09.649761 | controller |
2025-12-03 10:52:09.649769 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-12-03 10:52:09.649775 | controller | Wednesday 03 December 2025  10:52:09 +0000 (0:00:00.042)       0:01:59.178 ****
2025-12-03 10:52:09.649784 | controller | ok: [instance]
2025-12-03 10:52:09.848237 | controller |
2025-12-03 10:52:09.848273 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-12-03 10:52:09.848283 | controller | Wednesday 03 December 2025  10:52:09 +0000 (0:00:00.223)       0:01:59.401 ****
2025-12-03 10:52:09.848295 | controller | ok: [instance]
2025-12-03 10:52:10.116883 | controller |
2025-12-03 10:52:10.116913 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ******
2025-12-03 10:52:10.116920 | controller | Wednesday 03 December 2025  10:52:09 +0000 (0:00:00.198)       0:01:59.600 ****
2025-12-03 10:52:10.116930 | controller | changed: [instance]
2025-12-03 10:52:10.136425 | controller |
2025-12-03 10:52:10.136454 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] ***
2025-12-03 10:52:10.136464 | controller | Wednesday 03 December 2025  10:52:10 +0000 (0:00:00.268)       0:01:59.868 ****
2025-12-03 10:52:10.136474 | controller | skipping: [instance]
2025-12-03 10:52:10.136503 | controller |
2025-12-03 10:52:10.136664 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] *****
2025-12-03 10:52:10.163813 | controller | Wednesday 03 December 2025  10:52:10 +0000 (0:00:00.020)       0:01:59.889 ****
2025-12-03 10:52:10.163840 | controller | skipping: [instance]
2025-12-03 10:52:10.190434 | controller |
2025-12-03 10:52:10.190458 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] ***********
2025-12-03 10:52:10.190467 | controller | Wednesday 03 December 2025  10:52:10 +0000 (0:00:00.027)       0:01:59.916 ****
2025-12-03 10:52:10.190478 | controller | skipping: [instance]
2025-12-03 10:52:10.190506 | controller |
2025-12-03 10:52:10.190515 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ********************
2025-12-03 10:52:10.190612 | controller | Wednesday 03 December 2025  10:52:10 +0000 (0:00:00.026)       0:01:59.942 ****
2025-12-03 10:52:10.216485 | controller | skipping: [instance]
2025-12-03 10:52:10.216550 | controller |
2025-12-03 10:52:10.216789 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2025-12-03 10:52:10.424127 | controller | Wednesday 03 December 2025  10:52:10 +0000 (0:00:00.025)       0:01:59.968 ****
2025-12-03 10:52:10.424155 | controller | changed: [instance]
2025-12-03 10:52:10.513446 | controller |
2025-12-03 10:52:10.513475 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2025-12-03 10:52:10.513489 | controller | Wednesday 03 December 2025  10:52:10 +0000 (0:00:00.207)       0:02:00.176 ****
2025-12-03 10:52:10.513500 | controller | ok: [instance]
2025-12-03 10:52:10.566502 | controller |
2025-12-03 10:52:10.566535 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2025-12-03 10:52:10.566548 | controller | Wednesday 03 December 2025  10:52:10 +0000 (0:00:00.089)       0:02:00.265 ****
2025-12-03 10:52:10.566565 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2025-12-03 10:52:10.752189 | controller |
2025-12-03 10:52:10.752215 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2025-12-03 10:52:10.752222 | controller | Wednesday 03 December 2025  10:52:10 +0000 (0:00:00.052)       0:02:00.318 ****
2025-12-03 10:52:10.752230 | controller | ok: [instance]
2025-12-03 10:52:10.812764 | controller |
2025-12-03 10:52:10.812786 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2025-12-03 10:52:10.812795 | controller | Wednesday 03 December 2025  10:52:10 +0000 (0:00:00.186)       0:02:00.504 ****
2025-12-03 10:52:10.812805 | controller | ok: [instance]
2025-12-03 10:52:10.856097 | controller |
2025-12-03 10:52:10.856118 | controller | TASK [libvirt_manager : Define the user data] **********************************
2025-12-03 10:52:10.856127 | controller | Wednesday 03 December 2025  10:52:10 +0000 (0:00:00.060)       0:02:00.565 ****
2025-12-03 10:52:10.856137 | controller | ok: [instance]
2025-12-03 10:52:10.897081 | controller |
2025-12-03 10:52:10.897102 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2025-12-03 10:52:10.897110 | controller | Wednesday 03 December 2025  10:52:10 +0000 (0:00:00.043)       0:02:00.608 ****
2025-12-03 10:52:10.897120 | controller | skipping: [instance]
2025-12-03 10:52:10.938132 | controller |
2025-12-03 10:52:10.938153 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2025-12-03 10:52:10.938161 | controller | Wednesday 03 December 2025  10:52:10 +0000 (0:00:00.040)       0:02:00.649 ****
2025-12-03 10:52:10.938185 | controller | skipping: [instance]
2025-12-03 10:52:10.998036 | controller |
2025-12-03 10:52:10.998065 | controller | TASK [Call the config_drive role] **********************************************
2025-12-03 10:52:10.998073 | controller | Wednesday 03 December 2025  10:52:10 +0000 (0:00:00.041)       0:02:00.690 ****
2025-12-03 10:52:10.998084 | controller |
2025-12-03 10:52:11.379009 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2025-12-03 10:52:11.379036 | controller | Wednesday 03 December 2025  10:52:10 +0000 (0:00:00.059)       0:02:00.750 ****
2025-12-03 10:52:11.379047 | controller | ok: [instance] => (item=artifacts)
2025-12-03 10:52:12.497456 | controller | ok: [instance] => (item=logs)
2025-12-03 10:52:12.497493 | controller |
2025-12-03 10:52:12.497502 | controller | TASK [config_drive : Install required RPM packages] ****************************
2025-12-03 10:52:12.497509 | controller | Wednesday 03 December 2025  10:52:11 +0000 (0:00:00.380)       0:02:01.131 ****
2025-12-03 10:52:12.497520 | controller | ok: [instance]
2025-12-03 10:52:12.704439 | controller |
2025-12-03 10:52:12.704468 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2025-12-03 10:52:12.704476 | controller | Wednesday 03 December 2025  10:52:12 +0000 (0:00:01.118)       0:02:02.249 ****
2025-12-03 10:52:12.704486 | controller | changed: [instance]
2025-12-03 10:52:13.062062 | controller |
2025-12-03 10:52:13.062091 | controller | TASK [config_drive : Generate meta-data] ***************************************
2025-12-03 10:52:13.062099 | controller | Wednesday 03 December 2025  10:52:12 +0000 (0:00:00.207)       0:02:02.456 ****
2025-12-03 10:52:13.062109 | controller | changed: [instance]
2025-12-03 10:52:13.429997 | controller |
2025-12-03 10:52:13.430030 | controller | TASK [config_drive : Generate user-data] ***************************************
2025-12-03 10:52:13.430039 | controller | Wednesday 03 December 2025  10:52:13 +0000 (0:00:00.357)       0:02:02.814 ****
2025-12-03 10:52:13.430055 | controller | changed: [instance]
2025-12-03 10:52:13.472115 | controller |
2025-12-03 10:52:13.472142 | controller | TASK [config_drive : Generate network-data] ************************************
2025-12-03 10:52:13.472151 | controller | Wednesday 03 December 2025  10:52:13 +0000 (0:00:00.367)       0:02:03.181 ****
2025-12-03 10:52:13.472167 | controller | skipping: [instance]
2025-12-03 10:52:13.675772 | controller |
2025-12-03 10:52:13.675799 | controller | TASK [config_drive : Check ISO availability] ***********************************
2025-12-03 10:52:13.675806 | controller | Wednesday 03 December 2025  10:52:13 +0000 (0:00:00.042)       0:02:03.224 ****
2025-12-03 10:52:13.675816 | controller | ok: [instance]
2025-12-03 10:52:13.719455 | controller |
2025-12-03 10:52:13.719486 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2025-12-03 10:52:13.719494 | controller | Wednesday 03 December 2025  10:52:13 +0000 (0:00:00.203)       0:02:03.427 ****
2025-12-03 10:52:13.719504 | controller | skipping: [instance]
2025-12-03 10:52:13.719532 | controller |
2025-12-03 10:52:13.719541 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2025-12-03 10:52:13.719562 | controller | Wednesday 03 December 2025  10:52:13 +0000 (0:00:00.043)       0:02:03.471 ****
2025-12-03 10:52:13.955972 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log
2025-12-03 10:52:14.230396 | controller | changed: [instance]
2025-12-03 10:52:14.230433 | controller |
2025-12-03 10:52:14.230443 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2025-12-03 10:52:14.230451 | controller | Wednesday 03 December 2025  10:52:13 +0000 (0:00:00.235)       0:02:03.707 ****
2025-12-03 10:52:14.230464 | controller | changed: [instance]
2025-12-03 10:52:14.276918 | controller |
2025-12-03 10:52:14.276952 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2025-12-03 10:52:14.276961 | controller | Wednesday 03 December 2025  10:52:14 +0000 (0:00:00.274)       0:02:03.982 ****
2025-12-03 10:52:14.276972 | controller | skipping: [instance]
2025-12-03 10:52:14.304311 | controller |
2025-12-03 10:52:14.304353 | controller | TASK [libvirt_manager : Configure boot order for controller-0] *****************
2025-12-03 10:52:14.304365 | controller | Wednesday 03 December 2025  10:52:14 +0000 (0:00:00.046)       0:02:04.029 ****
2025-12-03 10:52:14.304376 | controller | skipping: [instance]
2025-12-03 10:52:14.541385 | controller |
2025-12-03 10:52:14.541407 | controller | TASK [libvirt_manager : Create VM image for crc-0] *****************************
2025-12-03 10:52:14.541415 | controller | Wednesday 03 December 2025  10:52:14 +0000 (0:00:00.027)       0:02:04.056 ****
2025-12-03 10:52:14.541424 | controller | changed: [instance]
2025-12-03 10:52:14.754816 | controller |
2025-12-03 10:52:14.754836 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************
2025-12-03 10:52:14.754843 | controller | Wednesday 03 December 2025  10:52:14 +0000 (0:00:00.236)       0:02:04.293 ****
2025-12-03 10:52:14.754852 | controller | changed: [instance]
2025-12-03 10:52:15.039716 | controller |
2025-12-03 10:52:15.039755 | controller | TASK [libvirt_manager : Define VMs for type crc-0] *****************************
2025-12-03 10:52:15.039765 | controller | Wednesday 03 December 2025  10:52:14 +0000 (0:00:00.213)       0:02:04.507 ****
2025-12-03 10:52:15.039777 | controller | changed: [instance]
2025-12-03 10:52:15.069442 | controller |
2025-12-03 10:52:15.069469 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] ***************
2025-12-03 10:52:15.069477 | controller | Wednesday 03 December 2025  10:52:15 +0000 (0:00:00.284)       0:02:04.791 ****
2025-12-03 10:52:15.069487 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2025-12-03 10:52:15.113411 | controller |
2025-12-03 10:52:15.113439 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2025-12-03 10:52:15.113448 | controller | Wednesday 03 December 2025  10:52:15 +0000 (0:00:00.030)       0:02:04.821 ****
2025-12-03 10:52:15.113461 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2025-12-03 10:52:15.113470 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2025-12-03 10:52:15.113477 | controller |
2025-12-03 10:52:15.113485 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-12-03 10:52:15.113495 | controller | Wednesday 03 December 2025  10:52:15 +0000 (0:00:00.043)       0:02:04.865 ****
2025-12-03 10:52:15.340357 | controller | ok: [instance]
2025-12-03 10:52:15.383930 | controller |
2025-12-03 10:52:15.383961 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-12-03 10:52:15.383974 | controller | Wednesday 03 December 2025  10:52:15 +0000 (0:00:00.226)       0:02:05.092 ****
2025-12-03 10:52:15.383989 | controller | ok: [instance] => (item=cifmw-public)
2025-12-03 10:52:15.384262 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-12-03 10:52:15.384544 | controller |
2025-12-03 10:52:15.384776 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-12-03 10:52:15.384916 | controller | Wednesday 03 December 2025  10:52:15 +0000 (0:00:00.044)       0:02:05.136 ****
2025-12-03 10:52:15.606285 | controller | ok: [instance]
2025-12-03 10:52:15.797459 | controller |
2025-12-03 10:52:15.797483 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-12-03 10:52:15.797493 | controller | Wednesday 03 December 2025  10:52:15 +0000 (0:00:00.221)       0:02:05.358 ****
2025-12-03 10:52:15.797504 | controller | ok: [instance]
2025-12-03 10:52:16.071371 | controller |
2025-12-03 10:52:16.071394 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] ****************
2025-12-03 10:52:16.071403 | controller | Wednesday 03 December 2025  10:52:15 +0000 (0:00:00.191)       0:02:05.549 ****
2025-12-03 10:52:16.071413 | controller | changed: [instance]
2025-12-03 10:52:16.294261 | controller |
2025-12-03 10:52:16.294285 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2025-12-03 10:52:16.294295 | controller | Wednesday 03 December 2025  10:52:16 +0000 (0:00:00.273)       0:02:05.823 ****
2025-12-03 10:52:16.294305 | controller | ok: [instance]
2025-12-03 10:52:16.336884 | controller |
2025-12-03 10:52:16.336906 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2025-12-03 10:52:16.336913 | controller | Wednesday 03 December 2025  10:52:16 +0000 (0:00:00.222)       0:02:06.046 ****
2025-12-03 10:52:16.336921 | controller | ok: [instance] => (item=cifmw-public)
2025-12-03 10:52:16.558384 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2025-12-03 10:52:16.558409 | controller |
2025-12-03 10:52:16.558416 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2025-12-03 10:52:16.558422 | controller | Wednesday 03 December 2025  10:52:16 +0000 (0:00:00.042)       0:02:06.089 ****
2025-12-03 10:52:16.558431 | controller | ok: [instance]
2025-12-03 10:52:16.558764 | controller |
2025-12-03 10:52:16.757422 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2025-12-03 10:52:16.757492 | controller | Wednesday 03 December 2025  10:52:16 +0000 (0:00:00.221)       0:02:06.310 ****
2025-12-03 10:52:16.757508 | controller | ok: [instance]
2025-12-03 10:52:16.757696 | controller |
2025-12-03 10:52:16.757728 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] *************
2025-12-03 10:52:17.034466 | controller | Wednesday 03 December 2025  10:52:16 +0000 (0:00:00.198)       0:02:06.509 ****
2025-12-03 10:52:17.034507 | controller | changed: [instance]
2025-12-03 10:52:17.034540 | controller |
2025-12-03 10:52:17.034551 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] *********
2025-12-03 10:52:17.034684 | controller | Wednesday 03 December 2025  10:52:17 +0000 (0:00:00.276)       0:02:06.786 ****
2025-12-03 10:52:17.055473 | controller | skipping: [instance]
2025-12-03 10:52:17.055724 | controller |
2025-12-03 10:52:17.055750 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************
2025-12-03 10:52:17.081841 | controller | Wednesday 03 December 2025  10:52:17 +0000 (0:00:00.021)       0:02:06.807 ****
2025-12-03 10:52:17.081867 | controller | skipping: [instance]
2025-12-03 10:52:17.107452 | controller |
2025-12-03 10:52:17.107475 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ******************
2025-12-03 10:52:17.107484 | controller | Wednesday 03 December 2025  10:52:17 +0000 (0:00:00.026)       0:02:06.834 ****
2025-12-03 10:52:17.107495 | controller | skipping: [instance]
2025-12-03 10:52:17.133449 | controller |
2025-12-03 10:52:17.133478 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] ***************************
2025-12-03 10:52:17.133487 | controller | Wednesday 03 December 2025  10:52:17 +0000 (0:00:00.025)       0:02:06.859 ****
2025-12-03 10:52:17.133497 | controller | skipping: [instance]
2025-12-03 10:52:18.341765 | controller |
2025-12-03 10:52:18.341801 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2025-12-03 10:52:18.341809 | controller | Wednesday 03 December 2025  10:52:17 +0000 (0:00:00.025)       0:02:06.885 ****
2025-12-03 10:52:18.341821 | controller | changed: [instance]
2025-12-03 10:52:18.378854 | controller |
2025-12-03 10:52:18.378880 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2025-12-03 10:52:18.378897 | controller | Wednesday 03 December 2025  10:52:18 +0000 (0:00:01.208)       0:02:08.093 ****
2025-12-03 10:52:18.378909 | controller | ok: [instance]
2025-12-03 10:52:18.405141 | controller |
2025-12-03 10:52:18.405169 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2025-12-03 10:52:18.405189 | controller | Wednesday 03 December 2025  10:52:18 +0000 (0:00:00.037)       0:02:08.131 ****
2025-12-03 10:52:18.405201 | controller | skipping: [instance]
2025-12-03 10:52:18.431449 | controller |
2025-12-03 10:52:18.431482 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2025-12-03 10:52:18.431490 | controller | Wednesday 03 December 2025  10:52:18 +0000 (0:00:00.026)       0:02:08.157 ****
2025-12-03 10:52:18.431504 | controller | skipping: [instance]
2025-12-03 10:52:18.431520 | controller |
2025-12-03 10:52:18.431528 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2025-12-03 10:52:18.431565 | controller | Wednesday 03 December 2025  10:52:18 +0000 (0:00:00.026)       0:02:08.183 ****
2025-12-03 10:52:18.474137 | controller | skipping: [instance]
2025-12-03 10:52:18.474212 | controller |
2025-12-03 10:52:18.474376 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************
2025-12-03 10:52:18.474497 | controller | Wednesday 03 December 2025  10:52:18 +0000 (0:00:00.042)       0:02:08.226 ****
2025-12-03 10:52:18.500436 | controller | skipping: [instance]
2025-12-03 10:52:18.500595 | controller |
2025-12-03 10:52:18.500618 | controller | TASK [libvirt_manager : Start (power-on) VMs] **********************************
2025-12-03 10:52:18.500632 | controller | Wednesday 03 December 2025  10:52:18 +0000 (0:00:00.025)       0:02:08.252 ****
2025-12-03 10:52:18.557950 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance
2025-12-03 10:52:18.792426 | controller |
2025-12-03 10:52:18.792462 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] *****************
2025-12-03 10:52:18.792473 | controller | Wednesday 03 December 2025  10:52:18 +0000 (0:00:00.057)       0:02:08.310 ****
2025-12-03 10:52:18.792487 | controller | ok: [instance] => (item=crc)
2025-12-03 10:52:18.792528 | controller |
2025-12-03 10:52:18.792539 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] **********************
2025-12-03 10:52:18.792619 | controller | Wednesday 03 December 2025  10:52:18 +0000 (0:00:00.234)       0:02:08.544 ****
2025-12-03 10:52:20.860467 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2025-12-03 10:52:20.861015 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2025-12-03 10:52:20.861044 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2025-12-03 10:52:21.662444 | controller |
2025-12-03 10:52:21.662478 | controller | TASK [libvirt_manager : Start vm] **********************************************
2025-12-03 10:52:21.662487 | controller | Wednesday 03 December 2025  10:52:20 +0000 (0:00:02.067)       0:02:10.612 ****
2025-12-03 10:52:21.662497 | controller | changed: [instance]
2025-12-03 10:52:22.468923 | controller |
2025-12-03 10:52:22.468966 | controller | TASK [libvirt_manager : Start vm] **********************************************
2025-12-03 10:52:22.468976 | controller | Wednesday 03 December 2025  10:52:21 +0000 (0:00:00.801)       0:02:11.414 ****
2025-12-03 10:52:22.468988 | controller | changed: [instance]
2025-12-03 10:52:22.469013 | controller |
2025-12-03 10:52:22.469094 | controller | TASK [libvirt_manager : Start vm] **********************************************
2025-12-03 10:52:22.469210 | controller | Wednesday 03 December 2025  10:52:22 +0000 (0:00:00.806)       0:02:12.221 ****
2025-12-03 10:52:23.283319 | controller | changed: [instance]
2025-12-03 10:52:23.283401 | controller |
2025-12-03 10:52:23.283511 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] ***************************
2025-12-03 10:52:23.283623 | controller | Wednesday 03 December 2025  10:52:23 +0000 (0:00:00.814)       0:02:13.035 ****
2025-12-03 10:52:23.985897 | controller | changed: [instance] => (item=compute-0.utility)
2025-12-03 10:52:23.985953 | controller | changed: [instance] => (item=controller-0.utility)
2025-12-03 10:52:23.986454 | controller | changed: [instance] => (item=crc-0.utility)
2025-12-03 10:52:43.826092 | controller |
2025-12-03 10:52:43.826177 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] ****************************
2025-12-03 10:52:43.826187 | controller | Wednesday 03 December 2025  10:52:23 +0000 (0:00:00.701)       0:02:13.737 ****
2025-12-03 10:52:43.826203 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
2025-12-03 10:52:43.956674 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left).
2025-12-03 10:52:43.956709 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left).
2025-12-03 10:52:43.956717 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left).
2025-12-03 10:52:43.956723 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left).
2025-12-03 10:52:43.956729 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j829236319187.24118', 'results_file': '/home/zuul/.ansible_async/j829236319187.24118', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'})
2025-12-03 10:52:43.956743 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j368586144579.24136', 'results_file': '/home/zuul/.ansible_async/j368586144579.24136', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'})
2025-12-03 10:52:43.956749 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
2025-12-03 10:52:43.956754 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j456875686975.24152', 'results_file': '/home/zuul/.ansible_async/j456875686975.24152', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'})
2025-12-03 10:52:43.956760 | controller |
2025-12-03 10:52:43.956766 | controller | TASK [libvirt_manager : Configure managed VMs] *********************************
2025-12-03 10:52:43.956771 | controller | Wednesday 03 December 2025  10:52:43 +0000 (0:00:19.838)       0:02:33.575 ****
2025-12-03 10:52:43.956784 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2025-12-03 10:52:43.989993 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2025-12-03 10:52:43.990020 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2025-12-03 10:52:43.990028 | controller |
2025-12-03 10:52:43.990034 | controller | TASK [Check if new ssh keypair exists] *****************************************
2025-12-03 10:52:43.990039 | controller | Wednesday 03 December 2025  10:52:43 +0000 (0:00:00.132)       0:02:33.708 ****
2025-12-03 10:52:43.990049 | controller | skipping: [instance]
2025-12-03 10:52:44.033873 | controller |
2025-12-03 10:52:44.033898 | controller | TASK [Push ssh jumper/configuration for compute-0] *****************************
2025-12-03 10:52:44.033905 | controller | Wednesday 03 December 2025  10:52:43 +0000 (0:00:00.033)       0:02:33.741 ****
2025-12-03 10:52:44.033914 | controller |
2025-12-03 10:52:44.033974 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2025-12-03 10:52:44.033995 | controller | Wednesday 03 December 2025  10:52:44 +0000 (0:00:00.044)       0:02:33.786 ****
2025-12-03 10:52:44.122049 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2025-12-03 10:52:44.363469 | controller |
2025-12-03 10:52:44.363529 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2025-12-03 10:52:44.363539 | controller | Wednesday 03 December 2025  10:52:44 +0000 (0:00:00.088)       0:02:33.874 ****
2025-12-03 10:52:44.363551 | controller | changed: [instance]
2025-12-03 10:52:44.605426 | controller |
2025-12-03 10:52:44.605496 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2025-12-03 10:52:44.605513 | controller | Wednesday 03 December 2025  10:52:44 +0000 (0:00:00.239)       0:02:34.114 ****
2025-12-03 10:52:44.605527 | controller | changed: [instance]
2025-12-03 10:52:45.020574 | controller |
2025-12-03 10:52:45.020637 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] *******************
2025-12-03 10:52:45.020647 | controller | Wednesday 03 December 2025  10:52:44 +0000 (0:00:00.242)       0:02:34.356 ****
2025-12-03 10:52:45.020662 | controller | changed: [instance]
2025-12-03 10:52:45.056429 | controller |
2025-12-03 10:52:45.056451 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ******************
2025-12-03 10:52:45.056458 | controller | Wednesday 03 December 2025  10:52:45 +0000 (0:00:00.414)       0:02:34.770 ****
2025-12-03 10:52:45.056468 | controller | skipping: [instance]
2025-12-03 10:52:45.056530 | controller |
2025-12-03 10:52:45.056907 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2025-12-03 10:52:45.057057 | controller | Wednesday 03 December 2025  10:52:45 +0000 (0:00:00.037)       0:02:34.808 ****
2025-12-03 10:52:45.096100 | controller | skipping: [instance]
2025-12-03 10:52:45.157596 | controller |
2025-12-03 10:52:45.157632 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] *****************
2025-12-03 10:52:45.157641 | controller | Wednesday 03 December 2025  10:52:45 +0000 (0:00:00.039)       0:02:34.848 ****
2025-12-03 10:52:45.157652 | controller | skipping: [instance]
2025-12-03 10:52:45.214808 | controller |
2025-12-03 10:52:45.214845 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ******************
2025-12-03 10:52:45.214854 | controller | Wednesday 03 December 2025  10:52:45 +0000 (0:00:00.061)       0:02:34.909 ****
2025-12-03 10:52:45.214865 | controller | skipping: [instance]
2025-12-03 10:52:45.240678 | controller |
2025-12-03 10:52:45.240708 | controller | TASK [Check if new ssh keypair exists] *****************************************
2025-12-03 10:52:45.240715 | controller | Wednesday 03 December 2025  10:52:45 +0000 (0:00:00.054)       0:02:34.964 ****
2025-12-03 10:52:45.240725 | controller | skipping: [instance]
2025-12-03 10:52:45.281680 | controller |
2025-12-03 10:52:45.281698 | controller | TASK [Push ssh jumper/configuration for controller-0] **************************
2025-12-03 10:52:45.281706 | controller | Wednesday 03 December 2025  10:52:45 +0000 (0:00:00.028)       0:02:34.992 ****
2025-12-03 10:52:45.281715 | controller |
2025-12-03 10:52:45.379116 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2025-12-03 10:52:45.379136 | controller | Wednesday 03 December 2025  10:52:45 +0000 (0:00:00.040)       0:02:35.033 ****
2025-12-03 10:52:45.379147 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2025-12-03 10:52:45.626432 | controller |
2025-12-03 10:52:45.626466 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2025-12-03 10:52:45.626474 | controller | Wednesday 03 December 2025  10:52:45 +0000 (0:00:00.097)       0:02:35.131 ****
2025-12-03 10:52:45.626489 | controller | ok: [instance]
2025-12-03 10:52:45.840617 | controller |
2025-12-03 10:52:45.840644 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2025-12-03 10:52:45.840652 | controller | Wednesday 03 December 2025  10:52:45 +0000 (0:00:00.247)       0:02:35.378 ****
2025-12-03 10:52:45.840661 | controller | ok: [instance]
2025-12-03 10:52:46.243792 | controller |
2025-12-03 10:52:46.243824 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] ****************
2025-12-03 10:52:46.243832 | controller | Wednesday 03 December 2025  10:52:45 +0000 (0:00:00.214)       0:02:35.592 ****
2025-12-03 10:52:46.243841 | controller | changed: [instance]
2025-12-03 10:52:46.274282 | controller |
2025-12-03 10:52:46.274302 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] ***************
2025-12-03 10:52:46.274310 | controller | Wednesday 03 December 2025  10:52:46 +0000 (0:00:00.402)       0:02:35.995 ****
2025-12-03 10:52:46.274345 | controller | skipping: [instance]
2025-12-03 10:52:46.307341 | controller |
2025-12-03 10:52:46.307361 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2025-12-03 10:52:46.307369 | controller | Wednesday 03 December 2025  10:52:46 +0000 (0:00:00.030)       0:02:36.026 ****
2025-12-03 10:52:46.307378 | controller | skipping: [instance]
2025-12-03 10:52:47.933096 | controller |
2025-12-03 10:52:47.933126 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] **************
2025-12-03 10:52:47.933140 | controller | Wednesday 03 December 2025  10:52:46 +0000 (0:00:00.032)       0:02:36.059 ****
2025-12-03 10:52:47.933160 | controller | changed: [instance -> controller-0.instance]
2025-12-03 10:52:49.094882 | controller |
2025-12-03 10:52:49.094914 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] ***************
2025-12-03 10:52:49.094921 | controller | Wednesday 03 December 2025  10:52:47 +0000 (0:00:01.625)       0:02:37.685 ****
2025-12-03 10:52:49.094935 | controller | changed: [instance -> controller-0.instance]
2025-12-03 10:52:49.133034 | controller |
2025-12-03 10:52:49.133056 | controller | TASK [Check if new ssh keypair exists] *****************************************
2025-12-03 10:52:49.133064 | controller | Wednesday 03 December 2025  10:52:49 +0000 (0:00:01.161)       0:02:38.846 ****
2025-12-03 10:52:49.133072 | controller |
2025-12-03 10:52:49.392383 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2025-12-03 10:52:49.392416 | controller | Wednesday 03 December 2025  10:52:49 +0000 (0:00:00.038)       0:02:38.885 ****
2025-12-03 10:52:49.392427 | controller | ok: [instance]
2025-12-03 10:52:49.424321 | controller |
2025-12-03 10:52:49.424358 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2025-12-03 10:52:49.424366 | controller | Wednesday 03 December 2025  10:52:49 +0000 (0:00:00.258)       0:02:39.143 ****
2025-12-03 10:52:49.424375 | controller | ok: [instance]
2025-12-03 10:52:49.465359 | controller |
2025-12-03 10:52:49.465380 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2025-12-03 10:52:49.465387 | controller | Wednesday 03 December 2025  10:52:49 +0000 (0:00:00.032)       0:02:39.176 ****
2025-12-03 10:52:49.465396 | controller | skipping: [instance]
2025-12-03 10:52:49.518685 | controller |
2025-12-03 10:52:49.518703 | controller | TASK [Push ssh jumper/configuration for crc-0] *********************************
2025-12-03 10:52:49.518710 | controller | Wednesday 03 December 2025  10:52:49 +0000 (0:00:00.040)       0:02:39.217 ****
2025-12-03 10:52:49.518718 | controller |
2025-12-03 10:52:49.672519 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2025-12-03 10:52:49.672605 | controller | Wednesday 03 December 2025  10:52:49 +0000 (0:00:00.053)       0:02:39.271 ****
2025-12-03 10:52:49.672624 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'})
2025-12-03 10:52:49.967253 | controller |
2025-12-03 10:52:49.967351 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2025-12-03 10:52:49.967376 | controller | Wednesday 03 December 2025  10:52:49 +0000 (0:00:00.153)       0:02:39.424 ****
2025-12-03 10:52:49.967398 | controller | ok: [instance]
2025-12-03 10:52:50.199848 | controller |
2025-12-03 10:52:50.199895 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2025-12-03 10:52:50.199903 | controller | Wednesday 03 December 2025  10:52:49 +0000 (0:00:00.294)       0:02:39.719 ****
2025-12-03 10:52:50.199916 | controller | ok: [instance]
2025-12-03 10:52:50.199934 | controller |
2025-12-03 10:52:50.199940 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] ***********************
2025-12-03 10:52:50.199947 | controller | Wednesday 03 December 2025  10:52:50 +0000 (0:00:00.232)       0:02:39.952 ****
2025-12-03 10:52:50.625323 | controller | changed: [instance]
2025-12-03 10:52:50.625405 | controller |
2025-12-03 10:52:50.625498 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] **********************
2025-12-03 10:52:50.625606 | controller | Wednesday 03 December 2025  10:52:50 +0000 (0:00:00.425)       0:02:40.377 ****
2025-12-03 10:52:51.606525 | controller | changed: [instance]
2025-12-03 10:52:51.606614 | controller |
2025-12-03 10:52:51.606720 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2025-12-03 10:52:51.606733 | controller | Wednesday 03 December 2025  10:52:51 +0000 (0:00:00.981)       0:02:41.358 ****
2025-12-03 10:52:51.641538 | controller | skipping: [instance]
2025-12-03 10:52:51.641631 | controller |
2025-12-03 10:52:51.641644 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] *********************
2025-12-03 10:52:51.696419 | controller | Wednesday 03 December 2025  10:52:51 +0000 (0:00:00.035)       0:02:41.393 ****
2025-12-03 10:52:51.696440 | controller | skipping: [instance]
2025-12-03 10:52:51.696505 | controller |
2025-12-03 10:52:51.696604 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] **********************
2025-12-03 10:52:51.696696 | controller | Wednesday 03 December 2025  10:52:51 +0000 (0:00:00.055)       0:02:41.448 ****
2025-12-03 10:52:51.743075 | controller | skipping: [instance]
2025-12-03 10:52:51.743176 | controller |
2025-12-03 10:52:51.743277 | controller | TASK [Create VBMC entity] ******************************************************
2025-12-03 10:52:51.743452 | controller | Wednesday 03 December 2025  10:52:51 +0000 (0:00:00.046)       0:02:41.495 ****
2025-12-03 10:52:51.796229 | controller | skipping: [instance] => (item=compute-0)
2025-12-03 10:52:52.042282 | controller | skipping: [instance] => (item=controller-0)
2025-12-03 10:52:52.042312 | controller | skipping: [instance] => (item=crc-0)
2025-12-03 10:52:52.042319 | controller | skipping: [instance]
2025-12-03 10:52:52.042347 | controller |
2025-12-03 10:52:52.042357 | controller | TASK [libvirt_manager : List running virtual machines.] ************************
2025-12-03 10:52:52.042363 | controller | Wednesday 03 December 2025  10:52:51 +0000 (0:00:00.052)       0:02:41.548 ****
2025-12-03 10:52:52.042372 | controller | ok: [instance]
2025-12-03 10:52:52.415890 | controller |
2025-12-03 10:52:52.415923 | controller | TASK [libvirt_manager : Dump UUIDs] ********************************************
2025-12-03 10:52:52.415938 | controller | Wednesday 03 December 2025  10:52:52 +0000 (0:00:00.245)       0:02:41.794 ****
2025-12-03 10:52:52.415948 | controller | changed: [instance]
2025-12-03 10:52:52.463682 | controller |
2025-12-03 10:52:52.463747 | controller | TASK [Ensure fresh vbmc listing] ***********************************************
2025-12-03 10:52:52.463755 | controller | Wednesday 03 December 2025  10:52:52 +0000 (0:00:00.373)       0:02:42.167 ****
2025-12-03 10:52:52.463770 | controller | skipping: [instance]
2025-12-03 10:52:52.499167 | controller |
2025-12-03 10:52:52.499189 | controller | TASK [libvirt_manager : Update vbmc related fact] ******************************
2025-12-03 10:52:52.499196 | controller | Wednesday 03 December 2025  10:52:52 +0000 (0:00:00.047)       0:02:42.215 ****
2025-12-03 10:52:52.499206 | controller | skipping: [instance]
2025-12-03 10:52:52.499257 | controller |
2025-12-03 10:52:52.499394 | controller | TASK [libvirt_manager : Dump vbmc known hosts] *********************************
2025-12-03 10:52:52.499499 | controller | Wednesday 03 December 2025  10:52:52 +0000 (0:00:00.036)       0:02:42.251 ****
2025-12-03 10:52:52.530693 | controller | skipping: [instance]
2025-12-03 10:52:53.182949 | controller |
2025-12-03 10:52:53.182986 | controller | TASK [libvirt_manager : Copy authorized_keys] **********************************
2025-12-03 10:52:53.183000 | controller | Wednesday 03 December 2025  10:52:52 +0000 (0:00:00.031)       0:02:42.282 ****
2025-12-03 10:52:53.183011 | controller | changed: [instance]
2025-12-03 10:52:53.834177 | controller |
2025-12-03 10:52:53.834209 | controller | TASK [libvirt_manager : Enable root access on CRC] *****************************
2025-12-03 10:52:53.834218 | controller | Wednesday 03 December 2025  10:52:53 +0000 (0:00:00.651)       0:02:42.934 ****
2025-12-03 10:52:53.834228 | controller | changed: [instance]
2025-12-03 10:52:53.834325 | controller |
2025-12-03 10:52:53.834358 | controller | TASK [reproducer : Get deployed VM group inventories] **************************
2025-12-03 10:52:53.834448 | controller | Wednesday 03 December 2025  10:52:53 +0000 (0:00:00.650)       0:02:43.585 ****
2025-12-03 10:52:53.877004 | controller | skipping: [instance]
2025-12-03 10:52:53.942235 | controller |
2025-12-03 10:52:53.942271 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] *************
2025-12-03 10:52:53.942279 | controller | Wednesday 03 December 2025  10:52:53 +0000 (0:00:00.043)       0:02:43.629 ****
2025-12-03 10:52:53.942290 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance)
2025-12-03 10:52:53.984861 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0)
2025-12-03 10:52:53.984896 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0)
2025-12-03 10:52:53.984906 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0)
2025-12-03 10:52:53.984914 | controller |
2025-12-03 10:52:53.984921 | controller | TASK [reproducer : Gather inventories from instance] ***************************
2025-12-03 10:52:53.984928 | controller | Wednesday 03 December 2025  10:52:53 +0000 (0:00:00.064)       0:02:43.693 ****
2025-12-03 10:52:53.984940 | controller | skipping: [instance]
2025-12-03 10:52:53.984971 | controller |
2025-12-03 10:52:53.985000 | controller | TASK [reproducer : Gather inventories from compute-0] **************************
2025-12-03 10:52:53.985143 | controller | Wednesday 03 December 2025  10:52:53 +0000 (0:00:00.043)       0:02:43.737 ****
2025-12-03 10:52:54.021486 | controller | skipping: [instance]
2025-12-03 10:52:54.021602 | controller |
2025-12-03 10:52:54.021617 | controller | TASK [reproducer : Gather inventories from controller-0] ***********************
2025-12-03 10:52:54.021629 | controller | Wednesday 03 December 2025  10:52:54 +0000 (0:00:00.035)       0:02:43.773 ****
2025-12-03 10:52:54.077689 | controller | skipping: [instance]
2025-12-03 10:52:54.077841 | controller |
2025-12-03 10:52:54.077991 | controller | TASK [reproducer : Gather inventories from crc-0] ******************************
2025-12-03 10:52:54.078111 | controller | Wednesday 03 December 2025  10:52:54 +0000 (0:00:00.055)       0:02:43.828 ****
2025-12-03 10:52:54.123823 | controller | skipping: [instance]
2025-12-03 10:52:54.123940 | controller |
2025-12-03 10:52:54.124058 | controller | TASK [reproducer : Push generated inventory from hypervisor] *******************
2025-12-03 10:52:54.124261 | controller | Wednesday 03 December 2025  10:52:54 +0000 (0:00:00.046)       0:02:43.875 ****
2025-12-03 10:52:54.801394 | controller | changed: [instance]
2025-12-03 10:52:54.801471 | controller |
2025-12-03 10:52:54.801482 | controller | TASK [reproducer : Slurp devscripts private key] *******************************
2025-12-03 10:52:54.801583 | controller | Wednesday 03 December 2025  10:52:54 +0000 (0:00:00.677)       0:02:44.552 ****
2025-12-03 10:52:54.842205 | controller | skipping: [instance]
2025-12-03 10:52:54.842375 | controller |
2025-12-03 10:52:54.842401 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] *****************
2025-12-03 10:52:54.879754 | controller | Wednesday 03 December 2025  10:52:54 +0000 (0:00:00.041)       0:02:44.594 ****
2025-12-03 10:52:54.879775 | controller | skipping: [instance]
2025-12-03 10:52:54.879901 | controller |
2025-12-03 10:52:54.880158 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] *********
2025-12-03 10:52:54.880243 | controller | Wednesday 03 December 2025  10:52:54 +0000 (0:00:00.037)       0:02:44.631 ****
2025-12-03 10:52:54.918514 | controller | skipping: [instance]
2025-12-03 10:52:54.918571 | controller |
2025-12-03 10:52:54.918616 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2025-12-03 10:52:54.918738 | controller | Wednesday 03 December 2025  10:52:54 +0000 (0:00:00.039)       0:02:44.670 ****
2025-12-03 10:52:54.955094 | controller | skipping: [instance]
2025-12-03 10:52:54.988742 | controller |
2025-12-03 10:52:54.988767 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2025-12-03 10:52:54.988775 | controller | Wednesday 03 December 2025  10:52:54 +0000 (0:00:00.036)       0:02:44.706 ****
2025-12-03 10:52:54.988784 | controller | skipping: [instance]
2025-12-03 10:52:55.025161 | controller |
2025-12-03 10:52:55.025236 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2025-12-03 10:52:55.025246 | controller | Wednesday 03 December 2025  10:52:54 +0000 (0:00:00.033)       0:02:44.740 ****
2025-12-03 10:52:55.025260 | controller | skipping: [instance]
2025-12-03 10:52:55.025282 | controller |
2025-12-03 10:52:55.025288 | controller | TASK [openshift_login : Assert files exist] ************************************
2025-12-03 10:52:55.025296 | controller | Wednesday 03 December 2025  10:52:55 +0000 (0:00:00.035)       0:02:44.776 ****
2025-12-03 10:52:55.064274 | controller | skipping: [instance]
2025-12-03 10:52:55.064346 | controller |
2025-12-03 10:52:55.064478 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2025-12-03 10:52:55.064570 | controller | Wednesday 03 December 2025  10:52:55 +0000 (0:00:00.039)       0:02:44.816 ****
2025-12-03 10:52:55.105852 | controller | skipping: [instance]
2025-12-03 10:52:55.105927 | controller |
2025-12-03 10:52:55.106039 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2025-12-03 10:52:55.106177 | controller | Wednesday 03 December 2025  10:52:55 +0000 (0:00:00.041)       0:02:44.858 ****
2025-12-03 10:52:55.147447 | controller | skipping: [instance]
2025-12-03 10:52:55.147516 | controller |
2025-12-03 10:52:55.147634 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2025-12-03 10:52:55.147724 | controller | Wednesday 03 December 2025  10:52:55 +0000 (0:00:00.041)       0:02:44.899 ****
2025-12-03 10:52:55.193166 | controller | skipping: [instance]
2025-12-03 10:52:55.193245 | controller |
2025-12-03 10:52:55.193379 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] *********************
2025-12-03 10:52:55.193500 | controller | Wednesday 03 December 2025  10:52:55 +0000 (0:00:00.045)       0:02:44.945 ****
2025-12-03 10:52:55.228489 | controller | skipping: [instance]
2025-12-03 10:52:55.228576 | controller |
2025-12-03 10:52:55.228678 | controller | TASK [reproducer : Configure Controller node] **********************************
2025-12-03 10:52:55.228778 | controller | Wednesday 03 December 2025  10:52:55 +0000 (0:00:00.035)       0:02:44.980 ****
2025-12-03 10:52:55.388203 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance
2025-12-03 10:52:55.388264 | controller |
2025-12-03 10:52:55.388365 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2025-12-03 10:52:55.388484 | controller | Wednesday 03 December 2025  10:52:55 +0000 (0:00:00.159)       0:02:45.140 ****
2025-12-03 10:52:56.877730 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2025-12-03 10:52:56.877822 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2025-12-03 10:52:56.877917 | controller |
2025-12-03 10:52:56.877928 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2025-12-03 10:52:56.878019 | controller | Wednesday 03 December 2025  10:52:56 +0000 (0:00:01.489)       0:02:46.629 ****
2025-12-03 10:52:56.905566 | controller | skipping: [instance]
2025-12-03 10:52:56.905694 | controller |
2025-12-03 10:52:56.905839 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2025-12-03 10:52:56.905979 | controller | Wednesday 03 December 2025  10:52:56 +0000 (0:00:00.028)       0:02:46.657 ****
2025-12-03 10:52:57.564260 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:52:57.564380 | controller |
2025-12-03 10:52:57.564401 | controller | TASK [install_ca : Install internal CA from url] *******************************
2025-12-03 10:52:57.564440 | controller | Wednesday 03 December 2025  10:52:57 +0000 (0:00:00.658)       0:02:47.316 ****
2025-12-03 10:52:57.609244 | controller | skipping: [instance]
2025-12-03 10:52:57.609373 | controller |
2025-12-03 10:52:57.609538 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2025-12-03 10:52:57.609679 | controller | Wednesday 03 December 2025  10:52:57 +0000 (0:00:00.045)       0:02:47.361 ****
2025-12-03 10:52:57.649397 | controller | skipping: [instance]
2025-12-03 10:52:57.649494 | controller |
2025-12-03 10:52:57.649601 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2025-12-03 10:52:57.649699 | controller | Wednesday 03 December 2025  10:52:57 +0000 (0:00:00.040)       0:02:47.401 ****
2025-12-03 10:52:57.695570 | controller | skipping: [instance]
2025-12-03 10:52:57.695693 | controller |
2025-12-03 10:52:57.695827 | controller | TASK [install_ca : Update ca bundle] *******************************************
2025-12-03 10:52:57.695962 | controller | Wednesday 03 December 2025  10:52:57 +0000 (0:00:00.045)       0:02:47.447 ****
2025-12-03 10:52:59.350528 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:52:59.350631 | controller |
2025-12-03 10:52:59.350649 | controller | TASK [reproducer : Get rhos-release] *******************************************
2025-12-03 10:52:59.350728 | controller | Wednesday 03 December 2025  10:52:59 +0000 (0:00:01.654)       0:02:49.102 ****
2025-12-03 10:52:59.388882 | controller | skipping: [instance]
2025-12-03 10:52:59.388996 | controller |
2025-12-03 10:52:59.389133 | controller | TASK [reproducer : Install repos] **********************************************
2025-12-03 10:52:59.389233 | controller | Wednesday 03 December 2025  10:52:59 +0000 (0:00:00.038)       0:02:49.141 ****
2025-12-03 10:52:59.424752 | controller | skipping: [instance]
2025-12-03 10:52:59.424819 | controller |
2025-12-03 10:52:59.424932 | controller | TASK [reproducer : Run custom commands after rhos-release setup] ***************
2025-12-03 10:52:59.425060 | controller | Wednesday 03 December 2025  10:52:59 +0000 (0:00:00.035)       0:02:49.177 ****
2025-12-03 10:52:59.467758 | controller | skipping: [instance]
2025-12-03 10:52:59.467912 | controller |
2025-12-03 10:52:59.468093 | controller | TASK [reproducer : Create bundle for CRC] **************************************
2025-12-03 10:52:59.468290 | controller | Wednesday 03 December 2025  10:52:59 +0000 (0:00:00.043)       0:02:49.220 ****
2025-12-03 10:52:59.505002 | controller | skipping: [instance]
2025-12-03 10:52:59.505104 | controller |
2025-12-03 10:52:59.505254 | controller | TASK [reproducer : Install some tools] *****************************************
2025-12-03 10:52:59.505370 | controller | Wednesday 03 December 2025  10:52:59 +0000 (0:00:00.037)       0:02:49.257 ****
2025-12-03 10:53:00.727964 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:53:00.728266 | controller |
2025-12-03 10:53:01.904942 | controller | TASK [reproducer : Inject command aliases for faster debugging] ****************
2025-12-03 10:53:01.905020 | controller | Wednesday 03 December 2025  10:53:00 +0000 (0:00:01.222)       0:02:50.479 ****
2025-12-03 10:53:01.905042 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:53:02.560094 | controller |
2025-12-03 10:53:02.560143 | controller | TASK [reproducer : Build job inventory for hook usage] *************************
2025-12-03 10:53:02.560152 | controller | Wednesday 03 December 2025  10:53:01 +0000 (0:00:01.176)       0:02:51.656 ****
2025-12-03 10:53:02.560163 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:53:03.627616 | controller |
2025-12-03 10:53:03.627692 | controller | TASK [reproducer : Push the MAC mapping data] **********************************
2025-12-03 10:53:03.627701 | controller | Wednesday 03 December 2025  10:53:02 +0000 (0:00:00.655)       0:02:52.312 ****
2025-12-03 10:53:03.627717 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:53:03.627768 | controller |
2025-12-03 10:53:03.627777 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] ***************************
2025-12-03 10:53:04.994154 | controller | Wednesday 03 December 2025  10:53:03 +0000 (0:00:01.067)       0:02:53.379 ****
2025-12-03 10:53:04.994199 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2025-12-03 10:53:05.678364 | controller | skipping: [instance] => (item=compute-0)
2025-12-03 10:53:05.678404 | controller | skipping: [instance] => (item=controller-0)
2025-12-03 10:53:05.678416 | controller | skipping: [instance] => (item=crc-0)
2025-12-03 10:53:05.678422 | controller |
2025-12-03 10:53:05.678427 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] *****************
2025-12-03 10:53:05.678433 | controller | Wednesday 03 December 2025  10:53:04 +0000 (0:00:01.366)       0:02:54.745 ****
2025-12-03 10:53:05.678443 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2025-12-03 10:53:05.678811 | controller | skipping: [instance] => (item=compute-0)
2025-12-03 10:53:05.678823 | controller | skipping: [instance] => (item=controller-0)
2025-12-03 10:53:05.678829 | controller | skipping: [instance] => (item=crc-0)
2025-12-03 10:53:05.678836 | controller |
2025-12-03 10:53:07.432109 | controller | TASK [reproducer : Inject SSH configuration] ***********************************
2025-12-03 10:53:07.432148 | controller | Wednesday 03 December 2025  10:53:05 +0000 (0:00:00.684)       0:02:55.430 ****
2025-12-03 10:53:07.432160 | controller | skipping: [instance] => (item=instance)
2025-12-03 10:53:08.099888 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0)
2025-12-03 10:53:08.099925 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2025-12-03 10:53:08.099932 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0)
2025-12-03 10:53:08.099938 | controller |
2025-12-03 10:53:08.099943 | controller | TASK [reproducer : Create kube directory] **************************************
2025-12-03 10:53:08.099948 | controller | Wednesday 03 December 2025  10:53:07 +0000 (0:00:01.753)       0:02:57.183 ****
2025-12-03 10:53:08.099962 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:53:09.182615 | controller |
2025-12-03 10:53:09.182654 | controller | TASK [reproducer : Inject kubeconfig content] **********************************
2025-12-03 10:53:09.182662 | controller | Wednesday 03 December 2025  10:53:08 +0000 (0:00:00.667)       0:02:57.851 ****
2025-12-03 10:53:09.182672 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:53:10.189379 | controller |
2025-12-03 10:53:10.189429 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************
2025-12-03 10:53:10.189439 | controller | Wednesday 03 December 2025  10:53:09 +0000 (0:00:01.078)       0:02:58.929 ****
2025-12-03 10:53:10.189456 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:53:10.232668 | controller |
2025-12-03 10:53:10.232711 | controller | TASK [reproducer : Inject devscripts private key if set] ***********************
2025-12-03 10:53:10.232720 | controller | Wednesday 03 December 2025  10:53:10 +0000 (0:00:01.011)       0:02:59.940 ****
2025-12-03 10:53:10.232731 | controller | skipping: [instance]
2025-12-03 10:53:10.865609 | controller |
2025-12-03 10:53:10.865665 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ******************************
2025-12-03 10:53:10.865673 | controller | Wednesday 03 December 2025  10:53:10 +0000 (0:00:00.043)       0:02:59.984 ****
2025-12-03 10:53:10.865685 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:53:11.454181 | controller |
2025-12-03 10:53:11.454237 | controller | TASK [manage_secrets : Ensure directory tree exist] ****************************
2025-12-03 10:53:11.454245 | controller | Wednesday 03 December 2025  10:53:10 +0000 (0:00:00.632)       0:03:00.616 ****
2025-12-03 10:53:11.454257 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:53:11.454479 | controller |
2025-12-03 10:53:11.454639 | controller | TASK [manage_secrets : Assert we get needed data] ******************************
2025-12-03 10:53:11.454781 | controller | Wednesday 03 December 2025  10:53:11 +0000 (0:00:00.589)       0:03:01.206 ****
2025-12-03 10:53:11.499114 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:53:11.499279 | controller |
2025-12-03 10:53:11.499459 | controller | TASK [manage_secrets : Push reproducer secrets] ********************************
2025-12-03 10:53:11.499607 | controller | Wednesday 03 December 2025  10:53:11 +0000 (0:00:00.045)       0:03:01.251 ****
2025-12-03 10:53:11.575399 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'})
2025-12-03 10:53:11.575589 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'})
2025-12-03 10:53:11.575716 | controller |
2025-12-03 10:53:11.575855 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2025-12-03 10:53:11.575981 | controller | Wednesday 03 December 2025  10:53:11 +0000 (0:00:00.076)       0:03:01.327 ****
2025-12-03 10:53:11.635301 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-12-03 10:53:11.635489 | controller |   _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt
2025-12-03 10:53:11.635627 | controller |
2025-12-03 10:53:11.635766 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2025-12-03 10:53:11.635904 | controller | Wednesday 03 December 2025  10:53:11 +0000 (0:00:00.060)       0:03:01.387 ****
2025-12-03 10:53:11.698019 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-12-03 10:53:11.698189 | controller |   _secret_file: ''
2025-12-03 10:53:11.698314 | controller |
2025-12-03 10:53:11.698475 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2025-12-03 10:53:11.698610 | controller | Wednesday 03 December 2025  10:53:11 +0000 (0:00:00.062)       0:03:01.450 ****
2025-12-03 10:53:11.752149 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-12-03 10:53:11.752315 | controller |   _secret_content: my-default-location-place
2025-12-03 10:53:11.752487 | controller |
2025-12-03 10:53:11.752643 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2025-12-03 10:53:11.752782 | controller | Wednesday 03 December 2025  10:53:11 +0000 (0:00:00.054)       0:03:01.504 ****
2025-12-03 10:53:11.818477 | controller | skipping: [instance]
2025-12-03 10:53:11.875784 | controller |
2025-12-03 10:53:11.875808 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2025-12-03 10:53:11.875816 | controller | Wednesday 03 December 2025  10:53:11 +0000 (0:00:00.065)       0:03:01.570 ****
2025-12-03 10:53:11.875826 | controller | skipping: [instance]
2025-12-03 10:53:11.929760 | controller |
2025-12-03 10:53:11.929778 | controller | TASK [manage_secrets : Copy file to location] **********************************
2025-12-03 10:53:11.929785 | controller | Wednesday 03 December 2025  10:53:11 +0000 (0:00:00.057)       0:03:01.627 ****
2025-12-03 10:53:11.929794 | controller | skipping: [instance]
2025-12-03 10:53:13.032500 | controller |
2025-12-03 10:53:13.032541 | controller | TASK [manage_secrets : Create file from content] *******************************
2025-12-03 10:53:13.032550 | controller | Wednesday 03 December 2025  10:53:11 +0000 (0:00:00.054)       0:03:01.682 ****
2025-12-03 10:53:13.032561 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:53:13.088939 | controller |
2025-12-03 10:53:13.088959 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2025-12-03 10:53:13.088966 | controller | Wednesday 03 December 2025  10:53:13 +0000 (0:00:01.102)       0:03:02.784 ****
2025-12-03 10:53:13.088976 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-12-03 10:53:13.152980 | controller |   _secret_dest: /home/zuul/ipmi-things
2025-12-03 10:53:13.152998 | controller |
2025-12-03 10:53:13.153005 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2025-12-03 10:53:13.153011 | controller | Wednesday 03 December 2025  10:53:13 +0000 (0:00:00.056)       0:03:02.841 ****
2025-12-03 10:53:13.153019 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-12-03 10:53:13.205036 | controller |   _secret_file: /tmp/ipmi-things
2025-12-03 10:53:13.205055 | controller |
2025-12-03 10:53:13.205062 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2025-12-03 10:53:13.205078 | controller | Wednesday 03 December 2025  10:53:13 +0000 (0:00:00.064)       0:03:02.905 ****
2025-12-03 10:53:13.205087 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2025-12-03 10:53:13.275645 | controller |   _secret_content: ''
2025-12-03 10:53:13.275663 | controller |
2025-12-03 10:53:13.275670 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2025-12-03 10:53:13.275682 | controller | Wednesday 03 December 2025  10:53:13 +0000 (0:00:00.052)       0:03:02.957 ****
2025-12-03 10:53:13.275694 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false
2025-12-03 10:53:13.920975 | controller |   msg: All assertions passed
2025-12-03 10:53:13.921016 | controller |
2025-12-03 10:53:13.921023 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2025-12-03 10:53:13.921030 | controller | Wednesday 03 December 2025  10:53:13 +0000 (0:00:00.070)       0:03:03.027 ****
2025-12-03 10:53:13.921039 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:53:14.949473 | controller |
2025-12-03 10:53:14.949517 | controller | TASK [manage_secrets : Copy file to location] **********************************
2025-12-03 10:53:14.949525 | controller | Wednesday 03 December 2025  10:53:13 +0000 (0:00:00.644)       0:03:03.672 ****
2025-12-03 10:53:14.949535 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:53:15.009592 | controller |
2025-12-03 10:53:15.009638 | controller | TASK [manage_secrets : Create file from content] *******************************
2025-12-03 10:53:15.009647 | controller | Wednesday 03 December 2025  10:53:14 +0000 (0:00:01.028)       0:03:04.701 ****
2025-12-03 10:53:15.009658 | controller | skipping: [instance]
2025-12-03 10:53:15.637248 | controller |
2025-12-03 10:53:15.637289 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] **********************************
2025-12-03 10:53:15.637297 | controller | Wednesday 03 December 2025  10:53:15 +0000 (0:00:00.060)       0:03:04.761 ****
2025-12-03 10:53:15.637308 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:53:16.356715 | controller |
2025-12-03 10:53:16.356755 | controller | TASK [reproducer : Check if async file is still available] *********************
2025-12-03 10:53:16.356763 | controller | Wednesday 03 December 2025  10:53:15 +0000 (0:00:00.627)       0:03:05.388 ****
2025-12-03 10:53:16.356774 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:53:16.356953 | controller |
2025-12-03 10:53:16.357144 | controller | TASK [reproducer : Check package install status] *******************************
2025-12-03 10:53:16.357288 | controller | Wednesday 03 December 2025  10:53:16 +0000 (0:00:00.719)       0:03:06.108 ****
2025-12-03 10:54:12.752589 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left).
2025-12-03 10:54:13.448776 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left).
2025-12-03 10:54:13.448828 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left).
2025-12-03 10:54:13.448835 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left).
2025-12-03 10:54:13.448841 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left).
2025-12-03 10:54:13.448846 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left).
2025-12-03 10:54:13.448852 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left).
2025-12-03 10:54:13.448857 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (93 retries left).
2025-12-03 10:54:13.448862 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (92 retries left).
2025-12-03 10:54:13.448868 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (91 retries left).
2025-12-03 10:54:13.448874 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:13.448880 | controller |
2025-12-03 10:54:13.448885 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] ***************
2025-12-03 10:54:13.448892 | controller | Wednesday 03 December 2025  10:54:12 +0000 (0:00:56.393)       0:04:02.502 ****
2025-12-03 10:54:13.448902 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:16.583823 | controller |
2025-12-03 10:54:16.583871 | controller | TASK [sushy_emulator : Install required packages] ******************************
2025-12-03 10:54:16.583881 | controller | Wednesday 03 December 2025  10:54:13 +0000 (0:00:00.697)       0:04:03.199 ****
2025-12-03 10:54:16.583892 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:16.640213 | controller |
2025-12-03 10:54:16.640233 | controller | TASK [sushy_emulator : Get ingresses domain] ***********************************
2025-12-03 10:54:16.640240 | controller | Wednesday 03 December 2025  10:54:16 +0000 (0:00:03.135)       0:04:06.335 ****
2025-12-03 10:54:16.640248 | controller | skipping: [instance]
2025-12-03 10:54:16.698709 | controller |
2025-12-03 10:54:16.698729 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] *********************
2025-12-03 10:54:16.698736 | controller | Wednesday 03 December 2025  10:54:16 +0000 (0:00:00.056)       0:04:06.392 ****
2025-12-03 10:54:16.698745 | controller | skipping: [instance]
2025-12-03 10:54:17.501261 | controller |
2025-12-03 10:54:17.501311 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] **********************
2025-12-03 10:54:17.501345 | controller | Wednesday 03 December 2025  10:54:16 +0000 (0:00:00.058)       0:04:06.450 ****
2025-12-03 10:54:17.501361 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:18.173165 | controller |
2025-12-03 10:54:18.173217 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ********************
2025-12-03 10:54:18.173226 | controller | Wednesday 03 December 2025  10:54:17 +0000 (0:00:00.801)       0:04:07.252 ****
2025-12-03 10:54:18.173238 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:18.173256 | controller |
2025-12-03 10:54:18.173262 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] *******************************
2025-12-03 10:54:18.173269 | controller | Wednesday 03 December 2025  10:54:18 +0000 (0:00:00.671)       0:04:07.924 ****
2025-12-03 10:54:18.537162 | controller | changed: [instance]
2025-12-03 10:54:19.237214 | controller |
2025-12-03 10:54:19.237259 | controller | TASK [sushy_emulator : Run ssh-keyscan] ****************************************
2025-12-03 10:54:19.237268 | controller | Wednesday 03 December 2025  10:54:18 +0000 (0:00:00.363)       0:04:08.288 ****
2025-12-03 10:54:19.237280 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:20.332854 | controller |
2025-12-03 10:54:20.332900 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************
2025-12-03 10:54:20.332909 | controller | Wednesday 03 December 2025  10:54:19 +0000 (0:00:00.699)       0:04:08.988 ****
2025-12-03 10:54:20.332920 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:20.381107 | controller |
2025-12-03 10:54:20.381141 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2025-12-03 10:54:20.381150 | controller | Wednesday 03 December 2025  10:54:20 +0000 (0:00:01.096)       0:04:10.084 ****
2025-12-03 10:54:20.381162 | controller | skipping: [instance]
2025-12-03 10:54:20.429873 | controller |
2025-12-03 10:54:20.429938 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2025-12-03 10:54:20.429948 | controller | Wednesday 03 December 2025  10:54:20 +0000 (0:00:00.048)       0:04:10.133 ****
2025-12-03 10:54:20.429962 | controller | skipping: [instance]
2025-12-03 10:54:20.472880 | controller |
2025-12-03 10:54:20.472954 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2025-12-03 10:54:20.472963 | controller | Wednesday 03 December 2025  10:54:20 +0000 (0:00:00.048)       0:04:10.181 ****
2025-12-03 10:54:20.472986 | controller | skipping: [instance]
2025-12-03 10:54:20.535086 | controller |
2025-12-03 10:54:20.535106 | controller | TASK [sushy_emulator : Generate list of filtered VMs] **************************
2025-12-03 10:54:20.535115 | controller | Wednesday 03 December 2025  10:54:20 +0000 (0:00:00.042)       0:04:10.224 ****
2025-12-03 10:54:20.535124 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:20.579148 | controller |
2025-12-03 10:54:20.579164 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] ***************************
2025-12-03 10:54:20.579171 | controller | Wednesday 03 December 2025  10:54:20 +0000 (0:00:00.062)       0:04:10.286 ****
2025-12-03 10:54:20.579180 | controller | skipping: [instance]
2025-12-03 10:54:20.623278 | controller |
2025-12-03 10:54:20.623295 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ********
2025-12-03 10:54:20.623301 | controller | Wednesday 03 December 2025  10:54:20 +0000 (0:00:00.044)       0:04:10.331 ****
2025-12-03 10:54:20.623318 | controller | skipping: [instance]
2025-12-03 10:54:20.668188 | controller |
2025-12-03 10:54:20.668208 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] ***************
2025-12-03 10:54:20.668214 | controller | Wednesday 03 December 2025  10:54:20 +0000 (0:00:00.044)       0:04:10.375 ****
2025-12-03 10:54:20.668223 | controller | skipping: [instance]
2025-12-03 10:54:20.668381 | controller |
2025-12-03 10:54:20.668524 | controller | TASK [sushy_emulator : Generate htpasswd string] *******************************
2025-12-03 10:54:20.668660 | controller | Wednesday 03 December 2025  10:54:20 +0000 (0:00:00.045)       0:04:10.420 ****
2025-12-03 10:54:21.409815 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:21.410018 | controller |
2025-12-03 10:54:21.410159 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] *********************
2025-12-03 10:54:21.410293 | controller | Wednesday 03 December 2025  10:54:21 +0000 (0:00:00.740)       0:04:11.161 ****
2025-12-03 10:54:21.518012 | controller | skipping: [instance] => (item=secret)
2025-12-03 10:54:21.518190 | controller | skipping: [instance] => (item=configmap)
2025-12-03 10:54:21.518344 | controller | skipping: [instance] => (item=pod)
2025-12-03 10:54:21.518508 | controller | skipping: [instance] => (item=service)
2025-12-03 10:54:21.518644 | controller | skipping: [instance] => (item=route)
2025-12-03 10:54:21.518771 | controller | skipping: [instance]
2025-12-03 10:54:21.518891 | controller |
2025-12-03 10:54:21.519031 | controller | TASK [sushy_emulator : Write sushy emulator config] ****************************
2025-12-03 10:54:21.519160 | controller | Wednesday 03 December 2025  10:54:21 +0000 (0:00:00.108)       0:04:11.270 ****
2025-12-03 10:54:22.662058 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:23.788256 | controller |
2025-12-03 10:54:23.788312 | controller | TASK [sushy_emulator : Write htpasswd string to file] **************************
2025-12-03 10:54:23.788321 | controller | Wednesday 03 December 2025  10:54:22 +0000 (0:00:01.143)       0:04:12.413 ****
2025-12-03 10:54:23.788350 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:23.836255 | controller |
2025-12-03 10:54:23.836272 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ********************
2025-12-03 10:54:23.836279 | controller | Wednesday 03 December 2025  10:54:23 +0000 (0:00:01.125)       0:04:13.538 ****
2025-12-03 10:54:23.836288 | controller | skipping: [instance]
2025-12-03 10:54:23.886053 | controller |
2025-12-03 10:54:23.886071 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] ***
2025-12-03 10:54:23.886086 | controller | Wednesday 03 December 2025  10:54:23 +0000 (0:00:00.049)       0:04:13.588 ****
2025-12-03 10:54:23.886095 | controller | skipping: [instance]
2025-12-03 10:54:23.973552 | controller |
2025-12-03 10:54:23.973607 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] *************************
2025-12-03 10:54:23.973616 | controller | Wednesday 03 December 2025  10:54:23 +0000 (0:00:00.049)       0:04:13.638 ****
2025-12-03 10:54:23.973628 | controller | skipping: [instance] => (item=secret)
2025-12-03 10:54:24.021432 | controller | skipping: [instance] => (item=configmap)
2025-12-03 10:54:24.021450 | controller | skipping: [instance] => (item=service)
2025-12-03 10:54:24.021458 | controller | skipping: [instance] => (item=route)
2025-12-03 10:54:24.021464 | controller | skipping: [instance]
2025-12-03 10:54:24.021470 | controller |
2025-12-03 10:54:24.021476 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] **********************
2025-12-03 10:54:24.021481 | controller | Wednesday 03 December 2025  10:54:23 +0000 (0:00:00.086)       0:04:13.724 ****
2025-12-03 10:54:24.021490 | controller | skipping: [instance]
2025-12-03 10:54:25.679093 | controller |
2025-12-03 10:54:25.679131 | controller | TASK [podman : Ensure podman is installed] *************************************
2025-12-03 10:54:25.679140 | controller | Wednesday 03 December 2025  10:54:24 +0000 (0:00:00.048)       0:04:13.773 ****
2025-12-03 10:54:25.679151 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:26.610864 | controller |
2025-12-03 10:54:26.610919 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] *********************
2025-12-03 10:54:26.610928 | controller | Wednesday 03 December 2025  10:54:25 +0000 (0:00:01.657)       0:04:15.430 ****
2025-12-03 10:54:26.610940 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:26.664788 | controller |
2025-12-03 10:54:26.664811 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] *******************
2025-12-03 10:54:26.664818 | controller | Wednesday 03 December 2025  10:54:26 +0000 (0:00:00.931)       0:04:16.362 ****
2025-12-03 10:54:26.664827 | controller | skipping: [instance]
2025-12-03 10:54:26.725134 | controller |
2025-12-03 10:54:26.725199 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] *******************
2025-12-03 10:54:26.725209 | controller | Wednesday 03 December 2025  10:54:26 +0000 (0:00:00.054)       0:04:16.416 ****
2025-12-03 10:54:26.725222 | controller | skipping: [instance]
2025-12-03 10:54:26.725243 | controller |
2025-12-03 10:54:26.725249 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] ***
2025-12-03 10:54:26.725257 | controller | Wednesday 03 December 2025  10:54:26 +0000 (0:00:00.060)       0:04:16.476 ****
2025-12-03 10:54:26.777587 | controller | skipping: [instance]
2025-12-03 10:54:26.777646 | controller |
2025-12-03 10:54:26.777760 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ********************
2025-12-03 10:54:26.777865 | controller | Wednesday 03 December 2025  10:54:26 +0000 (0:00:00.052)       0:04:16.529 ****
2025-12-03 10:54:37.907529 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:37.907598 | controller |
2025-12-03 10:54:37.907699 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] **************
2025-12-03 10:54:37.907803 | controller | Wednesday 03 December 2025  10:54:37 +0000 (0:00:11.129)       0:04:27.659 ****
2025-12-03 10:54:39.372303 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:39.372441 | controller |
2025-12-03 10:54:39.372499 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2025-12-03 10:54:39.372513 | controller | Wednesday 03 December 2025  10:54:39 +0000 (0:00:01.464)       0:04:29.124 ****
2025-12-03 10:54:40.625025 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2025-12-03 10:54:40.625094 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2025-12-03 10:54:40.664152 | controller |
2025-12-03 10:54:40.664184 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] *************
2025-12-03 10:54:40.664193 | controller | Wednesday 03 December 2025  10:54:40 +0000 (0:00:01.243)       0:04:30.368 ****
2025-12-03 10:54:40.664206 | controller | skipping: [instance]
2025-12-03 10:54:40.664269 | controller |
2025-12-03 10:54:40.664411 | controller | TASK [reproducer : Check if baremetal-info.yml exists] *************************
2025-12-03 10:54:40.664541 | controller | Wednesday 03 December 2025  10:54:40 +0000 (0:00:00.048)       0:04:30.416 ****
2025-12-03 10:54:41.343410 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:41.343669 | controller |
2025-12-03 10:54:41.343832 | controller | TASK [reproducer : Get content of baremetal-info file] *************************
2025-12-03 10:54:41.343986 | controller | Wednesday 03 December 2025  10:54:41 +0000 (0:00:00.674)       0:04:31.091 ****
2025-12-03 10:54:41.376644 | controller | skipping: [instance]
2025-12-03 10:54:41.376791 | controller |
2025-12-03 10:54:41.376928 | controller | TASK [reproducer : Interpret remote file content as yaml] **********************
2025-12-03 10:54:41.377076 | controller | Wednesday 03 December 2025  10:54:41 +0000 (0:00:00.038)       0:04:31.129 ****
2025-12-03 10:54:41.418730 | controller | skipping: [instance]
2025-12-03 10:54:41.418909 | controller |
2025-12-03 10:54:41.419084 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2025-12-03 10:54:41.419228 | controller | Wednesday 03 December 2025  10:54:41 +0000 (0:00:00.041)       0:04:31.171 ****
2025-12-03 10:54:41.467163 | controller | skipping: [instance]
2025-12-03 10:54:41.467317 | controller |
2025-12-03 10:54:41.467507 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2025-12-03 10:54:41.467654 | controller | Wednesday 03 December 2025  10:54:41 +0000 (0:00:00.048)       0:04:31.219 ****
2025-12-03 10:54:41.505148 | controller | skipping: [instance]
2025-12-03 10:54:41.505319 | controller |
2025-12-03 10:54:41.505495 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] *****************
2025-12-03 10:54:41.505645 | controller | Wednesday 03 December 2025  10:54:41 +0000 (0:00:00.037)       0:04:31.257 ****
2025-12-03 10:54:41.649735 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '6b0ac32b-3223-4bcf-afd9-6c6e8c01d459'})
2025-12-03 10:54:41.649934 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '9a852344-ece2-4e0c-8109-f1e09dad938c'})
2025-12-03 10:54:41.650102 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': 'c1b7f31f-bf9a-45ab-98bf-c17be78b883e'})
2025-12-03 10:54:41.650237 | controller |
2025-12-03 10:54:41.650400 | controller | TASK [reproducer : Output baremetal info file] *********************************
2025-12-03 10:54:41.650541 | controller | Wednesday 03 December 2025  10:54:41 +0000 (0:00:00.143)       0:04:31.401 ****
2025-12-03 10:54:42.866950 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:42.867167 | controller |
2025-12-03 10:54:42.867338 | controller | TASK [reproducer : Output ironic_nodes to file] ********************************
2025-12-03 10:54:42.867501 | controller | Wednesday 03 December 2025  10:54:42 +0000 (0:00:01.216)       0:04:32.617 ****
2025-12-03 10:54:42.918285 | controller | skipping: [instance]
2025-12-03 10:54:42.918470 | controller |
2025-12-03 10:54:42.918621 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] *******************
2025-12-03 10:54:42.918761 | controller | Wednesday 03 December 2025  10:54:42 +0000 (0:00:00.053)       0:04:32.670 ****
2025-12-03 10:54:43.052454 | controller |
2025-12-03 10:54:43.052657 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] ***
2025-12-03 10:54:43.052808 | controller | Wednesday 03 December 2025  10:54:43 +0000 (0:00:00.134)       0:04:32.804 ****
2025-12-03 10:54:43.106395 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:43.106573 | controller |
2025-12-03 10:54:43.106728 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2025-12-03 10:54:43.106868 | controller | Wednesday 03 December 2025  10:54:43 +0000 (0:00:00.053)       0:04:32.858 ****
2025-12-03 10:54:43.155520 | controller | skipping: [instance]
2025-12-03 10:54:43.155685 | controller |
2025-12-03 10:54:43.155842 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2025-12-03 10:54:43.156000 | controller | Wednesday 03 December 2025  10:54:43 +0000 (0:00:00.049)       0:04:32.907 ****
2025-12-03 10:54:43.199844 | controller | skipping: [instance]
2025-12-03 10:54:43.200048 | controller |
2025-12-03 10:54:43.200212 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] ***
2025-12-03 10:54:43.200378 | controller | Wednesday 03 December 2025  10:54:43 +0000 (0:00:00.043)       0:04:32.951 ****
2025-12-03 10:54:44.641432 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:44.641591 | controller |
2025-12-03 10:54:44.641602 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] ***
2025-12-03 10:54:44.641611 | controller | Wednesday 03 December 2025  10:54:44 +0000 (0:00:01.438)       0:04:34.390 ****
2025-12-03 10:54:49.914262 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=6b0ac32b-3223-4bcf-afd9-6c6e8c01d459)
2025-12-03 10:54:50.024410 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=9a852344-ece2-4e0c-8109-f1e09dad938c)
2025-12-03 10:54:50.024438 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=c1b7f31f-bf9a-45ab-98bf-c17be78b883e)
2025-12-03 10:54:50.024446 | controller |
2025-12-03 10:54:50.024452 | controller | TASK [sushy_emulator : Verify baremetal VM power status] ***********************
2025-12-03 10:54:50.024458 | controller | Wednesday 03 December 2025  10:54:49 +0000 (0:00:05.275)       0:04:39.665 ****
2025-12-03 10:54:50.024468 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0)
2025-12-03 10:54:50.260054 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0)
2025-12-03 10:54:50.260078 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0)
2025-12-03 10:54:50.260087 | controller |
2025-12-03 10:54:50.260098 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] **********
2025-12-03 10:54:50.260105 | controller | Wednesday 03 December 2025  10:54:50 +0000 (0:00:00.108)       0:04:39.774 ****
2025-12-03 10:54:50.260114 | controller | ok: [instance -> localhost]
2025-12-03 10:54:52.367210 | controller |
2025-12-03 10:54:52.367245 | controller | TASK [reproducer : Sync local repositories to other hosts if present] **********
2025-12-03 10:54:52.367254 | controller | Wednesday 03 December 2025  10:54:50 +0000 (0:00:00.235)       0:04:40.010 ****
2025-12-03 10:54:52.367264 | controller | changed: [instance -> localhost] => (item=controller-0)
2025-12-03 10:54:52.368428 | controller |
2025-12-03 10:54:52.368450 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] ****
2025-12-03 10:54:53.013350 | controller | Wednesday 03 December 2025  10:54:52 +0000 (0:00:02.108)       0:04:42.118 ****
2025-12-03 10:54:53.013391 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:53.787827 | controller |
2025-12-03 10:54:53.787871 | controller | TASK [reproducer : Install ansible dependencies] *******************************
2025-12-03 10:54:53.787879 | controller | Wednesday 03 December 2025  10:54:53 +0000 (0:00:00.646)       0:04:42.765 ****
2025-12-03 10:54:53.787890 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:54.947382 | controller |
2025-12-03 10:54:54.947437 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] ***
2025-12-03 10:54:54.947445 | controller | Wednesday 03 December 2025  10:54:53 +0000 (0:00:00.774)       0:04:43.539 ****
2025-12-03 10:54:54.947457 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:55.607266 | controller |
2025-12-03 10:54:55.607301 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] ****
2025-12-03 10:54:55.607316 | controller | Wednesday 03 December 2025  10:54:54 +0000 (0:00:01.159)       0:04:44.699 ****
2025-12-03 10:54:55.607345 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:56.682220 | controller |
2025-12-03 10:54:56.682265 | controller | TASK [reproducer : Inject local environment parameters] ************************
2025-12-03 10:54:56.682273 | controller | Wednesday 03 December 2025  10:54:55 +0000 (0:00:00.659)       0:04:45.359 ****
2025-12-03 10:54:56.682283 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:57.301272 | controller |
2025-12-03 10:54:57.301308 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] ***
2025-12-03 10:54:57.301317 | controller | Wednesday 03 December 2025  10:54:56 +0000 (0:00:01.074)       0:04:46.433 ****
2025-12-03 10:54:57.301343 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:57.919210 | controller |
2025-12-03 10:54:57.919244 | controller | TASK [reproducer : Get interfaces-info content] ********************************
2025-12-03 10:54:57.919253 | controller | Wednesday 03 December 2025  10:54:57 +0000 (0:00:00.619)       0:04:47.053 ****
2025-12-03 10:54:57.919264 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:59.241320 | controller |
2025-12-03 10:54:59.241374 | controller | TASK [reproducer : Wait for OCP nodes to be ready] *****************************
2025-12-03 10:54:59.241382 | controller | Wednesday 03 December 2025  10:54:57 +0000 (0:00:00.613)       0:04:47.666 ****
2025-12-03 10:54:59.241393 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2025-12-03 10:54:59.278572 | controller |
2025-12-03 10:54:59.278598 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2025-12-03 10:54:59.278606 | controller | Wednesday 03 December 2025  10:54:59 +0000 (0:00:01.326)       0:04:48.993 ****
2025-12-03 10:54:59.278617 | controller | skipping: [instance]
2025-12-03 10:54:59.313887 | controller |
2025-12-03 10:54:59.313907 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2025-12-03 10:54:59.313915 | controller | Wednesday 03 December 2025  10:54:59 +0000 (0:00:00.037)       0:04:49.030 ****
2025-12-03 10:54:59.313923 | controller | skipping: [instance]
2025-12-03 10:54:59.353471 | controller |
2025-12-03 10:54:59.353488 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2025-12-03 10:54:59.353495 | controller | Wednesday 03 December 2025  10:54:59 +0000 (0:00:00.035)       0:04:49.066 ****
2025-12-03 10:54:59.353510 | controller | skipping: [instance]
2025-12-03 10:54:59.387979 | controller |
2025-12-03 10:54:59.387996 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2025-12-03 10:54:59.388002 | controller | Wednesday 03 December 2025  10:54:59 +0000 (0:00:00.039)       0:04:49.105 ****
2025-12-03 10:54:59.388010 | controller | skipping: [instance]
2025-12-03 10:54:59.423196 | controller |
2025-12-03 10:54:59.423213 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2025-12-03 10:54:59.423219 | controller | Wednesday 03 December 2025  10:54:59 +0000 (0:00:00.034)       0:04:49.140 ****
2025-12-03 10:54:59.423228 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:54:59.523618 | controller |
2025-12-03 10:54:59.523636 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2025-12-03 10:54:59.523644 | controller | Wednesday 03 December 2025  10:54:59 +0000 (0:00:00.035)       0:04:49.175 ****
2025-12-03 10:54:59.523662 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}})
2025-12-03 10:54:59.572112 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={})
2025-12-03 10:54:59.572130 | controller |
2025-12-03 10:54:59.572137 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2025-12-03 10:54:59.572142 | controller | Wednesday 03 December 2025  10:54:59 +0000 (0:00:00.100)       0:04:49.275 ****
2025-12-03 10:54:59.572151 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance
2025-12-03 10:55:02.831513 | controller |
2025-12-03 10:55:02.831551 | controller | TASK [networking_mapper : Gather the facts] ************************************
2025-12-03 10:55:02.831559 | controller | Wednesday 03 December 2025  10:54:59 +0000 (0:00:00.048)       0:04:49.324 ****
2025-12-03 10:55:02.831574 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2025-12-03 10:55:04.002601 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0)
2025-12-03 10:55:04.002635 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2025-12-03 10:55:04.002642 | controller |
2025-12-03 10:55:04.002649 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] ***
2025-12-03 10:55:04.002655 | controller | Wednesday 03 December 2025  10:55:02 +0000 (0:00:03.258)       0:04:52.583 ****
2025-12-03 10:55:04.002671 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:04.492353 | controller |
2025-12-03 10:55:04.492391 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2025-12-03 10:55:04.492399 | controller | Wednesday 03 December 2025  10:55:03 +0000 (0:00:01.171)       0:04:53.754 ****
2025-12-03 10:55:04.492410 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:05.388840 | controller |
2025-12-03 10:55:05.388872 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2025-12-03 10:55:05.388880 | controller | Wednesday 03 December 2025  10:55:04 +0000 (0:00:00.488)       0:04:54.243 ****
2025-12-03 10:55:05.388897 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:05.469776 | controller |
2025-12-03 10:55:05.469801 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2025-12-03 10:55:05.469810 | controller | Wednesday 03 December 2025  10:55:05 +0000 (0:00:00.897)       0:04:55.140 ****
2025-12-03 10:55:05.469820 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:05.522387 | controller |
2025-12-03 10:55:05.522411 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2025-12-03 10:55:05.522419 | controller | Wednesday 03 December 2025  10:55:05 +0000 (0:00:00.081)       0:04:55.221 ****
2025-12-03 10:55:05.522429 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:05.522809 | controller |
2025-12-03 10:55:06.512374 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2025-12-03 10:55:06.512409 | controller | Wednesday 03 December 2025  10:55:05 +0000 (0:00:00.052)       0:04:55.274 ****
2025-12-03 10:55:06.512422 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:07.435409 | controller |
2025-12-03 10:55:07.435444 | controller | TASK [reproducer : Inject CRC ssh key] *****************************************
2025-12-03 10:55:07.435452 | controller | Wednesday 03 December 2025  10:55:06 +0000 (0:00:00.989)       0:04:56.264 ****
2025-12-03 10:55:07.435463 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:07.435695 | controller |
2025-12-03 10:55:07.435711 | controller | TASK [reproducer : Ensure we have all dependencies installed] ******************
2025-12-03 10:55:13.406392 | controller | Wednesday 03 December 2025  10:55:07 +0000 (0:00:00.923)       0:04:57.187 ****
2025-12-03 10:55:13.406438 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left).
2025-12-03 10:55:13.615758 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:13.615792 | controller |
2025-12-03 10:55:13.615801 | controller | TASK [Configure ntp service] ***************************************************
2025-12-03 10:55:13.615809 | controller | Wednesday 03 December 2025  10:55:13 +0000 (0:00:05.970)       0:05:03.157 ****
2025-12-03 10:55:13.615820 | controller |
2025-12-03 10:55:14.560293 | controller | TASK [cifmw_ntp : Install chrony] **********************************************
2025-12-03 10:55:14.560357 | controller | Wednesday 03 December 2025  10:55:13 +0000 (0:00:00.209)       0:05:03.367 ****
2025-12-03 10:55:14.560376 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:15.537696 | controller |
2025-12-03 10:55:15.537730 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] *************************
2025-12-03 10:55:15.537738 | controller | Wednesday 03 December 2025  10:55:14 +0000 (0:00:00.943)       0:05:04.311 ****
2025-12-03 10:55:15.537748 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True})
2025-12-03 10:55:16.553957 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'})
2025-12-03 10:55:16.553991 | controller |
2025-12-03 10:55:16.553998 | controller | TASK [cifmw_ntp : Render chrony extra config file] *****************************
2025-12-03 10:55:16.554004 | controller | Wednesday 03 December 2025  10:55:15 +0000 (0:00:00.977)       0:05:05.289 ****
2025-12-03 10:55:16.554015 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:17.202055 | controller |
2025-12-03 10:55:17.202090 | controller | TASK [cifmw_ntp : Enable chrony service] ***************************************
2025-12-03 10:55:17.202097 | controller | Wednesday 03 December 2025  10:55:16 +0000 (0:00:01.010)       0:05:06.299 ****
2025-12-03 10:55:17.202107 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:17.405823 | controller |
2025-12-03 10:55:17.405872 | controller | TASK [reproducer : Configure CRC node if available] ****************************
2025-12-03 10:55:17.405880 | controller | Wednesday 03 December 2025  10:55:17 +0000 (0:00:00.653)       0:05:06.952 ****
2025-12-03 10:55:17.405890 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance
2025-12-03 10:55:17.931383 | controller |
2025-12-03 10:55:17.931419 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] ***
2025-12-03 10:55:17.931426 | controller | Wednesday 03 December 2025  10:55:17 +0000 (0:00:00.203)       0:05:07.156 ****
2025-12-03 10:55:17.931438 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:17.931461 | controller |
2025-12-03 10:55:17.931469 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ********************
2025-12-03 10:55:17.931570 | controller | Wednesday 03 December 2025  10:55:17 +0000 (0:00:00.524)       0:05:07.681 ****
2025-12-03 10:55:18.468152 | controller | ok: [instance -> crc-0(crc-0.instance)]
2025-12-03 10:55:19.122388 | controller |
2025-12-03 10:55:19.122426 | controller | TASK [reproducer : Configure local DNS for CRC pod] ****************************
2025-12-03 10:55:19.122434 | controller | Wednesday 03 December 2025  10:55:18 +0000 (0:00:00.536)       0:05:08.218 ****
2025-12-03 10:55:19.122445 | controller | changed: [instance -> crc-0(crc-0.instance)]
2025-12-03 10:55:19.724137 | controller |
2025-12-03 10:55:19.724201 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] ***************
2025-12-03 10:55:19.724211 | controller | Wednesday 03 December 2025  10:55:19 +0000 (0:00:00.654)       0:05:08.873 ****
2025-12-03 10:55:19.724225 | controller | changed: [instance -> crc-0(crc-0.instance)]
2025-12-03 10:55:19.783229 | controller |
2025-12-03 10:55:19.783250 | controller | TASK [Restart DNS in CRC VM] ***************************************************
2025-12-03 10:55:19.783274 | controller | Wednesday 03 December 2025  10:55:19 +0000 (0:00:00.601)       0:05:09.475 ****
2025-12-03 10:55:19.783284 | controller |
2025-12-03 10:55:20.287046 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] ***************
2025-12-03 10:55:20.287098 | controller | Wednesday 03 December 2025  10:55:19 +0000 (0:00:00.060)       0:05:09.535 ****
2025-12-03 10:55:20.287113 | controller | ok: [instance -> crc-0(crc-0.instance)]
2025-12-03 10:55:21.060132 | controller |
2025-12-03 10:55:21.060187 | controller | TASK [openshift_setup : Restart dnsmasq service if used] ***********************
2025-12-03 10:55:21.060196 | controller | Wednesday 03 December 2025  10:55:20 +0000 (0:00:00.502)       0:05:10.038 ****
2025-12-03 10:55:21.060209 | controller | changed: [instance -> crc-0(crc-0.instance)]
2025-12-03 10:55:21.098282 | controller |
2025-12-03 10:55:21.098303 | controller | TASK [openshift_setup : Stop dnsmasq] ******************************************
2025-12-03 10:55:21.098311 | controller | Wednesday 03 December 2025  10:55:21 +0000 (0:00:00.773)       0:05:10.811 ****
2025-12-03 10:55:21.098321 | controller | skipping: [instance]
2025-12-03 10:55:21.140673 | controller |
2025-12-03 10:55:21.140694 | controller | TASK [openshift_setup : Start dnsmasq] *****************************************
2025-12-03 10:55:21.140702 | controller | Wednesday 03 December 2025  10:55:21 +0000 (0:00:00.039)       0:05:10.850 ****
2025-12-03 10:55:21.140713 | controller | skipping: [instance]
2025-12-03 10:55:21.401146 | controller |
2025-12-03 10:55:21.401196 | controller | TASK [reproducer : Remove entry from /etc/hosts] *******************************
2025-12-03 10:55:21.401205 | controller | Wednesday 03 December 2025  10:55:21 +0000 (0:00:00.042)       0:05:10.892 ****
2025-12-03 10:55:21.401216 | controller | changed: [instance]
2025-12-03 10:55:21.477984 | controller |
2025-12-03 10:55:21.478015 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] **********************
2025-12-03 10:55:21.478022 | controller | Wednesday 03 December 2025  10:55:21 +0000 (0:00:00.259)       0:05:11.152 ****
2025-12-03 10:55:21.478031 | controller | skipping: [instance] => (item=)
2025-12-03 10:55:21.513046 | controller |
2025-12-03 10:55:21.513067 | controller | TASK [dnsmasq : Assert we have needed address data] ****************************
2025-12-03 10:55:21.513074 | controller | Wednesday 03 December 2025  10:55:21 +0000 (0:00:00.077)       0:05:11.229 ****
2025-12-03 10:55:21.513084 | controller | ok: [instance]
2025-12-03 10:55:21.585710 | controller |
2025-12-03 10:55:21.585746 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2025-12-03 10:55:21.585759 | controller | Wednesday 03 December 2025  10:55:21 +0000 (0:00:00.035)       0:05:11.265 ****
2025-12-03 10:55:21.585775 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2025-12-03 10:55:21.843811 | controller |
2025-12-03 10:55:21.843855 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2025-12-03 10:55:21.843863 | controller | Wednesday 03 December 2025  10:55:21 +0000 (0:00:00.072)       0:05:11.337 ****
2025-12-03 10:55:21.843876 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2025-12-03 10:55:21.890772 | controller |
2025-12-03 10:55:21.890792 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************
2025-12-03 10:55:21.890800 | controller | Wednesday 03 December 2025  10:55:21 +0000 (0:00:00.257)       0:05:11.595 ****
2025-12-03 10:55:21.890810 | controller |
2025-12-03 10:55:21.958971 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2025-12-03 10:55:21.958999 | controller | Wednesday 03 December 2025  10:55:21 +0000 (0:00:00.047)       0:05:11.643 ****
2025-12-03 10:55:21.959011 | controller | ok: [instance]
2025-12-03 10:55:21.959103 | controller |
2025-12-03 10:55:21.959112 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2025-12-03 10:55:21.959120 | controller | Wednesday 03 December 2025  10:55:21 +0000 (0:00:00.065)       0:05:11.708 ****
2025-12-03 10:55:22.018210 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2025-12-03 10:55:22.306836 | controller |
2025-12-03 10:55:22.306877 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2025-12-03 10:55:22.306885 | controller | Wednesday 03 December 2025  10:55:22 +0000 (0:00:00.062)       0:05:11.770 ****
2025-12-03 10:55:22.306897 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2025-12-03 10:55:22.307405 | controller |
2025-12-03 10:55:22.782488 | controller | TASK [reproducer : Ensure "testing" domain is "local"] *************************
2025-12-03 10:55:22.782532 | controller | Wednesday 03 December 2025  10:55:22 +0000 (0:00:00.284)       0:05:12.055 ****
2025-12-03 10:55:22.782545 | controller | changed: [instance]
2025-12-03 10:55:23.464123 | controller |
2025-12-03 10:55:23.464175 | controller | TASK [reproducer : Flush handlers] *********************************************
2025-12-03 10:55:23.464184 | controller | Wednesday 03 December 2025  10:55:22 +0000 (0:00:00.466)       0:05:12.521 ****
2025-12-03 10:55:23.464190 | controller |
2025-12-03 10:55:23.464205 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] ***********************************
2025-12-03 10:55:23.464210 | controller | Wednesday 03 December 2025  10:55:22 +0000 (0:00:00.011)       0:05:12.533 ****
2025-12-03 10:55:23.464222 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:23.882042 | controller |
2025-12-03 10:55:23.882087 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2025-12-03 10:55:23.882095 | controller | Wednesday 03 December 2025  10:55:23 +0000 (0:00:00.682)       0:05:13.215 ****
2025-12-03 10:55:23.882120 | controller | changed: [instance]
2025-12-03 10:55:24.068899 | controller |
2025-12-03 10:55:24.068938 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] ****************
2025-12-03 10:55:24.068959 | controller | Wednesday 03 December 2025  10:55:23 +0000 (0:00:00.417)       0:05:13.633 ****
2025-12-03 10:55:24.068972 | controller | skipping: [instance] => (item=controller-0)
2025-12-03 10:55:25.605908 | controller | skipping: [instance] => (item=crc-0)
2025-12-03 10:55:25.605987 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0)
2025-12-03 10:55:25.605996 | controller |
2025-12-03 10:55:25.606002 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] **************
2025-12-03 10:55:25.606008 | controller | Wednesday 03 December 2025  10:55:24 +0000 (0:00:00.186)       0:05:13.820 ****
2025-12-03 10:55:25.606021 | controller | changed: [instance -> compute-0(compute-0.instance)]
2025-12-03 10:55:25.631355 | controller |
2025-12-03 10:55:25.631402 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2025-12-03 10:55:25.631411 | controller | Wednesday 03 December 2025  10:55:25 +0000 (0:00:01.537)       0:05:15.357 ****
2025-12-03 10:55:25.631422 | controller | skipping: [instance]
2025-12-03 10:55:25.631503 | controller |
2025-12-03 10:55:25.631677 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2025-12-03 10:55:25.631789 | controller | Wednesday 03 December 2025  10:55:25 +0000 (0:00:00.026)       0:05:15.383 ****
2025-12-03 10:55:26.167225 | controller | ok: [instance -> compute-0(compute-0.instance)]
2025-12-03 10:55:26.167293 | controller |
2025-12-03 10:55:26.167345 | controller | TASK [install_ca : Install internal CA from url] *******************************
2025-12-03 10:55:26.167489 | controller | Wednesday 03 December 2025  10:55:26 +0000 (0:00:00.535)       0:05:15.918 ****
2025-12-03 10:55:26.211976 | controller | skipping: [instance]
2025-12-03 10:55:26.212081 | controller |
2025-12-03 10:55:26.212208 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2025-12-03 10:55:26.212347 | controller | Wednesday 03 December 2025  10:55:26 +0000 (0:00:00.045)       0:05:15.964 ****
2025-12-03 10:55:26.259955 | controller | skipping: [instance]
2025-12-03 10:55:26.260041 | controller |
2025-12-03 10:55:26.260142 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2025-12-03 10:55:26.260248 | controller | Wednesday 03 December 2025  10:55:26 +0000 (0:00:00.048)       0:05:16.012 ****
2025-12-03 10:55:26.304170 | controller | skipping: [instance]
2025-12-03 10:55:26.304216 | controller |
2025-12-03 10:55:26.304366 | controller | TASK [install_ca : Update ca bundle] *******************************************
2025-12-03 10:55:26.304485 | controller | Wednesday 03 December 2025  10:55:26 +0000 (0:00:00.043)       0:05:16.055 ****
2025-12-03 10:55:27.818624 | controller | changed: [instance -> compute-0(compute-0.instance)]
2025-12-03 10:55:27.818920 | controller |
2025-12-03 10:55:27.855713 | controller | TASK [reproducer : Get rhos-release and setup repos] ***************************
2025-12-03 10:55:27.855745 | controller | Wednesday 03 December 2025  10:55:27 +0000 (0:00:01.514)       0:05:17.570 ****
2025-12-03 10:55:27.855759 | controller | skipping: [instance]
2025-12-03 10:55:27.855821 | controller |
2025-12-03 10:55:27.855832 | controller | TASK [reproducer : Create repositories on computes] ****************************
2025-12-03 10:55:27.855948 | controller | Wednesday 03 December 2025  10:55:27 +0000 (0:00:00.037)       0:05:17.607 ****
2025-12-03 10:55:27.876497 | controller | skipping: [instance]
2025-12-03 10:55:27.876572 | controller |
2025-12-03 10:55:27.876678 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] *********************
2025-12-03 10:55:27.876797 | controller | Wednesday 03 December 2025  10:55:27 +0000 (0:00:00.020)       0:05:17.628 ****
2025-12-03 10:55:27.905697 | controller | skipping: [instance]
2025-12-03 10:55:27.905833 | controller |
2025-12-03 10:55:27.905991 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] *******
2025-12-03 10:55:27.906255 | controller | Wednesday 03 December 2025  10:55:27 +0000 (0:00:00.029)       0:05:17.658 ****
2025-12-03 10:55:27.960099 | controller | ok: [instance]
2025-12-03 10:55:27.960203 | controller |
2025-12-03 10:55:27.960218 | controller | TASK [reproducer : Push local code] ********************************************
2025-12-03 10:55:28.057387 | controller | Wednesday 03 December 2025  10:55:27 +0000 (0:00:00.054)       0:05:17.712 ****
2025-12-03 10:55:28.057416 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance
2025-12-03 10:55:28.057491 | controller |
2025-12-03 10:55:28.057603 | controller | TASK [reproducer : Check if repository directories already exist] **************
2025-12-03 10:55:28.057721 | controller | Wednesday 03 December 2025  10:55:28 +0000 (0:00:00.097)       0:05:17.809 ****
2025-12-03 10:55:28.098562 | controller | skipping: [instance]
2025-12-03 10:55:28.098705 | controller |
2025-12-03 10:55:28.098853 | controller | TASK [reproducer : Ensure we are not in the job_id branch] *********************
2025-12-03 10:55:28.099007 | controller | Wednesday 03 December 2025  10:55:28 +0000 (0:00:00.040)       0:05:17.850 ****
2025-12-03 10:55:28.139905 | controller | skipping: [instance]
2025-12-03 10:55:28.140030 | controller |
2025-12-03 10:55:28.140159 | controller | TASK [reproducer : Fetch zuul.items repositories] ******************************
2025-12-03 10:55:28.140285 | controller | Wednesday 03 December 2025  10:55:28 +0000 (0:00:00.041)       0:05:17.892 ****
2025-12-03 10:55:28.182138 | controller | skipping: [instance]
2025-12-03 10:55:28.182270 | controller |
2025-12-03 10:55:28.182478 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] **********
2025-12-03 10:55:28.182621 | controller | Wednesday 03 December 2025  10:55:28 +0000 (0:00:00.042)       0:05:17.934 ****
2025-12-03 10:55:28.220881 | controller | skipping: [instance]
2025-12-03 10:55:28.220967 | controller |
2025-12-03 10:55:28.221081 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] ***
2025-12-03 10:55:28.221197 | controller | Wednesday 03 December 2025  10:55:28 +0000 (0:00:00.038)       0:05:17.973 ****
2025-12-03 10:55:28.257532 | controller | skipping: [instance]
2025-12-03 10:55:28.257691 | controller |
2025-12-03 10:55:28.257725 | controller | TASK [reproducer : Create target directories beforehand] ***********************
2025-12-03 10:55:28.257954 | controller | Wednesday 03 December 2025  10:55:28 +0000 (0:00:00.036)       0:05:18.009 ****
2025-12-03 10:55:28.708802 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators)
2025-12-03 10:55:28.708902 | controller |
2025-12-03 10:55:28.709043 | controller | TASK [reproducer : Sync local repositories to ansible controller] **************
2025-12-03 10:55:28.709169 | controller | Wednesday 03 December 2025  10:55:28 +0000 (0:00:00.451)       0:05:18.460 ****
2025-12-03 10:55:29.278896 | controller | ok: [instance -> localhost] => (item=ci-framework)
2025-12-03 10:55:29.278983 | controller |
2025-12-03 10:55:29.279126 | controller | TASK [reproducer : Sync remote repositories] ***********************************
2025-12-03 10:55:29.279255 | controller | Wednesday 03 December 2025  10:55:29 +0000 (0:00:00.570)       0:05:19.030 ****
2025-12-03 10:55:29.323782 | controller | skipping: [instance] => (item=ci-framework)
2025-12-03 10:55:29.323868 | controller | skipping: [instance]
2025-12-03 10:55:29.324092 | controller |
2025-12-03 10:55:29.324305 | controller | TASK [reproducer : Ensure default repositories are present] ********************
2025-12-03 10:55:29.324324 | controller | Wednesday 03 December 2025  10:55:29 +0000 (0:00:00.045)       0:05:19.076 ****
2025-12-03 10:55:29.399923 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework)
2025-12-03 10:55:29.400036 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls)
2025-12-03 10:55:29.400142 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture)
2025-12-03 10:55:29.400234 | controller |
2025-12-03 10:55:29.400348 | controller | TASK [reproducer : Check repository availability: ci-framework] ****************
2025-12-03 10:55:29.400468 | controller | Wednesday 03 December 2025  10:55:29 +0000 (0:00:00.076)       0:05:19.152 ****
2025-12-03 10:55:29.852163 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:29.852284 | controller |
2025-12-03 10:55:29.852698 | controller | TASK [reproducer : Clone repository if needed: ci-framework] *******************
2025-12-03 10:55:29.889272 | controller | Wednesday 03 December 2025  10:55:29 +0000 (0:00:00.451)       0:05:19.604 ****
2025-12-03 10:55:29.889300 | controller | skipping: [instance]
2025-12-03 10:55:29.889416 | controller |
2025-12-03 10:55:29.889547 | controller | TASK [reproducer : Check repository availability: install_yamls] ***************
2025-12-03 10:55:29.889664 | controller | Wednesday 03 December 2025  10:55:29 +0000 (0:00:00.037)       0:05:19.641 ****
2025-12-03 10:55:30.360644 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:30.360727 | controller |
2025-12-03 10:55:30.360841 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ******************
2025-12-03 10:55:30.360951 | controller | Wednesday 03 December 2025  10:55:30 +0000 (0:00:00.471)       0:05:20.112 ****
2025-12-03 10:55:30.399188 | controller | skipping: [instance]
2025-12-03 10:55:30.399272 | controller |
2025-12-03 10:55:30.399428 | controller | TASK [reproducer : Check repository availability: architecture] ****************
2025-12-03 10:55:30.399535 | controller | Wednesday 03 December 2025  10:55:30 +0000 (0:00:00.038)       0:05:20.151 ****
2025-12-03 10:55:30.819797 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:30.819875 | controller |
2025-12-03 10:55:30.820019 | controller | TASK [reproducer : Clone repository if needed: architecture] *******************
2025-12-03 10:55:30.820142 | controller | Wednesday 03 December 2025  10:55:30 +0000 (0:00:00.420)       0:05:20.571 ****
2025-12-03 10:55:33.058806 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:33.058858 | controller |
2025-12-03 10:55:33.059015 | controller | TASK [reproducer : Sync local repositories to ansible controller] **************
2025-12-03 10:55:33.059144 | controller | Wednesday 03 December 2025  10:55:33 +0000 (0:00:02.238)       0:05:22.810 ****
2025-12-03 10:55:33.846958 | controller | changed: [instance -> localhost]
2025-12-03 10:55:33.847046 | controller |
2025-12-03 10:55:33.847145 | controller | TASK [reproducer : Install collections on controller-0] ************************
2025-12-03 10:55:33.847277 | controller | Wednesday 03 December 2025  10:55:33 +0000 (0:00:00.788)       0:05:23.598 ****
2025-12-03 10:55:53.198698 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:53.198752 | controller |
2025-12-03 10:55:53.198858 | controller | TASK [reproducer : Inject CI Framework motd] ***********************************
2025-12-03 10:55:53.198954 | controller | Wednesday 03 December 2025  10:55:53 +0000 (0:00:19.351)       0:05:42.950 ****
2025-12-03 10:55:54.290639 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:54.290711 | controller |
2025-12-03 10:55:54.290802 | controller | TASK [reproducer : Rotate some logs] *******************************************
2025-12-03 10:55:54.290888 | controller | Wednesday 03 December 2025  10:55:54 +0000 (0:00:01.091)       0:05:44.042 ****
2025-12-03 10:55:54.392730 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log)
2025-12-03 10:55:54.392798 | controller |
2025-12-03 10:55:54.392906 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] *********************
2025-12-03 10:55:54.393030 | controller | Wednesday 03 December 2025  10:55:54 +0000 (0:00:00.102)       0:05:44.145 ****
2025-12-03 10:55:54.895283 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:54.895366 | controller |
2025-12-03 10:55:54.895465 | controller | TASK [reproducer : Rotate log if present] **************************************
2025-12-03 10:55:54.895567 | controller | Wednesday 03 December 2025  10:55:54 +0000 (0:00:00.502)       0:05:44.647 ****
2025-12-03 10:55:54.945039 | controller | skipping: [instance]
2025-12-03 10:55:54.945130 | controller |
2025-12-03 10:55:54.945252 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] ***********************
2025-12-03 10:55:54.945375 | controller | Wednesday 03 December 2025  10:55:54 +0000 (0:00:00.050)       0:05:44.697 ****
2025-12-03 10:55:54.992190 | controller | skipping: [instance]
2025-12-03 10:55:54.992292 | controller |
2025-12-03 10:55:54.992431 | controller | TASK [cifmw_setup : Get customized parameters] *********************************
2025-12-03 10:55:54.992532 | controller | Wednesday 03 December 2025  10:55:54 +0000 (0:00:00.046)       0:05:44.744 ****
2025-12-03 10:55:55.085956 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:55.086025 | controller |
2025-12-03 10:55:55.086166 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2025-12-03 10:55:55.086275 | controller | Wednesday 03 December 2025  10:55:55 +0000 (0:00:00.093)       0:05:44.838 ****
2025-12-03 10:55:55.641406 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:55.641680 | controller |
2025-12-03 10:55:55.687614 | controller | TASK [install_ca : Install internal CA from url] *******************************
2025-12-03 10:55:55.687663 | controller | Wednesday 03 December 2025  10:55:55 +0000 (0:00:00.554)       0:05:45.393 ****
2025-12-03 10:55:55.687678 | controller | skipping: [instance]
2025-12-03 10:55:55.731644 | controller |
2025-12-03 10:55:55.731677 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2025-12-03 10:55:55.731685 | controller | Wednesday 03 December 2025  10:55:55 +0000 (0:00:00.046)       0:05:45.439 ****
2025-12-03 10:55:55.731696 | controller | skipping: [instance]
2025-12-03 10:55:55.731829 | controller |
2025-12-03 10:55:55.731968 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2025-12-03 10:55:55.732041 | controller | Wednesday 03 December 2025  10:55:55 +0000 (0:00:00.044)       0:05:45.484 ****
2025-12-03 10:55:55.775254 | controller | skipping: [instance]
2025-12-03 10:55:55.775351 | controller |
2025-12-03 10:55:55.775567 | controller | TASK [install_ca : Update ca bundle] *******************************************
2025-12-03 10:55:55.775663 | controller | Wednesday 03 December 2025  10:55:55 +0000 (0:00:00.043)       0:05:45.527 ****
2025-12-03 10:55:57.317043 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:55:58.908533 | controller |
2025-12-03 10:55:58.908571 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2025-12-03 10:55:58.908579 | controller | Wednesday 03 December 2025  10:55:57 +0000 (0:00:01.541)       0:05:47.068 ****
2025-12-03 10:55:58.908588 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-12-03 10:55:59.955804 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-12-03 10:55:59.955840 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-12-03 10:55:59.955848 | controller | changed: [instance -> controller-0]
2025-12-03 10:55:59.955854 | controller |
2025-12-03 10:55:59.955860 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2025-12-03 10:55:59.955865 | controller | Wednesday 03 December 2025  10:55:58 +0000 (0:00:01.591)       0:05:48.659 ****
2025-12-03 10:55:59.955876 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:56:01.260164 | controller |
2025-12-03 10:56:01.260205 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2025-12-03 10:56:01.260241 | controller | Wednesday 03 December 2025  10:55:59 +0000 (0:00:01.047)       0:05:49.707 ****
2025-12-03 10:56:01.260254 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:56:09.286775 | controller |
2025-12-03 10:56:09.286817 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2025-12-03 10:56:09.286825 | controller | Wednesday 03 December 2025  10:56:01 +0000 (0:00:01.304)       0:05:51.011 ****
2025-12-03 10:56:09.286848 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:56:10.406870 | controller |
2025-12-03 10:56:10.406913 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2025-12-03 10:56:10.406922 | controller | Wednesday 03 December 2025  10:56:09 +0000 (0:00:08.026)       0:05:59.038 ****
2025-12-03 10:56:10.406932 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:56:10.459485 | controller |
2025-12-03 10:56:10.459529 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2025-12-03 10:56:10.459537 | controller | Wednesday 03 December 2025  10:56:10 +0000 (0:00:01.120)       0:06:00.158 ****
2025-12-03 10:56:10.459548 | controller | skipping: [instance]
2025-12-03 10:56:10.459555 | controller |
2025-12-03 10:56:10.459561 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2025-12-03 10:56:10.459578 | controller | Wednesday 03 December 2025  10:56:10 +0000 (0:00:00.052)       0:06:00.210 ****
2025-12-03 10:56:11.672806 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:56:11.741181 | controller |
2025-12-03 10:56:11.741222 | controller | TASK [repo_setup : Get component repo] *****************************************
2025-12-03 10:56:11.741230 | controller | Wednesday 03 December 2025  10:56:11 +0000 (0:00:01.213)       0:06:01.424 ****
2025-12-03 10:56:11.741242 | controller | skipping: [instance]
2025-12-03 10:56:11.741271 | controller |
2025-12-03 10:56:11.741279 | controller | TASK [repo_setup : Rename component repo] **************************************
2025-12-03 10:56:11.741402 | controller | Wednesday 03 December 2025  10:56:11 +0000 (0:00:00.068)       0:06:01.493 ****
2025-12-03 10:56:11.804071 | controller | skipping: [instance]
2025-12-03 10:56:11.873220 | controller |
2025-12-03 10:56:11.873376 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2025-12-03 10:56:11.873393 | controller | Wednesday 03 December 2025  10:56:11 +0000 (0:00:00.062)       0:06:01.556 ****
2025-12-03 10:56:11.873421 | controller | skipping: [instance]
2025-12-03 10:56:12.841998 | controller |
2025-12-03 10:56:12.842080 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2025-12-03 10:56:12.842090 | controller | Wednesday 03 December 2025  10:56:11 +0000 (0:00:00.068)       0:06:01.624 ****
2025-12-03 10:56:12.842105 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:56:12.842135 | controller |
2025-12-03 10:56:12.842145 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2025-12-03 10:56:12.842248 | controller | Wednesday 03 December 2025  10:56:12 +0000 (0:00:00.968)       0:06:02.593 ****
2025-12-03 10:56:13.818858 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:56:13.818928 | controller |
2025-12-03 10:56:13.819109 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2025-12-03 10:56:13.819232 | controller | Wednesday 03 December 2025  10:56:13 +0000 (0:00:00.976)       0:06:03.570 ****
2025-12-03 10:56:13.868101 | controller | skipping: [instance]
2025-12-03 10:56:13.868210 | controller |
2025-12-03 10:56:13.868421 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2025-12-03 10:56:13.868471 | controller | Wednesday 03 December 2025  10:56:13 +0000 (0:00:00.049)       0:06:03.620 ****
2025-12-03 10:56:13.919626 | controller | skipping: [instance]
2025-12-03 10:56:13.919717 | controller |
2025-12-03 10:56:13.919728 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2025-12-03 10:56:13.919739 | controller | Wednesday 03 December 2025  10:56:13 +0000 (0:00:00.051)       0:06:03.671 ****
2025-12-03 10:56:13.968120 | controller | skipping: [instance]
2025-12-03 10:56:13.968356 | controller |
2025-12-03 10:56:13.968404 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2025-12-03 10:56:14.027462 | controller | Wednesday 03 December 2025  10:56:13 +0000 (0:00:00.048)       0:06:03.720 ****
2025-12-03 10:56:14.027516 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:56:14.027549 | controller |
2025-12-03 10:56:14.027574 | controller | TASK [repo_setup : Create download directory] **********************************
2025-12-03 10:56:14.027705 | controller | Wednesday 03 December 2025  10:56:14 +0000 (0:00:00.059)       0:06:03.779 ****
2025-12-03 10:56:14.071275 | controller | skipping: [instance]
2025-12-03 10:56:14.071353 | controller |
2025-12-03 10:56:14.071641 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2025-12-03 10:56:14.114282 | controller | Wednesday 03 December 2025  10:56:14 +0000 (0:00:00.043)       0:06:03.823 ****
2025-12-03 10:56:14.114319 | controller | skipping: [instance]
2025-12-03 10:56:14.162950 | controller |
2025-12-03 10:56:14.163049 | controller | TASK [Download the RPM] ********************************************************
2025-12-03 10:56:14.163058 | controller | Wednesday 03 December 2025  10:56:14 +0000 (0:00:00.042)       0:06:03.866 ****
2025-12-03 10:56:14.163069 | controller | skipping: [instance]
2025-12-03 10:56:14.163317 | controller |
2025-12-03 10:56:14.163375 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2025-12-03 10:56:14.206552 | controller | Wednesday 03 December 2025  10:56:14 +0000 (0:00:00.048)       0:06:03.915 ****
2025-12-03 10:56:14.206615 | controller | skipping: [instance]
2025-12-03 10:56:14.206639 | controller |
2025-12-03 10:56:14.206648 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2025-12-03 10:56:14.206693 | controller | Wednesday 03 December 2025  10:56:14 +0000 (0:00:00.043)       0:06:03.958 ****
2025-12-03 10:56:14.259859 | controller | skipping: [instance]
2025-12-03 10:56:14.303174 | controller |
2025-12-03 10:56:14.303220 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2025-12-03 10:56:14.303228 | controller | Wednesday 03 December 2025  10:56:14 +0000 (0:00:00.053)       0:06:04.011 ****
2025-12-03 10:56:14.303239 | controller | skipping: [instance]
2025-12-03 10:56:14.303269 | controller |
2025-12-03 10:56:14.303594 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2025-12-03 10:56:14.345666 | controller | Wednesday 03 December 2025  10:56:14 +0000 (0:00:00.043)       0:06:04.055 ****
2025-12-03 10:56:14.345733 | controller | skipping: [instance]
2025-12-03 10:56:14.866420 | controller |
2025-12-03 10:56:14.866469 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2025-12-03 10:56:14.866477 | controller | Wednesday 03 December 2025  10:56:14 +0000 (0:00:00.042)       0:06:04.097 ****
2025-12-03 10:56:14.866489 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:56:14.936026 | controller |
2025-12-03 10:56:14.936056 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2025-12-03 10:56:14.936063 | controller | Wednesday 03 December 2025  10:56:14 +0000 (0:00:00.520)       0:06:04.618 ****
2025-12-03 10:56:14.936074 | controller | skipping: [instance]
2025-12-03 10:56:15.146677 | controller |
2025-12-03 10:56:15.146706 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2025-12-03 10:56:15.146715 | controller | Wednesday 03 December 2025  10:56:14 +0000 (0:00:00.069)       0:06:04.688 ****
2025-12-03 10:56:15.146725 | controller | skipping: [instance]
2025-12-03 10:56:15.195559 | controller |
2025-12-03 10:56:15.195579 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2025-12-03 10:56:15.195587 | controller | Wednesday 03 December 2025  10:56:15 +0000 (0:00:00.210)       0:06:04.898 ****
2025-12-03 10:56:15.195595 | controller | skipping: [instance]
2025-12-03 10:56:15.260076 | controller |
2025-12-03 10:56:15.260112 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2025-12-03 10:56:15.260120 | controller | Wednesday 03 December 2025  10:56:15 +0000 (0:00:00.049)       0:06:04.947 ****
2025-12-03 10:56:15.260129 | controller | skipping: [instance]
2025-12-03 10:56:15.323236 | controller |
2025-12-03 10:56:15.323279 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2025-12-03 10:56:15.323288 | controller | Wednesday 03 December 2025  10:56:15 +0000 (0:00:00.063)       0:06:05.011 ****
2025-12-03 10:56:15.323300 | controller | skipping: [instance]
2025-12-03 10:56:15.387932 | controller |
2025-12-03 10:56:15.388014 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2025-12-03 10:56:15.388025 | controller | Wednesday 03 December 2025  10:56:15 +0000 (0:00:00.063)       0:06:05.075 ****
2025-12-03 10:56:15.388040 | controller | skipping: [instance]
2025-12-03 10:56:15.456393 | controller |
2025-12-03 10:56:15.456428 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2025-12-03 10:56:15.456437 | controller | Wednesday 03 December 2025  10:56:15 +0000 (0:00:00.064)       0:06:05.139 ****
2025-12-03 10:56:15.456448 | controller | skipping: [instance]
2025-12-03 10:56:15.456511 | controller |
2025-12-03 10:56:15.456670 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo] ***
2025-12-03 10:56:15.456802 | controller | Wednesday 03 December 2025  10:56:15 +0000 (0:00:00.068)       0:06:05.208 ****
2025-12-03 10:56:15.520841 | controller | skipping: [instance]
2025-12-03 10:56:15.520927 | controller |
2025-12-03 10:56:15.521060 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2025-12-03 10:56:15.521160 | controller | Wednesday 03 December 2025  10:56:15 +0000 (0:00:00.064)       0:06:05.273 ****
2025-12-03 10:56:16.155472 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:56:16.155571 | controller |
2025-12-03 10:56:16.155583 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2025-12-03 10:56:16.155644 | controller | Wednesday 03 December 2025  10:56:16 +0000 (0:00:00.634)       0:06:05.907 ****
2025-12-03 10:56:17.274726 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-12-03 10:56:17.274799 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-12-03 10:56:17.274925 | controller | changed: [instance -> controller-0]
2025-12-03 10:56:17.275034 | controller |
2025-12-03 10:56:17.275143 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2025-12-03 10:56:17.275246 | controller | Wednesday 03 December 2025  10:56:17 +0000 (0:00:01.119)       0:06:07.026 ****
2025-12-03 10:56:18.059225 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:56:18.059322 | controller |
2025-12-03 10:56:18.059457 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2025-12-03 10:56:18.059473 | controller | Wednesday 03 December 2025  10:56:18 +0000 (0:00:00.784)       0:06:07.810 ****
2025-12-03 10:56:18.660859 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:56:18.660955 | controller |
2025-12-03 10:56:18.661120 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2025-12-03 10:56:18.661163 | controller | Wednesday 03 December 2025  10:56:18 +0000 (0:00:00.601)       0:06:08.412 ****
2025-12-03 10:56:18.731879 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-12-03 10:56:18.786158 | controller | ok: [instance -> controller-0]
2025-12-03 10:56:18.786187 | controller |
2025-12-03 10:56:18.786196 | controller | TASK [ci_setup : List packages to install] *************************************
2025-12-03 10:56:18.786202 | controller | Wednesday 03 December 2025  10:56:18 +0000 (0:00:00.071)       0:06:08.483 ****
2025-12-03 10:56:18.786213 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:56:52.501681 | controller |
2025-12-03 10:56:52.501791 | controller | TASK [ci_setup : Install needed packages] **************************************
2025-12-03 10:56:52.501803 | controller | Wednesday 03 December 2025  10:56:18 +0000 (0:00:00.054)       0:06:08.538 ****
2025-12-03 10:56:52.501832 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:56:53.029342 | controller |
2025-12-03 10:56:53.029412 | controller | TASK [ci_setup : Gather version of openshift client] ***************************
2025-12-03 10:56:53.029420 | controller | Wednesday 03 December 2025  10:56:52 +0000 (0:00:33.714)       0:06:42.252 ****
2025-12-03 10:56:53.029437 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:56:53.029501 | controller |
2025-12-03 10:56:53.029513 | controller | TASK [ci_setup : Ensure openshift client install path is present] **************
2025-12-03 10:56:53.029602 | controller | Wednesday 03 December 2025  10:56:53 +0000 (0:00:00.528)       0:06:42.781 ****
2025-12-03 10:56:53.571837 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:56:53.571904 | controller |
2025-12-03 10:56:53.572144 | controller | TASK [ci_setup : Install openshift client] *************************************
2025-12-03 10:56:59.729227 | controller | Wednesday 03 December 2025  10:56:53 +0000 (0:00:00.542)       0:06:43.323 ****
2025-12-03 10:56:59.729298 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:56:59.729370 | controller |
2025-12-03 10:56:59.729386 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
2025-12-03 10:56:59.729457 | controller | Wednesday 03 December 2025  10:56:59 +0000 (0:00:06.157)       0:06:49.481 ****
2025-12-03 10:56:59.784879 | controller | skipping: [instance]
2025-12-03 10:56:59.784960 | controller |
2025-12-03 10:56:59.785080 | controller | TASK [ci_setup : Create completion file] ***************************************
2025-12-03 10:56:59.785184 | controller | Wednesday 03 December 2025  10:56:59 +0000 (0:00:00.055)       0:06:49.536 ****
2025-12-03 10:57:00.494190 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:57:00.494291 | controller |
2025-12-03 10:57:00.494369 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************
2025-12-03 10:57:00.494399 | controller | Wednesday 03 December 2025  10:57:00 +0000 (0:00:00.708)       0:06:50.246 ****
2025-12-03 10:57:01.007656 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:57:01.007732 | controller |
2025-12-03 10:57:01.007783 | controller | TASK [ci_setup : Check rhsm status] ********************************************
2025-12-03 10:57:01.007889 | controller | Wednesday 03 December 2025  10:57:01 +0000 (0:00:00.513)       0:06:50.759 ****
2025-12-03 10:57:01.057139 | controller | skipping: [instance]
2025-12-03 10:57:01.057250 | controller |
2025-12-03 10:57:01.057405 | controller | TASK [ci_setup : Gather the repos to be enabled] *******************************
2025-12-03 10:57:01.057519 | controller | Wednesday 03 December 2025  10:57:01 +0000 (0:00:00.049)       0:06:50.809 ****
2025-12-03 10:57:01.107405 | controller | skipping: [instance]
2025-12-03 10:57:01.107658 | controller |
2025-12-03 10:57:01.107702 | controller | TASK [ci_setup : Enabling the required repositories.] **************************
2025-12-03 10:57:01.107712 | controller | Wednesday 03 December 2025  10:57:01 +0000 (0:00:00.050)       0:06:50.859 ****
2025-12-03 10:57:01.156143 | controller | skipping: [instance]
2025-12-03 10:57:01.156249 | controller |
2025-12-03 10:57:01.156398 | controller | TASK [ci_setup : Get current /etc/redhat-release] ******************************
2025-12-03 10:57:01.156478 | controller | Wednesday 03 December 2025  10:57:01 +0000 (0:00:00.048)       0:06:50.908 ****
2025-12-03 10:57:01.202250 | controller | skipping: [instance]
2025-12-03 10:57:01.202315 | controller |
2025-12-03 10:57:01.202455 | controller | TASK [ci_setup : Print current /etc/redhat-release] ****************************
2025-12-03 10:57:01.202557 | controller | Wednesday 03 December 2025  10:57:01 +0000 (0:00:00.046)       0:06:50.954 ****
2025-12-03 10:57:01.248915 | controller | skipping: [instance]
2025-12-03 10:57:01.249002 | controller |
2025-12-03 10:57:01.249118 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
2025-12-03 10:57:01.249225 | controller | Wednesday 03 December 2025  10:57:01 +0000 (0:00:00.046)       0:06:51.001 ****
2025-12-03 10:57:01.295708 | controller | skipping: [instance]
2025-12-03 10:57:01.295761 | controller |
2025-12-03 10:57:01.295832 | controller | TASK [ci_setup : Manage directories] *******************************************
2025-12-03 10:57:01.295955 | controller | Wednesday 03 December 2025  10:57:01 +0000 (0:00:00.046)       0:06:51.048 ****
2025-12-03 10:57:04.012434 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-12-03 10:57:04.012491 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-12-03 10:57:04.012633 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-12-03 10:57:04.012718 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-12-03 10:57:04.012810 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-12-03 10:57:04.012907 | controller | changed: [instance -> controller-0]
2025-12-03 10:57:04.012995 | controller |
2025-12-03 10:57:04.013096 | controller | TASK [Prepare install_yamls make targets] **************************************
2025-12-03 10:57:04.013204 | controller | Wednesday 03 December 2025  10:57:04 +0000 (0:00:02.716)       0:06:53.764 ****
2025-12-03 10:57:04.177826 | controller |
2025-12-03 10:57:04.177964 | controller | TASK [install_yamls : Ensure directories exist] ********************************
2025-12-03 10:57:04.178119 | controller | Wednesday 03 December 2025  10:57:04 +0000 (0:00:00.165)       0:06:53.929 ****
2025-12-03 10:57:05.788584 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-12-03 10:57:05.788681 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-12-03 10:57:05.788906 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-12-03 10:57:05.788960 | controller | changed: [instance -> controller-0]
2025-12-03 10:57:05.788972 | controller |
2025-12-03 10:57:05.789001 | controller | TASK [Create variables with local repos based on Zuul items] *******************
2025-12-03 10:57:05.789128 | controller | Wednesday 03 December 2025  10:57:05 +0000 (0:00:01.610)       0:06:55.540 ****
2025-12-03 10:57:05.856299 | controller |
2025-12-03 10:57:05.856409 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] ***********
2025-12-03 10:57:05.856430 | controller | Wednesday 03 December 2025  10:57:05 +0000 (0:00:00.067)       0:06:55.608 ****
2025-12-03 10:57:05.907002 | controller | skipping: [instance]
2025-12-03 10:57:05.959904 | controller |
2025-12-03 10:57:05.959934 | controller | TASK [install_yamls : Print helpful data for debugging] ************************
2025-12-03 10:57:05.959943 | controller | Wednesday 03 December 2025  10:57:05 +0000 (0:00:00.050)       0:06:55.658 ****
2025-12-03 10:57:05.959953 | controller | skipping: [instance]
2025-12-03 10:57:05.960045 | controller |
2025-12-03 10:57:05.960075 | controller | TASK [Customize install_yamls devsetup vars if needed] *************************
2025-12-03 10:57:05.960088 | controller | Wednesday 03 December 2025  10:57:05 +0000 (0:00:00.053)       0:06:55.711 ****
2025-12-03 10:57:06.026810 | controller |
2025-12-03 10:57:06.071660 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] ***
2025-12-03 10:57:06.071687 | controller | Wednesday 03 December 2025  10:57:06 +0000 (0:00:00.066)       0:06:55.778 ****
2025-12-03 10:57:06.071700 | controller | skipping: [instance]
2025-12-03 10:57:06.071859 | controller |
2025-12-03 10:57:06.071871 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] ***
2025-12-03 10:57:06.071880 | controller | Wednesday 03 December 2025  10:57:06 +0000 (0:00:00.044)       0:06:55.823 ****
2025-12-03 10:57:06.113933 | controller | skipping: [instance]
2025-12-03 10:57:06.114083 | controller |
2025-12-03 10:57:06.114105 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] ***
2025-12-03 10:57:06.155846 | controller | Wednesday 03 December 2025  10:57:06 +0000 (0:00:00.042)       0:06:55.865 ****
2025-12-03 10:57:06.155870 | controller | skipping: [instance]
2025-12-03 10:57:06.156066 | controller |
2025-12-03 10:57:06.156100 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] ***
2025-12-03 10:57:06.156109 | controller | Wednesday 03 December 2025  10:57:06 +0000 (0:00:00.042)       0:06:55.908 ****
2025-12-03 10:57:06.205059 | controller | skipping: [instance]
2025-12-03 10:57:06.297860 | controller |
2025-12-03 10:57:06.297901 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ********
2025-12-03 10:57:06.297909 | controller | Wednesday 03 December 2025  10:57:06 +0000 (0:00:00.048)       0:06:55.957 ****
2025-12-03 10:57:06.297921 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2025-12-03 10:57:06.297973 | controller | ok: [instance -> controller-0]
2025-12-03 10:57:06.297996 | controller |
2025-12-03 10:57:06.298199 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] ***
2025-12-03 10:57:06.377680 | controller | Wednesday 03 December 2025  10:57:06 +0000 (0:00:00.092)       0:06:56.049 ****
2025-12-03 10:57:06.377709 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:57:06.377973 | controller |
2025-12-03 10:57:06.379383 | controller | TASK [install_yamls : Get environment structure] *******************************
2025-12-03 10:57:07.521867 | controller | Wednesday 03 December 2025  10:57:06 +0000 (0:00:00.079)       0:06:56.129 ****
2025-12-03 10:57:07.521941 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:57:07.571283 | controller |
2025-12-03 10:57:07.571323 | controller | TASK [install_yamls : Ensure Output directory exists] **************************
2025-12-03 10:57:07.571351 | controller | Wednesday 03 December 2025  10:57:07 +0000 (0:00:01.143)       0:06:57.272 ****
2025-12-03 10:57:07.571362 | controller | skipping: [instance]
2025-12-03 10:57:07.571623 | controller |
2025-12-03 10:57:07.571791 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] ***
2025-12-03 10:57:07.571876 | controller | Wednesday 03 December 2025  10:57:07 +0000 (0:00:00.046)       0:06:57.319 ****
2025-12-03 10:57:07.630175 | controller | skipping: [instance]
2025-12-03 10:57:07.630254 | controller |
2025-12-03 10:57:07.630264 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] ***
2025-12-03 10:57:07.630274 | controller | Wednesday 03 December 2025  10:57:07 +0000 (0:00:00.062)       0:06:57.381 ****
2025-12-03 10:57:07.670868 | controller | skipping: [instance]
2025-12-03 10:57:07.671077 | controller |
2025-12-03 10:57:07.671230 | controller | TASK [install_yamls : Set install_yamls default values] ************************
2025-12-03 10:57:07.671414 | controller | Wednesday 03 December 2025  10:57:07 +0000 (0:00:00.041)       0:06:57.422 ****
2025-12-03 10:57:07.730060 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:57:07.730239 | controller |
2025-12-03 10:57:07.730411 | controller | TASK [install_yamls : Show the env structure] **********************************
2025-12-03 10:57:07.730552 | controller | Wednesday 03 December 2025  10:57:07 +0000 (0:00:00.059)       0:06:57.482 ****
2025-12-03 10:57:07.864267 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:57:07.864555 | controller |
2025-12-03 10:57:07.864733 | controller | TASK [install_yamls : Show the env structure defaults] *************************
2025-12-03 10:57:07.864889 | controller | Wednesday 03 December 2025  10:57:07 +0000 (0:00:00.133)       0:06:57.616 ****
2025-12-03 10:57:07.928099 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:57:07.928292 | controller |
2025-12-03 10:57:07.928491 | controller | TASK [install_yamls : Generate make targets] ***********************************
2025-12-03 10:57:07.928646 | controller | Wednesday 03 December 2025  10:57:07 +0000 (0:00:00.063)       0:06:57.680 ****
2025-12-03 10:57:08.574961 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:57:08.636232 | controller |
2025-12-03 10:57:08.636277 | controller | TASK [install_yamls : Debug generate_make module] ******************************
2025-12-03 10:57:08.636285 | controller | Wednesday 03 December 2025  10:57:08 +0000 (0:00:00.646)       0:06:58.326 ****
2025-12-03 10:57:08.636296 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:57:08.636536 | controller |
2025-12-03 10:57:08.636553 | controller | TASK [install_yamls : Create the install_yamls parameters file] ****************
2025-12-03 10:57:08.636634 | controller | Wednesday 03 December 2025  10:57:08 +0000 (0:00:00.061)       0:06:58.388 ****
2025-12-03 10:57:09.620621 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:57:09.620687 | controller |
2025-12-03 10:57:09.620695 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] ***
2025-12-03 10:57:09.620715 | controller | Wednesday 03 December 2025  10:57:09 +0000 (0:00:00.983)       0:06:59.371 ****
2025-12-03 10:57:09.680840 | controller | skipping: [instance]
2025-12-03 10:57:09.680922 | controller |
2025-12-03 10:57:09.681054 | controller | TASK [discover_latest_image : Get latest image] ********************************
2025-12-03 10:57:09.681146 | controller | Wednesday 03 December 2025  10:57:09 +0000 (0:00:00.061)       0:06:59.432 ****
2025-12-03 10:57:10.478175 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:57:10.478264 | controller |
2025-12-03 10:57:10.478397 | controller | TASK [discover_latest_image : Export facts accordingly] ************************
2025-12-03 10:57:10.478496 | controller | Wednesday 03 December 2025  10:57:10 +0000 (0:00:00.796)       0:07:00.229 ****
2025-12-03 10:57:10.544044 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:57:10.544232 | controller |
2025-12-03 10:57:10.544367 | controller | TASK [cifmw_setup : Create artifacts with custom params] ***********************
2025-12-03 10:57:10.544388 | controller | Wednesday 03 December 2025  10:57:10 +0000 (0:00:00.066)       0:07:00.296 ****
2025-12-03 10:57:11.614875 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:57:11.614948 | controller |
2025-12-03 10:57:11.615069 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] *******
2025-12-03 10:57:11.615174 | controller | Wednesday 03 December 2025  10:57:11 +0000 (0:00:01.070)       0:07:01.366 ****
2025-12-03 10:57:12.169894 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:57:12.169976 | controller |
2025-12-03 10:57:12.170111 | controller | TASK [Configure CRC network if needed] *****************************************
2025-12-03 10:57:12.170222 | controller | Wednesday 03 December 2025  10:57:12 +0000 (0:00:00.555)       0:07:01.921 ****
2025-12-03 10:57:12.335410 | controller |
2025-12-03 10:57:12.335508 | controller | TASK [openshift_setup : Gather network.operator info] **************************
2025-12-03 10:57:12.335617 | controller | Wednesday 03 December 2025  10:57:12 +0000 (0:00:00.166)       0:07:02.087 ****
2025-12-03 10:57:13.592936 | controller | ok: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:57:13.593135 | controller |
2025-12-03 10:57:13.593176 | controller | TASK [openshift_setup : Patch network operator] ********************************
2025-12-03 10:57:13.593187 | controller | Wednesday 03 December 2025  10:57:13 +0000 (0:00:01.256)       0:07:03.344 ****
2025-12-03 10:57:14.828566 | controller | changed: [instance -> controller-0(controller-0.instance)]
2025-12-03 10:57:14.828829 | controller |
2025-12-03 10:57:14.828903 | controller | TASK [Ensure OCP cluster is stable] ********************************************
2025-12-03 10:57:14.867125 | controller | Wednesday 03 December 2025  10:57:14 +0000 (0:00:01.235)       0:07:04.579 ****
2025-12-03 10:57:14.867184 | controller | skipping: [instance]
2025-12-03 10:57:14.917941 | controller |
2025-12-03 10:57:14.917960 | controller | TASK [reproducer : Emulate CI job] *********************************************
2025-12-03 10:57:14.917967 | controller | Wednesday 03 December 2025  10:57:14 +0000 (0:00:00.039)       0:07:04.619 ****
2025-12-03 10:57:14.917976 | controller | skipping: [instance]
2025-12-03 10:57:14.962995 | controller |
2025-12-03 10:57:14.963019 | controller | TASK [reproducer : Currently reproducer vars] **********************************
2025-12-03 10:57:14.963050 | controller | Wednesday 03 December 2025  10:57:14 +0000 (0:00:00.050)       0:07:04.669 ****
2025-12-03 10:57:14.963063 | controller | fatal: [instance -> controller-0]: FAILED! =>
2025-12-03 10:57:14.963092 | controller |   msg: |-
2025-12-03 10:57:14.963099 | controller |     The task includes an option with an undefined variable. The error was: 'cifmw_deploy_reproducer_env' is undefined. 'cifmw_deploy_reproducer_env' is undefined
2025-12-03 10:57:14.963105 | controller |
2025-12-03 10:57:14.963110 | controller |     The error appears to be in '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/main.yml': line 366, column 7, but may
2025-12-03 10:57:14.963116 | controller |     be elsewhere in the file depending on the exact syntax problem.
2025-12-03 10:57:14.963122 | controller |
2025-12-03 10:57:14.963126 | controller |     The offending line appears to be:
2025-12-03 10:57:14.963134 | controller |
2025-12-03 10:57:14.976071 | controller |
2025-12-03 10:57:14.976089 | controller |         - name: Currently reproducer vars
2025-12-03 10:57:14.976096 | controller |           ^ here
2025-12-03 10:57:14.976106 | controller |
2025-12-03 10:57:15.218767 | controller | TASK [Create dnsmasq dir] ******************************************************
2025-12-03 10:57:15.218802 | controller | Wednesday 03 December 2025  10:57:14 +0000 (0:00:00.058)       0:07:04.727 ****
2025-12-03 10:57:15.218815 | controller | changed: [instance]
2025-12-03 10:57:15.488880 | controller |
2025-12-03 10:57:15.488937 | controller | TASK [Get journalctl in a file] ************************************************
2025-12-03 10:57:15.488947 | controller | Wednesday 03 December 2025  10:57:15 +0000 (0:00:00.242)       0:07:04.970 ****
2025-12-03 10:57:15.488959 | controller | changed: [instance]
2025-12-03 10:57:15.945836 | controller |
2025-12-03 10:57:15.945879 | controller | TASK [Dump journalctl output] **************************************************
2025-12-03 10:57:15.945888 | controller | Wednesday 03 December 2025  10:57:15 +0000 (0:00:00.269)       0:07:05.240 ****
2025-12-03 10:57:15.945901 | controller | changed: [instance]
2025-12-03 10:57:16.509123 | controller |
2025-12-03 10:57:16.509184 | controller | TASK [Copy all dnsmasq config] *************************************************
2025-12-03 10:57:16.509192 | controller | Wednesday 03 December 2025  10:57:15 +0000 (0:00:00.456)       0:07:05.696 ****
2025-12-03 10:57:16.509209 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2025-12-03 10:57:16.746598 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/)
2025-12-03 10:57:16.746636 | controller |
2025-12-03 10:57:16.746644 | controller | TASK [Create log directory] ****************************************************
2025-12-03 10:57:16.746650 | controller | Wednesday 03 December 2025  10:57:16 +0000 (0:00:00.563)       0:07:06.260 ****
2025-12-03 10:57:16.746664 | controller | changed: [instance]
2025-12-03 10:57:17.697716 | controller |
2025-12-03 10:57:17.697773 | controller | TASK [Sync logs from controller-0] *********************************************
2025-12-03 10:57:17.697782 | controller | Wednesday 03 December 2025  10:57:16 +0000 (0:00:00.237)       0:07:06.497 ****
2025-12-03 10:57:17.697801 | controller | changed: [instance]
2025-12-03 10:57:17.859492 | controller |
2025-12-03 10:57:17.859543 | controller | PLAY RECAP *********************************************************************
2025-12-03 10:57:17.859561 | controller | instance                   : ok=542  changed=210  unreachable=0    failed=1    skipped=224  rescued=0    ignored=0
2025-12-03 10:57:17.859567 | controller |
2025-12-03 10:57:17.859572 | controller | Wednesday 03 December 2025  10:57:17 +0000 (0:00:00.946)       0:07:07.444 ****
2025-12-03 10:57:17.859577 | controller | ===============================================================================
2025-12-03 10:57:17.859582 | controller | reproducer : Check package install status ------------------------------ 56.39s
2025-12-03 10:57:17.859588 | controller | ci_setup : Install needed packages ------------------------------------- 33.71s
2025-12-03 10:57:17.859593 | controller | libvirt_manager : Download base image ---------------------------------- 20.37s
2025-12-03 10:57:17.859597 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 19.84s
2025-12-03 10:57:17.859602 | controller | reproducer : Install collections on controller-0 ----------------------- 19.35s
2025-12-03 10:57:17.859607 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 11.13s
2025-12-03 10:57:17.859612 | controller | libvirt_manager : Install packages required for using KVM -------------- 10.83s
2025-12-03 10:57:17.859617 | controller | repo_setup : Initialize python venv and install requirements ------------ 8.03s
2025-12-03 10:57:17.859622 | controller | ci_setup : Install openshift client ------------------------------------- 6.16s
2025-12-03 10:57:17.859627 | controller | reproducer : Ensure we have all dependencies installed ------------------ 5.97s
2025-12-03 10:57:17.859632 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 5.28s
2025-12-03 10:57:17.859637 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.13s
2025-12-03 10:57:17.859642 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.54s
2025-12-03 10:57:17.859647 | controller | networking_mapper : Gather the facts ------------------------------------ 3.26s
2025-12-03 10:57:17.859659 | controller | sushy_emulator : Install required packages ------------------------------ 3.14s
2025-12-03 10:57:17.859692 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.00s
2025-12-03 10:57:17.859697 | controller | ci_setup : Manage directories ------------------------------------------- 2.72s
2025-12-03 10:57:17.859702 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.24s
2025-12-03 10:57:17.859707 | controller | reproducer : Sync local repositories to other hosts if present ---------- 2.11s
2025-12-03 10:57:17.859712 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s
2025-12-03 10:57:17.859727 | controller | CRITICAL Ansible return code was 2, command was: ['ansible-playbook', '--inventory', '/home/zuul/.cache/molecule/reproducer/crc_layout/inventory', '--skip-tags', 'molecule-notest,notest', '/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/crc_layout/converge.yml']
2025-12-03 10:57:17.859923 | controller | WARNING  An error occurred during the test sequence action: 'converge'. Cleaning up.
2025-12-03 10:57:17.870201 | controller | INFO     Running crc_layout > cleanup
2025-12-03 10:57:17.870690 | controller | WARNING  Skipping, cleanup playbook not configured.
2025-12-03 10:57:17.877947 | controller | INFO     Running crc_layout > destroy
2025-12-03 10:57:17.878241 | controller | WARNING  Skipping, instances are delegated.
2025-12-03 10:57:17.878587 | controller | INFO     Pruning extra files from scenario ephemeral directory
2025-12-03 10:57:17.880369 | controller | INFO     Writing /tmp/report.html report.
2025-12-03 10:57:18.370201 | [controller] Waiting on logger
2025-12-03 10:57:23.506553 | [controller] Waiting on logger
2025-12-03 10:57:33.938530 | [controller] Waiting on logger
2025-12-03 10:57:44.370636 | [controller] Waiting on logger
2025-12-03 10:57:48.003820 | [Zuul] Log Stream did not terminate
2025-12-03 10:57:48.004091 | controller | ERROR
2025-12-03 10:57:48.004189 | controller | {
2025-12-03 10:57:48.004223 | controller |   "delta": "0:08:50.403577",
2025-12-03 10:57:48.004247 | controller |   "end": "2025-12-03 10:57:17.960070",
2025-12-03 10:57:48.004267 | controller |   "msg": "non-zero return code",
2025-12-03 10:57:48.004286 | controller |   "rc": 1,
2025-12-03 10:57:48.004304 | controller |   "start": "2025-12-03 10:48:27.556493"
2025-12-03 10:57:48.004322 | controller | }
failure
2025-12-03 10:57:48.055099 | 
2025-12-03 10:57:48.055159 | PLAY RECAP
2025-12-03 10:57:48.055203 | controller | ok: 3 changed: 0 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0
2025-12-03 10:57:48.055231 | 
2025-12-03 10:57:48.113474 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2025-12-03 10:57:48.114238 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2025-12-03 10:57:48.625688 | 
2025-12-03 10:57:48.625790 | PLAY [Run ci/playbooks/collect-logs.yml]
2025-12-03 10:57:48.646202 | 
2025-12-03 10:57:48.646272 | TASK [Filter out host if needed]
2025-12-03 10:57:48.654533 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller
2025-12-03 10:57:48.659103 | 
2025-12-03 10:57:48.659170 | TASK [Ensure file is present]
2025-12-03 10:57:49.096047 | controller | ok
2025-12-03 10:57:49.101432 | 
2025-12-03 10:57:49.101497 | TASK [Manage molecule report file]
2025-12-03 10:57:49.125875 | [controller] Waiting on logger
2025-12-03 10:57:58.487983 | [controller] Waiting on logger
2025-12-03 10:58:08.882863 | [controller] Waiting on logger
2025-12-03 10:58:19.315008 | [controller] Waiting on logger
2025-12-03 10:58:19.507448 | [Zuul] Log Stream did not terminate
2025-12-03 10:58:19.507607 | controller | changed
2025-12-03 10:58:19.512248 | 
2025-12-03 10:58:19.512305 | TASK [Check if we get ci-framework-data basedir]
2025-12-03 10:58:19.803719 | controller | ok
2025-12-03 10:58:19.808843 | 
2025-12-03 10:58:19.808900 | TASK [Create ci-framework-data log directory for zuul]
2025-12-03 10:58:20.192345 | controller | changed
2025-12-03 10:58:20.197589 | 
2025-12-03 10:58:20.197649 | TASK [Copy ci-framework interesting files]
2025-12-03 10:58:25.222100 | controller | changed
2025-12-03 10:58:25.227310 | 
2025-12-03 10:58:25.227374 | TASK [Get SELinux listing]
2025-12-03 10:58:26.290503 | [controller] Waiting on logger
2025-12-03 10:58:35.634659 | [controller] Waiting on logger
2025-12-03 10:58:46.066398 | [controller] Waiting on logger
2025-12-03 10:58:55.447592 | [controller] Waiting on logger
2025-12-03 10:58:55.547662 | [Zuul] Log Stream did not terminate
2025-12-03 10:58:55.547927 | controller | changed
2025-12-03 10:58:55.553441 | 
2025-12-03 10:58:55.553505 | TASK [Generate log index]
2025-12-03 10:58:56.800291 | controller | changed
2025-12-03 10:58:56.804886 | 
2025-12-03 10:58:56.804958 | TASK [Get some env related data]
2025-12-03 10:58:59.890668 | [controller] Waiting on logger
2025-12-03 10:59:13.074539 | [controller] Waiting on logger
2025-12-03 10:59:19.602570 | [controller] Waiting on logger
2025-12-03 10:59:28.042848 | [Zuul] Log Stream did not terminate
2025-12-03 10:59:28.043072 | controller | changed
2025-12-03 10:59:28.048280 | 
2025-12-03 10:59:28.048343 | TASK [Generate list of logs to collect in home directory]
2025-12-03 10:59:28.459087 | controller | ok: All paths examined
2025-12-03 10:59:28.464350 | 
2025-12-03 10:59:28.464411 | LOOP [Copy logs from home directory]
2025-12-03 10:59:29.177666 | controller | changed:
2025-12-03 10:59:29.177861 | controller | {
2025-12-03 10:59:29.177891 | controller |   "atime": 1743544925.4788878,
2025-12-03 10:59:29.177938 | controller |   "ctime": 1743545329.1409318,
2025-12-03 10:59:29.177962 | controller |   "dev": 64513,
2025-12-03 10:59:29.177996 | controller |   "gid": 1000,
2025-12-03 10:59:29.178013 | controller |   "gr_name": "zuul",
2025-12-03 10:59:29.178029 | controller |   "inode": 4518807,
2025-12-03 10:59:29.178044 | controller |   "isblk": false,
2025-12-03 10:59:29.178064 | controller |   "ischr": false,
2025-12-03 10:59:29.178087 | controller |   "isdir": false,
2025-12-03 10:59:29.178102 | controller |   "isfifo": false,
2025-12-03 10:59:29.178117 | controller |   "isgid": false,
2025-12-03 10:59:29.178131 | controller |   "islnk": false,
2025-12-03 10:59:29.178145 | controller |   "isreg": true,
2025-12-03 10:59:29.178158 | controller |   "issock": false,
2025-12-03 10:59:29.178171 | controller |   "isuid": false,
2025-12-03 10:59:29.178188 | controller |   "mode": "0644",
2025-12-03 10:59:29.178202 | controller |   "mtime": 1743545329.1409318,
2025-12-03 10:59:29.178221 | controller |   "nlink": 1,
2025-12-03 10:59:29.178236 | controller |   "path": "/home/zuul/crc-setup.log",
2025-12-03 10:59:29.178250 | controller |   "pw_name": "zuul",
2025-12-03 10:59:29.178263 | controller |   "rgrp": true,
2025-12-03 10:59:29.178275 | controller |   "roth": true,
2025-12-03 10:59:29.178288 | controller |   "rusr": true,
2025-12-03 10:59:29.178301 | controller |   "size": 4108,
2025-12-03 10:59:29.178315 | controller |   "uid": 1000,
2025-12-03 10:59:29.178327 | controller |   "wgrp": false,
2025-12-03 10:59:29.178340 | controller |   "woth": false,
2025-12-03 10:59:29.178353 | controller |   "wusr": true,
2025-12-03 10:59:29.178365 | controller |   "xgrp": false,
2025-12-03 10:59:29.178378 | controller |   "xoth": false,
2025-12-03 10:59:29.178391 | controller |   "xusr": false
2025-12-03 10:59:29.178404 | controller | }
2025-12-03 10:59:29.822500 | controller | changed:
2025-12-03 10:59:29.822554 | controller | {
2025-12-03 10:59:29.822580 | controller |   "atime": 1743545331.0429637,
2025-12-03 10:59:29.822599 | controller |   "ctime": 1743545842.0111232,
2025-12-03 10:59:29.822616 | controller |   "dev": 64513,
2025-12-03 10:59:29.822633 | controller |   "gid": 1000,
2025-12-03 10:59:29.822650 | controller |   "gr_name": "zuul",
2025-12-03 10:59:29.822666 | controller |   "inode": 4194437,
2025-12-03 10:59:29.822681 | controller |   "isblk": false,
2025-12-03 10:59:29.822695 | controller |   "ischr": false,
2025-12-03 10:59:29.822709 | controller |   "isdir": false,
2025-12-03 10:59:29.822723 | controller |   "isfifo": false,
2025-12-03 10:59:29.822737 | controller |   "isgid": false,
2025-12-03 10:59:29.822750 | controller |   "islnk": false,
2025-12-03 10:59:29.822764 | controller |   "isreg": true,
2025-12-03 10:59:29.822777 | controller |   "issock": false,
2025-12-03 10:59:29.822791 | controller |   "isuid": false,
2025-12-03 10:59:29.822805 | controller |   "mode": "0644",
2025-12-03 10:59:29.822818 | controller |   "mtime": 1743545842.0111232,
2025-12-03 10:59:29.822831 | controller |   "nlink": 1,
2025-12-03 10:59:29.822844 | controller |   "path": "/home/zuul/crc-start.log",
2025-12-03 10:59:29.822857 | controller |   "pw_name": "zuul",
2025-12-03 10:59:29.822870 | controller |   "rgrp": true,
2025-12-03 10:59:29.822882 | controller |   "roth": true,
2025-12-03 10:59:29.822894 | controller |   "rusr": true,
2025-12-03 10:59:29.822921 | controller |   "size": 4023,
2025-12-03 10:59:29.822945 | controller |   "uid": 1000,
2025-12-03 10:59:29.822962 | controller |   "wgrp": false,
2025-12-03 10:59:29.822988 | controller |   "woth": false,
2025-12-03 10:59:29.823003 | controller |   "wusr": true,
2025-12-03 10:59:29.823016 | controller |   "xgrp": false,
2025-12-03 10:59:29.823029 | controller |   "xoth": false,
2025-12-03 10:59:29.823041 | controller |   "xusr": false
2025-12-03 10:59:29.823054 | controller | }
2025-12-03 10:59:30.453270 | controller | changed:
2025-12-03 10:59:30.453318 | controller | {
2025-12-03 10:59:30.453341 | controller |   "atime": 1764758890.0149953,
2025-12-03 10:59:30.453357 | controller |   "ctime": 1764758905.2840242,
2025-12-03 10:59:30.453372 | controller |   "dev": 64513,
2025-12-03 10:59:30.453387 | controller |   "gid": 1000,
2025-12-03 10:59:30.453400 | controller |   "gr_name": "zuul",
2025-12-03 10:59:30.453414 | controller |   "inode": 4524403,
2025-12-03 10:59:30.453427 | controller |   "isblk": false,
2025-12-03 10:59:30.453441 | controller |   "ischr": false,
2025-12-03 10:59:30.453454 | controller |   "isdir": false,
2025-12-03 10:59:30.453468 | controller |   "isfifo": false,
2025-12-03 10:59:30.453484 | controller |   "isgid": false,
2025-12-03 10:59:30.453498 | controller |   "islnk": false,
2025-12-03 10:59:30.453511 | controller |   "isreg": true,
2025-12-03 10:59:30.453523 | controller |   "issock": false,
2025-12-03 10:59:30.453535 | controller |   "isuid": false,
2025-12-03 10:59:30.453547 | controller |   "mode": "0644",
2025-12-03 10:59:30.453559 | controller |   "mtime": 1764758905.2840242,
2025-12-03 10:59:30.453571 | controller |   "nlink": 1,
2025-12-03 10:59:30.453587 | controller |   "path": "/home/zuul/ansible.log",
2025-12-03 10:59:30.453600 | controller |   "pw_name": "zuul",
2025-12-03 10:59:30.453613 | controller |   "rgrp": true,
2025-12-03 10:59:30.453625 | controller |   "roth": true,
2025-12-03 10:59:30.453637 | controller |   "rusr": true,
2025-12-03 10:59:30.453649 | controller |   "size": 6749,
2025-12-03 10:59:30.453661 | controller |   "uid": 1000,
2025-12-03 10:59:30.453673 | controller |   "wgrp": false,
2025-12-03 10:59:30.453686 | controller |   "woth": false,
2025-12-03 10:59:30.453698 | controller |   "wusr": true,
2025-12-03 10:59:30.453710 | controller |   "xgrp": false,
2025-12-03 10:59:30.453722 | controller |   "xoth": false,
2025-12-03 10:59:30.453733 | controller |   "xusr": false
2025-12-03 10:59:30.453745 | controller | }
2025-12-03 10:59:30.466397 | 
2025-12-03 10:59:30.466499 | TASK [Copy crio stats log file]
2025-12-03 10:59:30.479847 | controller | skipping: Conditional result was False
2025-12-03 10:59:30.484614 | 
2025-12-03 10:59:30.484673 | TASK [Get SELinux related data]
2025-12-03 10:59:30.503491 | [controller] Waiting on logger
2025-12-03 10:59:35.794604 | [controller] Waiting on logger
2025-12-03 10:59:44.370659 | [controller] Waiting on logger
2025-12-03 10:59:51.653781 | controller | ERROR
2025-12-03 10:59:51.653961 | controller | {
2025-12-03 10:59:51.654006 | controller |   "delta": "0:00:00.010367",
2025-12-03 10:59:51.654028 | controller |   "end": "2025-12-03 10:59:30.776159",
2025-12-03 10:59:51.654045 | controller |   "msg": "non-zero return code",
2025-12-03 10:59:51.654060 | controller |   "rc": 1,
2025-12-03 10:59:51.654075 | controller |   "start": "2025-12-03 10:59:30.765792"
2025-12-03 10:59:51.654089 | controller | }
2025-12-03 10:59:51.654108 | controller | ERROR: Ignoring Errors
2025-12-03 10:59:51.658764 | 
2025-12-03 10:59:51.658827 | TASK [Create system configuration directory]
2025-12-03 10:59:51.931109 | controller | changed
2025-12-03 10:59:51.935372 | 
2025-12-03 10:59:51.935432 | TASK [Get some of the system configurations]
2025-12-03 10:59:55.058683 | [controller] Waiting on logger
2025-12-03 10:59:58.514456 | [controller] Waiting on logger
2025-12-03 11:00:07.538547 | [controller] Waiting on logger
2025-12-03 11:00:17.970520 | [controller] Waiting on logger
2025-12-03 11:00:22.245332 | [Zuul] Log Stream did not terminate
2025-12-03 11:00:22.245625 | controller | changed
2025-12-03 11:00:22.251002 | 
2025-12-03 11:00:22.251064 | TASK [Copy generated documentation if available]
2025-12-03 11:00:22.264105 | controller | skipping: Conditional result was False
2025-12-03 11:00:22.269182 | 
2025-12-03 11:00:22.269245 | TASK [Copy generated AsciiDoc documentation if available]
2025-12-03 11:00:22.282153 | controller | skipping: Conditional result was False
2025-12-03 11:00:22.286807 | 
2025-12-03 11:00:22.286864 | TASK [Compress logs bigger than 2MB]
2025-12-03 11:00:25.394654 | [controller] Waiting on logger
2025-12-03 11:00:35.826598 | [controller] Waiting on logger
2025-12-03 11:00:46.258735 | [controller] Waiting on logger
2025-12-03 11:00:52.637536 | [Zuul] Log Stream did not terminate
2025-12-03 11:00:52.637785 | controller | changed
2025-12-03 11:00:52.643113 | 
2025-12-03 11:00:52.643185 | TASK [Copy files from workspace on node]
2025-12-03 11:00:52.661337 | controller | ok
2025-12-03 11:00:52.682275 | 
2025-12-03 11:00:52.682340 | TASK [fetch-output : Set log path for multiple nodes]
2025-12-03 11:00:52.695426 | controller | skipping: Conditional result was False
2025-12-03 11:00:52.700421 | 
2025-12-03 11:00:52.700485 | TASK [fetch-output : Set log path for single node]
2025-12-03 11:00:52.728008 | controller | ok
2025-12-03 11:00:52.732771 | 
2025-12-03 11:00:52.732833 | LOOP [fetch-output : Ensure local output dirs]
2025-12-03 11:00:52.914194 | controller -> localhost | ok: "/var/lib/zuul/builds/448b5a8453c048dc8ef3fd38808b6ca9/work/logs"
2025-12-03 11:00:52.914434 | controller -> localhost | changed: All items complete
2025-12-03 11:00:52.914463 | 
2025-12-03 11:00:53.078079 | controller -> localhost | changed: "/var/lib/zuul/builds/448b5a8453c048dc8ef3fd38808b6ca9/work/artifacts"
2025-12-03 11:00:53.240356 | controller -> localhost | changed: "/var/lib/zuul/builds/448b5a8453c048dc8ef3fd38808b6ca9/work/docs"
2025-12-03 11:00:53.250158 | 
2025-12-03 11:00:53.250245 | LOOP [fetch-output : Collect logs, artifacts and docs]
2025-12-03 11:00:53.926458 | controller | changed:
2025-12-03 11:00:53.926606 | controller | .d..t...... ./
2025-12-03 11:00:53.926634 | controller | >f+++++++++ README.html
2025-12-03 11:00:53.926654 | controller | >f+++++++++ ansible-execution.log
2025-12-03 11:00:53.926672 | controller | >f+++++++++ ansible.log
2025-12-03 11:00:53.926687 | controller | >f+++++++++ crc-setup.log
2025-12-03 11:00:53.926703 | controller | >f+++++++++ crc-start.log
2025-12-03 11:00:53.926717 | controller | >f+++++++++ dmesg.log
2025-12-03 11:00:53.926731 | controller | >f+++++++++ installed-pkgs.log
2025-12-03 11:00:53.926746 | controller | >f+++++++++ python.log
2025-12-03 11:00:53.926760 | controller | >f+++++++++ registries.conf
2025-12-03 11:00:53.926773 | controller | >f+++++++++ report.html
2025-12-03 11:00:53.926787 | controller | >f+++++++++ selinux-denials.log
2025-12-03 11:00:53.926801 | controller | >f+++++++++ selinux-listing.log
2025-12-03 11:00:53.926814 | controller | cd+++++++++ ci-framework-data/
2025-12-03 11:00:53.926827 | controller | cd+++++++++ ci-framework-data/artifacts/
2025-12-03 11:00:53.926840 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml
2025-12-03 11:00:53.926854 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/
2025-12-03 11:00:53.926868 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf
2025-12-03 11:00:53.926883 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf
2025-12-03 11:00:53.926898 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf
2025-12-03 11:00:53.926930 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf
2025-12-03 11:00:53.926948 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf
2025-12-03 11:00:53.926963 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log
2025-12-03 11:00:53.926976 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf
2025-12-03 11:00:53.926989 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf
2025-12-03 11:00:53.927014 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf
2025-12-03 11:00:53.927027 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf
2025-12-03 11:00:53.927039 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/
2025-12-03 11:00:53.927052 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:17:fc:59
2025-12-03 11:00:53.927065 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:5c:a8:7e
2025-12-03 11:00:53.927078 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:89:90:d0
2025-12-03 11:00:53.927091 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:7e:31:96
2025-12-03 11:00:53.927104 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:f7:f1:6d
2025-12-03 11:00:53.927116 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:55:33:0d
2025-12-03 11:00:53.927128 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/
2025-12-03 11:00:53.927141 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml
2025-12-03 11:00:53.927153 | controller | cd+++++++++ ci-framework-data/logs/
2025-12-03 11:00:53.927165 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log
2025-12-03 11:00:53.927177 | controller | cd+++++++++ ci-framework-data/logs/controller-0/
2025-12-03 11:00:53.927194 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log
2025-12-03 11:00:53.927207 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/
2025-12-03 11:00:53.927220 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/
2025-12-03 11:00:53.927232 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml
2025-12-03 11:00:53.927245 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml
2025-12-03 11:00:53.927258 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/
2025-12-03 11:00:53.927273 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/
2025-12-03 11:00:53.927288 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/
2025-12-03 11:00:53.927301 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/
2025-12-03 11:00:53.927314 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml
2025-12-03 11:00:53.927327 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml
2025-12-03 11:00:53.927339 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/
2025-12-03 11:00:53.927352 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo
2025-12-03 11:00:53.927366 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo
2025-12-03 11:00:53.927379 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5
2025-12-03 11:00:53.927392 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo
2025-12-03 11:00:53.927405 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo
2025-12-03 11:00:53.927417 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo
2025-12-03 11:00:53.927430 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo
2025-12-03 11:00:53.927442 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/
2025-12-03 11:00:53.927454 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/
2025-12-03 11:00:53.927467 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd
2025-12-03 11:00:53.927479 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf
2025-12-03 11:00:53.927492 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts
2025-12-03 11:00:53.927504 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/
2025-12-03 11:00:53.927517 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/
2025-12-03 11:00:53.927529 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml
2025-12-03 11:00:53.927541 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml
2025-12-03 11:00:53.927554 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml
2025-12-03 11:00:53.927569 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml
2025-12-03 11:00:53.927583 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/
2025-12-03 11:00:53.927596 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt
2025-12-03 11:00:53.927609 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/
2025-12-03 11:00:53.927622 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/
2025-12-03 11:00:53.927636 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd
2025-12-03 11:00:53.927650 | controller | cd+++++++++ registries.conf.d/
2025-12-03 11:00:53.927663 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf
2025-12-03 11:00:53.927676 | controller | cd+++++++++ system-config/
2025-12-03 11:00:53.927689 | controller | cd+++++++++ system-config/libvirt/
2025-12-03 11:00:53.927701 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf
2025-12-03 11:00:53.927715 | controller | >f+++++++++ system-config/libvirt/libvirt.conf
2025-12-03 11:00:53.927728 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf
2025-12-03 11:00:53.927741 | controller | >f+++++++++ system-config/libvirt/network.conf
2025-12-03 11:00:53.927753 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf
2025-12-03 11:00:53.927765 | controller | >f+++++++++ system-config/libvirt/qemu.conf
2025-12-03 11:00:53.927778 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf
2025-12-03 11:00:53.927790 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf
2025-12-03 11:00:53.927803 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf
2025-12-03 11:00:53.927815 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf
2025-12-03 11:00:53.927827 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf
2025-12-03 11:00:53.927839 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf
2025-12-03 11:00:53.927851 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf
2025-12-03 11:00:53.927864 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf
2025-12-03 11:00:53.927876 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf
2025-12-03 11:00:53.927888 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf
2025-12-03 11:00:54.394062 | controller | changed: .d..t...... ./
2025-12-03 11:00:54.836351 | controller | changed: .d..t...... ./
2025-12-03 11:00:54.854626 | 
2025-12-03 11:00:54.854728 | TASK [Return artifact to Zuul]
2025-12-03 11:00:54.882972 | controller | ok
2025-12-03 11:00:54.899981 | 
2025-12-03 11:00:54.900043 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host]
2025-12-03 11:00:54.900135 | 
2025-12-03 11:00:54.900162 | PLAY RECAP
2025-12-03 11:00:54.900198 | controller | ok: 18 changed: 13 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1
2025-12-03 11:00:54.900218 | 
2025-12-03 11:00:54.970616 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2025-12-03 11:00:54.971493 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2025-12-03 11:00:55.451072 | 
2025-12-03 11:00:55.451167 | PLAY [all]
2025-12-03 11:00:55.469139 | 
2025-12-03 11:00:55.469211 | TASK [include_role : fetch-output]
2025-12-03 11:00:55.497743 | controller | ok
2025-12-03 11:00:55.514180 | 
2025-12-03 11:00:55.514260 | TASK [fetch-output : Set log path for multiple nodes]
2025-12-03 11:00:55.558384 | controller | skipping: Conditional result was False
2025-12-03 11:00:55.563643 | 
2025-12-03 11:00:55.563710 | TASK [fetch-output : Set log path for single node]
2025-12-03 11:00:55.591825 | controller | ok
2025-12-03 11:00:55.596896 | 
2025-12-03 11:00:55.596980 | LOOP [fetch-output : Ensure local output dirs]
2025-12-03 11:00:55.910197 | controller -> localhost | ok: "/var/lib/zuul/builds/448b5a8453c048dc8ef3fd38808b6ca9/work/logs"
2025-12-03 11:00:56.087410 | controller -> localhost | ok: "/var/lib/zuul/builds/448b5a8453c048dc8ef3fd38808b6ca9/work/artifacts"
2025-12-03 11:00:56.261444 | controller -> localhost | ok: "/var/lib/zuul/builds/448b5a8453c048dc8ef3fd38808b6ca9/work/docs"
2025-12-03 11:00:56.276308 | 
2025-12-03 11:00:56.276408 | LOOP [fetch-output : Collect logs, artifacts and docs]
2025-12-03 11:00:56.888009 | controller | ok
2025-12-03 11:00:56.888257 | controller | ok: All items complete
2025-12-03 11:00:56.888293 | 
2025-12-03 11:00:57.362373 | controller | ok
2025-12-03 11:00:57.832326 | controller | ok
2025-12-03 11:00:57.851248 | 
2025-12-03 11:00:57.851345 | TASK [include_role : fetch-output-openshift]
2025-12-03 11:00:57.864769 | controller | skipping: Conditional result was False
2025-12-03 11:00:57.869906 | 
2025-12-03 11:00:57.869984 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2025-12-03 11:00:58.175876 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.006203
2025-12-03 11:00:58.352183 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.005669
2025-12-03 11:00:58.383598 | 
2025-12-03 11:00:58.383678 | PLAY [all]
2025-12-03 11:00:58.396279 | 
2025-12-03 11:00:58.396342 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2025-12-03 11:00:58.872299 | controller | changed
2025-12-03 11:00:58.891755 | 
2025-12-03 11:00:58.891810 | PLAY RECAP
2025-12-03 11:00:58.891853 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0
2025-12-03 11:00:58.891874 | 
2025-12-03 11:00:58.956383 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2025-12-03 11:00:58.957135 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master]
2025-12-03 11:00:59.458955 | 
2025-12-03 11:00:59.459081 | PLAY [localhost]
2025-12-03 11:00:59.474743 | 
2025-12-03 11:00:59.474813 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2025-12-03 11:00:59.755420 | localhost | changed
2025-12-03 11:00:59.759882 | 
2025-12-03 11:00:59.759989 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2025-12-03 11:00:59.778222 | localhost | ok
2025-12-03 11:00:59.785865 | 
2025-12-03 11:00:59.785961 | TASK [add-fileserver : Create SSH private key tempfile]
2025-12-03 11:01:00.065906 | localhost | changed
2025-12-03 11:01:00.071311 | 
2025-12-03 11:01:00.071382 | TASK [add-fileserver : Create SSH private key from secret]
2025-12-03 11:01:00.574186 | localhost | changed
2025-12-03 11:01:00.578451 | 
2025-12-03 11:01:00.578511 | TASK [add-fileserver : Add fileserver ssh key]
2025-12-03 11:01:00.878932 | localhost | Identity added: /var/lib/zuul/builds/448b5a8453c048dc8ef3fd38808b6ca9/work/tmp/ansible.z9_mmfqa (/var/lib/zuul/builds/448b5a8453c048dc8ef3fd38808b6ca9/work/tmp/ansible.z9_mmfqa)
2025-12-03 11:01:00.879080 | localhost | ok: Runtime: 0:00:00.006134
2025-12-03 11:01:00.883008 | 
2025-12-03 11:01:00.883080 | TASK [add-fileserver : Remove SSH private key from disk]
2025-12-03 11:01:01.082362 | localhost | ok: Runtime: 0:00:00.003824
2025-12-03 11:01:01.086722 | 
2025-12-03 11:01:01.086789 | TASK [add-fileserver : Add fileserver to inventory]
2025-12-03 11:01:01.134283 | localhost | changed
2025-12-03 11:01:01.138979 | 
2025-12-03 11:01:01.139056 | TASK [add-fileserver : Add fileserver server to known hosts]
2025-12-03 11:01:01.439579 | localhost | changed
2025-12-03 11:01:01.457262 | 
2025-12-03 11:01:01.457315 | PLAY [localhost]
2025-12-03 11:01:01.467495 | 
2025-12-03 11:01:01.467552 | TASK [Generate bulk log download script]
2025-12-03 11:01:01.485213 | localhost | ok
2025-12-03 11:01:01.495670 | 
2025-12-03 11:01:01.495732 | TASK [local-log-download : Check API endpoint is defined]
2025-12-03 11:01:01.523024 | localhost | ok: All assertions passed
2025-12-03 11:01:01.527259 | 
2025-12-03 11:01:01.527324 | TASK [local-log-download : Create download script]
2025-12-03 11:01:01.854956 | localhost -> localhost | changed
2025-12-03 11:01:01.862368 | 
2025-12-03 11:01:01.862428 | TASK [Register quick-download link]
2025-12-03 11:01:01.878505 | localhost | ok
2025-12-03 11:01:01.911626 | 
2025-12-03 11:01:01.911694 | PLAY [logserver.rdoproject.org]
2025-12-03 11:01:01.920720 | 
2025-12-03 11:01:01.920780 | TASK [Set zuul-log-path fact]
2025-12-03 11:01:01.936404 | logserver.rdoproject.org | ok
2025-12-03 11:01:01.944776 | 
2025-12-03 11:01:01.944840 | TASK [set-zuul-log-path-fact : Set log path for a build]
2025-12-03 11:01:01.970504 | logserver.rdoproject.org | ok
2025-12-03 11:01:01.975193 | 
2025-12-03 11:01:01.975250 | TASK [upload-logs : Create log directories]
2025-12-03 11:01:03.646431 | logserver.rdoproject.org | changed
2025-12-03 11:01:03.649499 | 
2025-12-03 11:01:03.649565 | TASK [upload-logs : Ensure logs are readable before uploading]
2025-12-03 11:01:03.865224 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.005114
2025-12-03 11:01:03.869576 | 
2025-12-03 11:01:03.869643 | TASK [upload-logs : Upload logs to log server]
2025-12-03 11:01:05.378796 | logserver.rdoproject.org | Output suppressed because no_log was given
2025-12-03 11:01:05.381423 | 
2025-12-03 11:01:05.381483 | LOOP [upload-logs : Compress console log and json output]
2025-12-03 11:01:05.415132 | logserver.rdoproject.org | skipping: Conditional result was False
2025-12-03 11:01:05.422520 | logserver.rdoproject.org | skipping: Conditional result was False
2025-12-03 11:01:05.429089 | 
2025-12-03 11:01:05.429186 | LOOP [upload-logs : Upload compressed console log and json output]
2025-12-03 11:01:05.459500 | logserver.rdoproject.org | skipping: Conditional result was False
2025-12-03 11:01:05.459681 | 
2025-12-03 11:01:05.462765 | logserver.rdoproject.org | skipping: Conditional result was False
2025-12-03 11:01:05.475424 | 
2025-12-03 11:01:05.475514 | LOOP [upload-logs : Upload console log and json output]