2026-03-18 16:25:26.333732 | Job console starting...
2026-03-18 16:25:26.541355 | Updating repositories
2026-03-18 16:25:27.270825 | Preparing job workspace
2026-03-18 16:25:33.958532 | Running Ansible setup...
2026-03-18 16:25:37.334772 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-03-18 16:25:37.815876 | 
2026-03-18 16:25:37.815968 | PLAY [localhost]
2026-03-18 16:25:37.823652 | 
2026-03-18 16:25:37.823721 | TASK [Gathering Facts]
2026-03-18 16:25:38.617968 | localhost | ok
2026-03-18 16:25:38.630209 | 
2026-03-18 16:25:38.630308 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-18 16:25:38.927123 | localhost -> localhost | changed
2026-03-18 16:25:38.932492 | 
2026-03-18 16:25:38.932575 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-18 16:25:39.563385 | localhost -> localhost | changed
2026-03-18 16:25:39.571534 | 
2026-03-18 16:25:39.571595 | TASK [Setup log path fact]
2026-03-18 16:25:39.589139 | localhost | ok
2026-03-18 16:25:39.600439 | 
2026-03-18 16:25:39.600509 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-18 16:25:39.627339 | localhost | ok
2026-03-18 16:25:39.634545 | 
2026-03-18 16:25:39.634610 | TASK [emit-job-header : Print job information]
2026-03-18 16:25:39.655909 | # Job Information
2026-03-18 16:25:39.656022 | Ansible Version: 2.15.12
2026-03-18 16:25:39.656050 | Job: cifmw-molecule-reproducer
2026-03-18 16:25:39.656070 | Pipeline: github-check
2026-03-18 16:25:39.656089 | Executor: ibm-bm3-ze.softwarefactory-project.io
2026-03-18 16:25:39.656106 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3739
2026-03-18 16:25:39.656125 | Log URL (when completed): https://logserver.rdoproject.org/b91/rdoproject.org/b91f0e2af46b42aa97c0c1f37d76ea08/
2026-03-18 16:25:39.656142 | Event ID: ead58400-22e6-11f1-950a-224cef9ae5c3
2026-03-18 16:25:39.659467 | 
2026-03-18 16:25:39.659524 | LOOP [emit-job-header : Print node information]
2026-03-18 16:25:39.739923 | localhost | ok:
2026-03-18 16:25:39.740107 | localhost | # Node Information
2026-03-18 16:25:39.740135 | localhost | Inventory Hostname: controller
2026-03-18 16:25:39.740158 | localhost | Hostname: np0005651014
2026-03-18 16:25:39.740177 | localhost | Username: zuul
2026-03-18 16:25:39.740196 | localhost | Distro: CentOS 9
2026-03-18 16:25:39.740213 | localhost | Provider: ibm-bm3-nodepool
2026-03-18 16:25:39.740229 | localhost | Region: regionOne
2026-03-18 16:25:39.740245 | localhost | Label: centos-9-stream-crc-2-48-0-xxl-ibm
2026-03-18 16:25:39.740274 | localhost | Product Name: OpenStack Compute
2026-03-18 16:25:39.740300 | localhost | Interface IP: 192.168.25.212
2026-03-18 16:25:39.761932 | 
2026-03-18 16:25:39.761994 | PLAY [all]
2026-03-18 16:25:39.768047 | 
2026-03-18 16:25:39.768104 | TASK [Gather network facts]
2026-03-18 16:25:40.201842 | controller | ok
2026-03-18 16:25:40.215458 | 
2026-03-18 16:25:40.215519 | TASK [include_role : start-zuul-console]
2026-03-18 16:25:40.233595 | controller | ok
2026-03-18 16:25:40.244328 | 
2026-03-18 16:25:40.244395 | TASK [start-zuul-console : Start zuul_console daemon.]
2026-03-18 16:25:40.606552 | controller | ok
2026-03-18 16:25:40.615511 | 
2026-03-18 16:25:40.615577 | TASK [include_role : add-build-sshkey]
2026-03-18 16:25:40.633076 | controller | ok
2026-03-18 16:25:40.644863 | 
2026-03-18 16:25:40.644927 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-18 16:25:40.820054 | controller -> localhost | ok
2026-03-18 16:25:40.825180 | 
2026-03-18 16:25:40.825241 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-18 16:25:40.843378 | controller | ok
2026-03-18 16:25:40.854505 | controller | included: /var/lib/zuul/builds/b91f0e2af46b42aa97c0c1f37d76ea08/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-18 16:25:40.859495 | 
2026-03-18 16:25:40.859552 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-18 16:25:41.311995 | controller -> localhost | Generating public/private rsa key pair.
2026-03-18 16:25:41.312181 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/b91f0e2af46b42aa97c0c1f37d76ea08/work/b91f0e2af46b42aa97c0c1f37d76ea08_id_rsa.
2026-03-18 16:25:41.312212 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/b91f0e2af46b42aa97c0c1f37d76ea08/work/b91f0e2af46b42aa97c0c1f37d76ea08_id_rsa.pub.
2026-03-18 16:25:41.312235 | controller -> localhost | The key fingerprint is:
2026-03-18 16:25:41.312256 | controller -> localhost | SHA256:PQBbeEH7I10W4nTpjQRmwXzKZ5ulXfomAZ34EsKBvO4 zuul-build-sshkey
2026-03-18 16:25:41.312298 | controller -> localhost | The key's randomart image is:
2026-03-18 16:25:41.312319 | controller -> localhost | +---[RSA 3072]----+
2026-03-18 16:25:41.312337 | controller -> localhost | |      .++=Boo.   |
2026-03-18 16:25:41.312355 | controller -> localhost | |      .++*+o+.   |
2026-03-18 16:25:41.312372 | controller -> localhost | |      ..o+.*o= . |
2026-03-18 16:25:41.312389 | controller -> localhost | |        .==oO = .|
2026-03-18 16:25:41.312406 | controller -> localhost | |       .S *+ X o |
2026-03-18 16:25:41.312423 | controller -> localhost | |        .. o= =  |
2026-03-18 16:25:41.312440 | controller -> localhost | |       .     . o |
2026-03-18 16:25:41.312457 | controller -> localhost | |        E     . o|
2026-03-18 16:25:41.312474 | controller -> localhost | |               o |
2026-03-18 16:25:41.312492 | controller -> localhost | +----[SHA256]-----+
2026-03-18 16:25:41.312536 | controller -> localhost | ok: Runtime: 0:00:00.152860
2026-03-18 16:25:41.317629 | 
2026-03-18 16:25:41.317690 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-18 16:25:41.334807 | controller | ok
2026-03-18 16:25:41.343347 | controller | included: /var/lib/zuul/builds/b91f0e2af46b42aa97c0c1f37d76ea08/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-18 16:25:41.350315 | 
2026-03-18 16:25:41.350375 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-18 16:25:41.363479 | controller | skipping: Conditional result was False
2026-03-18 16:25:41.368497 | 
2026-03-18 16:25:41.368555 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-18 16:25:41.811300 | controller | changed
2026-03-18 16:25:41.815656 | 
2026-03-18 16:25:41.815718 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-18 16:25:42.076525 | controller | ok
2026-03-18 16:25:42.081335 | 
2026-03-18 16:25:42.081400 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-18 16:25:43.177789 | controller | changed
2026-03-18 16:25:43.182203 | 
2026-03-18 16:25:43.182275 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-18 16:25:44.265508 | controller | changed
2026-03-18 16:25:44.270343 | 
2026-03-18 16:25:44.270407 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-18 16:25:44.284003 | controller | skipping: Conditional result was False
2026-03-18 16:25:44.289531 | 
2026-03-18 16:25:44.289593 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-18 16:25:44.587022 | controller -> localhost | changed
2026-03-18 16:25:44.596258 | 
2026-03-18 16:25:44.596391 | TASK [add-build-sshkey : Add back temp key]
2026-03-18 16:25:44.812323 | controller -> localhost | Identity added: /var/lib/zuul/builds/b91f0e2af46b42aa97c0c1f37d76ea08/work/b91f0e2af46b42aa97c0c1f37d76ea08_id_rsa (zuul-build-sshkey)
2026-03-18 16:25:44.812502 | controller -> localhost | ok: Runtime: 0:00:00.006927
2026-03-18 16:25:44.817980 | 
2026-03-18 16:25:44.818042 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-18 16:25:45.171328 | controller | ok
2026-03-18 16:25:45.176132 | 
2026-03-18 16:25:45.176198 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-18 16:25:45.200353 | controller | skipping: Conditional result was False
2026-03-18 16:25:45.208932 | 
2026-03-18 16:25:45.209003 | TASK [include_role : validate-host]
2026-03-18 16:25:45.226139 | controller | ok
2026-03-18 16:25:45.242457 | 
2026-03-18 16:25:45.242520 | TASK [validate-host : Define zuul_info_dir fact]
2026-03-18 16:25:45.260373 | controller | ok
2026-03-18 16:25:45.264406 | 
2026-03-18 16:25:45.264464 | TASK [validate-host : Ensure Zuul Ansible directory exists]
2026-03-18 16:25:45.449553 | controller -> localhost | ok
2026-03-18 16:25:45.455170 | 
2026-03-18 16:25:45.455242 | TASK [validate-host : Collect information about the host]
2026-03-18 16:25:46.198806 | controller | ok
2026-03-18 16:25:46.206351 | 
2026-03-18 16:25:46.206409 | TASK [validate-host : Sanitize hostname]
2026-03-18 16:25:46.244257 | controller | ok
2026-03-18 16:25:46.248591 | 
2026-03-18 16:25:46.248651 | TASK [validate-host : Write out all ansible variables/facts known for each host]
2026-03-18 16:25:46.586399 | controller -> localhost | changed
2026-03-18 16:25:46.591463 | 
2026-03-18 16:25:46.591526 | TASK [validate-host : Collect information about zuul worker]
2026-03-18 16:25:46.954415 | controller | ok
2026-03-18 16:25:46.958828 | 
2026-03-18 16:25:46.958896 | TASK [validate-host : Write out all zuul information for each host]
2026-03-18 16:25:47.286035 | controller -> localhost | changed
2026-03-18 16:25:47.296598 | 
2026-03-18 16:25:47.296666 | TASK [include_role : prepare-workspace-openshift]
2026-03-18 16:25:47.310250 | controller | skipping: Conditional result was False
2026-03-18 16:25:47.315700 | 
2026-03-18 16:25:47.315764 | TASK [include_role : remove-zuul-sshkey]
2026-03-18 16:25:47.328811 | controller | skipping: Conditional result was False
2026-03-18 16:25:47.333534 | 
2026-03-18 16:25:47.333598 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-18 16:25:47.575721 | controller | ok: "logs"
2026-03-18 16:25:47.575917 | controller | ok: All items complete
2026-03-18 16:25:47.575948 | 
2026-03-18 16:25:47.794968 | controller | ok: "artifacts"
2026-03-18 16:25:48.014703 | controller | ok: "docs"
2026-03-18 16:25:48.019693 | 
2026-03-18 16:25:48.019753 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-18 16:25:48.269420 | controller | changed: "logs"
2026-03-18 16:25:48.482494 | controller | changed: "artifacts"
2026-03-18 16:25:48.702499 | controller | changed: "docs"
2026-03-18 16:25:48.722004 | 
2026-03-18 16:25:48.722050 | PLAY RECAP
2026-03-18 16:25:48.722097 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2026-03-18 16:25:48.722122 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-18 16:25:48.722140 | 
2026-03-18 16:25:48.789676 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master]
2026-03-18 16:25:48.790436 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2026-03-18 16:25:49.291967 | 
2026-03-18 16:25:49.292067 | PLAY [all]
2026-03-18 16:25:49.310616 | 
2026-03-18 16:25:49.310686 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2026-03-18 16:25:49.358645 | controller | ok
2026-03-18 16:25:49.363381 | 
2026-03-18 16:25:49.363458 | TASK [mirror-info-fork : Create /etc/ci]
2026-03-18 16:25:49.736373 | controller | changed
2026-03-18 16:25:49.741829 | 
2026-03-18 16:25:49.741900 | TASK [mirror-info-fork : Install ci_mirror script]
2026-03-18 16:25:50.894419 | controller | changed
2026-03-18 16:25:50.903036 | 
2026-03-18 16:25:50.903101 | LOOP [add-authorized-keys : Enable access via build key on all nodes]
2026-03-18 16:25:51.317898 | controller | changed:
2026-03-18 16:25:51.318064 | controller | {
2026-03-18 16:25:51.318096 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com"
2026-03-18 16:25:51.318124 | controller | }
2026-03-18 16:25:51.581771 | controller | changed:
2026-03-18 16:25:51.581848 | controller | {
2026-03-18 16:25:51.581877 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com"
2026-03-18 16:25:51.581897 | controller | }
2026-03-18 16:25:51.857611 | controller | changed:
2026-03-18 16:25:51.857700 | controller | {
2026-03-18 16:25:51.857726 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com"
2026-03-18 16:25:51.857745 | controller | }
2026-03-18 16:25:52.128314 | controller | changed:
2026-03-18 16:25:52.128386 | controller | {
2026-03-18 16:25:52.128412 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com"
2026-03-18 16:25:52.128432 | controller | }
2026-03-18 16:25:52.393861 | controller | changed:
2026-03-18 16:25:52.393950 | controller | {
2026-03-18 16:25:52.393988 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com"
2026-03-18 16:25:52.394009 | controller | }
2026-03-18 16:25:52.666536 | controller | changed:
2026-03-18 16:25:52.666587 | controller | {
2026-03-18 16:25:52.666612 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com"
2026-03-18 16:25:52.666631 | controller | }
2026-03-18 16:25:52.939801 | controller | changed:
2026-03-18 16:25:52.939883 | controller | {
2026-03-18 16:25:52.939908 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen"
2026-03-18 16:25:52.939927 | controller | }
2026-03-18 16:25:53.219444 | controller | changed:
2026-03-18 16:25:53.219496 | controller | {
2026-03-18 16:25:53.219520 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora"
2026-03-18 16:25:53.219540 | controller | }
2026-03-18 16:25:53.493123 | controller | changed:
2026-03-18 16:25:53.493193 | controller | {
2026-03-18 16:25:53.493220 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner"
2026-03-18 16:25:53.493241 | controller | }
2026-03-18 16:25:53.775496 | controller | changed:
2026-03-18 16:25:53.775566 | controller | {
2026-03-18 16:25:53.775591 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com"
2026-03-18 16:25:53.775608 | controller | }
2026-03-18 16:25:54.029041 | controller | changed:
2026-03-18 16:25:54.029219 | controller | {
2026-03-18 16:25:54.029254 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com"
2026-03-18 16:25:54.029296 | controller | }
2026-03-18 16:25:54.295144 | controller | changed:
2026-03-18 16:25:54.295239 | controller | {
2026-03-18 16:25:54.295287 | controller |   "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com"
2026-03-18 16:25:54.295313 | controller | }
2026-03-18 16:25:54.563751 | controller | changed:
2026-03-18 16:25:54.563840 | controller | {
2026-03-18 16:25:54.563869 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICWBreHW95Wz2Toz5YwCGQwFcUG8oFYkienDh9tntmDc ralfieri@redhat.com"
2026-03-18 16:25:54.563890 | controller | }
2026-03-18 16:25:54.835846 | controller | changed:
2026-03-18 16:25:54.835934 | controller | {
2026-03-18 16:25:54.835970 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel"
2026-03-18 16:25:54.835990 | controller | }
2026-03-18 16:25:55.104358 | controller | changed:
2026-03-18 16:25:55.104435 | controller | {
2026-03-18 16:25:55.104462 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux"
2026-03-18 16:25:55.104483 | controller | }
2026-03-18 16:25:55.380985 | controller | changed:
2026-03-18 16:25:55.381068 | controller | {
2026-03-18 16:25:55.381094 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr"
2026-03-18 16:25:55.381114 | controller | }
2026-03-18 16:25:55.650462 | controller | changed:
2026-03-18 16:25:55.650559 | controller | {
2026-03-18 16:25:55.650587 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com"
2026-03-18 16:25:55.650607 | controller | }
2026-03-18 16:25:55.922503 | controller | changed:
2026-03-18 16:25:55.922596 | controller | {
2026-03-18 16:25:55.922623 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb"
2026-03-18 16:25:55.922654 | controller | }
2026-03-18 16:25:56.203586 | controller | changed:
2026-03-18 16:25:56.203666 | controller | {
2026-03-18 16:25:56.203693 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9"
2026-03-18 16:25:56.203714 | controller | }
2026-03-18 16:25:56.466135 | controller | changed:
2026-03-18 16:25:56.466240 | controller | {
2026-03-18 16:25:56.466286 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora"
2026-03-18 16:25:56.466310 | controller | }
2026-03-18 16:25:56.734221 | controller | changed:
2026-03-18 16:25:56.734386 | controller | {
2026-03-18 16:25:56.734424 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac"
2026-03-18 16:25:56.734448 | controller | }
2026-03-18 16:25:57.002810 | controller | changed:
2026-03-18 16:25:57.002896 | controller | {
2026-03-18 16:25:57.002921 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop"
2026-03-18 16:25:57.002940 | controller | }
2026-03-18 16:25:57.279082 | controller | changed:
2026-03-18 16:25:57.279159 | controller | {
2026-03-18 16:25:57.279184 | controller |   "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com"
2026-03-18 16:25:57.279205 | controller | }
2026-03-18 16:25:57.559738 | controller | changed:
2026-03-18 16:25:57.559807 | controller | {
2026-03-18 16:25:57.559831 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com"
2026-03-18 16:25:57.559849 | controller | }
2026-03-18 16:25:57.837354 | controller | changed:
2026-03-18 16:25:57.837438 | controller | {
2026-03-18 16:25:57.837468 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com"
2026-03-18 16:25:57.837492 | controller | }
2026-03-18 16:25:58.108392 | controller | changed:
2026-03-18 16:25:58.108480 | controller | {
2026-03-18 16:25:58.108505 | controller |   "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono"
2026-03-18 16:25:58.108525 | controller | }
2026-03-18 16:25:58.126098 | 
2026-03-18 16:25:58.126208 | TASK [Set timezone to UTC]
2026-03-18 16:25:58.582240 | controller | changed: executed `/bin/timedatectl set-timezone UTC`
2026-03-18 16:25:58.587415 | 
2026-03-18 16:25:58.587493 | TASK [Create nodepool directory]
2026-03-18 16:25:58.839076 | controller | changed
2026-03-18 16:25:58.844311 | 
2026-03-18 16:25:58.844374 | TASK [Create nodepool sub_nodes file]
2026-03-18 16:25:59.731491 | controller | changed
2026-03-18 16:25:59.736186 | 
2026-03-18 16:25:59.736249 | TASK [Create nodepool sub_nodes_private file]
2026-03-18 16:26:00.604757 | controller | changed
2026-03-18 16:26:00.609739 | 
2026-03-18 16:26:00.609798 | LOOP [Populate nodepool sub_nodes file]
2026-03-18 16:26:00.639512 | 
2026-03-18 16:26:00.639656 | LOOP [Populate nodepool sub_nodes_private file]
2026-03-18 16:26:00.668095 | 
2026-03-18 16:26:00.668212 | TASK [Create nodepool primary file]
2026-03-18 16:26:00.691617 | controller | skipping: Conditional result was False
2026-03-18 16:26:00.696909 | 
2026-03-18 16:26:00.696990 | TASK [Create nodepool node_private for this node]
2026-03-18 16:26:01.588833 | controller | changed
2026-03-18 16:26:01.593769 | 
2026-03-18 16:26:01.593825 | LOOP [Copy ssh keys to nodepool directory]
2026-03-18 16:26:01.949054 | controller | ok: Item: id_rsa Runtime: 0:00:00.003928
2026-03-18 16:26:01.949208 | 
2026-03-18 16:26:02.152989 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.004646
2026-03-18 16:26:02.164624 | 
2026-03-18 16:26:02.164732 | TASK [Add sudoers role for zuul-sudo-grep.sh]
2026-03-18 16:26:03.056919 | controller | changed
2026-03-18 16:26:03.061362 | 
2026-03-18 16:26:03.061417 | TASK [Validate sudoers config after edits]
2026-03-18 16:26:03.311382 | controller | /etc/sudoers: parsed OK
2026-03-18 16:26:03.311448 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK
2026-03-18 16:26:03.311459 | controller | /etc/sudoers.d/zuul: parsed OK
2026-03-18 16:26:03.311465 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK
2026-03-18 16:26:03.584802 | controller | ok: Runtime: 0:00:00.004657
2026-03-18 16:26:03.589510 | 
2026-03-18 16:26:03.589565 | TASK [Show the environment passed in to job shell scripts]
2026-03-18 16:26:03.833106 | controller | SHELL=/bin/bash
2026-03-18 16:26:03.833151 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework
2026-03-18 16:26:03.833161 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework
2026-03-18 16:26:03.833169 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/39/3739/606034ddbec26b3dc5ea5a510185c4254d43b8b9
2026-03-18 16:26:03.833175 | controller | PWD=/home/zuul
2026-03-18 16:26:03.833181 | controller | ZUUL_PIPELINE=github-check
2026-03-18 16:26:03.833226 | controller | LOGNAME=zuul
2026-03-18 16:26:03.833236 | controller | XDG_SESSION_TYPE=tty
2026-03-18 16:26:03.833241 | controller | _=/usr/bin/env
2026-03-18 16:26:03.833247 | controller | MOTD_SHOWN=pam
2026-03-18 16:26:03.833252 | controller | HOME=/home/zuul
2026-03-18 16:26:03.833257 | controller | LANG=en_US.UTF-8
2026-03-18 16:26:03.833263 | controller | SSH_CONNECTION=192.168.25.12 54084 192.168.25.212 22
2026-03-18 16:26:03.833268 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET
2026-03-18 16:26:03.833277 | controller | ZUUL_CHANGE_IDS=3739,606034ddbec26b3dc5ea5a510185c4254d43b8b9
2026-03-18 16:26:03.833282 | controller | WORKSPACE=/home/zuul/workspace
2026-03-18 16:26:03.833301 | controller | XDG_SESSION_CLASS=user
2026-03-18 16:26:03.833308 | controller | SELINUX_ROLE_REQUESTED=
2026-03-18 16:26:03.833313 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s
2026-03-18 16:26:03.833319 | controller | USER=zuul
2026-03-18 16:26:03.833324 | controller | ZUUL_VOTING=True
2026-03-18 16:26:03.833329 | controller | BUILD_TIMEOUT=5400000
2026-03-18 16:26:03.833335 | controller | SELINUX_USE_CURRENT_RANGE=
2026-03-18 16:26:03.833340 | controller | SHLVL=1
2026-03-18 16:26:03.833346 | controller | ZUUL_PATCHSET=606034ddbec26b3dc5ea5a510185c4254d43b8b9
2026-03-18 16:26:03.833351 | controller | XDG_SESSION_ID=1
2026-03-18 16:26:03.833356 | controller | ZUUL_BRANCH=main
2026-03-18 16:26:03.833362 | controller | XDG_RUNTIME_DIR=/run/user/1000
2026-03-18 16:26:03.833367 | controller | SSH_CLIENT=192.168.25.12 54084 22
2026-03-18 16:26:03.833373 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/
2026-03-18 16:26:03.833378 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima:
2026-03-18 16:26:03.833384 | controller | which_declare=declare -f
2026-03-18 16:26:03.833390 | controller | PATH=/home/zuul/.crc/bin/oc:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin
2026-03-18 16:26:03.833395 | controller | SELINUX_LEVEL_REQUESTED=
2026-03-18 16:26:03.833401 | controller | ZUUL_CHANGE=3739
2026-03-18 16:26:03.833406 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus
2026-03-18 16:26:03.833411 | controller | ZUUL_UUID=b91f0e2af46b42aa97c0c1f37d76ea08
2026-03-18 16:26:03.833417 | controller | BASH_FUNC_which%%=() {  ( alias;
2026-03-18 16:26:03.833422 | controller |  eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@
2026-03-18 16:26:03.833428 | controller | }
2026-03-18 16:26:04.112538 | controller | ok: Runtime: 0:00:00.005840
2026-03-18 16:26:04.117152 | 
2026-03-18 16:26:04.117206 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars]
2026-03-18 16:26:04.130403 | controller | skipping: Conditional result was False
2026-03-18 16:26:04.135438 | 
2026-03-18 16:26:04.135502 | TASK [Symlink /home/zuul-worker/workspace]
2026-03-18 16:26:04.659116 | controller | skipping: Conditional result was False
2026-03-18 16:26:04.664417 | 
2026-03-18 16:26:04.664477 | TASK [Ensure legacy workspace directory]
2026-03-18 16:26:04.914544 | controller | changed
2026-03-18 16:26:04.929861 | 
2026-03-18 16:26:04.929911 | PLAY RECAP
2026-03-18 16:26:04.929950 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0
2026-03-18 16:26:04.929991 | 
2026-03-18 16:26:04.988516 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master]
2026-03-18 16:26:04.989300 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2026-03-18 16:26:05.471375 | 
2026-03-18 16:26:05.471481 | PLAY [Run ci/playbooks/dump_zuul_data.yml]
2026-03-18 16:26:05.491779 | 
2026-03-18 16:26:05.491856 | TASK [Create zuul-output directory]
2026-03-18 16:26:05.855239 | controller | changed
2026-03-18 16:26:05.859838 | 
2026-03-18 16:26:05.859904 | TASK [Slurp Zuul inventory test]
2026-03-18 16:26:06.106788 | controller -> localhost | ok
2026-03-18 16:26:06.112691 | 
2026-03-18 16:26:06.112751 | TASK [Save zuul inventory]
2026-03-18 16:26:07.215950 | controller | changed
2026-03-18 16:26:07.220446 | 
2026-03-18 16:26:07.220509 | TASK [Save zuul vars without the change_message]
2026-03-18 16:26:08.162645 | controller | changed
2026-03-18 16:26:08.179799 | 
2026-03-18 16:26:08.179849 | PLAY RECAP
2026-03-18 16:26:08.179886 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-18 16:26:08.179908 | 
2026-03-18 16:26:08.240048 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main]
2026-03-18 16:26:08.240732 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2026-03-18 16:26:08.741831 | 
2026-03-18 16:26:08.741940 | PLAY [Run ci/playbooks/molecule-prepare.yml]
2026-03-18 16:26:08.762386 | 
2026-03-18 16:26:08.762462 | TASK [Execute mirror info role to configure /etc/ci/mirror_info.sh]
2026-03-18 16:26:08.780843 | controller | ok
2026-03-18 16:26:08.796709 | 
2026-03-18 16:26:08.796794 | TASK [mirror-info-fork : Set mirror_fqdn if not defined]
2026-03-18 16:26:08.820421 | controller | skipping: Conditional result was False
2026-03-18 16:26:08.825950 | 
2026-03-18 16:26:08.826032 | TASK [mirror-info-fork : Create /etc/ci]
2026-03-18 16:26:09.178297 | controller | ok
2026-03-18 16:26:09.183832 | 
2026-03-18 16:26:09.183903 | TASK [mirror-info-fork : Install ci_mirror script]
2026-03-18 16:26:10.056990 | controller | ok
2026-03-18 16:26:10.066249 | 
2026-03-18 16:26:10.066329 | TASK [Prepare workspace]
2026-03-18 16:26:10.084458 | controller | ok
2026-03-18 16:26:10.100579 | 
2026-03-18 16:26:10.100641 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-18 16:26:10.433116 | controller | ok
2026-03-18 16:26:10.438532 | 
2026-03-18 16:26:10.438592 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-18 16:26:12.814852 | controller | Output suppressed because no_log was given
2026-03-18 16:26:12.823659 | 
2026-03-18 16:26:12.823721 | LOOP [Create zuul-output directory]
2026-03-18 16:26:13.125432 | controller | changed: "/home/zuul/ci-framework-data/logs"
2026-03-18 16:26:13.360128 | controller | ok: "/home/zuul/zuul-output/logs"
2026-03-18 16:26:13.371908 | 
2026-03-18 16:26:13.372025 | TASK [Install required packages]
2026-03-18 16:26:37.253762 | controller | ok: Nothing to do
2026-03-18 16:26:37.258571 | 
2026-03-18 16:26:37.258631 | TASK [Install venv]
2026-03-18 16:27:36.050931 | controller | changed
2026-03-18 16:27:36.072611 | 
2026-03-18 16:27:36.072702 | PLAY RECAP
2026-03-18 16:27:36.072744 | controller | ok: 7 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-18 16:27:36.072765 | 
2026-03-18 16:27:36.140125 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-prepare.yml@main]
2026-03-18 16:27:36.140893 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2026-03-18 16:27:36.602785 | 
2026-03-18 16:27:36.602867 | PLAY [Run ci/playbooks/molecule-test.yml]
2026-03-18 16:27:36.621456 | 
2026-03-18 16:27:36.621522 | TASK [Gather required facts]
2026-03-18 16:27:37.147967 | controller | ok
2026-03-18 16:27:37.152856 | 
2026-03-18 16:27:37.152924 | TASK [Load environment var if instructed to]
2026-03-18 16:27:37.177031 | controller | skipping: Conditional result was False
2026-03-18 16:27:37.182297 | 
2026-03-18 16:27:37.182362 | TASK [Ensure group_vars dir exists]
2026-03-18 16:27:37.555653 | controller | ok
2026-03-18 16:27:37.560712 | 
2026-03-18 16:27:37.560779 | TASK [Print related variables]
2026-03-18 16:27:37.602027 | controller | ok:
2026-03-18 16:27:37.602137 | controller | mol_config_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config_local.yml
2026-03-18 16:27:37.602165 | controller | roles_dir: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer
2026-03-18 16:27:37.606802 | 
2026-03-18 16:27:37.606865 | TASK [Run molecule]
2026-03-18 16:27:38.620341 | controller | INFO     Found config file /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/.config/molecule/config.yml
2026-03-18 16:27:38.877744 | controller | INFO     Performing prerun with role_name_check=0...
2026-03-18 16:27:57.207354 | controller | WARNING  Another version of '@NAMESPACE@.@NAME@' 3.1.4 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 3.1.4 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-18 16:27:57.207763 | controller | WARNING  Another version of 'ansible.netcommon' 7.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 7.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-18 16:27:57.208253 | controller | WARNING  Another version of 'ansible.posix' 1.6.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.6.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-18 16:27:57.208692 | controller | WARNING  Another version of 'ansible.utils' 5.1.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.1.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-18 16:27:57.209171 | controller | WARNING  Another version of 'cifmw.general' 1.0.0+f50a2d1f was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0+f50a2d1f (/home/zuul/.ansible/collections/ansible_collections).
2026-03-18 16:27:57.209626 | controller | WARNING  Another version of 'cisco.ios' 9.0.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.0.3 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-18 16:27:57.210062 | controller | WARNING  Another version of 'community.crypto' 2.22.3 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.22.3 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-18 16:27:57.210527 | controller | WARNING  Another version of 'community.general' 10.0.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 10.0.1 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-18 16:27:57.210959 | controller | WARNING  Another version of 'community.libvirt' 1.3.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.3.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-18 16:27:57.211367 | controller | WARNING  Another version of 'community.okd' 4.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 4.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-18 16:27:57.211772 | controller | WARNING  Another version of 'containers.podman' 1.16.2 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.16.2 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-18 16:27:57.212216 | controller | WARNING  Another version of 'junipernetworks.junos' 9.1.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 9.1.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-18 16:27:57.212640 | controller | WARNING  Another version of 'kubernetes.core' 5.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 5.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-18 16:27:57.213077 | controller | WARNING  Another version of 'mellanox.onyx' 1.0.0 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 1.0.0 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-18 16:27:57.213522 | controller | WARNING  Another version of 'openstack.config_template' 2.1.1 was found installed in /home/zuul/.cache/ansible-compat/82c225/collections/ansible_collections, only the first one will be used, 2.1.1 (/home/zuul/.ansible/collections/ansible_collections).
2026-03-18 16:27:57.223303 | controller | INFO     Running crc_layout > prepare
2026-03-18 16:27:57.889868 | controller |
2026-03-18 16:27:57.889923 | controller | PLAY [Prepare] *****************************************************************
2026-03-18 16:27:57.890044 | controller |
2026-03-18 16:27:57.890138 | controller | TASK [Gathering Facts] *********************************************************
2026-03-18 16:27:57.890228 | controller | Wednesday 18 March 2026  16:27:57 +0000 (0:00:00.018)       0:00:00.018 *******
2026-03-18 16:27:58.714436 | controller | ok: [instance]
2026-03-18 16:27:58.714524 | controller |
2026-03-18 16:27:58.714594 | controller | TASK [Create custom basedir] ***************************************************
2026-03-18 16:27:58.714692 | controller | Wednesday 18 March 2026  16:27:58 +0000 (0:00:00.824)       0:00:00.843 *******
2026-03-18 16:27:59.014637 | controller | changed: [instance]
2026-03-18 16:27:59.014677 | controller |
2026-03-18 16:27:59.014799 | controller | TASK [test_deps : Gather facts if they don't exist] ****************************
2026-03-18 16:27:59.014866 | controller | Wednesday 18 March 2026  16:27:59 +0000 (0:00:00.300)       0:00:01.143 *******
2026-03-18 16:27:59.032070 | controller | skipping: [instance]
2026-03-18 16:27:59.032157 | controller |
2026-03-18 16:27:59.032320 | controller | TASK [test_deps : Gather variables for each operating system] ******************
2026-03-18 16:27:59.032417 | controller | Wednesday 18 March 2026  16:27:59 +0000 (0:00:00.017)       0:00:01.161 *******
2026-03-18 16:27:59.072706 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/test_deps/vars/centos-9.yml)
2026-03-18 16:27:59.072794 | controller |
2026-03-18 16:27:59.072947 | controller | TASK [test_deps : Detect mirrors file] *****************************************
2026-03-18 16:27:59.073062 | controller | Wednesday 18 March 2026  16:27:59 +0000 (0:00:00.040)       0:00:01.202 *******
2026-03-18 16:27:59.347378 | controller | ok: [instance]
2026-03-18 16:27:59.347416 | controller |
2026-03-18 16:27:59.347548 | controller | TASK [test_deps : Disable ubi host subscription-manager integration] ***********
2026-03-18 16:27:59.347623 | controller | Wednesday 18 March 2026  16:27:59 +0000 (0:00:00.274)       0:00:01.476 *******
2026-03-18 16:27:59.552754 | controller | ok: [instance]
2026-03-18 16:27:59.552828 | controller |
2026-03-18 16:27:59.552956 | controller | TASK [test_deps : Disable ubi 9 repos] *****************************************
2026-03-18 16:27:59.553070 | controller | Wednesday 18 March 2026  16:27:59 +0000 (0:00:00.205)       0:00:01.682 *******
2026-03-18 16:28:00.226550 | controller | ok: [instance] => (item=ubi-9-appstream)
2026-03-18 16:28:00.226630 | controller | ok: [instance] => (item=ubi-9-baseos)
2026-03-18 16:28:00.226748 | controller | ok: [instance] => (item=ubi-9-codeready-builder)
2026-03-18 16:28:00.226826 | controller |
2026-03-18 16:28:00.226923 | controller | TASK [Deploy repo-setup] *******************************************************
2026-03-18 16:28:00.227092 | controller | Wednesday 18 March 2026  16:28:00 +0000 (0:00:00.673)       0:00:02.355 *******
2026-03-18 16:28:00.281565 | controller |
2026-03-18 16:28:00.281705 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2026-03-18 16:28:00.281790 | controller | Wednesday 18 March 2026  16:28:00 +0000 (0:00:00.055)       0:00:02.411 *******
2026-03-18 16:28:00.795361 | controller | changed: [instance] => (item=tmp)
2026-03-18 16:28:00.795404 | controller | changed: [instance] => (item=artifacts/repositories)
2026-03-18 16:28:00.795546 | controller | changed: [instance] => (item=venv/repo_setup)
2026-03-18 16:28:00.795609 | controller |
2026-03-18 16:28:00.795705 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2026-03-18 16:28:00.795793 | controller | Wednesday 18 March 2026  16:28:00 +0000 (0:00:00.513)       0:00:02.924 *******
2026-03-18 16:28:01.608834 | controller | ok: [instance]
2026-03-18 16:28:01.608955 | controller |
2026-03-18 16:28:01.608983 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2026-03-18 16:28:01.609055 | controller | Wednesday 18 March 2026  16:28:01 +0000 (0:00:00.813)       0:00:03.737 *******
2026-03-18 16:28:02.703509 | controller | changed: [instance]
2026-03-18 16:28:10.052156 | controller |
2026-03-18 16:28:10.052214 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2026-03-18 16:28:10.052223 | controller | Wednesday 18 March 2026  16:28:02 +0000 (0:00:01.094)       0:00:04.832 *******
2026-03-18 16:28:10.052235 | controller | changed: [instance]
2026-03-18 16:28:10.735032 | controller |
2026-03-18 16:28:10.735073 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2026-03-18 16:28:10.735082 | controller | Wednesday 18 March 2026  16:28:10 +0000 (0:00:07.348)       0:00:12.181 *******
2026-03-18 16:28:10.735092 | controller | changed: [instance]
2026-03-18 16:28:10.735247 | controller |
2026-03-18 16:28:10.735280 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2026-03-18 16:28:10.735292 | controller | Wednesday 18 March 2026  16:28:10 +0000 (0:00:00.682)       0:00:12.863 *******
2026-03-18 16:28:10.756602 | controller | skipping: [instance]
2026-03-18 16:28:11.607477 | controller |
2026-03-18 16:28:11.607510 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2026-03-18 16:28:11.607518 | controller | Wednesday 18 March 2026  16:28:10 +0000 (0:00:00.022)       0:00:12.885 *******
2026-03-18 16:28:11.607527 | controller | changed: [instance]
2026-03-18 16:28:11.643507 | controller |
2026-03-18 16:28:11.643529 | controller | TASK [repo_setup : Get component repo] *****************************************
2026-03-18 16:28:11.643538 | controller | Wednesday 18 March 2026  16:28:11 +0000 (0:00:00.850)       0:00:13.736 *******
2026-03-18 16:28:11.643548 | controller | skipping: [instance]
2026-03-18 16:28:11.678032 | controller |
2026-03-18 16:28:11.678080 | controller | TASK [repo_setup : Rename component repo] **************************************
2026-03-18 16:28:11.678090 | controller | Wednesday 18 March 2026  16:28:11 +0000 (0:00:00.036)       0:00:13.772 *******
2026-03-18 16:28:11.678104 | controller | skipping: [instance]
2026-03-18 16:28:11.678160 | controller |
2026-03-18 16:28:11.678349 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2026-03-18 16:28:11.711023 | controller | Wednesday 18 March 2026  16:28:11 +0000 (0:00:00.034)       0:00:13.806 *******
2026-03-18 16:28:11.711068 | controller | skipping: [instance]
2026-03-18 16:28:11.711098 | controller |
2026-03-18 16:28:11.711458 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2026-03-18 16:28:12.235193 | controller | Wednesday 18 March 2026  16:28:11 +0000 (0:00:00.033)       0:00:13.840 *******
2026-03-18 16:28:12.235243 | controller | changed: [instance]
2026-03-18 16:28:12.235268 | controller |
2026-03-18 16:28:12.235278 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2026-03-18 16:28:12.663643 | controller | Wednesday 18 March 2026  16:28:12 +0000 (0:00:00.524)       0:00:14.364 *******
2026-03-18 16:28:12.663690 | controller | changed: [instance]
2026-03-18 16:28:12.693912 | controller |
2026-03-18 16:28:12.693947 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2026-03-18 16:28:12.693957 | controller | Wednesday 18 March 2026  16:28:12 +0000 (0:00:00.428)       0:00:14.792 *******
2026-03-18 16:28:12.693966 | controller | skipping: [instance]
2026-03-18 16:28:12.723696 | controller |
2026-03-18 16:28:12.723730 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2026-03-18 16:28:12.723741 | controller | Wednesday 18 March 2026  16:28:12 +0000 (0:00:00.030)       0:00:14.822 *******
2026-03-18 16:28:12.723754 | controller | skipping: [instance]
2026-03-18 16:28:12.750641 | controller |
2026-03-18 16:28:12.750660 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2026-03-18 16:28:12.750667 | controller | Wednesday 18 March 2026  16:28:12 +0000 (0:00:00.029)       0:00:14.852 *******
2026-03-18 16:28:12.750676 | controller | skipping: [instance]
2026-03-18 16:28:12.789139 | controller |
2026-03-18 16:28:12.789188 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2026-03-18 16:28:12.789201 | controller | Wednesday 18 March 2026  16:28:12 +0000 (0:00:00.027)       0:00:14.879 *******
2026-03-18 16:28:12.789219 | controller | ok: [instance]
2026-03-18 16:28:12.817041 | controller |
2026-03-18 16:28:12.817088 | controller | TASK [repo_setup : Create download directory] **********************************
2026-03-18 16:28:12.817097 | controller | Wednesday 18 March 2026  16:28:12 +0000 (0:00:00.038)       0:00:14.918 *******
2026-03-18 16:28:12.817119 | controller | skipping: [instance]
2026-03-18 16:28:12.844333 | controller |
2026-03-18 16:28:12.844355 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2026-03-18 16:28:12.844363 | controller | Wednesday 18 March 2026  16:28:12 +0000 (0:00:00.027)       0:00:14.946 *******
2026-03-18 16:28:12.844373 | controller | skipping: [instance]
2026-03-18 16:28:12.844564 | controller |
2026-03-18 16:28:12.844775 | controller | TASK [Download the RPM] ********************************************************
2026-03-18 16:28:12.844999 | controller | Wednesday 18 March 2026  16:28:12 +0000 (0:00:00.027)       0:00:14.973 *******
2026-03-18 16:28:12.870742 | controller | skipping: [instance]
2026-03-18 16:28:12.870880 | controller |
2026-03-18 16:28:12.871036 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2026-03-18 16:28:12.871161 | controller | Wednesday 18 March 2026  16:28:12 +0000 (0:00:00.026)       0:00:15.000 *******
2026-03-18 16:28:12.898059 | controller | skipping: [instance]
2026-03-18 16:28:12.898233 | controller |
2026-03-18 16:28:12.898377 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2026-03-18 16:28:12.898513 | controller | Wednesday 18 March 2026  16:28:12 +0000 (0:00:00.027)       0:00:15.027 *******
2026-03-18 16:28:12.924466 | controller | skipping: [instance]
2026-03-18 16:28:12.924693 | controller |
2026-03-18 16:28:12.924904 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2026-03-18 16:28:12.925150 | controller | Wednesday 18 March 2026  16:28:12 +0000 (0:00:00.026)       0:00:15.053 *******
2026-03-18 16:28:12.952642 | controller | skipping: [instance]
2026-03-18 16:28:12.952799 | controller |
2026-03-18 16:28:12.952940 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2026-03-18 16:28:12.953113 | controller | Wednesday 18 March 2026  16:28:12 +0000 (0:00:00.028)       0:00:15.082 *******
2026-03-18 16:28:12.979318 | controller | skipping: [instance]
2026-03-18 16:28:12.979547 | controller |
2026-03-18 16:28:12.979756 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2026-03-18 16:28:12.979957 | controller | Wednesday 18 March 2026  16:28:12 +0000 (0:00:00.026)       0:00:15.108 *******
2026-03-18 16:28:13.163626 | controller | ok: [instance]
2026-03-18 16:28:13.163724 | controller |
2026-03-18 16:28:13.163837 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2026-03-18 16:28:13.163950 | controller | Wednesday 18 March 2026  16:28:13 +0000 (0:00:00.184)       0:00:15.292 *******
2026-03-18 16:28:13.372906 | controller | changed: [instance]
2026-03-18 16:28:13.617349 | controller |
2026-03-18 16:28:13.617382 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2026-03-18 16:28:13.617390 | controller | Wednesday 18 March 2026  16:28:13 +0000 (0:00:00.209)       0:00:15.501 *******
2026-03-18 16:28:13.617401 | controller | changed: [instance]
2026-03-18 16:28:13.639023 | controller |
2026-03-18 16:28:13.639043 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2026-03-18 16:28:13.639051 | controller | Wednesday 18 March 2026  16:28:13 +0000 (0:00:00.244)       0:00:15.746 *******
2026-03-18 16:28:13.639062 | controller | skipping: [instance]
2026-03-18 16:28:13.661576 | controller |
2026-03-18 16:28:13.661592 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2026-03-18 16:28:13.661599 | controller | Wednesday 18 March 2026  16:28:13 +0000 (0:00:00.021)       0:00:15.768 *******
2026-03-18 16:28:13.661607 | controller | skipping: [instance]
2026-03-18 16:28:13.684108 | controller |
2026-03-18 16:28:13.684161 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2026-03-18 16:28:13.684171 | controller | Wednesday 18 March 2026  16:28:13 +0000 (0:00:00.022)       0:00:15.790 *******
2026-03-18 16:28:13.684185 | controller | skipping: [instance]
2026-03-18 16:28:13.706644 | controller |
2026-03-18 16:28:13.706668 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2026-03-18 16:28:13.706676 | controller | Wednesday 18 March 2026  16:28:13 +0000 (0:00:00.022)       0:00:15.813 *******
2026-03-18 16:28:13.706685 | controller | skipping: [instance]
2026-03-18 16:28:13.729454 | controller |
2026-03-18 16:28:13.729477 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2026-03-18 16:28:13.729493 | controller | Wednesday 18 March 2026  16:28:13 +0000 (0:00:00.022)       0:00:15.835 *******
2026-03-18 16:28:13.729504 | controller | skipping: [instance]
2026-03-18 16:28:13.752276 | controller |
2026-03-18 16:28:13.752300 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] ***
2026-03-18 16:28:13.752309 | controller | Wednesday 18 March 2026  16:28:13 +0000 (0:00:00.022)       0:00:15.858 *******
2026-03-18 16:28:13.752320 | controller | skipping: [instance]
2026-03-18 16:28:13.752486 | controller |
2026-03-18 16:28:13.752658 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2026-03-18 16:28:13.752791 | controller | Wednesday 18 March 2026  16:28:13 +0000 (0:00:00.023)       0:00:15.881 *******
2026-03-18 16:28:13.771181 | controller | skipping: [instance]
2026-03-18 16:28:13.771361 | controller |
2026-03-18 16:28:13.771526 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2026-03-18 16:28:13.771683 | controller | Wednesday 18 March 2026  16:28:13 +0000 (0:00:00.019)       0:00:15.900 *******
2026-03-18 16:28:13.799785 | controller | skipping: [instance]
2026-03-18 16:28:13.799987 | controller |
2026-03-18 16:28:13.800177 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2026-03-18 16:28:13.800351 | controller | Wednesday 18 March 2026  16:28:13 +0000 (0:00:00.028)       0:00:15.929 *******
2026-03-18 16:28:13.817220 | controller | skipping: [instance]
2026-03-18 16:28:13.817398 | controller |
2026-03-18 16:28:13.817568 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2026-03-18 16:28:13.817723 | controller | Wednesday 18 March 2026  16:28:13 +0000 (0:00:00.017)       0:00:15.946 *******
2026-03-18 16:28:13.838407 | controller | skipping: [instance]
2026-03-18 16:28:13.838585 | controller |
2026-03-18 16:28:13.838748 | controller | TASK [test_deps : Look for redhat-release rpm] *********************************
2026-03-18 16:28:13.838908 | controller | Wednesday 18 March 2026  16:28:13 +0000 (0:00:00.021)       0:00:15.967 *******
2026-03-18 16:28:13.867890 | controller | skipping: [instance]
2026-03-18 16:28:13.868093 | controller |
2026-03-18 16:28:13.868283 | controller | TASK [test_deps : Remove redhat-release] ***************************************
2026-03-18 16:28:13.868448 | controller | Wednesday 18 March 2026  16:28:13 +0000 (0:00:00.029)       0:00:15.997 *******
2026-03-18 16:28:13.897470 | controller | skipping: [instance]
2026-03-18 16:28:13.897650 | controller |
2026-03-18 16:28:13.897818 | controller | TASK [test_deps : Install centos-stream-release] *******************************
2026-03-18 16:28:13.897992 | controller | Wednesday 18 March 2026  16:28:13 +0000 (0:00:00.029)       0:00:16.027 *******
2026-03-18 16:28:13.927223 | controller | skipping: [instance]
2026-03-18 16:28:13.927402 | controller |
2026-03-18 16:28:13.927568 | controller | TASK [test_deps : Install additional packages] *********************************
2026-03-18 16:28:13.927727 | controller | Wednesday 18 March 2026  16:28:13 +0000 (0:00:00.029)       0:00:16.056 *******
2026-03-18 16:28:13.958184 | controller | skipping: [instance]
2026-03-18 16:28:13.958347 | controller |
2026-03-18 16:28:13.958509 | controller | TASK [test_deps : Install selinux python libs] *********************************
2026-03-18 16:28:13.958669 | controller | Wednesday 18 March 2026  16:28:13 +0000 (0:00:00.031)       0:00:16.087 *******
2026-03-18 16:28:58.012035 | controller | ok: [instance]
2026-03-18 16:28:59.249803 | controller |
2026-03-18 16:28:59.249836 | controller | TASK [test_deps : Install python yaml libs] ************************************
2026-03-18 16:28:59.249844 | controller | Wednesday 18 March 2026  16:28:58 +0000 (0:00:44.052)       0:01:00.140 *******
2026-03-18 16:28:59.249854 | controller | ok: [instance]
2026-03-18 16:28:59.280326 | controller |
2026-03-18 16:28:59.280344 | controller | TASK [test_deps : Install extra packages] **************************************
2026-03-18 16:28:59.280352 | controller | Wednesday 18 March 2026  16:28:59 +0000 (0:00:01.238)       0:01:01.378 *******
2026-03-18 16:28:59.280360 | controller | skipping: [instance]
2026-03-18 16:28:59.319382 | controller |
2026-03-18 16:28:59.319401 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2026-03-18 16:28:59.319408 | controller | Wednesday 18 March 2026  16:28:59 +0000 (0:00:00.030)       0:01:01.409 *******
2026-03-18 16:28:59.319425 | controller | ok: [instance] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml)
2026-03-18 16:28:59.340138 | controller |
2026-03-18 16:28:59.340191 | controller | TASK [ci_setup : List packages to install] *************************************
2026-03-18 16:28:59.340205 | controller | Wednesday 18 March 2026  16:28:59 +0000 (0:00:00.039)       0:01:01.448 *******
2026-03-18 16:28:59.340232 | controller | ok: [instance] =>
2026-03-18 16:28:59.340266 | controller |   cifmw_ci_setup_packages:
2026-03-18 16:28:59.340277 | controller |   - bash-completion
2026-03-18 16:28:59.340287 | controller |   - ca-certificates
2026-03-18 16:28:59.340297 | controller |   - git-core
2026-03-18 16:28:59.340307 | controller |   - make
2026-03-18 16:28:59.340317 | controller |   - tar
2026-03-18 16:28:59.340327 | controller |   - tmux
2026-03-18 16:28:59.340337 | controller |   - python3-pip
2026-03-18 16:28:59.340346 | controller |
2026-03-18 16:28:59.340360 | controller | TASK [ci_setup : Install needed packages] **************************************
2026-03-18 16:29:02.988594 | controller | Wednesday 18 March 2026  16:28:59 +0000 (0:00:00.020)       0:01:01.468 *******
2026-03-18 16:29:02.988631 | controller | changed: [instance]
2026-03-18 16:29:03.533867 | controller |
2026-03-18 16:29:03.533900 | controller | TASK [ci_setup : Gather version of openshift client] ***************************
2026-03-18 16:29:03.533908 | controller | Wednesday 18 March 2026  16:29:02 +0000 (0:00:03.648)       0:01:05.117 *******
2026-03-18 16:29:03.533918 | controller | ok: [instance]
2026-03-18 16:29:03.728623 | controller |
2026-03-18 16:29:03.728650 | controller | TASK [ci_setup : Ensure openshift client install path is present] **************
2026-03-18 16:29:03.728658 | controller | Wednesday 18 March 2026  16:29:03 +0000 (0:00:00.545)       0:01:05.662 *******
2026-03-18 16:29:03.728668 | controller | changed: [instance]
2026-03-18 16:29:08.564550 | controller |
2026-03-18 16:29:08.564581 | controller | TASK [ci_setup : Install openshift client] *************************************
2026-03-18 16:29:08.564589 | controller | Wednesday 18 March 2026  16:29:03 +0000 (0:00:00.194)       0:01:05.857 *******
2026-03-18 16:29:08.564598 | controller | changed: [instance]
2026-03-18 16:29:08.603890 | controller |
2026-03-18 16:29:08.603912 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
2026-03-18 16:29:08.603921 | controller | Wednesday 18 March 2026  16:29:08 +0000 (0:00:04.835)       0:01:10.692 *******
2026-03-18 16:29:08.603954 | controller | ok: [instance]
2026-03-18 16:29:08.885832 | controller |
2026-03-18 16:29:08.885863 | controller | TASK [ci_setup : Create completion file] ***************************************
2026-03-18 16:29:08.885872 | controller | Wednesday 18 March 2026  16:29:08 +0000 (0:00:00.039)       0:01:10.732 *******
2026-03-18 16:29:08.885882 | controller | changed: [instance]
2026-03-18 16:29:09.168041 | controller |
2026-03-18 16:29:09.168076 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************
2026-03-18 16:29:09.168084 | controller | Wednesday 18 March 2026  16:29:08 +0000 (0:00:00.281)       0:01:11.014 *******
2026-03-18 16:29:09.168095 | controller | changed: [instance]
2026-03-18 16:29:09.190002 | controller |
2026-03-18 16:29:09.190022 | controller | TASK [ci_setup : Check rhsm status] ********************************************
2026-03-18 16:29:09.190030 | controller | Wednesday 18 March 2026  16:29:09 +0000 (0:00:00.281)       0:01:11.296 *******
2026-03-18 16:29:09.190041 | controller | skipping: [instance]
2026-03-18 16:29:09.190226 | controller |
2026-03-18 16:29:09.190261 | controller | TASK [ci_setup : Gather the repos to be enabled] *******************************
2026-03-18 16:29:09.211626 | controller | Wednesday 18 March 2026  16:29:09 +0000 (0:00:00.022)       0:01:11.319 *******
2026-03-18 16:29:09.211647 | controller | skipping: [instance]
2026-03-18 16:29:09.233664 | controller |
2026-03-18 16:29:09.233683 | controller | TASK [ci_setup : Enabling the required repositories.] **************************
2026-03-18 16:29:09.233691 | controller | Wednesday 18 March 2026  16:29:09 +0000 (0:00:00.021)       0:01:11.340 *******
2026-03-18 16:29:09.233700 | controller | skipping: [instance]
2026-03-18 16:29:09.254763 | controller |
2026-03-18 16:29:09.254785 | controller | TASK [ci_setup : Get current /etc/redhat-release] ******************************
2026-03-18 16:29:09.254792 | controller | Wednesday 18 March 2026  16:29:09 +0000 (0:00:00.022)       0:01:11.362 *******
2026-03-18 16:29:09.254800 | controller | skipping: [instance]
2026-03-18 16:29:09.273704 | controller |
2026-03-18 16:29:09.273735 | controller | TASK [ci_setup : Print current /etc/redhat-release] ****************************
2026-03-18 16:29:09.273752 | controller | Wednesday 18 March 2026  16:29:09 +0000 (0:00:00.020)       0:01:11.383 *******
2026-03-18 16:29:09.273760 | controller | skipping: [instance]
2026-03-18 16:29:09.273887 | controller |
2026-03-18 16:29:09.274040 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
2026-03-18 16:29:09.274169 | controller | Wednesday 18 March 2026  16:29:09 +0000 (0:00:00.019)       0:01:11.403 *******
2026-03-18 16:29:09.301414 | controller | skipping: [instance]
2026-03-18 16:29:09.301550 | controller |
2026-03-18 16:29:09.301675 | controller | TASK [ci_setup : Manage directories] *******************************************
2026-03-18 16:29:09.301795 | controller | Wednesday 18 March 2026  16:29:09 +0000 (0:00:00.027)       0:01:11.430 *******
2026-03-18 16:29:10.280028 | controller | changed: [instance] => (item=/opt/basedir/artifacts/manifests/openstack/cr)
2026-03-18 16:29:10.280077 | controller | changed: [instance] => (item=/opt/basedir/logs)
2026-03-18 16:29:10.280085 | controller | ok: [instance] => (item=/opt/basedir/tmp)
2026-03-18 16:29:10.280091 | controller | changed: [instance] => (item=/opt/basedir/volumes)
2026-03-18 16:29:10.280097 | controller | changed: [instance] => (item=/opt/basedir/artifacts/parameters)
2026-03-18 16:29:10.280104 | controller |
2026-03-18 16:29:10.280283 | controller | TASK [Create secret file] ******************************************************
2026-03-18 16:29:10.638095 | controller | Wednesday 18 March 2026  16:29:10 +0000 (0:00:00.978)       0:01:12.408 *******
2026-03-18 16:29:10.638140 | controller | changed: [instance]
2026-03-18 16:29:10.638203 | controller |
2026-03-18 16:29:10.638219 | controller | PLAY RECAP *********************************************************************
2026-03-18 16:29:10.638229 | controller | instance                   : ok=31   changed=17   unreachable=0    failed=0    skipped=36   rescued=0    ignored=0
2026-03-18 16:29:10.638254 | controller |
2026-03-18 16:29:10.640053 | controller | Wednesday 18 March 2026  16:29:10 +0000 (0:00:00.358)       0:01:12.766 *******
2026-03-18 16:29:10.689191 | controller | ===============================================================================
2026-03-18 16:29:10.689211 | controller | test_deps : Install selinux python libs -------------------------------- 44.05s
2026-03-18 16:29:10.689218 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.35s
2026-03-18 16:29:10.689223 | controller | ci_setup : Install openshift client ------------------------------------- 4.84s
2026-03-18 16:29:10.689228 | controller | ci_setup : Install needed packages -------------------------------------- 3.65s
2026-03-18 16:29:10.689233 | controller | test_deps : Install python yaml libs ------------------------------------ 1.24s
2026-03-18 16:29:10.689238 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.09s
2026-03-18 16:29:10.689243 | controller | ci_setup : Manage directories ------------------------------------------- 0.98s
2026-03-18 16:29:10.689248 | controller | repo_setup : Run repo-setup --------------------------------------------- 0.85s
2026-03-18 16:29:10.689253 | controller | Gathering Facts --------------------------------------------------------- 0.82s
2026-03-18 16:29:10.689258 | controller | repo_setup : Make sure git-core package is installed -------------------- 0.81s
2026-03-18 16:29:10.689262 | controller | repo_setup : Install repo-setup package --------------------------------- 0.68s
2026-03-18 16:29:10.689267 | controller | test_deps : Disable ubi 9 repos ----------------------------------------- 0.67s
2026-03-18 16:29:10.689272 | controller | ci_setup : Gather version of openshift client --------------------------- 0.55s
2026-03-18 16:29:10.689277 | controller | repo_setup : Run repo-setup-get-hash ------------------------------------ 0.52s
2026-03-18 16:29:10.689282 | controller | repo_setup : Ensure directories are present ----------------------------- 0.51s
2026-03-18 16:29:10.689287 | controller | repo_setup : Dump full hash in delorean.repo.md5 file ------------------- 0.43s
2026-03-18 16:29:10.689292 | controller | Create secret file ------------------------------------------------------ 0.36s
2026-03-18 16:29:10.689297 | controller | Create custom basedir --------------------------------------------------- 0.30s
2026-03-18 16:29:10.689301 | controller | ci_setup : Source completion from within .bashrc ------------------------ 0.28s
2026-03-18 16:29:10.689311 | controller | ci_setup : Create completion file --------------------------------------- 0.28s
2026-03-18 16:29:10.689320 | controller | INFO     Running crc_layout > converge
2026-03-18 16:29:11.294580 | controller |
2026-03-18 16:29:11.294755 | controller | PLAY [Converge] ****************************************************************
2026-03-18 16:29:11.294885 | controller |
2026-03-18 16:29:11.295048 | controller | TASK [Gathering Facts] *********************************************************
2026-03-18 16:29:11.295208 | controller | Wednesday 18 March 2026  16:29:11 +0000 (0:00:00.029)       0:00:00.029 *******
2026-03-18 16:29:12.109375 | controller | ok: [instance]
2026-03-18 16:29:12.129681 | controller |
2026-03-18 16:29:12.129704 | controller | TASK [Load networking definition from scenario file] ***************************
2026-03-18 16:29:12.129713 | controller | Wednesday 18 March 2026  16:29:12 +0000 (0:00:00.814)       0:00:00.843 *******
2026-03-18 16:29:12.129724 | controller | ok: [instance]
2026-03-18 16:29:12.147071 | controller |
2026-03-18 16:29:12.147112 | controller | TASK [discover_latest_image : Set the discovered images dict to empty] *********
2026-03-18 16:29:12.147123 | controller | Wednesday 18 March 2026  16:29:12 +0000 (0:00:00.020)       0:00:00.864 *******
2026-03-18 16:29:12.147146 | controller | ok: [instance]
2026-03-18 16:29:12.147184 | controller |
2026-03-18 16:29:12.147212 | controller | TASK [discover_latest_image : Discover images] *********************************
2026-03-18 16:29:12.147339 | controller | Wednesday 18 March 2026  16:29:12 +0000 (0:00:00.017)       0:00:00.881 *******
2026-03-18 16:29:12.184895 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/discover_latest_image/tasks/per-image.yml for instance => (item={'key': 'default', 'value': {'base_url': 'https://cloud.centos.org/centos/9-stream/x86_64/images/', 'qcow_prefix': 'CentOS-Stream-GenericCloud-', 'images_file': 'CHECKSUM'}})
2026-03-18 16:29:12.228045 | controller |
2026-03-18 16:29:12.228071 | controller | TASK [discover_latest_image : Ensure the current image dict entry has the expected data] ***
2026-03-18 16:29:12.228081 | controller | Wednesday 18 March 2026  16:29:12 +0000 (0:00:00.037)       0:00:00.919 *******
2026-03-18 16:29:12.228093 | controller | ok: [instance] => changed=false
2026-03-18 16:29:12.228493 | controller |   msg: All assertions passed
2026-03-18 16:29:14.021824 | controller |
2026-03-18 16:29:14.021855 | controller | TASK [discover_latest_image : Get latest image for the current entry] **********
2026-03-18 16:29:14.021863 | controller | Wednesday 18 March 2026  16:29:12 +0000 (0:00:00.043)       0:00:00.962 *******
2026-03-18 16:29:14.021873 | controller | changed: [instance]
2026-03-18 16:29:14.053068 | controller |
2026-03-18 16:29:14.053104 | controller | TASK [discover_latest_image : Append the current return value to the discovered images dict] ***
2026-03-18 16:29:14.053114 | controller | Wednesday 18 March 2026  16:29:14 +0000 (0:00:01.793)       0:00:02.756 *******
2026-03-18 16:29:14.053126 | controller | ok: [instance]
2026-03-18 16:29:14.053399 | controller |
2026-03-18 16:29:14.053414 | controller | TASK [discover_latest_image : Export single-image facts if an image with name 'default' was discovered] ***
2026-03-18 16:29:14.053425 | controller | Wednesday 18 March 2026  16:29:14 +0000 (0:00:00.031)       0:00:02.787 *******
2026-03-18 16:29:14.084069 | controller | ok: [instance]
2026-03-18 16:29:14.084135 | controller |
2026-03-18 16:29:14.084313 | controller | TASK [reproducer : Load CI job environment] ************************************
2026-03-18 16:29:14.105471 | controller | Wednesday 18 March 2026  16:29:14 +0000 (0:00:00.031)       0:00:02.819 *******
2026-03-18 16:29:14.105494 | controller | skipping: [instance]
2026-03-18 16:29:14.152160 | controller |
2026-03-18 16:29:14.152206 | controller | TASK [Build final libvirt layout] **********************************************
2026-03-18 16:29:14.152220 | controller | Wednesday 18 March 2026  16:29:14 +0000 (0:00:00.021)       0:00:02.840 *******
2026-03-18 16:29:14.152236 | controller |
2026-03-18 16:29:14.152277 | controller | TASK [libvirt_manager : Chose right parameter for layout definition] ***********
2026-03-18 16:29:14.152290 | controller | Wednesday 18 March 2026  16:29:14 +0000 (0:00:00.046)       0:00:02.886 *******
2026-03-18 16:29:14.228985 | controller | ok: [instance]
2026-03-18 16:29:14.229445 | controller |
2026-03-18 16:29:14.229482 | controller | TASK [libvirt_manager : Patch the layout if needed] ****************************
2026-03-18 16:29:14.290306 | controller | Wednesday 18 March 2026  16:29:14 +0000 (0:00:00.077)       0:00:02.963 *******
2026-03-18 16:29:14.290336 | controller | skipping: [instance]
2026-03-18 16:29:14.326566 | controller |
2026-03-18 16:29:14.326585 | controller | TASK [reproducer : Assert no conflicting parameters were passed] ***************
2026-03-18 16:29:14.326593 | controller | Wednesday 18 March 2026  16:29:14 +0000 (0:00:00.061)       0:00:03.025 *******
2026-03-18 16:29:14.326602 | controller | ok: [instance]
2026-03-18 16:29:14.326739 | controller |
2026-03-18 16:29:14.326880 | controller | TASK [reproducer : Assert that deprecated cifmw_reproducer_internal_ca parameters was not passed] ***
2026-03-18 16:29:14.327041 | controller | Wednesday 18 March 2026  16:29:14 +0000 (0:00:00.036)       0:00:03.061 *******
2026-03-18 16:29:14.349655 | controller | ok: [instance] => changed=false
2026-03-18 16:29:14.349831 | controller |   msg: All assertions passed
2026-03-18 16:29:14.350011 | controller |
2026-03-18 16:29:14.350184 | controller | TASK [reproducer : Set _use_crc based on actual layout] ************************
2026-03-18 16:29:14.350313 | controller | Wednesday 18 March 2026  16:29:14 +0000 (0:00:00.023)       0:00:03.084 *******
2026-03-18 16:29:14.395397 | controller | ok: [instance]
2026-03-18 16:29:14.395663 | controller |
2026-03-18 16:29:14.395923 | controller | TASK [reproducer : Register current host as controller-0] **********************
2026-03-18 16:29:14.396254 | controller | Wednesday 18 March 2026  16:29:14 +0000 (0:00:00.045)       0:00:03.130 *******
2026-03-18 16:29:14.422684 | controller | skipping: [instance]
2026-03-18 16:29:14.422865 | controller |
2026-03-18 16:29:14.423067 | controller | TASK [reproducer : Set minimal libvirt layout for bare metal OCP] **************
2026-03-18 16:29:14.423255 | controller | Wednesday 18 March 2026  16:29:14 +0000 (0:00:00.027)       0:00:03.157 *******
2026-03-18 16:29:14.449633 | controller | skipping: [instance]
2026-03-18 16:29:14.449814 | controller |
2026-03-18 16:29:14.450012 | controller | TASK [reproducer : Ensure directories are present] *****************************
2026-03-18 16:29:14.450202 | controller | Wednesday 18 March 2026  16:29:14 +0000 (0:00:00.026)       0:00:03.184 *******
2026-03-18 16:29:14.886081 | controller | ok: [instance] => (item=artifacts)
2026-03-18 16:29:14.950877 | controller | ok: [instance] => (item=logs)
2026-03-18 16:29:14.950910 | controller |
2026-03-18 16:29:14.950924 | controller | TASK [Bootstrap libvirt if needed] *********************************************
2026-03-18 16:29:14.950972 | controller | Wednesday 18 March 2026  16:29:14 +0000 (0:00:00.436)       0:00:03.620 *******
2026-03-18 16:29:14.950989 | controller |
2026-03-18 16:29:15.125777 | controller | TASK [libvirt_manager : Ensure output directory exists] ************************
2026-03-18 16:29:15.125796 | controller | Wednesday 18 March 2026  16:29:14 +0000 (0:00:00.064)       0:00:03.685 *******
2026-03-18 16:29:15.125806 | controller | ok: [instance]
2026-03-18 16:29:15.392953 | controller |
2026-03-18 16:29:15.392985 | controller | TASK [libvirt_manager : Get vmx/svm extensions from /proc/cpuinfo] *************
2026-03-18 16:29:15.392994 | controller | Wednesday 18 March 2026  16:29:15 +0000 (0:00:00.174)       0:00:03.860 *******
2026-03-18 16:29:15.393010 | controller | changed: [instance]
2026-03-18 16:29:15.666421 | controller |
2026-03-18 16:29:15.666445 | controller | TASK [libvirt_manager : Check if KVM is enabled] *******************************
2026-03-18 16:29:15.666453 | controller | Wednesday 18 March 2026  16:29:15 +0000 (0:00:00.267)       0:00:04.127 *******
2026-03-18 16:29:15.666463 | controller | ok: [instance]
2026-03-18 16:29:15.695027 | controller |
2026-03-18 16:29:15.695075 | controller | TASK [libvirt_manager : Fail if KVM not enabled] *******************************
2026-03-18 16:29:15.695086 | controller | Wednesday 18 March 2026  16:29:15 +0000 (0:00:00.273)       0:00:04.401 *******
2026-03-18 16:29:15.695099 | controller | skipping: [instance]
2026-03-18 16:29:15.695538 | controller |
2026-03-18 16:29:15.712544 | controller | TASK [libvirt_manager : Check if VMX virtualization] ***************************
2026-03-18 16:29:15.712574 | controller | Wednesday 18 March 2026  16:29:15 +0000 (0:00:00.028)       0:00:04.429 *******
2026-03-18 16:29:15.712592 | controller | skipping: [instance]
2026-03-18 16:29:15.733660 | controller |
2026-03-18 16:29:15.733693 | controller | TASK [libvirt_manager : Check if SVM virtualization] ***************************
2026-03-18 16:29:15.733707 | controller | Wednesday 18 March 2026  16:29:15 +0000 (0:00:00.017)       0:00:04.447 *******
2026-03-18 16:29:15.733723 | controller | ok: [instance]
2026-03-18 16:29:15.761818 | controller |
2026-03-18 16:29:15.761839 | controller | TASK [libvirt_manager : Enable VMX virtualization] *****************************
2026-03-18 16:29:15.761847 | controller | Wednesday 18 March 2026  16:29:15 +0000 (0:00:00.020)       0:00:04.467 *******
2026-03-18 16:29:15.761856 | controller | skipping: [instance]
2026-03-18 16:29:28.439027 | controller |
2026-03-18 16:29:28.439063 | controller | TASK [libvirt_manager : Install packages required for using KVM] ***************
2026-03-18 16:29:28.439072 | controller | Wednesday 18 March 2026  16:29:15 +0000 (0:00:00.028)       0:00:04.496 *******
2026-03-18 16:29:28.439090 | controller | changed: [instance]
2026-03-18 16:29:28.645571 | controller |
2026-03-18 16:29:28.645600 | controller | TASK [libvirt_manager : Create rules.d polkit folder] **************************
2026-03-18 16:29:28.645608 | controller | Wednesday 18 March 2026  16:29:28 +0000 (0:00:12.677)       0:00:17.173 *******
2026-03-18 16:29:28.645619 | controller | changed: [instance]
2026-03-18 16:29:28.645643 | controller |
2026-03-18 16:29:28.645886 | controller | TASK [libvirt_manager : Enable UNIX socket PolicyKit auth] *********************
2026-03-18 16:29:29.134575 | controller | Wednesday 18 March 2026  16:29:28 +0000 (0:00:00.206)       0:00:17.380 *******
2026-03-18 16:29:29.134609 | controller | changed: [instance]
2026-03-18 16:29:29.704566 | controller |
2026-03-18 16:29:29.704595 | controller | TASK [libvirt_manager : Restart service polkit service] ************************
2026-03-18 16:29:29.704604 | controller | Wednesday 18 March 2026  16:29:29 +0000 (0:00:00.488)       0:00:17.869 *******
2026-03-18 16:29:29.704615 | controller | changed: [instance]
2026-03-18 16:29:29.894596 | controller |
2026-03-18 16:29:29.894625 | controller | TASK [libvirt_manager : Remove directory for service override] *****************
2026-03-18 16:29:29.894633 | controller | Wednesday 18 March 2026  16:29:29 +0000 (0:00:00.570)       0:00:18.439 *******
2026-03-18 16:29:29.894642 | controller | ok: [instance]
2026-03-18 16:29:30.523470 | controller |
2026-03-18 16:29:30.523503 | controller | TASK [libvirt_manager : Reload systemctl and start/enable virtproxyd.service] ***
2026-03-18 16:29:30.523511 | controller | Wednesday 18 March 2026  16:29:29 +0000 (0:00:00.190)       0:00:18.629 *******
2026-03-18 16:29:30.523522 | controller | ok: [instance]
2026-03-18 16:29:31.256946 | controller |
2026-03-18 16:29:31.256979 | controller | TASK [libvirt_manager : Ensure firewalld service is up] ************************
2026-03-18 16:29:31.256987 | controller | Wednesday 18 March 2026  16:29:30 +0000 (0:00:00.628)       0:00:19.257 *******
2026-03-18 16:29:31.256997 | controller | changed: [instance]
2026-03-18 16:29:31.339184 | controller |
2026-03-18 16:29:31.339238 | controller | TASK [libvirt_manager : Ensure libvirt modular driver daemons are started.] ****
2026-03-18 16:29:31.339255 | controller | Wednesday 18 March 2026  16:29:31 +0000 (0:00:00.733)       0:00:19.991 *******
2026-03-18 16:29:31.339272 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=qemu)
2026-03-18 16:29:31.339314 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=interface)
2026-03-18 16:29:31.339325 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=network)
2026-03-18 16:29:31.339337 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nodedev)
2026-03-18 16:29:31.339371 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=nwfilter)
2026-03-18 16:29:31.339899 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=secret)
2026-03-18 16:29:31.657044 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=storage)
2026-03-18 16:29:31.657088 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/drivers.yml for instance => (item=proxy)
2026-03-18 16:29:31.657098 | controller |
2026-03-18 16:29:31.657106 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for qemu.] *********
2026-03-18 16:29:31.657122 | controller | Wednesday 18 March 2026  16:29:31 +0000 (0:00:00.082)       0:00:20.073 *******
2026-03-18 16:29:31.657136 | controller | ok: [instance]
2026-03-18 16:29:31.657295 | controller |
2026-03-18 16:29:31.657315 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for qemu.] **********
2026-03-18 16:29:31.964012 | controller | Wednesday 18 March 2026  16:29:31 +0000 (0:00:00.318)       0:00:20.391 *******
2026-03-18 16:29:31.964055 | controller | ok: [instance]
2026-03-18 16:29:31.964094 | controller |
2026-03-18 16:29:31.964102 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for qemu.] **************
2026-03-18 16:29:32.266601 | controller | Wednesday 18 March 2026  16:29:31 +0000 (0:00:00.306)       0:00:20.698 *******
2026-03-18 16:29:32.266638 | controller | ok: [instance]
2026-03-18 16:29:32.568624 | controller |
2026-03-18 16:29:32.568654 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for interface.] ****
2026-03-18 16:29:32.568662 | controller | Wednesday 18 March 2026  16:29:32 +0000 (0:00:00.302)       0:00:21.001 *******
2026-03-18 16:29:32.568681 | controller | ok: [instance]
2026-03-18 16:29:32.872607 | controller |
2026-03-18 16:29:32.872635 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for interface.] *****
2026-03-18 16:29:32.872644 | controller | Wednesday 18 March 2026  16:29:32 +0000 (0:00:00.302)       0:00:21.303 *******
2026-03-18 16:29:32.872654 | controller | ok: [instance]
2026-03-18 16:29:33.174073 | controller |
2026-03-18 16:29:33.174110 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for interface.] *********
2026-03-18 16:29:33.174120 | controller | Wednesday 18 March 2026  16:29:32 +0000 (0:00:00.303)       0:00:21.607 *******
2026-03-18 16:29:33.174133 | controller | ok: [instance]
2026-03-18 16:29:33.174141 | controller |
2026-03-18 16:29:33.174148 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for network.] ******
2026-03-18 16:29:33.174158 | controller | Wednesday 18 March 2026  16:29:33 +0000 (0:00:00.301)       0:00:21.908 *******
2026-03-18 16:29:33.479999 | controller | ok: [instance]
2026-03-18 16:29:33.782539 | controller |
2026-03-18 16:29:33.782572 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for network.] *******
2026-03-18 16:29:33.782580 | controller | Wednesday 18 March 2026  16:29:33 +0000 (0:00:00.305)       0:00:22.214 *******
2026-03-18 16:29:33.782591 | controller | ok: [instance]
2026-03-18 16:29:34.095049 | controller |
2026-03-18 16:29:34.095076 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for network.] ***********
2026-03-18 16:29:34.095085 | controller | Wednesday 18 March 2026  16:29:33 +0000 (0:00:00.302)       0:00:22.517 *******
2026-03-18 16:29:34.095095 | controller | ok: [instance]
2026-03-18 16:29:34.402670 | controller |
2026-03-18 16:29:34.402697 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nodedev.] ******
2026-03-18 16:29:34.402706 | controller | Wednesday 18 March 2026  16:29:34 +0000 (0:00:00.312)       0:00:22.829 *******
2026-03-18 16:29:34.402716 | controller | ok: [instance]
2026-03-18 16:29:34.705119 | controller |
2026-03-18 16:29:34.705167 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nodedev.] *******
2026-03-18 16:29:34.705181 | controller | Wednesday 18 March 2026  16:29:34 +0000 (0:00:00.307)       0:00:23.137 *******
2026-03-18 16:29:34.705198 | controller | ok: [instance]
2026-03-18 16:29:35.018811 | controller |
2026-03-18 16:29:35.018846 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nodedev.] ***********
2026-03-18 16:29:35.018855 | controller | Wednesday 18 March 2026  16:29:34 +0000 (0:00:00.302)       0:00:23.439 *******
2026-03-18 16:29:35.018865 | controller | ok: [instance]
2026-03-18 16:29:35.325435 | controller |
2026-03-18 16:29:35.325470 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for nwfilter.] *****
2026-03-18 16:29:35.325478 | controller | Wednesday 18 March 2026  16:29:35 +0000 (0:00:00.313)       0:00:23.753 *******
2026-03-18 16:29:35.325489 | controller | ok: [instance]
2026-03-18 16:29:35.627068 | controller |
2026-03-18 16:29:35.627102 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for nwfilter.] ******
2026-03-18 16:29:35.627110 | controller | Wednesday 18 March 2026  16:29:35 +0000 (0:00:00.306)       0:00:24.059 *******
2026-03-18 16:29:35.627120 | controller | ok: [instance]
2026-03-18 16:29:35.627144 | controller |
2026-03-18 16:29:35.627152 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for nwfilter.] **********
2026-03-18 16:29:35.627285 | controller | Wednesday 18 March 2026  16:29:35 +0000 (0:00:00.301)       0:00:24.361 *******
2026-03-18 16:29:35.923089 | controller | ok: [instance]
2026-03-18 16:29:36.229904 | controller |
2026-03-18 16:29:36.229951 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for secret.] *******
2026-03-18 16:29:36.229962 | controller | Wednesday 18 March 2026  16:29:35 +0000 (0:00:00.295)       0:00:24.657 *******
2026-03-18 16:29:36.229973 | controller | ok: [instance]
2026-03-18 16:29:36.538668 | controller |
2026-03-18 16:29:36.538694 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for secret.] ********
2026-03-18 16:29:36.538703 | controller | Wednesday 18 March 2026  16:29:36 +0000 (0:00:00.306)       0:00:24.964 *******
2026-03-18 16:29:36.538713 | controller | ok: [instance]
2026-03-18 16:29:36.854017 | controller |
2026-03-18 16:29:36.854053 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for secret.] ************
2026-03-18 16:29:36.854061 | controller | Wednesday 18 March 2026  16:29:36 +0000 (0:00:00.308)       0:00:25.273 *******
2026-03-18 16:29:36.854078 | controller | ok: [instance]
2026-03-18 16:29:36.854103 | controller |
2026-03-18 16:29:36.854111 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for storage.] ******
2026-03-18 16:29:37.169764 | controller | Wednesday 18 March 2026  16:29:36 +0000 (0:00:00.315)       0:00:25.588 *******
2026-03-18 16:29:37.169796 | controller | ok: [instance]
2026-03-18 16:29:37.477535 | controller |
2026-03-18 16:29:37.477564 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for storage.] *******
2026-03-18 16:29:37.477582 | controller | Wednesday 18 March 2026  16:29:37 +0000 (0:00:00.315)       0:00:25.904 *******
2026-03-18 16:29:37.477592 | controller | ok: [instance]
2026-03-18 16:29:37.794053 | controller |
2026-03-18 16:29:37.794095 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for storage.] ***********
2026-03-18 16:29:37.794105 | controller | Wednesday 18 March 2026  16:29:37 +0000 (0:00:00.307)       0:00:26.212 *******
2026-03-18 16:29:37.794118 | controller | ok: [instance]
2026-03-18 16:29:38.118765 | controller |
2026-03-18 16:29:38.118797 | controller | TASK [libvirt_manager : Ensure read-write socket is enabled for proxy.] ********
2026-03-18 16:29:38.118805 | controller | Wednesday 18 March 2026  16:29:37 +0000 (0:00:00.316)       0:00:26.528 *******
2026-03-18 16:29:38.118816 | controller | ok: [instance]
2026-03-18 16:29:38.424684 | controller |
2026-03-18 16:29:38.424715 | controller | TASK [libvirt_manager : Ensure read-only socket is enabled for proxy.] *********
2026-03-18 16:29:38.424723 | controller | Wednesday 18 March 2026  16:29:38 +0000 (0:00:00.324)       0:00:26.853 *******
2026-03-18 16:29:38.424733 | controller | ok: [instance]
2026-03-18 16:29:38.724996 | controller |
2026-03-18 16:29:38.725028 | controller | TASK [libvirt_manager : Ensure admin socket is enabled for proxy.] *************
2026-03-18 16:29:38.725036 | controller | Wednesday 18 March 2026  16:29:38 +0000 (0:00:00.305)       0:00:27.159 *******
2026-03-18 16:29:38.725046 | controller | ok: [instance]
2026-03-18 16:29:38.743384 | controller |
2026-03-18 16:29:38.743402 | controller | TASK [libvirt_manager : Manage service for older releases] *********************
2026-03-18 16:29:38.743409 | controller | Wednesday 18 March 2026  16:29:38 +0000 (0:00:00.300)       0:00:27.459 *******
2026-03-18 16:29:38.743418 | controller | skipping: [instance]
2026-03-18 16:29:39.005707 | controller |
2026-03-18 16:29:39.005740 | controller | TASK [libvirt_manager : Get libvirt group users] *******************************
2026-03-18 16:29:39.005749 | controller | Wednesday 18 March 2026  16:29:38 +0000 (0:00:00.018)       0:00:27.478 *******
2026-03-18 16:29:39.005761 | controller | ok: [instance]
2026-03-18 16:29:39.380963 | controller |
2026-03-18 16:29:39.380998 | controller | TASK [libvirt_manager : Add user if not exists in libvirt group] ***************
2026-03-18 16:29:39.381007 | controller | Wednesday 18 March 2026  16:29:39 +0000 (0:00:00.262)       0:00:27.740 *******
2026-03-18 16:29:39.381017 | controller | ok: [instance]
2026-03-18 16:29:39.671041 | controller |
2026-03-18 16:29:39.671080 | controller | TASK [libvirt_manager : Allow QEMU on home directory for the storage access] ***
2026-03-18 16:29:39.671091 | controller | Wednesday 18 March 2026  16:29:39 +0000 (0:00:00.375)       0:00:28.115 *******
2026-03-18 16:29:39.671104 | controller | changed: [instance]
2026-03-18 16:29:39.923117 | controller |
2026-03-18 16:29:39.923150 | controller | TASK [libvirt_manager : Inject system connection parameters in bashrc] *********
2026-03-18 16:29:39.923164 | controller | Wednesday 18 March 2026  16:29:39 +0000 (0:00:00.290)       0:00:28.405 *******
2026-03-18 16:29:39.923174 | controller | [WARNING]: Reset is not implemented for this connection
2026-03-18 16:29:39.933109 | controller | changed: [instance]
2026-03-18 16:29:39.933196 | controller |
2026-03-18 16:29:39.933213 | controller | TASK [libvirt_manager : Ensure we reload user env] *****************************
2026-03-18 16:29:39.933220 | controller | Wednesday 18 March 2026  16:29:39 +0000 (0:00:00.246)       0:00:28.651 *******
2026-03-18 16:29:39.933226 | controller |
2026-03-18 16:29:39.933231 | controller | TASK [reproducer : Deploy networks in libvirt] *********************************
2026-03-18 16:29:39.933240 | controller | Wednesday 18 March 2026  16:29:39 +0000 (0:00:00.015)       0:00:28.667 *******
2026-03-18 16:29:39.998886 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/prepare_networking.yml for instance
2026-03-18 16:29:40.039091 | controller |
2026-03-18 16:29:40.039125 | controller | TASK [reproducer : Ensure networks are consistent] *****************************
2026-03-18 16:29:40.039134 | controller | Wednesday 18 March 2026  16:29:39 +0000 (0:00:00.065)       0:00:28.733 *******
2026-03-18 16:29:40.039146 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/network_assertions.yml for instance
2026-03-18 16:29:40.083088 | controller |
2026-03-18 16:29:40.083112 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-03-18 16:29:40.083122 | controller | Wednesday 18 March 2026  16:29:40 +0000 (0:00:00.040)       0:00:28.773 *******
2026-03-18 16:29:40.083132 | controller | ok: [instance] => (item=compute)
2026-03-18 16:29:40.083162 | controller | ok: [instance] => (item=controller)
2026-03-18 16:29:40.083169 | controller | ok: [instance] => (item=crc)
2026-03-18 16:29:40.083176 | controller |
2026-03-18 16:29:40.083184 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2026-03-18 16:29:40.083325 | controller | Wednesday 18 March 2026  16:29:40 +0000 (0:00:00.043)       0:00:28.817 *******
2026-03-18 16:29:40.121322 | controller | ok: [instance]
2026-03-18 16:29:40.163314 | controller |
2026-03-18 16:29:40.163348 | controller | TASK [reproducer : Ensure we don't have extra network defined] *****************
2026-03-18 16:29:40.163361 | controller | Wednesday 18 March 2026  16:29:40 +0000 (0:00:00.038)       0:00:28.856 *******
2026-03-18 16:29:40.163376 | controller | ok: [instance] => changed=false
2026-03-18 16:29:40.163606 | controller |   msg: All assertions passed
2026-03-18 16:29:40.163725 | controller |
2026-03-18 16:29:40.163847 | controller | TASK [Ensure we get latest OCP config] *****************************************
2026-03-18 16:29:40.164026 | controller | Wednesday 18 March 2026  16:29:40 +0000 (0:00:00.042)       0:00:28.898 *******
2026-03-18 16:29:40.203427 | controller |
2026-03-18 16:29:40.203674 | controller | TASK [devscripts : Gather the configurations to be passed to dev-scripts.] *****
2026-03-18 16:29:40.203799 | controller | Wednesday 18 March 2026  16:29:40 +0000 (0:00:00.040)       0:00:28.938 *******
2026-03-18 16:29:40.278864 | controller | ok: [instance] => (item={'working_dir': '/home/dev-scripts', 'assets_extra_folder': '/home/dev-scripts/assets', 'openshift_release_type': 'ga', 'openshift_version': '4.16.54', 'cluster_name': 'ocp', 'base_domain': 'openstack.lab', 'ntp_servers': 'clock.corp.redhat.com', 'provisioning_network_profile': 'Managed', 'provisioning_network': '172.22.0.0/24', 'cluster_subnet_v4': '192.168.16.0/20', 'cluster_host_prefix_v4': '23', 'service_subnet_v4': '172.30.0.0/16', 'external_subnet_v4': '192.168.111.0/24', 'num_masters': 3, 'num_workers': 0, 'ip_stack': 'v4', 'network_type': 'OVNKubernetes'})
2026-03-18 16:29:40.279200 | controller | ok: [instance] => (item={})
2026-03-18 16:29:40.279449 | controller |
2026-03-18 16:29:40.279717 | controller | TASK [devscripts : Check if num_masters is equal to 1 when cifmw_devscripts_sno] ***
2026-03-18 16:29:40.279846 | controller | Wednesday 18 March 2026  16:29:40 +0000 (0:00:00.075)       0:00:29.013 *******
2026-03-18 16:29:40.304997 | controller | skipping: [instance]
2026-03-18 16:29:40.305273 | controller |
2026-03-18 16:29:40.305534 | controller | TASK [devscripts : Replace OCP version if "stable-" alias used] ****************
2026-03-18 16:29:40.305806 | controller | Wednesday 18 March 2026  16:29:40 +0000 (0:00:00.026)       0:00:29.039 *******
2026-03-18 16:29:40.320503 | controller | skipping: [instance]
2026-03-18 16:29:40.320787 | controller |
2026-03-18 16:29:40.320979 | controller | TASK [devscripts : Ensure output directory exists] *****************************
2026-03-18 16:29:40.321107 | controller | Wednesday 18 March 2026  16:29:40 +0000 (0:00:00.015)       0:00:29.055 *******
2026-03-18 16:29:40.526895 | controller | ok: [instance]
2026-03-18 16:29:40.852007 | controller |
2026-03-18 16:29:40.852028 | controller | TASK [devscripts : Output built config for easier debugging] *******************
2026-03-18 16:29:40.852036 | controller | Wednesday 18 March 2026  16:29:40 +0000 (0:00:00.205)       0:00:29.261 *******
2026-03-18 16:29:40.852045 | controller | changed: [instance]
2026-03-18 16:29:41.570052 | controller |
2026-03-18 16:29:41.570086 | controller | TASK [ci_network : Remove the local dns configuration] *************************
2026-03-18 16:29:41.570097 | controller | Wednesday 18 March 2026  16:29:40 +0000 (0:00:00.325)       0:00:29.586 *******
2026-03-18 16:29:41.570109 | controller | ok: [instance] => (item=/etc/NetworkManager/conf.d/00-use-dnsmasq.conf)
2026-03-18 16:29:41.570138 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/98-cifmw-static-leases.conf)
2026-03-18 16:29:41.570553 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/99-cifmw-dns-forwarders.conf)
2026-03-18 16:29:41.595071 | controller | ok: [instance] => (item=/etc/NetworkManager/dnsmasq.d/97-cifmw-local-domain.conf)
2026-03-18 16:29:41.595102 | controller |
2026-03-18 16:29:41.595114 | controller | TASK [ci_network : Reload the NetworkManager to pick the changes] **************
2026-03-18 16:29:41.595124 | controller | Wednesday 18 March 2026  16:29:41 +0000 (0:00:00.718)       0:00:30.304 *******
2026-03-18 16:29:41.595138 | controller | skipping: [instance]
2026-03-18 16:29:41.948519 | controller |
2026-03-18 16:29:41.948547 | controller | TASK [reproducer : Ensure NetworkManager is configured to use dnsmasq] *********
2026-03-18 16:29:41.948554 | controller | Wednesday 18 March 2026  16:29:41 +0000 (0:00:00.024)       0:00:30.329 *******
2026-03-18 16:29:41.948563 | controller | changed: [instance]
2026-03-18 16:29:42.360485 | controller |
2026-03-18 16:29:42.360517 | controller | TASK [reproducer : Flush handlers for NetworkManager restart] ******************
2026-03-18 16:29:42.360536 | controller | Wednesday 18 March 2026  16:29:41 +0000 (0:00:00.345)       0:00:30.674 *******
2026-03-18 16:29:42.360542 | controller |
2026-03-18 16:29:42.360548 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-03-18 16:29:42.360553 | controller | Wednesday 18 March 2026  16:29:41 +0000 (0:00:00.008)       0:00:30.683 *******
2026-03-18 16:29:42.360563 | controller | changed: [instance]
2026-03-18 16:29:42.435038 | controller |
2026-03-18 16:29:42.435066 | controller | TASK [Ensure no default networks exists] ***************************************
2026-03-18 16:29:42.435077 | controller | Wednesday 18 March 2026  16:29:42 +0000 (0:00:00.411)       0:00:31.094 *******
2026-03-18 16:29:42.435099 | controller |
2026-03-18 16:29:42.435142 | controller | TASK [libvirt_manager : Deactivate crc] ****************************************
2026-03-18 16:29:42.435235 | controller | Wednesday 18 March 2026  16:29:42 +0000 (0:00:00.074)       0:00:31.169 *******
2026-03-18 16:29:43.623324 | controller | ok: [instance]
2026-03-18 16:29:43.849876 | controller |
2026-03-18 16:29:43.849915 | controller | TASK [libvirt_manager : Removing crc] ******************************************
2026-03-18 16:29:43.849925 | controller | Wednesday 18 March 2026  16:29:43 +0000 (0:00:01.187)       0:00:32.357 *******
2026-03-18 16:29:43.849961 | controller | ok: [instance]
2026-03-18 16:29:44.349880 | controller |
2026-03-18 16:29:44.349911 | controller | TASK [libvirt_manager : Deactivate default] ************************************
2026-03-18 16:29:44.349919 | controller | Wednesday 18 March 2026  16:29:43 +0000 (0:00:00.226)       0:00:32.584 *******
2026-03-18 16:29:44.349943 | controller | ok: [instance]
2026-03-18 16:29:44.573992 | controller |
2026-03-18 16:29:44.574020 | controller | TASK [libvirt_manager : Removing default] **************************************
2026-03-18 16:29:44.574028 | controller | Wednesday 18 March 2026  16:29:44 +0000 (0:00:00.500)       0:00:33.084 *******
2026-03-18 16:29:44.574039 | controller | ok: [instance]
2026-03-18 16:29:44.574259 | controller |
2026-03-18 16:29:44.574273 | controller | TASK [reproducer : Ensure firewalld is installed] ******************************
2026-03-18 16:29:45.762361 | controller | Wednesday 18 March 2026  16:29:44 +0000 (0:00:00.224)       0:00:33.308 *******
2026-03-18 16:29:45.762395 | controller | ok: [instance]
2026-03-18 16:29:46.062373 | controller |
2026-03-18 16:29:46.062403 | controller | TASK [reproducer : Ensure firewalld service is enabled and started] ************
2026-03-18 16:29:46.062412 | controller | Wednesday 18 March 2026  16:29:45 +0000 (0:00:01.188)       0:00:34.496 *******
2026-03-18 16:29:46.062422 | controller | ok: [instance]
2026-03-18 16:29:46.375646 | controller |
2026-03-18 16:29:46.375675 | controller | TASK [reproducer : Ensure br_netfilter module is loaded] ***********************
2026-03-18 16:29:46.375684 | controller | Wednesday 18 March 2026  16:29:46 +0000 (0:00:00.300)       0:00:34.797 *******
2026-03-18 16:29:46.375694 | controller | changed: [instance]
2026-03-18 16:29:46.681003 | controller |
2026-03-18 16:29:46.681042 | controller | TASK [reproducer : Ensure IP forwarding is enabled] ****************************
2026-03-18 16:29:46.681051 | controller | Wednesday 18 March 2026  16:29:46 +0000 (0:00:00.313)       0:00:35.110 *******
2026-03-18 16:29:46.681061 | controller | changed: [instance]
2026-03-18 16:29:46.681080 | controller |
2026-03-18 16:29:46.681143 | controller | TASK [reproducer : Ensure the required parameters are loaded] ******************
2026-03-18 16:29:46.681273 | controller | Wednesday 18 March 2026  16:29:46 +0000 (0:00:00.305)       0:00:35.415 *******
2026-03-18 16:29:47.238890 | controller | changed: [instance] => (item=arptables)
2026-03-18 16:29:47.569832 | controller | changed: [instance] => (item=iptables)
2026-03-18 16:29:47.569858 | controller | changed: [instance] => (item=ip6tables)
2026-03-18 16:29:47.569866 | controller |
2026-03-18 16:29:47.569873 | controller | TASK [reproducer : Ensure firewall service is enabled and started] *************
2026-03-18 16:29:47.569880 | controller | Wednesday 18 March 2026  16:29:47 +0000 (0:00:00.557)       0:00:35.973 *******
2026-03-18 16:29:47.569889 | controller | ok: [instance]
2026-03-18 16:29:47.656515 | controller |
2026-03-18 16:29:47.656533 | controller | TASK [reproducer : Set cifmw_ci_nmstate_instance_config if needed] *************
2026-03-18 16:29:47.656540 | controller | Wednesday 18 March 2026  16:29:47 +0000 (0:00:00.331)       0:00:36.304 *******
2026-03-18 16:29:47.656548 | controller | ok: [instance]
2026-03-18 16:29:47.699922 | controller |
2026-03-18 16:29:47.699961 | controller | TASK [Ensure the required network configurations are applied] ******************
2026-03-18 16:29:47.699969 | controller | Wednesday 18 March 2026  16:29:47 +0000 (0:00:00.086)       0:00:36.391 *******
2026-03-18 16:29:47.699977 | controller |
2026-03-18 16:29:47.723147 | controller | TASK [networking_mapper : Check for Networking Environment Definition file existence] ***
2026-03-18 16:29:47.723185 | controller | Wednesday 18 March 2026  16:29:47 +0000 (0:00:00.043)       0:00:36.434 *******
2026-03-18 16:29:47.723199 | controller | skipping: [instance]
2026-03-18 16:29:47.723221 | controller |
2026-03-18 16:29:47.723238 | controller | TASK [networking_mapper : Check for Networking Definition file existance] ******
2026-03-18 16:29:47.723258 | controller | Wednesday 18 March 2026  16:29:47 +0000 (0:00:00.023)       0:00:36.458 *******
2026-03-18 16:29:47.745573 | controller | skipping: [instance]
2026-03-18 16:29:47.745615 | controller |
2026-03-18 16:29:47.745727 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-18 16:29:47.745811 | controller | Wednesday 18 March 2026  16:29:47 +0000 (0:00:00.022)       0:00:36.480 *******
2026-03-18 16:29:47.768028 | controller | skipping: [instance]
2026-03-18 16:29:47.768074 | controller |
2026-03-18 16:29:47.768192 | controller | TASK [networking_mapper : Set cifmw_networking_env_definition is present] ******
2026-03-18 16:29:47.768268 | controller | Wednesday 18 March 2026  16:29:47 +0000 (0:00:00.022)       0:00:36.503 *******
2026-03-18 16:29:47.794998 | controller | skipping: [instance]
2026-03-18 16:29:47.795256 | controller |
2026-03-18 16:29:47.833060 | controller | TASK [ci_nmstate : Initialize NMstates for each instance] **********************
2026-03-18 16:29:47.833099 | controller | Wednesday 18 March 2026  16:29:47 +0000 (0:00:00.026)       0:00:36.530 *******
2026-03-18 16:29:47.833114 | controller | ok: [instance]
2026-03-18 16:29:47.864306 | controller |
2026-03-18 16:29:47.864330 | controller | TASK [ci_nmstate : Build NMstates from the Networking Environment Definition] ***
2026-03-18 16:29:47.864339 | controller | Wednesday 18 March 2026  16:29:47 +0000 (0:00:00.037)       0:00:36.567 *******
2026-03-18 16:29:47.864358 | controller | skipping: [instance]
2026-03-18 16:29:47.889085 | controller |
2026-03-18 16:29:47.889127 | controller | TASK [ci_nmstate : Get k8s nodes] **********************************************
2026-03-18 16:29:47.889137 | controller | Wednesday 18 March 2026  16:29:47 +0000 (0:00:00.031)       0:00:36.599 *******
2026-03-18 16:29:47.889150 | controller | skipping: [instance]
2026-03-18 16:29:47.941608 | controller |
2026-03-18 16:29:47.941634 | controller | TASK [ci_nmstate : Set the hosts that will provision nmstate using k8s] ********
2026-03-18 16:29:47.941644 | controller | Wednesday 18 March 2026  16:29:47 +0000 (0:00:00.024)       0:00:36.623 *******
2026-03-18 16:29:47.941656 | controller | ok: [instance]
2026-03-18 16:29:47.962022 | controller |
2026-03-18 16:29:47.962045 | controller | TASK [ci_nmstate : Provision k8s workers with nmstate] *************************
2026-03-18 16:29:47.962053 | controller | Wednesday 18 March 2026  16:29:47 +0000 (0:00:00.052)       0:00:36.676 *******
2026-03-18 16:29:47.962064 | controller | skipping: [instance]
2026-03-18 16:29:48.006143 | controller |
2026-03-18 16:29:48.006185 | controller | TASK [ci_nmstate : Provision unmanaged nodes with nmstate] *********************
2026-03-18 16:29:48.006196 | controller | Wednesday 18 March 2026  16:29:47 +0000 (0:00:00.020)       0:00:36.696 *******
2026-03-18 16:29:48.006216 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_nmstate/tasks/nmstate_unmanaged_provision_node.yml for instance => (item=localhost)
2026-03-18 16:29:48.006248 | controller |
2026-03-18 16:29:48.006565 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2026-03-18 16:29:48.314622 | controller | Wednesday 18 March 2026  16:29:48 +0000 (0:00:00.044)       0:00:36.740 *******
2026-03-18 16:29:48.314647 | controller | ok: [instance -> localhost]
2026-03-18 16:29:53.465726 | controller |
2026-03-18 16:29:53.465759 | controller | TASK [ci_nmstate : Install required packages on localhost] *********************
2026-03-18 16:29:53.465767 | controller | Wednesday 18 March 2026  16:29:48 +0000 (0:00:00.308)       0:00:37.049 *******
2026-03-18 16:29:53.465777 | controller | changed: [instance -> localhost]
2026-03-18 16:29:53.650781 | controller |
2026-03-18 16:29:53.650801 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2026-03-18 16:29:53.650809 | controller | Wednesday 18 March 2026  16:29:53 +0000 (0:00:05.150)       0:00:42.200 *******
2026-03-18 16:29:53.650818 | controller | changed: [instance]
2026-03-18 16:29:53.990011 | controller |
2026-03-18 16:29:53.990036 | controller | TASK [ci_nmstate : Save nmstate state for localhost] ***************************
2026-03-18 16:29:53.990044 | controller | Wednesday 18 March 2026  16:29:53 +0000 (0:00:00.185)       0:00:42.385 *******
2026-03-18 16:29:53.990054 | controller | changed: [instance]
2026-03-18 16:29:55.580700 | controller |
2026-03-18 16:29:55.580734 | controller | TASK [ci_nmstate : Apply the desidered state on localhost] *********************
2026-03-18 16:29:55.580742 | controller | Wednesday 18 March 2026  16:29:53 +0000 (0:00:00.339)       0:00:42.724 *******
2026-03-18 16:29:55.580752 | controller | changed: [instance -> localhost]
2026-03-18 16:29:55.923876 | controller |
2026-03-18 16:29:55.923904 | controller | TASK [ci_nmstate : Save nmstate debugging data for localhost] ******************
2026-03-18 16:29:55.923912 | controller | Wednesday 18 March 2026  16:29:55 +0000 (0:00:01.590)       0:00:44.314 *******
2026-03-18 16:29:55.923922 | controller | changed: [instance]
2026-03-18 16:29:55.953059 | controller |
2026-03-18 16:29:55.953105 | controller | TASK [reproducer : Select right domain] ****************************************
2026-03-18 16:29:55.953115 | controller | Wednesday 18 March 2026  16:29:55 +0000 (0:00:00.343)       0:00:44.658 *******
2026-03-18 16:29:55.953129 | controller | ok: [instance]
2026-03-18 16:29:56.068818 | controller |
2026-03-18 16:29:56.068844 | controller | TASK [Create the virtual networks] *********************************************
2026-03-18 16:29:56.068853 | controller | Wednesday 18 March 2026  16:29:55 +0000 (0:00:00.029)       0:00:44.687 *******
2026-03-18 16:29:56.068865 | controller |
2026-03-18 16:29:56.109436 | controller | TASK [libvirt_manager : Ensure fact is existing, and empty] ********************
2026-03-18 16:29:56.109457 | controller | Wednesday 18 March 2026  16:29:56 +0000 (0:00:00.115)       0:00:44.803 *******
2026-03-18 16:29:56.109469 | controller | ok: [instance]
2026-03-18 16:29:56.291440 | controller |
2026-03-18 16:29:56.291460 | controller | TASK [libvirt_manager : Check if we get an existing interfaces-info.yml] *******
2026-03-18 16:29:56.291473 | controller | Wednesday 18 March 2026  16:29:56 +0000 (0:00:00.040)       0:00:44.844 *******
2026-03-18 16:29:56.291482 | controller | ok: [instance]
2026-03-18 16:29:56.320037 | controller |
2026-03-18 16:29:56.320073 | controller | TASK [libvirt_manager : Load file if exists] ***********************************
2026-03-18 16:29:56.320083 | controller | Wednesday 18 March 2026  16:29:56 +0000 (0:00:00.181)       0:00:45.026 *******
2026-03-18 16:29:56.320095 | controller | skipping: [instance]
2026-03-18 16:29:56.320122 | controller |
2026-03-18 16:29:56.320132 | controller | TASK [libvirt_manager : Update fact with existing content] *********************
2026-03-18 16:29:56.320256 | controller | Wednesday 18 March 2026  16:29:56 +0000 (0:00:00.028)       0:00:45.054 *******
2026-03-18 16:29:56.348643 | controller | skipping: [instance]
2026-03-18 16:29:56.402814 | controller |
2026-03-18 16:29:56.402838 | controller | TASK [libvirt_manager : Generate VM list] **************************************
2026-03-18 16:29:56.402847 | controller | Wednesday 18 March 2026  16:29:56 +0000 (0:00:00.028)       0:00:45.082 *******
2026-03-18 16:29:56.402858 | controller | ok: [instance]
2026-03-18 16:29:56.521627 | controller |
2026-03-18 16:29:56.521646 | controller | TASK [libvirt_manager : Generate/update mapping all nodes] *********************
2026-03-18 16:29:56.521654 | controller | Wednesday 18 March 2026  16:29:56 +0000 (0:00:00.054)       0:00:45.137 *******
2026-03-18 16:29:56.521663 | controller | ok: [instance] => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-18 16:29:56.554042 | controller | ok: [instance] => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-18 16:29:56.554075 | controller | ok: [instance] => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-18 16:29:56.554083 | controller |
2026-03-18 16:29:56.554090 | controller | TASK [libvirt_manager : Append baremetal nodes if needed] **********************
2026-03-18 16:29:56.554095 | controller | Wednesday 18 March 2026  16:29:56 +0000 (0:00:00.118)       0:00:45.255 *******
2026-03-18 16:29:56.554105 | controller | skipping: [instance]
2026-03-18 16:29:56.880882 | controller |
2026-03-18 16:29:56.880905 | controller | TASK [libvirt_manager : Dump MAC mapping] **************************************
2026-03-18 16:29:56.880913 | controller | Wednesday 18 March 2026  16:29:56 +0000 (0:00:00.032)       0:00:45.288 *******
2026-03-18 16:29:56.880922 | controller | changed: [instance]
2026-03-18 16:29:56.970179 | controller |
2026-03-18 16:29:56.970228 | controller | TASK [libvirt_manager : Inject all VMs in the inventory] ***********************
2026-03-18 16:29:56.970243 | controller | Wednesday 18 March 2026  16:29:56 +0000 (0:00:00.327)       0:00:45.615 *******
2026-03-18 16:29:56.970261 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding compute-0 to computes)
2026-03-18 16:29:57.020075 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding controller-0 to controllers)
2026-03-18 16:29:57.020113 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/add_vm_to_inventory.yml for instance => (item=Adding crc-0 to ocps)
2026-03-18 16:29:57.020123 | controller |
2026-03-18 16:29:57.020131 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-03-18 16:29:57.020139 | controller | Wednesday 18 March 2026  16:29:56 +0000 (0:00:00.088)       0:00:45.703 *******
2026-03-18 16:29:57.020151 | controller | changed: [instance]
2026-03-18 16:29:57.020184 | controller |
2026-03-18 16:29:57.020454 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-03-18 16:29:57.298990 | controller | Wednesday 18 March 2026  16:29:57 +0000 (0:00:00.050)       0:00:45.754 *******
2026-03-18 16:29:57.299016 | controller | changed: [instance]
2026-03-18 16:29:57.299040 | controller |
2026-03-18 16:29:57.299048 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-03-18 16:29:57.299119 | controller | Wednesday 18 March 2026  16:29:57 +0000 (0:00:00.279)       0:00:46.033 *******
2026-03-18 16:29:57.504312 | controller | changed: [instance]
2026-03-18 16:29:57.554144 | controller |
2026-03-18 16:29:57.554191 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-03-18 16:29:57.554206 | controller | Wednesday 18 March 2026  16:29:57 +0000 (0:00:00.205)       0:00:46.239 *******
2026-03-18 16:29:57.554223 | controller | changed: [instance]
2026-03-18 16:29:57.554267 | controller |
2026-03-18 16:29:57.554281 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-03-18 16:29:57.554366 | controller | Wednesday 18 March 2026  16:29:57 +0000 (0:00:00.049)       0:00:46.288 *******
2026-03-18 16:29:57.751883 | controller | changed: [instance]
2026-03-18 16:29:57.960047 | controller |
2026-03-18 16:29:57.960072 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-03-18 16:29:57.960081 | controller | Wednesday 18 March 2026  16:29:57 +0000 (0:00:00.197)       0:00:46.486 *******
2026-03-18 16:29:57.960091 | controller | changed: [instance]
2026-03-18 16:29:58.012688 | controller |
2026-03-18 16:29:58.012731 | controller | TASK [libvirt_manager : Add host to runtime inventory] *************************
2026-03-18 16:29:58.012745 | controller | Wednesday 18 March 2026  16:29:57 +0000 (0:00:00.208)       0:00:46.694 *******
2026-03-18 16:29:58.012762 | controller | changed: [instance]
2026-03-18 16:29:58.208337 | controller |
2026-03-18 16:29:58.208365 | controller | TASK [libvirt_manager : Ensure group section exists] ***************************
2026-03-18 16:29:58.208373 | controller | Wednesday 18 March 2026  16:29:58 +0000 (0:00:00.051)       0:00:46.746 *******
2026-03-18 16:29:58.208382 | controller | changed: [instance]
2026-03-18 16:29:58.418802 | controller |
2026-03-18 16:29:58.418822 | controller | TASK [libvirt_manager : Append host under proper group] ************************
2026-03-18 16:29:58.418834 | controller | Wednesday 18 March 2026  16:29:58 +0000 (0:00:00.196)       0:00:46.943 *******
2026-03-18 16:29:58.418843 | controller | changed: [instance]
2026-03-18 16:29:58.607066 | controller |
2026-03-18 16:29:58.607114 | controller | TASK [libvirt_manager : Check if ini inventory file exists] ********************
2026-03-18 16:29:58.607125 | controller | Wednesday 18 March 2026  16:29:58 +0000 (0:00:00.210)       0:00:47.153 *******
2026-03-18 16:29:58.607137 | controller | ok: [instance]
2026-03-18 16:29:58.607159 | controller |
2026-03-18 16:29:58.607168 | controller | TASK [libvirt_manager : Convert ini inventory file into yaml] ******************
2026-03-18 16:29:58.607246 | controller | Wednesday 18 March 2026  16:29:58 +0000 (0:00:00.188)       0:00:47.341 *******
2026-03-18 16:29:59.086871 | controller | changed: [instance]
2026-03-18 16:29:59.266504 | controller |
2026-03-18 16:29:59.266523 | controller | TASK [libvirt_manager : Remove ini file after conversion] **********************
2026-03-18 16:29:59.266531 | controller | Wednesday 18 March 2026  16:29:59 +0000 (0:00:00.479)       0:00:47.821 *******
2026-03-18 16:29:59.266540 | controller | changed: [instance]
2026-03-18 16:29:59.289090 | controller |
2026-03-18 16:29:59.289125 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-03-18 16:29:59.289134 | controller | Wednesday 18 March 2026  16:29:59 +0000 (0:00:00.179)       0:00:48.001 *******
2026-03-18 16:29:59.289144 | controller | skipping: [instance]
2026-03-18 16:29:59.289205 | controller |
2026-03-18 16:29:59.289424 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-18 16:29:59.312839 | controller | Wednesday 18 March 2026  16:29:59 +0000 (0:00:00.022)       0:00:48.024 *******
2026-03-18 16:29:59.312878 | controller | skipping: [instance]
2026-03-18 16:29:59.337652 | controller |
2026-03-18 16:29:59.337671 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-03-18 16:29:59.337679 | controller | Wednesday 18 March 2026  16:29:59 +0000 (0:00:00.023)       0:00:48.047 *******
2026-03-18 16:29:59.337687 | controller | skipping: [instance]
2026-03-18 16:29:59.361720 | controller |
2026-03-18 16:29:59.361753 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-03-18 16:29:59.361767 | controller | Wednesday 18 March 2026  16:29:59 +0000 (0:00:00.024)       0:00:48.071 *******
2026-03-18 16:29:59.361782 | controller | skipping: [instance]
2026-03-18 16:29:59.362071 | controller |
2026-03-18 16:29:59.362325 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-03-18 16:29:59.362582 | controller | Wednesday 18 March 2026  16:29:59 +0000 (0:00:00.024)       0:00:48.096 *******
2026-03-18 16:29:59.380869 | controller | ok: [instance]
2026-03-18 16:29:59.381179 | controller |
2026-03-18 16:29:59.381454 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-03-18 16:29:59.381697 | controller | Wednesday 18 March 2026  16:29:59 +0000 (0:00:00.019)       0:00:48.115 *******
2026-03-18 16:29:59.459664 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2026-03-18 16:29:59.459884 | controller |
2026-03-18 16:29:59.460047 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-03-18 16:29:59.460183 | controller | Wednesday 18 March 2026  16:29:59 +0000 (0:00:00.078)       0:00:48.194 *******
2026-03-18 16:29:59.477278 | controller | skipping: [instance]
2026-03-18 16:29:59.477562 | controller |
2026-03-18 16:29:59.477824 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-03-18 16:29:59.477999 | controller | Wednesday 18 March 2026  16:29:59 +0000 (0:00:00.017)       0:00:48.212 *******
2026-03-18 16:29:59.674613 | controller | changed: [instance]
2026-03-18 16:30:00.058883 | controller |
2026-03-18 16:30:00.058919 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-03-18 16:30:00.058962 | controller | Wednesday 18 March 2026  16:29:59 +0000 (0:00:00.196)       0:00:48.409 *******
2026-03-18 16:30:00.058984 | controller | changed: [instance]
2026-03-18 16:30:00.115126 | controller |
2026-03-18 16:30:00.115174 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-03-18 16:30:00.115189 | controller | Wednesday 18 March 2026  16:30:00 +0000 (0:00:00.383)       0:00:48.793 *******
2026-03-18 16:30:00.115206 | controller | ok: [instance]
2026-03-18 16:30:00.115238 | controller |
2026-03-18 16:30:00.115252 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-03-18 16:30:00.115295 | controller | Wednesday 18 March 2026  16:30:00 +0000 (0:00:00.056)       0:00:48.849 *******
2026-03-18 16:30:00.146884 | controller | ok: [instance]
2026-03-18 16:30:00.524607 | controller |
2026-03-18 16:30:00.524629 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-03-18 16:30:00.524645 | controller | Wednesday 18 March 2026  16:30:00 +0000 (0:00:00.031)       0:00:48.881 *******
2026-03-18 16:30:00.524655 | controller | changed: [instance]
2026-03-18 16:30:00.609130 | controller |
2026-03-18 16:30:00.609170 | controller | TASK [libvirt_manager : Manage networks if needed] *****************************
2026-03-18 16:30:00.609185 | controller | Wednesday 18 March 2026  16:30:00 +0000 (0:00:00.378)       0:00:49.259 *******
2026-03-18 16:30:00.609201 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks.yml for instance
2026-03-18 16:30:00.658065 | controller |
2026-03-18 16:30:00.658115 | controller | TASK [libvirt_manager : Define the localized variables for performing the tasks here.] ***
2026-03-18 16:30:00.658130 | controller | Wednesday 18 March 2026  16:30:00 +0000 (0:00:00.084)       0:00:49.343 *******
2026-03-18 16:30:00.658148 | controller | ok: [instance] => (item=public)
2026-03-18 16:30:00.658192 | controller | ok: [instance] => (item=osp_trunk)
2026-03-18 16:30:00.658366 | controller |
2026-03-18 16:30:00.658400 | controller | TASK [libvirt_manager : Ensure networks are defined] ***************************
2026-03-18 16:30:01.089043 | controller | Wednesday 18 March 2026  16:30:00 +0000 (0:00:00.049)       0:00:49.392 *******
2026-03-18 16:30:01.089088 | controller | changed: [instance] => (item=cifmw-public)
2026-03-18 16:30:01.654464 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-03-18 16:30:01.654496 | controller |
2026-03-18 16:30:01.654504 | controller | TASK [libvirt_manager : Ensure networks are created/started] *******************
2026-03-18 16:30:01.654510 | controller | Wednesday 18 March 2026  16:30:01 +0000 (0:00:00.430)       0:00:49.823 *******
2026-03-18 16:30:01.654520 | controller | ok: [instance] => (item=cifmw-public)
2026-03-18 16:30:02.082764 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-18 16:30:02.082795 | controller |
2026-03-18 16:30:02.082803 | controller | TASK [libvirt_manager : Ensure networks are active] ****************************
2026-03-18 16:30:02.082809 | controller | Wednesday 18 March 2026  16:30:01 +0000 (0:00:00.565)       0:00:50.388 *******
2026-03-18 16:30:02.082819 | controller | ok: [instance] => (item=cifmw-public)
2026-03-18 16:30:02.498032 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-18 16:30:02.498062 | controller |
2026-03-18 16:30:02.498070 | controller | TASK [libvirt_manager : Ensure networks enabled to autostart] ******************
2026-03-18 16:30:02.498076 | controller | Wednesday 18 March 2026  16:30:02 +0000 (0:00:00.428)       0:00:50.817 *******
2026-03-18 16:30:02.498086 | controller | changed: [instance] => (item=cifmw-public)
2026-03-18 16:30:02.498112 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-03-18 16:30:02.498118 | controller |
2026-03-18 16:30:02.498125 | controller | TASK [libvirt_manager : Add a dummy interface to bridges if required] **********
2026-03-18 16:30:02.498207 | controller | Wednesday 18 March 2026  16:30:02 +0000 (0:00:00.415)       0:00:51.232 *******
2026-03-18 16:30:02.558084 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_networks_dummy_interfaces.yml for instance
2026-03-18 16:30:02.742055 | controller |
2026-03-18 16:30:02.742088 | controller | TASK [libvirt_manager : Fetch present bridge interfaces] ***********************
2026-03-18 16:30:02.742097 | controller | Wednesday 18 March 2026  16:30:02 +0000 (0:00:00.059)       0:00:51.292 *******
2026-03-18 16:30:02.742108 | controller | ok: [instance]
2026-03-18 16:30:03.120506 | controller |
2026-03-18 16:30:03.120542 | controller | TASK [libvirt_manager : Fetch bridges ports link info] *************************
2026-03-18 16:30:03.120550 | controller | Wednesday 18 March 2026  16:30:02 +0000 (0:00:00.183)       0:00:51.476 *******
2026-03-18 16:30:03.120561 | controller | ok: [instance] => (item=cifmw-public)
2026-03-18 16:30:03.189667 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-18 16:30:03.189702 | controller |
2026-03-18 16:30:03.189715 | controller | TASK [Create dummy interfaces to ensure bridges are UP] ************************
2026-03-18 16:30:03.189726 | controller | Wednesday 18 March 2026  16:30:03 +0000 (0:00:00.378)       0:00:51.854 *******
2026-03-18 16:30:03.189740 | controller |
2026-03-18 16:30:03.224806 | controller | TASK [ci_nmstate : Ensure we have needed facts] ********************************
2026-03-18 16:30:03.224836 | controller | Wednesday 18 March 2026  16:30:03 +0000 (0:00:00.069)       0:00:51.924 *******
2026-03-18 16:30:03.224860 | controller | skipping: [instance]
2026-03-18 16:30:04.473825 | controller |
2026-03-18 16:30:04.473856 | controller | TASK [ci_nmstate : Install required packages on instance] **********************
2026-03-18 16:30:04.473864 | controller | Wednesday 18 March 2026  16:30:03 +0000 (0:00:00.035)       0:00:51.959 *******
2026-03-18 16:30:04.473875 | controller | ok: [instance]
2026-03-18 16:30:04.658053 | controller |
2026-03-18 16:30:04.658083 | controller | TASK [ci_nmstate : Create the target NMstate dump directory] *******************
2026-03-18 16:30:04.658091 | controller | Wednesday 18 March 2026  16:30:04 +0000 (0:00:01.249)       0:00:53.208 *******
2026-03-18 16:30:04.658101 | controller | ok: [instance]
2026-03-18 16:30:05.002386 | controller |
2026-03-18 16:30:05.002422 | controller | TASK [ci_nmstate : Save nmstate state for instance] ****************************
2026-03-18 16:30:05.002432 | controller | Wednesday 18 March 2026  16:30:04 +0000 (0:00:00.184)       0:00:53.392 *******
2026-03-18 16:30:05.002444 | controller | changed: [instance]
2026-03-18 16:30:06.637704 | controller |
2026-03-18 16:30:06.637733 | controller | TASK [ci_nmstate : Apply the desidered state on instance] **********************
2026-03-18 16:30:06.637742 | controller | Wednesday 18 March 2026  16:30:04 +0000 (0:00:00.344)       0:00:53.736 *******
2026-03-18 16:30:06.637756 | controller | changed: [instance]
2026-03-18 16:30:06.976059 | controller |
2026-03-18 16:30:06.976094 | controller | TASK [ci_nmstate : Save nmstate debugging data for instance] *******************
2026-03-18 16:30:06.976104 | controller | Wednesday 18 March 2026  16:30:06 +0000 (0:00:01.635)       0:00:55.372 *******
2026-03-18 16:30:06.976115 | controller | changed: [instance]
2026-03-18 16:30:06.976143 | controller |
2026-03-18 16:30:06.976152 | controller | TASK [Create extra network configuration] **************************************
2026-03-18 16:30:06.976248 | controller | Wednesday 18 March 2026  16:30:06 +0000 (0:00:00.338)       0:00:55.710 *******
2026-03-18 16:30:07.006076 | controller | skipping: [instance]
2026-03-18 16:30:07.006171 | controller |
2026-03-18 16:30:07.006190 | controller | TASK [libvirt_manager : Ensure extra networks is in correct zone] **************
2026-03-18 16:30:07.006201 | controller | Wednesday 18 March 2026  16:30:07 +0000 (0:00:00.030)       0:00:55.740 *******
2026-03-18 16:30:07.032707 | controller | skipping: [instance]
2026-03-18 16:30:07.459844 | controller |
2026-03-18 16:30:07.459872 | controller | TASK [libvirt_manager : Refresh networking facts on host] **********************
2026-03-18 16:30:07.459880 | controller | Wednesday 18 March 2026  16:30:07 +0000 (0:00:00.026)       0:00:55.767 *******
2026-03-18 16:30:07.459890 | controller | ok: [instance]
2026-03-18 16:30:07.596858 | controller |
2026-03-18 16:30:07.596877 | controller | TASK [libvirt_manager : Build needed network/dnsmasq related content] **********
2026-03-18 16:30:07.596884 | controller | Wednesday 18 March 2026  16:30:07 +0000 (0:00:00.427)       0:00:56.194 *******
2026-03-18 16:30:07.596892 | controller | ok: [instance] => (item=cifmw-public)
2026-03-18 16:30:08.818603 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-18 16:30:08.818633 | controller |
2026-03-18 16:30:08.818641 | controller | TASK [dnsmasq : Install needed packages] ***************************************
2026-03-18 16:30:08.818648 | controller | Wednesday 18 March 2026  16:30:07 +0000 (0:00:00.137)       0:00:56.331 *******
2026-03-18 16:30:08.818657 | controller | ok: [instance]
2026-03-18 16:30:12.390949 | controller |
2026-03-18 16:30:12.390983 | controller | TASK [dnsmasq : Ensure SELinux knows about the new files and directories] ******
2026-03-18 16:30:12.390991 | controller | Wednesday 18 March 2026  16:30:08 +0000 (0:00:01.221)       0:00:57.553 *******
2026-03-18 16:30:12.391002 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.conf', 'setype': 'dnsmasq_etc_t'})
2026-03-18 16:30:12.598600 | controller | changed: [instance] => (item={'target': '/etc/cifmw-dnsmasq.d(/.*)?', 'setype': 'dnsmasq_etc_t'})
2026-03-18 16:30:12.598625 | controller | changed: [instance] => (item={'target': '/var/run/cifmw-dnsmasq.pid', 'setype': 'dnsmasq_var_run_t'})
2026-03-18 16:30:12.598637 | controller |
2026-03-18 16:30:12.598642 | controller | TASK [dnsmasq : Manage configuration directory] ********************************
2026-03-18 16:30:12.598648 | controller | Wednesday 18 March 2026  16:30:12 +0000 (0:00:03.572)       0:01:01.125 *******
2026-03-18 16:30:12.598656 | controller | changed: [instance]
2026-03-18 16:30:12.952032 | controller |
2026-03-18 16:30:12.952065 | controller | TASK [dnsmasq : Manage systemd unit file] **************************************
2026-03-18 16:30:12.952075 | controller | Wednesday 18 March 2026  16:30:12 +0000 (0:00:00.208)       0:01:01.333 *******
2026-03-18 16:30:12.952087 | controller | changed: [instance]
2026-03-18 16:30:13.331715 | controller |
2026-03-18 16:30:13.331748 | controller | TASK [dnsmasq : Manage base configuration file] ********************************
2026-03-18 16:30:13.331756 | controller | Wednesday 18 March 2026  16:30:12 +0000 (0:00:00.353)       0:01:01.686 *******
2026-03-18 16:30:13.331766 | controller | changed: [instance]
2026-03-18 16:30:13.364405 | controller |
2026-03-18 16:30:13.364426 | controller | TASK [dnsmasq : Render listener configuration] *********************************
2026-03-18 16:30:13.364433 | controller | Wednesday 18 March 2026  16:30:13 +0000 (0:00:00.379)       0:01:02.066 *******
2026-03-18 16:30:13.364443 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/listener.yml for instance
2026-03-18 16:30:13.753365 | controller |
2026-03-18 16:30:13.753394 | controller | TASK [dnsmasq : Create listener configuration file] ****************************
2026-03-18 16:30:13.753402 | controller | Wednesday 18 March 2026  16:30:13 +0000 (0:00:00.032)       0:01:02.099 *******
2026-03-18 16:30:13.753412 | controller | changed: [instance]
2026-03-18 16:30:13.773666 | controller |
2026-03-18 16:30:13.773686 | controller | TASK [dnsmasq : Remove listener configuration file] ****************************
2026-03-18 16:30:13.773695 | controller | Wednesday 18 March 2026  16:30:13 +0000 (0:00:00.388)       0:01:02.487 *******
2026-03-18 16:30:13.773706 | controller | skipping: [instance]
2026-03-18 16:30:13.808842 | controller |
2026-03-18 16:30:13.808861 | controller | TASK [dnsmasq : Render dns configuration] **************************************
2026-03-18 16:30:13.808869 | controller | Wednesday 18 March 2026  16:30:13 +0000 (0:00:00.020)       0:01:02.508 *******
2026-03-18 16:30:13.808878 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/dns.yml for instance
2026-03-18 16:30:14.178696 | controller |
2026-03-18 16:30:14.178725 | controller | TASK [dnsmasq : Create dns configuration file] *********************************
2026-03-18 16:30:14.178733 | controller | Wednesday 18 March 2026  16:30:13 +0000 (0:00:00.035)       0:01:02.543 *******
2026-03-18 16:30:14.178749 | controller | changed: [instance]
2026-03-18 16:30:14.197703 | controller |
2026-03-18 16:30:14.197724 | controller | TASK [dnsmasq : Remove dns configuration file] *********************************
2026-03-18 16:30:14.197732 | controller | Wednesday 18 March 2026  16:30:14 +0000 (0:00:00.369)       0:01:02.913 *******
2026-03-18 16:30:14.197741 | controller | skipping: [instance]
2026-03-18 16:30:14.406056 | controller |
2026-03-18 16:30:14.406088 | controller | TASK [dnsmasq : Add localhost addresses from defined dnsmasq listen addresses to loopback interface] ***
2026-03-18 16:30:14.406098 | controller | Wednesday 18 March 2026  16:30:14 +0000 (0:00:00.019)       0:01:02.932 *******
2026-03-18 16:30:14.406111 | controller | ok: [instance] => (item=127.0.0.2)
2026-03-18 16:30:14.406142 | controller |
2026-03-18 16:30:14.406152 | controller | TASK [dnsmasq : Enable and start service] **************************************
2026-03-18 16:30:14.406252 | controller | Wednesday 18 March 2026  16:30:14 +0000 (0:00:00.208)       0:01:03.140 *******
2026-03-18 16:30:15.093333 | controller | changed: [instance]
2026-03-18 16:30:15.114527 | controller |
2026-03-18 16:30:15.114547 | controller | TASK [dnsmasq : Stop service] **************************************************
2026-03-18 16:30:15.114555 | controller | Wednesday 18 March 2026  16:30:15 +0000 (0:00:00.686)       0:01:03.827 *******
2026-03-18 16:30:15.114564 | controller | skipping: [instance]
2026-03-18 16:30:15.134386 | controller |
2026-03-18 16:30:15.134403 | controller | TASK [dnsmasq : Remove unit file] **********************************************
2026-03-18 16:30:15.134410 | controller | Wednesday 18 March 2026  16:30:15 +0000 (0:00:00.021)       0:01:03.849 *******
2026-03-18 16:30:15.134418 | controller | skipping: [instance]
2026-03-18 16:30:15.166009 | controller |
2026-03-18 16:30:15.166032 | controller | TASK [dnsmasq : Remove main configuration files] *******************************
2026-03-18 16:30:15.166041 | controller | Wednesday 18 March 2026  16:30:15 +0000 (0:00:00.019)       0:01:03.869 *******
2026-03-18 16:30:15.166052 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2026-03-18 16:30:15.284019 | controller | skipping: [instance] => (item=/etc/cifmw-dnsmasq.d)
2026-03-18 16:30:15.284047 | controller | skipping: [instance]
2026-03-18 16:30:15.284056 | controller |
2026-03-18 16:30:15.284062 | controller | TASK [Create dnsmasq networks] *************************************************
2026-03-18 16:30:15.284069 | controller | Wednesday 18 March 2026  16:30:15 +0000 (0:00:00.031)       0:01:03.900 *******
2026-03-18 16:30:15.284078 | controller |
2026-03-18 16:30:15.316094 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2026-03-18 16:30:15.316131 | controller | Wednesday 18 March 2026  16:30:15 +0000 (0:00:00.118)       0:01:04.018 *******
2026-03-18 16:30:15.316145 | controller | ok: [instance] => changed=false
2026-03-18 16:30:15.354331 | controller |   msg: All assertions passed
2026-03-18 16:30:15.354355 | controller |
2026-03-18 16:30:15.354365 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2026-03-18 16:30:15.354373 | controller | Wednesday 18 March 2026  16:30:15 +0000 (0:00:00.031)       0:01:04.050 *******
2026-03-18 16:30:15.354383 | controller | ok: [instance] => changed=false
2026-03-18 16:30:15.793678 | controller |   msg: All assertions passed
2026-03-18 16:30:15.793708 | controller |
2026-03-18 16:30:15.793716 | controller | TASK [dnsmasq : Create network] ************************************************
2026-03-18 16:30:15.793722 | controller | Wednesday 18 March 2026  16:30:15 +0000 (0:00:00.038)       0:01:04.088 *******
2026-03-18 16:30:15.793732 | controller | changed: [instance]
2026-03-18 16:30:15.812779 | controller |
2026-03-18 16:30:15.812798 | controller | TASK [dnsmasq : Remove network] ************************************************
2026-03-18 16:30:15.812806 | controller | Wednesday 18 March 2026  16:30:15 +0000 (0:00:00.439)       0:01:04.528 *******
2026-03-18 16:30:15.812815 | controller | skipping: [instance]
2026-03-18 16:30:15.836732 | controller |
2026-03-18 16:30:15.836751 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2026-03-18 16:30:15.836759 | controller | Wednesday 18 March 2026  16:30:15 +0000 (0:00:00.019)       0:01:04.547 *******
2026-03-18 16:30:15.836768 | controller | skipping: [instance]
2026-03-18 16:30:15.867068 | controller |
2026-03-18 16:30:15.867103 | controller | TASK [dnsmasq : Assert mandatory parameter] ************************************
2026-03-18 16:30:15.867112 | controller | Wednesday 18 March 2026  16:30:15 +0000 (0:00:00.023)       0:01:04.571 *******
2026-03-18 16:30:15.867125 | controller | ok: [instance] => changed=false
2026-03-18 16:30:15.904027 | controller |   msg: All assertions passed
2026-03-18 16:30:15.904048 | controller |
2026-03-18 16:30:15.904057 | controller | TASK [dnsmasq : Assert mandatory parameters for new network] *******************
2026-03-18 16:30:15.904064 | controller | Wednesday 18 March 2026  16:30:15 +0000 (0:00:00.030)       0:01:04.601 *******
2026-03-18 16:30:15.904074 | controller | ok: [instance] => changed=false
2026-03-18 16:30:15.904102 | controller |   msg: All assertions passed
2026-03-18 16:30:15.904111 | controller |
2026-03-18 16:30:15.904323 | controller | TASK [dnsmasq : Create network] ************************************************
2026-03-18 16:30:16.329471 | controller | Wednesday 18 March 2026  16:30:15 +0000 (0:00:00.037)       0:01:04.638 *******
2026-03-18 16:30:16.329508 | controller | changed: [instance]
2026-03-18 16:30:16.349657 | controller |
2026-03-18 16:30:16.349682 | controller | TASK [dnsmasq : Remove network] ************************************************
2026-03-18 16:30:16.349700 | controller | Wednesday 18 March 2026  16:30:16 +0000 (0:00:00.424)       0:01:05.063 *******
2026-03-18 16:30:16.349720 | controller | skipping: [instance]
2026-03-18 16:30:16.349748 | controller |
2026-03-18 16:30:16.349832 | controller | TASK [dnsmasq : Remove dhcp host files] ****************************************
2026-03-18 16:30:16.349945 | controller | Wednesday 18 March 2026  16:30:16 +0000 (0:00:00.020)       0:01:05.084 *******
2026-03-18 16:30:16.375016 | controller | skipping: [instance]
2026-03-18 16:30:16.375076 | controller |
2026-03-18 16:30:16.375174 | controller | TASK [Deploy radvd for IPv6 router advertisements] *****************************
2026-03-18 16:30:16.375269 | controller | Wednesday 18 March 2026  16:30:16 +0000 (0:00:00.025)       0:01:05.110 *******
2026-03-18 16:30:16.405876 | controller | skipping: [instance]
2026-03-18 16:30:16.405955 | controller |
2026-03-18 16:30:16.406083 | controller | TASK [libvirt_manager : Ensure network is in correct zone] *********************
2026-03-18 16:30:16.406180 | controller | Wednesday 18 March 2026  16:30:16 +0000 (0:00:00.030)       0:01:05.140 *******
2026-03-18 16:30:16.905511 | controller | changed: [instance] => (item=cifmw-public)
2026-03-18 16:30:16.941162 | controller | changed: [instance] => (item=cifmw-osp_trunk)
2026-03-18 16:30:16.941183 | controller |
2026-03-18 16:30:16.941191 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-03-18 16:30:16.941197 | controller | Wednesday 18 March 2026  16:30:16 +0000 (0:00:00.491)       0:01:05.632 *******
2026-03-18 16:30:16.941206 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-public)
2026-03-18 16:30:17.274311 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/network_bridge_info_gen.yml for instance => (item=cifmw-osp_trunk)
2026-03-18 16:30:17.274341 | controller |
2026-03-18 16:30:17.274349 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-03-18 16:30:17.274355 | controller | Wednesday 18 March 2026  16:30:16 +0000 (0:00:00.042)       0:01:05.675 *******
2026-03-18 16:30:17.274365 | controller | ok: [instance]
2026-03-18 16:30:17.305031 | controller |
2026-03-18 16:30:17.305068 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2026-03-18 16:30:17.305076 | controller | Wednesday 18 March 2026  16:30:17 +0000 (0:00:00.330)       0:01:06.006 *******
2026-03-18 16:30:17.305087 | controller | ok: [instance]
2026-03-18 16:30:17.305105 | controller |
2026-03-18 16:30:17.305111 | controller | TASK [libvirt_manager : Extract IP address from network bridges] ***************
2026-03-18 16:30:17.305118 | controller | Wednesday 18 March 2026  16:30:17 +0000 (0:00:00.033)       0:01:06.039 *******
2026-03-18 16:30:17.508610 | controller | ok: [instance]
2026-03-18 16:30:17.508895 | controller |
2026-03-18 16:30:17.542411 | controller | TASK [libvirt_manager : Set network_bridge_info fact with network and address] ***
2026-03-18 16:30:17.542427 | controller | Wednesday 18 March 2026  16:30:17 +0000 (0:00:00.203)       0:01:06.243 *******
2026-03-18 16:30:17.542438 | controller | ok: [instance]
2026-03-18 16:30:17.872150 | controller |
2026-03-18 16:30:17.872199 | controller | TASK [libvirt_manager : Output _network_data] **********************************
2026-03-18 16:30:17.872214 | controller | Wednesday 18 March 2026  16:30:17 +0000 (0:00:00.033)       0:01:06.277 *******
2026-03-18 16:30:17.872231 | controller | changed: [instance]
2026-03-18 16:30:18.205435 | controller |
2026-03-18 16:30:18.205468 | controller | TASK [libvirt_manager : Output pub_net] ****************************************
2026-03-18 16:30:18.205476 | controller | Wednesday 18 March 2026  16:30:17 +0000 (0:00:00.329)       0:01:06.606 *******
2026-03-18 16:30:18.205487 | controller | changed: [instance]
2026-03-18 16:30:18.551099 | controller |
2026-03-18 16:30:18.551138 | controller | TASK [libvirt_manager : Output _cifmw_libvirt_manager_layout] ******************
2026-03-18 16:30:18.551149 | controller | Wednesday 18 March 2026  16:30:18 +0000 (0:00:00.333)       0:01:06.939 *******
2026-03-18 16:30:18.551162 | controller | changed: [instance]
2026-03-18 16:30:18.642980 | controller |
2026-03-18 16:30:18.643009 | controller | TASK [libvirt_manager : Expose patch for networking_mapper] ********************
2026-03-18 16:30:18.643018 | controller | Wednesday 18 March 2026  16:30:18 +0000 (0:00:00.342)       0:01:07.282 *******
2026-03-18 16:30:18.643030 | controller | ok: [instance]
2026-03-18 16:30:18.981992 | controller |
2026-03-18 16:30:18.982023 | controller | TASK [libvirt_manager : Save networking_mapper patch] **************************
2026-03-18 16:30:18.982031 | controller | Wednesday 18 March 2026  16:30:18 +0000 (0:00:00.095)       0:01:07.377 *******
2026-03-18 16:30:18.982041 | controller | changed: [instance]
2026-03-18 16:30:19.005604 | controller |
2026-03-18 16:30:19.005624 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-03-18 16:30:19.005632 | controller | Wednesday 18 March 2026  16:30:18 +0000 (0:00:00.338)       0:01:07.716 *******
2026-03-18 16:30:19.005641 | controller | skipping: [instance]
2026-03-18 16:30:19.029396 | controller |
2026-03-18 16:30:19.029418 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-18 16:30:19.029427 | controller | Wednesday 18 March 2026  16:30:19 +0000 (0:00:00.023)       0:01:07.740 *******
2026-03-18 16:30:19.029444 | controller | skipping: [instance]
2026-03-18 16:30:19.054135 | controller |
2026-03-18 16:30:19.054178 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-03-18 16:30:19.054202 | controller | Wednesday 18 March 2026  16:30:19 +0000 (0:00:00.023)       0:01:07.764 *******
2026-03-18 16:30:19.054220 | controller | skipping: [instance]
2026-03-18 16:30:19.079856 | controller |
2026-03-18 16:30:19.079877 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-03-18 16:30:19.079885 | controller | Wednesday 18 March 2026  16:30:19 +0000 (0:00:00.024)       0:01:07.788 *******
2026-03-18 16:30:19.079894 | controller | skipping: [instance]
2026-03-18 16:30:19.098767 | controller |
2026-03-18 16:30:19.098801 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-03-18 16:30:19.098813 | controller | Wednesday 18 March 2026  16:30:19 +0000 (0:00:00.025)       0:01:07.814 *******
2026-03-18 16:30:19.098822 | controller | ok: [instance]
2026-03-18 16:30:19.098848 | controller |
2026-03-18 16:30:19.099028 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-03-18 16:30:19.099062 | controller | Wednesday 18 March 2026  16:30:19 +0000 (0:00:00.019)       0:01:07.833 *******
2026-03-18 16:30:19.193813 | controller | ok: [instance] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}}}}})
2026-03-18 16:30:19.212410 | controller | ok: [instance] => (item={'networks': {'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'computes': {'networks': {'public': None}}, 'ocps': {'networks': {'public': None}}}, 'instances': {'controller-0': {'networks': {'public': {'ip-v4': '192.168.101.9'}}}}})
2026-03-18 16:30:19.212435 | controller |
2026-03-18 16:30:19.212444 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-03-18 16:30:19.212452 | controller | Wednesday 18 March 2026  16:30:19 +0000 (0:00:00.094)       0:01:07.928 *******
2026-03-18 16:30:19.212463 | controller | skipping: [instance]
2026-03-18 16:30:19.212634 | controller |
2026-03-18 16:30:19.212799 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-03-18 16:30:19.212983 | controller | Wednesday 18 March 2026  16:30:19 +0000 (0:00:00.019)       0:01:07.947 *******
2026-03-18 16:30:19.419041 | controller | ok: [instance]
2026-03-18 16:30:19.419095 | controller |
2026-03-18 16:30:19.419106 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-03-18 16:30:19.419116 | controller | Wednesday 18 March 2026  16:30:19 +0000 (0:00:00.206)       0:01:08.153 *******
2026-03-18 16:30:19.817007 | controller | changed: [instance]
2026-03-18 16:30:19.817044 | controller |
2026-03-18 16:30:19.817054 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-03-18 16:30:19.817064 | controller | Wednesday 18 March 2026  16:30:19 +0000 (0:00:00.397)       0:01:08.551 *******
2026-03-18 16:30:19.879049 | controller | ok: [instance]
2026-03-18 16:30:19.911837 | controller |
2026-03-18 16:30:19.911869 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-03-18 16:30:19.911877 | controller | Wednesday 18 March 2026  16:30:19 +0000 (0:00:00.061)       0:01:08.613 *******
2026-03-18 16:30:19.911888 | controller | ok: [instance]
2026-03-18 16:30:20.353658 | controller |
2026-03-18 16:30:20.353696 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-03-18 16:30:20.353705 | controller | Wednesday 18 March 2026  16:30:19 +0000 (0:00:00.033)       0:01:08.646 *******
2026-03-18 16:30:20.353716 | controller | changed: [instance]
2026-03-18 16:30:20.382730 | controller |
2026-03-18 16:30:20.382750 | controller | TASK [libvirt_manager : Be sure to save current state of networking_mapper environment] ***
2026-03-18 16:30:20.382759 | controller | Wednesday 18 March 2026  16:30:20 +0000 (0:00:00.441)       0:01:09.088 *******
2026-03-18 16:30:20.382770 | controller | ok: [instance]
2026-03-18 16:30:20.402102 | controller |
2026-03-18 16:30:20.402138 | controller | TASK [libvirt_manager : Unset patch] *******************************************
2026-03-18 16:30:20.402158 | controller | Wednesday 18 March 2026  16:30:20 +0000 (0:00:00.029)       0:01:09.117 *******
2026-03-18 16:30:20.402174 | controller | ok: [instance]
2026-03-18 16:30:20.402362 | controller |
2026-03-18 16:30:20.402378 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_entries fact] ****************
2026-03-18 16:30:20.422473 | controller | Wednesday 18 March 2026  16:30:20 +0000 (0:00:00.019)       0:01:09.136 *******
2026-03-18 16:30:20.422495 | controller | ok: [instance]
2026-03-18 16:30:20.525479 | controller |
2026-03-18 16:30:20.525498 | controller | TASK [libvirt_manager : Reserve IPs on networks] *******************************
2026-03-18 16:30:20.525506 | controller | Wednesday 18 March 2026  16:30:20 +0000 (0:00:00.020)       0:01:09.157 *******
2026-03-18 16:30:20.525515 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=ctlplane)
2026-03-18 16:30:20.661888 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=internalapi)
2026-03-18 16:30:20.661908 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storage)
2026-03-18 16:30:20.661916 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=tenant)
2026-03-18 16:30:20.661922 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=external)
2026-03-18 16:30:20.661945 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=storagemgmt)
2026-03-18 16:30:20.661953 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/reserve_dnsmasq_ips.yml for instance => (item=public)
2026-03-18 16:30:20.661959 | controller |
2026-03-18 16:30:20.661965 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-18 16:30:20.661970 | controller | Wednesday 18 March 2026  16:30:20 +0000 (0:00:00.102)       0:01:09.259 *******
2026-03-18 16:30:20.661983 | controller | ok: [instance] => (item=compute-0 - ctlplane)
2026-03-18 16:30:20.746891 | controller | ok: [instance] => (item=controller-0 - ctlplane)
2026-03-18 16:30:20.746923 | controller | ok: [instance] => (item=crc-0 - ctlplane)
2026-03-18 16:30:20.746964 | controller |
2026-03-18 16:30:20.746973 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-18 16:30:20.746981 | controller | Wednesday 18 March 2026  16:30:20 +0000 (0:00:00.136)       0:01:09.396 *******
2026-03-18 16:30:20.747001 | controller | skipping: [instance] => (item=compute-0 - internalapi)
2026-03-18 16:30:20.747361 | controller | skipping: [instance] => (item=controller-0 - internalapi)
2026-03-18 16:30:20.747526 | controller | skipping: [instance] => (item=crc-0 - internalapi)
2026-03-18 16:30:20.747679 | controller | skipping: [instance]
2026-03-18 16:30:20.747833 | controller |
2026-03-18 16:30:20.747992 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-18 16:30:20.748125 | controller | Wednesday 18 March 2026  16:30:20 +0000 (0:00:00.085)       0:01:09.481 *******
2026-03-18 16:30:20.844944 | controller | skipping: [instance] => (item=compute-0 - storage)
2026-03-18 16:30:20.845128 | controller | skipping: [instance] => (item=controller-0 - storage)
2026-03-18 16:30:20.845281 | controller | skipping: [instance] => (item=crc-0 - storage)
2026-03-18 16:30:20.845408 | controller | skipping: [instance]
2026-03-18 16:30:20.845529 | controller |
2026-03-18 16:30:20.845654 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-18 16:30:20.845779 | controller | Wednesday 18 March 2026  16:30:20 +0000 (0:00:00.098)       0:01:09.579 *******
2026-03-18 16:30:20.948014 | controller | skipping: [instance] => (item=compute-0 - tenant)
2026-03-18 16:30:20.948563 | controller | skipping: [instance] => (item=controller-0 - tenant)
2026-03-18 16:30:20.948752 | controller | skipping: [instance] => (item=crc-0 - tenant)
2026-03-18 16:30:20.948888 | controller | skipping: [instance]
2026-03-18 16:30:20.949105 | controller |
2026-03-18 16:30:20.949276 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-18 16:30:20.949383 | controller | Wednesday 18 March 2026  16:30:20 +0000 (0:00:00.103)       0:01:09.682 *******
2026-03-18 16:30:21.037542 | controller | skipping: [instance] => (item=compute-0 - external)
2026-03-18 16:30:21.037633 | controller | skipping: [instance] => (item=controller-0 - external)
2026-03-18 16:30:21.037715 | controller | skipping: [instance] => (item=crc-0 - external)
2026-03-18 16:30:21.037795 | controller | skipping: [instance]
2026-03-18 16:30:21.037882 | controller |
2026-03-18 16:30:21.037961 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-18 16:30:21.038050 | controller | Wednesday 18 March 2026  16:30:21 +0000 (0:00:00.089)       0:01:09.772 *******
2026-03-18 16:30:21.122721 | controller | skipping: [instance] => (item=compute-0 - storagemgmt)
2026-03-18 16:30:21.122874 | controller | skipping: [instance] => (item=controller-0 - storagemgmt)
2026-03-18 16:30:21.123239 | controller | skipping: [instance] => (item=crc-0 - storagemgmt)
2026-03-18 16:30:21.123269 | controller | skipping: [instance]
2026-03-18 16:30:21.123440 | controller |
2026-03-18 16:30:21.123559 | controller | TASK [libvirt_manager : Loop on host IPs] **************************************
2026-03-18 16:30:21.123737 | controller | Wednesday 18 March 2026  16:30:21 +0000 (0:00:00.085)       0:01:09.857 *******
2026-03-18 16:30:21.261416 | controller | ok: [instance] => (item=compute-0 - public)
2026-03-18 16:30:21.261600 | controller | ok: [instance] => (item=controller-0 - public)
2026-03-18 16:30:21.261716 | controller | ok: [instance] => (item=crc-0 - public)
2026-03-18 16:30:21.261916 | controller |
2026-03-18 16:30:21.262016 | controller | TASK [Inject DHCP entries for net {{ net_name }}] ******************************
2026-03-18 16:30:21.262084 | controller | Wednesday 18 March 2026  16:30:21 +0000 (0:00:00.138)       0:01:09.996 *******
2026-03-18 16:30:21.379009 | controller |
2026-03-18 16:30:21.379118 | controller | TASK [dnsmasq : Ensure we have the right data and type] ************************
2026-03-18 16:30:21.379377 | controller | Wednesday 18 March 2026  16:30:21 +0000 (0:00:00.117)       0:01:10.113 *******
2026-03-18 16:30:21.424764 | controller | ok: [instance]
2026-03-18 16:30:21.424818 | controller |
2026-03-18 16:30:21.424921 | controller | TASK [dnsmasq : Assert we have needed host data] *******************************
2026-03-18 16:30:21.425032 | controller | Wednesday 18 March 2026  16:30:21 +0000 (0:00:00.045)       0:01:10.159 *******
2026-03-18 16:30:21.526965 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:7e:b4:24', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2026-03-18 16:30:21.527188 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:f8:7f:21', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2026-03-18 16:30:21.527373 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:aa:75:1a', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2026-03-18 16:30:21.527527 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:b2:d4:13', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2026-03-18 16:30:21.527571 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:c4:bb:2c', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2026-03-18 16:30:21.527653 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:a7:2b:c8', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2026-03-18 16:30:21.527719 | controller |
2026-03-18 16:30:21.527799 | controller | TASK [dnsmasq : Ensure networks exists] ****************************************
2026-03-18 16:30:21.527880 | controller | Wednesday 18 March 2026  16:30:21 +0000 (0:00:00.101)       0:01:10.261 *******
2026-03-18 16:30:21.584041 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=osp_trunk)
2026-03-18 16:30:21.584236 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/dnsmasq/tasks/_check_net_status.yml for instance => (item=public)
2026-03-18 16:30:21.584365 | controller |
2026-03-18 16:30:21.584537 | controller | TASK [dnsmasq : Check network file status] *************************************
2026-03-18 16:30:21.584710 | controller | Wednesday 18 March 2026  16:30:21 +0000 (0:00:00.057)       0:01:10.318 *******
2026-03-18 16:30:21.765239 | controller | ok: [instance]
2026-03-18 16:30:21.765306 | controller |
2026-03-18 16:30:21.765404 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2026-03-18 16:30:21.765496 | controller | Wednesday 18 March 2026  16:30:21 +0000 (0:00:00.181)       0:01:10.500 *******
2026-03-18 16:30:21.791422 | controller | ok: [instance]
2026-03-18 16:30:21.791505 | controller |
2026-03-18 16:30:21.791593 | controller | TASK [dnsmasq : Check network file status] *************************************
2026-03-18 16:30:21.791681 | controller | Wednesday 18 March 2026  16:30:21 +0000 (0:00:00.026)       0:01:10.526 *******
2026-03-18 16:30:21.973478 | controller | ok: [instance]
2026-03-18 16:30:22.000947 | controller |
2026-03-18 16:30:22.000974 | controller | TASK [dnsmasq : Assert network exists] *****************************************
2026-03-18 16:30:22.000984 | controller | Wednesday 18 March 2026  16:30:21 +0000 (0:00:00.181)       0:01:10.708 *******
2026-03-18 16:30:22.000995 | controller | ok: [instance]
2026-03-18 16:30:22.023997 | controller |
2026-03-18 16:30:22.024018 | controller | TASK [dnsmasq : Initialize empty dhcp_host_entries] ****************************
2026-03-18 16:30:22.024027 | controller | Wednesday 18 March 2026  16:30:21 +0000 (0:00:00.027)       0:01:10.735 *******
2026-03-18 16:30:22.024038 | controller | ok: [instance]
2026-03-18 16:30:22.024383 | controller |
2026-03-18 16:30:22.024397 | controller | TASK [dnsmasq : Compute entry] *************************************************
2026-03-18 16:30:22.196021 | controller | Wednesday 18 March 2026  16:30:22 +0000 (0:00:00.023)       0:01:10.758 *******
2026-03-18 16:30:22.196056 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:7e:b4:24', 'ips': ['192.168.140.100', ''], 'tag': 'compute'})
2026-03-18 16:30:22.196434 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:f8:7f:21', 'ips': ['192.168.140.9', ''], 'tag': 'controller'})
2026-03-18 16:30:22.196455 | controller | ok: [instance] => (item={'network': 'osp_trunk', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:aa:75:1a', 'ips': ['192.168.140.10', ''], 'tag': 'ocp'})
2026-03-18 16:30:22.196470 | controller | ok: [instance] => (item={'network': 'public', 'name': 'compute-0', 'state': 'present', 'mac': '52:54:00:b2:d4:13', 'ips': ['192.168.101.100', ''], 'tag': 'compute'})
2026-03-18 16:30:22.196482 | controller | ok: [instance] => (item={'network': 'public', 'name': 'controller-0', 'state': 'present', 'mac': '52:54:01:c4:bb:2c', 'ips': ['192.168.101.9', ''], 'tag': 'controller'})
2026-03-18 16:30:22.235059 | controller | ok: [instance] => (item={'network': 'public', 'name': 'crc-0', 'state': 'present', 'mac': '52:54:02:a7:2b:c8', 'ips': ['192.168.101.10', ''], 'tag': 'ocp'})
2026-03-18 16:30:22.235085 | controller |
2026-03-18 16:30:22.235094 | controller | TASK [dnsmasq : Create add/remove sets] ****************************************
2026-03-18 16:30:22.235109 | controller | Wednesday 18 March 2026  16:30:22 +0000 (0:00:00.171)       0:01:10.930 *******
2026-03-18 16:30:22.235120 | controller | ok: [instance]
2026-03-18 16:30:22.235444 | controller |
2026-03-18 16:30:22.235470 | controller | TASK [dnsmasq : Add DHCP entries] **********************************************
2026-03-18 16:30:24.288894 | controller | Wednesday 18 March 2026  16:30:22 +0000 (0:00:00.039)       0:01:10.969 *******
2026-03-18 16:30:24.288946 | controller | changed: [instance] => (item={'file': 'osp_trunk_compute-0_52:54:00:7e:b4:24', 'entry': 'set:compute,52:54:00:7e:b4:24,192.168.140.100,compute-0', 'state': 'present'})
2026-03-18 16:30:24.311040 | controller | changed: [instance] => (item={'file': 'osp_trunk_controller-0_52:54:01:f8:7f:21', 'entry': 'set:controller,52:54:01:f8:7f:21,192.168.140.9,controller-0', 'state': 'present'})
2026-03-18 16:30:24.311071 | controller | changed: [instance] => (item={'file': 'osp_trunk_crc-0_52:54:02:aa:75:1a', 'entry': 'set:ocp,52:54:02:aa:75:1a,192.168.140.10,crc-0', 'state': 'present'})
2026-03-18 16:30:24.311085 | controller | changed: [instance] => (item={'file': 'public_compute-0_52:54:00:b2:d4:13', 'entry': 'set:compute,52:54:00:b2:d4:13,192.168.101.100,compute-0', 'state': 'present'})
2026-03-18 16:30:24.311095 | controller | changed: [instance] => (item={'file': 'public_controller-0_52:54:01:c4:bb:2c', 'entry': 'set:controller,52:54:01:c4:bb:2c,192.168.101.9,controller-0', 'state': 'present'})
2026-03-18 16:30:24.311104 | controller | changed: [instance] => (item={'file': 'public_crc-0_52:54:02:a7:2b:c8', 'entry': 'set:ocp,52:54:02:a7:2b:c8,192.168.101.10,crc-0', 'state': 'present'})
2026-03-18 16:30:24.311113 | controller |
2026-03-18 16:30:24.311123 | controller | TASK [dnsmasq : Remove DHCP entries] *******************************************
2026-03-18 16:30:24.311132 | controller | Wednesday 18 March 2026  16:30:24 +0000 (0:00:02.053)       0:01:13.022 *******
2026-03-18 16:30:24.311147 | controller | skipping: [instance]
2026-03-18 16:30:24.311198 | controller |
2026-03-18 16:30:24.311213 | controller | TASK [libvirt_manager : Create per-network and .utility DNS entries] ***********
2026-03-18 16:30:24.311325 | controller | Wednesday 18 March 2026  16:30:24 +0000 (0:00:00.022)       0:01:13.045 *******
2026-03-18 16:30:24.517509 | controller | ok: [instance] => (item=compute-0)
2026-03-18 16:30:24.638692 | controller | ok: [instance] => (item=controller-0)
2026-03-18 16:30:24.638710 | controller | ok: [instance] => (item=crc-0)
2026-03-18 16:30:24.638718 | controller |
2026-03-18 16:30:24.638724 | controller | TASK [Inject VMs in the .utility zone] *****************************************
2026-03-18 16:30:24.638730 | controller | Wednesday 18 March 2026  16:30:24 +0000 (0:00:00.206)       0:01:13.251 *******
2026-03-18 16:30:24.638739 | controller |
2026-03-18 16:30:24.678047 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-03-18 16:30:24.678077 | controller | Wednesday 18 March 2026  16:30:24 +0000 (0:00:00.121)       0:01:13.373 *******
2026-03-18 16:30:24.678090 | controller | ok: [instance]
2026-03-18 16:30:24.906075 | controller |
2026-03-18 16:30:24.906110 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-18 16:30:24.906124 | controller | Wednesday 18 March 2026  16:30:24 +0000 (0:00:00.039)       0:01:13.412 *******
2026-03-18 16:30:24.906141 | controller | ok: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-18 16:30:24.906258 | controller | ok: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-18 16:30:24.906281 | controller | ok: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-03-18 16:30:24.906532 | controller | ok: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-03-18 16:30:24.906679 | controller | ok: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-03-18 16:30:24.906809 | controller | ok: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-03-18 16:30:24.906903 | controller | ok: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-03-18 16:30:24.907039 | controller | ok: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-18 16:30:24.907144 | controller | ok: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-18 16:30:24.907256 | controller | ok: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-03-18 16:30:24.907365 | controller | ok: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-18 16:30:24.907468 | controller | ok: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-18 16:30:24.907573 | controller | ok: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-03-18 16:30:24.907678 | controller | ok: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-03-18 16:30:24.907779 | controller | ok: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-03-18 16:30:24.907879 | controller | ok: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-03-18 16:30:24.907991 | controller |
2026-03-18 16:30:24.908100 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-18 16:30:24.908209 | controller | Wednesday 18 March 2026  16:30:24 +0000 (0:00:00.227)       0:01:13.640 *******
2026-03-18 16:30:27.928066 | controller | changed: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-18 16:30:27.928123 | controller | changed: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-18 16:30:27.928134 | controller | changed: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-03-18 16:30:27.928141 | controller | changed: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-03-18 16:30:27.928148 | controller | changed: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-03-18 16:30:27.928168 | controller | changed: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-03-18 16:30:27.928179 | controller | changed: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-03-18 16:30:27.928186 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-18 16:30:27.928192 | controller | changed: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-18 16:30:27.928203 | controller | changed: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-03-18 16:30:27.928229 | controller | changed: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-18 16:30:27.928902 | controller | changed: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-18 16:30:27.959007 | controller | changed: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-03-18 16:30:27.959047 | controller | changed: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-03-18 16:30:27.959057 | controller | changed: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-03-18 16:30:27.959064 | controller | changed: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-03-18 16:30:27.959072 | controller |
2026-03-18 16:30:27.959079 | controller | TASK [dnsmasq : Remove crc.testing from host_records] **************************
2026-03-18 16:30:27.959087 | controller | Wednesday 18 March 2026  16:30:27 +0000 (0:00:03.021)       0:01:16.662 *******
2026-03-18 16:30:27.959100 | controller | skipping: [instance]
2026-03-18 16:30:27.959141 | controller |
2026-03-18 16:30:27.959170 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-03-18 16:30:27.959182 | controller | Wednesday 18 March 2026  16:30:27 +0000 (0:00:00.031)       0:01:16.693 *******
2026-03-18 16:30:28.296123 | controller | skipping: [instance] => (item={'names': ['compute-0.utility', 'compute-0.instance', 'compute-0.utility', 'compute-0.instance'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-18 16:30:28.296237 | controller | skipping: [instance] => (item={'names': ['compute-0.ctlplane.crc.testing', 'compute-0.ctlplane.crc.testing'], 'ips': ['192.168.140.100', ''], 'state': 'present'})
2026-03-18 16:30:28.296254 | controller | skipping: [instance] => (item={'names': ['compute-0.internalapi.crc.testing', 'compute-0.internalapi.crc.testing'], 'ips': ['172.17.0.100', ''], 'state': 'present'})
2026-03-18 16:30:28.296265 | controller | skipping: [instance] => (item={'names': ['compute-0.public.crc.testing', 'compute-0.public.crc.testing'], 'ips': ['192.168.101.100', ''], 'state': 'present'})
2026-03-18 16:30:28.296280 | controller | skipping: [instance] => (item={'names': ['compute-0.storage.crc.testing', 'compute-0.storage.crc.testing'], 'ips': ['172.18.0.100', ''], 'state': 'present'})
2026-03-18 16:30:28.296309 | controller | skipping: [instance] => (item={'names': ['compute-0.storagemgmt.crc.testing', 'compute-0.storagemgmt.crc.testing'], 'ips': ['172.20.0.100', ''], 'state': 'present'})
2026-03-18 16:30:28.296346 | controller | skipping: [instance] => (item={'names': ['compute-0.tenant.crc.testing', 'compute-0.tenant.crc.testing'], 'ips': ['172.19.0.100', ''], 'state': 'present'})
2026-03-18 16:30:28.297023 | controller | changed: [instance] => (item={'names': ['controller-0.utility', 'controller-0.instance', 'controller-0.utility', 'controller-0.instance'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-18 16:30:28.297074 | controller | skipping: [instance] => (item={'names': ['controller-0.ctlplane.crc.testing', 'controller-0.ctlplane.crc.testing'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-18 16:30:28.297083 | controller | skipping: [instance] => (item={'names': ['controller-0.public.crc.testing', 'controller-0.public.crc.testing'], 'ips': ['192.168.101.9', ''], 'state': 'present'})
2026-03-18 16:30:28.297089 | controller | skipping: [instance] => (item={'names': ['crc-0.utility', 'crc-0.instance', 'ocp-0.utility', 'ocp-0.instance'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-18 16:30:28.297094 | controller | skipping: [instance] => (item={'names': ['crc-0.ctlplane.crc.testing', 'ocp-0.ctlplane.crc.testing'], 'ips': ['192.168.140.10', ''], 'state': 'present'})
2026-03-18 16:30:28.297099 | controller | skipping: [instance] => (item={'names': ['crc-0.internalapi.crc.testing', 'ocp-0.internalapi.crc.testing'], 'ips': ['172.17.0.10', ''], 'state': 'present'})
2026-03-18 16:30:28.297104 | controller | skipping: [instance] => (item={'names': ['crc-0.public.crc.testing', 'ocp-0.public.crc.testing'], 'ips': ['192.168.101.10', ''], 'state': 'present'})
2026-03-18 16:30:28.297109 | controller | skipping: [instance] => (item={'names': ['crc-0.storage.crc.testing', 'ocp-0.storage.crc.testing'], 'ips': ['172.18.0.10', ''], 'state': 'present'})
2026-03-18 16:30:28.297117 | controller | skipping: [instance] => (item={'names': ['crc-0.tenant.crc.testing', 'ocp-0.tenant.crc.testing'], 'ips': ['172.19.0.10', ''], 'state': 'present'})
2026-03-18 16:30:28.297142 | controller |
2026-03-18 16:30:28.297306 | controller | TASK [libvirt_manager : Initialize empty _lm_dhcp_options fact] ****************
2026-03-18 16:30:28.317021 | controller | Wednesday 18 March 2026  16:30:28 +0000 (0:00:00.336)       0:01:17.030 *******
2026-03-18 16:30:28.317066 | controller | ok: [instance]
2026-03-18 16:30:28.317103 | controller |
2026-03-18 16:30:28.317369 | controller | TASK [libvirt_manager : Collect DHCP options from VM definitions] **************
2026-03-18 16:30:28.360025 | controller | Wednesday 18 March 2026  16:30:28 +0000 (0:00:00.021)       0:01:17.051 *******
2026-03-18 16:30:28.360066 | controller | skipping: [instance] => (item=compute)
2026-03-18 16:30:28.360105 | controller | skipping: [instance] => (item=controller)
2026-03-18 16:30:28.360115 | controller | skipping: [instance] => (item=crc)
2026-03-18 16:30:28.360429 | controller | skipping: [instance]
2026-03-18 16:30:28.394560 | controller |
2026-03-18 16:30:28.394583 | controller | TASK [libvirt_manager : Generate DHCP option configuration for VM types] *******
2026-03-18 16:30:28.394593 | controller | Wednesday 18 March 2026  16:30:28 +0000 (0:00:00.042)       0:01:17.094 *******
2026-03-18 16:30:28.394604 | controller | skipping: [instance]
2026-03-18 16:30:28.758065 | controller |
2026-03-18 16:30:28.758104 | controller | TASK [libvirt_manager : Ensure some domains are local] *************************
2026-03-18 16:30:28.758114 | controller | Wednesday 18 March 2026  16:30:28 +0000 (0:00:00.034)       0:01:17.129 *******
2026-03-18 16:30:28.758127 | controller | changed: [instance]
2026-03-18 16:30:29.380406 | controller |
2026-03-18 16:30:29.380449 | controller | TASK [libvirt_manager : Ensure dnsmasq is reloaded now] ************************
2026-03-18 16:30:29.380458 | controller | Wednesday 18 March 2026  16:30:28 +0000 (0:00:00.352)       0:01:17.481 *******
2026-03-18 16:30:29.380464 | controller |
2026-03-18 16:30:29.380470 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2026-03-18 16:30:29.380475 | controller | Wednesday 18 March 2026  16:30:28 +0000 (0:00:00.010)       0:01:17.492 *******
2026-03-18 16:30:29.380485 | controller | changed: [instance]
2026-03-18 16:30:29.380505 | controller |
2026-03-18 16:30:29.380569 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-03-18 16:30:29.380691 | controller | Wednesday 18 March 2026  16:30:29 +0000 (0:00:00.622)       0:01:18.115 *******
2026-03-18 16:30:29.726740 | controller | changed: [instance]
2026-03-18 16:30:30.080706 | controller |
2026-03-18 16:30:30.080740 | controller | RUNNING HANDLER [dnsmasq : Reload dnsmasq] *************************************
2026-03-18 16:30:30.080749 | controller | Wednesday 18 March 2026  16:30:29 +0000 (0:00:00.345)       0:01:18.461 *******
2026-03-18 16:30:30.080759 | controller | changed: [instance]
2026-03-18 16:30:30.441040 | controller |
2026-03-18 16:30:30.441084 | controller | TASK [reproducer : Delegate our domains to our own instance] *******************
2026-03-18 16:30:30.441093 | controller | Wednesday 18 March 2026  16:30:30 +0000 (0:00:00.353)       0:01:18.815 *******
2026-03-18 16:30:30.441104 | controller | changed: [instance]
2026-03-18 16:30:30.441130 | controller |
2026-03-18 16:30:30.441355 | controller | TASK [reproducer : Ensure "utility" domain is local] ***************************
2026-03-18 16:30:30.807516 | controller | Wednesday 18 March 2026  16:30:30 +0000 (0:00:00.360)       0:01:19.175 *******
2026-03-18 16:30:30.807558 | controller | changed: [instance]
2026-03-18 16:30:30.840669 | controller |
2026-03-18 16:30:30.840699 | controller | TASK [Build utility records dataset] *******************************************
2026-03-18 16:30:30.840711 | controller | Wednesday 18 March 2026  16:30:30 +0000 (0:00:00.366)       0:01:19.541 *******
2026-03-18 16:30:30.840726 | controller |
2026-03-18 16:30:30.928745 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-03-18 16:30:30.928777 | controller | Wednesday 18 March 2026  16:30:30 +0000 (0:00:00.033)       0:01:19.575 *******
2026-03-18 16:30:30.928794 | controller | ok: [instance]
2026-03-18 16:30:31.025421 | controller |
2026-03-18 16:30:31.025440 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-18 16:30:31.025448 | controller | Wednesday 18 March 2026  16:30:30 +0000 (0:00:00.087)       0:01:19.663 *******
2026-03-18 16:30:31.025457 | controller | ok: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-03-18 16:30:31.474017 | controller | ok: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-18 16:30:31.474050 | controller |
2026-03-18 16:30:31.474058 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-18 16:30:31.474065 | controller | Wednesday 18 March 2026  16:30:31 +0000 (0:00:00.096)       0:01:19.760 *******
2026-03-18 16:30:31.474077 | controller | changed: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-03-18 16:30:31.506061 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-18 16:30:31.506098 | controller |
2026-03-18 16:30:31.506108 | controller | TASK [dnsmasq : Remove crc.testing from host_records] **************************
2026-03-18 16:30:31.506116 | controller | Wednesday 18 March 2026  16:30:31 +0000 (0:00:00.448)       0:01:20.208 *******
2026-03-18 16:30:31.506142 | controller | skipping: [instance]
2026-03-18 16:30:31.506177 | controller |
2026-03-18 16:30:31.506187 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-03-18 16:30:31.506276 | controller | Wednesday 18 March 2026  16:30:31 +0000 (0:00:00.032)       0:01:20.240 *******
2026-03-18 16:30:31.792032 | controller | skipping: [instance] => (item={'names': ['ipmi.utility', 'instance.utility', 'virthost.ocp.openstack.lab'], 'ips': ['192.168.101.1', ''], 'state': 'present'})
2026-03-18 16:30:31.792555 | controller | changed: [instance] => (item={'names': ['sushy.utility', 'controller-0.utility'], 'ips': ['192.168.140.9', ''], 'state': 'present'})
2026-03-18 16:30:31.792589 | controller |
2026-03-18 16:30:32.258958 | controller | TASK [reproducer : Flush handlers] *********************************************
2026-03-18 16:30:32.258990 | controller | Wednesday 18 March 2026  16:30:31 +0000 (0:00:00.275)       0:01:20.515 *******
2026-03-18 16:30:32.258998 | controller |
2026-03-18 16:30:32.259004 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-03-18 16:30:32.259009 | controller | Wednesday 18 March 2026  16:30:31 +0000 (0:00:00.010)       0:01:20.526 *******
2026-03-18 16:30:32.259019 | controller | changed: [instance]
2026-03-18 16:30:32.617949 | controller |
2026-03-18 16:30:32.617983 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-03-18 16:30:32.617992 | controller | Wednesday 18 March 2026  16:30:32 +0000 (0:00:00.466)       0:01:20.993 *******
2026-03-18 16:30:32.618002 | controller | changed: [instance]
2026-03-18 16:30:32.650814 | controller |
2026-03-18 16:30:32.650844 | controller | TASK [reproducer : Bootstrap nat64 if needed] **********************************
2026-03-18 16:30:32.650853 | controller | Wednesday 18 March 2026  16:30:32 +0000 (0:00:00.358)       0:01:21.352 *******
2026-03-18 16:30:32.650863 | controller | skipping: [instance]
2026-03-18 16:30:32.720158 | controller |
2026-03-18 16:30:32.720207 | controller | TASK [reproducer : Deploy CRC if needed] ***************************************
2026-03-18 16:30:32.720221 | controller | Wednesday 18 March 2026  16:30:32 +0000 (0:00:00.033)       0:01:21.385 *******
2026-03-18 16:30:32.720240 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/crc_layout.yml for instance
2026-03-18 16:30:32.720285 | controller |
2026-03-18 16:30:32.720299 | controller | TASK [reproducer : Check for CRC availability in known path] *******************
2026-03-18 16:30:32.720355 | controller | Wednesday 18 March 2026  16:30:32 +0000 (0:00:00.069)       0:01:21.454 *******
2026-03-18 16:30:32.903101 | controller | ok: [instance]
2026-03-18 16:30:32.923081 | controller |
2026-03-18 16:30:32.923129 | controller | TASK [Deploy CRC if needed] ****************************************************
2026-03-18 16:30:32.923150 | controller | Wednesday 18 March 2026  16:30:32 +0000 (0:00:00.182)       0:01:21.637 *******
2026-03-18 16:30:32.923166 | controller | skipping: [instance]
2026-03-18 16:30:32.923212 | controller |
2026-03-18 16:30:32.923226 | controller | TASK [rhol_crc : Stop CRC VM] **************************************************
2026-03-18 16:30:32.923338 | controller | Wednesday 18 March 2026  16:30:32 +0000 (0:00:00.020)       0:01:21.657 *******
2026-03-18 16:30:33.265988 | controller | ok: [instance]
2026-03-18 16:30:33.498566 | controller |
2026-03-18 16:30:33.498601 | controller | TASK [rhol_crc : Undefine CRC VM] **********************************************
2026-03-18 16:30:33.498611 | controller | Wednesday 18 March 2026  16:30:33 +0000 (0:00:00.342)       0:01:22.000 *******
2026-03-18 16:30:33.498624 | controller | ok: [instance]
2026-03-18 16:30:33.712481 | controller |
2026-03-18 16:30:33.712508 | controller | TASK [rhol_crc : Destroy CRC network] ******************************************
2026-03-18 16:30:33.712515 | controller | Wednesday 18 March 2026  16:30:33 +0000 (0:00:00.232)       0:01:22.233 *******
2026-03-18 16:30:33.712525 | controller | ok: [instance]
2026-03-18 16:30:33.925892 | controller |
2026-03-18 16:30:33.925916 | controller | TASK [rhol_crc : Undefine CRC network] *****************************************
2026-03-18 16:30:33.925924 | controller | Wednesday 18 March 2026  16:30:33 +0000 (0:00:00.214)       0:01:22.447 *******
2026-03-18 16:30:33.925951 | controller | ok: [instance]
2026-03-18 16:30:34.168034 | controller |
2026-03-18 16:30:34.168075 | controller | TASK [rhol_crc : Destroy default network] **************************************
2026-03-18 16:30:34.168086 | controller | Wednesday 18 March 2026  16:30:33 +0000 (0:00:00.213)       0:01:22.660 *******
2026-03-18 16:30:34.168100 | controller | ok: [instance]
2026-03-18 16:30:34.168363 | controller |
2026-03-18 16:30:34.205808 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-18 16:30:34.205831 | controller | Wednesday 18 March 2026  16:30:34 +0000 (0:00:00.242)       0:01:22.902 *******
2026-03-18 16:30:34.205844 | controller |
2026-03-18 16:30:34.397379 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2026-03-18 16:30:34.397403 | controller | Wednesday 18 March 2026  16:30:34 +0000 (0:00:00.037)       0:01:22.940 *******
2026-03-18 16:30:34.397414 | controller | ok: [instance]
2026-03-18 16:30:34.419819 | controller |
2026-03-18 16:30:34.419840 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2026-03-18 16:30:34.419848 | controller | Wednesday 18 March 2026  16:30:34 +0000 (0:00:00.191)       0:01:23.132 *******
2026-03-18 16:30:34.419856 | controller | ok: [instance]
2026-03-18 16:30:34.445076 | controller |
2026-03-18 16:30:34.445123 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2026-03-18 16:30:34.445133 | controller | Wednesday 18 March 2026  16:30:34 +0000 (0:00:00.022)       0:01:23.154 *******
2026-03-18 16:30:34.445146 | controller | skipping: [instance]
2026-03-18 16:30:34.445211 | controller |
2026-03-18 16:30:34.445233 | controller | TASK [reproducer : Slurp ssh key for CRC access] *******************************
2026-03-18 16:30:34.445246 | controller | Wednesday 18 March 2026  16:30:34 +0000 (0:00:00.025)       0:01:23.179 *******
2026-03-18 16:30:34.691025 | controller | ok: [instance]
2026-03-18 16:30:34.691074 | controller |
2026-03-18 16:30:34.691085 | controller | TASK [reproducer : Get kubeconfig file from crc directory] *********************
2026-03-18 16:30:34.691240 | controller | Wednesday 18 March 2026  16:30:34 +0000 (0:00:00.245)       0:01:23.425 *******
2026-03-18 16:30:34.907515 | controller | ok: [instance]
2026-03-18 16:30:35.078951 | controller |
2026-03-18 16:30:35.078970 | controller | TASK [reproducer : Get kubeadmin-password file from crc directory] *************
2026-03-18 16:30:35.078977 | controller | Wednesday 18 March 2026  16:30:34 +0000 (0:00:00.216)       0:01:23.642 *******
2026-03-18 16:30:35.078985 | controller | ok: [instance]
2026-03-18 16:30:35.138030 | controller |
2026-03-18 16:30:35.138076 | controller | TASK [Ensure we expose openshift_login related facts] **************************
2026-03-18 16:30:35.138087 | controller | Wednesday 18 March 2026  16:30:35 +0000 (0:00:00.171)       0:01:23.813 *******
2026-03-18 16:30:35.138111 | controller |
2026-03-18 16:30:35.185194 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2026-03-18 16:30:35.185241 | controller | Wednesday 18 March 2026  16:30:35 +0000 (0:00:00.058)       0:01:23.872 *******
2026-03-18 16:30:35.185261 | controller | ok: [instance] => changed=false
2026-03-18 16:30:35.185291 | controller |   msg: All assertions passed
2026-03-18 16:30:35.185301 | controller |
2026-03-18 16:30:35.185311 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2026-03-18 16:30:35.185323 | controller | Wednesday 18 March 2026  16:30:35 +0000 (0:00:00.047)       0:01:23.919 *******
2026-03-18 16:30:35.361987 | controller | ok: [instance]
2026-03-18 16:30:35.549653 | controller |
2026-03-18 16:30:35.549683 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2026-03-18 16:30:35.549691 | controller | Wednesday 18 March 2026  16:30:35 +0000 (0:00:00.176)       0:01:24.096 *******
2026-03-18 16:30:35.549701 | controller | ok: [instance]
2026-03-18 16:30:35.573807 | controller |
2026-03-18 16:30:35.573832 | controller | TASK [openshift_login : Assert files exist] ************************************
2026-03-18 16:30:35.573840 | controller | Wednesday 18 March 2026  16:30:35 +0000 (0:00:00.187)       0:01:24.284 *******
2026-03-18 16:30:35.573850 | controller | ok: [instance] => changed=false
2026-03-18 16:30:35.761064 | controller |   msg: All assertions passed
2026-03-18 16:30:35.761109 | controller |
2026-03-18 16:30:35.761119 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2026-03-18 16:30:35.761126 | controller | Wednesday 18 March 2026  16:30:35 +0000 (0:00:00.024)       0:01:24.308 *******
2026-03-18 16:30:35.761137 | controller | ok: [instance]
2026-03-18 16:30:35.761166 | controller |
2026-03-18 16:30:35.761173 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2026-03-18 16:30:35.761182 | controller | Wednesday 18 March 2026  16:30:35 +0000 (0:00:00.187)       0:01:24.495 *******
2026-03-18 16:30:35.934011 | controller | ok: [instance]
2026-03-18 16:30:35.981140 | controller |
2026-03-18 16:30:35.981186 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2026-03-18 16:30:35.981198 | controller | Wednesday 18 March 2026  16:30:35 +0000 (0:00:00.172)       0:01:24.668 *******
2026-03-18 16:30:35.981214 | controller | ok: [instance]
2026-03-18 16:30:35.981241 | controller |
2026-03-18 16:30:35.981254 | controller | TASK [reproducer : Remove CRC managed zone delegation] *************************
2026-03-18 16:30:35.981376 | controller | Wednesday 18 March 2026  16:30:35 +0000 (0:00:00.047)       0:01:24.715 *******
2026-03-18 16:30:36.357857 | controller | changed: [instance] => (item=dnsmasq.d/crc.conf)
2026-03-18 16:30:36.377425 | controller | changed: [instance] => (item=conf.d/crc-nm-dnsmasq.conf)
2026-03-18 16:30:36.377443 | controller |
2026-03-18 16:30:36.377451 | controller | TASK [reproducer : Consume dev-scripts for OCP cluster] ************************
2026-03-18 16:30:36.377458 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.376)       0:01:25.092 *******
2026-03-18 16:30:36.377466 | controller | skipping: [instance]
2026-03-18 16:30:36.408493 | controller |
2026-03-18 16:30:36.408510 | controller | TASK [Consume dev-scripts for bare metal OCP SNO] ******************************
2026-03-18 16:30:36.408517 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.019)       0:01:25.112 *******
2026-03-18 16:30:36.408525 | controller | skipping: [instance]
2026-03-18 16:30:36.439358 | controller |
2026-03-18 16:30:36.439380 | controller | TASK [reproducer : Slurp kubeconfig from dev-scripts] **************************
2026-03-18 16:30:36.439389 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.030)       0:01:25.143 *******
2026-03-18 16:30:36.439400 | controller | skipping: [instance]
2026-03-18 16:30:36.470097 | controller |
2026-03-18 16:30:36.470141 | controller | TASK [reproducer : Slurp kubeadmin-password from dev-scripts] ******************
2026-03-18 16:30:36.470154 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.030)       0:01:25.174 *******
2026-03-18 16:30:36.470170 | controller | skipping: [instance]
2026-03-18 16:30:36.470211 | controller |
2026-03-18 16:30:36.470247 | controller | TASK [reproducer : Ensure .kube directory exists] ******************************
2026-03-18 16:30:36.470380 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.031)       0:01:25.205 *******
2026-03-18 16:30:36.499667 | controller | skipping: [instance]
2026-03-18 16:30:36.528847 | controller |
2026-03-18 16:30:36.528869 | controller | TASK [reproducer : Copy kubeconfig to local ~/.kube/config] ********************
2026-03-18 16:30:36.528878 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.029)       0:01:25.234 *******
2026-03-18 16:30:36.528889 | controller | skipping: [instance]
2026-03-18 16:30:36.560636 | controller |
2026-03-18 16:30:36.560656 | controller | TASK [reproducer : Copy kubeadmin-password] ************************************
2026-03-18 16:30:36.560665 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.029)       0:01:25.263 *******
2026-03-18 16:30:36.560674 | controller | skipping: [instance]
2026-03-18 16:30:36.560824 | controller |
2026-03-18 16:30:36.561002 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2026-03-18 16:30:36.561174 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.032)       0:01:25.295 *******
2026-03-18 16:30:36.593098 | controller | skipping: [instance]
2026-03-18 16:30:36.593235 | controller |
2026-03-18 16:30:36.593367 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2026-03-18 16:30:36.593487 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.032)       0:01:25.328 *******
2026-03-18 16:30:36.624854 | controller | skipping: [instance]
2026-03-18 16:30:36.625053 | controller |
2026-03-18 16:30:36.625231 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2026-03-18 16:30:36.625379 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.031)       0:01:25.359 *******
2026-03-18 16:30:36.655984 | controller | skipping: [instance]
2026-03-18 16:30:36.656168 | controller |
2026-03-18 16:30:36.656333 | controller | TASK [openshift_login : Assert files exist] ************************************
2026-03-18 16:30:36.656486 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.031)       0:01:25.391 *******
2026-03-18 16:30:36.688186 | controller | skipping: [instance]
2026-03-18 16:30:36.688350 | controller |
2026-03-18 16:30:36.688502 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2026-03-18 16:30:36.688645 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.032)       0:01:25.423 *******
2026-03-18 16:30:36.719692 | controller | skipping: [instance]
2026-03-18 16:30:36.719867 | controller |
2026-03-18 16:30:36.720055 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2026-03-18 16:30:36.720195 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.031)       0:01:25.454 *******
2026-03-18 16:30:36.752038 | controller | skipping: [instance]
2026-03-18 16:30:36.752182 | controller |
2026-03-18 16:30:36.752304 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2026-03-18 16:30:36.752422 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.032)       0:01:25.487 *******
2026-03-18 16:30:36.788441 | controller | skipping: [instance]
2026-03-18 16:30:36.788601 | controller |
2026-03-18 16:30:36.788751 | controller | TASK [reproducer : Set wait for OCP cluster flag] ******************************
2026-03-18 16:30:36.788893 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.036)       0:01:25.523 *******
2026-03-18 16:30:36.819351 | controller | skipping: [instance]
2026-03-18 16:30:36.844663 | controller |
2026-03-18 16:30:36.844685 | controller | TASK [Load the architecture local kustomize patches] ***************************
2026-03-18 16:30:36.844694 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.030)       0:01:25.554 *******
2026-03-18 16:30:36.844710 | controller | skipping: [instance]
2026-03-18 16:30:36.942114 | controller |
2026-03-18 16:30:36.942145 | controller | TASK [reproducer : Consume libvirt_manager] ************************************
2026-03-18 16:30:36.942158 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.025)       0:01:25.579 *******
2026-03-18 16:30:36.942173 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/libvirt_layout.yml for instance
2026-03-18 16:30:36.942550 | controller |
2026-03-18 16:30:36.964839 | controller | TASK [libvirt_manager : Import layout generator if needed] *********************
2026-03-18 16:30:36.964869 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.097)       0:01:25.676 *******
2026-03-18 16:30:36.964885 | controller | skipping: [instance]
2026-03-18 16:30:36.965166 | controller |
2026-03-18 16:30:36.965396 | controller | TASK [libvirt_manager : Enable forwarding in the libvirt zone] *****************
2026-03-18 16:30:36.965557 | controller | Wednesday 18 March 2026  16:30:36 +0000 (0:00:00.022)       0:01:25.699 *******
2026-03-18 16:30:37.365790 | controller | changed: [instance]
2026-03-18 16:30:37.855047 | controller |
2026-03-18 16:30:37.855098 | controller | TASK [libvirt_manager : Enable masquerading for public traffic] ****************
2026-03-18 16:30:37.855108 | controller | Wednesday 18 March 2026  16:30:37 +0000 (0:00:00.400)       0:01:26.100 *******
2026-03-18 16:30:37.855122 | controller | changed: [instance]
2026-03-18 16:30:37.855152 | controller |
2026-03-18 16:30:37.855160 | controller | TASK [libvirt_manager : Ensure firewalld is restarts] **************************
2026-03-18 16:30:37.855167 | controller | Wednesday 18 March 2026  16:30:37 +0000 (0:00:00.477)       0:01:26.578 *******
2026-03-18 16:30:37.855174 | controller |
2026-03-18 16:30:37.855184 | controller | RUNNING HANDLER [reproducer : Restart NetworkManager] **************************
2026-03-18 16:30:38.262964 | controller | Wednesday 18 March 2026  16:30:37 +0000 (0:00:00.011)       0:01:26.589 *******
2026-03-18 16:30:38.263007 | controller | changed: [instance]
2026-03-18 16:30:38.912171 | controller |
2026-03-18 16:30:38.912203 | controller | RUNNING HANDLER [libvirt_manager : Restart firewalld] **************************
2026-03-18 16:30:38.912211 | controller | Wednesday 18 March 2026  16:30:38 +0000 (0:00:00.408)       0:01:26.997 *******
2026-03-18 16:30:38.912221 | controller | changed: [instance]
2026-03-18 16:30:38.942841 | controller |
2026-03-18 16:30:38.942864 | controller | TASK [Deploy virtualbmc] *******************************************************
2026-03-18 16:30:38.942873 | controller | Wednesday 18 March 2026  16:30:38 +0000 (0:00:00.649)       0:01:27.646 *******
2026-03-18 16:30:38.942884 | controller | skipping: [instance]
2026-03-18 16:30:38.975331 | controller |
2026-03-18 16:30:38.975364 | controller | TASK [libvirt_manager : Let the project know we have vbmc available] ***********
2026-03-18 16:30:38.975372 | controller | Wednesday 18 March 2026  16:30:38 +0000 (0:00:00.030)       0:01:27.677 *******
2026-03-18 16:30:38.975387 | controller | skipping: [instance]
2026-03-18 16:30:39.510725 | controller |
2026-03-18 16:30:39.510756 | controller | TASK [libvirt_manager : Create needed workload directory] **********************
2026-03-18 16:30:39.510764 | controller | Wednesday 18 March 2026  16:30:38 +0000 (0:00:00.032)       0:01:27.709 *******
2026-03-18 16:30:39.510774 | controller | changed: [instance] => (item=workload)
2026-03-18 16:30:39.904099 | controller | changed: [instance] => (item=reproducer-inventory)
2026-03-18 16:30:39.904134 | controller | ok: [instance] => (item=volumes)
2026-03-18 16:30:39.904144 | controller |
2026-03-18 16:30:39.904152 | controller | TASK [libvirt_manager : Allow QEMU on workload directory] **********************
2026-03-18 16:30:39.904159 | controller | Wednesday 18 March 2026  16:30:39 +0000 (0:00:00.535)       0:01:28.245 *******
2026-03-18 16:30:39.904171 | controller | changed: [instance] => (item=workload)
2026-03-18 16:30:39.904202 | controller | changed: [instance] => (item=volumes)
2026-03-18 16:30:39.904212 | controller |
2026-03-18 16:30:39.904382 | controller | TASK [libvirt_manager : Generate networking data] ******************************
2026-03-18 16:30:39.929037 | controller | Wednesday 18 March 2026  16:30:39 +0000 (0:00:00.393)       0:01:28.638 *******
2026-03-18 16:30:39.929073 | controller | skipping: [instance]
2026-03-18 16:30:39.929290 | controller |
2026-03-18 16:30:39.929312 | controller | TASK [libvirt_manager : Create group inventories] ******************************
2026-03-18 16:30:40.947917 | controller | Wednesday 18 March 2026  16:30:39 +0000 (0:00:00.025)       0:01:28.663 *******
2026-03-18 16:30:40.947970 | controller | changed: [instance] => (item=compute)
2026-03-18 16:30:40.978421 | controller | changed: [instance] => (item=controller)
2026-03-18 16:30:40.978440 | controller | changed: [instance] => (item=crc)
2026-03-18 16:30:40.978448 | controller |
2026-03-18 16:30:40.978455 | controller | TASK [libvirt_manager : Create "all" group inventory file] *********************
2026-03-18 16:30:40.978462 | controller | Wednesday 18 March 2026  16:30:40 +0000 (0:00:01.017)       0:01:29.681 *******
2026-03-18 16:30:40.978471 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_all_group_inventory.yml for instance
2026-03-18 16:30:41.151591 | controller |
2026-03-18 16:30:41.151614 | controller | TASK [libvirt_manager : Check if all-group.yml already exists] *****************
2026-03-18 16:30:41.151624 | controller | Wednesday 18 March 2026  16:30:40 +0000 (0:00:00.031)       0:01:29.713 *******
2026-03-18 16:30:41.151635 | controller | ok: [instance]
2026-03-18 16:30:41.172525 | controller |
2026-03-18 16:30:41.172544 | controller | TASK [libvirt_manager : Slurp existing all-group.yml if it exists] *************
2026-03-18 16:30:41.172552 | controller | Wednesday 18 March 2026  16:30:41 +0000 (0:00:00.172)       0:01:29.886 *******
2026-03-18 16:30:41.172561 | controller | skipping: [instance]
2026-03-18 16:30:41.533102 | controller |
2026-03-18 16:30:41.533139 | controller | TASK [libvirt_manager : Create new "all" group inventory file from template] ***
2026-03-18 16:30:41.533149 | controller | Wednesday 18 March 2026  16:30:41 +0000 (0:00:00.020)       0:01:29.907 *******
2026-03-18 16:30:41.533161 | controller | changed: [instance]
2026-03-18 16:30:41.554073 | controller |
2026-03-18 16:30:41.554116 | controller | TASK [libvirt_manager : Slurp newly created all-group.yml] *********************
2026-03-18 16:30:41.554127 | controller | Wednesday 18 March 2026  16:30:41 +0000 (0:00:00.360)       0:01:30.267 *******
2026-03-18 16:30:41.554140 | controller | skipping: [instance]
2026-03-18 16:30:41.554178 | controller |
2026-03-18 16:30:41.554188 | controller | TASK [libvirt_manager : Write merged all-group.yml] ****************************
2026-03-18 16:30:41.554276 | controller | Wednesday 18 March 2026  16:30:41 +0000 (0:00:00.021)       0:01:30.288 *******
2026-03-18 16:30:41.574675 | controller | skipping: [instance]
2026-03-18 16:30:41.611659 | controller |
2026-03-18 16:30:41.611679 | controller | TASK [libvirt_manager : Ensure storage pool is present.] ***********************
2026-03-18 16:30:41.611688 | controller | Wednesday 18 March 2026  16:30:41 +0000 (0:00:00.020)       0:01:30.309 *******
2026-03-18 16:30:41.611698 | controller | skipping: [instance]
2026-03-18 16:30:41.678445 | controller |
2026-03-18 16:30:41.678472 | controller | TASK [libvirt_manager : Ensure images are present] *****************************
2026-03-18 16:30:41.678481 | controller | Wednesday 18 March 2026  16:30:41 +0000 (0:00:00.036)       0:01:30.346 *******
2026-03-18 16:30:41.678493 | controller | skipping: [instance] => (item=crc)
2026-03-18 16:30:41.891424 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=compute)
2026-03-18 16:30:41.891448 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/get_image.yml for instance => (item=controller)
2026-03-18 16:30:41.891456 | controller |
2026-03-18 16:30:41.891463 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2026-03-18 16:30:41.891469 | controller | Wednesday 18 March 2026  16:30:41 +0000 (0:00:00.066)       0:01:30.412 *******
2026-03-18 16:30:41.891477 | controller | changed: [instance]
2026-03-18 16:30:42.077084 | controller |
2026-03-18 16:30:42.077112 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2026-03-18 16:30:42.077122 | controller | Wednesday 18 March 2026  16:30:41 +0000 (0:00:00.213)       0:01:30.626 *******
2026-03-18 16:30:42.077134 | controller | ok: [instance]
2026-03-18 16:30:42.077162 | controller |
2026-03-18 16:30:42.077170 | controller | TASK [libvirt_manager : Download base image] ***********************************
2026-03-18 16:30:42.077180 | controller | Wednesday 18 March 2026  16:30:42 +0000 (0:00:00.185)       0:01:30.811 *******
2026-03-18 16:31:12.274090 | controller | changed: [instance]
2026-03-18 16:31:12.274134 | controller |
2026-03-18 16:31:12.274145 | controller | TASK [libvirt_manager : Check image] *******************************************
2026-03-18 16:31:12.274159 | controller | Wednesday 18 March 2026  16:31:12 +0000 (0:00:30.196)       0:02:01.008 *******
2026-03-18 16:31:12.465608 | controller | ok: [instance]
2026-03-18 16:31:12.507748 | controller |
2026-03-18 16:31:12.507767 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2026-03-18 16:31:12.507775 | controller | Wednesday 18 March 2026  16:31:12 +0000 (0:00:00.191)       0:02:01.200 *******
2026-03-18 16:31:12.507784 | controller | ok: [instance] => changed=false
2026-03-18 16:31:12.731426 | controller |   msg: All assertions passed
2026-03-18 16:31:12.731451 | controller |
2026-03-18 16:31:12.731461 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2026-03-18 16:31:12.731468 | controller | Wednesday 18 March 2026  16:31:12 +0000 (0:00:00.042)       0:02:01.242 *******
2026-03-18 16:31:12.731479 | controller | changed: [instance]
2026-03-18 16:31:12.930003 | controller |
2026-03-18 16:31:12.930042 | controller | TASK [libvirt_manager : Ensure directory exists] *******************************
2026-03-18 16:31:12.930051 | controller | Wednesday 18 March 2026  16:31:12 +0000 (0:00:00.223)       0:02:01.466 *******
2026-03-18 16:31:12.930061 | controller | ok: [instance]
2026-03-18 16:31:12.930087 | controller |
2026-03-18 16:31:12.930096 | controller | TASK [libvirt_manager : Check if base image exists] ****************************
2026-03-18 16:31:12.930251 | controller | Wednesday 18 March 2026  16:31:12 +0000 (0:00:00.198)       0:02:01.664 *******
2026-03-18 16:31:13.123081 | controller | ok: [instance]
2026-03-18 16:31:13.145405 | controller |
2026-03-18 16:31:13.145428 | controller | TASK [libvirt_manager : Download base image] ***********************************
2026-03-18 16:31:13.145438 | controller | Wednesday 18 March 2026  16:31:13 +0000 (0:00:00.193)       0:02:01.857 *******
2026-03-18 16:31:13.145449 | controller | skipping: [instance]
2026-03-18 16:31:13.336861 | controller |
2026-03-18 16:31:13.336886 | controller | TASK [libvirt_manager : Check image] *******************************************
2026-03-18 16:31:13.336895 | controller | Wednesday 18 March 2026  16:31:13 +0000 (0:00:00.022)       0:02:01.879 *******
2026-03-18 16:31:13.336906 | controller | ok: [instance]
2026-03-18 16:31:13.377865 | controller |
2026-03-18 16:31:13.377888 | controller | TASK [libvirt_manager : Assert image status] ***********************************
2026-03-18 16:31:13.377897 | controller | Wednesday 18 March 2026  16:31:13 +0000 (0:00:00.191)       0:02:02.071 *******
2026-03-18 16:31:13.377908 | controller | ok: [instance] => changed=false
2026-03-18 16:31:13.581071 | controller |   msg: All assertions passed
2026-03-18 16:31:13.581096 | controller |
2026-03-18 16:31:13.581105 | controller | TASK [libvirt_manager : Ensure image access rights] ****************************
2026-03-18 16:31:13.581112 | controller | Wednesday 18 March 2026  16:31:13 +0000 (0:00:00.040)       0:02:02.112 *******
2026-03-18 16:31:13.581123 | controller | ok: [instance]
2026-03-18 16:31:13.581339 | controller |
2026-03-18 16:31:13.581361 | controller | TASK [libvirt_manager : Get ssh key state] *************************************
2026-03-18 16:31:13.753042 | controller | Wednesday 18 March 2026  16:31:13 +0000 (0:00:00.203)       0:02:02.315 *******
2026-03-18 16:31:13.753072 | controller | ok: [instance]
2026-03-18 16:31:14.128864 | controller |
2026-03-18 16:31:14.128891 | controller | TASK [libvirt_manager : Create temporary ssh keypair] **************************
2026-03-18 16:31:14.128900 | controller | Wednesday 18 March 2026  16:31:13 +0000 (0:00:00.171)       0:02:02.487 *******
2026-03-18 16:31:14.128910 | controller | changed: [instance]
2026-03-18 16:31:14.303302 | controller |
2026-03-18 16:31:14.303321 | controller | TASK [libvirt_manager : Slurp public key for later use] ************************
2026-03-18 16:31:14.303329 | controller | Wednesday 18 March 2026  16:31:14 +0000 (0:00:00.375)       0:02:02.863 *******
2026-03-18 16:31:14.303338 | controller | ok: [instance]
2026-03-18 16:31:14.472664 | controller |
2026-03-18 16:31:14.472687 | controller | TASK [libvirt_manager : Slurp private key for later use] ***********************
2026-03-18 16:31:14.472697 | controller | Wednesday 18 March 2026  16:31:14 +0000 (0:00:00.174)       0:02:03.038 *******
2026-03-18 16:31:14.472708 | controller | ok: [instance]
2026-03-18 16:31:14.851850 | controller |
2026-03-18 16:31:14.851881 | controller | TASK [libvirt_manager : Inject cifmw_reproducer_key.pub in hypervisor authorized_keys] ***
2026-03-18 16:31:14.851896 | controller | Wednesday 18 March 2026  16:31:14 +0000 (0:00:00.169)       0:02:03.207 *******
2026-03-18 16:31:14.851908 | controller | changed: [instance]
2026-03-18 16:31:14.872055 | controller |
2026-03-18 16:31:14.872078 | controller | TASK [libvirt_manager : Create fact holding network data for VMs] **************
2026-03-18 16:31:14.872088 | controller | Wednesday 18 March 2026  16:31:14 +0000 (0:00:00.379)       0:02:03.586 *******
2026-03-18 16:31:14.872099 | controller | ok: [instance]
2026-03-18 16:31:14.872267 | controller |
2026-03-18 16:31:14.872284 | controller | TASK [libvirt_manager : List existing networks] ********************************
2026-03-18 16:31:15.092382 | controller | Wednesday 18 March 2026  16:31:14 +0000 (0:00:00.020)       0:02:03.607 *******
2026-03-18 16:31:15.092416 | controller | ok: [instance]
2026-03-18 16:31:15.541534 | controller |
2026-03-18 16:31:15.541560 | controller | TASK [libvirt_manager : Gather pool fact] **************************************
2026-03-18 16:31:15.541568 | controller | Wednesday 18 March 2026  16:31:15 +0000 (0:00:00.219)       0:02:03.826 *******
2026-03-18 16:31:15.541577 | controller | ok: [instance]
2026-03-18 16:31:15.692924 | controller |
2026-03-18 16:31:15.692972 | controller | TASK [libvirt_manager : Create and run VMs] ************************************
2026-03-18 16:31:15.692980 | controller | Wednesday 18 March 2026  16:31:15 +0000 (0:00:00.449)       0:02:04.276 *******
2026-03-18 16:31:15.692991 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-18 16:31:15.938647 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-18 16:31:15.938675 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-18 16:31:15.938684 | controller |
2026-03-18 16:31:15.938690 | controller | TASK [libvirt_manager : Create VM image for compute-0] *************************
2026-03-18 16:31:15.938696 | controller | Wednesday 18 March 2026  16:31:15 +0000 (0:00:00.151)       0:02:04.427 *******
2026-03-18 16:31:15.938705 | controller | changed: [instance]
2026-03-18 16:31:16.153013 | controller |
2026-03-18 16:31:16.153043 | controller | TASK [libvirt_manager : Ensure file ownership and rights for compute-0] ********
2026-03-18 16:31:16.153051 | controller | Wednesday 18 March 2026  16:31:15 +0000 (0:00:00.246)       0:02:04.673 *******
2026-03-18 16:31:16.153062 | controller | changed: [instance]
2026-03-18 16:31:16.153392 | controller |
2026-03-18 16:31:16.438145 | controller | TASK [libvirt_manager : Define VMs for type compute-0] *************************
2026-03-18 16:31:16.438197 | controller | Wednesday 18 March 2026  16:31:16 +0000 (0:00:00.214)       0:02:04.887 *******
2026-03-18 16:31:16.438218 | controller | changed: [instance]
2026-03-18 16:31:16.465340 | controller |
2026-03-18 16:31:16.465370 | controller | TASK [libvirt_manager : Attach listed networks to the VMs compute-0] ***********
2026-03-18 16:31:16.465380 | controller | Wednesday 18 March 2026  16:31:16 +0000 (0:00:00.284)       0:02:05.172 *******
2026-03-18 16:31:16.465391 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-03-18 16:31:16.509089 | controller |
2026-03-18 16:31:16.509311 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-03-18 16:31:16.509321 | controller | Wednesday 18 March 2026  16:31:16 +0000 (0:00:00.027)       0:02:05.200 *******
2026-03-18 16:31:16.509333 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-03-18 16:31:16.735431 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-03-18 16:31:16.735471 | controller |
2026-03-18 16:31:16.735482 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-18 16:31:16.735489 | controller | Wednesday 18 March 2026  16:31:16 +0000 (0:00:00.043)       0:02:05.243 *******
2026-03-18 16:31:16.735508 | controller | ok: [instance]
2026-03-18 16:31:16.735531 | controller |
2026-03-18 16:31:16.735709 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-18 16:31:16.783047 | controller | Wednesday 18 March 2026  16:31:16 +0000 (0:00:00.226)       0:02:05.470 *******
2026-03-18 16:31:16.783074 | controller | ok: [instance] => (item=cifmw-public)
2026-03-18 16:31:17.010520 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-18 16:31:17.010546 | controller |
2026-03-18 16:31:17.010556 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-18 16:31:17.010563 | controller | Wednesday 18 March 2026  16:31:16 +0000 (0:00:00.047)       0:02:05.517 *******
2026-03-18 16:31:17.010573 | controller | ok: [instance]
2026-03-18 16:31:17.209834 | controller |
2026-03-18 16:31:17.209862 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-18 16:31:17.209872 | controller | Wednesday 18 March 2026  16:31:17 +0000 (0:00:00.227)       0:02:05.745 *******
2026-03-18 16:31:17.209883 | controller | ok: [instance]
2026-03-18 16:31:17.501043 | controller |
2026-03-18 16:31:17.501083 | controller | TASK [libvirt_manager : Attach interface public on cifmw-compute-0] ************
2026-03-18 16:31:17.501093 | controller | Wednesday 18 March 2026  16:31:17 +0000 (0:00:00.199)       0:02:05.944 *******
2026-03-18 16:31:17.501105 | controller | changed: [instance]
2026-03-18 16:31:17.501127 | controller |
2026-03-18 16:31:17.501310 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-18 16:31:17.720673 | controller | Wednesday 18 March 2026  16:31:17 +0000 (0:00:00.291)       0:02:06.235 *******
2026-03-18 16:31:17.720700 | controller | ok: [instance]
2026-03-18 16:31:17.765578 | controller |
2026-03-18 16:31:17.765603 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-18 16:31:17.765611 | controller | Wednesday 18 March 2026  16:31:17 +0000 (0:00:00.219)       0:02:06.455 *******
2026-03-18 16:31:17.765621 | controller | ok: [instance] => (item=cifmw-public)
2026-03-18 16:31:18.008065 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-18 16:31:18.008099 | controller |
2026-03-18 16:31:18.008109 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-18 16:31:18.008118 | controller | Wednesday 18 March 2026  16:31:17 +0000 (0:00:00.044)       0:02:06.500 *******
2026-03-18 16:31:18.008130 | controller | ok: [instance]
2026-03-18 16:31:18.199836 | controller |
2026-03-18 16:31:18.199868 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-18 16:31:18.199879 | controller | Wednesday 18 March 2026  16:31:18 +0000 (0:00:00.242)       0:02:06.742 *******
2026-03-18 16:31:18.199888 | controller | ok: [instance]
2026-03-18 16:31:18.477515 | controller |
2026-03-18 16:31:18.477553 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-compute-0] *********
2026-03-18 16:31:18.477561 | controller | Wednesday 18 March 2026  16:31:18 +0000 (0:00:00.191)       0:02:06.934 *******
2026-03-18 16:31:18.477570 | controller | changed: [instance]
2026-03-18 16:31:18.499025 | controller |
2026-03-18 16:31:18.499052 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs compute-0] *****
2026-03-18 16:31:18.499061 | controller | Wednesday 18 March 2026  16:31:18 +0000 (0:00:00.277)       0:02:07.212 *******
2026-03-18 16:31:18.499073 | controller | skipping: [instance]
2026-03-18 16:31:18.499124 | controller |
2026-03-18 16:31:18.499140 | controller | TASK [libvirt_manager : Create the requested extra disks for compute-0] ********
2026-03-18 16:31:18.499150 | controller | Wednesday 18 March 2026  16:31:18 +0000 (0:00:00.021)       0:02:07.233 *******
2026-03-18 16:31:18.528105 | controller | skipping: [instance]
2026-03-18 16:31:18.556088 | controller |
2026-03-18 16:31:18.556122 | controller | TASK [libvirt_manager : Find volume attachments for VM compute-0] **************
2026-03-18 16:31:18.556132 | controller | Wednesday 18 March 2026  16:31:18 +0000 (0:00:00.028)       0:02:07.262 *******
2026-03-18 16:31:18.556143 | controller | skipping: [instance]
2026-03-18 16:31:18.556170 | controller |
2026-03-18 16:31:18.556178 | controller | TASK [libvirt_manager : Attach volumes for VM compute-0] ***********************
2026-03-18 16:31:18.556187 | controller | Wednesday 18 March 2026  16:31:18 +0000 (0:00:00.028)       0:02:07.290 *******
2026-03-18 16:31:18.581621 | controller | skipping: [instance]
2026-03-18 16:31:18.790680 | controller |
2026-03-18 16:31:18.790708 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-03-18 16:31:18.790716 | controller | Wednesday 18 March 2026  16:31:18 +0000 (0:00:00.025)       0:02:07.316 *******
2026-03-18 16:31:18.790726 | controller | changed: [instance]
2026-03-18 16:31:18.827914 | controller |
2026-03-18 16:31:18.827949 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-03-18 16:31:18.827959 | controller | Wednesday 18 March 2026  16:31:18 +0000 (0:00:00.208)       0:02:07.525 *******
2026-03-18 16:31:18.827968 | controller | ok: [instance]
2026-03-18 16:31:18.884126 | controller |
2026-03-18 16:31:18.884175 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-03-18 16:31:18.884189 | controller | Wednesday 18 March 2026  16:31:18 +0000 (0:00:00.037)       0:02:07.562 *******
2026-03-18 16:31:18.884211 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2026-03-18 16:31:18.884477 | controller |
2026-03-18 16:31:18.884511 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2026-03-18 16:31:19.076986 | controller | Wednesday 18 March 2026  16:31:18 +0000 (0:00:00.056)       0:02:07.618 *******
2026-03-18 16:31:19.077033 | controller | ok: [instance]
2026-03-18 16:31:19.138144 | controller |
2026-03-18 16:31:19.138195 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2026-03-18 16:31:19.138209 | controller | Wednesday 18 March 2026  16:31:19 +0000 (0:00:00.192)       0:02:07.811 *******
2026-03-18 16:31:19.138227 | controller | ok: [instance]
2026-03-18 16:31:19.181064 | controller |
2026-03-18 16:31:19.181101 | controller | TASK [libvirt_manager : Define the user data] **********************************
2026-03-18 16:31:19.181113 | controller | Wednesday 18 March 2026  16:31:19 +0000 (0:00:00.061)       0:02:07.872 *******
2026-03-18 16:31:19.181126 | controller | ok: [instance]
2026-03-18 16:31:19.220098 | controller |
2026-03-18 16:31:19.220135 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2026-03-18 16:31:19.220145 | controller | Wednesday 18 March 2026  16:31:19 +0000 (0:00:00.042)       0:02:07.915 *******
2026-03-18 16:31:19.220156 | controller | skipping: [instance]
2026-03-18 16:31:19.220197 | controller |
2026-03-18 16:31:19.220341 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2026-03-18 16:31:19.220372 | controller | Wednesday 18 March 2026  16:31:19 +0000 (0:00:00.039)       0:02:07.955 *******
2026-03-18 16:31:19.260091 | controller | skipping: [instance]
2026-03-18 16:31:19.315704 | controller |
2026-03-18 16:31:19.315737 | controller | TASK [Call the config_drive role] **********************************************
2026-03-18 16:31:19.315747 | controller | Wednesday 18 March 2026  16:31:19 +0000 (0:00:00.039)       0:02:07.994 *******
2026-03-18 16:31:19.315758 | controller |
2026-03-18 16:31:19.709074 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2026-03-18 16:31:19.709109 | controller | Wednesday 18 March 2026  16:31:19 +0000 (0:00:00.055)       0:02:08.050 *******
2026-03-18 16:31:19.709135 | controller | ok: [instance] => (item=artifacts)
2026-03-18 16:31:19.709166 | controller | ok: [instance] => (item=logs)
2026-03-18 16:31:19.709175 | controller |
2026-03-18 16:31:19.709185 | controller | TASK [config_drive : Install required RPM packages] ****************************
2026-03-18 16:31:19.709285 | controller | Wednesday 18 March 2026  16:31:19 +0000 (0:00:00.393)       0:02:08.443 *******
2026-03-18 16:31:20.958727 | controller | ok: [instance]
2026-03-18 16:31:21.167724 | controller |
2026-03-18 16:31:21.167767 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2026-03-18 16:31:21.167777 | controller | Wednesday 18 March 2026  16:31:20 +0000 (0:00:01.249)       0:02:09.693 *******
2026-03-18 16:31:21.167790 | controller | changed: [instance]
2026-03-18 16:31:21.523506 | controller |
2026-03-18 16:31:21.523539 | controller | TASK [config_drive : Generate meta-data] ***************************************
2026-03-18 16:31:21.523548 | controller | Wednesday 18 March 2026  16:31:21 +0000 (0:00:00.208)       0:02:09.902 *******
2026-03-18 16:31:21.523558 | controller | changed: [instance]
2026-03-18 16:31:21.886758 | controller |
2026-03-18 16:31:21.886792 | controller | TASK [config_drive : Generate user-data] ***************************************
2026-03-18 16:31:21.886804 | controller | Wednesday 18 March 2026  16:31:21 +0000 (0:00:00.355)       0:02:10.258 *******
2026-03-18 16:31:21.886816 | controller | changed: [instance]
2026-03-18 16:31:21.929562 | controller |
2026-03-18 16:31:21.929583 | controller | TASK [config_drive : Generate network-data] ************************************
2026-03-18 16:31:21.929590 | controller | Wednesday 18 March 2026  16:31:21 +0000 (0:00:00.363)       0:02:10.621 *******
2026-03-18 16:31:21.929598 | controller | skipping: [instance]
2026-03-18 16:31:22.127604 | controller |
2026-03-18 16:31:22.127637 | controller | TASK [config_drive : Check ISO availability] ***********************************
2026-03-18 16:31:22.127645 | controller | Wednesday 18 March 2026  16:31:21 +0000 (0:00:00.043)       0:02:10.664 *******
2026-03-18 16:31:22.127655 | controller | ok: [instance]
2026-03-18 16:31:22.167976 | controller |
2026-03-18 16:31:22.168016 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2026-03-18 16:31:22.168025 | controller | Wednesday 18 March 2026  16:31:22 +0000 (0:00:00.197)       0:02:10.862 *******
2026-03-18 16:31:22.168036 | controller | skipping: [instance]
2026-03-18 16:31:22.393041 | controller |
2026-03-18 16:31:22.393083 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2026-03-18 16:31:22.393093 | controller | Wednesday 18 March 2026  16:31:22 +0000 (0:00:00.040)       0:02:10.902 *******
2026-03-18 16:31:22.393107 | controller | Follow script's output here: /opt/basedir/logs/ci_script_000_generate_nocloud_iso.log
2026-03-18 16:31:22.393135 | controller | changed: [instance]
2026-03-18 16:31:22.393145 | controller |
2026-03-18 16:31:22.393257 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-03-18 16:31:22.393288 | controller | Wednesday 18 March 2026  16:31:22 +0000 (0:00:00.225)       0:02:11.127 *******
2026-03-18 16:31:22.669327 | controller | changed: [instance]
2026-03-18 16:31:22.712177 | controller |
2026-03-18 16:31:22.712228 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-03-18 16:31:22.712243 | controller | Wednesday 18 March 2026  16:31:22 +0000 (0:00:00.276)       0:02:11.403 *******
2026-03-18 16:31:22.712262 | controller | skipping: [instance]
2026-03-18 16:31:22.740665 | controller |
2026-03-18 16:31:22.740700 | controller | TASK [libvirt_manager : Configure boot order for compute-0] ********************
2026-03-18 16:31:22.740710 | controller | Wednesday 18 March 2026  16:31:22 +0000 (0:00:00.043)       0:02:11.446 *******
2026-03-18 16:31:22.740722 | controller | skipping: [instance]
2026-03-18 16:31:22.984100 | controller |
2026-03-18 16:31:22.984149 | controller | TASK [libvirt_manager : Create VM image for controller-0] **********************
2026-03-18 16:31:22.984163 | controller | Wednesday 18 March 2026  16:31:22 +0000 (0:00:00.028)       0:02:11.475 *******
2026-03-18 16:31:22.984182 | controller | changed: [instance]
2026-03-18 16:31:23.196086 | controller |
2026-03-18 16:31:23.196126 | controller | TASK [libvirt_manager : Ensure file ownership and rights for controller-0] *****
2026-03-18 16:31:23.196136 | controller | Wednesday 18 March 2026  16:31:22 +0000 (0:00:00.243)       0:02:11.718 *******
2026-03-18 16:31:23.196149 | controller | changed: [instance]
2026-03-18 16:31:23.196190 | controller |
2026-03-18 16:31:23.196199 | controller | TASK [libvirt_manager : Define VMs for type controller-0] **********************
2026-03-18 16:31:23.196209 | controller | Wednesday 18 March 2026  16:31:23 +0000 (0:00:00.211)       0:02:11.930 *******
2026-03-18 16:31:23.516640 | controller | changed: [instance]
2026-03-18 16:31:23.544395 | controller |
2026-03-18 16:31:23.544418 | controller | TASK [libvirt_manager : Attach listed networks to the VMs controller-0] ********
2026-03-18 16:31:23.544428 | controller | Wednesday 18 March 2026  16:31:23 +0000 (0:00:00.320)       0:02:12.251 *******
2026-03-18 16:31:23.544444 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-03-18 16:31:23.586037 | controller |
2026-03-18 16:31:23.586077 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-03-18 16:31:23.586088 | controller | Wednesday 18 March 2026  16:31:23 +0000 (0:00:00.028)       0:02:12.279 *******
2026-03-18 16:31:23.586102 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-03-18 16:31:23.586604 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-03-18 16:31:23.586641 | controller |
2026-03-18 16:31:23.812878 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-18 16:31:23.812914 | controller | Wednesday 18 March 2026  16:31:23 +0000 (0:00:00.041)       0:02:12.320 *******
2026-03-18 16:31:23.812926 | controller | ok: [instance]
2026-03-18 16:31:23.861044 | controller |
2026-03-18 16:31:23.861072 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-18 16:31:23.861082 | controller | Wednesday 18 March 2026  16:31:23 +0000 (0:00:00.226)       0:02:12.547 *******
2026-03-18 16:31:23.861093 | controller | ok: [instance] => (item=cifmw-public)
2026-03-18 16:31:23.861306 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-18 16:31:23.861315 | controller |
2026-03-18 16:31:23.861324 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-18 16:31:23.861418 | controller | Wednesday 18 March 2026  16:31:23 +0000 (0:00:00.048)       0:02:12.595 *******
2026-03-18 16:31:24.094415 | controller | ok: [instance]
2026-03-18 16:31:24.293355 | controller |
2026-03-18 16:31:24.293387 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-18 16:31:24.293395 | controller | Wednesday 18 March 2026  16:31:24 +0000 (0:00:00.233)       0:02:12.828 *******
2026-03-18 16:31:24.293405 | controller | ok: [instance]
2026-03-18 16:31:24.583894 | controller |
2026-03-18 16:31:24.583941 | controller | TASK [libvirt_manager : Attach interface public on cifmw-controller-0] *********
2026-03-18 16:31:24.583953 | controller | Wednesday 18 March 2026  16:31:24 +0000 (0:00:00.198)       0:02:13.027 *******
2026-03-18 16:31:24.583964 | controller | changed: [instance]
2026-03-18 16:31:24.813777 | controller |
2026-03-18 16:31:24.813808 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-18 16:31:24.813816 | controller | Wednesday 18 March 2026  16:31:24 +0000 (0:00:00.290)       0:02:13.318 *******
2026-03-18 16:31:24.813827 | controller | ok: [instance]
2026-03-18 16:31:24.858036 | controller |
2026-03-18 16:31:24.858061 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-18 16:31:24.858069 | controller | Wednesday 18 March 2026  16:31:24 +0000 (0:00:00.229)       0:02:13.548 *******
2026-03-18 16:31:24.858079 | controller | ok: [instance] => (item=cifmw-public)
2026-03-18 16:31:25.078944 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-18 16:31:25.078969 | controller |
2026-03-18 16:31:25.078977 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-18 16:31:25.078984 | controller | Wednesday 18 March 2026  16:31:24 +0000 (0:00:00.044)       0:02:13.592 *******
2026-03-18 16:31:25.078994 | controller | ok: [instance]
2026-03-18 16:31:25.278384 | controller |
2026-03-18 16:31:25.278410 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-18 16:31:25.278418 | controller | Wednesday 18 March 2026  16:31:25 +0000 (0:00:00.220)       0:02:13.813 *******
2026-03-18 16:31:25.278428 | controller | ok: [instance]
2026-03-18 16:31:25.554913 | controller |
2026-03-18 16:31:25.554954 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-controller-0] ******
2026-03-18 16:31:25.554966 | controller | Wednesday 18 March 2026  16:31:25 +0000 (0:00:00.199)       0:02:14.013 *******
2026-03-18 16:31:25.554976 | controller | changed: [instance]
2026-03-18 16:31:25.576896 | controller |
2026-03-18 16:31:25.576917 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs controller-0] ***
2026-03-18 16:31:25.576925 | controller | Wednesday 18 March 2026  16:31:25 +0000 (0:00:00.276)       0:02:14.289 *******
2026-03-18 16:31:25.576953 | controller | skipping: [instance]
2026-03-18 16:31:25.606046 | controller |
2026-03-18 16:31:25.606082 | controller | TASK [libvirt_manager : Create the requested extra disks for controller-0] *****
2026-03-18 16:31:25.606092 | controller | Wednesday 18 March 2026  16:31:25 +0000 (0:00:00.022)       0:02:14.311 *******
2026-03-18 16:31:25.606105 | controller | skipping: [instance]
2026-03-18 16:31:25.633394 | controller |
2026-03-18 16:31:25.633419 | controller | TASK [libvirt_manager : Find volume attachments for VM controller-0] ***********
2026-03-18 16:31:25.633426 | controller | Wednesday 18 March 2026  16:31:25 +0000 (0:00:00.029)       0:02:14.340 *******
2026-03-18 16:31:25.633440 | controller | skipping: [instance]
2026-03-18 16:31:25.659476 | controller |
2026-03-18 16:31:25.659494 | controller | TASK [libvirt_manager : Attach volumes for VM controller-0] ********************
2026-03-18 16:31:25.659501 | controller | Wednesday 18 March 2026  16:31:25 +0000 (0:00:00.027)       0:02:14.368 *******
2026-03-18 16:31:25.659510 | controller | skipping: [instance]
2026-03-18 16:31:25.872958 | controller |
2026-03-18 16:31:25.873018 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-03-18 16:31:25.873031 | controller | Wednesday 18 March 2026  16:31:25 +0000 (0:00:00.025)       0:02:14.394 *******
2026-03-18 16:31:25.873041 | controller | changed: [instance]
2026-03-18 16:31:25.911063 | controller |
2026-03-18 16:31:25.911088 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-03-18 16:31:25.911098 | controller | Wednesday 18 March 2026  16:31:25 +0000 (0:00:00.213)       0:02:14.607 *******
2026-03-18 16:31:25.911110 | controller | ok: [instance]
2026-03-18 16:31:25.911282 | controller |
2026-03-18 16:31:25.911301 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-03-18 16:31:25.965117 | controller | Wednesday 18 March 2026  16:31:25 +0000 (0:00:00.038)       0:02:14.645 *******
2026-03-18 16:31:25.965171 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/create_cloud_init_iso.yml for instance
2026-03-18 16:31:26.158551 | controller |
2026-03-18 16:31:26.158574 | controller | TASK [libvirt_manager : Acquire authorized_keys from hypervisor] ***************
2026-03-18 16:31:26.158582 | controller | Wednesday 18 March 2026  16:31:25 +0000 (0:00:00.053)       0:02:14.699 *******
2026-03-18 16:31:26.158591 | controller | ok: [instance]
2026-03-18 16:31:26.219587 | controller |
2026-03-18 16:31:26.219620 | controller | TASK [libvirt_manager : Define the default users for the vm] *******************
2026-03-18 16:31:26.219634 | controller | Wednesday 18 March 2026  16:31:26 +0000 (0:00:00.193)       0:02:14.893 *******
2026-03-18 16:31:26.219650 | controller | ok: [instance]
2026-03-18 16:31:26.262153 | controller |
2026-03-18 16:31:26.262186 | controller | TASK [libvirt_manager : Define the user data] **********************************
2026-03-18 16:31:26.262200 | controller | Wednesday 18 March 2026  16:31:26 +0000 (0:00:00.060)       0:02:14.953 *******
2026-03-18 16:31:26.262216 | controller | ok: [instance]
2026-03-18 16:31:26.262400 | controller |
2026-03-18 16:31:26.262733 | controller | TASK [libvirt_manager : Define the network config for all vms] *****************
2026-03-18 16:31:26.262882 | controller | Wednesday 18 March 2026  16:31:26 +0000 (0:00:00.043)       0:02:14.996 *******
2026-03-18 16:31:26.302654 | controller | skipping: [instance]
2026-03-18 16:31:26.302818 | controller |
2026-03-18 16:31:26.303009 | controller | TASK [libvirt_manager : Define the network config for each vm] *****************
2026-03-18 16:31:26.303167 | controller | Wednesday 18 March 2026  16:31:26 +0000 (0:00:00.040)       0:02:15.037 *******
2026-03-18 16:31:26.342362 | controller | skipping: [instance]
2026-03-18 16:31:26.342526 | controller |
2026-03-18 16:31:26.342677 | controller | TASK [Call the config_drive role] **********************************************
2026-03-18 16:31:26.342818 | controller | Wednesday 18 March 2026  16:31:26 +0000 (0:00:00.039)       0:02:15.077 *******
2026-03-18 16:31:26.399699 | controller |
2026-03-18 16:31:26.400005 | controller | TASK [config_drive : Ensure needed directories exist] **************************
2026-03-18 16:31:26.400141 | controller | Wednesday 18 March 2026  16:31:26 +0000 (0:00:00.057)       0:02:15.134 *******
2026-03-18 16:31:26.778054 | controller | ok: [instance] => (item=artifacts)
2026-03-18 16:31:26.778130 | controller | ok: [instance] => (item=logs)
2026-03-18 16:31:26.778141 | controller |
2026-03-18 16:31:26.778151 | controller | TASK [config_drive : Install required RPM packages] ****************************
2026-03-18 16:31:26.778206 | controller | Wednesday 18 March 2026  16:31:26 +0000 (0:00:00.378)       0:02:15.512 *******
2026-03-18 16:31:28.009413 | controller | ok: [instance]
2026-03-18 16:31:28.223150 | controller |
2026-03-18 16:31:28.223175 | controller | TASK [config_drive : Crate config drive instance directory] ********************
2026-03-18 16:31:28.223183 | controller | Wednesday 18 March 2026  16:31:28 +0000 (0:00:01.231)       0:02:16.743 *******
2026-03-18 16:31:28.223197 | controller | changed: [instance]
2026-03-18 16:31:28.587875 | controller |
2026-03-18 16:31:28.587900 | controller | TASK [config_drive : Generate meta-data] ***************************************
2026-03-18 16:31:28.587908 | controller | Wednesday 18 March 2026  16:31:28 +0000 (0:00:00.213)       0:02:16.957 *******
2026-03-18 16:31:28.587917 | controller | changed: [instance]
2026-03-18 16:31:28.955220 | controller |
2026-03-18 16:31:28.955257 | controller | TASK [config_drive : Generate user-data] ***************************************
2026-03-18 16:31:28.955267 | controller | Wednesday 18 March 2026  16:31:28 +0000 (0:00:00.364)       0:02:17.322 *******
2026-03-18 16:31:28.955280 | controller | changed: [instance]
2026-03-18 16:31:29.001093 | controller |
2026-03-18 16:31:29.001116 | controller | TASK [config_drive : Generate network-data] ************************************
2026-03-18 16:31:29.001126 | controller | Wednesday 18 March 2026  16:31:28 +0000 (0:00:00.367)       0:02:17.690 *******
2026-03-18 16:31:29.001137 | controller | skipping: [instance]
2026-03-18 16:31:29.001168 | controller |
2026-03-18 16:31:29.001178 | controller | TASK [config_drive : Check ISO availability] ***********************************
2026-03-18 16:31:29.001324 | controller | Wednesday 18 March 2026  16:31:28 +0000 (0:00:00.045)       0:02:17.735 *******
2026-03-18 16:31:29.200724 | controller | ok: [instance]
2026-03-18 16:31:29.241628 | controller |
2026-03-18 16:31:29.241652 | controller | TASK [config_drive : Assert we don't try to change an existing ISO] ************
2026-03-18 16:31:29.241661 | controller | Wednesday 18 March 2026  16:31:29 +0000 (0:00:00.199)       0:02:17.935 *******
2026-03-18 16:31:29.241672 | controller | skipping: [instance]
2026-03-18 16:31:29.473024 | controller |
2026-03-18 16:31:29.473059 | controller | TASK [config_drive : Generate nocloud iso image] *******************************
2026-03-18 16:31:29.473067 | controller | Wednesday 18 March 2026  16:31:29 +0000 (0:00:00.040)       0:02:17.976 *******
2026-03-18 16:31:29.473079 | controller | Follow script's output here: /opt/basedir/logs/ci_script_001_generate_nocloud_iso.log
2026-03-18 16:31:29.746622 | controller | changed: [instance]
2026-03-18 16:31:29.746655 | controller |
2026-03-18 16:31:29.746663 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-03-18 16:31:29.746670 | controller | Wednesday 18 March 2026  16:31:29 +0000 (0:00:00.231)       0:02:18.207 *******
2026-03-18 16:31:29.746679 | controller | changed: [instance]
2026-03-18 16:31:29.791563 | controller |
2026-03-18 16:31:29.791587 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-03-18 16:31:29.791596 | controller | Wednesday 18 March 2026  16:31:29 +0000 (0:00:00.273)       0:02:18.481 *******
2026-03-18 16:31:29.791607 | controller | skipping: [instance]
2026-03-18 16:31:29.819121 | controller |
2026-03-18 16:31:29.819164 | controller | TASK [libvirt_manager : Configure boot order for controller-0] *****************
2026-03-18 16:31:29.819177 | controller | Wednesday 18 March 2026  16:31:29 +0000 (0:00:00.044)       0:02:18.526 *******
2026-03-18 16:31:29.819194 | controller | skipping: [instance]
2026-03-18 16:31:30.105106 | controller |
2026-03-18 16:31:30.105138 | controller | TASK [libvirt_manager : Create VM image for crc-0] *****************************
2026-03-18 16:31:30.105146 | controller | Wednesday 18 March 2026  16:31:29 +0000 (0:00:00.027)       0:02:18.553 *******
2026-03-18 16:31:30.105157 | controller | changed: [instance]
2026-03-18 16:31:30.345728 | controller |
2026-03-18 16:31:30.345764 | controller | TASK [libvirt_manager : Ensure file ownership and rights for crc-0] ************
2026-03-18 16:31:30.345774 | controller | Wednesday 18 March 2026  16:31:30 +0000 (0:00:00.285)       0:02:18.839 *******
2026-03-18 16:31:30.345786 | controller | changed: [instance]
2026-03-18 16:31:30.634046 | controller |
2026-03-18 16:31:30.634078 | controller | TASK [libvirt_manager : Define VMs for type crc-0] *****************************
2026-03-18 16:31:30.634086 | controller | Wednesday 18 March 2026  16:31:30 +0000 (0:00:00.240)       0:02:19.080 *******
2026-03-18 16:31:30.634096 | controller | changed: [instance]
2026-03-18 16:31:30.664103 | controller |
2026-03-18 16:31:30.664143 | controller | TASK [libvirt_manager : Attach listed networks to the VMs crc-0] ***************
2026-03-18 16:31:30.664153 | controller | Wednesday 18 March 2026  16:31:30 +0000 (0:00:00.288)       0:02:19.368 *******
2026-03-18 16:31:30.664166 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/net_to_vms.yml for instance
2026-03-18 16:31:30.709083 | controller |
2026-03-18 16:31:30.709114 | controller | TASK [libvirt_manager : Attach {{ vm_item }} to {{ net_item }}] ****************
2026-03-18 16:31:30.709127 | controller | Wednesday 18 March 2026  16:31:30 +0000 (0:00:00.030)       0:02:19.398 *******
2026-03-18 16:31:30.709143 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=public)
2026-03-18 16:31:30.931054 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/attach_interface.yml for instance => (item=osp_trunk)
2026-03-18 16:31:30.931089 | controller |
2026-03-18 16:31:30.931099 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-18 16:31:30.931107 | controller | Wednesday 18 March 2026  16:31:30 +0000 (0:00:00.044)       0:02:19.443 *******
2026-03-18 16:31:30.931119 | controller | ok: [instance]
2026-03-18 16:31:30.931151 | controller |
2026-03-18 16:31:30.931161 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-18 16:31:30.931255 | controller | Wednesday 18 March 2026  16:31:30 +0000 (0:00:00.222)       0:02:19.665 *******
2026-03-18 16:31:30.976053 | controller | ok: [instance] => (item=cifmw-public)
2026-03-18 16:31:30.976425 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-18 16:31:31.200801 | controller |
2026-03-18 16:31:31.200826 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-18 16:31:31.200834 | controller | Wednesday 18 March 2026  16:31:30 +0000 (0:00:00.045)       0:02:19.711 *******
2026-03-18 16:31:31.200844 | controller | ok: [instance]
2026-03-18 16:31:31.414027 | controller |
2026-03-18 16:31:31.414064 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-18 16:31:31.414072 | controller | Wednesday 18 March 2026  16:31:31 +0000 (0:00:00.224)       0:02:19.935 *******
2026-03-18 16:31:31.414084 | controller | ok: [instance]
2026-03-18 16:31:31.414292 | controller |
2026-03-18 16:31:31.414321 | controller | TASK [libvirt_manager : Attach interface public on cifmw-crc-0] ****************
2026-03-18 16:31:31.694019 | controller | Wednesday 18 March 2026  16:31:31 +0000 (0:00:00.213)       0:02:20.148 *******
2026-03-18 16:31:31.694063 | controller | changed: [instance]
2026-03-18 16:31:31.694430 | controller |
2026-03-18 16:31:31.925005 | controller | TASK [libvirt_manager : Get virtual network information] ***********************
2026-03-18 16:31:31.925028 | controller | Wednesday 18 March 2026  16:31:31 +0000 (0:00:00.280)       0:02:20.428 *******
2026-03-18 16:31:31.925039 | controller | ok: [instance]
2026-03-18 16:31:31.969512 | controller |
2026-03-18 16:31:31.969531 | controller | TASK [libvirt_manager : Create network to bridge mapping] **********************
2026-03-18 16:31:31.969538 | controller | Wednesday 18 March 2026  16:31:31 +0000 (0:00:00.230)       0:02:20.659 *******
2026-03-18 16:31:31.969547 | controller | ok: [instance] => (item=cifmw-public)
2026-03-18 16:31:32.195509 | controller | ok: [instance] => (item=cifmw-osp_trunk)
2026-03-18 16:31:32.195542 | controller |
2026-03-18 16:31:32.195550 | controller | TASK [libvirt_manager : Dump domain xml] ***************************************
2026-03-18 16:31:32.195557 | controller | Wednesday 18 March 2026  16:31:31 +0000 (0:00:00.044)       0:02:20.704 *******
2026-03-18 16:31:32.195567 | controller | ok: [instance]
2026-03-18 16:31:32.395560 | controller |
2026-03-18 16:31:32.395588 | controller | TASK [libvirt_manager : Extract networks from XML] *****************************
2026-03-18 16:31:32.395596 | controller | Wednesday 18 March 2026  16:31:32 +0000 (0:00:00.225)       0:02:20.929 *******
2026-03-18 16:31:32.395606 | controller | ok: [instance]
2026-03-18 16:31:32.717975 | controller |
2026-03-18 16:31:32.718018 | controller | TASK [libvirt_manager : Attach interface osp_trunk on cifmw-crc-0] *************
2026-03-18 16:31:32.718027 | controller | Wednesday 18 March 2026  16:31:32 +0000 (0:00:00.200)       0:02:21.130 *******
2026-03-18 16:31:32.718037 | controller | changed: [instance]
2026-03-18 16:31:32.739102 | controller |
2026-03-18 16:31:32.739135 | controller | TASK [libvirt_manager : Attach spines/leafs networks to the VMs crc-0] *********
2026-03-18 16:31:32.739148 | controller | Wednesday 18 March 2026  16:31:32 +0000 (0:00:00.321)       0:02:21.452 *******
2026-03-18 16:31:32.739163 | controller | skipping: [instance]
2026-03-18 16:31:32.739245 | controller |
2026-03-18 16:31:32.739271 | controller | TASK [libvirt_manager : Create the requested extra disks for crc-0] ************
2026-03-18 16:31:32.739285 | controller | Wednesday 18 March 2026  16:31:32 +0000 (0:00:00.021)       0:02:21.474 *******
2026-03-18 16:31:32.767345 | controller | skipping: [instance]
2026-03-18 16:31:32.794921 | controller |
2026-03-18 16:31:32.794951 | controller | TASK [libvirt_manager : Find volume attachments for VM crc-0] ******************
2026-03-18 16:31:32.794958 | controller | Wednesday 18 March 2026  16:31:32 +0000 (0:00:00.028)       0:02:21.502 *******
2026-03-18 16:31:32.794966 | controller | skipping: [instance]
2026-03-18 16:31:32.822097 | controller |
2026-03-18 16:31:32.822135 | controller | TASK [libvirt_manager : Attach volumes for VM crc-0] ***************************
2026-03-18 16:31:32.822145 | controller | Wednesday 18 March 2026  16:31:32 +0000 (0:00:00.027)       0:02:21.529 *******
2026-03-18 16:31:32.822157 | controller | skipping: [instance]
2026-03-18 16:31:33.035869 | controller |
2026-03-18 16:31:33.035899 | controller | TASK [libvirt_manager : Get VM UUID] *******************************************
2026-03-18 16:31:33.035909 | controller | Wednesday 18 March 2026  16:31:32 +0000 (0:00:00.026)       0:02:21.556 *******
2026-03-18 16:31:33.035921 | controller | changed: [instance]
2026-03-18 16:31:33.073597 | controller |
2026-03-18 16:31:33.073629 | controller | TASK [libvirt_manager : Inject UUID in dataset] ********************************
2026-03-18 16:31:33.073638 | controller | Wednesday 18 March 2026  16:31:33 +0000 (0:00:00.213)       0:02:21.770 *******
2026-03-18 16:31:33.073648 | controller | ok: [instance]
2026-03-18 16:31:33.098158 | controller |
2026-03-18 16:31:33.098177 | controller | TASK [libvirt_manager : Create cloud-init ISO] *********************************
2026-03-18 16:31:33.098184 | controller | Wednesday 18 March 2026  16:31:33 +0000 (0:00:00.037)       0:02:21.808 *******
2026-03-18 16:31:33.098193 | controller | skipping: [instance]
2026-03-18 16:31:33.098319 | controller |
2026-03-18 16:31:33.098451 | controller | TASK [libvirt_manager : Attach cloud-init ISO if exists] ***********************
2026-03-18 16:31:33.098575 | controller | Wednesday 18 March 2026  16:31:33 +0000 (0:00:00.025)       0:02:21.833 *******
2026-03-18 16:31:33.123225 | controller | skipping: [instance]
2026-03-18 16:31:33.123387 | controller |
2026-03-18 16:31:33.123535 | controller | TASK [libvirt_manager : Attach additional devices if specified] ****************
2026-03-18 16:31:33.123666 | controller | Wednesday 18 March 2026  16:31:33 +0000 (0:00:00.024)       0:02:21.858 *******
2026-03-18 16:31:33.164497 | controller | skipping: [instance]
2026-03-18 16:31:33.164662 | controller |
2026-03-18 16:31:33.164787 | controller | TASK [libvirt_manager : Configure boot order for crc-0] ************************
2026-03-18 16:31:33.164907 | controller | Wednesday 18 March 2026  16:31:33 +0000 (0:00:00.041)       0:02:21.899 *******
2026-03-18 16:31:33.189630 | controller | skipping: [instance]
2026-03-18 16:31:33.189781 | controller |
2026-03-18 16:31:33.189907 | controller | TASK [libvirt_manager : Start (power-on) VMs] **********************************
2026-03-18 16:31:33.190061 | controller | Wednesday 18 March 2026  16:31:33 +0000 (0:00:00.025)       0:02:21.924 *******
2026-03-18 16:31:33.250579 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_vms.yml for instance
2026-03-18 16:31:33.250711 | controller |
2026-03-18 16:31:33.250834 | controller | TASK [libvirt_manager : Refresh oooq_pool before starting VMs] *****************
2026-03-18 16:31:33.250971 | controller | Wednesday 18 March 2026  16:31:33 +0000 (0:00:00.060)       0:02:21.985 *******
2026-03-18 16:31:33.483750 | controller | ok: [instance] => (item=crc)
2026-03-18 16:31:33.483960 | controller |
2026-03-18 16:31:33.484164 | controller | TASK [libvirt_manager : Start VMs for type {{ vm_type }}] **********************
2026-03-18 16:31:33.484311 | controller | Wednesday 18 March 2026  16:31:33 +0000 (0:00:00.232)       0:02:22.218 *******
2026-03-18 16:31:35.554272 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-18 16:31:35.554446 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-18 16:31:35.554583 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/start_one_vm.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-18 16:31:35.554710 | controller |
2026-03-18 16:31:35.554849 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-03-18 16:31:35.555007 | controller | Wednesday 18 March 2026  16:31:35 +0000 (0:00:02.070)       0:02:24.289 *******
2026-03-18 16:31:36.095424 | controller | changed: [instance]
2026-03-18 16:31:36.553553 | controller |
2026-03-18 16:31:36.553585 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-03-18 16:31:36.553593 | controller | Wednesday 18 March 2026  16:31:36 +0000 (0:00:00.540)       0:02:24.829 *******
2026-03-18 16:31:36.553603 | controller | changed: [instance]
2026-03-18 16:31:37.048032 | controller |
2026-03-18 16:31:37.048064 | controller | TASK [libvirt_manager : Start vm] **********************************************
2026-03-18 16:31:37.048072 | controller | Wednesday 18 March 2026  16:31:36 +0000 (0:00:00.458)       0:02:25.287 *******
2026-03-18 16:31:37.048082 | controller | changed: [instance]
2026-03-18 16:31:37.806589 | controller |
2026-03-18 16:31:37.806621 | controller | TASK [libvirt_manager : Wait for SSH on started VMs] ***************************
2026-03-18 16:31:37.806630 | controller | Wednesday 18 March 2026  16:31:37 +0000 (0:00:00.494)       0:02:25.782 *******
2026-03-18 16:31:37.806640 | controller | changed: [instance] => (item=compute-0.utility)
2026-03-18 16:32:00.827264 | controller | changed: [instance] => (item=controller-0.utility)
2026-03-18 16:32:00.827300 | controller | changed: [instance] => (item=crc-0.utility)
2026-03-18 16:32:00.827309 | controller |
2026-03-18 16:32:00.827315 | controller | TASK [libvirt_manager : Ensure we get SSH on nodes] ****************************
2026-03-18 16:32:00.827321 | controller | Wednesday 18 March 2026  16:31:37 +0000 (0:00:00.758)       0:02:26.540 *******
2026-03-18 16:32:00.827332 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (90 retries left).
2026-03-18 16:32:00.948710 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (89 retries left).
2026-03-18 16:32:00.948749 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (88 retries left).
2026-03-18 16:32:00.948756 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (87 retries left).
2026-03-18 16:32:00.948762 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (86 retries left).
2026-03-18 16:32:00.948768 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (85 retries left).
2026-03-18 16:32:00.948773 | controller | FAILED - RETRYING: [instance]: Ensure we get SSH on nodes (84 retries left).
2026-03-18 16:32:00.948779 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j916538397340.22841', 'results_file': '/home/zuul/.ansible_async/j916538397340.22841', 'changed': True, '_vm': {'key': 'compute-0', 'value': 'compute'}, 'ansible_loop_var': '_vm'})
2026-03-18 16:32:00.948790 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j650987199845.22858', 'results_file': '/home/zuul/.ansible_async/j650987199845.22858', 'changed': True, '_vm': {'key': 'controller-0', 'value': 'controller'}, 'ansible_loop_var': '_vm'})
2026-03-18 16:32:00.948796 | controller | ok: [instance] => (item={'failed': 0, 'started': 1, 'finished': 0, 'ansible_job_id': 'j802324147727.22874', 'results_file': '/home/zuul/.ansible_async/j802324147727.22874', 'changed': True, '_vm': {'key': 'crc-0', 'value': 'crc'}, 'ansible_loop_var': '_vm'})
2026-03-18 16:32:00.948802 | controller |
2026-03-18 16:32:00.948808 | controller | TASK [libvirt_manager : Configure managed VMs] *********************************
2026-03-18 16:32:00.948814 | controller | Wednesday 18 March 2026  16:32:00 +0000 (0:00:23.019)       0:02:49.560 *******
2026-03-18 16:32:00.948824 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'compute-0', 'value': 'compute'})
2026-03-18 16:32:00.973398 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'controller-0', 'value': 'controller'})
2026-03-18 16:32:00.973437 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/libvirt_manager/tasks/manage_vms.yml for instance => (item={'key': 'crc-0', 'value': 'crc'})
2026-03-18 16:32:00.973446 | controller |
2026-03-18 16:32:00.973453 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-18 16:32:00.973459 | controller | Wednesday 18 March 2026  16:32:00 +0000 (0:00:00.122)       0:02:49.682 *******
2026-03-18 16:32:00.973469 | controller | skipping: [instance]
2026-03-18 16:32:01.023345 | controller |
2026-03-18 16:32:01.023380 | controller | TASK [Push ssh jumper/configuration for compute-0] *****************************
2026-03-18 16:32:01.023389 | controller | Wednesday 18 March 2026  16:32:00 +0000 (0:00:00.025)       0:02:49.707 *******
2026-03-18 16:32:01.023398 | controller |
2026-03-18 16:32:01.118609 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-03-18 16:32:01.118647 | controller | Wednesday 18 March 2026  16:32:01 +0000 (0:00:00.049)       0:02:49.757 *******
2026-03-18 16:32:01.118665 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'compute-0.utility', 'patterns': ['compute-0', 'compute-0', 'compute-0.utility', 'compute-0.localdomain', 'compute-0.instance', 'compute-0', 'compute-0.instance', 'compute-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2026-03-18 16:32:01.368163 | controller |
2026-03-18 16:32:01.368204 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-03-18 16:32:01.368213 | controller | Wednesday 18 March 2026  16:32:01 +0000 (0:00:00.095)       0:02:49.852 *******
2026-03-18 16:32:01.368223 | controller | changed: [instance]
2026-03-18 16:32:01.609367 | controller |
2026-03-18 16:32:01.609401 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-03-18 16:32:01.609409 | controller | Wednesday 18 March 2026  16:32:01 +0000 (0:00:00.249)       0:02:50.102 *******
2026-03-18 16:32:01.609419 | controller | changed: [instance]
2026-03-18 16:32:02.027070 | controller |
2026-03-18 16:32:02.027103 | controller | TASK [ssh_jumper : Inject ssh jumpers for compute-0.utility] *******************
2026-03-18 16:32:02.027112 | controller | Wednesday 18 March 2026  16:32:01 +0000 (0:00:00.241)       0:02:50.343 *******
2026-03-18 16:32:02.027123 | controller | changed: [instance]
2026-03-18 16:32:02.027140 | controller |
2026-03-18 16:32:02.027147 | controller | TASK [libvirt_manager : Configure ssh access on VM compute-0] ******************
2026-03-18 16:32:02.027179 | controller | Wednesday 18 March 2026  16:32:02 +0000 (0:00:00.417)       0:02:50.761 *******
2026-03-18 16:32:02.057453 | controller | skipping: [instance]
2026-03-18 16:32:02.057679 | controller |
2026-03-18 16:32:02.057715 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-03-18 16:32:02.086408 | controller | Wednesday 18 March 2026  16:32:02 +0000 (0:00:00.030)       0:02:50.792 *******
2026-03-18 16:32:02.086432 | controller | skipping: [instance]
2026-03-18 16:32:02.138773 | controller |
2026-03-18 16:32:02.138799 | controller | TASK [libvirt_manager : Inject private key on hosts compute-0] *****************
2026-03-18 16:32:02.138807 | controller | Wednesday 18 March 2026  16:32:02 +0000 (0:00:00.028)       0:02:50.821 *******
2026-03-18 16:32:02.138816 | controller | skipping: [instance]
2026-03-18 16:32:02.195163 | controller |
2026-03-18 16:32:02.195185 | controller | TASK [libvirt_manager : Inject public key on hosts compute-0] ******************
2026-03-18 16:32:02.195193 | controller | Wednesday 18 March 2026  16:32:02 +0000 (0:00:00.051)       0:02:50.872 *******
2026-03-18 16:32:02.195202 | controller | skipping: [instance]
2026-03-18 16:32:02.221672 | controller |
2026-03-18 16:32:02.221692 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-18 16:32:02.221700 | controller | Wednesday 18 March 2026  16:32:02 +0000 (0:00:00.056)       0:02:50.929 *******
2026-03-18 16:32:02.221709 | controller | skipping: [instance]
2026-03-18 16:32:02.261972 | controller |
2026-03-18 16:32:02.261991 | controller | TASK [Push ssh jumper/configuration for controller-0] **************************
2026-03-18 16:32:02.261998 | controller | Wednesday 18 March 2026  16:32:02 +0000 (0:00:00.026)       0:02:50.956 *******
2026-03-18 16:32:02.262013 | controller |
2026-03-18 16:32:02.342693 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-03-18 16:32:02.342714 | controller | Wednesday 18 March 2026  16:32:02 +0000 (0:00:00.040)       0:02:50.996 *******
2026-03-18 16:32:02.342729 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'zuul', 'hostname': 'controller-0.utility', 'patterns': ['controller-0', 'controller-0', 'controller-0.utility', 'controller-0.localdomain', 'controller-0.instance', 'controller-0', 'controller-0.instance', 'controller-0.instance'], 'identity_file': '/home/zuul/.ssh/cifmw_reproducer_key'})
2026-03-18 16:32:02.572870 | controller |
2026-03-18 16:32:02.572907 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-03-18 16:32:02.572916 | controller | Wednesday 18 March 2026  16:32:02 +0000 (0:00:00.080)       0:02:51.077 *******
2026-03-18 16:32:02.572954 | controller | ok: [instance]
2026-03-18 16:32:02.799372 | controller |
2026-03-18 16:32:02.799414 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-03-18 16:32:02.799423 | controller | Wednesday 18 March 2026  16:32:02 +0000 (0:00:00.229)       0:02:51.307 *******
2026-03-18 16:32:02.799434 | controller | ok: [instance]
2026-03-18 16:32:03.218387 | controller |
2026-03-18 16:32:03.218425 | controller | TASK [ssh_jumper : Inject ssh jumpers for controller-0.utility] ****************
2026-03-18 16:32:03.218434 | controller | Wednesday 18 March 2026  16:32:02 +0000 (0:00:00.226)       0:02:51.533 *******
2026-03-18 16:32:03.218445 | controller | changed: [instance]
2026-03-18 16:32:03.257578 | controller |
2026-03-18 16:32:03.257604 | controller | TASK [libvirt_manager : Configure ssh access on VM controller-0] ***************
2026-03-18 16:32:03.257612 | controller | Wednesday 18 March 2026  16:32:03 +0000 (0:00:00.419)       0:02:51.952 *******
2026-03-18 16:32:03.257621 | controller | skipping: [instance]
2026-03-18 16:32:03.298307 | controller |
2026-03-18 16:32:03.298331 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-03-18 16:32:03.298338 | controller | Wednesday 18 March 2026  16:32:03 +0000 (0:00:00.039)       0:02:51.992 *******
2026-03-18 16:32:03.298347 | controller | skipping: [instance]
2026-03-18 16:32:05.060097 | controller |
2026-03-18 16:32:05.060162 | controller | TASK [libvirt_manager : Inject private key on hosts controller-0] **************
2026-03-18 16:32:05.060172 | controller | Wednesday 18 March 2026  16:32:03 +0000 (0:00:00.040)       0:02:52.032 *******
2026-03-18 16:32:05.060186 | controller | changed: [instance -> controller-0.instance]
2026-03-18 16:32:06.301992 | controller |
2026-03-18 16:32:06.302052 | controller | TASK [libvirt_manager : Inject public key on hosts controller-0] ***************
2026-03-18 16:32:06.302061 | controller | Wednesday 18 March 2026  16:32:05 +0000 (0:00:01.760)       0:02:53.793 *******
2026-03-18 16:32:06.302074 | controller | changed: [instance -> controller-0.instance]
2026-03-18 16:32:06.353158 | controller |
2026-03-18 16:32:06.353194 | controller | TASK [Check if new ssh keypair exists] *****************************************
2026-03-18 16:32:06.353203 | controller | Wednesday 18 March 2026  16:32:06 +0000 (0:00:01.241)       0:02:55.035 *******
2026-03-18 16:32:06.353214 | controller |
2026-03-18 16:32:06.599904 | controller | TASK [recognize_ssh_keypair : Check if id_ed25519 key exists] ******************
2026-03-18 16:32:06.599971 | controller | Wednesday 18 March 2026  16:32:06 +0000 (0:00:00.051)       0:02:55.087 *******
2026-03-18 16:32:06.599987 | controller | ok: [instance]
2026-03-18 16:32:06.631460 | controller |
2026-03-18 16:32:06.631490 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair exists] ******************
2026-03-18 16:32:06.631503 | controller | Wednesday 18 March 2026  16:32:06 +0000 (0:00:00.245)       0:02:55.333 *******
2026-03-18 16:32:06.631514 | controller | ok: [instance]
2026-03-18 16:32:06.669612 | controller |
2026-03-18 16:32:06.669649 | controller | TASK [recognize_ssh_keypair : Set fact if new keypair does not exists] *********
2026-03-18 16:32:06.669658 | controller | Wednesday 18 March 2026  16:32:06 +0000 (0:00:00.031)       0:02:55.365 *******
2026-03-18 16:32:06.669671 | controller | skipping: [instance]
2026-03-18 16:32:06.725211 | controller |
2026-03-18 16:32:06.725252 | controller | TASK [Push ssh jumper/configuration for crc-0] *********************************
2026-03-18 16:32:06.725272 | controller | Wednesday 18 March 2026  16:32:06 +0000 (0:00:00.038)       0:02:55.404 *******
2026-03-18 16:32:06.725284 | controller |
2026-03-18 16:32:06.816414 | controller | TASK [ssh_jumper : Create ssh-jumper entries] **********************************
2026-03-18 16:32:06.816461 | controller | Wednesday 18 March 2026  16:32:06 +0000 (0:00:00.055)       0:02:55.459 *******
2026-03-18 16:32:06.816479 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ssh_jumper/tasks/manage_ssh_jumper_entry.yml for instance => (item={'ssh_dir': '/home/zuul/.ssh', 'user': 'core', 'hostname': 'crc-0.utility', 'patterns': ['crc-0', 'crc-0', 'crc-0.utility', 'crc-0.localdomain', 'crc-0.instance', 'crc-0', 'crc-0.instance', 'crc-0.instance'], 'identity_file': '/home/zuul/.crc/machines/crc/id_ed25519'})
2026-03-18 16:32:07.070706 | controller |
2026-03-18 16:32:07.070773 | controller | TASK [ssh_jumper : Make sure ~/.ssh/cifmw_ssh_config.d directory exists] *******
2026-03-18 16:32:07.070782 | controller | Wednesday 18 March 2026  16:32:06 +0000 (0:00:00.091)       0:02:55.550 *******
2026-03-18 16:32:07.070794 | controller | ok: [instance]
2026-03-18 16:32:07.306674 | controller |
2026-03-18 16:32:07.306730 | controller | TASK [ssh_jumper : Include ~/.ssh/cifmw_ssh_config.d/inventory_hostname/*.conf] ***
2026-03-18 16:32:07.306739 | controller | Wednesday 18 March 2026  16:32:07 +0000 (0:00:00.253)       0:02:55.804 *******
2026-03-18 16:32:07.306752 | controller | ok: [instance]
2026-03-18 16:32:07.761895 | controller |
2026-03-18 16:32:07.761968 | controller | TASK [ssh_jumper : Inject ssh jumpers for crc-0.utility] ***********************
2026-03-18 16:32:07.761981 | controller | Wednesday 18 March 2026  16:32:07 +0000 (0:00:00.235)       0:02:56.040 *******
2026-03-18 16:32:07.761994 | controller | changed: [instance]
2026-03-18 16:32:08.652188 | controller |
2026-03-18 16:32:08.652243 | controller | TASK [libvirt_manager : Configure ssh access on VM crc-0] **********************
2026-03-18 16:32:08.652253 | controller | Wednesday 18 March 2026  16:32:07 +0000 (0:00:00.455)       0:02:56.495 *******
2026-03-18 16:32:08.652266 | controller | changed: [instance]
2026-03-18 16:32:08.684020 | controller |
2026-03-18 16:32:08.684051 | controller | TASK [libvirt_manager : Ensure we grow volume for OCP cluster members] *********
2026-03-18 16:32:08.684058 | controller | Wednesday 18 March 2026  16:32:08 +0000 (0:00:00.890)       0:02:57.386 *******
2026-03-18 16:32:08.684068 | controller | skipping: [instance]
2026-03-18 16:32:08.744715 | controller |
2026-03-18 16:32:08.744743 | controller | TASK [libvirt_manager : Inject private key on hosts crc-0] *********************
2026-03-18 16:32:08.744751 | controller | Wednesday 18 March 2026  16:32:08 +0000 (0:00:00.032)       0:02:57.418 *******
2026-03-18 16:32:08.744761 | controller | skipping: [instance]
2026-03-18 16:32:08.800108 | controller |
2026-03-18 16:32:08.800125 | controller | TASK [libvirt_manager : Inject public key on hosts crc-0] **********************
2026-03-18 16:32:08.800132 | controller | Wednesday 18 March 2026  16:32:08 +0000 (0:00:00.060)       0:02:57.479 *******
2026-03-18 16:32:08.800141 | controller | skipping: [instance]
2026-03-18 16:32:08.867828 | controller |
2026-03-18 16:32:08.867849 | controller | TASK [Create VBMC entity] ******************************************************
2026-03-18 16:32:08.867857 | controller | Wednesday 18 March 2026  16:32:08 +0000 (0:00:00.055)       0:02:57.534 *******
2026-03-18 16:32:08.867866 | controller | skipping: [instance] => (item=compute-0)
2026-03-18 16:32:09.144447 | controller | skipping: [instance] => (item=controller-0)
2026-03-18 16:32:09.144481 | controller | skipping: [instance] => (item=crc-0)
2026-03-18 16:32:09.144489 | controller | skipping: [instance]
2026-03-18 16:32:09.144495 | controller |
2026-03-18 16:32:09.144501 | controller | TASK [libvirt_manager : List running virtual machines.] ************************
2026-03-18 16:32:09.144507 | controller | Wednesday 18 March 2026  16:32:08 +0000 (0:00:00.067)       0:02:57.602 *******
2026-03-18 16:32:09.144517 | controller | ok: [instance]
2026-03-18 16:32:09.544106 | controller |
2026-03-18 16:32:09.544154 | controller | TASK [libvirt_manager : Dump UUIDs] ********************************************
2026-03-18 16:32:09.544163 | controller | Wednesday 18 March 2026  16:32:09 +0000 (0:00:00.276)       0:02:57.878 *******
2026-03-18 16:32:09.544176 | controller | changed: [instance]
2026-03-18 16:32:09.544410 | controller |
2026-03-18 16:32:09.544460 | controller | TASK [Ensure fresh vbmc listing] ***********************************************
2026-03-18 16:32:09.544484 | controller | Wednesday 18 March 2026  16:32:09 +0000 (0:00:00.398)       0:02:58.277 *******
2026-03-18 16:32:09.586668 | controller | skipping: [instance]
2026-03-18 16:32:09.628863 | controller |
2026-03-18 16:32:09.628893 | controller | TASK [libvirt_manager : Update vbmc related fact] ******************************
2026-03-18 16:32:09.628906 | controller | Wednesday 18 March 2026  16:32:09 +0000 (0:00:00.043)       0:02:58.321 *******
2026-03-18 16:32:09.628970 | controller | skipping: [instance]
2026-03-18 16:32:09.673850 | controller |
2026-03-18 16:32:09.673875 | controller | TASK [libvirt_manager : Dump vbmc known hosts] *********************************
2026-03-18 16:32:09.673886 | controller | Wednesday 18 March 2026  16:32:09 +0000 (0:00:00.042)       0:02:58.363 *******
2026-03-18 16:32:09.673898 | controller | skipping: [instance]
2026-03-18 16:32:10.425085 | controller |
2026-03-18 16:32:10.425133 | controller | TASK [libvirt_manager : Copy authorized_keys] **********************************
2026-03-18 16:32:10.425142 | controller | Wednesday 18 March 2026  16:32:09 +0000 (0:00:00.045)       0:02:58.408 *******
2026-03-18 16:32:10.425154 | controller | changed: [instance]
2026-03-18 16:32:11.255403 | controller |
2026-03-18 16:32:11.255450 | controller | TASK [libvirt_manager : Enable root access on CRC] *****************************
2026-03-18 16:32:11.255459 | controller | Wednesday 18 March 2026  16:32:10 +0000 (0:00:00.750)       0:02:59.158 *******
2026-03-18 16:32:11.255471 | controller | changed: [instance]
2026-03-18 16:32:11.307676 | controller |
2026-03-18 16:32:11.307694 | controller | TASK [reproducer : Get deployed VM group inventories] **************************
2026-03-18 16:32:11.307701 | controller | Wednesday 18 March 2026  16:32:11 +0000 (0:00:00.830)       0:02:59.989 *******
2026-03-18 16:32:11.307710 | controller | skipping: [instance]
2026-03-18 16:32:11.378096 | controller |
2026-03-18 16:32:11.378154 | controller | TASK [reproducer : Inject remote inventories onto main hypervisor] *************
2026-03-18 16:32:11.378162 | controller | Wednesday 18 March 2026  16:32:11 +0000 (0:00:00.052)       0:03:00.042 *******
2026-03-18 16:32:11.378175 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=instance)
2026-03-18 16:32:11.378195 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=compute-0)
2026-03-18 16:32:11.378203 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=controller-0)
2026-03-18 16:32:11.378276 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/gather_inventories.yml for instance => (item=crc-0)
2026-03-18 16:32:11.378287 | controller |
2026-03-18 16:32:11.378364 | controller | TASK [reproducer : Gather inventories from instance] ***************************
2026-03-18 16:32:11.378447 | controller | Wednesday 18 March 2026  16:32:11 +0000 (0:00:00.070)       0:03:00.112 *******
2026-03-18 16:32:11.439335 | controller | skipping: [instance]
2026-03-18 16:32:11.439387 | controller |
2026-03-18 16:32:11.439471 | controller | TASK [reproducer : Gather inventories from compute-0] **************************
2026-03-18 16:32:11.439557 | controller | Wednesday 18 March 2026  16:32:11 +0000 (0:00:00.061)       0:03:00.174 *******
2026-03-18 16:32:11.483621 | controller | skipping: [instance]
2026-03-18 16:32:11.483697 | controller |
2026-03-18 16:32:11.483794 | controller | TASK [reproducer : Gather inventories from controller-0] ***********************
2026-03-18 16:32:11.483871 | controller | Wednesday 18 March 2026  16:32:11 +0000 (0:00:00.044)       0:03:00.218 *******
2026-03-18 16:32:11.525971 | controller | skipping: [instance]
2026-03-18 16:32:11.526085 | controller |
2026-03-18 16:32:11.526138 | controller | TASK [reproducer : Gather inventories from crc-0] ******************************
2026-03-18 16:32:11.526224 | controller | Wednesday 18 March 2026  16:32:11 +0000 (0:00:00.042)       0:03:00.260 *******
2026-03-18 16:32:11.566858 | controller | skipping: [instance]
2026-03-18 16:32:11.566937 | controller |
2026-03-18 16:32:11.567049 | controller | TASK [reproducer : Push generated inventory from hypervisor] *******************
2026-03-18 16:32:11.567132 | controller | Wednesday 18 March 2026  16:32:11 +0000 (0:00:00.040)       0:03:00.301 *******
2026-03-18 16:32:12.234477 | controller | changed: [instance]
2026-03-18 16:32:12.234537 | controller |
2026-03-18 16:32:12.234582 | controller | TASK [reproducer : Slurp devscripts private key] *******************************
2026-03-18 16:32:12.234684 | controller | Wednesday 18 March 2026  16:32:12 +0000 (0:00:00.666)       0:03:00.968 *******
2026-03-18 16:32:12.281838 | controller | skipping: [instance]
2026-03-18 16:32:12.281936 | controller |
2026-03-18 16:32:12.282056 | controller | TASK [reproducer : Slurp content of the devscripts kubeconfig] *****************
2026-03-18 16:32:12.282150 | controller | Wednesday 18 March 2026  16:32:12 +0000 (0:00:00.042)       0:03:01.011 *******
2026-03-18 16:32:12.321392 | controller | skipping: [instance]
2026-03-18 16:32:12.321467 | controller |
2026-03-18 16:32:12.321567 | controller | TASK [reproducer : Slurp content of the devscripts kubeadmin-password] *********
2026-03-18 16:32:12.321659 | controller | Wednesday 18 March 2026  16:32:12 +0000 (0:00:00.044)       0:03:01.056 *******
2026-03-18 16:32:12.359591 | controller | skipping: [instance]
2026-03-18 16:32:12.359671 | controller |
2026-03-18 16:32:12.359771 | controller | TASK [openshift_login : Assert we have needed parameters] **********************
2026-03-18 16:32:12.359863 | controller | Wednesday 18 March 2026  16:32:12 +0000 (0:00:00.038)       0:03:01.094 *******
2026-03-18 16:32:12.400559 | controller | skipping: [instance]
2026-03-18 16:32:12.400637 | controller |
2026-03-18 16:32:12.400735 | controller | TASK [openshift_login : Stat kubeconfig] ***************************************
2026-03-18 16:32:12.400829 | controller | Wednesday 18 March 2026  16:32:12 +0000 (0:00:00.040)       0:03:01.135 *******
2026-03-18 16:32:12.438870 | controller | skipping: [instance]
2026-03-18 16:32:12.438975 | controller |
2026-03-18 16:32:12.439096 | controller | TASK [openshift_login : Stat kubeadmin] ****************************************
2026-03-18 16:32:12.439199 | controller | Wednesday 18 March 2026  16:32:12 +0000 (0:00:00.038)       0:03:01.173 *******
2026-03-18 16:32:12.478238 | controller | skipping: [instance]
2026-03-18 16:32:12.478326 | controller |
2026-03-18 16:32:12.478413 | controller | TASK [openshift_login : Assert files exist] ************************************
2026-03-18 16:32:12.478516 | controller | Wednesday 18 March 2026  16:32:12 +0000 (0:00:00.039)       0:03:01.213 *******
2026-03-18 16:32:12.516984 | controller | skipping: [instance]
2026-03-18 16:32:12.517070 | controller |
2026-03-18 16:32:12.517166 | controller | TASK [openshift_login : Gather the password of the deployed cluster.] **********
2026-03-18 16:32:12.517274 | controller | Wednesday 18 March 2026  16:32:12 +0000 (0:00:00.038)       0:03:01.251 *******
2026-03-18 16:32:12.554011 | controller | skipping: [instance]
2026-03-18 16:32:12.554099 | controller |
2026-03-18 16:32:12.554201 | controller | TASK [openshift_login : Gather the deployed OCP configuration.] ****************
2026-03-18 16:32:12.554293 | controller | Wednesday 18 March 2026  16:32:12 +0000 (0:00:00.037)       0:03:01.288 *******
2026-03-18 16:32:12.591110 | controller | skipping: [instance]
2026-03-18 16:32:12.591243 | controller |
2026-03-18 16:32:12.591296 | controller | TASK [openshift_login : Set the OpenShift platform access information.] ********
2026-03-18 16:32:12.591644 | controller | Wednesday 18 March 2026  16:32:12 +0000 (0:00:00.037)       0:03:01.326 *******
2026-03-18 16:32:12.646894 | controller | skipping: [instance]
2026-03-18 16:32:12.646975 | controller |
2026-03-18 16:32:12.647073 | controller | TASK [reproducer : Set fact for later wait on OCP cluster] *********************
2026-03-18 16:32:12.647203 | controller | Wednesday 18 March 2026  16:32:12 +0000 (0:00:00.055)       0:03:01.381 *******
2026-03-18 16:32:12.690542 | controller | skipping: [instance]
2026-03-18 16:32:12.690629 | controller |
2026-03-18 16:32:12.690727 | controller | TASK [reproducer : Configure Controller node] **********************************
2026-03-18 16:32:12.690822 | controller | Wednesday 18 March 2026  16:32:12 +0000 (0:00:00.043)       0:03:01.425 *******
2026-03-18 16:32:12.852063 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_controller.yml for instance
2026-03-18 16:32:12.852113 | controller |
2026-03-18 16:32:12.852223 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2026-03-18 16:32:12.852320 | controller | Wednesday 18 March 2026  16:32:12 +0000 (0:00:00.161)       0:03:01.586 *******
2026-03-18 16:32:14.409139 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2026-03-18 16:32:14.409235 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2026-03-18 16:32:14.409295 | controller |
2026-03-18 16:32:14.409306 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2026-03-18 16:32:14.409397 | controller | Wednesday 18 March 2026  16:32:14 +0000 (0:00:01.556)       0:03:03.143 *******
2026-03-18 16:32:14.435484 | controller | skipping: [instance]
2026-03-18 16:32:14.435596 | controller |
2026-03-18 16:32:14.435685 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-03-18 16:32:14.435780 | controller | Wednesday 18 March 2026  16:32:14 +0000 (0:00:00.026)       0:03:03.170 *******
2026-03-18 16:32:15.173856 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:32:15.211457 | controller |
2026-03-18 16:32:15.211487 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-03-18 16:32:15.211495 | controller | Wednesday 18 March 2026  16:32:15 +0000 (0:00:00.737)       0:03:03.907 *******
2026-03-18 16:32:15.211509 | controller | skipping: [instance]
2026-03-18 16:32:15.257713 | controller |
2026-03-18 16:32:15.257744 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-03-18 16:32:15.257753 | controller | Wednesday 18 March 2026  16:32:15 +0000 (0:00:00.038)       0:03:03.946 *******
2026-03-18 16:32:15.257766 | controller | skipping: [instance]
2026-03-18 16:32:15.298236 | controller |
2026-03-18 16:32:15.298294 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-03-18 16:32:15.298304 | controller | Wednesday 18 March 2026  16:32:15 +0000 (0:00:00.046)       0:03:03.992 *******
2026-03-18 16:32:15.298317 | controller | skipping: [instance]
2026-03-18 16:32:15.298373 | controller |
2026-03-18 16:32:15.345417 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-03-18 16:32:15.345439 | controller | Wednesday 18 March 2026  16:32:15 +0000 (0:00:00.040)       0:03:04.033 *******
2026-03-18 16:32:15.345450 | controller | skipping: [instance]
2026-03-18 16:32:15.345486 | controller |
2026-03-18 16:32:15.345575 | controller | TASK [reproducer : Get rhos-release] *******************************************
2026-03-18 16:32:15.345662 | controller | Wednesday 18 March 2026  16:32:15 +0000 (0:00:00.047)       0:03:04.080 *******
2026-03-18 16:32:15.389122 | controller | skipping: [instance]
2026-03-18 16:32:15.389187 | controller |
2026-03-18 16:32:15.389295 | controller | TASK [reproducer : Install repos] **********************************************
2026-03-18 16:32:15.389419 | controller | Wednesday 18 March 2026  16:32:15 +0000 (0:00:00.043)       0:03:04.123 *******
2026-03-18 16:32:15.423457 | controller | skipping: [instance]
2026-03-18 16:32:15.423539 | controller |
2026-03-18 16:32:15.423649 | controller | TASK [reproducer : Run custom commands after rhos-release setup] ***************
2026-03-18 16:32:15.423734 | controller | Wednesday 18 March 2026  16:32:15 +0000 (0:00:00.034)       0:03:04.158 *******
2026-03-18 16:32:15.468133 | controller | skipping: [instance]
2026-03-18 16:32:15.468191 | controller |
2026-03-18 16:32:15.468303 | controller | TASK [reproducer : Create bundle for CRC] **************************************
2026-03-18 16:32:15.468420 | controller | Wednesday 18 March 2026  16:32:15 +0000 (0:00:00.040)       0:03:04.199 *******
2026-03-18 16:32:15.610908 | controller | skipping: [instance]
2026-03-18 16:32:15.611002 | controller |
2026-03-18 16:32:15.611111 | controller | TASK [reproducer : Install some tools] *****************************************
2026-03-18 16:32:15.611203 | controller | Wednesday 18 March 2026  16:32:15 +0000 (0:00:00.146)       0:03:04.345 *******
2026-03-18 16:32:16.837055 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:32:16.838180 | controller |
2026-03-18 16:32:18.057559 | controller | TASK [reproducer : Inject command aliases for faster debugging] ****************
2026-03-18 16:32:18.057611 | controller | Wednesday 18 March 2026  16:32:16 +0000 (0:00:01.225)       0:03:05.571 *******
2026-03-18 16:32:18.057624 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:32:18.756490 | controller |
2026-03-18 16:32:18.756537 | controller | TASK [reproducer : Build job inventory for hook usage] *************************
2026-03-18 16:32:18.756546 | controller | Wednesday 18 March 2026  16:32:18 +0000 (0:00:01.218)       0:03:06.790 *******
2026-03-18 16:32:18.756564 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:32:18.756602 | controller |
2026-03-18 16:32:18.756610 | controller | TASK [reproducer : Push the MAC mapping data] **********************************
2026-03-18 16:32:19.966855 | controller | Wednesday 18 March 2026  16:32:18 +0000 (0:00:00.700)       0:03:07.490 *******
2026-03-18 16:32:19.966896 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:32:19.966922 | controller |
2026-03-18 16:32:19.966962 | controller | TASK [reproducer : Inject other Hypervisor SSH keys] ***************************
2026-03-18 16:32:19.967043 | controller | Wednesday 18 March 2026  16:32:19 +0000 (0:00:01.209)       0:03:08.700 *******
2026-03-18 16:32:21.070667 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2026-03-18 16:32:21.840898 | controller | skipping: [instance] => (item=compute-0)
2026-03-18 16:32:21.840955 | controller | skipping: [instance] => (item=controller-0)
2026-03-18 16:32:21.840966 | controller | skipping: [instance] => (item=crc-0)
2026-03-18 16:32:21.840972 | controller |
2026-03-18 16:32:21.840978 | controller | TASK [reproducer : Inject remote hypervisor SSH configuration] *****************
2026-03-18 16:32:21.840984 | controller | Wednesday 18 March 2026  16:32:21 +0000 (0:00:01.103)       0:03:09.804 *******
2026-03-18 16:32:21.840994 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=instance)
2026-03-18 16:32:23.819507 | controller | skipping: [instance] => (item=compute-0)
2026-03-18 16:32:23.819547 | controller | skipping: [instance] => (item=controller-0)
2026-03-18 16:32:23.819555 | controller | skipping: [instance] => (item=crc-0)
2026-03-18 16:32:23.819561 | controller |
2026-03-18 16:32:23.819567 | controller | TASK [reproducer : Inject SSH configuration] ***********************************
2026-03-18 16:32:23.819573 | controller | Wednesday 18 March 2026  16:32:21 +0000 (0:00:00.770)       0:03:10.574 *******
2026-03-18 16:32:23.819584 | controller | skipping: [instance] => (item=instance)
2026-03-18 16:32:24.435581 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=compute-0)
2026-03-18 16:32:24.435616 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2026-03-18 16:32:24.435623 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=crc-0)
2026-03-18 16:32:24.435629 | controller |
2026-03-18 16:32:24.435635 | controller | TASK [reproducer : Create kube directory] **************************************
2026-03-18 16:32:24.435641 | controller | Wednesday 18 March 2026  16:32:23 +0000 (0:00:01.978)       0:03:12.553 *******
2026-03-18 16:32:24.435651 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:32:25.496117 | controller |
2026-03-18 16:32:25.496154 | controller | TASK [reproducer : Inject kubeconfig content] **********************************
2026-03-18 16:32:25.496162 | controller | Wednesday 18 March 2026  16:32:24 +0000 (0:00:00.616)       0:03:13.170 *******
2026-03-18 16:32:25.496173 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:32:26.561102 | controller |
2026-03-18 16:32:26.561137 | controller | TASK [reproducer : Inject kubeadmin-password if exists] ************************
2026-03-18 16:32:26.561145 | controller | Wednesday 18 March 2026  16:32:25 +0000 (0:00:01.060)       0:03:14.230 *******
2026-03-18 16:32:26.561155 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:32:26.598562 | controller |
2026-03-18 16:32:26.598590 | controller | TASK [reproducer : Inject devscripts private key if set] ***********************
2026-03-18 16:32:26.598598 | controller | Wednesday 18 March 2026  16:32:26 +0000 (0:00:01.065)       0:03:15.295 *******
2026-03-18 16:32:26.598608 | controller | skipping: [instance]
2026-03-18 16:32:27.328696 | controller |
2026-03-18 16:32:27.328737 | controller | TASK [reproducer : Ensure /etc/ci/env is created] ******************************
2026-03-18 16:32:27.328746 | controller | Wednesday 18 March 2026  16:32:26 +0000 (0:00:00.037)       0:03:15.333 *******
2026-03-18 16:32:27.328756 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:32:28.005182 | controller |
2026-03-18 16:32:28.005216 | controller | TASK [manage_secrets : Ensure directory tree exist] ****************************
2026-03-18 16:32:28.005229 | controller | Wednesday 18 March 2026  16:32:27 +0000 (0:00:00.729)       0:03:16.062 *******
2026-03-18 16:32:28.005245 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:32:28.056259 | controller |
2026-03-18 16:32:28.056278 | controller | TASK [manage_secrets : Assert we get needed data] ******************************
2026-03-18 16:32:28.056285 | controller | Wednesday 18 March 2026  16:32:28 +0000 (0:00:00.676)       0:03:16.739 *******
2026-03-18 16:32:28.056294 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:32:28.128702 | controller |
2026-03-18 16:32:28.128721 | controller | TASK [manage_secrets : Push reproducer secrets] ********************************
2026-03-18 16:32:28.128729 | controller | Wednesday 18 March 2026  16:32:28 +0000 (0:00:00.051)       0:03:16.791 *******
2026-03-18 16:32:28.128739 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'content': 'my-default-location-place', 'dest': 'default.txt'})
2026-03-18 16:32:28.192967 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/manage_secrets/tasks/_push_secret.yml for instance => (item={'src': '/tmp/ipmi-things', 'dest': '/home/zuul/ipmi-things'})
2026-03-18 16:32:28.192985 | controller |
2026-03-18 16:32:28.192992 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2026-03-18 16:32:28.192998 | controller | Wednesday 18 March 2026  16:32:28 +0000 (0:00:00.072)       0:03:16.863 *******
2026-03-18 16:32:28.193006 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-18 16:32:28.251014 | controller |   _secret_dest: /home/zuul/ci-framework-data/secrets/default.txt
2026-03-18 16:32:28.251032 | controller |
2026-03-18 16:32:28.251039 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2026-03-18 16:32:28.251044 | controller | Wednesday 18 March 2026  16:32:28 +0000 (0:00:00.064)       0:03:16.927 *******
2026-03-18 16:32:28.251052 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-18 16:32:28.305453 | controller |   _secret_file: ''
2026-03-18 16:32:28.305470 | controller |
2026-03-18 16:32:28.305477 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2026-03-18 16:32:28.305483 | controller | Wednesday 18 March 2026  16:32:28 +0000 (0:00:00.057)       0:03:16.985 *******
2026-03-18 16:32:28.305490 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-18 16:32:28.361103 | controller |   _secret_content: my-default-location-place
2026-03-18 16:32:28.361120 | controller |
2026-03-18 16:32:28.361127 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2026-03-18 16:32:28.361133 | controller | Wednesday 18 March 2026  16:32:28 +0000 (0:00:00.054)       0:03:17.040 *******
2026-03-18 16:32:28.361141 | controller | skipping: [instance]
2026-03-18 16:32:28.421037 | controller |
2026-03-18 16:32:28.421058 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2026-03-18 16:32:28.421065 | controller | Wednesday 18 March 2026  16:32:28 +0000 (0:00:00.055)       0:03:17.095 *******
2026-03-18 16:32:28.421075 | controller | skipping: [instance]
2026-03-18 16:32:28.480375 | controller |
2026-03-18 16:32:28.480393 | controller | TASK [manage_secrets : Copy file to location] **********************************
2026-03-18 16:32:28.480400 | controller | Wednesday 18 March 2026  16:32:28 +0000 (0:00:00.059)       0:03:17.155 *******
2026-03-18 16:32:28.480408 | controller | skipping: [instance]
2026-03-18 16:32:29.700698 | controller |
2026-03-18 16:32:29.700728 | controller | TASK [manage_secrets : Create file from content] *******************************
2026-03-18 16:32:29.700736 | controller | Wednesday 18 March 2026  16:32:28 +0000 (0:00:00.059)       0:03:17.215 *******
2026-03-18 16:32:29.700746 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:32:29.773808 | controller |
2026-03-18 16:32:29.773828 | controller | TASK [manage_secrets : Debug _secret_dest] *************************************
2026-03-18 16:32:29.773835 | controller | Wednesday 18 March 2026  16:32:29 +0000 (0:00:01.219)       0:03:18.434 *******
2026-03-18 16:32:29.773843 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-18 16:32:29.837448 | controller |   _secret_dest: /home/zuul/ipmi-things
2026-03-18 16:32:29.837468 | controller |
2026-03-18 16:32:29.837476 | controller | TASK [manage_secrets : Debug _secret_file] *************************************
2026-03-18 16:32:29.837487 | controller | Wednesday 18 March 2026  16:32:29 +0000 (0:00:00.073)       0:03:18.508 *******
2026-03-18 16:32:29.837496 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-18 16:32:29.899957 | controller |   _secret_file: /tmp/ipmi-things
2026-03-18 16:32:29.899978 | controller |
2026-03-18 16:32:29.899986 | controller | TASK [manage_secrets : Debug _secret_content] **********************************
2026-03-18 16:32:29.899992 | controller | Wednesday 18 March 2026  16:32:29 +0000 (0:00:00.063)       0:03:18.571 *******
2026-03-18 16:32:29.900001 | controller | ok: [instance -> controller-0(controller-0.instance)] =>
2026-03-18 16:32:29.967823 | controller |   _secret_content: ''
2026-03-18 16:32:29.967842 | controller |
2026-03-18 16:32:29.967849 | controller | TASK [manage_secrets : Ensure parameter is an absolute path] *******************
2026-03-18 16:32:29.967855 | controller | Wednesday 18 March 2026  16:32:29 +0000 (0:00:00.062)       0:03:18.634 *******
2026-03-18 16:32:29.967864 | controller | ok: [instance -> controller-0(controller-0.instance)] => changed=false
2026-03-18 16:32:30.662815 | controller |   msg: All assertions passed
2026-03-18 16:32:30.662866 | controller |
2026-03-18 16:32:30.662875 | controller | TASK [manage_secrets : Check if pull secret src file exists] *******************
2026-03-18 16:32:30.662881 | controller | Wednesday 18 March 2026  16:32:29 +0000 (0:00:00.068)       0:03:18.702 *******
2026-03-18 16:32:30.662891 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:32:31.847698 | controller |
2026-03-18 16:32:31.847736 | controller | TASK [manage_secrets : Copy file to location] **********************************
2026-03-18 16:32:31.847744 | controller | Wednesday 18 March 2026  16:32:30 +0000 (0:00:00.694)       0:03:19.397 *******
2026-03-18 16:32:31.847760 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:32:31.904531 | controller |
2026-03-18 16:32:31.904568 | controller | TASK [manage_secrets : Create file from content] *******************************
2026-03-18 16:32:31.904578 | controller | Wednesday 18 March 2026  16:32:31 +0000 (0:00:01.184)       0:03:20.581 *******
2026-03-18 16:32:31.904590 | controller | skipping: [instance]
2026-03-18 16:32:32.573136 | controller |
2026-03-18 16:32:32.573176 | controller | TASK [reproducer : Inject FQDN in /etc/hosts] **********************************
2026-03-18 16:32:32.573184 | controller | Wednesday 18 March 2026  16:32:31 +0000 (0:00:00.057)       0:03:20.639 *******
2026-03-18 16:32:32.573195 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:32:33.271158 | controller |
2026-03-18 16:32:33.271207 | controller | TASK [reproducer : Check if async file is still available] *********************
2026-03-18 16:32:33.271215 | controller | Wednesday 18 March 2026  16:32:32 +0000 (0:00:00.668)       0:03:21.307 *******
2026-03-18 16:32:33.271226 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:12.808812 | controller |
2026-03-18 16:33:12.808860 | controller | TASK [reproducer : Check package install status] *******************************
2026-03-18 16:33:12.808868 | controller | Wednesday 18 March 2026  16:32:33 +0000 (0:00:00.698)       0:03:22.005 *******
2026-03-18 16:33:12.808879 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (100 retries left).
2026-03-18 16:33:13.596938 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (99 retries left).
2026-03-18 16:33:13.596975 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (98 retries left).
2026-03-18 16:33:13.596982 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (97 retries left).
2026-03-18 16:33:13.596988 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (96 retries left).
2026-03-18 16:33:13.596993 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (95 retries left).
2026-03-18 16:33:13.596998 | controller | FAILED - RETRYING: [instance -> controller-0]: Check package install status (94 retries left).
2026-03-18 16:33:13.597003 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:13.597008 | controller |
2026-03-18 16:33:13.597014 | controller | TASK [sushy_emulator : Create Sushy Emulator resource directory] ***************
2026-03-18 16:33:13.597024 | controller | Wednesday 18 March 2026  16:33:12 +0000 (0:00:39.535)       0:04:01.540 *******
2026-03-18 16:33:13.597034 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:16.703013 | controller |
2026-03-18 16:33:16.703046 | controller | TASK [sushy_emulator : Install required packages] ******************************
2026-03-18 16:33:16.703054 | controller | Wednesday 18 March 2026  16:33:13 +0000 (0:00:00.790)       0:04:02.331 *******
2026-03-18 16:33:16.703064 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:16.760923 | controller |
2026-03-18 16:33:16.760968 | controller | TASK [sushy_emulator : Get ingresses domain] ***********************************
2026-03-18 16:33:16.760976 | controller | Wednesday 18 March 2026  16:33:16 +0000 (0:00:03.106)       0:04:05.437 *******
2026-03-18 16:33:16.760986 | controller | skipping: [instance]
2026-03-18 16:33:16.813062 | controller |
2026-03-18 16:33:16.813091 | controller | TASK [sushy_emulator : Set sushy url for ocp installation] *********************
2026-03-18 16:33:16.813099 | controller | Wednesday 18 March 2026  16:33:16 +0000 (0:00:00.058)       0:04:05.495 *******
2026-03-18 16:33:16.813109 | controller | skipping: [instance]
2026-03-18 16:33:17.474004 | controller |
2026-03-18 16:33:17.474037 | controller | TASK [sushy_emulator : Create ssh key for Sushy Emulator] **********************
2026-03-18 16:33:17.474045 | controller | Wednesday 18 March 2026  16:33:16 +0000 (0:00:00.052)       0:04:05.547 *******
2026-03-18 16:33:17.474055 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:18.160812 | controller |
2026-03-18 16:33:18.160845 | controller | TASK [sushy_emulator : Slurp private ssh key for later use] ********************
2026-03-18 16:33:18.160854 | controller | Wednesday 18 March 2026  16:33:17 +0000 (0:00:00.660)       0:04:06.208 *******
2026-03-18 16:33:18.160864 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:18.498233 | controller |
2026-03-18 16:33:18.498269 | controller | TASK [sushy_emulator : Allow Sushy Emulator key] *******************************
2026-03-18 16:33:18.498277 | controller | Wednesday 18 March 2026  16:33:18 +0000 (0:00:00.686)       0:04:06.894 *******
2026-03-18 16:33:18.498287 | controller | changed: [instance]
2026-03-18 16:33:19.217887 | controller |
2026-03-18 16:33:19.217921 | controller | TASK [sushy_emulator : Run ssh-keyscan] ****************************************
2026-03-18 16:33:19.217952 | controller | Wednesday 18 March 2026  16:33:18 +0000 (0:00:00.337)       0:04:07.232 *******
2026-03-18 16:33:19.217964 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:20.434419 | controller |
2026-03-18 16:33:20.434455 | controller | TASK [sushy_emulator : Write known hosts for later use] ************************
2026-03-18 16:33:20.434468 | controller | Wednesday 18 March 2026  16:33:19 +0000 (0:00:00.719)       0:04:07.952 *******
2026-03-18 16:33:20.434478 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:20.484616 | controller |
2026-03-18 16:33:20.484644 | controller | TASK [sushy_emulator : Ensure file exists: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-03-18 16:33:20.484653 | controller | Wednesday 18 March 2026  16:33:20 +0000 (0:00:01.216)       0:04:09.168 *******
2026-03-18 16:33:20.484662 | controller | skipping: [instance]
2026-03-18 16:33:20.535247 | controller |
2026-03-18 16:33:20.535275 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-03-18 16:33:20.535284 | controller | Wednesday 18 March 2026  16:33:20 +0000 (0:00:00.050)       0:04:09.219 *******
2026-03-18 16:33:20.535293 | controller | skipping: [instance]
2026-03-18 16:33:20.585316 | controller |
2026-03-18 16:33:20.585354 | controller | TASK [sushy_emulator : Set cifmw_libvirt_manager_uuids fact from /home/zuul/ci-framework-data/artifacts/libvirt-uuids.yml] ***
2026-03-18 16:33:20.585363 | controller | Wednesday 18 March 2026  16:33:20 +0000 (0:00:00.050)       0:04:09.269 *******
2026-03-18 16:33:20.585374 | controller | skipping: [instance]
2026-03-18 16:33:20.648757 | controller |
2026-03-18 16:33:20.648777 | controller | TASK [sushy_emulator : Generate list of filtered VMs] **************************
2026-03-18 16:33:20.648784 | controller | Wednesday 18 March 2026  16:33:20 +0000 (0:00:00.049)       0:04:09.319 *******
2026-03-18 16:33:20.648793 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:20.694344 | controller |
2026-03-18 16:33:20.694362 | controller | TASK [sushy_emulator : Get Openstack instance UUIDs] ***************************
2026-03-18 16:33:20.694369 | controller | Wednesday 18 March 2026  16:33:20 +0000 (0:00:00.063)       0:04:09.383 *******
2026-03-18 16:33:20.694378 | controller | skipping: [instance]
2026-03-18 16:33:20.741362 | controller |
2026-03-18 16:33:20.741381 | controller | TASK [sushy_emulator : Set instance_uuid variable for openstack driver] ********
2026-03-18 16:33:20.741389 | controller | Wednesday 18 March 2026  16:33:20 +0000 (0:00:00.045)       0:04:09.428 *******
2026-03-18 16:33:20.741398 | controller | skipping: [instance]
2026-03-18 16:33:20.790668 | controller |
2026-03-18 16:33:20.790687 | controller | TASK [sushy_emulator : Base64 encode openstack clouds.yaml file] ***************
2026-03-18 16:33:20.790694 | controller | Wednesday 18 March 2026  16:33:20 +0000 (0:00:00.047)       0:04:09.476 *******
2026-03-18 16:33:20.790703 | controller | skipping: [instance]
2026-03-18 16:33:21.501695 | controller |
2026-03-18 16:33:21.501732 | controller | TASK [sushy_emulator : Generate htpasswd string] *******************************
2026-03-18 16:33:21.501741 | controller | Wednesday 18 March 2026  16:33:20 +0000 (0:00:00.049)       0:04:09.525 *******
2026-03-18 16:33:21.501751 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:21.612256 | controller |
2026-03-18 16:33:21.612292 | controller | TASK [sushy_emulator : Write sushy emulator resource loop] *********************
2026-03-18 16:33:21.612300 | controller | Wednesday 18 March 2026  16:33:21 +0000 (0:00:00.710)       0:04:10.235 *******
2026-03-18 16:33:21.612312 | controller | skipping: [instance] => (item=secret)
2026-03-18 16:33:22.747809 | controller | skipping: [instance] => (item=configmap)
2026-03-18 16:33:22.747849 | controller | skipping: [instance] => (item=pod)
2026-03-18 16:33:22.747857 | controller | skipping: [instance] => (item=service)
2026-03-18 16:33:22.747863 | controller | skipping: [instance] => (item=route)
2026-03-18 16:33:22.747877 | controller | skipping: [instance]
2026-03-18 16:33:22.747884 | controller |
2026-03-18 16:33:22.747890 | controller | TASK [sushy_emulator : Write sushy emulator config] ****************************
2026-03-18 16:33:22.747896 | controller | Wednesday 18 March 2026  16:33:21 +0000 (0:00:00.110)       0:04:10.345 *******
2026-03-18 16:33:22.747906 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:23.741478 | controller |
2026-03-18 16:33:23.741516 | controller | TASK [sushy_emulator : Write htpasswd string to file] **************************
2026-03-18 16:33:23.741523 | controller | Wednesday 18 March 2026  16:33:22 +0000 (0:00:01.136)       0:04:11.481 *******
2026-03-18 16:33:23.741534 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:23.788121 | controller |
2026-03-18 16:33:23.788151 | controller | TASK [sushy_emulator : Create the sushy-emulator namespace] ********************
2026-03-18 16:33:23.788159 | controller | Wednesday 18 March 2026  16:33:23 +0000 (0:00:00.993)       0:04:12.475 *******
2026-03-18 16:33:23.788168 | controller | skipping: [instance]
2026-03-18 16:33:23.834373 | controller |
2026-03-18 16:33:23.834402 | controller | TASK [sushy_emulator : Check if router pod is running in openshift-ingress namespace] ***
2026-03-18 16:33:23.834410 | controller | Wednesday 18 March 2026  16:33:23 +0000 (0:00:00.047)       0:04:12.522 *******
2026-03-18 16:33:23.834419 | controller | skipping: [instance]
2026-03-18 16:33:23.921802 | controller |
2026-03-18 16:33:23.921831 | controller | TASK [sushy_emulator : Apply Sushy Emulator resources] *************************
2026-03-18 16:33:23.921839 | controller | Wednesday 18 March 2026  16:33:23 +0000 (0:00:00.046)       0:04:12.568 *******
2026-03-18 16:33:23.921850 | controller | skipping: [instance] => (item=secret)
2026-03-18 16:33:23.976006 | controller | skipping: [instance] => (item=configmap)
2026-03-18 16:33:23.976034 | controller | skipping: [instance] => (item=service)
2026-03-18 16:33:23.976041 | controller | skipping: [instance] => (item=route)
2026-03-18 16:33:23.976047 | controller | skipping: [instance]
2026-03-18 16:33:23.976053 | controller |
2026-03-18 16:33:23.976059 | controller | TASK [sushy_emulator : Apply Sushy Emulator pod resource] **********************
2026-03-18 16:33:23.976065 | controller | Wednesday 18 March 2026  16:33:23 +0000 (0:00:00.080)       0:04:12.649 *******
2026-03-18 16:33:23.976074 | controller | skipping: [instance]
2026-03-18 16:33:25.658913 | controller |
2026-03-18 16:33:25.658964 | controller | TASK [podman : Ensure podman is installed] *************************************
2026-03-18 16:33:25.658978 | controller | Wednesday 18 March 2026  16:33:23 +0000 (0:00:00.061)       0:04:12.710 *******
2026-03-18 16:33:25.658989 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:26.491498 | controller |
2026-03-18 16:33:26.491540 | controller | TASK [podman : Enable loginctl linger for ansible_user_id] *********************
2026-03-18 16:33:26.491553 | controller | Wednesday 18 March 2026  16:33:25 +0000 (0:00:01.682)       0:04:14.393 *******
2026-03-18 16:33:26.491564 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:26.534057 | controller |
2026-03-18 16:33:26.534098 | controller | TASK [podman : Ensure subordinate UID entry exists for zuul] *******************
2026-03-18 16:33:26.534111 | controller | Wednesday 18 March 2026  16:33:26 +0000 (0:00:00.832)       0:04:15.225 *******
2026-03-18 16:33:26.534126 | controller | skipping: [instance]
2026-03-18 16:33:26.570429 | controller |
2026-03-18 16:33:26.570457 | controller | TASK [podman : Ensure subordinate GID entry exists for zuul] *******************
2026-03-18 16:33:26.570470 | controller | Wednesday 18 March 2026  16:33:26 +0000 (0:00:00.042)       0:04:15.268 *******
2026-03-18 16:33:26.570479 | controller | skipping: [instance]
2026-03-18 16:33:26.614991 | controller |
2026-03-18 16:33:26.615016 | controller | TASK [podman : Run podman system migrate if subuid/subgid files were changed] ***
2026-03-18 16:33:26.615024 | controller | Wednesday 18 March 2026  16:33:26 +0000 (0:00:00.036)       0:04:15.305 *******
2026-03-18 16:33:26.615034 | controller | skipping: [instance]
2026-03-18 16:33:37.121247 | controller |
2026-03-18 16:33:37.121509 | controller | TASK [sushy_emulator : Pull Sushy Emulator container image] ********************
2026-03-18 16:33:37.121518 | controller | Wednesday 18 March 2026  16:33:26 +0000 (0:00:00.044)       0:04:15.349 *******
2026-03-18 16:33:37.121529 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:38.744619 | controller |
2026-03-18 16:33:38.744684 | controller | TASK [sushy_emulator : Create and start Sushy Emulator container] **************
2026-03-18 16:33:38.744694 | controller | Wednesday 18 March 2026  16:33:37 +0000 (0:00:10.501)       0:04:25.851 *******
2026-03-18 16:33:38.744707 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:39.935058 | controller |
2026-03-18 16:33:39.935129 | controller | TASK [reproducer : Ensure directories exist] ***********************************
2026-03-18 16:33:39.935138 | controller | Wednesday 18 March 2026  16:33:38 +0000 (0:00:01.627)       0:04:27.478 *******
2026-03-18 16:33:39.935152 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=parameters)
2026-03-18 16:33:39.971422 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=artifacts)
2026-03-18 16:33:39.971444 | controller |
2026-03-18 16:33:39.971452 | controller | TASK [reproducer : Convert VBMC list into a dict for better usage] *************
2026-03-18 16:33:39.971458 | controller | Wednesday 18 March 2026  16:33:39 +0000 (0:00:01.190)       0:04:28.668 *******
2026-03-18 16:33:39.971467 | controller | skipping: [instance]
2026-03-18 16:33:40.578107 | controller |
2026-03-18 16:33:40.578178 | controller | TASK [reproducer : Check if baremetal-info.yml exists] *************************
2026-03-18 16:33:40.578188 | controller | Wednesday 18 March 2026  16:33:39 +0000 (0:00:00.037)       0:04:28.706 *******
2026-03-18 16:33:40.578201 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:40.615079 | controller |
2026-03-18 16:33:40.615100 | controller | TASK [reproducer : Get content of baremetal-info file] *************************
2026-03-18 16:33:40.615107 | controller | Wednesday 18 March 2026  16:33:40 +0000 (0:00:00.605)       0:04:29.312 *******
2026-03-18 16:33:40.615116 | controller | skipping: [instance]
2026-03-18 16:33:40.660859 | controller |
2026-03-18 16:33:40.660877 | controller | TASK [reproducer : Interpret remote file content as yaml] **********************
2026-03-18 16:33:40.660884 | controller | Wednesday 18 March 2026  16:33:40 +0000 (0:00:00.037)       0:04:29.349 *******
2026-03-18 16:33:40.660893 | controller | skipping: [instance]
2026-03-18 16:33:40.661050 | controller |
2026-03-18 16:33:40.661186 | controller | TASK [reproducer : Slurp content of: /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2026-03-18 16:33:40.661312 | controller | Wednesday 18 March 2026  16:33:40 +0000 (0:00:00.046)       0:04:29.395 *******
2026-03-18 16:33:40.704309 | controller | skipping: [instance]
2026-03-18 16:33:40.704437 | controller |
2026-03-18 16:33:40.704563 | controller | TASK [reproducer : Set cifmw_libvirt_manager_mac_map fact from /home/zuul/ci-framework-data/artifacts/interfaces-info.yml] ***
2026-03-18 16:33:40.704684 | controller | Wednesday 18 March 2026  16:33:40 +0000 (0:00:00.042)       0:04:29.437 *******
2026-03-18 16:33:40.744240 | controller | skipping: [instance]
2026-03-18 16:33:40.744371 | controller |
2026-03-18 16:33:40.744495 | controller | TASK [reproducer : Generate libvirt_manager_bm_info_data fact] *****************
2026-03-18 16:33:40.744617 | controller | Wednesday 18 March 2026  16:33:40 +0000 (0:00:00.041)       0:04:29.479 *******
2026-03-18 16:33:40.879702 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-compute-0', 'value': '20f8929e-571d-583f-969c-f0d6357022c1'})
2026-03-18 16:33:42.048554 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-controller-0', 'value': '41e636ff-54e1-588d-b6c5-f5405b3f5f6b'})
2026-03-18 16:33:42.048612 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'key': 'cifmw-crc-0', 'value': '913caf22-8dd8-51c3-8d80-9fcd24a8e282'})
2026-03-18 16:33:42.048620 | controller |
2026-03-18 16:33:42.048628 | controller | TASK [reproducer : Output baremetal info file] *********************************
2026-03-18 16:33:42.048634 | controller | Wednesday 18 March 2026  16:33:40 +0000 (0:00:00.134)       0:04:29.614 *******
2026-03-18 16:33:42.048647 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:42.100398 | controller |
2026-03-18 16:33:42.100435 | controller | TASK [reproducer : Output ironic_nodes to file] ********************************
2026-03-18 16:33:42.100445 | controller | Wednesday 18 March 2026  16:33:42 +0000 (0:00:01.167)       0:04:30.782 *******
2026-03-18 16:33:42.100457 | controller | skipping: [instance]
2026-03-18 16:33:42.242778 | controller |
2026-03-18 16:33:42.242826 | controller | TASK [Verify connection to baremetal VMs via Sushy Emulator] *******************
2026-03-18 16:33:42.242855 | controller | Wednesday 18 March 2026  16:33:42 +0000 (0:00:00.051)       0:04:30.833 *******
2026-03-18 16:33:42.242882 | controller |
2026-03-18 16:33:42.298678 | controller | TASK [sushy_emulator : Load baremetal hosts from libvirt_manager_bm_info_data fact] ***
2026-03-18 16:33:42.298699 | controller | Wednesday 18 March 2026  16:33:42 +0000 (0:00:00.143)       0:04:30.976 *******
2026-03-18 16:33:42.298710 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:42.351155 | controller |
2026-03-18 16:33:42.351178 | controller | TASK [sushy_emulator : Slurp content of: /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2026-03-18 16:33:42.351186 | controller | Wednesday 18 March 2026  16:33:42 +0000 (0:00:00.056)       0:04:31.033 *******
2026-03-18 16:33:42.351195 | controller | skipping: [instance]
2026-03-18 16:33:42.400142 | controller |
2026-03-18 16:33:42.400164 | controller | TASK [sushy_emulator : Set cifmw_baremetal_hosts fact from /home/zuul/ci-framework-data/parameters/baremetal-info.yml] ***
2026-03-18 16:33:42.400172 | controller | Wednesday 18 March 2026  16:33:42 +0000 (0:00:00.052)       0:04:31.085 *******
2026-03-18 16:33:42.400182 | controller | skipping: [instance]
2026-03-18 16:33:43.838989 | controller |
2026-03-18 16:33:43.839044 | controller | TASK [sushy_emulator : Test Sushy Emulator and connection to hypervisor libvirt socket] ***
2026-03-18 16:33:43.839053 | controller | Wednesday 18 March 2026  16:33:42 +0000 (0:00:00.049)       0:04:31.134 *******
2026-03-18 16:33:43.839066 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:52.020422 | controller |
2026-03-18 16:33:52.020485 | controller | TASK [sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator] ***
2026-03-18 16:33:52.020495 | controller | Wednesday 18 March 2026  16:33:43 +0000 (0:00:01.438)       0:04:32.572 *******
2026-03-18 16:33:52.020508 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=20f8929e-571d-583f-969c-f0d6357022c1)
2026-03-18 16:33:52.127226 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=41e636ff-54e1-588d-b6c5-f5405b3f5f6b)
2026-03-18 16:33:52.127264 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=913caf22-8dd8-51c3-8d80-9fcd24a8e282)
2026-03-18 16:33:52.127270 | controller |
2026-03-18 16:33:52.127277 | controller | TASK [sushy_emulator : Verify baremetal VM power status] ***********************
2026-03-18 16:33:52.127288 | controller | Wednesday 18 March 2026  16:33:52 +0000 (0:00:08.180)       0:04:40.753 *******
2026-03-18 16:33:52.127299 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-compute-0)
2026-03-18 16:33:52.375496 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-controller-0)
2026-03-18 16:33:52.375548 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=cifmw-crc-0)
2026-03-18 16:33:52.375557 | controller |
2026-03-18 16:33:52.375565 | controller | TASK [reproducer : Check if cifmw_reproducer_src_dir is on localhost] **********
2026-03-18 16:33:52.375571 | controller | Wednesday 18 March 2026  16:33:52 +0000 (0:00:00.107)       0:04:40.861 *******
2026-03-18 16:33:52.375583 | controller | ok: [instance -> localhost]
2026-03-18 16:33:54.239212 | controller |
2026-03-18 16:33:54.239257 | controller | TASK [reproducer : Sync local repositories to other hosts if present] **********
2026-03-18 16:33:54.239265 | controller | Wednesday 18 March 2026  16:33:52 +0000 (0:00:00.247)       0:04:41.109 *******
2026-03-18 16:33:54.239276 | controller | changed: [instance -> localhost] => (item=controller-0)
2026-03-18 16:33:54.988221 | controller |
2026-03-18 16:33:54.988267 | controller | TASK [reproducer : Check if common-requirements.txt exists on controller-0] ****
2026-03-18 16:33:54.988276 | controller | Wednesday 18 March 2026  16:33:54 +0000 (0:00:01.863)       0:04:42.973 *******
2026-03-18 16:33:54.988287 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:55.815921 | controller |
2026-03-18 16:33:55.815971 | controller | TASK [reproducer : Install ansible dependencies] *******************************
2026-03-18 16:33:55.815979 | controller | Wednesday 18 March 2026  16:33:54 +0000 (0:00:00.749)       0:04:43.722 *******
2026-03-18 16:33:55.815990 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:57.031688 | controller |
2026-03-18 16:33:57.031748 | controller | TASK [reproducer : Inject most of the cifmw_ parameters passed to the reproducer run] ***
2026-03-18 16:33:57.031757 | controller | Wednesday 18 March 2026  16:33:55 +0000 (0:00:00.827)       0:04:44.550 *******
2026-03-18 16:33:57.031771 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:57.770061 | controller |
2026-03-18 16:33:57.770127 | controller | TASK [reproducer : Create reproducer-variables.yml symlink to old location] ****
2026-03-18 16:33:57.770137 | controller | Wednesday 18 March 2026  16:33:57 +0000 (0:00:01.214)       0:04:45.764 *******
2026-03-18 16:33:57.770151 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:58.974318 | controller |
2026-03-18 16:33:58.974361 | controller | TASK [reproducer : Inject local environment parameters] ************************
2026-03-18 16:33:58.974369 | controller | Wednesday 18 March 2026  16:33:57 +0000 (0:00:00.739)       0:04:46.503 *******
2026-03-18 16:33:58.974380 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:33:58.974474 | controller |
2026-03-18 16:33:58.974486 | controller | TASK [reproducer : Create openshift-environment.yml symlink to old location] ***
2026-03-18 16:33:58.974494 | controller | Wednesday 18 March 2026  16:33:58 +0000 (0:00:01.204)       0:04:47.708 *******
2026-03-18 16:33:59.686448 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:00.370181 | controller |
2026-03-18 16:34:00.370221 | controller | TASK [reproducer : Get interfaces-info content] ********************************
2026-03-18 16:34:00.370228 | controller | Wednesday 18 March 2026  16:33:59 +0000 (0:00:00.712)       0:04:48.420 *******
2026-03-18 16:34:00.370238 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:01.849820 | controller |
2026-03-18 16:34:01.849863 | controller | TASK [reproducer : Wait for OCP nodes to be ready] *****************************
2026-03-18 16:34:01.849878 | controller | Wednesday 18 March 2026  16:34:00 +0000 (0:00:00.683)       0:04:49.104 *******
2026-03-18 16:34:01.849889 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2026-03-18 16:34:01.896943 | controller |
2026-03-18 16:34:01.897029 | controller | TASK [networking_mapper : Check for Networking Definition file existence] ******
2026-03-18 16:34:01.897039 | controller | Wednesday 18 March 2026  16:34:01 +0000 (0:00:01.479)       0:04:50.583 *******
2026-03-18 16:34:01.897062 | controller | skipping: [instance]
2026-03-18 16:34:01.897096 | controller |
2026-03-18 16:34:01.897105 | controller | TASK [networking_mapper : Load the Networking Definition from file] ************
2026-03-18 16:34:01.943620 | controller | Wednesday 18 March 2026  16:34:01 +0000 (0:00:00.047)       0:04:50.631 *******
2026-03-18 16:34:01.943672 | controller | skipping: [instance]
2026-03-18 16:34:01.988562 | controller |
2026-03-18 16:34:01.988605 | controller | TASK [networking_mapper : Check for interfaces info file existence] ************
2026-03-18 16:34:01.988614 | controller | Wednesday 18 March 2026  16:34:01 +0000 (0:00:00.046)       0:04:50.678 *******
2026-03-18 16:34:01.988628 | controller | skipping: [instance]
2026-03-18 16:34:02.033355 | controller |
2026-03-18 16:34:02.033386 | controller | TASK [networking_mapper : Load the interfaces info from file] ******************
2026-03-18 16:34:02.033395 | controller | Wednesday 18 March 2026  16:34:01 +0000 (0:00:00.044)       0:04:50.723 *******
2026-03-18 16:34:02.033407 | controller | skipping: [instance]
2026-03-18 16:34:02.078129 | controller |
2026-03-18 16:34:02.078151 | controller | TASK [networking_mapper : Ensure local fact is empty] **************************
2026-03-18 16:34:02.078160 | controller | Wednesday 18 March 2026  16:34:02 +0000 (0:00:00.043)       0:04:50.766 *******
2026-03-18 16:34:02.078170 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:02.197113 | controller |
2026-03-18 16:34:02.197138 | controller | TASK [networking_mapper : Set the input Networking Definition and patch it if needed] ***
2026-03-18 16:34:02.197146 | controller | Wednesday 18 March 2026  16:34:02 +0000 (0:00:00.045)       0:04:50.812 *******
2026-03-18 16:34:02.197167 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'networks': {'ctlplane': {'network': '192.168.140.0/24', 'gateway': '192.168.140.1', 'dns': ['192.168.140.1'], 'mtu': 1500, 'tools': {'multus': {'ranges': [{'start': 30, 'end': 70}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 120}, {'start': 150, 'end': 170}]}, 'metallb': {'ranges': [{'start': 80, 'end': 90}]}}}, 'internalapi': {'network': '172.17.0.0/24', 'vlan': 20, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'storage': {'network': '172.18.0.0/24', 'vlan': 21, 'mtu': 1496, 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}}, 'tenant': {'network': '172.19.0.0/24', 'tools': {'metallb': {'ranges': [{'start': 80, 'end': 90}]}, 'netconfig': {'ranges': [{'start': 100, 'end': 250}]}, 'multus': {'ranges': [{'start': 30, 'end': 70}]}}, 'vlan': 22, 'mtu': 1496}, 'external': {'network': '10.0.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 22, 'mtu': 1500}, 'storagemgmt': {'network': '172.20.0.0/24', 'tools': {'netconfig': {'ranges': [{'start': 100, 'end': 250}]}}, 'vlan': 23, 'mtu': 1500}, 'public': {'network-v4': '192.168.101.0/24'}}, 'group-templates': {'ocps': {'network-template': {'range': {'start': 10, 'length': 10}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'computes': {'network-template': {'range': {'start': 100, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}, 'public': None}}, 'cephs': {'network-template': {'range': {'start': 150, 'length': 21}}, 'networks': {'ctlplane': {}, 'internalapi': {'trunk-parent': 'ctlplane'}, 'tenant': {'trunk-parent': 'ctlplane'}, 'storage': {'trunk-parent': 'ctlplane'}, 'storagemgmt': {'trunk-parent': 'ctlplane'}}}}, 'instances': {'controller-0': {'networks': {'ctlplane': {'ip': '192.168.140.9'}, 'public': {'ip-v4': '192.168.101.9'}}}}})
2026-03-18 16:34:02.254155 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={})
2026-03-18 16:34:02.254173 | controller |
2026-03-18 16:34:02.254181 | controller | TASK [networking_mapper : Gather facts if requested] ***************************
2026-03-18 16:34:02.254197 | controller | Wednesday 18 March 2026  16:34:02 +0000 (0:00:00.118)       0:04:50.931 *******
2026-03-18 16:34:02.254207 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/networking_mapper/tasks/_gather_facts.yml for instance
2026-03-18 16:34:05.936630 | controller |
2026-03-18 16:34:05.936665 | controller | TASK [networking_mapper : Gather the facts] ************************************
2026-03-18 16:34:05.936673 | controller | Wednesday 18 March 2026  16:34:02 +0000 (0:00:00.056)       0:04:50.988 *******
2026-03-18 16:34:05.936683 | controller | ok: [instance -> crc-0(crc-0.instance)] => (item=crc-0)
2026-03-18 16:34:07.107170 | controller | ok: [instance -> compute-0(compute-0.instance)] => (item=compute-0)
2026-03-18 16:34:07.107206 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=controller-0)
2026-03-18 16:34:07.107214 | controller |
2026-03-18 16:34:07.107220 | controller | TASK [networking_mapper : Save instances refreshed facts for troubleshooting purposes] ***
2026-03-18 16:34:07.107227 | controller | Wednesday 18 March 2026  16:34:05 +0000 (0:00:03.682)       0:04:54.670 *******
2026-03-18 16:34:07.107237 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:07.727305 | controller |
2026-03-18 16:34:07.727344 | controller | TASK [networking_mapper : Ensure CI infrastructure dir exists] *****************
2026-03-18 16:34:07.727352 | controller | Wednesday 18 March 2026  16:34:07 +0000 (0:00:01.170)       0:04:55.841 *******
2026-03-18 16:34:07.727362 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:08.769077 | controller |
2026-03-18 16:34:08.769112 | controller | TASK [networking_mapper : Write the Networking Definition to file] *************
2026-03-18 16:34:08.769120 | controller | Wednesday 18 March 2026  16:34:07 +0000 (0:00:00.620)       0:04:56.461 *******
2026-03-18 16:34:08.769131 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:08.854112 | controller |
2026-03-18 16:34:08.854145 | controller | TASK [networking_mapper : Call the networking mapper] **************************
2026-03-18 16:34:08.854153 | controller | Wednesday 18 March 2026  16:34:08 +0000 (0:00:01.041)       0:04:57.503 *******
2026-03-18 16:34:08.854163 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:08.918315 | controller |
2026-03-18 16:34:08.918342 | controller | TASK [networking_mapper : Set networking mapper facts] *************************
2026-03-18 16:34:08.918350 | controller | Wednesday 18 March 2026  16:34:08 +0000 (0:00:00.085)       0:04:57.588 *******
2026-03-18 16:34:08.918359 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:10.040632 | controller |
2026-03-18 16:34:10.040667 | controller | TASK [networking_mapper : Write the Networking Environment Definition to file] ***
2026-03-18 16:34:10.040692 | controller | Wednesday 18 March 2026  16:34:08 +0000 (0:00:00.064)       0:04:57.653 *******
2026-03-18 16:34:10.040704 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:11.050605 | controller |
2026-03-18 16:34:11.050640 | controller | TASK [reproducer : Inject CRC ssh key] *****************************************
2026-03-18 16:34:11.050647 | controller | Wednesday 18 March 2026  16:34:10 +0000 (0:00:01.121)       0:04:58.774 *******
2026-03-18 16:34:11.050672 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:17.165502 | controller |
2026-03-18 16:34:17.165557 | controller | TASK [reproducer : Ensure we have all dependencies installed] ******************
2026-03-18 16:34:17.165566 | controller | Wednesday 18 March 2026  16:34:11 +0000 (0:00:01.010)       0:04:59.784 *******
2026-03-18 16:34:17.165576 | controller | FAILED - RETRYING: [instance -> controller-0]: Ensure we have all dependencies installed (20 retries left).
2026-03-18 16:34:17.392855 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:17.392881 | controller |
2026-03-18 16:34:17.392888 | controller | TASK [Configure ntp service] ***************************************************
2026-03-18 16:34:17.392899 | controller | Wednesday 18 March 2026  16:34:17 +0000 (0:00:06.114)       0:05:05.899 *******
2026-03-18 16:34:17.392909 | controller |
2026-03-18 16:34:18.525546 | controller | TASK [cifmw_ntp : Install chrony] **********************************************
2026-03-18 16:34:18.525590 | controller | Wednesday 18 March 2026  16:34:17 +0000 (0:00:00.227)       0:05:06.127 *******
2026-03-18 16:34:18.525603 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:19.638474 | controller |
2026-03-18 16:34:19.638528 | controller | TASK [cifmw_ntp : Configure original chrony.conf file] *************************
2026-03-18 16:34:19.638537 | controller | Wednesday 18 March 2026  16:34:18 +0000 (0:00:01.132)       0:05:07.259 *******
2026-03-18 16:34:19.638548 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item={'regexp': '^(server.*)$', 'line': '#\\g<1>', 'backrefs': True})
2026-03-18 16:34:20.686275 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item={'line': 'include /etc/chrony-cifmw.conf', 'insertafter': 'EOF'})
2026-03-18 16:34:20.686352 | controller |
2026-03-18 16:34:20.686361 | controller | TASK [cifmw_ntp : Render chrony extra config file] *****************************
2026-03-18 16:34:20.686368 | controller | Wednesday 18 March 2026  16:34:19 +0000 (0:00:01.112)       0:05:08.372 *******
2026-03-18 16:34:20.686384 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:20.686412 | controller |
2026-03-18 16:34:20.686421 | controller | TASK [cifmw_ntp : Enable chrony service] ***************************************
2026-03-18 16:34:20.686431 | controller | Wednesday 18 March 2026  16:34:20 +0000 (0:00:01.047)       0:05:09.420 *******
2026-03-18 16:34:21.381061 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:21.381131 | controller |
2026-03-18 16:34:21.381200 | controller | TASK [reproducer : Configure CRC node if available] ****************************
2026-03-18 16:34:21.381301 | controller | Wednesday 18 March 2026  16:34:21 +0000 (0:00:00.695)       0:05:10.115 *******
2026-03-18 16:34:21.573262 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_crc.yml for instance
2026-03-18 16:34:21.573321 | controller |
2026-03-18 16:34:21.573418 | controller | TASK [reproducer : Get the networking-environment-definition from controller-0] ***
2026-03-18 16:34:21.573509 | controller | Wednesday 18 March 2026  16:34:21 +0000 (0:00:00.192)       0:05:10.307 *******
2026-03-18 16:34:22.089079 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:22.089137 | controller |
2026-03-18 16:34:22.089246 | controller | TASK [reproducer : Check which dnsmasq config we must edit] ********************
2026-03-18 16:34:22.089341 | controller | Wednesday 18 March 2026  16:34:22 +0000 (0:00:00.515)       0:05:10.823 *******
2026-03-18 16:34:22.663458 | controller | ok: [instance -> crc-0(crc-0.instance)]
2026-03-18 16:34:22.663528 | controller |
2026-03-18 16:34:22.663749 | controller | TASK [reproducer : Configure local DNS for CRC pod] ****************************
2026-03-18 16:34:23.328237 | controller | Wednesday 18 March 2026  16:34:22 +0000 (0:00:00.574)       0:05:11.397 *******
2026-03-18 16:34:23.328294 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-03-18 16:34:23.328504 | controller |
2026-03-18 16:34:23.861551 | controller | TASK [reproducer : Ensure dnsmasq listens on correct interfaces] ***************
2026-03-18 16:34:23.861596 | controller | Wednesday 18 March 2026  16:34:23 +0000 (0:00:00.664)       0:05:12.062 *******
2026-03-18 16:34:23.861609 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-03-18 16:34:23.915973 | controller |
2026-03-18 16:34:23.916016 | controller | TASK [Restart DNS in CRC VM] ***************************************************
2026-03-18 16:34:23.916027 | controller | Wednesday 18 March 2026  16:34:23 +0000 (0:00:00.533)       0:05:12.595 *******
2026-03-18 16:34:23.916041 | controller |
2026-03-18 16:34:24.425961 | controller | TASK [openshift_setup : Check which dnsmasq config we must edit] ***************
2026-03-18 16:34:24.426015 | controller | Wednesday 18 March 2026  16:34:23 +0000 (0:00:00.054)       0:05:12.650 *******
2026-03-18 16:34:24.426029 | controller | ok: [instance -> crc-0(crc-0.instance)]
2026-03-18 16:34:25.171604 | controller |
2026-03-18 16:34:25.171650 | controller | TASK [openshift_setup : Restart dnsmasq service if used] ***********************
2026-03-18 16:34:25.171660 | controller | Wednesday 18 March 2026  16:34:24 +0000 (0:00:00.509)       0:05:13.160 *******
2026-03-18 16:34:25.171672 | controller | changed: [instance -> crc-0(crc-0.instance)]
2026-03-18 16:34:25.209641 | controller |
2026-03-18 16:34:25.209679 | controller | TASK [openshift_setup : Stop dnsmasq] ******************************************
2026-03-18 16:34:25.209697 | controller | Wednesday 18 March 2026  16:34:25 +0000 (0:00:00.745)       0:05:13.905 *******
2026-03-18 16:34:25.209711 | controller | skipping: [instance]
2026-03-18 16:34:25.251885 | controller |
2026-03-18 16:34:25.251914 | controller | TASK [openshift_setup : Start dnsmasq] *****************************************
2026-03-18 16:34:25.251951 | controller | Wednesday 18 March 2026  16:34:25 +0000 (0:00:00.038)       0:05:13.944 *******
2026-03-18 16:34:25.251967 | controller | skipping: [instance]
2026-03-18 16:34:25.496840 | controller |
2026-03-18 16:34:25.496885 | controller | TASK [reproducer : Remove entry from /etc/hosts] *******************************
2026-03-18 16:34:25.496895 | controller | Wednesday 18 March 2026  16:34:25 +0000 (0:00:00.042)       0:05:13.986 *******
2026-03-18 16:34:25.496906 | controller | changed: [instance]
2026-03-18 16:34:25.586989 | controller |
2026-03-18 16:34:25.587127 | controller | TASK [Inject wildcard A/AAAA record for apps-crc.testing] **********************
2026-03-18 16:34:25.587146 | controller | Wednesday 18 March 2026  16:34:25 +0000 (0:00:00.244)       0:05:14.231 *******
2026-03-18 16:34:25.587158 | controller | skipping: [instance] => (item=)
2026-03-18 16:34:25.628233 | controller |
2026-03-18 16:34:25.628257 | controller | TASK [dnsmasq : Assert we have needed address data] ****************************
2026-03-18 16:34:25.628268 | controller | Wednesday 18 March 2026  16:34:25 +0000 (0:00:00.090)       0:05:14.321 *******
2026-03-18 16:34:25.628281 | controller | ok: [instance]
2026-03-18 16:34:25.718962 | controller |
2026-03-18 16:34:25.718987 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-18 16:34:25.718996 | controller | Wednesday 18 March 2026  16:34:25 +0000 (0:00:00.041)       0:05:14.362 *******
2026-03-18 16:34:25.719008 | controller | ok: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2026-03-18 16:34:26.010427 | controller |
2026-03-18 16:34:26.010470 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-18 16:34:26.010479 | controller | Wednesday 18 March 2026  16:34:25 +0000 (0:00:00.090)       0:05:14.453 *******
2026-03-18 16:34:26.010491 | controller | changed: [instance] => (item={'domains': ['apps-crc.testing'], 'ipaddr': '192.168.140.10', 'state': 'present'})
2026-03-18 16:34:26.070354 | controller |
2026-03-18 16:34:26.070380 | controller | TASK [Inject A/AAAA record for api/api-int.crc.testing] ************************
2026-03-18 16:34:26.070390 | controller | Wednesday 18 March 2026  16:34:26 +0000 (0:00:00.291)       0:05:14.744 *******
2026-03-18 16:34:26.070402 | controller |
2026-03-18 16:34:26.144569 | controller | TASK [dnsmasq : Assert we have needed host record data] ************************
2026-03-18 16:34:26.144591 | controller | Wednesday 18 March 2026  16:34:26 +0000 (0:00:00.060)       0:05:14.804 *******
2026-03-18 16:34:26.144602 | controller | ok: [instance]
2026-03-18 16:34:26.213415 | controller |
2026-03-18 16:34:26.213434 | controller | TASK [dnsmasq : Assert each address element have needed data] ******************
2026-03-18 16:34:26.213442 | controller | Wednesday 18 March 2026  16:34:26 +0000 (0:00:00.074)       0:05:14.879 *******
2026-03-18 16:34:26.213451 | controller | ok: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-03-18 16:34:26.213637 | controller |
2026-03-18 16:34:26.213845 | controller | TASK [dnsmasq : Add/Remove address] ********************************************
2026-03-18 16:34:26.508050 | controller | Wednesday 18 March 2026  16:34:26 +0000 (0:00:00.069)       0:05:14.948 *******
2026-03-18 16:34:26.508097 | controller | changed: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-03-18 16:34:26.508325 | controller |
2026-03-18 16:34:26.508340 | controller | TASK [dnsmasq : Remove crc.testing from host_records] **************************
2026-03-18 16:34:26.540579 | controller | Wednesday 18 March 2026  16:34:26 +0000 (0:00:00.293)       0:05:15.242 *******
2026-03-18 16:34:26.540600 | controller | skipping: [instance]
2026-03-18 16:34:26.610911 | controller |
2026-03-18 16:34:26.610960 | controller | TASK [dnsmasq : Add controller-0 short hostname record when 'utility' in the name into /etc/hosts] ***
2026-03-18 16:34:26.610969 | controller | Wednesday 18 March 2026  16:34:26 +0000 (0:00:00.033)       0:05:15.275 *******
2026-03-18 16:34:26.610992 | controller | skipping: [instance] => (item={'names': ['api.crc.testing', 'api-int.crc.testing'], 'ips': ['192.168.140.10'], 'state': 'present'})
2026-03-18 16:34:27.055826 | controller | skipping: [instance]
2026-03-18 16:34:27.055868 | controller |
2026-03-18 16:34:27.055877 | controller | TASK [reproducer : Ensure "testing" domain is "local"] *************************
2026-03-18 16:34:27.055884 | controller | Wednesday 18 March 2026  16:34:26 +0000 (0:00:00.069)       0:05:15.345 *******
2026-03-18 16:34:27.055896 | controller | changed: [instance]
2026-03-18 16:34:27.812271 | controller |
2026-03-18 16:34:27.812313 | controller | TASK [reproducer : Flush handlers] *********************************************
2026-03-18 16:34:27.812321 | controller | Wednesday 18 March 2026  16:34:27 +0000 (0:00:00.431)       0:05:15.776 *******
2026-03-18 16:34:27.812328 | controller |
2026-03-18 16:34:27.812334 | controller | RUNNING HANDLER [cifmw_ntp : Restart chrony] ***********************************
2026-03-18 16:34:27.812339 | controller | Wednesday 18 March 2026  16:34:27 +0000 (0:00:00.013)       0:05:15.789 *******
2026-03-18 16:34:27.812350 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:28.271109 | controller |
2026-03-18 16:34:28.271164 | controller | RUNNING HANDLER [dnsmasq : Restart dnsmasq] ************************************
2026-03-18 16:34:28.271177 | controller | Wednesday 18 March 2026  16:34:27 +0000 (0:00:00.756)       0:05:16.546 *******
2026-03-18 16:34:28.271193 | controller | changed: [instance]
2026-03-18 16:34:28.460329 | controller |
2026-03-18 16:34:28.460369 | controller | TASK [reproducer : Configure EDPM based nodes ctlplane network] ****************
2026-03-18 16:34:28.460378 | controller | Wednesday 18 March 2026  16:34:28 +0000 (0:00:00.458)       0:05:17.005 *******
2026-03-18 16:34:28.460397 | controller | skipping: [instance] => (item=controller-0)
2026-03-18 16:34:30.011499 | controller | skipping: [instance] => (item=crc-0)
2026-03-18 16:34:30.011533 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/configure_computes.yml for instance => (item=compute-0)
2026-03-18 16:34:30.011541 | controller |
2026-03-18 16:34:30.011548 | controller | TASK [reproducer : Ensure we can ping controller-0 from ctlplane] **************
2026-03-18 16:34:30.011554 | controller | Wednesday 18 March 2026  16:34:28 +0000 (0:00:00.188)       0:05:17.194 *******
2026-03-18 16:34:30.011564 | controller | changed: [instance -> compute-0(compute-0.instance)]
2026-03-18 16:34:30.031021 | controller |
2026-03-18 16:34:30.031050 | controller | TASK [reproducer : Tweak dnf configuration] ************************************
2026-03-18 16:34:30.031058 | controller | Wednesday 18 March 2026  16:34:30 +0000 (0:00:01.551)       0:05:18.745 *******
2026-03-18 16:34:30.031069 | controller | skipping: [instance]
2026-03-18 16:34:30.031205 | controller |
2026-03-18 16:34:30.031316 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-03-18 16:34:30.031338 | controller | Wednesday 18 March 2026  16:34:30 +0000 (0:00:00.020)       0:05:18.765 *******
2026-03-18 16:34:30.551187 | controller | ok: [instance -> compute-0(compute-0.instance)]
2026-03-18 16:34:30.582467 | controller |
2026-03-18 16:34:30.582501 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-03-18 16:34:30.582509 | controller | Wednesday 18 March 2026  16:34:30 +0000 (0:00:00.519)       0:05:19.285 *******
2026-03-18 16:34:30.582520 | controller | skipping: [instance]
2026-03-18 16:34:30.615437 | controller |
2026-03-18 16:34:30.615472 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-03-18 16:34:30.615482 | controller | Wednesday 18 March 2026  16:34:30 +0000 (0:00:00.031)       0:05:19.317 *******
2026-03-18 16:34:30.615495 | controller | skipping: [instance]
2026-03-18 16:34:30.648167 | controller |
2026-03-18 16:34:30.648195 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-03-18 16:34:30.648203 | controller | Wednesday 18 March 2026  16:34:30 +0000 (0:00:00.032)       0:05:19.349 *******
2026-03-18 16:34:30.648213 | controller | skipping: [instance]
2026-03-18 16:34:30.691376 | controller |
2026-03-18 16:34:30.691406 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-03-18 16:34:30.691416 | controller | Wednesday 18 March 2026  16:34:30 +0000 (0:00:00.032)       0:05:19.382 *******
2026-03-18 16:34:30.691435 | controller | skipping: [instance]
2026-03-18 16:34:30.729623 | controller |
2026-03-18 16:34:30.729659 | controller | TASK [reproducer : Get rhos-release and setup repos] ***************************
2026-03-18 16:34:30.729669 | controller | Wednesday 18 March 2026  16:34:30 +0000 (0:00:00.043)       0:05:19.425 *******
2026-03-18 16:34:30.729689 | controller | skipping: [instance]
2026-03-18 16:34:30.751644 | controller |
2026-03-18 16:34:30.751671 | controller | TASK [reproducer : Create repositories on computes] ****************************
2026-03-18 16:34:30.751680 | controller | Wednesday 18 March 2026  16:34:30 +0000 (0:00:00.037)       0:05:19.463 *******
2026-03-18 16:34:30.751692 | controller | skipping: [instance]
2026-03-18 16:34:30.751875 | controller |
2026-03-18 16:34:30.752080 | controller | TASK [reproducer : Configure controller for bare metal OCP] ********************
2026-03-18 16:34:30.752249 | controller | Wednesday 18 March 2026  16:34:30 +0000 (0:00:00.022)       0:05:19.486 *******
2026-03-18 16:34:30.779157 | controller | skipping: [instance]
2026-03-18 16:34:30.779292 | controller |
2026-03-18 16:34:30.779417 | controller | TASK [reproducer : Apply VLAN ids to TAP type interfaces.] *********************
2026-03-18 16:34:30.779551 | controller | Wednesday 18 March 2026  16:34:30 +0000 (0:00:00.027)       0:05:19.513 *******
2026-03-18 16:34:30.817292 | controller | skipping: [instance]
2026-03-18 16:34:30.817454 | controller |
2026-03-18 16:34:30.817594 | controller | TASK [reproducer : Discover and expose CI Framework path on remote node] *******
2026-03-18 16:34:30.817724 | controller | Wednesday 18 March 2026  16:34:30 +0000 (0:00:00.038)       0:05:19.551 *******
2026-03-18 16:34:30.873428 | controller | ok: [instance]
2026-03-18 16:34:30.873577 | controller |
2026-03-18 16:34:30.873710 | controller | TASK [reproducer : Push local code] ********************************************
2026-03-18 16:34:30.873871 | controller | Wednesday 18 March 2026  16:34:30 +0000 (0:00:00.056)       0:05:19.608 *******
2026-03-18 16:34:30.972922 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/push_code.yml for instance
2026-03-18 16:34:30.973132 | controller |
2026-03-18 16:34:30.973286 | controller | TASK [reproducer : Check if repository directories already exist] **************
2026-03-18 16:34:30.973430 | controller | Wednesday 18 March 2026  16:34:30 +0000 (0:00:00.099)       0:05:19.707 *******
2026-03-18 16:34:31.010064 | controller | skipping: [instance]
2026-03-18 16:34:31.010228 | controller |
2026-03-18 16:34:31.010420 | controller | TASK [reproducer : Ensure we are not in the job_id branch] *********************
2026-03-18 16:34:31.010593 | controller | Wednesday 18 March 2026  16:34:31 +0000 (0:00:00.036)       0:05:19.744 *******
2026-03-18 16:34:31.048198 | controller | skipping: [instance]
2026-03-18 16:34:31.093286 | controller |
2026-03-18 16:34:31.093333 | controller | TASK [reproducer : Fetch zuul.items repositories] ******************************
2026-03-18 16:34:31.093350 | controller | Wednesday 18 March 2026  16:34:31 +0000 (0:00:00.038)       0:05:19.782 *******
2026-03-18 16:34:31.093362 | controller | skipping: [instance]
2026-03-18 16:34:31.093382 | controller |
2026-03-18 16:34:31.093470 | controller | TASK [reproducer : Fetch zuul.projects repositories for dependencies] **********
2026-03-18 16:34:31.093580 | controller | Wednesday 18 March 2026  16:34:31 +0000 (0:00:00.044)       0:05:19.827 *******
2026-03-18 16:34:31.148090 | controller | skipping: [instance]
2026-03-18 16:34:31.191005 | controller |
2026-03-18 16:34:31.191072 | controller | TASK [reproducer : Expand cifmw_reproducer_repositories to pull code from ansible controller to controller-0] ***
2026-03-18 16:34:31.191081 | controller | Wednesday 18 March 2026  16:34:31 +0000 (0:00:00.054)       0:05:19.882 *******
2026-03-18 16:34:31.191095 | controller | skipping: [instance]
2026-03-18 16:34:31.191119 | controller |
2026-03-18 16:34:31.191126 | controller | TASK [reproducer : Create target directories beforehand] ***********************
2026-03-18 16:34:31.724035 | controller | Wednesday 18 March 2026  16:34:31 +0000 (0:00:00.043)       0:05:19.925 *******
2026-03-18 16:34:31.724097 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=/home/zuul/src/github.com/openstack-k8s-operators)
2026-03-18 16:34:31.724125 | controller |
2026-03-18 16:34:31.724233 | controller | TASK [reproducer : Sync local repositories to ansible controller] **************
2026-03-18 16:34:31.724242 | controller | Wednesday 18 March 2026  16:34:31 +0000 (0:00:00.532)       0:05:20.458 *******
2026-03-18 16:34:32.424132 | controller | ok: [instance -> localhost] => (item=ci-framework)
2026-03-18 16:34:32.424200 | controller |
2026-03-18 16:34:32.424349 | controller | TASK [reproducer : Sync remote repositories] ***********************************
2026-03-18 16:34:32.469806 | controller | Wednesday 18 March 2026  16:34:32 +0000 (0:00:00.700)       0:05:21.158 *******
2026-03-18 16:34:32.469830 | controller | skipping: [instance] => (item=ci-framework)
2026-03-18 16:34:32.469919 | controller | skipping: [instance]
2026-03-18 16:34:32.470031 | controller |
2026-03-18 16:34:32.470132 | controller | TASK [reproducer : Ensure default repositories are present] ********************
2026-03-18 16:34:32.470221 | controller | Wednesday 18 March 2026  16:34:32 +0000 (0:00:00.046)       0:05:21.204 *******
2026-03-18 16:34:32.550053 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=ci-framework)
2026-03-18 16:34:32.550545 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=install_yamls)
2026-03-18 16:34:32.550610 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/default_repositories.yml for instance => (item=architecture)
2026-03-18 16:34:32.550621 | controller |
2026-03-18 16:34:32.550630 | controller | TASK [reproducer : Check repository availability: ci-framework] ****************
2026-03-18 16:34:32.550643 | controller | Wednesday 18 March 2026  16:34:32 +0000 (0:00:00.080)       0:05:21.284 *******
2026-03-18 16:34:33.092708 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:33.144326 | controller |
2026-03-18 16:34:33.144351 | controller | TASK [reproducer : Clone repository if needed: ci-framework] *******************
2026-03-18 16:34:33.144360 | controller | Wednesday 18 March 2026  16:34:33 +0000 (0:00:00.542)       0:05:21.826 *******
2026-03-18 16:34:33.144370 | controller | skipping: [instance]
2026-03-18 16:34:33.678796 | controller |
2026-03-18 16:34:33.678859 | controller | TASK [reproducer : Check repository availability: install_yamls] ***************
2026-03-18 16:34:33.678868 | controller | Wednesday 18 March 2026  16:34:33 +0000 (0:00:00.051)       0:05:21.878 *******
2026-03-18 16:34:33.678882 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:33.723332 | controller |
2026-03-18 16:34:33.723359 | controller | TASK [reproducer : Clone repository if needed: install_yamls] ******************
2026-03-18 16:34:33.723368 | controller | Wednesday 18 March 2026  16:34:33 +0000 (0:00:00.533)       0:05:22.412 *******
2026-03-18 16:34:33.723379 | controller | skipping: [instance]
2026-03-18 16:34:34.250807 | controller |
2026-03-18 16:34:34.250857 | controller | TASK [reproducer : Check repository availability: architecture] ****************
2026-03-18 16:34:34.250867 | controller | Wednesday 18 March 2026  16:34:33 +0000 (0:00:00.045)       0:05:22.457 *******
2026-03-18 16:34:34.250888 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:34.251008 | controller |
2026-03-18 16:34:34.251031 | controller | TASK [reproducer : Clone repository if needed: architecture] *******************
2026-03-18 16:34:34.251108 | controller | Wednesday 18 March 2026  16:34:34 +0000 (0:00:00.527)       0:05:22.985 *******
2026-03-18 16:34:36.930157 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:36.930229 | controller |
2026-03-18 16:34:36.930340 | controller | TASK [reproducer : Install collections on controller-0] ************************
2026-03-18 16:34:36.930454 | controller | Wednesday 18 March 2026  16:34:36 +0000 (0:00:02.679)       0:05:25.664 *******
2026-03-18 16:34:58.009047 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:58.009130 | controller |
2026-03-18 16:34:58.009142 | controller | TASK [reproducer : Inject CI Framework motd] ***********************************
2026-03-18 16:34:58.009153 | controller | Wednesday 18 March 2026  16:34:58 +0000 (0:00:21.078)       0:05:46.743 *******
2026-03-18 16:34:59.223257 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:59.223311 | controller |
2026-03-18 16:34:59.223398 | controller | TASK [reproducer : Rotate some logs] *******************************************
2026-03-18 16:34:59.223500 | controller | Wednesday 18 March 2026  16:34:59 +0000 (0:00:01.214)       0:05:47.957 *******
2026-03-18 16:34:59.336117 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/tasks/rotate_log.yml for instance => (item=/home/zuul/ansible-bootstrap.log)
2026-03-18 16:34:59.336240 | controller |
2026-03-18 16:34:59.336362 | controller | TASK [reproducer : Check /home/zuul/ansible-bootstrap.log] *********************
2026-03-18 16:34:59.336456 | controller | Wednesday 18 March 2026  16:34:59 +0000 (0:00:00.113)       0:05:48.070 *******
2026-03-18 16:34:59.874267 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:34:59.874322 | controller |
2026-03-18 16:34:59.874422 | controller | TASK [reproducer : Rotate log if present] **************************************
2026-03-18 16:34:59.874541 | controller | Wednesday 18 March 2026  16:34:59 +0000 (0:00:00.538)       0:05:48.608 *******
2026-03-18 16:34:59.922568 | controller | skipping: [instance]
2026-03-18 16:34:59.922632 | controller |
2026-03-18 16:34:59.922726 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] ***********************
2026-03-18 16:34:59.922845 | controller | Wednesday 18 March 2026  16:34:59 +0000 (0:00:00.043)       0:05:48.652 *******
2026-03-18 16:34:59.975735 | controller | skipping: [instance]
2026-03-18 16:34:59.975783 | controller |
2026-03-18 16:34:59.975892 | controller | TASK [cifmw_setup : Get customized parameters] *********************************
2026-03-18 16:34:59.976004 | controller | Wednesday 18 March 2026  16:34:59 +0000 (0:00:00.054)       0:05:48.707 *******
2026-03-18 16:35:00.086790 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:35:00.086841 | controller |
2026-03-18 16:35:00.086951 | controller | TASK [install_ca : Ensure target directory exists] *****************************
2026-03-18 16:35:00.087133 | controller | Wednesday 18 March 2026  16:35:00 +0000 (0:00:00.113)       0:05:48.821 *******
2026-03-18 16:35:00.605145 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:35:00.605207 | controller |
2026-03-18 16:35:00.605291 | controller | TASK [install_ca : Install internal CA from url] *******************************
2026-03-18 16:35:00.605397 | controller | Wednesday 18 March 2026  16:35:00 +0000 (0:00:00.518)       0:05:49.339 *******
2026-03-18 16:35:00.643639 | controller | skipping: [instance]
2026-03-18 16:35:00.643709 | controller |
2026-03-18 16:35:00.643817 | controller | TASK [install_ca : Install custom CA bundle from inline] ***********************
2026-03-18 16:35:00.643910 | controller | Wednesday 18 March 2026  16:35:00 +0000 (0:00:00.038)       0:05:49.377 *******
2026-03-18 16:35:00.693016 | controller | skipping: [instance]
2026-03-18 16:35:00.693078 | controller |
2026-03-18 16:35:00.693184 | controller | TASK [install_ca : Install custom CA bundle from file] *************************
2026-03-18 16:35:00.693282 | controller | Wednesday 18 March 2026  16:35:00 +0000 (0:00:00.049)       0:05:49.427 *******
2026-03-18 16:35:00.743505 | controller | skipping: [instance]
2026-03-18 16:35:00.743582 | controller |
2026-03-18 16:35:00.743701 | controller | TASK [install_ca : Update ca bundle] *******************************************
2026-03-18 16:35:00.743786 | controller | Wednesday 18 March 2026  16:35:00 +0000 (0:00:00.050)       0:05:49.478 *******
2026-03-18 16:35:00.805413 | controller | skipping: [instance]
2026-03-18 16:35:00.805481 | controller |
2026-03-18 16:35:00.805602 | controller | TASK [repo_setup : Ensure directories are present] *****************************
2026-03-18 16:35:00.805703 | controller | Wednesday 18 March 2026  16:35:00 +0000 (0:00:00.052)       0:05:49.531 *******
2026-03-18 16:35:02.369266 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-18 16:35:02.369316 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-18 16:35:02.369414 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-18 16:35:02.369512 | controller | changed: [instance -> controller-0]
2026-03-18 16:35:02.369612 | controller |
2026-03-18 16:35:02.369708 | controller | TASK [repo_setup : Make sure git-core package is installed] ********************
2026-03-18 16:35:02.369795 | controller | Wednesday 18 March 2026  16:35:02 +0000 (0:00:01.572)       0:05:51.103 *******
2026-03-18 16:35:03.446420 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:35:03.446665 | controller |
2026-03-18 16:35:03.446714 | controller | TASK [repo_setup : Get repo-setup repository] **********************************
2026-03-18 16:35:04.902576 | controller | Wednesday 18 March 2026  16:35:03 +0000 (0:00:01.076)       0:05:52.180 *******
2026-03-18 16:35:04.902618 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:35:12.635995 | controller |
2026-03-18 16:35:12.636041 | controller | TASK [repo_setup : Initialize python venv and install requirements] ************
2026-03-18 16:35:12.636050 | controller | Wednesday 18 March 2026  16:35:04 +0000 (0:00:01.455)       0:05:53.636 *******
2026-03-18 16:35:12.636062 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:35:13.756417 | controller |
2026-03-18 16:35:13.756459 | controller | TASK [repo_setup : Install repo-setup package] *********************************
2026-03-18 16:35:13.756468 | controller | Wednesday 18 March 2026  16:35:12 +0000 (0:00:07.730)       0:06:01.366 *******
2026-03-18 16:35:13.756480 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:35:13.803715 | controller |
2026-03-18 16:35:13.803763 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider] ***
2026-03-18 16:35:13.803771 | controller | Wednesday 18 March 2026  16:35:13 +0000 (0:00:01.124)       0:06:02.490 *******
2026-03-18 16:35:13.803784 | controller | skipping: [instance]
2026-03-18 16:35:15.011560 | controller |
2026-03-18 16:35:15.011615 | controller | TASK [repo_setup : Run repo-setup] *********************************************
2026-03-18 16:35:15.011625 | controller | Wednesday 18 March 2026  16:35:13 +0000 (0:00:00.047)       0:06:02.537 *******
2026-03-18 16:35:15.011648 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:35:15.068694 | controller |
2026-03-18 16:35:15.068729 | controller | TASK [repo_setup : Get component repo] *****************************************
2026-03-18 16:35:15.068738 | controller | Wednesday 18 March 2026  16:35:15 +0000 (0:00:01.207)       0:06:03.745 *******
2026-03-18 16:35:15.068751 | controller | skipping: [instance]
2026-03-18 16:35:15.126115 | controller |
2026-03-18 16:35:15.126172 | controller | TASK [repo_setup : Rename component repo] **************************************
2026-03-18 16:35:15.126181 | controller | Wednesday 18 March 2026  16:35:15 +0000 (0:00:00.057)       0:06:03.803 *******
2026-03-18 16:35:15.126194 | controller | skipping: [instance]
2026-03-18 16:35:15.189322 | controller |
2026-03-18 16:35:15.189352 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo] *******
2026-03-18 16:35:15.189360 | controller | Wednesday 18 March 2026  16:35:15 +0000 (0:00:00.057)       0:06:03.860 *******
2026-03-18 16:35:15.189370 | controller | skipping: [instance]
2026-03-18 16:35:16.122417 | controller |
2026-03-18 16:35:16.122459 | controller | TASK [repo_setup : Run repo-setup-get-hash] ************************************
2026-03-18 16:35:16.122468 | controller | Wednesday 18 March 2026  16:35:15 +0000 (0:00:00.062)       0:06:03.923 *******
2026-03-18 16:35:16.122479 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:35:17.184058 | controller |
2026-03-18 16:35:17.184125 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file] *******************
2026-03-18 16:35:17.184135 | controller | Wednesday 18 March 2026  16:35:16 +0000 (0:00:00.932)       0:06:04.856 *******
2026-03-18 16:35:17.184162 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:35:17.184212 | controller |
2026-03-18 16:35:17.184226 | controller | TASK [repo_setup : Dump current-podified hash] *********************************
2026-03-18 16:35:17.184326 | controller | Wednesday 18 March 2026  16:35:17 +0000 (0:00:01.061)       0:06:05.918 *******
2026-03-18 16:35:17.238447 | controller | skipping: [instance]
2026-03-18 16:35:17.238490 | controller |
2026-03-18 16:35:17.238624 | controller | TASK [repo_setup : Slurp current podified hash] ********************************
2026-03-18 16:35:17.238723 | controller | Wednesday 18 March 2026  16:35:17 +0000 (0:00:00.054)       0:06:05.972 *******
2026-03-18 16:35:17.289808 | controller | skipping: [instance]
2026-03-18 16:35:17.289883 | controller |
2026-03-18 16:35:17.289990 | controller | TASK [repo_setup : Update the value of full_hash] ******************************
2026-03-18 16:35:17.290091 | controller | Wednesday 18 March 2026  16:35:17 +0000 (0:00:00.051)       0:06:06.024 *******
2026-03-18 16:35:17.340162 | controller | skipping: [instance]
2026-03-18 16:35:17.340263 | controller |
2026-03-18 16:35:17.340363 | controller | TASK [repo_setup : Export hashes facts for further use] ************************
2026-03-18 16:35:17.340439 | controller | Wednesday 18 March 2026  16:35:17 +0000 (0:00:00.050)       0:06:06.074 *******
2026-03-18 16:35:17.403831 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:35:17.403910 | controller |
2026-03-18 16:35:17.404038 | controller | TASK [repo_setup : Create download directory] **********************************
2026-03-18 16:35:17.404149 | controller | Wednesday 18 March 2026  16:35:17 +0000 (0:00:00.063)       0:06:06.138 *******
2026-03-18 16:35:17.448902 | controller | skipping: [instance]
2026-03-18 16:35:17.448977 | controller |
2026-03-18 16:35:17.449098 | controller | TASK [repo_setup : Print the URL to request] ***********************************
2026-03-18 16:35:17.449200 | controller | Wednesday 18 March 2026  16:35:17 +0000 (0:00:00.045)       0:06:06.183 *******
2026-03-18 16:35:17.493909 | controller | skipping: [instance]
2026-03-18 16:35:17.494017 | controller |
2026-03-18 16:35:17.494120 | controller | TASK [Download the RPM] ********************************************************
2026-03-18 16:35:17.494228 | controller | Wednesday 18 March 2026  16:35:17 +0000 (0:00:00.044)       0:06:06.228 *******
2026-03-18 16:35:17.542098 | controller | skipping: [instance]
2026-03-18 16:35:17.542172 | controller |
2026-03-18 16:35:17.542263 | controller | TASK [repo_setup : Install RHOS Release tool] **********************************
2026-03-18 16:35:17.542348 | controller | Wednesday 18 March 2026  16:35:17 +0000 (0:00:00.048)       0:06:06.276 *******
2026-03-18 16:35:17.593959 | controller | skipping: [instance]
2026-03-18 16:35:17.594069 | controller |
2026-03-18 16:35:17.594174 | controller | TASK [repo_setup : Get rhos-release tool version] ******************************
2026-03-18 16:35:17.594265 | controller | Wednesday 18 March 2026  16:35:17 +0000 (0:00:00.050)       0:06:06.327 *******
2026-03-18 16:35:17.640849 | controller | skipping: [instance]
2026-03-18 16:35:17.640923 | controller |
2026-03-18 16:35:17.641047 | controller | TASK [repo_setup : Print rhos-release tool version] ****************************
2026-03-18 16:35:17.641060 | controller | Wednesday 18 March 2026  16:35:17 +0000 (0:00:00.047)       0:06:06.375 *******
2026-03-18 16:35:17.688906 | controller | skipping: [instance]
2026-03-18 16:35:17.688977 | controller |
2026-03-18 16:35:17.689087 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }}] ***
2026-03-18 16:35:17.689182 | controller | Wednesday 18 March 2026  16:35:17 +0000 (0:00:00.048)       0:06:06.423 *******
2026-03-18 16:35:17.734971 | controller | skipping: [instance]
2026-03-18 16:35:17.735033 | controller |
2026-03-18 16:35:17.735150 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh] ***************************
2026-03-18 16:35:17.735230 | controller | Wednesday 18 March 2026  16:35:17 +0000 (0:00:00.045)       0:06:06.469 *******
2026-03-18 16:35:18.280231 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:35:18.280308 | controller |
2026-03-18 16:35:18.280475 | controller | TASK [repo_setup : Use RDO proxy mirrors] **************************************
2026-03-18 16:35:18.340722 | controller | Wednesday 18 March 2026  16:35:18 +0000 (0:00:00.544)       0:06:07.014 *******
2026-03-18 16:35:18.340771 | controller | skipping: [instance]
2026-03-18 16:35:18.340793 | controller |
2026-03-18 16:35:18.340882 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist)] ***
2026-03-18 16:35:18.340997 | controller | Wednesday 18 March 2026  16:35:18 +0000 (0:00:00.061)       0:06:07.075 *******
2026-03-18 16:35:18.404265 | controller | skipping: [instance]
2026-03-18 16:35:18.404349 | controller |
2026-03-18 16:35:18.404458 | controller | TASK [repo_setup : Check for gating.repo file on content provider] *************
2026-03-18 16:35:18.404572 | controller | Wednesday 18 March 2026  16:35:18 +0000 (0:00:00.063)       0:06:07.138 *******
2026-03-18 16:35:18.455313 | controller | skipping: [instance]
2026-03-18 16:35:18.455531 | controller |
2026-03-18 16:35:18.455673 | controller | TASK [repo_setup : Populate gating repo from content provider ip] **************
2026-03-18 16:35:18.455689 | controller | Wednesday 18 March 2026  16:35:18 +0000 (0:00:00.050)       0:06:07.189 *******
2026-03-18 16:35:18.513668 | controller | skipping: [instance]
2026-03-18 16:35:18.513757 | controller |
2026-03-18 16:35:18.513846 | controller | TASK [repo_setup : Check for DLRN repo at the destination] *********************
2026-03-18 16:35:18.513967 | controller | Wednesday 18 March 2026  16:35:18 +0000 (0:00:00.058)       0:06:07.248 *******
2026-03-18 16:35:18.572072 | controller | skipping: [instance]
2026-03-18 16:35:18.572166 | controller |
2026-03-18 16:35:18.572276 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo] ***
2026-03-18 16:35:18.572384 | controller | Wednesday 18 March 2026  16:35:18 +0000 (0:00:00.058)       0:06:07.306 *******
2026-03-18 16:35:18.627011 | controller | skipping: [instance]
2026-03-18 16:35:18.627175 | controller |
2026-03-18 16:35:18.627308 | controller | TASK [repo_setup : Check for DLRN component repo] ******************************
2026-03-18 16:35:18.627322 | controller | Wednesday 18 March 2026  16:35:18 +0000 (0:00:00.054)       0:06:07.361 *******
2026-03-18 16:35:18.686517 | controller | skipping: [instance]
2026-03-18 16:35:18.686568 | controller |
2026-03-18 16:35:18.686674 | controller | TASK [repo_setup : Lower the priority of component repos to allow installation from gating repo] ***
2026-03-18 16:35:18.686755 | controller | Wednesday 18 March 2026  16:35:18 +0000 (0:00:00.059)       0:06:07.421 *******
2026-03-18 16:35:18.742876 | controller | skipping: [instance]
2026-03-18 16:35:18.742979 | controller |
2026-03-18 16:35:18.743081 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory] ********
2026-03-18 16:35:18.743181 | controller | Wednesday 18 March 2026  16:35:18 +0000 (0:00:00.056)       0:06:07.477 *******
2026-03-18 16:35:19.489486 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:35:19.489553 | controller |
2026-03-18 16:35:19.489604 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory] ******
2026-03-18 16:35:19.489716 | controller | Wednesday 18 March 2026  16:35:19 +0000 (0:00:00.745)       0:06:08.223 *******
2026-03-18 16:35:20.617420 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-18 16:35:20.617528 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-18 16:35:20.617632 | controller | changed: [instance -> controller-0]
2026-03-18 16:35:20.617647 | controller |
2026-03-18 16:35:20.617667 | controller | TASK [repo_setup : Cleanup existing metadata] **********************************
2026-03-18 16:35:20.617747 | controller | Wednesday 18 March 2026  16:35:20 +0000 (0:00:01.127)       0:06:09.351 *******
2026-03-18 16:35:21.431061 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:35:21.431135 | controller |
2026-03-18 16:35:21.431236 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory] *********
2026-03-18 16:35:21.431346 | controller | Wednesday 18 March 2026  16:35:21 +0000 (0:00:00.813)       0:06:10.165 *******
2026-03-18 16:35:22.005856 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:35:22.006126 | controller |
2026-03-18 16:35:22.006218 | controller | TASK [ci_setup : Gather variables for each operating system] *******************
2026-03-18 16:35:22.006237 | controller | Wednesday 18 March 2026  16:35:22 +0000 (0:00:00.574)       0:06:10.740 *******
2026-03-18 16:35:22.074095 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-18 16:35:22.074147 | controller | ok: [instance -> controller-0]
2026-03-18 16:35:22.074411 | controller |
2026-03-18 16:35:22.122642 | controller | TASK [ci_setup : List packages to install] *************************************
2026-03-18 16:35:22.122687 | controller | Wednesday 18 March 2026  16:35:22 +0000 (0:00:00.068)       0:06:10.808 *******
2026-03-18 16:35:22.122701 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:35:56.434662 | controller |
2026-03-18 16:35:56.434712 | controller | TASK [ci_setup : Install needed packages] **************************************
2026-03-18 16:35:56.434721 | controller | Wednesday 18 March 2026  16:35:22 +0000 (0:00:00.048)       0:06:10.857 *******
2026-03-18 16:35:56.434746 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:35:56.964659 | controller |
2026-03-18 16:35:56.964714 | controller | TASK [ci_setup : Gather version of openshift client] ***************************
2026-03-18 16:35:56.964737 | controller | Wednesday 18 March 2026  16:35:56 +0000 (0:00:34.311)       0:06:45.168 *******
2026-03-18 16:35:56.964750 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:35:57.498504 | controller |
2026-03-18 16:35:57.498561 | controller | TASK [ci_setup : Ensure openshift client install path is present] **************
2026-03-18 16:35:57.498576 | controller | Wednesday 18 March 2026  16:35:56 +0000 (0:00:00.529)       0:06:45.698 *******
2026-03-18 16:35:57.498606 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:02.405188 | controller |
2026-03-18 16:36:02.405251 | controller | TASK [ci_setup : Install openshift client] *************************************
2026-03-18 16:36:02.405261 | controller | Wednesday 18 March 2026  16:35:57 +0000 (0:00:00.533)       0:06:46.232 *******
2026-03-18 16:36:02.405273 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:02.454860 | controller |
2026-03-18 16:36:02.454912 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed] **********************
2026-03-18 16:36:02.454921 | controller | Wednesday 18 March 2026  16:36:02 +0000 (0:00:04.904)       0:06:51.136 *******
2026-03-18 16:36:02.454959 | controller | skipping: [instance]
2026-03-18 16:36:02.455011 | controller |
2026-03-18 16:36:02.455021 | controller | TASK [ci_setup : Create completion file] ***************************************
2026-03-18 16:36:03.144650 | controller | Wednesday 18 March 2026  16:36:02 +0000 (0:00:00.052)       0:06:51.189 *******
2026-03-18 16:36:03.144700 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:03.144731 | controller |
2026-03-18 16:36:03.144964 | controller | TASK [ci_setup : Source completion from within .bashrc] ************************
2026-03-18 16:36:03.694278 | controller | Wednesday 18 March 2026  16:36:03 +0000 (0:00:00.689)       0:06:51.878 *******
2026-03-18 16:36:03.694340 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:03.747137 | controller |
2026-03-18 16:36:03.747194 | controller | TASK [ci_setup : Check rhsm status] ********************************************
2026-03-18 16:36:03.747205 | controller | Wednesday 18 March 2026  16:36:03 +0000 (0:00:00.549)       0:06:52.428 *******
2026-03-18 16:36:03.747218 | controller | skipping: [instance]
2026-03-18 16:36:03.747226 | controller |
2026-03-18 16:36:03.747235 | controller | TASK [ci_setup : Gather the repos to be enabled] *******************************
2026-03-18 16:36:03.792850 | controller | Wednesday 18 March 2026  16:36:03 +0000 (0:00:00.053)       0:06:52.481 *******
2026-03-18 16:36:03.792901 | controller | skipping: [instance]
2026-03-18 16:36:03.792924 | controller |
2026-03-18 16:36:03.792960 | controller | TASK [ci_setup : Enabling the required repositories.] **************************
2026-03-18 16:36:03.838993 | controller | Wednesday 18 March 2026  16:36:03 +0000 (0:00:00.045)       0:06:52.527 *******
2026-03-18 16:36:03.839016 | controller | skipping: [instance]
2026-03-18 16:36:03.839056 | controller |
2026-03-18 16:36:03.839158 | controller | TASK [ci_setup : Get current /etc/redhat-release] ******************************
2026-03-18 16:36:03.839255 | controller | Wednesday 18 March 2026  16:36:03 +0000 (0:00:00.046)       0:06:52.573 *******
2026-03-18 16:36:03.893226 | controller | skipping: [instance]
2026-03-18 16:36:03.893305 | controller |
2026-03-18 16:36:03.893548 | controller | TASK [ci_setup : Print current /etc/redhat-release] ****************************
2026-03-18 16:36:03.941999 | controller | Wednesday 18 March 2026  16:36:03 +0000 (0:00:00.053)       0:06:52.627 *******
2026-03-18 16:36:03.942049 | controller | skipping: [instance]
2026-03-18 16:36:03.942081 | controller |
2026-03-18 16:36:03.942193 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum] *********
2026-03-18 16:36:03.942316 | controller | Wednesday 18 March 2026  16:36:03 +0000 (0:00:00.048)       0:06:52.676 *******
2026-03-18 16:36:03.993704 | controller | skipping: [instance]
2026-03-18 16:36:03.993779 | controller |
2026-03-18 16:36:03.993789 | controller | TASK [ci_setup : Manage directories] *******************************************
2026-03-18 16:36:03.993799 | controller | Wednesday 18 March 2026  16:36:03 +0000 (0:00:00.051)       0:06:52.727 *******
2026-03-18 16:36:06.906368 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-18 16:36:06.906623 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-18 16:36:06.906753 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-18 16:36:06.906772 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-18 16:36:06.906784 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-18 16:36:06.906793 | controller | changed: [instance -> controller-0]
2026-03-18 16:36:06.906890 | controller |
2026-03-18 16:36:06.906967 | controller | TASK [Prepare install_yamls make targets] **************************************
2026-03-18 16:36:06.907076 | controller | Wednesday 18 March 2026  16:36:06 +0000 (0:00:02.912)       0:06:55.640 *******
2026-03-18 16:36:07.089445 | controller |
2026-03-18 16:36:07.089591 | controller | TASK [install_yamls : Ensure directories exist] ********************************
2026-03-18 16:36:07.089731 | controller | Wednesday 18 March 2026  16:36:07 +0000 (0:00:00.183)       0:06:55.824 *******
2026-03-18 16:36:08.787615 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-18 16:36:08.788194 | controller | changed: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-18 16:36:08.860979 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-18 16:36:08.861016 | controller | changed: [instance -> controller-0]
2026-03-18 16:36:08.861025 | controller |
2026-03-18 16:36:08.861032 | controller | TASK [Create variables with local repos based on Zuul items] *******************
2026-03-18 16:36:08.861039 | controller | Wednesday 18 March 2026  16:36:08 +0000 (0:00:01.697)       0:06:57.521 *******
2026-03-18 16:36:08.861063 | controller |
2026-03-18 16:36:08.913505 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items] ***********
2026-03-18 16:36:08.913550 | controller | Wednesday 18 March 2026  16:36:08 +0000 (0:00:00.073)       0:06:57.595 *******
2026-03-18 16:36:08.913564 | controller | skipping: [instance]
2026-03-18 16:36:08.914068 | controller |
2026-03-18 16:36:08.914426 | controller | TASK [install_yamls : Print helpful data for debugging] ************************
2026-03-18 16:36:08.969495 | controller | Wednesday 18 March 2026  16:36:08 +0000 (0:00:00.052)       0:06:57.648 *******
2026-03-18 16:36:08.969540 | controller | skipping: [instance]
2026-03-18 16:36:09.046699 | controller |
2026-03-18 16:36:09.046721 | controller | TASK [Customize install_yamls devsetup vars if needed] *************************
2026-03-18 16:36:09.046729 | controller | Wednesday 18 March 2026  16:36:08 +0000 (0:00:00.055)       0:06:57.703 *******
2026-03-18 16:36:09.046739 | controller |
2026-03-18 16:36:09.046771 | controller | TASK [install_yamls : Update opm_version in install_yamls devsetup/vars/default.yaml] ***
2026-03-18 16:36:09.046899 | controller | Wednesday 18 March 2026  16:36:09 +0000 (0:00:00.077)       0:06:57.781 *******
2026-03-18 16:36:09.100398 | controller | skipping: [instance]
2026-03-18 16:36:09.149413 | controller |
2026-03-18 16:36:09.149439 | controller | TASK [install_yamls : Update sdk_version in install_yamls devsetup/vars/default.yaml] ***
2026-03-18 16:36:09.149447 | controller | Wednesday 18 March 2026  16:36:09 +0000 (0:00:00.053)       0:06:57.834 *******
2026-03-18 16:36:09.149459 | controller | skipping: [instance]
2026-03-18 16:36:09.197217 | controller |
2026-03-18 16:36:09.197242 | controller | TASK [install_yamls : Update go_version in install_yamls devsetup/vars/default.yaml] ***
2026-03-18 16:36:09.197250 | controller | Wednesday 18 March 2026  16:36:09 +0000 (0:00:00.049)       0:06:57.883 *******
2026-03-18 16:36:09.197260 | controller | skipping: [instance]
2026-03-18 16:36:09.197312 | controller |
2026-03-18 16:36:09.197322 | controller | TASK [install_yamls : Update kustomize_version in install_yamls devsetup/vars/default.yaml] ***
2026-03-18 16:36:09.197332 | controller | Wednesday 18 March 2026  16:36:09 +0000 (0:00:00.047)       0:06:57.931 *******
2026-03-18 16:36:09.256820 | controller | skipping: [instance]
2026-03-18 16:36:09.256888 | controller |
2026-03-18 16:36:09.257007 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value] ********
2026-03-18 16:36:09.257089 | controller | Wednesday 18 March 2026  16:36:09 +0000 (0:00:00.059)       0:06:57.991 *******
2026-03-18 16:36:09.367419 | controller | ok: [instance -> controller-0(controller-0.instance)] => (item=None)
2026-03-18 16:36:09.367526 | controller | ok: [instance -> controller-0]
2026-03-18 16:36:09.367649 | controller |
2026-03-18 16:36:09.367791 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact] ***
2026-03-18 16:36:09.367913 | controller | Wednesday 18 March 2026  16:36:09 +0000 (0:00:00.110)       0:06:58.102 *******
2026-03-18 16:36:09.438486 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:09.438561 | controller |
2026-03-18 16:36:09.438663 | controller | TASK [install_yamls : Get environment structure] *******************************
2026-03-18 16:36:09.438765 | controller | Wednesday 18 March 2026  16:36:09 +0000 (0:00:00.071)       0:06:58.173 *******
2026-03-18 16:36:10.565558 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:10.565630 | controller |
2026-03-18 16:36:10.565714 | controller | TASK [install_yamls : Ensure Output directory exists] **************************
2026-03-18 16:36:10.565807 | controller | Wednesday 18 March 2026  16:36:10 +0000 (0:00:01.126)       0:06:59.299 *******
2026-03-18 16:36:10.612282 | controller | skipping: [instance]
2026-03-18 16:36:10.612338 | controller |
2026-03-18 16:36:10.612452 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables] ***
2026-03-18 16:36:10.612536 | controller | Wednesday 18 March 2026  16:36:10 +0000 (0:00:00.047)       0:06:59.346 *******
2026-03-18 16:36:10.667493 | controller | skipping: [instance]
2026-03-18 16:36:10.667585 | controller |
2026-03-18 16:36:10.667666 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh] ***
2026-03-18 16:36:10.667767 | controller | Wednesday 18 March 2026  16:36:10 +0000 (0:00:00.055)       0:06:59.402 *******
2026-03-18 16:36:10.718188 | controller | skipping: [instance]
2026-03-18 16:36:10.718270 | controller |
2026-03-18 16:36:10.718369 | controller | TASK [install_yamls : Set install_yamls default values] ************************
2026-03-18 16:36:10.718495 | controller | Wednesday 18 March 2026  16:36:10 +0000 (0:00:00.050)       0:06:59.452 *******
2026-03-18 16:36:10.785514 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:10.785583 | controller |
2026-03-18 16:36:10.785618 | controller | TASK [install_yamls : Show the env structure] **********************************
2026-03-18 16:36:10.785709 | controller | Wednesday 18 March 2026  16:36:10 +0000 (0:00:00.067)       0:06:59.520 *******
2026-03-18 16:36:10.843205 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:10.843302 | controller |
2026-03-18 16:36:10.843521 | controller | TASK [install_yamls : Show the env structure defaults] *************************
2026-03-18 16:36:10.915335 | controller | Wednesday 18 March 2026  16:36:10 +0000 (0:00:00.057)       0:06:59.578 *******
2026-03-18 16:36:10.915365 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:10.915434 | controller |
2026-03-18 16:36:10.915521 | controller | TASK [install_yamls : Generate make targets] ***********************************
2026-03-18 16:36:10.915639 | controller | Wednesday 18 March 2026  16:36:10 +0000 (0:00:00.071)       0:06:59.649 *******
2026-03-18 16:36:11.681135 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:11.681204 | controller |
2026-03-18 16:36:11.681460 | controller | TASK [install_yamls : Debug generate_make module] ******************************
2026-03-18 16:36:11.739427 | controller | Wednesday 18 March 2026  16:36:11 +0000 (0:00:00.765)       0:07:00.415 *******
2026-03-18 16:36:11.739458 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:11.739502 | controller |
2026-03-18 16:36:11.739620 | controller | TASK [install_yamls : Create the install_yamls parameters file] ****************
2026-03-18 16:36:11.739684 | controller | Wednesday 18 March 2026  16:36:11 +0000 (0:00:00.058)       0:07:00.474 *******
2026-03-18 16:36:12.884193 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:12.884260 | controller |
2026-03-18 16:36:12.884286 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed] ***
2026-03-18 16:36:12.884402 | controller | Wednesday 18 March 2026  16:36:12 +0000 (0:00:01.144)       0:07:01.618 *******
2026-03-18 16:36:12.940203 | controller | skipping: [instance]
2026-03-18 16:36:12.940319 | controller |
2026-03-18 16:36:12.940464 | controller | TASK [discover_latest_image : Set the discovered images dict to empty] *********
2026-03-18 16:36:12.940590 | controller | Wednesday 18 March 2026  16:36:12 +0000 (0:00:00.056)       0:07:01.674 *******
2026-03-18 16:36:12.999892 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:13.000075 | controller |
2026-03-18 16:36:13.000177 | controller | TASK [discover_latest_image : Discover images] *********************************
2026-03-18 16:36:13.000275 | controller | Wednesday 18 March 2026  16:36:12 +0000 (0:00:00.058)       0:07:01.733 *******
2026-03-18 16:36:13.063216 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/discover_latest_image/tasks/per-image.yml for instance => (item=(censored due to no_log))
2026-03-18 16:36:13.063323 | controller |
2026-03-18 16:36:13.063462 | controller | TASK [discover_latest_image : Ensure the current image dict entry has the expected data] ***
2026-03-18 16:36:13.063562 | controller | Wednesday 18 March 2026  16:36:13 +0000 (0:00:00.064)       0:07:01.797 *******
2026-03-18 16:36:13.123459 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:13.123546 | controller |
2026-03-18 16:36:13.123640 | controller | TASK [discover_latest_image : Get latest image for the current entry] **********
2026-03-18 16:36:13.123734 | controller | Wednesday 18 March 2026  16:36:13 +0000 (0:00:00.059)       0:07:01.857 *******
2026-03-18 16:36:14.031085 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:14.031385 | controller |
2026-03-18 16:36:14.092071 | controller | TASK [discover_latest_image : Append the current return value to the discovered images dict] ***
2026-03-18 16:36:14.092123 | controller | Wednesday 18 March 2026  16:36:14 +0000 (0:00:00.908)       0:07:02.765 *******
2026-03-18 16:36:14.092138 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:14.160818 | controller |
2026-03-18 16:36:14.160870 | controller | TASK [discover_latest_image : Export single-image facts if an image with name 'default' was discovered] ***
2026-03-18 16:36:14.160880 | controller | Wednesday 18 March 2026  16:36:14 +0000 (0:00:00.061)       0:07:02.826 *******
2026-03-18 16:36:14.160894 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:14.160912 | controller |
2026-03-18 16:36:14.160918 | controller | TASK [cifmw_setup : Create artifacts with custom params] ***********************
2026-03-18 16:36:14.160941 | controller | Wednesday 18 March 2026  16:36:14 +0000 (0:00:00.068)       0:07:02.895 *******
2026-03-18 16:36:15.297424 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:15.297550 | controller |
2026-03-18 16:36:15.297616 | controller | TASK [reproducer : Install dev tools from install_yamls on controller-0] *******
2026-03-18 16:36:15.866829 | controller | Wednesday 18 March 2026  16:36:15 +0000 (0:00:01.136)       0:07:04.031 *******
2026-03-18 16:36:15.866919 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:15.867074 | controller |
2026-03-18 16:36:15.867135 | controller | TASK [Configure CRC network if needed] *****************************************
2026-03-18 16:36:16.039657 | controller | Wednesday 18 March 2026  16:36:15 +0000 (0:00:00.569)       0:07:04.600 *******
2026-03-18 16:36:16.039697 | controller |
2026-03-18 16:36:17.269861 | controller | TASK [openshift_setup : Gather network.operator info] **************************
2026-03-18 16:36:17.269916 | controller | Wednesday 18 March 2026  16:36:16 +0000 (0:00:00.172)       0:07:04.773 *******
2026-03-18 16:36:17.269950 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:17.269988 | controller |
2026-03-18 16:36:17.270017 | controller | TASK [openshift_setup : Patch network operator] ********************************
2026-03-18 16:36:17.270134 | controller | Wednesday 18 March 2026  16:36:17 +0000 (0:00:01.230)       0:07:06.003 *******
2026-03-18 16:36:18.531449 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:18.572473 | controller |
2026-03-18 16:36:18.572510 | controller | TASK [Ensure OCP cluster is stable] ********************************************
2026-03-18 16:36:18.572520 | controller | Wednesday 18 March 2026  16:36:18 +0000 (0:00:01.261)       0:07:07.265 *******
2026-03-18 16:36:18.572533 | controller | skipping: [instance]
2026-03-18 16:36:18.620788 | controller |
2026-03-18 16:36:18.620826 | controller | TASK [reproducer : Emulate CI job] *********************************************
2026-03-18 16:36:18.620835 | controller | Wednesday 18 March 2026  16:36:18 +0000 (0:00:00.041)       0:07:07.306 *******
2026-03-18 16:36:18.620855 | controller | skipping: [instance]
2026-03-18 16:36:18.620873 | controller |
2026-03-18 16:36:18.620974 | controller | TASK [reproducer : Prepare architecture-based deployment] **********************
2026-03-18 16:36:18.621074 | controller | Wednesday 18 March 2026  16:36:18 +0000 (0:00:00.048)       0:07:07.355 *******
2026-03-18 16:36:18.666308 | controller | skipping: [instance]
2026-03-18 16:36:18.709100 | controller |
2026-03-18 16:36:18.709162 | controller | TASK [reproducer : Prepare architecture-based post deployment] *****************
2026-03-18 16:36:18.709183 | controller | Wednesday 18 March 2026  16:36:18 +0000 (0:00:00.045)       0:07:07.400 *******
2026-03-18 16:36:18.709199 | controller | skipping: [instance]
2026-03-18 16:36:19.795580 | controller |
2026-03-18 16:36:19.795656 | controller | TASK [reproducer : Prepare ci-like EDPM deploy] ********************************
2026-03-18 16:36:19.795665 | controller | Wednesday 18 March 2026  16:36:18 +0000 (0:00:00.042)       0:07:07.443 *******
2026-03-18 16:36:19.795679 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:20.348613 | controller |
2026-03-18 16:36:20.348680 | controller | TASK [Ensure we have appropriate credentials for OpenShift accesses] ***********
2026-03-18 16:36:20.348689 | controller | Wednesday 18 March 2026  16:36:19 +0000 (0:00:01.085)       0:07:08.529 *******
2026-03-18 16:36:20.348703 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:20.858104 | controller |
2026-03-18 16:36:20.858166 | controller | TASK [Ensure we have needed inventory files] ***********************************
2026-03-18 16:36:20.858175 | controller | Wednesday 18 March 2026  16:36:20 +0000 (0:00:00.553)       0:07:09.082 *******
2026-03-18 16:36:20.858190 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:21.410467 | controller |
2026-03-18 16:36:21.410517 | controller | TASK [Ensure we have CRC ssh key] **********************************************
2026-03-18 16:36:21.410525 | controller | Wednesday 18 March 2026  16:36:20 +0000 (0:00:00.509)       0:07:09.591 *******
2026-03-18 16:36:21.410538 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:21.968834 | controller |
2026-03-18 16:36:21.968887 | controller | TASK [Ensure we have the MAC mapping file] *************************************
2026-03-18 16:36:21.968897 | controller | Wednesday 18 March 2026  16:36:21 +0000 (0:00:00.552)       0:07:10.144 *******
2026-03-18 16:36:21.968909 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:21.968943 | controller |
2026-03-18 16:36:21.968957 | controller | TASK [Load crc inventory] ******************************************************
2026-03-18 16:36:22.462874 | controller | Wednesday 18 March 2026  16:36:21 +0000 (0:00:00.558)       0:07:10.702 *******
2026-03-18 16:36:22.462987 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:22.984595 | controller |
2026-03-18 16:36:22.984719 | controller | TASK [Load compute inventory] **************************************************
2026-03-18 16:36:22.984728 | controller | Wednesday 18 March 2026  16:36:22 +0000 (0:00:00.494)       0:07:11.197 *******
2026-03-18 16:36:22.984753 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:23.542290 | controller |
2026-03-18 16:36:23.542420 | controller | TASK [Ensure we can ping compute-0 on osp_trunk net] ***************************
2026-03-18 16:36:23.542430 | controller | Wednesday 18 March 2026  16:36:22 +0000 (0:00:00.521)       0:07:11.718 *******
2026-03-18 16:36:23.542456 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:24.062196 | controller |
2026-03-18 16:36:24.062244 | controller | TASK [Ensure we can ping crc-0 on osp_trunk net] *******************************
2026-03-18 16:36:24.062253 | controller | Wednesday 18 March 2026  16:36:23 +0000 (0:00:00.555)       0:07:12.275 *******
2026-03-18 16:36:24.062264 | controller | changed: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:24.649079 | controller |
2026-03-18 16:36:24.649135 | controller | TASK [Check default location secret file] **************************************
2026-03-18 16:36:24.649144 | controller | Wednesday 18 March 2026  16:36:24 +0000 (0:00:00.521)       0:07:12.796 *******
2026-03-18 16:36:24.649156 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:25.190310 | controller |
2026-03-18 16:36:25.190356 | controller | TASK [Check non-default location secret] ***************************************
2026-03-18 16:36:25.190364 | controller | Wednesday 18 March 2026  16:36:24 +0000 (0:00:00.586)       0:07:13.382 *******
2026-03-18 16:36:25.190375 | controller | ok: [instance -> controller-0(controller-0.instance)]
2026-03-18 16:36:25.230494 | controller |
2026-03-18 16:36:25.230525 | controller | TASK [Assert all of the tests] *************************************************
2026-03-18 16:36:25.230532 | controller | Wednesday 18 March 2026  16:36:25 +0000 (0:00:00.540)       0:07:13.923 *******
2026-03-18 16:36:25.230556 | controller | ok: [instance]
2026-03-18 16:36:25.477197 | controller |
2026-03-18 16:36:25.477254 | controller | TASK [Create dnsmasq dir] ******************************************************
2026-03-18 16:36:25.477270 | controller | Wednesday 18 March 2026  16:36:25 +0000 (0:00:00.041)       0:07:13.965 *******
2026-03-18 16:36:25.477284 | controller | changed: [instance]
2026-03-18 16:36:25.477501 | controller |
2026-03-18 16:36:25.477611 | controller | TASK [Get journalctl in a file] ************************************************
2026-03-18 16:36:25.477640 | controller | Wednesday 18 March 2026  16:36:25 +0000 (0:00:00.246)       0:07:14.211 *******
2026-03-18 16:36:25.772521 | controller | changed: [instance]
2026-03-18 16:36:26.178499 | controller |
2026-03-18 16:36:26.178561 | controller | TASK [Dump journalctl output] **************************************************
2026-03-18 16:36:26.178570 | controller | Wednesday 18 March 2026  16:36:25 +0000 (0:00:00.295)       0:07:14.506 *******
2026-03-18 16:36:26.178583 | controller | changed: [instance]
2026-03-18 16:36:26.800293 | controller |
2026-03-18 16:36:26.800340 | controller | TASK [Copy all dnsmasq config] *************************************************
2026-03-18 16:36:26.800349 | controller | Wednesday 18 March 2026  16:36:26 +0000 (0:00:00.406)       0:07:14.912 *******
2026-03-18 16:36:26.800361 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.conf)
2026-03-18 16:36:27.029621 | controller | changed: [instance] => (item=/etc/cifmw-dnsmasq.d/)
2026-03-18 16:36:27.029666 | controller |
2026-03-18 16:36:27.029674 | controller | TASK [Create log directory] ****************************************************
2026-03-18 16:36:27.029680 | controller | Wednesday 18 March 2026  16:36:26 +0000 (0:00:00.621)       0:07:15.534 *******
2026-03-18 16:36:27.029691 | controller | changed: [instance]
2026-03-18 16:36:27.960046 | controller |
2026-03-18 16:36:27.960092 | controller | TASK [Sync logs from controller-0] *********************************************
2026-03-18 16:36:27.960101 | controller | Wednesday 18 March 2026  16:36:27 +0000 (0:00:00.229)       0:07:15.763 *******
2026-03-18 16:36:27.960112 | controller | changed: [instance]
2026-03-18 16:36:27.961034 | controller |
2026-03-18 16:36:27.961053 | controller | PLAY RECAP *********************************************************************
2026-03-18 16:36:27.961060 | controller | instance                   : ok=563  changed=212  unreachable=0    failed=0    skipped=254  rescued=0    ignored=0
2026-03-18 16:36:27.961067 | controller |
2026-03-18 16:36:27.961072 | controller | Wednesday 18 March 2026  16:36:27 +0000 (0:00:00.926)       0:07:16.690 *******
2026-03-18 16:36:27.961078 | controller | ===============================================================================
2026-03-18 16:36:27.961083 | controller | reproducer : Check package install status ------------------------------ 39.54s
2026-03-18 16:36:27.961089 | controller | ci_setup : Install needed packages ------------------------------------- 34.31s
2026-03-18 16:36:27.961094 | controller | libvirt_manager : Download base image ---------------------------------- 30.20s
2026-03-18 16:36:27.961099 | controller | libvirt_manager : Ensure we get SSH on nodes --------------------------- 23.02s
2026-03-18 16:36:27.961105 | controller | reproducer : Install collections on controller-0 ----------------------- 21.08s
2026-03-18 16:36:27.961110 | controller | libvirt_manager : Install packages required for using KVM -------------- 12.68s
2026-03-18 16:36:27.961116 | controller | sushy_emulator : Pull Sushy Emulator container image ------------------- 10.50s
2026-03-18 16:36:27.961121 | controller | sushy_emulator : Verify connection to baremetal VMs via Sushy Emulator --- 8.18s
2026-03-18 16:36:27.961127 | controller | repo_setup : Initialize python venv and install requirements ------------ 7.73s
2026-03-18 16:36:27.961132 | controller | reproducer : Ensure we have all dependencies installed ------------------ 6.11s
2026-03-18 16:36:27.961140 | controller | ci_nmstate : Install required packages on localhost --------------------- 5.15s
2026-03-18 16:36:28.105310 | controller | ci_setup : Install openshift client ------------------------------------- 4.90s
2026-03-18 16:36:28.105351 | controller | networking_mapper : Gather the facts ------------------------------------ 3.68s
2026-03-18 16:36:28.105359 | controller | dnsmasq : Ensure SELinux knows about the new files and directories ------ 3.57s
2026-03-18 16:36:28.105364 | controller | sushy_emulator : Install required packages ------------------------------ 3.11s
2026-03-18 16:36:28.105373 | controller | dnsmasq : Add/Remove address -------------------------------------------- 3.02s
2026-03-18 16:36:28.105378 | controller | ci_setup : Manage directories ------------------------------------------- 2.91s
2026-03-18 16:36:28.105383 | controller | reproducer : Clone repository if needed: architecture ------------------- 2.68s
2026-03-18 16:36:28.105388 | controller | libvirt_manager : Start VMs for type {{ vm_type }} ---------------------- 2.07s
2026-03-18 16:36:28.105401 | controller | dnsmasq : Add DHCP entries ---------------------------------------------- 2.05s
2026-03-18 16:36:28.105412 | controller | INFO     Running crc_layout > cleanup
2026-03-18 16:36:28.105904 | controller | WARNING  Skipping, cleanup playbook not configured.
2026-03-18 16:36:28.112872 | controller | INFO     Running job_uri > prepare
2026-03-18 16:36:28.113296 | controller | WARNING  Skipping, prepare playbook not configured.
2026-03-18 16:36:28.120069 | controller | INFO     Running job_uri > converge
2026-03-18 16:36:28.613500 | controller |
2026-03-18 16:36:28.709343 | controller | PLAY [Prepare] *****************************************************************
2026-03-18 16:36:28.709386 | controller |
2026-03-18 16:36:28.709393 | controller | TASK [Call task file in loop] **************************************************
2026-03-18 16:36:28.709399 | controller | Wednesday 18 March 2026  16:36:28 +0000 (0:00:00.036)       0:00:00.036 *******
2026-03-18 16:36:28.709422 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////'})
2026-03-18 16:36:28.766427 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'})
2026-03-18 16:36:28.766457 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7'})
2026-03-18 16:36:28.766464 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35'})
2026-03-18 16:36:28.766470 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'})
2026-03-18 16:36:28.766479 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030'})
2026-03-18 16:36:28.766488 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log'})
2026-03-18 16:36:28.766494 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': True, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/'})
2026-03-18 16:36:28.766507 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': 'https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4'})
2026-03-18 16:36:28.766513 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/job_uri/tasks/test_regex.yml for instance => (item={'pass': False, 'string': '/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a'})
2026-03-18 16:36:28.766518 | controller |
2026-03-18 16:36:28.766524 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7/anything/////] ***
2026-03-18 16:36:28.766531 | controller | Wednesday 18 March 2026  16:36:28 +0000 (0:00:00.095)       0:00:00.132 *******
2026-03-18 16:36:28.766553 | controller |
2026-03-18 16:36:28.817729 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-18 16:36:28.817752 | controller | Wednesday 18 March 2026  16:36:28 +0000 (0:00:00.058)       0:00:00.190 *******
2026-03-18 16:36:28.817763 | controller | ok: [instance]
2026-03-18 16:36:28.881087 | controller |
2026-03-18 16:36:28.881116 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-18 16:36:28.881124 | controller | Wednesday 18 March 2026  16:36:28 +0000 (0:00:00.050)       0:00:00.241 *******
2026-03-18 16:36:28.881133 | controller | ok: [instance]
2026-03-18 16:36:28.938235 | controller |
2026-03-18 16:36:28.938264 | controller | TASK [reproducer : Extract job id for later reference] *************************
2026-03-18 16:36:28.938277 | controller | Wednesday 18 March 2026  16:36:28 +0000 (0:00:00.061)       0:00:00.303 *******
2026-03-18 16:36:28.938287 | controller | ok: [instance]
2026-03-18 16:36:28.976972 | controller |
2026-03-18 16:36:28.976999 | controller | TASK [Fail if return string doesn't match expected value] **********************
2026-03-18 16:36:28.977007 | controller | Wednesday 18 March 2026  16:36:28 +0000 (0:00:00.059)       0:00:00.362 *******
2026-03-18 16:36:28.977016 | controller | skipping: [instance]
2026-03-18 16:36:29.068655 | controller |
2026-03-18 16:36:29.068698 | controller | TASK [Fail if string incorrectly passed when defined not to pass] **************
2026-03-18 16:36:29.068707 | controller | Wednesday 18 March 2026  16:36:28 +0000 (0:00:00.038)       0:00:00.401 *******
2026-03-18 16:36:29.068722 | controller | ok: [instance] => changed=false
2026-03-18 16:36:29.124052 | controller |   msg: All assertions passed
2026-03-18 16:36:29.124082 | controller |
2026-03-18 16:36:29.124090 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] ***
2026-03-18 16:36:29.124098 | controller | Wednesday 18 March 2026  16:36:29 +0000 (0:00:00.091)       0:00:00.492 *******
2026-03-18 16:36:29.124112 | controller |
2026-03-18 16:36:29.178672 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-18 16:36:29.178696 | controller | Wednesday 18 March 2026  16:36:29 +0000 (0:00:00.055)       0:00:00.548 *******
2026-03-18 16:36:29.178706 | controller | ok: [instance]
2026-03-18 16:36:29.251324 | controller |
2026-03-18 16:36:29.251354 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-18 16:36:29.251362 | controller | Wednesday 18 March 2026  16:36:29 +0000 (0:00:00.054)       0:00:00.602 *******
2026-03-18 16:36:29.251371 | controller | ok: [instance]
2026-03-18 16:36:29.306405 | controller |
2026-03-18 16:36:29.306435 | controller | TASK [reproducer : Extract job id for later reference] *************************
2026-03-18 16:36:29.306443 | controller | Wednesday 18 March 2026  16:36:29 +0000 (0:00:00.063)       0:00:00.666 *******
2026-03-18 16:36:29.306459 | controller | ok: [instance]
2026-03-18 16:36:29.355457 | controller |
2026-03-18 16:36:29.355497 | controller | TASK [Fail if return string doesn't match expected value] **********************
2026-03-18 16:36:29.355506 | controller | Wednesday 18 March 2026  16:36:29 +0000 (0:00:00.064)       0:00:00.730 *******
2026-03-18 16:36:29.355518 | controller | skipping: [instance]
2026-03-18 16:36:29.460494 | controller |
2026-03-18 16:36:29.460528 | controller | TASK [Fail if string incorrectly passed when defined not to pass] **************
2026-03-18 16:36:29.460586 | controller | Wednesday 18 March 2026  16:36:29 +0000 (0:00:00.048)       0:00:00.779 *******
2026-03-18 16:36:29.460599 | controller | ok: [instance] => changed=false
2026-03-18 16:36:29.516795 | controller |   msg: All assertions passed
2026-03-18 16:36:29.516820 | controller |
2026-03-18 16:36:29.516838 | controller | TASK [Call task file with https://logserver.rdoproject.abc2.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d0304e7] ***
2026-03-18 16:36:29.516850 | controller | Wednesday 18 March 2026  16:36:29 +0000 (0:00:00.105)       0:00:00.884 *******
2026-03-18 16:36:29.516862 | controller |
2026-03-18 16:36:29.571374 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-18 16:36:29.571395 | controller | Wednesday 18 March 2026  16:36:29 +0000 (0:00:00.056)       0:00:00.940 *******
2026-03-18 16:36:29.571407 | controller | ok: [instance]
2026-03-18 16:36:29.625583 | controller |
2026-03-18 16:36:29.625612 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-18 16:36:29.625620 | controller | Wednesday 18 March 2026  16:36:29 +0000 (0:00:00.052)       0:00:00.993 *******
2026-03-18 16:36:29.625654 | controller | ok: [instance]
2026-03-18 16:36:29.676845 | controller |
2026-03-18 16:36:29.676886 | controller | TASK [reproducer : Extract job id for later reference] *************************
2026-03-18 16:36:29.676895 | controller | Wednesday 18 March 2026  16:36:29 +0000 (0:00:00.055)       0:00:01.049 *******
2026-03-18 16:36:29.676910 | controller | ok: [instance]
2026-03-18 16:36:29.724720 | controller |
2026-03-18 16:36:29.724756 | controller | TASK [Fail if return string doesn't match expected value] **********************
2026-03-18 16:36:29.724766 | controller | Wednesday 18 March 2026  16:36:29 +0000 (0:00:00.051)       0:00:01.100 *******
2026-03-18 16:36:29.724777 | controller | skipping: [instance]
2026-03-18 16:36:29.789592 | controller |
2026-03-18 16:36:29.789630 | controller | TASK [Fail if string incorrectly passed when defined not to pass] **************
2026-03-18 16:36:29.789639 | controller | Wednesday 18 March 2026  16:36:29 +0000 (0:00:00.047)       0:00:01.147 *******
2026-03-18 16:36:29.789651 | controller | ok: [instance] => changed=false
2026-03-18 16:36:29.844751 | controller |   msg: All assertions passed
2026-03-18 16:36:29.844776 | controller |
2026-03-18 16:36:29.844784 | controller | TASK [Call task file with https://sf.hosted.hostanme.abc2.host.com/logs/pipeline-name-version2/repo.source.com/tripleo-ci/master/job-name-edpm-deployment-rhel9-osp18-crc-job-reproducer/f697f35] ***
2026-03-18 16:36:29.844791 | controller | Wednesday 18 March 2026  16:36:29 +0000 (0:00:00.065)       0:00:01.213 *******
2026-03-18 16:36:29.844802 | controller |
2026-03-18 16:36:29.918939 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-18 16:36:29.918975 | controller | Wednesday 18 March 2026  16:36:29 +0000 (0:00:00.055)       0:00:01.268 *******
2026-03-18 16:36:29.918999 | controller | ok: [instance]
2026-03-18 16:36:29.919196 | controller |
2026-03-18 16:36:29.919374 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-18 16:36:29.919561 | controller | Wednesday 18 March 2026  16:36:29 +0000 (0:00:00.071)       0:00:01.340 *******
2026-03-18 16:36:29.979192 | controller | ok: [instance]
2026-03-18 16:36:29.979383 | controller |
2026-03-18 16:36:29.979558 | controller | TASK [reproducer : Extract job id for later reference] *************************
2026-03-18 16:36:29.979734 | controller | Wednesday 18 March 2026  16:36:29 +0000 (0:00:00.062)       0:00:01.403 *******
2026-03-18 16:36:30.054233 | controller | ok: [instance]
2026-03-18 16:36:30.103911 | controller |
2026-03-18 16:36:30.103961 | controller | TASK [Fail if return string doesn't match expected value] **********************
2026-03-18 16:36:30.103971 | controller | Wednesday 18 March 2026  16:36:30 +0000 (0:00:00.074)       0:00:01.477 *******
2026-03-18 16:36:30.103982 | controller | skipping: [instance]
2026-03-18 16:36:30.172726 | controller |
2026-03-18 16:36:30.172749 | controller | TASK [Fail if string incorrectly passed when defined not to pass] **************
2026-03-18 16:36:30.172757 | controller | Wednesday 18 March 2026  16:36:30 +0000 (0:00:00.049)       0:00:01.527 *******
2026-03-18 16:36:30.172767 | controller | ok: [instance] => changed=false
2026-03-18 16:36:30.277237 | controller |   msg: All assertions passed
2026-03-18 16:36:30.277322 | controller |
2026-03-18 16:36:30.277332 | controller | TASK [Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] ***
2026-03-18 16:36:30.277339 | controller | Wednesday 18 March 2026  16:36:30 +0000 (0:00:00.068)       0:00:01.596 *******
2026-03-18 16:36:30.277350 | controller |
2026-03-18 16:36:30.330914 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-18 16:36:30.330953 | controller | Wednesday 18 March 2026  16:36:30 +0000 (0:00:00.104)       0:00:01.700 *******
2026-03-18 16:36:30.330968 | controller | ok: [instance]
2026-03-18 16:36:30.371634 | controller |
2026-03-18 16:36:30.371661 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-18 16:36:30.371669 | controller | Wednesday 18 March 2026  16:36:30 +0000 (0:00:00.054)       0:00:01.754 *******
2026-03-18 16:36:30.371679 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:30.410332 | controller |   assertion: _matched_url | default('') | length > 0
2026-03-18 16:36:30.410353 | controller |   evaluated_to: false
2026-03-18 16:36:30.410361 | controller |   msg: 'The cifmw_job_uri value provided is not valid: https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job'
2026-03-18 16:36:30.410376 | controller |
2026-03-18 16:36:30.460109 | controller | TASK [Clear errors to manually handle them] ************************************
2026-03-18 16:36:30.460213 | controller | Wednesday 18 March 2026  16:36:30 +0000 (0:00:00.052)       0:00:01.807 *******
2026-03-18 16:36:30.460223 | controller |
2026-03-18 16:36:30.460229 | controller | TASK [Really fail if string passed but should have failed] *********************
2026-03-18 16:36:30.460235 | controller | Wednesday 18 March 2026  16:36:30 +0000 (0:00:00.025)       0:00:01.833 *******
2026-03-18 16:36:30.460244 | controller | skipping: [instance]
2026-03-18 16:36:30.524584 | controller |
2026-03-18 16:36:30.524611 | controller | TASK [Really fail if string failed but should have passed] *********************
2026-03-18 16:36:30.524618 | controller | Wednesday 18 March 2026  16:36:30 +0000 (0:00:00.050)       0:00:01.883 *******
2026-03-18 16:36:30.524629 | controller | skipping: [instance]
2026-03-18 16:36:30.587683 | controller |
2026-03-18 16:36:30.587705 | controller | TASK [Call task file with httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030] ***
2026-03-18 16:36:30.587724 | controller | Wednesday 18 March 2026  16:36:30 +0000 (0:00:00.064)       0:00:01.948 *******
2026-03-18 16:36:30.587734 | controller |
2026-03-18 16:36:30.652120 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-18 16:36:30.652139 | controller | Wednesday 18 March 2026  16:36:30 +0000 (0:00:00.062)       0:00:02.011 *******
2026-03-18 16:36:30.652161 | controller | ok: [instance]
2026-03-18 16:36:30.692051 | controller |
2026-03-18 16:36:30.692071 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-18 16:36:30.692086 | controller | Wednesday 18 March 2026  16:36:30 +0000 (0:00:00.065)       0:00:02.076 *******
2026-03-18 16:36:30.692099 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:30.729808 | controller |   assertion: _matched_url | default('') | length > 0
2026-03-18 16:36:30.729831 | controller |   evaluated_to: false
2026-03-18 16:36:30.729840 | controller |   msg: 'The cifmw_job_uri value provided is not valid: httdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job'
2026-03-18 16:36:30.729855 | controller |
2026-03-18 16:36:30.794461 | controller | TASK [Clear errors to manually handle them] ************************************
2026-03-18 16:36:30.794490 | controller | Wednesday 18 March 2026  16:36:30 +0000 (0:00:00.059)       0:00:02.136 *******
2026-03-18 16:36:30.794498 | controller |
2026-03-18 16:36:30.794504 | controller | TASK [Really fail if string passed but should have failed] *********************
2026-03-18 16:36:30.794509 | controller | Wednesday 18 March 2026  16:36:30 +0000 (0:00:00.017)       0:00:02.153 *******
2026-03-18 16:36:30.794529 | controller | skipping: [instance]
2026-03-18 16:36:30.849803 | controller |
2026-03-18 16:36:30.849833 | controller | TASK [Really fail if string failed but should have passed] *********************
2026-03-18 16:36:30.849849 | controller | Wednesday 18 March 2026  16:36:30 +0000 (0:00:00.064)       0:00:02.218 *******
2026-03-18 16:36:30.849861 | controller | skipping: [instance]
2026-03-18 16:36:30.933952 | controller |
2026-03-18 16:36:30.933976 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log] ***
2026-03-18 16:36:30.933985 | controller | Wednesday 18 March 2026  16:36:30 +0000 (0:00:00.055)       0:00:02.273 *******
2026-03-18 16:36:30.933995 | controller |
2026-03-18 16:36:30.934169 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-18 16:36:30.934387 | controller | Wednesday 18 March 2026  16:36:30 +0000 (0:00:00.084)       0:00:02.358 *******
2026-03-18 16:36:31.002891 | controller | ok: [instance]
2026-03-18 16:36:31.066627 | controller |
2026-03-18 16:36:31.066655 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-18 16:36:31.066664 | controller | Wednesday 18 March 2026  16:36:31 +0000 (0:00:00.068)       0:00:02.426 *******
2026-03-18 16:36:31.066673 | controller | ok: [instance]
2026-03-18 16:36:31.132876 | controller |
2026-03-18 16:36:31.132913 | controller | TASK [reproducer : Extract job id for later reference] *************************
2026-03-18 16:36:31.132943 | controller | Wednesday 18 March 2026  16:36:31 +0000 (0:00:00.063)       0:00:02.490 *******
2026-03-18 16:36:31.132957 | controller | ok: [instance]
2026-03-18 16:36:31.188506 | controller |
2026-03-18 16:36:31.188543 | controller | TASK [Fail if return string doesn't match expected value] **********************
2026-03-18 16:36:31.188553 | controller | Wednesday 18 March 2026  16:36:31 +0000 (0:00:00.065)       0:00:02.556 *******
2026-03-18 16:36:31.188562 | controller | skipping: [instance]
2026-03-18 16:36:31.253450 | controller |
2026-03-18 16:36:31.253487 | controller | TASK [Fail if string incorrectly passed when defined not to pass] **************
2026-03-18 16:36:31.253496 | controller | Wednesday 18 March 2026  16:36:31 +0000 (0:00:00.056)       0:00:02.612 *******
2026-03-18 16:36:31.253508 | controller | ok: [instance] => changed=false
2026-03-18 16:36:31.446196 | controller |   msg: All assertions passed
2026-03-18 16:36:31.446256 | controller |
2026-03-18 16:36:31.446270 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/] ***
2026-03-18 16:36:31.446280 | controller | Wednesday 18 March 2026  16:36:31 +0000 (0:00:00.064)       0:00:02.677 *******
2026-03-18 16:36:31.446293 | controller |
2026-03-18 16:36:31.503951 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-18 16:36:31.503984 | controller | Wednesday 18 March 2026  16:36:31 +0000 (0:00:00.192)       0:00:02.869 *******
2026-03-18 16:36:31.504002 | controller | ok: [instance]
2026-03-18 16:36:31.564517 | controller |
2026-03-18 16:36:31.564556 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-18 16:36:31.564566 | controller | Wednesday 18 March 2026  16:36:31 +0000 (0:00:00.058)       0:00:02.927 *******
2026-03-18 16:36:31.564577 | controller | ok: [instance]
2026-03-18 16:36:31.622072 | controller |
2026-03-18 16:36:31.622101 | controller | TASK [reproducer : Extract job id for later reference] *************************
2026-03-18 16:36:31.622110 | controller | Wednesday 18 March 2026  16:36:31 +0000 (0:00:00.060)       0:00:02.988 *******
2026-03-18 16:36:31.622120 | controller | ok: [instance]
2026-03-18 16:36:31.669605 | controller |
2026-03-18 16:36:31.669629 | controller | TASK [Fail if return string doesn't match expected value] **********************
2026-03-18 16:36:31.669637 | controller | Wednesday 18 March 2026  16:36:31 +0000 (0:00:00.057)       0:00:03.045 *******
2026-03-18 16:36:31.669653 | controller | skipping: [instance]
2026-03-18 16:36:31.725310 | controller |
2026-03-18 16:36:31.725355 | controller | TASK [Fail if string incorrectly passed when defined not to pass] **************
2026-03-18 16:36:31.725363 | controller | Wednesday 18 March 2026  16:36:31 +0000 (0:00:00.047)       0:00:03.093 *******
2026-03-18 16:36:31.725374 | controller | ok: [instance] => changed=false
2026-03-18 16:36:31.785251 | controller |   msg: All assertions passed
2026-03-18 16:36:31.785276 | controller |
2026-03-18 16:36:31.785284 | controller | TASK [Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4] ***
2026-03-18 16:36:31.785295 | controller | Wednesday 18 March 2026  16:36:31 +0000 (0:00:00.055)       0:00:03.149 *******
2026-03-18 16:36:31.785321 | controller |
2026-03-18 16:36:31.839547 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-18 16:36:31.839607 | controller | Wednesday 18 March 2026  16:36:31 +0000 (0:00:00.060)       0:00:03.209 *******
2026-03-18 16:36:31.839621 | controller | ok: [instance]
2026-03-18 16:36:31.892274 | controller |
2026-03-18 16:36:31.892294 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-18 16:36:31.892302 | controller | Wednesday 18 March 2026  16:36:31 +0000 (0:00:00.053)       0:00:03.263 *******
2026-03-18 16:36:31.892317 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:31.892686 | controller |   assertion: _matched_url | default('') | length > 0
2026-03-18 16:36:31.928892 | controller |   evaluated_to: false
2026-03-18 16:36:31.928912 | controller |   msg: 'The cifmw_job_uri value provided is not valid: https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4 More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job'
2026-03-18 16:36:31.928923 | controller |
2026-03-18 16:36:31.987980 | controller | TASK [Clear errors to manually handle them] ************************************
2026-03-18 16:36:31.988045 | controller | Wednesday 18 March 2026  16:36:31 +0000 (0:00:00.066)       0:00:03.329 *******
2026-03-18 16:36:31.988054 | controller |
2026-03-18 16:36:31.988061 | controller | TASK [Really fail if string passed but should have failed] *********************
2026-03-18 16:36:31.988067 | controller | Wednesday 18 March 2026  16:36:31 +0000 (0:00:00.022)       0:00:03.352 *******
2026-03-18 16:36:31.988080 | controller | skipping: [instance]
2026-03-18 16:36:32.057961 | controller |
2026-03-18 16:36:32.057995 | controller | TASK [Really fail if string failed but should have passed] *********************
2026-03-18 16:36:32.058005 | controller | Wednesday 18 March 2026  16:36:31 +0000 (0:00:00.057)       0:00:03.410 *******
2026-03-18 16:36:32.058015 | controller | skipping: [instance]
2026-03-18 16:36:32.134585 | controller |
2026-03-18 16:36:32.134644 | controller | TASK [Call task file with /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a] ***
2026-03-18 16:36:32.134653 | controller | Wednesday 18 March 2026  16:36:32 +0000 (0:00:00.071)       0:00:03.481 *******
2026-03-18 16:36:32.134668 | controller |
2026-03-18 16:36:32.170142 | controller | TASK [reproducer : Apply regex match filter] ***********************************
2026-03-18 16:36:32.170169 | controller | Wednesday 18 March 2026  16:36:32 +0000 (0:00:00.058)       0:00:03.539 *******
2026-03-18 16:36:32.170185 | controller | ok: [instance]
2026-03-18 16:36:32.220557 | controller |
2026-03-18 16:36:32.220619 | controller | TASK [reproducer : Verify URL is valid] ****************************************
2026-03-18 16:36:32.220630 | controller | Wednesday 18 March 2026  16:36:32 +0000 (0:00:00.054)       0:00:03.594 *******
2026-03-18 16:36:32.220641 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:32.255333 | controller |   assertion: _matched_url | default('') | length > 0
2026-03-18 16:36:32.255354 | controller |   evaluated_to: false
2026-03-18 16:36:32.255368 | controller |   msg: 'The cifmw_job_uri value provided is not valid: /logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a More details here: https://ci-framework.readthedocs.io/en/latest/reproducers/03-zuul.html#create-a-custom-environment-file-to-feed-your-job'
2026-03-18 16:36:32.255380 | controller |
2026-03-18 16:36:32.305367 | controller | TASK [Clear errors to manually handle them] ************************************
2026-03-18 16:36:32.305388 | controller | Wednesday 18 March 2026  16:36:32 +0000 (0:00:00.066)       0:00:03.660 *******
2026-03-18 16:36:32.305395 | controller |
2026-03-18 16:36:32.305401 | controller | TASK [Really fail if string passed but should have failed] *********************
2026-03-18 16:36:32.305414 | controller | Wednesday 18 March 2026  16:36:32 +0000 (0:00:00.018)       0:00:03.679 *******
2026-03-18 16:36:32.305428 | controller | skipping: [instance]
2026-03-18 16:36:32.359087 | controller |
2026-03-18 16:36:32.359108 | controller | TASK [Really fail if string failed but should have passed] *********************
2026-03-18 16:36:32.359116 | controller | Wednesday 18 March 2026  16:36:32 +0000 (0:00:00.050)       0:00:03.729 *******
2026-03-18 16:36:32.359125 | controller | skipping: [instance]
2026-03-18 16:36:32.486837 | controller |
2026-03-18 16:36:32.486881 | controller | TASK [Print success message] ***************************************************
2026-03-18 16:36:32.486891 | controller | Wednesday 18 March 2026  16:36:32 +0000 (0:00:00.053)       0:00:03.782 *******
2026-03-18 16:36:32.486906 | controller | ok: [instance] =>
2026-03-18 16:36:32.487116 | controller |   msg: All strings passed!
2026-03-18 16:36:32.487291 | controller |
2026-03-18 16:36:32.487451 | controller | PLAY RECAP *********************************************************************
2026-03-18 16:36:32.487672 | controller | instance                   : ok=39   changed=0    unreachable=0    failed=0    skipped=14   rescued=4    ignored=0
2026-03-18 16:36:32.487854 | controller |
2026-03-18 16:36:32.488042 | controller | Wednesday 18 March 2026  16:36:32 +0000 (0:00:00.127)       0:00:03.910 *******
2026-03-18 16:36:32.488221 | controller | ===============================================================================
2026-03-18 16:36:32.488386 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/ --- 0.19s
2026-03-18 16:36:32.488549 | controller | Print success message --------------------------------------------------- 0.13s
2026-03-18 16:36:32.488721 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.11s
2026-03-18 16:36:32.488878 | controller | Call task file with https://logserver.rdoproject.org/94/1494/1f72e2797961e0fb0192e3280c3027a8d70b4e45/github-check/cifmw-molecule-libvirt_manager/d030 --- 0.10s
2026-03-18 16:36:32.489063 | controller | Call task file in loop -------------------------------------------------- 0.10s
2026-03-18 16:36:32.489247 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.09s
2026-03-18 16:36:32.489400 | controller | Call task file with https://internalhostname.com/logs/internal_pipeline_name/internalhostname.com/tripleo-ci/master/internal_job_name/d0f4a7a/installed-pkgs.log --- 0.08s
2026-03-18 16:36:32.489570 | controller | reproducer : Extract job id for later reference ------------------------- 0.07s
2026-03-18 16:36:32.489735 | controller | reproducer : Apply regex match filter ----------------------------------- 0.07s
2026-03-18 16:36:32.489896 | controller | Really fail if string failed but should have passed --------------------- 0.07s
2026-03-18 16:36:32.490085 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.07s
2026-03-18 16:36:32.490243 | controller | reproducer : Apply regex match filter ----------------------------------- 0.07s
2026-03-18 16:36:32.490394 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.07s
2026-03-18 16:36:32.490543 | controller | reproducer : Verify URL is valid ---------------------------------------- 0.07s
2026-03-18 16:36:32.490704 | controller | reproducer : Extract job id for later reference ------------------------- 0.07s
2026-03-18 16:36:32.490839 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.07s
2026-03-18 16:36:32.491010 | controller | reproducer : Apply regex match filter ----------------------------------- 0.07s
2026-03-18 16:36:32.491170 | controller | Fail if string incorrectly passed when defined not to pass -------------- 0.06s
2026-03-18 16:36:32.491321 | controller | Really fail if string passed but should have failed --------------------- 0.06s
2026-03-18 16:36:32.491471 | controller | Really fail if string failed but should have passed --------------------- 0.06s
2026-03-18 16:36:32.578674 | controller | INFO     Running job_uri > cleanup
2026-03-18 16:36:32.579274 | controller | WARNING  Skipping, cleanup playbook not configured.
2026-03-18 16:36:32.587859 | controller | INFO     Running network_validations > prepare
2026-03-18 16:36:32.588493 | controller | WARNING  Skipping, prepare playbook not configured.
2026-03-18 16:36:32.599761 | controller | INFO     Running network_validations > converge
2026-03-18 16:36:33.204988 | controller |
2026-03-18 16:36:33.231393 | controller | PLAY [Prepare] *****************************************************************
2026-03-18 16:36:33.231433 | controller |
2026-03-18 16:36:33.231442 | controller | TASK [Set failed fact] *********************************************************
2026-03-18 16:36:33.231453 | controller | Wednesday 18 March 2026  16:36:33 +0000 (0:00:00.039)       0:00:00.039 *******
2026-03-18 16:36:33.231469 | controller | ok: [instance]
2026-03-18 16:36:33.260857 | controller |
2026-03-18 16:36:33.260894 | controller | TASK [Load scenarios] **********************************************************
2026-03-18 16:36:33.260906 | controller | Wednesday 18 March 2026  16:36:33 +0000 (0:00:00.027)       0:00:00.067 *******
2026-03-18 16:36:33.260920 | controller | ok: [instance]
2026-03-18 16:36:33.338311 | controller |
2026-03-18 16:36:33.338409 | controller | TASK [Test network validations] ************************************************
2026-03-18 16:36:33.338419 | controller | Wednesday 18 March 2026  16:36:33 +0000 (0:00:00.029)       0:00:00.096 *******
2026-03-18 16:36:33.338436 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets only)
2026-03-18 16:36:33.369602 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets and spine/leaf)
2026-03-18 16:36:33.369627 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Default nets with extra defined net)
2026-03-18 16:36:33.369635 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing default net definition)
2026-03-18 16:36:33.369641 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=Missing spine/leaf net definition)
2026-03-18 16:36:33.369647 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/network_validations/tasks/test.yml for instance => (item=No network for a VM)
2026-03-18 16:36:33.369653 | controller |
2026-03-18 16:36:33.369665 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:33.369676 | controller | Wednesday 18 March 2026  16:36:33 +0000 (0:00:00.076)       0:00:00.173 *******
2026-03-18 16:36:33.369687 | controller | ok: [instance]
2026-03-18 16:36:33.406882 | controller |
2026-03-18 16:36:33.406915 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:33.406940 | controller | Wednesday 18 March 2026  16:36:33 +0000 (0:00:00.032)       0:00:00.205 *******
2026-03-18 16:36:33.406963 | controller | ok: [instance]
2026-03-18 16:36:33.445679 | controller |
2026-03-18 16:36:33.445708 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:33.445717 | controller | Wednesday 18 March 2026  16:36:33 +0000 (0:00:00.037)       0:00:00.242 *******
2026-03-18 16:36:33.445727 | controller | ok: [instance] =>
2026-03-18 16:36:33.510480 | controller |   msg: 'Running: Default nets only'
2026-03-18 16:36:33.510515 | controller |
2026-03-18 16:36:33.510528 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:33.510547 | controller | Wednesday 18 March 2026  16:36:33 +0000 (0:00:00.035)       0:00:00.278 *******
2026-03-18 16:36:33.510557 | controller |
2026-03-18 16:36:33.595718 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-03-18 16:36:33.595766 | controller | Wednesday 18 March 2026  16:36:33 +0000 (0:00:00.067)       0:00:00.346 *******
2026-03-18 16:36:33.595785 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter:
2026-03-18 16:36:33.640262 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value
2026-03-18 16:36:33.640290 | controller | in the `loop_control` option for the task to something else to avoid variable
2026-03-18 16:36:33.640298 | controller | collisions and unexpected behavior.
2026-03-18 16:36:33.640319 | controller | ok: [instance] => (item=controller)
2026-03-18 16:36:33.716320 | controller |
2026-03-18 16:36:33.716341 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2026-03-18 16:36:33.716367 | controller | Wednesday 18 March 2026  16:36:33 +0000 (0:00:00.129)       0:00:00.476 *******
2026-03-18 16:36:33.716378 | controller | ok: [instance]
2026-03-18 16:36:33.798194 | controller |
2026-03-18 16:36:33.798223 | controller | TASK [reproducer : Ensure we don't have extra network defined] *****************
2026-03-18 16:36:33.798232 | controller | Wednesday 18 March 2026  16:36:33 +0000 (0:00:00.076)       0:00:00.552 *******
2026-03-18 16:36:33.798242 | controller | ok: [instance] => changed=false
2026-03-18 16:36:33.852674 | controller |   msg: All assertions passed
2026-03-18 16:36:33.852701 | controller |
2026-03-18 16:36:33.852715 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:33.852721 | controller | Wednesday 18 March 2026  16:36:33 +0000 (0:00:00.081)       0:00:00.634 *******
2026-03-18 16:36:33.852731 | controller | skipping: [instance]
2026-03-18 16:36:33.893781 | controller |
2026-03-18 16:36:33.893802 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:33.893809 | controller | Wednesday 18 March 2026  16:36:33 +0000 (0:00:00.054)       0:00:00.688 *******
2026-03-18 16:36:33.893826 | controller | skipping: [instance]
2026-03-18 16:36:33.932892 | controller |
2026-03-18 16:36:33.932912 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:33.932919 | controller | Wednesday 18 March 2026  16:36:33 +0000 (0:00:00.039)       0:00:00.728 *******
2026-03-18 16:36:33.932941 | controller | skipping: [instance]
2026-03-18 16:36:33.959571 | controller |
2026-03-18 16:36:33.959596 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:33.959607 | controller | Wednesday 18 March 2026  16:36:33 +0000 (0:00:00.039)       0:00:00.767 *******
2026-03-18 16:36:33.959616 | controller | ok: [instance]
2026-03-18 16:36:33.998722 | controller |
2026-03-18 16:36:33.998740 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:33.998748 | controller | Wednesday 18 March 2026  16:36:33 +0000 (0:00:00.027)       0:00:00.795 *******
2026-03-18 16:36:33.998763 | controller | ok: [instance]
2026-03-18 16:36:33.999002 | controller |
2026-03-18 16:36:33.999208 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:33.999377 | controller | Wednesday 18 March 2026  16:36:33 +0000 (0:00:00.038)       0:00:00.834 *******
2026-03-18 16:36:34.029860 | controller | ok: [instance] =>
2026-03-18 16:36:34.030127 | controller |   msg: 'Running: Default nets and spine/leaf'
2026-03-18 16:36:34.030289 | controller |
2026-03-18 16:36:34.030446 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:34.030625 | controller | Wednesday 18 March 2026  16:36:34 +0000 (0:00:00.030)       0:00:00.864 *******
2026-03-18 16:36:34.073159 | controller |
2026-03-18 16:36:34.073369 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-03-18 16:36:34.073556 | controller | Wednesday 18 March 2026  16:36:34 +0000 (0:00:00.044)       0:00:00.909 *******
2026-03-18 16:36:34.105070 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter:
2026-03-18 16:36:34.105244 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value
2026-03-18 16:36:34.105403 | controller | in the `loop_control` option for the task to something else to avoid variable
2026-03-18 16:36:34.105566 | controller | collisions and unexpected behavior.
2026-03-18 16:36:34.129706 | controller | ok: [instance] => (item=controller)
2026-03-18 16:36:34.129894 | controller |
2026-03-18 16:36:34.130106 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2026-03-18 16:36:34.130278 | controller | Wednesday 18 March 2026  16:36:34 +0000 (0:00:00.056)       0:00:00.966 *******
2026-03-18 16:36:34.195311 | controller | ok: [instance]
2026-03-18 16:36:34.195483 | controller |
2026-03-18 16:36:34.195661 | controller | TASK [reproducer : Ensure we don't have extra network defined] *****************
2026-03-18 16:36:34.195829 | controller | Wednesday 18 March 2026  16:36:34 +0000 (0:00:00.062)       0:00:01.028 *******
2026-03-18 16:36:34.275539 | controller | ok: [instance] => changed=false
2026-03-18 16:36:34.275719 | controller |   msg: All assertions passed
2026-03-18 16:36:34.275880 | controller |
2026-03-18 16:36:34.276064 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:34.276227 | controller | Wednesday 18 March 2026  16:36:34 +0000 (0:00:00.083)       0:00:01.111 *******
2026-03-18 16:36:34.329297 | controller | skipping: [instance]
2026-03-18 16:36:34.329441 | controller |
2026-03-18 16:36:34.329597 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:34.329722 | controller | Wednesday 18 March 2026  16:36:34 +0000 (0:00:00.051)       0:00:01.163 *******
2026-03-18 16:36:34.409513 | controller | skipping: [instance]
2026-03-18 16:36:34.409731 | controller |
2026-03-18 16:36:34.410005 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:34.410193 | controller | Wednesday 18 March 2026  16:36:34 +0000 (0:00:00.040)       0:00:01.204 *******
2026-03-18 16:36:34.477417 | controller | skipping: [instance]
2026-03-18 16:36:34.477571 | controller |
2026-03-18 16:36:34.477704 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:34.477835 | controller | Wednesday 18 March 2026  16:36:34 +0000 (0:00:00.105)       0:00:01.309 *******
2026-03-18 16:36:34.517347 | controller | ok: [instance]
2026-03-18 16:36:34.517499 | controller |
2026-03-18 16:36:34.517655 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:34.517792 | controller | Wednesday 18 March 2026  16:36:34 +0000 (0:00:00.043)       0:00:01.353 *******
2026-03-18 16:36:34.554867 | controller | ok: [instance]
2026-03-18 16:36:34.555102 | controller |
2026-03-18 16:36:34.555294 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:34.555452 | controller | Wednesday 18 March 2026  16:36:34 +0000 (0:00:00.037)       0:00:01.390 *******
2026-03-18 16:36:34.595793 | controller | ok: [instance] =>
2026-03-18 16:36:34.696899 | controller |   msg: 'Running: Default nets with extra defined net'
2026-03-18 16:36:34.696976 | controller |
2026-03-18 16:36:34.696984 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:34.696996 | controller | Wednesday 18 March 2026  16:36:34 +0000 (0:00:00.040)       0:00:01.431 *******
2026-03-18 16:36:34.697009 | controller |
2026-03-18 16:36:34.734856 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-03-18 16:36:34.734893 | controller | Wednesday 18 March 2026  16:36:34 +0000 (0:00:00.100)       0:00:01.532 *******
2026-03-18 16:36:34.734907 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter:
2026-03-18 16:36:34.762462 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value
2026-03-18 16:36:34.762489 | controller | in the `loop_control` option for the task to something else to avoid variable
2026-03-18 16:36:34.762497 | controller | collisions and unexpected behavior.
2026-03-18 16:36:34.762507 | controller | ok: [instance] => (item=controller)
2026-03-18 16:36:34.836659 | controller |
2026-03-18 16:36:34.836694 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2026-03-18 16:36:34.836703 | controller | Wednesday 18 March 2026  16:36:34 +0000 (0:00:00.066)       0:00:01.598 *******
2026-03-18 16:36:34.836713 | controller | ok: [instance]
2026-03-18 16:36:34.896420 | controller |
2026-03-18 16:36:34.896440 | controller | TASK [reproducer : Ensure we don't have extra network defined] *****************
2026-03-18 16:36:34.896454 | controller | Wednesday 18 March 2026  16:36:34 +0000 (0:00:00.074)       0:00:01.672 *******
2026-03-18 16:36:34.896463 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:34.913077 | controller |   assertion: _defined | difference(_all_nets) | length == 0
2026-03-18 16:36:34.913097 | controller |   evaluated_to: false
2026-03-18 16:36:34.913104 | controller |   msg: 'Inconsistency detected: ensure you''re attaching all of the defined networks. Those nets don''t seem to be attached: [''extra_net_1'']'
2026-03-18 16:36:34.913114 | controller |
2026-03-18 16:36:34.958522 | controller | TASK [reproducer : Dump initial layout] ****************************************
2026-03-18 16:36:34.958551 | controller | Wednesday 18 March 2026  16:36:34 +0000 (0:00:00.076)       0:00:01.749 *******
2026-03-18 16:36:34.958567 | controller | ok: [instance] =>
2026-03-18 16:36:35.076657 | controller |   cifmw_libvirt_manager_configuration:
2026-03-18 16:36:35.076680 | controller |     networks:
2026-03-18 16:36:35.076687 | controller |       public: defined
2026-03-18 16:36:35.076693 | controller |     vms:
2026-03-18 16:36:35.076698 | controller |       controller:
2026-03-18 16:36:35.076705 | controller |         nets:
2026-03-18 16:36:35.076710 | controller |         - public
2026-03-18 16:36:35.076721 | controller |
2026-03-18 16:36:35.076731 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************
2026-03-18 16:36:35.076737 | controller | Wednesday 18 March 2026  16:36:34 +0000 (0:00:00.044)       0:00:01.793 *******
2026-03-18 16:36:35.076747 | controller | skipping: [instance]
2026-03-18 16:36:35.226212 | controller |
2026-03-18 16:36:35.226257 | controller | TASK [reproducer : Dump layout patches] ****************************************
2026-03-18 16:36:35.226276 | controller | Wednesday 18 March 2026  16:36:35 +0000 (0:00:00.118)       0:00:01.912 *******
2026-03-18 16:36:35.226287 | controller | skipping: [instance]
2026-03-18 16:36:35.386402 | controller |
2026-03-18 16:36:35.386440 | controller | TASK [reproducer : Dump built layout] ******************************************
2026-03-18 16:36:35.386448 | controller | Wednesday 18 March 2026  16:36:35 +0000 (0:00:00.149)       0:00:02.061 *******
2026-03-18 16:36:35.386459 | controller | ok: [instance] =>
2026-03-18 16:36:35.408692 | controller |   _cifmw_libvirt_manager_layout:
2026-03-18 16:36:35.408731 | controller |     networks:
2026-03-18 16:36:35.408744 | controller |       extra_net_1: defined
2026-03-18 16:36:35.408756 | controller |       public: defined
2026-03-18 16:36:35.408764 | controller |     vms:
2026-03-18 16:36:35.408770 | controller |       controller:
2026-03-18 16:36:35.408781 | controller |         nets:
2026-03-18 16:36:35.408790 | controller |         - public
2026-03-18 16:36:35.408796 | controller |
2026-03-18 16:36:35.408801 | controller | TASK [reproducer : Fail for good] **********************************************
2026-03-18 16:36:35.408811 | controller | Wednesday 18 March 2026  16:36:35 +0000 (0:00:00.159)       0:00:02.221 *******
2026-03-18 16:36:35.408826 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:35.448505 | controller |   msg: Error detected, please check assertions and debugging output above.
2026-03-18 16:36:35.448563 | controller |
2026-03-18 16:36:35.487417 | controller | TASK [Clear host errors] *******************************************************
2026-03-18 16:36:35.487437 | controller | Wednesday 18 March 2026  16:36:35 +0000 (0:00:00.042)       0:00:02.263 *******
2026-03-18 16:36:35.487449 | controller |
2026-03-18 16:36:35.487460 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:35.487465 | controller | Wednesday 18 March 2026  16:36:35 +0000 (0:00:00.020)       0:00:02.284 *******
2026-03-18 16:36:35.487475 | controller | ok: [instance]
2026-03-18 16:36:35.538819 | controller |
2026-03-18 16:36:35.538839 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:35.538846 | controller | Wednesday 18 March 2026  16:36:35 +0000 (0:00:00.038)       0:00:02.322 *******
2026-03-18 16:36:35.538856 | controller | skipping: [instance]
2026-03-18 16:36:35.589433 | controller |
2026-03-18 16:36:35.589455 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:35.589472 | controller | Wednesday 18 March 2026  16:36:35 +0000 (0:00:00.052)       0:00:02.374 *******
2026-03-18 16:36:35.589481 | controller | skipping: [instance]
2026-03-18 16:36:35.634717 | controller |
2026-03-18 16:36:35.634740 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:35.634748 | controller | Wednesday 18 March 2026  16:36:35 +0000 (0:00:00.047)       0:00:02.422 *******
2026-03-18 16:36:35.634758 | controller | skipping: [instance]
2026-03-18 16:36:35.664785 | controller |
2026-03-18 16:36:35.664811 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:35.664819 | controller | Wednesday 18 March 2026  16:36:35 +0000 (0:00:00.048)       0:00:02.470 *******
2026-03-18 16:36:35.664829 | controller | ok: [instance]
2026-03-18 16:36:35.698216 | controller |
2026-03-18 16:36:35.698245 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:35.698258 | controller | Wednesday 18 March 2026  16:36:35 +0000 (0:00:00.028)       0:00:02.499 *******
2026-03-18 16:36:35.698275 | controller | ok: [instance]
2026-03-18 16:36:35.732329 | controller |
2026-03-18 16:36:35.732350 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:35.732357 | controller | Wednesday 18 March 2026  16:36:35 +0000 (0:00:00.033)       0:00:02.533 *******
2026-03-18 16:36:35.732371 | controller | ok: [instance] =>
2026-03-18 16:36:35.778108 | controller |   msg: 'Running: Missing default net definition'
2026-03-18 16:36:35.778133 | controller |
2026-03-18 16:36:35.778142 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:35.778148 | controller | Wednesday 18 March 2026  16:36:35 +0000 (0:00:00.034)       0:00:02.568 *******
2026-03-18 16:36:35.778157 | controller |
2026-03-18 16:36:35.824014 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-03-18 16:36:35.824041 | controller | Wednesday 18 March 2026  16:36:35 +0000 (0:00:00.046)       0:00:02.614 *******
2026-03-18 16:36:35.824052 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter:
2026-03-18 16:36:35.840490 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value
2026-03-18 16:36:35.840509 | controller | in the `loop_control` option for the task to something else to avoid variable
2026-03-18 16:36:35.840516 | controller | collisions and unexpected behavior.
2026-03-18 16:36:35.840536 | controller | ok: [instance] => (item=controller)
2026-03-18 16:36:35.914301 | controller |
2026-03-18 16:36:35.914373 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2026-03-18 16:36:35.914384 | controller | Wednesday 18 March 2026  16:36:35 +0000 (0:00:00.061)       0:00:02.676 *******
2026-03-18 16:36:35.914404 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:35.926471 | controller |   assertion: _all_nets | difference(_defined) | length == 0
2026-03-18 16:36:35.926490 | controller |   evaluated_to: false
2026-03-18 16:36:35.926499 | controller |   msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''foo'']'
2026-03-18 16:36:35.926510 | controller |
2026-03-18 16:36:35.966945 | controller | TASK [reproducer : Dump initial layout] ****************************************
2026-03-18 16:36:35.966981 | controller | Wednesday 18 March 2026  16:36:35 +0000 (0:00:00.083)       0:00:02.760 *******
2026-03-18 16:36:35.966996 | controller | ok: [instance] =>
2026-03-18 16:36:36.117125 | controller |   cifmw_libvirt_manager_configuration:
2026-03-18 16:36:36.117176 | controller |     networks:
2026-03-18 16:36:36.117185 | controller |       public: defined
2026-03-18 16:36:36.117196 | controller |     vms:
2026-03-18 16:36:36.117205 | controller |       controller:
2026-03-18 16:36:36.117211 | controller |         nets:
2026-03-18 16:36:36.117217 | controller |         - public
2026-03-18 16:36:36.117224 | controller |
2026-03-18 16:36:36.117230 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************
2026-03-18 16:36:36.117241 | controller | Wednesday 18 March 2026  16:36:35 +0000 (0:00:00.040)       0:00:02.800 *******
2026-03-18 16:36:36.117258 | controller | skipping: [instance]
2026-03-18 16:36:36.223787 | controller |
2026-03-18 16:36:36.223842 | controller | TASK [reproducer : Dump layout patches] ****************************************
2026-03-18 16:36:36.223854 | controller | Wednesday 18 March 2026  16:36:36 +0000 (0:00:00.151)       0:00:02.952 *******
2026-03-18 16:36:36.223869 | controller | skipping: [instance]
2026-03-18 16:36:36.224110 | controller |
2026-03-18 16:36:36.224310 | controller | TASK [reproducer : Dump built layout] ******************************************
2026-03-18 16:36:36.224490 | controller | Wednesday 18 March 2026  16:36:36 +0000 (0:00:00.107)       0:00:03.059 *******
2026-03-18 16:36:36.284642 | controller | ok: [instance] =>
2026-03-18 16:36:36.284831 | controller |   _cifmw_libvirt_manager_layout:
2026-03-18 16:36:36.285015 | controller |     networks:
2026-03-18 16:36:36.285184 | controller |       public: defined
2026-03-18 16:36:36.285346 | controller |     vms:
2026-03-18 16:36:36.285494 | controller |       controller:
2026-03-18 16:36:36.285647 | controller |         nets:
2026-03-18 16:36:36.285814 | controller |         - public
2026-03-18 16:36:36.285994 | controller |         - foo
2026-03-18 16:36:36.286161 | controller |
2026-03-18 16:36:36.286325 | controller | TASK [reproducer : Fail for good] **********************************************
2026-03-18 16:36:36.286477 | controller | Wednesday 18 March 2026  16:36:36 +0000 (0:00:00.061)       0:00:03.120 *******
2026-03-18 16:36:36.303610 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:36.303811 | controller |   msg: Error detected, please check assertions and debugging output above.
2026-03-18 16:36:36.336439 | controller |
2026-03-18 16:36:36.336671 | controller | TASK [Clear host errors] *******************************************************
2026-03-18 16:36:36.336841 | controller | Wednesday 18 March 2026  16:36:36 +0000 (0:00:00.031)       0:00:03.152 *******
2026-03-18 16:36:36.337022 | controller |
2026-03-18 16:36:36.337177 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:36.337351 | controller | Wednesday 18 March 2026  16:36:36 +0000 (0:00:00.019)       0:00:03.172 *******
2026-03-18 16:36:36.371835 | controller | ok: [instance]
2026-03-18 16:36:36.372069 | controller |
2026-03-18 16:36:36.372285 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:36.372487 | controller | Wednesday 18 March 2026  16:36:36 +0000 (0:00:00.036)       0:00:03.208 *******
2026-03-18 16:36:36.424885 | controller | skipping: [instance]
2026-03-18 16:36:36.425089 | controller |
2026-03-18 16:36:36.425323 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:36.425509 | controller | Wednesday 18 March 2026  16:36:36 +0000 (0:00:00.053)       0:00:03.261 *******
2026-03-18 16:36:36.469288 | controller | skipping: [instance]
2026-03-18 16:36:36.511867 | controller |
2026-03-18 16:36:36.511898 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:36.511911 | controller | Wednesday 18 March 2026  16:36:36 +0000 (0:00:00.043)       0:00:03.304 *******
2026-03-18 16:36:36.511921 | controller | skipping: [instance]
2026-03-18 16:36:36.544468 | controller |
2026-03-18 16:36:36.544495 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:36.544508 | controller | Wednesday 18 March 2026  16:36:36 +0000 (0:00:00.043)       0:00:03.347 *******
2026-03-18 16:36:36.544518 | controller | ok: [instance]
2026-03-18 16:36:36.578455 | controller |
2026-03-18 16:36:36.578479 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:36.578487 | controller | Wednesday 18 March 2026  16:36:36 +0000 (0:00:00.032)       0:00:03.380 *******
2026-03-18 16:36:36.578495 | controller | ok: [instance]
2026-03-18 16:36:36.612244 | controller |
2026-03-18 16:36:36.612280 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:36.612293 | controller | Wednesday 18 March 2026  16:36:36 +0000 (0:00:00.034)       0:00:03.414 *******
2026-03-18 16:36:36.612307 | controller | ok: [instance] =>
2026-03-18 16:36:36.679611 | controller |   msg: 'Running: Missing spine/leaf net definition'
2026-03-18 16:36:36.679637 | controller |
2026-03-18 16:36:36.679650 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:36.679657 | controller | Wednesday 18 March 2026  16:36:36 +0000 (0:00:00.032)       0:00:03.446 *******
2026-03-18 16:36:36.679667 | controller |
2026-03-18 16:36:36.712238 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-03-18 16:36:36.712260 | controller | Wednesday 18 March 2026  16:36:36 +0000 (0:00:00.068)       0:00:03.515 *******
2026-03-18 16:36:36.712271 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter:
2026-03-18 16:36:36.712446 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value
2026-03-18 16:36:36.712635 | controller | in the `loop_control` option for the task to something else to avoid variable
2026-03-18 16:36:36.712798 | controller | collisions and unexpected behavior.
2026-03-18 16:36:36.738132 | controller | ok: [instance] => (item=controller)
2026-03-18 16:36:36.738351 | controller |
2026-03-18 16:36:36.738518 | controller | TASK [reproducer : Ensure all standard attached networks are defined] **********
2026-03-18 16:36:36.738722 | controller | Wednesday 18 March 2026  16:36:36 +0000 (0:00:00.057)       0:00:03.573 *******
2026-03-18 16:36:36.800951 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:36.801161 | controller |   assertion: _all_nets | difference(_defined) | length == 0
2026-03-18 16:36:36.801346 | controller |   evaluated_to: false
2026-03-18 16:36:36.801515 | controller |   msg: 'Inconsistency detected: ensure you''re defining all of the attached networks. Those nets don''t seem to be defined: [''l00-s1'']'
2026-03-18 16:36:36.812943 | controller |
2026-03-18 16:36:36.813111 | controller | TASK [reproducer : Dump initial layout] ****************************************
2026-03-18 16:36:36.813250 | controller | Wednesday 18 March 2026  16:36:36 +0000 (0:00:00.076)       0:00:03.649 *******
2026-03-18 16:36:36.880819 | controller | ok: [instance] =>
2026-03-18 16:36:36.881050 | controller |   cifmw_libvirt_manager_configuration:
2026-03-18 16:36:36.881277 | controller |     networks:
2026-03-18 16:36:36.881441 | controller |       l00-s0: defined
2026-03-18 16:36:36.881630 | controller |       public: defined
2026-03-18 16:36:36.881791 | controller |     vms:
2026-03-18 16:36:36.881968 | controller |       controller:
2026-03-18 16:36:36.882130 | controller |         nets:
2026-03-18 16:36:36.882291 | controller |         - public
2026-03-18 16:36:36.882458 | controller |         spineleafnets:
2026-03-18 16:36:36.882630 | controller |         - l00-s0
2026-03-18 16:36:36.882783 | controller |
2026-03-18 16:36:36.882966 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************
2026-03-18 16:36:36.883144 | controller | Wednesday 18 March 2026  16:36:36 +0000 (0:00:00.067)       0:00:03.717 *******
2026-03-18 16:36:36.931563 | controller | skipping: [instance]
2026-03-18 16:36:36.931755 | controller |
2026-03-18 16:36:36.931959 | controller | TASK [reproducer : Dump layout patches] ****************************************
2026-03-18 16:36:36.932144 | controller | Wednesday 18 March 2026  16:36:36 +0000 (0:00:00.050)       0:00:03.767 *******
2026-03-18 16:36:37.089902 | controller | skipping: [instance]
2026-03-18 16:36:37.090152 | controller |
2026-03-18 16:36:37.090372 | controller | TASK [reproducer : Dump built layout] ******************************************
2026-03-18 16:36:37.090562 | controller | Wednesday 18 March 2026  16:36:37 +0000 (0:00:00.157)       0:00:03.925 *******
2026-03-18 16:36:37.147082 | controller | ok: [instance] =>
2026-03-18 16:36:37.147308 | controller |   _cifmw_libvirt_manager_layout:
2026-03-18 16:36:37.147461 | controller |     networks:
2026-03-18 16:36:37.147657 | controller |       l00-s0: defined
2026-03-18 16:36:37.147823 | controller |       public: defined
2026-03-18 16:36:37.148010 | controller |     vms:
2026-03-18 16:36:37.148184 | controller |       controller:
2026-03-18 16:36:37.148345 | controller |         nets:
2026-03-18 16:36:37.148476 | controller |         - public
2026-03-18 16:36:37.148617 | controller |         spineleafnets:
2026-03-18 16:36:37.148741 | controller |         - l00-s0
2026-03-18 16:36:37.148865 | controller |         - l00-s1
2026-03-18 16:36:37.149043 | controller |
2026-03-18 16:36:37.149226 | controller | TASK [reproducer : Fail for good] **********************************************
2026-03-18 16:36:37.149400 | controller | Wednesday 18 March 2026  16:36:37 +0000 (0:00:00.057)       0:00:03.983 *******
2026-03-18 16:36:37.172297 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:37.172502 | controller |   msg: Error detected, please check assertions and debugging output above.
2026-03-18 16:36:37.207796 | controller |
2026-03-18 16:36:37.208024 | controller | TASK [Clear host errors] *******************************************************
2026-03-18 16:36:37.208221 | controller | Wednesday 18 March 2026  16:36:37 +0000 (0:00:00.043)       0:00:04.026 *******
2026-03-18 16:36:37.208394 | controller |
2026-03-18 16:36:37.208588 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:37.208778 | controller | Wednesday 18 March 2026  16:36:37 +0000 (0:00:00.017)       0:00:04.044 *******
2026-03-18 16:36:37.290770 | controller | ok: [instance]
2026-03-18 16:36:37.290926 | controller |
2026-03-18 16:36:37.291103 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:37.291239 | controller | Wednesday 18 March 2026  16:36:37 +0000 (0:00:00.082)       0:00:04.127 *******
2026-03-18 16:36:37.344254 | controller | skipping: [instance]
2026-03-18 16:36:37.344477 | controller |
2026-03-18 16:36:37.344674 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:37.344847 | controller | Wednesday 18 March 2026  16:36:37 +0000 (0:00:00.052)       0:00:04.180 *******
2026-03-18 16:36:37.399173 | controller | skipping: [instance]
2026-03-18 16:36:37.399382 | controller |
2026-03-18 16:36:37.399574 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:37.399753 | controller | Wednesday 18 March 2026  16:36:37 +0000 (0:00:00.050)       0:00:04.230 *******
2026-03-18 16:36:37.456745 | controller | skipping: [instance]
2026-03-18 16:36:37.456951 | controller |
2026-03-18 16:36:37.457160 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:37.457346 | controller | Wednesday 18 March 2026  16:36:37 +0000 (0:00:00.059)       0:00:04.290 *******
2026-03-18 16:36:37.488190 | controller | ok: [instance]
2026-03-18 16:36:37.488373 | controller |
2026-03-18 16:36:37.488576 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:37.488729 | controller | Wednesday 18 March 2026  16:36:37 +0000 (0:00:00.030)       0:00:04.321 *******
2026-03-18 16:36:37.524572 | controller | ok: [instance]
2026-03-18 16:36:37.524758 | controller |
2026-03-18 16:36:37.524953 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:37.525158 | controller | Wednesday 18 March 2026  16:36:37 +0000 (0:00:00.039)       0:00:04.361 *******
2026-03-18 16:36:37.562008 | controller | ok: [instance] =>
2026-03-18 16:36:37.562167 | controller |   msg: 'Running: No network for a VM'
2026-03-18 16:36:37.562312 | controller |
2026-03-18 16:36:37.562443 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:37.562581 | controller | Wednesday 18 March 2026  16:36:37 +0000 (0:00:00.037)       0:00:04.398 *******
2026-03-18 16:36:37.611808 | controller |
2026-03-18 16:36:37.612142 | controller | TASK [reproducer : Ensure all VM types have defined nets parameter] ************
2026-03-18 16:36:37.612313 | controller | Wednesday 18 March 2026  16:36:37 +0000 (0:00:00.049)       0:00:04.448 *******
2026-03-18 16:36:37.665371 | controller | [WARNING]: TASK: reproducer : Ensure all VM types have defined nets parameter:
2026-03-18 16:36:37.665554 | controller | The loop variable 'item' is already in use. You should set the `loop_var` value
2026-03-18 16:36:37.665721 | controller | in the `loop_control` option for the task to something else to avoid variable
2026-03-18 16:36:37.665886 | controller | collisions and unexpected behavior.
2026-03-18 16:36:37.686625 | controller | failed: [instance] (item=foo) => changed=false
2026-03-18 16:36:37.686770 | controller |   ansible_loop_var: item
2026-03-18 16:36:37.686894 | controller |   assertion: item.value.nets is defined
2026-03-18 16:36:37.687048 | controller |   evaluated_to: false
2026-03-18 16:36:37.687174 | controller |   item:
2026-03-18 16:36:37.687307 | controller |     key: foo
2026-03-18 16:36:37.687427 | controller |     value:
2026-03-18 16:36:37.687561 | controller |       disksize: 10
2026-03-18 16:36:37.687681 | controller |   msg: 'Inconsistency detected: VM type "foo" doesn''t seem to have any network.'
2026-03-18 16:36:37.700031 | controller | ok: [instance] => (item=controller)
2026-03-18 16:36:37.700168 | controller |
2026-03-18 16:36:37.700294 | controller | TASK [reproducer : Dump initial layout] ****************************************
2026-03-18 16:36:37.700414 | controller | Wednesday 18 March 2026  16:36:37 +0000 (0:00:00.088)       0:00:04.536 *******
2026-03-18 16:36:37.771256 | controller | ok: [instance] =>
2026-03-18 16:36:37.771456 | controller |   cifmw_libvirt_manager_configuration:
2026-03-18 16:36:37.771609 | controller |     networks:
2026-03-18 16:36:37.771758 | controller |       public: defined
2026-03-18 16:36:37.771902 | controller |     vms:
2026-03-18 16:36:37.772067 | controller |       controller:
2026-03-18 16:36:37.772225 | controller |         nets:
2026-03-18 16:36:37.772367 | controller |         - public
2026-03-18 16:36:37.772478 | controller |
2026-03-18 16:36:37.772694 | controller | TASK [reproducer : Dump CI reproducer generated layout] ************************
2026-03-18 16:36:37.772831 | controller | Wednesday 18 March 2026  16:36:37 +0000 (0:00:00.071)       0:00:04.607 *******
2026-03-18 16:36:37.846662 | controller | skipping: [instance]
2026-03-18 16:36:37.846858 | controller |
2026-03-18 16:36:37.847045 | controller | TASK [reproducer : Dump layout patches] ****************************************
2026-03-18 16:36:37.847211 | controller | Wednesday 18 March 2026  16:36:37 +0000 (0:00:00.075)       0:00:04.682 *******
2026-03-18 16:36:37.969392 | controller | skipping: [instance]
2026-03-18 16:36:37.969653 | controller |
2026-03-18 16:36:37.969853 | controller | TASK [reproducer : Dump built layout] ******************************************
2026-03-18 16:36:37.970053 | controller | Wednesday 18 March 2026  16:36:37 +0000 (0:00:00.120)       0:00:04.803 *******
2026-03-18 16:36:38.036909 | controller | ok: [instance] =>
2026-03-18 16:36:38.037132 | controller |   _cifmw_libvirt_manager_layout:
2026-03-18 16:36:38.037327 | controller |     networks:
2026-03-18 16:36:38.037512 | controller |       public: defined
2026-03-18 16:36:38.037692 | controller |     vms:
2026-03-18 16:36:38.037851 | controller |       controller:
2026-03-18 16:36:38.038031 | controller |         nets:
2026-03-18 16:36:38.038218 | controller |         - public
2026-03-18 16:36:38.038386 | controller |       foo:
2026-03-18 16:36:38.038599 | controller |         disksize: 10
2026-03-18 16:36:38.038770 | controller |
2026-03-18 16:36:38.038969 | controller | TASK [reproducer : Fail for good] **********************************************
2026-03-18 16:36:38.039164 | controller | Wednesday 18 March 2026  16:36:38 +0000 (0:00:00.066)       0:00:04.870 *******
2026-03-18 16:36:38.060400 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:38.060641 | controller |   msg: Error detected, please check assertions and debugging output above.
2026-03-18 16:36:38.095805 | controller |
2026-03-18 16:36:38.096030 | controller | TASK [Clear host errors] *******************************************************
2026-03-18 16:36:38.096230 | controller | Wednesday 18 March 2026  16:36:38 +0000 (0:00:00.042)       0:00:04.913 *******
2026-03-18 16:36:38.096434 | controller |
2026-03-18 16:36:38.096610 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:38.096775 | controller | Wednesday 18 March 2026  16:36:38 +0000 (0:00:00.019)       0:00:04.932 *******
2026-03-18 16:36:38.127530 | controller | ok: [instance]
2026-03-18 16:36:38.127731 | controller |
2026-03-18 16:36:38.127910 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:38.128123 | controller | Wednesday 18 March 2026  16:36:38 +0000 (0:00:00.029)       0:00:04.961 *******
2026-03-18 16:36:38.176696 | controller | skipping: [instance]
2026-03-18 16:36:38.176903 | controller |
2026-03-18 16:36:38.177114 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:38.177295 | controller | Wednesday 18 March 2026  16:36:38 +0000 (0:00:00.048)       0:00:05.009 *******
2026-03-18 16:36:38.231152 | controller | skipping: [instance]
2026-03-18 16:36:38.231342 | controller |
2026-03-18 16:36:38.231517 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:38.231712 | controller | Wednesday 18 March 2026  16:36:38 +0000 (0:00:00.054)       0:00:05.063 *******
2026-03-18 16:36:38.286549 | controller | skipping: [instance]
2026-03-18 16:36:38.286750 | controller |
2026-03-18 16:36:38.286946 | controller | TASK [Fail if needed] **********************************************************
2026-03-18 16:36:38.287139 | controller | Wednesday 18 March 2026  16:36:38 +0000 (0:00:00.058)       0:00:05.122 *******
2026-03-18 16:36:38.421646 | controller | skipping: [instance]
2026-03-18 16:36:38.421811 | controller |
2026-03-18 16:36:38.421978 | controller | PLAY RECAP *********************************************************************
2026-03-18 16:36:38.422162 | controller | instance                   : ok=48   changed=0    unreachable=0    failed=0    skipped=27   rescued=8    ignored=0
2026-03-18 16:36:38.422327 | controller |
2026-03-18 16:36:38.422489 | controller | Wednesday 18 March 2026  16:36:38 +0000 (0:00:00.135)       0:00:05.257 *******
2026-03-18 16:36:38.422659 | controller | ===============================================================================
2026-03-18 16:36:38.422829 | controller | reproducer : Dump built layout ------------------------------------------ 0.16s
2026-03-18 16:36:38.423017 | controller | reproducer : Dump layout patches ---------------------------------------- 0.16s
2026-03-18 16:36:38.423181 | controller | reproducer : Dump CI reproducer generated layout ------------------------ 0.15s
2026-03-18 16:36:38.423341 | controller | reproducer : Dump layout patches ---------------------------------------- 0.15s
2026-03-18 16:36:38.423495 | controller | Fail if needed ---------------------------------------------------------- 0.14s
2026-03-18 16:36:38.423660 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.13s
2026-03-18 16:36:38.423826 | controller | reproducer : Dump layout patches ---------------------------------------- 0.12s
2026-03-18 16:36:38.424035 | controller | reproducer : Dump CI reproducer generated layout ------------------------ 0.12s
2026-03-18 16:36:38.424214 | controller | reproducer : Dump layout patches ---------------------------------------- 0.11s
2026-03-18 16:36:38.424369 | controller | Append failed scenario to list ------------------------------------------ 0.11s
2026-03-18 16:36:38.424546 | controller | Validate data ----------------------------------------------------------- 0.10s
2026-03-18 16:36:38.424710 | controller | reproducer : Ensure all VM types have defined nets parameter ------------ 0.09s
2026-03-18 16:36:38.424879 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.08s
2026-03-18 16:36:38.425099 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.08s
2026-03-18 16:36:38.425270 | controller | Mark run as failed ------------------------------------------------------ 0.08s
2026-03-18 16:36:38.425446 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.08s
2026-03-18 16:36:38.425621 | controller | reproducer : Ensure we don't have extra network defined ----------------- 0.08s
2026-03-18 16:36:38.425779 | controller | Test network validations ------------------------------------------------ 0.08s
2026-03-18 16:36:38.425974 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.08s
2026-03-18 16:36:38.426155 | controller | reproducer : Ensure all standard attached networks are defined ---------- 0.08s
2026-03-18 16:36:38.517909 | controller | INFO     Running network_validations > cleanup
2026-03-18 16:36:38.518541 | controller | WARNING  Skipping, cleanup playbook not configured.
2026-03-18 16:36:38.526213 | controller | INFO     Running ocp_validations > prepare
2026-03-18 16:36:38.526675 | controller | WARNING  Skipping, prepare playbook not configured.
2026-03-18 16:36:38.533663 | controller | INFO     Running ocp_validations > converge
2026-03-18 16:36:39.104010 | controller |
2026-03-18 16:36:39.137300 | controller | PLAY [Prepare] *****************************************************************
2026-03-18 16:36:39.137395 | controller |
2026-03-18 16:36:39.137405 | controller | TASK [Set failed fact] *********************************************************
2026-03-18 16:36:39.137411 | controller | Wednesday 18 March 2026  16:36:39 +0000 (0:00:00.038)       0:00:00.038 *******
2026-03-18 16:36:39.137423 | controller | ok: [instance]
2026-03-18 16:36:39.179043 | controller |
2026-03-18 16:36:39.179083 | controller | TASK [Load scenarios] **********************************************************
2026-03-18 16:36:39.179093 | controller | Wednesday 18 March 2026  16:36:39 +0000 (0:00:00.034)       0:00:00.073 *******
2026-03-18 16:36:39.179105 | controller | ok: [instance]
2026-03-18 16:36:39.313997 | controller |
2026-03-18 16:36:39.314062 | controller | TASK [Test no volumes] *********************************************************
2026-03-18 16:36:39.314071 | controller | Wednesday 18 March 2026  16:36:39 +0000 (0:00:00.041)       0:00:00.115 *******
2026-03-18 16:36:39.314092 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, no worker)
2026-03-18 16:36:39.357452 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=No volume, with worker)
2026-03-18 16:36:39.357479 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, no worker)
2026-03-18 16:36:39.357493 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Volume, with worker)
2026-03-18 16:36:39.357500 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Too many allocated volumes)
2026-03-18 16:36:39.357506 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Different volume amount)
2026-03-18 16:36:39.357532 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVM without volume)
2026-03-18 16:36:39.357541 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Create LVMS without volume)
2026-03-18 16:36:39.357551 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice)
2026-03-18 16:36:39.357556 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no LVMS)
2026-03-18 16:36:39.357566 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Allocate same volume twice - no cinder_lvm)
2026-03-18 16:36:39.357574 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Config overrides via devscripts)
2026-03-18 16:36:39.357579 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 10 dev-scripts extra_worker)
2026-03-18 16:36:39.357585 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/reproducer/molecule/ocp_validations/tasks/test.yml for instance => (item=Inject 0 dev-scripts extra_worker)
2026-03-18 16:36:39.357590 | controller |
2026-03-18 16:36:39.357596 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:39.357602 | controller | Wednesday 18 March 2026  16:36:39 +0000 (0:00:00.133)       0:00:00.248 *******
2026-03-18 16:36:39.357611 | controller | ok: [instance]
2026-03-18 16:36:39.357796 | controller |
2026-03-18 16:36:39.358024 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:39.358213 | controller | Wednesday 18 March 2026  16:36:39 +0000 (0:00:00.041)       0:00:00.290 *******
2026-03-18 16:36:39.398457 | controller | ok: [instance]
2026-03-18 16:36:39.398654 | controller |
2026-03-18 16:36:39.398835 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:39.399032 | controller | Wednesday 18 March 2026  16:36:39 +0000 (0:00:00.044)       0:00:00.334 *******
2026-03-18 16:36:39.431270 | controller | ok: [instance] =>
2026-03-18 16:36:39.431444 | controller |   msg: 'Running: No volume, no worker'
2026-03-18 16:36:39.431607 | controller |
2026-03-18 16:36:39.431775 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:39.431911 | controller | Wednesday 18 March 2026  16:36:39 +0000 (0:00:00.032)       0:00:00.367 *******
2026-03-18 16:36:39.527840 | controller |
2026-03-18 16:36:39.528078 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-18 16:36:39.528227 | controller | Wednesday 18 March 2026  16:36:39 +0000 (0:00:00.096)       0:00:00.464 *******
2026-03-18 16:36:39.615686 | controller | ok: [instance]
2026-03-18 16:36:39.615854 | controller |
2026-03-18 16:36:39.616022 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-18 16:36:39.616164 | controller | Wednesday 18 March 2026  16:36:39 +0000 (0:00:00.088)       0:00:00.552 *******
2026-03-18 16:36:39.670035 | controller | ok: [instance]
2026-03-18 16:36:39.670231 | controller |
2026-03-18 16:36:39.670599 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-18 16:36:39.670775 | controller | Wednesday 18 March 2026  16:36:39 +0000 (0:00:00.054)       0:00:00.606 *******
2026-03-18 16:36:39.749302 | controller | ok: [instance]
2026-03-18 16:36:39.749487 | controller |
2026-03-18 16:36:39.749668 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-18 16:36:39.749837 | controller | Wednesday 18 March 2026  16:36:39 +0000 (0:00:00.079)       0:00:00.685 *******
2026-03-18 16:36:39.803614 | controller | skipping: [instance]
2026-03-18 16:36:39.803793 | controller |
2026-03-18 16:36:39.803970 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-18 16:36:39.804141 | controller | Wednesday 18 March 2026  16:36:39 +0000 (0:00:00.051)       0:00:00.737 *******
2026-03-18 16:36:39.898922 | controller | ok: [instance]
2026-03-18 16:36:39.899131 | controller |
2026-03-18 16:36:39.899324 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-18 16:36:39.899484 | controller | Wednesday 18 March 2026  16:36:39 +0000 (0:00:00.096)       0:00:00.834 *******
2026-03-18 16:36:39.971871 | controller | skipping: [instance]
2026-03-18 16:36:39.972103 | controller |
2026-03-18 16:36:39.972296 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-18 16:36:39.972452 | controller | Wednesday 18 March 2026  16:36:39 +0000 (0:00:00.074)       0:00:00.908 *******
2026-03-18 16:36:40.034918 | controller | skipping: [instance]
2026-03-18 16:36:40.035142 | controller |
2026-03-18 16:36:40.035335 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-18 16:36:40.035506 | controller | Wednesday 18 March 2026  16:36:40 +0000 (0:00:00.063)       0:00:00.971 *******
2026-03-18 16:36:40.087073 | controller | skipping: [instance]
2026-03-18 16:36:40.087268 | controller |
2026-03-18 16:36:40.087434 | controller | TASK [reproducer : Ensure no allocation overlap] *******************************
2026-03-18 16:36:40.087599 | controller | Wednesday 18 March 2026  16:36:40 +0000 (0:00:00.051)       0:00:01.023 *******
2026-03-18 16:36:40.147124 | controller | skipping: [instance]
2026-03-18 16:36:40.147345 | controller |
2026-03-18 16:36:40.147541 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ******************
2026-03-18 16:36:40.147716 | controller | Wednesday 18 March 2026  16:36:40 +0000 (0:00:00.057)       0:00:01.081 *******
2026-03-18 16:36:40.202334 | controller | skipping: [instance]
2026-03-18 16:36:40.202516 | controller |
2026-03-18 16:36:40.202711 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************
2026-03-18 16:36:40.202879 | controller | Wednesday 18 March 2026  16:36:40 +0000 (0:00:00.055)       0:00:01.137 *******
2026-03-18 16:36:40.289430 | controller | skipping: [instance]
2026-03-18 16:36:40.289634 | controller |
2026-03-18 16:36:40.289818 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:40.290002 | controller | Wednesday 18 March 2026  16:36:40 +0000 (0:00:00.088)       0:00:01.225 *******
2026-03-18 16:36:40.336390 | controller | skipping: [instance]
2026-03-18 16:36:40.371667 | controller |
2026-03-18 16:36:40.371694 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:40.371703 | controller | Wednesday 18 March 2026  16:36:40 +0000 (0:00:00.045)       0:00:01.271 *******
2026-03-18 16:36:40.371713 | controller | skipping: [instance]
2026-03-18 16:36:40.413514 | controller |
2026-03-18 16:36:40.413551 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:40.413560 | controller | Wednesday 18 March 2026  16:36:40 +0000 (0:00:00.036)       0:00:01.307 *******
2026-03-18 16:36:40.413570 | controller | skipping: [instance]
2026-03-18 16:36:40.443118 | controller |
2026-03-18 16:36:40.443142 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:40.443149 | controller | Wednesday 18 March 2026  16:36:40 +0000 (0:00:00.041)       0:00:01.349 *******
2026-03-18 16:36:40.443159 | controller | ok: [instance]
2026-03-18 16:36:40.484003 | controller |
2026-03-18 16:36:40.484029 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:40.484041 | controller | Wednesday 18 March 2026  16:36:40 +0000 (0:00:00.029)       0:00:01.379 *******
2026-03-18 16:36:40.484057 | controller | ok: [instance]
2026-03-18 16:36:40.589405 | controller |
2026-03-18 16:36:40.589447 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:40.589460 | controller | Wednesday 18 March 2026  16:36:40 +0000 (0:00:00.040)       0:00:01.419 *******
2026-03-18 16:36:40.589472 | controller | ok: [instance] =>
2026-03-18 16:36:40.645866 | controller |   msg: 'Running: No volume, with worker'
2026-03-18 16:36:40.645898 | controller |
2026-03-18 16:36:40.645906 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:40.645912 | controller | Wednesday 18 March 2026  16:36:40 +0000 (0:00:00.105)       0:00:01.524 *******
2026-03-18 16:36:40.645921 | controller |
2026-03-18 16:36:40.646129 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-18 16:36:40.646339 | controller | Wednesday 18 March 2026  16:36:40 +0000 (0:00:00.057)       0:00:01.582 *******
2026-03-18 16:36:40.723489 | controller | ok: [instance]
2026-03-18 16:36:40.723719 | controller |
2026-03-18 16:36:40.723910 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-18 16:36:40.724098 | controller | Wednesday 18 March 2026  16:36:40 +0000 (0:00:00.077)       0:00:01.659 *******
2026-03-18 16:36:40.899000 | controller | ok: [instance]
2026-03-18 16:36:40.899184 | controller |
2026-03-18 16:36:40.899333 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-18 16:36:40.899472 | controller | Wednesday 18 March 2026  16:36:40 +0000 (0:00:00.175)       0:00:01.835 *******
2026-03-18 16:36:41.026724 | controller | ok: [instance]
2026-03-18 16:36:41.026957 | controller |
2026-03-18 16:36:41.027129 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-18 16:36:41.027277 | controller | Wednesday 18 March 2026  16:36:41 +0000 (0:00:00.127)       0:00:01.963 *******
2026-03-18 16:36:41.130708 | controller | ok: [instance]
2026-03-18 16:36:41.130911 | controller |
2026-03-18 16:36:41.131117 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-18 16:36:41.131316 | controller | Wednesday 18 March 2026  16:36:41 +0000 (0:00:00.103)       0:00:02.066 *******
2026-03-18 16:36:41.221869 | controller | ok: [instance]
2026-03-18 16:36:41.222102 | controller |
2026-03-18 16:36:41.222306 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-18 16:36:41.222487 | controller | Wednesday 18 March 2026  16:36:41 +0000 (0:00:00.091)       0:00:02.158 *******
2026-03-18 16:36:41.281529 | controller | skipping: [instance]
2026-03-18 16:36:41.281700 | controller |
2026-03-18 16:36:41.281888 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-18 16:36:41.282082 | controller | Wednesday 18 March 2026  16:36:41 +0000 (0:00:00.059)       0:00:02.218 *******
2026-03-18 16:36:41.336190 | controller | skipping: [instance]
2026-03-18 16:36:41.336408 | controller |
2026-03-18 16:36:41.336604 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-18 16:36:41.336794 | controller | Wednesday 18 March 2026  16:36:41 +0000 (0:00:00.054)       0:00:02.272 *******
2026-03-18 16:36:41.400387 | controller | skipping: [instance]
2026-03-18 16:36:41.400564 | controller |
2026-03-18 16:36:41.400712 | controller | TASK [reproducer : Ensure no allocation overlap] *******************************
2026-03-18 16:36:41.400884 | controller | Wednesday 18 March 2026  16:36:41 +0000 (0:00:00.061)       0:00:02.334 *******
2026-03-18 16:36:41.475412 | controller | skipping: [instance]
2026-03-18 16:36:41.475608 | controller |
2026-03-18 16:36:41.475790 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ******************
2026-03-18 16:36:41.475982 | controller | Wednesday 18 March 2026  16:36:41 +0000 (0:00:00.077)       0:00:02.411 *******
2026-03-18 16:36:41.601957 | controller | skipping: [instance]
2026-03-18 16:36:41.602168 | controller |
2026-03-18 16:36:41.602352 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************
2026-03-18 16:36:41.602494 | controller | Wednesday 18 March 2026  16:36:41 +0000 (0:00:00.125)       0:00:02.537 *******
2026-03-18 16:36:41.701295 | controller | skipping: [instance]
2026-03-18 16:36:41.701497 | controller |
2026-03-18 16:36:41.701689 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:41.701876 | controller | Wednesday 18 March 2026  16:36:41 +0000 (0:00:00.100)       0:00:02.637 *******
2026-03-18 16:36:41.852844 | controller | skipping: [instance]
2026-03-18 16:36:41.853088 | controller |
2026-03-18 16:36:41.853282 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:41.853448 | controller | Wednesday 18 March 2026  16:36:41 +0000 (0:00:00.151)       0:00:02.788 *******
2026-03-18 16:36:41.910035 | controller | skipping: [instance]
2026-03-18 16:36:41.910254 | controller |
2026-03-18 16:36:41.910437 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:41.910638 | controller | Wednesday 18 March 2026  16:36:41 +0000 (0:00:00.057)       0:00:02.846 *******
2026-03-18 16:36:41.983341 | controller | skipping: [instance]
2026-03-18 16:36:42.018304 | controller |
2026-03-18 16:36:42.018325 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:42.018337 | controller | Wednesday 18 March 2026  16:36:41 +0000 (0:00:00.072)       0:00:02.919 *******
2026-03-18 16:36:42.018361 | controller | ok: [instance]
2026-03-18 16:36:42.067785 | controller |
2026-03-18 16:36:42.067812 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:42.067821 | controller | Wednesday 18 March 2026  16:36:42 +0000 (0:00:00.034)       0:00:02.954 *******
2026-03-18 16:36:42.067831 | controller | ok: [instance]
2026-03-18 16:36:42.109311 | controller |
2026-03-18 16:36:42.109337 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:42.109348 | controller | Wednesday 18 March 2026  16:36:42 +0000 (0:00:00.049)       0:00:03.003 *******
2026-03-18 16:36:42.109359 | controller | ok: [instance] =>
2026-03-18 16:36:42.161082 | controller |   msg: 'Running: Volume, no worker'
2026-03-18 16:36:42.161106 | controller |
2026-03-18 16:36:42.161114 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:42.161120 | controller | Wednesday 18 March 2026  16:36:42 +0000 (0:00:00.041)       0:00:03.045 *******
2026-03-18 16:36:42.161130 | controller |
2026-03-18 16:36:42.239737 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-18 16:36:42.239775 | controller | Wednesday 18 March 2026  16:36:42 +0000 (0:00:00.052)       0:00:03.097 *******
2026-03-18 16:36:42.239790 | controller | ok: [instance]
2026-03-18 16:36:42.300255 | controller |
2026-03-18 16:36:42.300279 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-18 16:36:42.300287 | controller | Wednesday 18 March 2026  16:36:42 +0000 (0:00:00.078)       0:00:03.175 *******
2026-03-18 16:36:42.300316 | controller | ok: [instance]
2026-03-18 16:36:42.437858 | controller |
2026-03-18 16:36:42.437947 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-18 16:36:42.437962 | controller | Wednesday 18 March 2026  16:36:42 +0000 (0:00:00.060)       0:00:03.236 *******
2026-03-18 16:36:42.437983 | controller | ok: [instance]
2026-03-18 16:36:42.438179 | controller |
2026-03-18 16:36:42.438374 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-18 16:36:42.438579 | controller | Wednesday 18 March 2026  16:36:42 +0000 (0:00:00.137)       0:00:03.373 *******
2026-03-18 16:36:42.496527 | controller | skipping: [instance]
2026-03-18 16:36:42.496727 | controller |
2026-03-18 16:36:42.496895 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-18 16:36:42.497098 | controller | Wednesday 18 March 2026  16:36:42 +0000 (0:00:00.057)       0:00:03.431 *******
2026-03-18 16:36:42.561917 | controller | skipping: [instance]
2026-03-18 16:36:42.562122 | controller |
2026-03-18 16:36:42.562320 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-18 16:36:42.562500 | controller | Wednesday 18 March 2026  16:36:42 +0000 (0:00:00.067)       0:00:03.498 *******
2026-03-18 16:36:42.624726 | controller | ok: [instance]
2026-03-18 16:36:42.624955 | controller |
2026-03-18 16:36:42.625148 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-18 16:36:42.625333 | controller | Wednesday 18 March 2026  16:36:42 +0000 (0:00:00.062)       0:00:03.561 *******
2026-03-18 16:36:42.678677 | controller | skipping: [instance]
2026-03-18 16:36:42.678850 | controller |
2026-03-18 16:36:42.679037 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-18 16:36:42.679201 | controller | Wednesday 18 March 2026  16:36:42 +0000 (0:00:00.052)       0:00:03.614 *******
2026-03-18 16:36:42.768187 | controller | ok: [instance]
2026-03-18 16:36:42.768365 | controller |
2026-03-18 16:36:42.768555 | controller | TASK [reproducer : Ensure no allocation overlap] *******************************
2026-03-18 16:36:42.768744 | controller | Wednesday 18 March 2026  16:36:42 +0000 (0:00:00.090)       0:00:03.704 *******
2026-03-18 16:36:42.869404 | controller | ok: [instance]
2026-03-18 16:36:42.869603 | controller |
2026-03-18 16:36:42.869781 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ******************
2026-03-18 16:36:42.869976 | controller | Wednesday 18 March 2026  16:36:42 +0000 (0:00:00.100)       0:00:03.805 *******
2026-03-18 16:36:43.272892 | controller | ok: [instance] => changed=false
2026-03-18 16:36:43.273110 | controller |   msg: All assertions passed
2026-03-18 16:36:43.273272 | controller |
2026-03-18 16:36:43.273442 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************
2026-03-18 16:36:43.273620 | controller | Wednesday 18 March 2026  16:36:43 +0000 (0:00:00.403)       0:00:04.208 *******
2026-03-18 16:36:43.408285 | controller | ok: [instance] => changed=false
2026-03-18 16:36:43.408479 | controller |   msg: All assertions passed
2026-03-18 16:36:43.408661 | controller |
2026-03-18 16:36:43.408848 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:43.409066 | controller | Wednesday 18 March 2026  16:36:43 +0000 (0:00:00.134)       0:00:04.343 *******
2026-03-18 16:36:43.464588 | controller | skipping: [instance]
2026-03-18 16:36:43.464767 | controller |
2026-03-18 16:36:43.464922 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:43.465099 | controller | Wednesday 18 March 2026  16:36:43 +0000 (0:00:00.056)       0:00:04.400 *******
2026-03-18 16:36:43.525047 | controller | skipping: [instance]
2026-03-18 16:36:43.525262 | controller |
2026-03-18 16:36:43.525454 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:43.525649 | controller | Wednesday 18 March 2026  16:36:43 +0000 (0:00:00.060)       0:00:04.461 *******
2026-03-18 16:36:43.577540 | controller | skipping: [instance]
2026-03-18 16:36:43.577733 | controller |
2026-03-18 16:36:43.577949 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:43.578141 | controller | Wednesday 18 March 2026  16:36:43 +0000 (0:00:00.052)       0:00:04.514 *******
2026-03-18 16:36:43.610235 | controller | ok: [instance]
2026-03-18 16:36:43.610426 | controller |
2026-03-18 16:36:43.610627 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:43.610790 | controller | Wednesday 18 March 2026  16:36:43 +0000 (0:00:00.031)       0:00:04.545 *******
2026-03-18 16:36:43.649460 | controller | ok: [instance]
2026-03-18 16:36:43.649663 | controller |
2026-03-18 16:36:43.649852 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:43.650062 | controller | Wednesday 18 March 2026  16:36:43 +0000 (0:00:00.038)       0:00:04.584 *******
2026-03-18 16:36:43.681696 | controller | ok: [instance] =>
2026-03-18 16:36:43.681883 | controller |   msg: 'Running: Volume, with worker'
2026-03-18 16:36:43.682073 | controller |
2026-03-18 16:36:43.682262 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:43.682458 | controller | Wednesday 18 March 2026  16:36:43 +0000 (0:00:00.033)       0:00:04.618 *******
2026-03-18 16:36:43.733033 | controller |
2026-03-18 16:36:43.733255 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-18 16:36:43.733449 | controller | Wednesday 18 March 2026  16:36:43 +0000 (0:00:00.051)       0:00:04.669 *******
2026-03-18 16:36:43.812259 | controller | ok: [instance]
2026-03-18 16:36:43.871040 | controller |
2026-03-18 16:36:43.871067 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-18 16:36:43.871080 | controller | Wednesday 18 March 2026  16:36:43 +0000 (0:00:00.078)       0:00:04.748 *******
2026-03-18 16:36:43.871092 | controller | ok: [instance]
2026-03-18 16:36:43.963326 | controller |
2026-03-18 16:36:43.963359 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-18 16:36:43.963369 | controller | Wednesday 18 March 2026  16:36:43 +0000 (0:00:00.057)       0:00:04.806 *******
2026-03-18 16:36:43.963379 | controller | ok: [instance]
2026-03-18 16:36:44.107899 | controller |
2026-03-18 16:36:44.107949 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-18 16:36:44.107962 | controller | Wednesday 18 March 2026  16:36:43 +0000 (0:00:00.092)       0:00:04.899 *******
2026-03-18 16:36:44.107973 | controller | ok: [instance]
2026-03-18 16:36:44.166769 | controller |
2026-03-18 16:36:44.166796 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-18 16:36:44.166808 | controller | Wednesday 18 March 2026  16:36:44 +0000 (0:00:00.144)       0:00:05.043 *******
2026-03-18 16:36:44.166819 | controller | skipping: [instance]
2026-03-18 16:36:44.233345 | controller |
2026-03-18 16:36:44.233368 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-18 16:36:44.233375 | controller | Wednesday 18 March 2026  16:36:44 +0000 (0:00:00.059)       0:00:05.102 *******
2026-03-18 16:36:44.233399 | controller | ok: [instance]
2026-03-18 16:36:44.304220 | controller |
2026-03-18 16:36:44.304249 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-18 16:36:44.304264 | controller | Wednesday 18 March 2026  16:36:44 +0000 (0:00:00.066)       0:00:05.169 *******
2026-03-18 16:36:44.304277 | controller | ok: [instance]
2026-03-18 16:36:44.422819 | controller |
2026-03-18 16:36:44.422846 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-18 16:36:44.422854 | controller | Wednesday 18 March 2026  16:36:44 +0000 (0:00:00.070)       0:00:05.240 *******
2026-03-18 16:36:44.422866 | controller | ok: [instance]
2026-03-18 16:36:44.530658 | controller |
2026-03-18 16:36:44.530706 | controller | TASK [reproducer : Ensure no allocation overlap] *******************************
2026-03-18 16:36:44.530720 | controller | Wednesday 18 March 2026  16:36:44 +0000 (0:00:00.118)       0:00:05.358 *******
2026-03-18 16:36:44.530737 | controller | ok: [instance]
2026-03-18 16:36:44.629517 | controller |
2026-03-18 16:36:44.629587 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ******************
2026-03-18 16:36:44.629601 | controller | Wednesday 18 March 2026  16:36:44 +0000 (0:00:00.107)       0:00:05.466 *******
2026-03-18 16:36:44.629613 | controller | ok: [instance] => changed=false
2026-03-18 16:36:44.746943 | controller |   msg: All assertions passed
2026-03-18 16:36:44.746985 | controller |
2026-03-18 16:36:44.746999 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************
2026-03-18 16:36:44.747012 | controller | Wednesday 18 March 2026  16:36:44 +0000 (0:00:00.098)       0:00:05.565 *******
2026-03-18 16:36:44.747032 | controller | ok: [instance] => changed=false
2026-03-18 16:36:44.747225 | controller |   msg: All assertions passed
2026-03-18 16:36:44.747385 | controller |
2026-03-18 16:36:44.747572 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:44.747743 | controller | Wednesday 18 March 2026  16:36:44 +0000 (0:00:00.118)       0:00:05.683 *******
2026-03-18 16:36:44.806523 | controller | skipping: [instance]
2026-03-18 16:36:44.806725 | controller |
2026-03-18 16:36:44.806905 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:44.807093 | controller | Wednesday 18 March 2026  16:36:44 +0000 (0:00:00.057)       0:00:05.740 *******
2026-03-18 16:36:44.853664 | controller | skipping: [instance]
2026-03-18 16:36:44.853840 | controller |
2026-03-18 16:36:44.854029 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:44.854225 | controller | Wednesday 18 March 2026  16:36:44 +0000 (0:00:00.049)       0:00:05.790 *******
2026-03-18 16:36:44.901490 | controller | skipping: [instance]
2026-03-18 16:36:44.901692 | controller |
2026-03-18 16:36:44.901888 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:44.902079 | controller | Wednesday 18 March 2026  16:36:44 +0000 (0:00:00.047)       0:00:05.837 *******
2026-03-18 16:36:44.935708 | controller | ok: [instance]
2026-03-18 16:36:44.935892 | controller |
2026-03-18 16:36:44.936095 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:44.936284 | controller | Wednesday 18 March 2026  16:36:44 +0000 (0:00:00.034)       0:00:05.872 *******
2026-03-18 16:36:44.969227 | controller | ok: [instance]
2026-03-18 16:36:44.969422 | controller |
2026-03-18 16:36:44.969611 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:44.969786 | controller | Wednesday 18 March 2026  16:36:44 +0000 (0:00:00.033)       0:00:05.905 *******
2026-03-18 16:36:45.000320 | controller | ok: [instance] =>
2026-03-18 16:36:45.000506 | controller |   msg: 'Running: Too many allocated volumes'
2026-03-18 16:36:45.000654 | controller |
2026-03-18 16:36:45.000792 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:45.000972 | controller | Wednesday 18 March 2026  16:36:44 +0000 (0:00:00.030)       0:00:05.936 *******
2026-03-18 16:36:45.053387 | controller |
2026-03-18 16:36:45.053653 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-18 16:36:45.053836 | controller | Wednesday 18 March 2026  16:36:45 +0000 (0:00:00.053)       0:00:05.989 *******
2026-03-18 16:36:45.286458 | controller | ok: [instance]
2026-03-18 16:36:45.286691 | controller |
2026-03-18 16:36:45.286884 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-18 16:36:45.287080 | controller | Wednesday 18 March 2026  16:36:45 +0000 (0:00:00.232)       0:00:06.222 *******
2026-03-18 16:36:45.351624 | controller | ok: [instance]
2026-03-18 16:36:45.351836 | controller |
2026-03-18 16:36:45.352063 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-18 16:36:45.352246 | controller | Wednesday 18 March 2026  16:36:45 +0000 (0:00:00.065)       0:00:06.287 *******
2026-03-18 16:36:45.449106 | controller | ok: [instance]
2026-03-18 16:36:45.449327 | controller |
2026-03-18 16:36:45.449521 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-18 16:36:45.449710 | controller | Wednesday 18 March 2026  16:36:45 +0000 (0:00:00.097)       0:00:06.385 *******
2026-03-18 16:36:45.531740 | controller | skipping: [instance]
2026-03-18 16:36:45.532050 | controller |
2026-03-18 16:36:45.532256 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-18 16:36:45.532440 | controller | Wednesday 18 March 2026  16:36:45 +0000 (0:00:00.081)       0:00:06.467 *******
2026-03-18 16:36:45.651944 | controller | skipping: [instance]
2026-03-18 16:36:45.652172 | controller |
2026-03-18 16:36:45.652337 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-18 16:36:45.652503 | controller | Wednesday 18 March 2026  16:36:45 +0000 (0:00:00.120)       0:00:06.587 *******
2026-03-18 16:36:45.719139 | controller | ok: [instance]
2026-03-18 16:36:45.719362 | controller |
2026-03-18 16:36:45.719599 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-18 16:36:45.719748 | controller | Wednesday 18 March 2026  16:36:45 +0000 (0:00:00.067)       0:00:06.655 *******
2026-03-18 16:36:45.794502 | controller | skipping: [instance]
2026-03-18 16:36:45.794759 | controller |
2026-03-18 16:36:45.794977 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-18 16:36:45.795193 | controller | Wednesday 18 March 2026  16:36:45 +0000 (0:00:00.069)       0:00:06.724 *******
2026-03-18 16:36:45.871841 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:45.910812 | controller |   assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int
2026-03-18 16:36:45.910849 | controller |   evaluated_to: false
2026-03-18 16:36:45.910859 | controller |   msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 3'
2026-03-18 16:36:45.910870 | controller |
2026-03-18 16:36:45.958404 | controller | TASK [Clear host errors] *******************************************************
2026-03-18 16:36:45.958436 | controller | Wednesday 18 March 2026  16:36:45 +0000 (0:00:00.099)       0:00:06.824 *******
2026-03-18 16:36:45.958445 | controller |
2026-03-18 16:36:45.958451 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:45.958457 | controller | Wednesday 18 March 2026  16:36:45 +0000 (0:00:00.021)       0:00:06.845 *******
2026-03-18 16:36:45.958473 | controller | ok: [instance]
2026-03-18 16:36:46.025980 | controller |
2026-03-18 16:36:46.026003 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:46.026011 | controller | Wednesday 18 March 2026  16:36:45 +0000 (0:00:00.048)       0:00:06.894 *******
2026-03-18 16:36:46.026021 | controller | skipping: [instance]
2026-03-18 16:36:46.195278 | controller |
2026-03-18 16:36:46.195315 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:46.195332 | controller | Wednesday 18 March 2026  16:36:46 +0000 (0:00:00.064)       0:00:06.958 *******
2026-03-18 16:36:46.195354 | controller | skipping: [instance]
2026-03-18 16:36:46.263981 | controller |
2026-03-18 16:36:46.264012 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:46.264021 | controller | Wednesday 18 March 2026  16:36:46 +0000 (0:00:00.172)       0:00:07.131 *******
2026-03-18 16:36:46.264032 | controller | skipping: [instance]
2026-03-18 16:36:46.303040 | controller |
2026-03-18 16:36:46.303069 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:46.303077 | controller | Wednesday 18 March 2026  16:36:46 +0000 (0:00:00.061)       0:00:07.192 *******
2026-03-18 16:36:46.303088 | controller | ok: [instance]
2026-03-18 16:36:46.359211 | controller |
2026-03-18 16:36:46.359259 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:46.359269 | controller | Wednesday 18 March 2026  16:36:46 +0000 (0:00:00.046)       0:00:07.239 *******
2026-03-18 16:36:46.359280 | controller | ok: [instance]
2026-03-18 16:36:46.398147 | controller |
2026-03-18 16:36:46.398185 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:46.398194 | controller | Wednesday 18 March 2026  16:36:46 +0000 (0:00:00.055)       0:00:07.295 *******
2026-03-18 16:36:46.398205 | controller | ok: [instance] =>
2026-03-18 16:36:46.475725 | controller |   msg: 'Running: Different volume amount'
2026-03-18 16:36:46.476495 | controller |
2026-03-18 16:36:46.476520 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:46.476594 | controller | Wednesday 18 March 2026  16:36:46 +0000 (0:00:00.036)       0:00:07.331 *******
2026-03-18 16:36:46.476667 | controller |
2026-03-18 16:36:46.556605 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-18 16:36:46.556632 | controller | Wednesday 18 March 2026  16:36:46 +0000 (0:00:00.069)       0:00:07.401 *******
2026-03-18 16:36:46.556645 | controller | ok: [instance]
2026-03-18 16:36:46.630337 | controller |
2026-03-18 16:36:46.630373 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-18 16:36:46.630382 | controller | Wednesday 18 March 2026  16:36:46 +0000 (0:00:00.090)       0:00:07.492 *******
2026-03-18 16:36:46.630393 | controller | ok: [instance]
2026-03-18 16:36:46.782076 | controller |
2026-03-18 16:36:46.782125 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-18 16:36:46.782134 | controller | Wednesday 18 March 2026  16:36:46 +0000 (0:00:00.068)       0:00:07.560 *******
2026-03-18 16:36:46.782145 | controller | ok: [instance]
2026-03-18 16:36:46.892721 | controller |
2026-03-18 16:36:46.892764 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-18 16:36:46.892776 | controller | Wednesday 18 March 2026  16:36:46 +0000 (0:00:00.154)       0:00:07.715 *******
2026-03-18 16:36:46.892787 | controller | ok: [instance]
2026-03-18 16:36:46.966116 | controller |
2026-03-18 16:36:46.966156 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-18 16:36:46.966167 | controller | Wednesday 18 March 2026  16:36:46 +0000 (0:00:00.109)       0:00:07.824 *******
2026-03-18 16:36:46.966178 | controller | skipping: [instance]
2026-03-18 16:36:47.024746 | controller |
2026-03-18 16:36:47.024782 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-18 16:36:47.024791 | controller | Wednesday 18 March 2026  16:36:46 +0000 (0:00:00.072)       0:00:07.897 *******
2026-03-18 16:36:47.024803 | controller | ok: [instance]
2026-03-18 16:36:47.083081 | controller |
2026-03-18 16:36:47.083116 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-18 16:36:47.083131 | controller | Wednesday 18 March 2026  16:36:47 +0000 (0:00:00.063)       0:00:07.960 *******
2026-03-18 16:36:47.083143 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:47.147668 | controller |   assertion: (_work.extra_disks_num is defined and _ocp.extra_disks_num == _work.extra_disks_num and _ocp.extra_disks_size is defined and _work.extra_disks_size is defined and _ocp.extra_disks_size == _work.extra_disks_size) or _ocp.extra_disks_num is undefined or _ocp.extra_disks_num == 0
2026-03-18 16:36:47.147721 | controller |   evaluated_to: false
2026-03-18 16:36:47.147730 | controller |   msg: 'Inconsistency detected: ensure you don''t allocate more disks in cifmw_lvms_disk_list and cifmw_devscripts_cinder_volume_pvs than available.'
2026-03-18 16:36:47.147751 | controller |
2026-03-18 16:36:47.179485 | controller | TASK [Clear host errors] *******************************************************
2026-03-18 16:36:47.179523 | controller | Wednesday 18 March 2026  16:36:47 +0000 (0:00:00.069)       0:00:08.030 *******
2026-03-18 16:36:47.179531 | controller |
2026-03-18 16:36:47.179542 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:47.179549 | controller | Wednesday 18 March 2026  16:36:47 +0000 (0:00:00.052)       0:00:08.083 *******
2026-03-18 16:36:47.179560 | controller | ok: [instance]
2026-03-18 16:36:47.265042 | controller |
2026-03-18 16:36:47.265065 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:47.265073 | controller | Wednesday 18 March 2026  16:36:47 +0000 (0:00:00.032)       0:00:08.115 *******
2026-03-18 16:36:47.265084 | controller | skipping: [instance]
2026-03-18 16:36:47.308925 | controller |
2026-03-18 16:36:47.308970 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:47.308982 | controller | Wednesday 18 March 2026  16:36:47 +0000 (0:00:00.081)       0:00:08.197 *******
2026-03-18 16:36:47.308994 | controller | skipping: [instance]
2026-03-18 16:36:47.352027 | controller |
2026-03-18 16:36:47.352047 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:47.352055 | controller | Wednesday 18 March 2026  16:36:47 +0000 (0:00:00.044)       0:00:08.242 *******
2026-03-18 16:36:47.352069 | controller | skipping: [instance]
2026-03-18 16:36:47.382828 | controller |
2026-03-18 16:36:47.382854 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:47.382863 | controller | Wednesday 18 March 2026  16:36:47 +0000 (0:00:00.045)       0:00:08.287 *******
2026-03-18 16:36:47.382872 | controller | ok: [instance]
2026-03-18 16:36:47.417175 | controller |
2026-03-18 16:36:47.417197 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:47.417205 | controller | Wednesday 18 March 2026  16:36:47 +0000 (0:00:00.031)       0:00:08.319 *******
2026-03-18 16:36:47.417214 | controller | ok: [instance]
2026-03-18 16:36:47.452561 | controller |
2026-03-18 16:36:47.452582 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:47.452595 | controller | Wednesday 18 March 2026  16:36:47 +0000 (0:00:00.031)       0:00:08.350 *******
2026-03-18 16:36:47.452606 | controller | ok: [instance] =>
2026-03-18 16:36:47.452794 | controller |   msg: 'Running: Create LVM without volume'
2026-03-18 16:36:47.452997 | controller |
2026-03-18 16:36:47.453206 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:47.453360 | controller | Wednesday 18 March 2026  16:36:47 +0000 (0:00:00.036)       0:00:08.386 *******
2026-03-18 16:36:47.509408 | controller |
2026-03-18 16:36:47.510866 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-18 16:36:47.511307 | controller | Wednesday 18 March 2026  16:36:47 +0000 (0:00:00.057)       0:00:08.444 *******
2026-03-18 16:36:47.599021 | controller | ok: [instance]
2026-03-18 16:36:47.599199 | controller |
2026-03-18 16:36:47.599376 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-18 16:36:47.599547 | controller | Wednesday 18 March 2026  16:36:47 +0000 (0:00:00.090)       0:00:08.535 *******
2026-03-18 16:36:47.660973 | controller | ok: [instance]
2026-03-18 16:36:47.661183 | controller |
2026-03-18 16:36:47.661369 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-18 16:36:47.661560 | controller | Wednesday 18 March 2026  16:36:47 +0000 (0:00:00.057)       0:00:08.592 *******
2026-03-18 16:36:47.756847 | controller | ok: [instance]
2026-03-18 16:36:47.757065 | controller |
2026-03-18 16:36:47.757253 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-18 16:36:47.757430 | controller | Wednesday 18 March 2026  16:36:47 +0000 (0:00:00.095)       0:00:08.688 *******
2026-03-18 16:36:47.977162 | controller | skipping: [instance]
2026-03-18 16:36:47.977517 | controller |
2026-03-18 16:36:47.977704 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-18 16:36:47.977866 | controller | Wednesday 18 March 2026  16:36:47 +0000 (0:00:00.225)       0:00:08.913 *******
2026-03-18 16:36:48.087668 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:48.126036 | controller |   assertion: not cifmw_devscripts_create_logical_volume | bool
2026-03-18 16:36:48.126066 | controller |   evaluated_to: false
2026-03-18 16:36:48.126076 | controller |   msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members'
2026-03-18 16:36:48.126092 | controller |
2026-03-18 16:36:48.163369 | controller | TASK [Clear host errors] *******************************************************
2026-03-18 16:36:48.163396 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.125)       0:00:09.039 *******
2026-03-18 16:36:48.163404 | controller |
2026-03-18 16:36:48.163410 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:48.163422 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.022)       0:00:09.061 *******
2026-03-18 16:36:48.163433 | controller | ok: [instance]
2026-03-18 16:36:48.211569 | controller |
2026-03-18 16:36:48.211594 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:48.211603 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.037)       0:00:09.099 *******
2026-03-18 16:36:48.211612 | controller | skipping: [instance]
2026-03-18 16:36:48.252893 | controller |
2026-03-18 16:36:48.252917 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:48.252937 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.045)       0:00:09.144 *******
2026-03-18 16:36:48.252947 | controller | skipping: [instance]
2026-03-18 16:36:48.296714 | controller |
2026-03-18 16:36:48.296739 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:48.296747 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.044)       0:00:09.189 *******
2026-03-18 16:36:48.296768 | controller | skipping: [instance]
2026-03-18 16:36:48.335556 | controller |
2026-03-18 16:36:48.335583 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:48.335591 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.043)       0:00:09.232 *******
2026-03-18 16:36:48.335601 | controller | ok: [instance]
2026-03-18 16:36:48.335864 | controller |
2026-03-18 16:36:48.336073 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:48.336253 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.039)       0:00:09.272 *******
2026-03-18 16:36:48.376420 | controller | ok: [instance]
2026-03-18 16:36:48.376616 | controller |
2026-03-18 16:36:48.376775 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:48.376949 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.040)       0:00:09.312 *******
2026-03-18 16:36:48.472373 | controller | ok: [instance] =>
2026-03-18 16:36:48.472585 | controller |   msg: 'Running: Create LVMS without volume'
2026-03-18 16:36:48.472731 | controller |
2026-03-18 16:36:48.472883 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:48.473067 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.095)       0:00:09.408 *******
2026-03-18 16:36:48.525905 | controller |
2026-03-18 16:36:48.526109 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-18 16:36:48.526274 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.053)       0:00:09.462 *******
2026-03-18 16:36:48.598964 | controller | ok: [instance]
2026-03-18 16:36:48.599153 | controller |
2026-03-18 16:36:48.599327 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-18 16:36:48.599512 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.073)       0:00:09.535 *******
2026-03-18 16:36:48.663432 | controller | ok: [instance]
2026-03-18 16:36:48.663632 | controller |
2026-03-18 16:36:48.663820 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-18 16:36:48.664019 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.064)       0:00:09.600 *******
2026-03-18 16:36:48.757159 | controller | ok: [instance]
2026-03-18 16:36:48.757357 | controller |
2026-03-18 16:36:48.757545 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-18 16:36:48.757720 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.089)       0:00:09.690 *******
2026-03-18 16:36:48.813666 | controller | skipping: [instance]
2026-03-18 16:36:48.813863 | controller |
2026-03-18 16:36:48.814292 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-18 16:36:48.814465 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.060)       0:00:09.750 *******
2026-03-18 16:36:48.865966 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:48.866143 | controller |   assertion: cifmw_lvms_disk_list is undefined or (cifmw_lvms_disk_list | length) == 0
2026-03-18 16:36:48.866321 | controller |   evaluated_to: false
2026-03-18 16:36:48.866474 | controller |   msg: 'Inconsistency detected: cifmw_devscripts_create_logical_volume is set to "true" or cifmw_lvms_disk_list is non-empty while you don''t allocate any extra disks to the OCP cluster members'
2026-03-18 16:36:48.901890 | controller |
2026-03-18 16:36:48.902113 | controller | TASK [Clear host errors] *******************************************************
2026-03-18 16:36:48.902286 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.068)       0:00:09.818 *******
2026-03-18 16:36:48.902439 | controller |
2026-03-18 16:36:48.902613 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:48.902773 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.019)       0:00:09.838 *******
2026-03-18 16:36:48.931866 | controller | ok: [instance]
2026-03-18 16:36:48.932075 | controller |
2026-03-18 16:36:48.932256 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:48.932423 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.030)       0:00:09.868 *******
2026-03-18 16:36:48.982939 | controller | skipping: [instance]
2026-03-18 16:36:48.983116 | controller |
2026-03-18 16:36:48.983268 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:48.983423 | controller | Wednesday 18 March 2026  16:36:48 +0000 (0:00:00.050)       0:00:09.919 *******
2026-03-18 16:36:49.036396 | controller | skipping: [instance]
2026-03-18 16:36:49.036580 | controller |
2026-03-18 16:36:49.036739 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:49.036901 | controller | Wednesday 18 March 2026  16:36:49 +0000 (0:00:00.052)       0:00:09.972 *******
2026-03-18 16:36:49.088801 | controller | skipping: [instance]
2026-03-18 16:36:49.089022 | controller |
2026-03-18 16:36:49.089238 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:49.089447 | controller | Wednesday 18 March 2026  16:36:49 +0000 (0:00:00.051)       0:00:10.024 *******
2026-03-18 16:36:49.128271 | controller | ok: [instance]
2026-03-18 16:36:49.128492 | controller |
2026-03-18 16:36:49.128727 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:49.128912 | controller | Wednesday 18 March 2026  16:36:49 +0000 (0:00:00.038)       0:00:10.062 *******
2026-03-18 16:36:49.179392 | controller | ok: [instance]
2026-03-18 16:36:49.179637 | controller |
2026-03-18 16:36:49.179829 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:49.180025 | controller | Wednesday 18 March 2026  16:36:49 +0000 (0:00:00.052)       0:00:10.115 *******
2026-03-18 16:36:49.217656 | controller | ok: [instance] =>
2026-03-18 16:36:49.270141 | controller |   msg: 'Running: Allocate same volume twice'
2026-03-18 16:36:49.270164 | controller |
2026-03-18 16:36:49.270181 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:49.270188 | controller | Wednesday 18 March 2026  16:36:49 +0000 (0:00:00.038)       0:00:10.153 *******
2026-03-18 16:36:49.270198 | controller |
2026-03-18 16:36:49.351432 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-18 16:36:49.351455 | controller | Wednesday 18 March 2026  16:36:49 +0000 (0:00:00.052)       0:00:10.206 *******
2026-03-18 16:36:49.351473 | controller | ok: [instance]
2026-03-18 16:36:49.412719 | controller |
2026-03-18 16:36:49.412746 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-18 16:36:49.412757 | controller | Wednesday 18 March 2026  16:36:49 +0000 (0:00:00.081)       0:00:10.287 *******
2026-03-18 16:36:49.412767 | controller | ok: [instance]
2026-03-18 16:36:49.511956 | controller |
2026-03-18 16:36:49.511992 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-18 16:36:49.512006 | controller | Wednesday 18 March 2026  16:36:49 +0000 (0:00:00.061)       0:00:10.348 *******
2026-03-18 16:36:49.512019 | controller | ok: [instance]
2026-03-18 16:36:49.568092 | controller |
2026-03-18 16:36:49.568124 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-18 16:36:49.568132 | controller | Wednesday 18 March 2026  16:36:49 +0000 (0:00:00.098)       0:00:10.447 *******
2026-03-18 16:36:49.568151 | controller | skipping: [instance]
2026-03-18 16:36:49.702875 | controller |
2026-03-18 16:36:49.702917 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-18 16:36:49.702942 | controller | Wednesday 18 March 2026  16:36:49 +0000 (0:00:00.056)       0:00:10.504 *******
2026-03-18 16:36:49.702957 | controller | skipping: [instance]
2026-03-18 16:36:49.767367 | controller |
2026-03-18 16:36:49.767393 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-18 16:36:49.767401 | controller | Wednesday 18 March 2026  16:36:49 +0000 (0:00:00.134)       0:00:10.638 *******
2026-03-18 16:36:49.767412 | controller | ok: [instance]
2026-03-18 16:36:49.831844 | controller |
2026-03-18 16:36:49.831875 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-18 16:36:49.831885 | controller | Wednesday 18 March 2026  16:36:49 +0000 (0:00:00.064)       0:00:10.703 *******
2026-03-18 16:36:49.831895 | controller | skipping: [instance]
2026-03-18 16:36:49.909255 | controller |
2026-03-18 16:36:49.909291 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-18 16:36:49.909304 | controller | Wednesday 18 March 2026  16:36:49 +0000 (0:00:00.062)       0:00:10.766 *******
2026-03-18 16:36:49.909315 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:49.941665 | controller |   assertion: (_cinder_vols + _lvms_vols) | length <= _ocp.extra_disks_num | int
2026-03-18 16:36:49.941689 | controller |   evaluated_to: false
2026-03-18 16:36:49.941697 | controller |   msg: 'Inconsistency detected: Created amount of volumes 2 is smaller than allocated volumes 4'
2026-03-18 16:36:49.941707 | controller |
2026-03-18 16:36:49.941870 | controller | TASK [Clear host errors] *******************************************************
2026-03-18 16:36:49.942058 | controller | Wednesday 18 March 2026  16:36:49 +0000 (0:00:00.094)       0:00:10.861 *******
2026-03-18 16:36:49.942209 | controller |
2026-03-18 16:36:49.942386 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:49.942566 | controller | Wednesday 18 March 2026  16:36:49 +0000 (0:00:00.017)       0:00:10.878 *******
2026-03-18 16:36:49.973670 | controller | ok: [instance]
2026-03-18 16:36:49.973826 | controller |
2026-03-18 16:36:49.974050 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:49.974255 | controller | Wednesday 18 March 2026  16:36:49 +0000 (0:00:00.032)       0:00:10.910 *******
2026-03-18 16:36:50.025363 | controller | skipping: [instance]
2026-03-18 16:36:50.025555 | controller |
2026-03-18 16:36:50.025735 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:50.025910 | controller | Wednesday 18 March 2026  16:36:50 +0000 (0:00:00.051)       0:00:10.961 *******
2026-03-18 16:36:50.080736 | controller | skipping: [instance]
2026-03-18 16:36:50.080917 | controller |
2026-03-18 16:36:50.081100 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:50.081254 | controller | Wednesday 18 March 2026  16:36:50 +0000 (0:00:00.055)       0:00:11.017 *******
2026-03-18 16:36:50.235461 | controller | skipping: [instance]
2026-03-18 16:36:50.235648 | controller |
2026-03-18 16:36:50.235815 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:50.236008 | controller | Wednesday 18 March 2026  16:36:50 +0000 (0:00:00.154)       0:00:11.171 *******
2026-03-18 16:36:50.309291 | controller | ok: [instance]
2026-03-18 16:36:50.309457 | controller |
2026-03-18 16:36:50.309629 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:50.309790 | controller | Wednesday 18 March 2026  16:36:50 +0000 (0:00:00.074)       0:00:11.245 *******
2026-03-18 16:36:50.361664 | controller | ok: [instance]
2026-03-18 16:36:50.361860 | controller |
2026-03-18 16:36:50.362064 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:50.362249 | controller | Wednesday 18 March 2026  16:36:50 +0000 (0:00:00.052)       0:00:11.298 *******
2026-03-18 16:36:50.404542 | controller | ok: [instance] =>
2026-03-18 16:36:50.404751 | controller |   msg: 'Running: Allocate same volume twice - no LVMS'
2026-03-18 16:36:50.404923 | controller |
2026-03-18 16:36:50.405135 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:50.405314 | controller | Wednesday 18 March 2026  16:36:50 +0000 (0:00:00.042)       0:00:11.340 *******
2026-03-18 16:36:50.465011 | controller |
2026-03-18 16:36:50.465206 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-18 16:36:50.465343 | controller | Wednesday 18 March 2026  16:36:50 +0000 (0:00:00.060)       0:00:11.401 *******
2026-03-18 16:36:50.553035 | controller | ok: [instance]
2026-03-18 16:36:50.553188 | controller |
2026-03-18 16:36:50.553349 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-18 16:36:50.553486 | controller | Wednesday 18 March 2026  16:36:50 +0000 (0:00:00.087)       0:00:11.489 *******
2026-03-18 16:36:50.601851 | controller | ok: [instance]
2026-03-18 16:36:50.711433 | controller |
2026-03-18 16:36:50.711469 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-18 16:36:50.711480 | controller | Wednesday 18 March 2026  16:36:50 +0000 (0:00:00.048)       0:00:11.537 *******
2026-03-18 16:36:50.711490 | controller | ok: [instance]
2026-03-18 16:36:50.768590 | controller |
2026-03-18 16:36:50.768612 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-18 16:36:50.768620 | controller | Wednesday 18 March 2026  16:36:50 +0000 (0:00:00.109)       0:00:11.647 *******
2026-03-18 16:36:50.768630 | controller | skipping: [instance]
2026-03-18 16:36:50.836414 | controller |
2026-03-18 16:36:50.836444 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-18 16:36:50.836452 | controller | Wednesday 18 March 2026  16:36:50 +0000 (0:00:00.056)       0:00:11.703 *******
2026-03-18 16:36:50.836461 | controller | skipping: [instance]
2026-03-18 16:36:50.904889 | controller |
2026-03-18 16:36:50.904919 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-18 16:36:50.904943 | controller | Wednesday 18 March 2026  16:36:50 +0000 (0:00:00.069)       0:00:11.772 *******
2026-03-18 16:36:50.904956 | controller | ok: [instance]
2026-03-18 16:36:50.966909 | controller |
2026-03-18 16:36:50.966957 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-18 16:36:50.966970 | controller | Wednesday 18 March 2026  16:36:50 +0000 (0:00:00.068)       0:00:11.841 *******
2026-03-18 16:36:50.966981 | controller | skipping: [instance]
2026-03-18 16:36:51.143328 | controller |
2026-03-18 16:36:51.143369 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-18 16:36:51.143378 | controller | Wednesday 18 March 2026  16:36:50 +0000 (0:00:00.061)       0:00:11.902 *******
2026-03-18 16:36:51.143389 | controller | ok: [instance]
2026-03-18 16:36:51.143545 | controller |
2026-03-18 16:36:51.143711 | controller | TASK [reproducer : Ensure no allocation overlap] *******************************
2026-03-18 16:36:51.143883 | controller | Wednesday 18 March 2026  16:36:51 +0000 (0:00:00.176)       0:00:12.079 *******
2026-03-18 16:36:51.203230 | controller | skipping: [instance]
2026-03-18 16:36:51.203408 | controller |
2026-03-18 16:36:51.203566 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ******************
2026-03-18 16:36:51.203725 | controller | Wednesday 18 March 2026  16:36:51 +0000 (0:00:00.059)       0:00:12.139 *******
2026-03-18 16:36:51.294313 | controller | ok: [instance] => changed=false
2026-03-18 16:36:51.294512 | controller |   msg: All assertions passed
2026-03-18 16:36:51.294673 | controller |
2026-03-18 16:36:51.294829 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************
2026-03-18 16:36:51.295019 | controller | Wednesday 18 March 2026  16:36:51 +0000 (0:00:00.085)       0:00:12.225 *******
2026-03-18 16:36:51.404578 | controller | ok: [instance] => changed=false
2026-03-18 16:36:51.404806 | controller |   msg: All assertions passed
2026-03-18 16:36:51.404985 | controller |
2026-03-18 16:36:51.405152 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:51.405301 | controller | Wednesday 18 March 2026  16:36:51 +0000 (0:00:00.115)       0:00:12.340 *******
2026-03-18 16:36:51.461027 | controller | skipping: [instance]
2026-03-18 16:36:51.461257 | controller |
2026-03-18 16:36:51.461440 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:51.461656 | controller | Wednesday 18 March 2026  16:36:51 +0000 (0:00:00.051)       0:00:12.392 *******
2026-03-18 16:36:51.728807 | controller | skipping: [instance]
2026-03-18 16:36:51.729038 | controller |
2026-03-18 16:36:51.729192 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:51.729331 | controller | Wednesday 18 March 2026  16:36:51 +0000 (0:00:00.196)       0:00:12.588 *******
2026-03-18 16:36:51.775555 | controller | skipping: [instance]
2026-03-18 16:36:51.775757 | controller |
2026-03-18 16:36:51.775989 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:51.776180 | controller | Wednesday 18 March 2026  16:36:51 +0000 (0:00:00.123)       0:00:12.711 *******
2026-03-18 16:36:51.812974 | controller | ok: [instance]
2026-03-18 16:36:51.813167 | controller |
2026-03-18 16:36:51.813355 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:51.813543 | controller | Wednesday 18 March 2026  16:36:51 +0000 (0:00:00.037)       0:00:12.749 *******
2026-03-18 16:36:51.853033 | controller | ok: [instance]
2026-03-18 16:36:51.853252 | controller |
2026-03-18 16:36:51.853454 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:51.853656 | controller | Wednesday 18 March 2026  16:36:51 +0000 (0:00:00.040)       0:00:12.789 *******
2026-03-18 16:36:51.906192 | controller | ok: [instance] =>
2026-03-18 16:36:51.963114 | controller |   msg: 'Running: Allocate same volume twice - no cinder_lvm'
2026-03-18 16:36:51.963152 | controller |
2026-03-18 16:36:51.963166 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:51.963178 | controller | Wednesday 18 March 2026  16:36:51 +0000 (0:00:00.052)       0:00:12.841 *******
2026-03-18 16:36:51.963194 | controller |
2026-03-18 16:36:52.053187 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-18 16:36:52.053223 | controller | Wednesday 18 March 2026  16:36:51 +0000 (0:00:00.057)       0:00:12.899 *******
2026-03-18 16:36:52.053240 | controller | ok: [instance]
2026-03-18 16:36:52.120842 | controller |
2026-03-18 16:36:52.120873 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-18 16:36:52.120888 | controller | Wednesday 18 March 2026  16:36:52 +0000 (0:00:00.089)       0:00:12.989 *******
2026-03-18 16:36:52.120900 | controller | ok: [instance]
2026-03-18 16:36:52.236889 | controller |
2026-03-18 16:36:52.236915 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-18 16:36:52.236923 | controller | Wednesday 18 March 2026  16:36:52 +0000 (0:00:00.065)       0:00:13.054 *******
2026-03-18 16:36:52.236953 | controller | ok: [instance]
2026-03-18 16:36:52.307589 | controller |
2026-03-18 16:36:52.307618 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-18 16:36:52.307628 | controller | Wednesday 18 March 2026  16:36:52 +0000 (0:00:00.114)       0:00:13.169 *******
2026-03-18 16:36:52.307639 | controller | skipping: [instance]
2026-03-18 16:36:52.372539 | controller |
2026-03-18 16:36:52.372569 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-18 16:36:52.372577 | controller | Wednesday 18 March 2026  16:36:52 +0000 (0:00:00.074)       0:00:13.243 *******
2026-03-18 16:36:52.372587 | controller | skipping: [instance]
2026-03-18 16:36:52.439857 | controller |
2026-03-18 16:36:52.439891 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-18 16:36:52.439901 | controller | Wednesday 18 March 2026  16:36:52 +0000 (0:00:00.061)       0:00:13.305 *******
2026-03-18 16:36:52.439912 | controller | ok: [instance]
2026-03-18 16:36:52.440426 | controller |
2026-03-18 16:36:52.498366 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-18 16:36:52.498387 | controller | Wednesday 18 March 2026  16:36:52 +0000 (0:00:00.071)       0:00:13.376 *******
2026-03-18 16:36:52.498398 | controller | skipping: [instance]
2026-03-18 16:36:52.611138 | controller |
2026-03-18 16:36:52.611161 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-18 16:36:52.611170 | controller | Wednesday 18 March 2026  16:36:52 +0000 (0:00:00.058)       0:00:13.434 *******
2026-03-18 16:36:52.611189 | controller | ok: [instance]
2026-03-18 16:36:52.717113 | controller |
2026-03-18 16:36:52.717146 | controller | TASK [reproducer : Ensure no allocation overlap] *******************************
2026-03-18 16:36:52.717156 | controller | Wednesday 18 March 2026  16:36:52 +0000 (0:00:00.109)       0:00:13.544 *******
2026-03-18 16:36:52.717174 | controller | skipping: [instance]
2026-03-18 16:36:52.838839 | controller |
2026-03-18 16:36:52.838879 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ******************
2026-03-18 16:36:52.838887 | controller | Wednesday 18 March 2026  16:36:52 +0000 (0:00:00.108)       0:00:13.653 *******
2026-03-18 16:36:52.838903 | controller | ok: [instance] => changed=false
2026-03-18 16:36:52.918890 | controller |   msg: All assertions passed
2026-03-18 16:36:52.918926 | controller |
2026-03-18 16:36:52.918957 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************
2026-03-18 16:36:52.918964 | controller | Wednesday 18 March 2026  16:36:52 +0000 (0:00:00.117)       0:00:13.770 *******
2026-03-18 16:36:52.918976 | controller | skipping: [instance]
2026-03-18 16:36:52.919127 | controller |
2026-03-18 16:36:52.919268 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:52.919399 | controller | Wednesday 18 March 2026  16:36:52 +0000 (0:00:00.084)       0:00:13.855 *******
2026-03-18 16:36:53.103833 | controller | skipping: [instance]
2026-03-18 16:36:53.104059 | controller |
2026-03-18 16:36:53.104238 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:53.104436 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.184)       0:00:14.040 *******
2026-03-18 16:36:53.157532 | controller | skipping: [instance]
2026-03-18 16:36:53.157710 | controller |
2026-03-18 16:36:53.157896 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:53.158097 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.053)       0:00:14.094 *******
2026-03-18 16:36:53.229812 | controller | skipping: [instance]
2026-03-18 16:36:53.230099 | controller |
2026-03-18 16:36:53.230284 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:53.230474 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.071)       0:00:14.165 *******
2026-03-18 16:36:53.261210 | controller | ok: [instance]
2026-03-18 16:36:53.261433 | controller |
2026-03-18 16:36:53.261645 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:53.261821 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.032)       0:00:14.197 *******
2026-03-18 16:36:53.302381 | controller | ok: [instance]
2026-03-18 16:36:53.302593 | controller |
2026-03-18 16:36:53.302775 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:53.302979 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.038)       0:00:14.236 *******
2026-03-18 16:36:53.341224 | controller | ok: [instance] =>
2026-03-18 16:36:53.341424 | controller |   msg: 'Running: Config overrides via devscripts'
2026-03-18 16:36:53.341619 | controller |
2026-03-18 16:36:53.341813 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:53.342018 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.038)       0:00:14.274 *******
2026-03-18 16:36:53.394609 | controller |
2026-03-18 16:36:53.394833 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-18 16:36:53.395040 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.056)       0:00:14.331 *******
2026-03-18 16:36:53.435994 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:53.466614 | controller |   assertion: cifmw_devscripts_config.master_memory is undefined
2026-03-18 16:36:53.466634 | controller |   evaluated_to: false
2026-03-18 16:36:53.466643 | controller |   msg: 'Inconsistency detected: your environment wants to provide devscripts configuration overrides. This isn''t supported, and you must pass those ressource allocation via the usual cifmw_libvirt_manager_configuration, or patch it.'
2026-03-18 16:36:53.466653 | controller |
2026-03-18 16:36:53.501660 | controller | TASK [Clear host errors] *******************************************************
2026-03-18 16:36:53.501686 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.052)       0:00:14.383 *******
2026-03-18 16:36:53.501694 | controller |
2026-03-18 16:36:53.501700 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:53.501705 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.018)       0:00:14.402 *******
2026-03-18 16:36:53.501726 | controller | ok: [instance]
2026-03-18 16:36:53.551347 | controller |
2026-03-18 16:36:53.551371 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:53.551379 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.035)       0:00:14.437 *******
2026-03-18 16:36:53.551395 | controller | skipping: [instance]
2026-03-18 16:36:53.596902 | controller |
2026-03-18 16:36:53.596965 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:53.596978 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.047)       0:00:14.485 *******
2026-03-18 16:36:53.596989 | controller | skipping: [instance]
2026-03-18 16:36:53.637984 | controller |
2026-03-18 16:36:53.638007 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:53.638039 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.043)       0:00:14.529 *******
2026-03-18 16:36:53.638050 | controller | skipping: [instance]
2026-03-18 16:36:53.663449 | controller |
2026-03-18 16:36:53.663472 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:53.663479 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.042)       0:00:14.571 *******
2026-03-18 16:36:53.663489 | controller | ok: [instance]
2026-03-18 16:36:53.696515 | controller |
2026-03-18 16:36:53.696538 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:53.696552 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.026)       0:00:14.597 *******
2026-03-18 16:36:53.696564 | controller | ok: [instance]
2026-03-18 16:36:53.726542 | controller |
2026-03-18 16:36:53.726564 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:53.726578 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.033)       0:00:14.630 *******
2026-03-18 16:36:53.726590 | controller | ok: [instance] =>
2026-03-18 16:36:53.774225 | controller |   msg: 'Running: Inject 10 dev-scripts extra_worker'
2026-03-18 16:36:53.774254 | controller |
2026-03-18 16:36:53.774263 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:53.774269 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.030)       0:00:14.660 *******
2026-03-18 16:36:53.774279 | controller |
2026-03-18 16:36:53.937126 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-18 16:36:53.937175 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.049)       0:00:14.710 *******
2026-03-18 16:36:53.937189 | controller | ok: [instance]
2026-03-18 16:36:53.997891 | controller |
2026-03-18 16:36:53.997946 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-18 16:36:53.997959 | controller | Wednesday 18 March 2026  16:36:53 +0000 (0:00:00.161)       0:00:14.872 *******
2026-03-18 16:36:53.997970 | controller | fatal: [instance]: FAILED! => changed=false
2026-03-18 16:36:54.028576 | controller |   assertion: cifmw_devscripts_config.num_extra_workers is undefined or cifmw_devscripts_config.num_extra_workers == 0
2026-03-18 16:36:54.028602 | controller |   evaluated_to: false
2026-03-18 16:36:54.028616 | controller |   msg: 'Inconsistency detected: dev-scripts extra_worker resources aren''t supported here. You can create compute, networker or any other kind of VM by defining it as you define OCP cluster nodes.'
2026-03-18 16:36:54.028628 | controller |
2026-03-18 16:36:54.068209 | controller | TASK [Clear host errors] *******************************************************
2026-03-18 16:36:54.068246 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.076)       0:00:14.948 *******
2026-03-18 16:36:54.068255 | controller |
2026-03-18 16:36:54.068261 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:54.068266 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.015)       0:00:14.964 *******
2026-03-18 16:36:54.068277 | controller | ok: [instance]
2026-03-18 16:36:54.118366 | controller |
2026-03-18 16:36:54.118396 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:54.118405 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.039)       0:00:15.004 *******
2026-03-18 16:36:54.118416 | controller | skipping: [instance]
2026-03-18 16:36:54.236427 | controller |
2026-03-18 16:36:54.236522 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:54.236538 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.050)       0:00:15.054 *******
2026-03-18 16:36:54.236552 | controller | skipping: [instance]
2026-03-18 16:36:54.236762 | controller |
2026-03-18 16:36:54.236974 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:54.237157 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.048)       0:00:15.102 *******
2026-03-18 16:36:54.284115 | controller | skipping: [instance]
2026-03-18 16:36:54.284289 | controller |
2026-03-18 16:36:54.284429 | controller | TASK [Mark run as failed] ******************************************************
2026-03-18 16:36:54.284571 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.118)       0:00:15.220 *******
2026-03-18 16:36:54.315013 | controller | ok: [instance]
2026-03-18 16:36:54.315181 | controller |
2026-03-18 16:36:54.315365 | controller | TASK [Load environment file] ***************************************************
2026-03-18 16:36:54.315540 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.030)       0:00:15.251 *******
2026-03-18 16:36:54.360112 | controller | ok: [instance]
2026-03-18 16:36:54.408512 | controller |
2026-03-18 16:36:54.408537 | controller | TASK [Output scenario name] ****************************************************
2026-03-18 16:36:54.408545 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.044)       0:00:15.296 *******
2026-03-18 16:36:54.408554 | controller | ok: [instance] =>
2026-03-18 16:36:54.457623 | controller |   msg: 'Running: Inject 0 dev-scripts extra_worker'
2026-03-18 16:36:54.457644 | controller |
2026-03-18 16:36:54.457658 | controller | TASK [Validate data] ***********************************************************
2026-03-18 16:36:54.457665 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.048)       0:00:15.344 *******
2026-03-18 16:36:54.457680 | controller |
2026-03-18 16:36:54.526437 | controller | TASK [reproducer : Ensure we don't try to pass resources via devscripts_overrides] ***
2026-03-18 16:36:54.526470 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.049)       0:00:15.394 *******
2026-03-18 16:36:54.526502 | controller | ok: [instance]
2026-03-18 16:36:54.572094 | controller |
2026-03-18 16:36:54.572130 | controller | TASK [reproducer : Ensure we don't try to create extra_workers] ****************
2026-03-18 16:36:54.572139 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.065)       0:00:15.460 *******
2026-03-18 16:36:54.572150 | controller | ok: [instance]
2026-03-18 16:36:54.650057 | controller |
2026-03-18 16:36:54.650104 | controller | TASK [reproducer : Ensure we get required data in the layout description] ******
2026-03-18 16:36:54.650113 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.048)       0:00:15.508 *******
2026-03-18 16:36:54.650125 | controller | ok: [instance]
2026-03-18 16:36:54.704187 | controller |
2026-03-18 16:36:54.707602 | controller | TASK [reproducer : Ensure we have needed data for ocp_worker if defined] *******
2026-03-18 16:36:54.707625 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.077)       0:00:15.585 *******
2026-03-18 16:36:54.707639 | controller | skipping: [instance]
2026-03-18 16:36:54.767759 | controller |
2026-03-18 16:36:54.767810 | controller | TASK [reproducer : Ensure we don't set some parameters when no extra disks] ****
2026-03-18 16:36:54.767818 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.050)       0:00:15.636 *******
2026-03-18 16:36:54.767830 | controller | ok: [instance]
2026-03-18 16:36:54.768000 | controller |
2026-03-18 16:36:54.768148 | controller | TASK [reproducer : Ensure we get disk_size] ************************************
2026-03-18 16:36:54.768294 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.064)       0:00:15.701 *******
2026-03-18 16:36:54.822185 | controller | skipping: [instance]
2026-03-18 16:36:54.822342 | controller |
2026-03-18 16:36:54.822517 | controller | TASK [reproducer : Ensure same amount of disks are created] ********************
2026-03-18 16:36:54.822661 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.057)       0:00:15.758 *******
2026-03-18 16:36:54.879227 | controller | skipping: [instance]
2026-03-18 16:36:54.879400 | controller |
2026-03-18 16:36:54.879568 | controller | TASK [reproducer : Ensure created amount matches at least allocated amounts] ***
2026-03-18 16:36:54.879708 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.053)       0:00:15.812 *******
2026-03-18 16:36:54.928176 | controller | skipping: [instance]
2026-03-18 16:36:54.928357 | controller |
2026-03-18 16:36:54.928513 | controller | TASK [reproducer : Ensure no allocation overlap] *******************************
2026-03-18 16:36:54.928660 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.052)       0:00:15.864 *******
2026-03-18 16:36:54.981192 | controller | skipping: [instance]
2026-03-18 16:36:55.033716 | controller |
2026-03-18 16:36:55.033743 | controller | TASK [reproducer : Ensure LVMS allocated disks are available] ******************
2026-03-18 16:36:55.033752 | controller | Wednesday 18 March 2026  16:36:54 +0000 (0:00:00.052)       0:00:15.917 *******
2026-03-18 16:36:55.033761 | controller | skipping: [instance]
2026-03-18 16:36:55.219630 | controller |
2026-03-18 16:36:55.219685 | controller | TASK [reproducer : Ensure Cinder PVs allocated disks are available] ************
2026-03-18 16:36:55.219694 | controller | Wednesday 18 March 2026  16:36:55 +0000 (0:00:00.052)       0:00:15.969 *******
2026-03-18 16:36:55.219705 | controller | skipping: [instance]
2026-03-18 16:36:55.273819 | controller |
2026-03-18 16:36:55.291714 | controller | TASK [Mark failure] ************************************************************
2026-03-18 16:36:55.291765 | controller | Wednesday 18 March 2026  16:36:55 +0000 (0:00:00.185)       0:00:16.155 *******
2026-03-18 16:36:55.291779 | controller | skipping: [instance]
2026-03-18 16:36:55.333234 | controller |
2026-03-18 16:36:55.333365 | controller | TASK [Display error message] ***************************************************
2026-03-18 16:36:55.333375 | controller | Wednesday 18 March 2026  16:36:55 +0000 (0:00:00.048)       0:00:16.204 *******
2026-03-18 16:36:55.333386 | controller | skipping: [instance]
2026-03-18 16:36:55.383868 | controller |
2026-03-18 16:36:55.383893 | controller | TASK [Append failed scenario to list] ******************************************
2026-03-18 16:36:55.383901 | controller | Wednesday 18 March 2026  16:36:55 +0000 (0:00:00.064)       0:00:16.268 *******
2026-03-18 16:36:55.383911 | controller | skipping: [instance]
2026-03-18 16:36:55.384077 | controller |
2026-03-18 16:36:55.384221 | controller | TASK [Fail if needed] **********************************************************
2026-03-18 16:36:55.384355 | controller | Wednesday 18 March 2026  16:36:55 +0000 (0:00:00.051)       0:00:16.320 *******
2026-03-18 16:36:55.456087 | controller | skipping: [instance]
2026-03-18 16:36:55.456208 | controller |
2026-03-18 16:36:55.456220 | controller | PLAY RECAP *********************************************************************
2026-03-18 16:36:55.456227 | controller | instance                   : ok=129  changed=0    unreachable=0    failed=0    skipped=85   rescued=7    ignored=0
2026-03-18 16:36:55.456234 | controller |
2026-03-18 16:36:55.456247 | controller | Wednesday 18 March 2026  16:36:55 +0000 (0:00:00.069)       0:00:16.390 *******
2026-03-18 16:36:55.456254 | controller | ===============================================================================
2026-03-18 16:36:55.456259 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.40s
2026-03-18 16:36:55.456264 | controller | reproducer : Ensure we don't try to pass resources via devscripts_overrides --- 0.23s
2026-03-18 16:36:55.456273 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.23s
2026-03-18 16:36:55.456278 | controller | Display error message --------------------------------------------------- 0.20s
2026-03-18 16:36:55.456284 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.19s
2026-03-18 16:36:55.456289 | controller | Mark failure ------------------------------------------------------------ 0.19s
2026-03-18 16:36:55.456294 | controller | reproducer : Ensure created amount matches at least allocated amounts --- 0.18s
2026-03-18 16:36:55.456300 | controller | reproducer : Ensure we don't try to create extra_workers ---------------- 0.18s
2026-03-18 16:36:55.456305 | controller | Display error message --------------------------------------------------- 0.17s
2026-03-18 16:36:55.456310 | controller | reproducer : Ensure we don't try to pass resources via devscripts_overrides --- 0.16s
2026-03-18 16:36:55.456318 | controller | reproducer : Ensure we get required data in the layout description ------ 0.15s
2026-03-18 16:36:55.456462 | controller | Append failed scenario to list ------------------------------------------ 0.15s
2026-03-18 16:36:55.456610 | controller | Mark failure ------------------------------------------------------------ 0.15s
2026-03-18 16:36:55.456758 | controller | reproducer : Ensure we have needed data for ocp_worker if defined ------- 0.14s
2026-03-18 16:36:55.456887 | controller | reproducer : Ensure we get required data in the layout description ------ 0.14s
2026-03-18 16:36:55.457041 | controller | reproducer : Ensure Cinder PVs allocated disks are available ------------ 0.13s
2026-03-18 16:36:55.457173 | controller | reproducer : Ensure we don't set some parameters when no extra disks ---- 0.13s
2026-03-18 16:36:55.457301 | controller | Test no volumes --------------------------------------------------------- 0.13s
2026-03-18 16:36:55.457428 | controller | reproducer : Ensure we get required data in the layout description ------ 0.13s
2026-03-18 16:36:55.457565 | controller | reproducer : Ensure LVMS allocated disks are available ------------------ 0.13s
2026-03-18 16:36:55.578876 | controller | INFO     Running ocp_validations > cleanup
2026-03-18 16:36:55.579496 | controller | WARNING  Skipping, cleanup playbook not configured.
2026-03-18 16:36:55.580255 | controller | INFO     Writing /tmp/report.html report.
2026-03-18 16:36:55.838292 | [controller] Waiting on logger
2026-03-18 16:37:00.981848 | [controller] Waiting on logger
2026-03-18 16:37:11.413868 | [controller] Waiting on logger
2026-03-18 16:37:21.845814 | [controller] Waiting on logger
2026-03-18 16:37:25.751662 | [Zuul] Log Stream did not terminate
2026-03-18 16:37:25.751915 | controller | changed
2026-03-18 16:37:25.807534 | 
2026-03-18 16:37:25.807596 | PLAY RECAP
2026-03-18 16:37:25.807631 | controller | ok: 4 changed: 1 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-18 16:37:25.807651 | 
2026-03-18 16:37:25.859493 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/molecule-test.yml@main]
2026-03-18 16:37:25.860172 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2026-03-18 16:37:26.332343 | 
2026-03-18 16:37:26.332439 | PLAY [Run ci/playbooks/collect-logs.yml]
2026-03-18 16:37:26.350398 | 
2026-03-18 16:37:26.350464 | TASK [Filter out host if needed]
2026-03-18 16:37:26.358061 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller
2026-03-18 16:37:26.362051 | 
2026-03-18 16:37:26.362113 | TASK [Ensure file is present]
2026-03-18 16:37:26.826834 | controller | ok
2026-03-18 16:37:26.832134 | 
2026-03-18 16:37:26.832200 | TASK [Manage molecule report file]
2026-03-18 16:37:26.851546 | [controller] Waiting on logger
2026-03-18 16:37:36.181672 | [controller] Waiting on logger
2026-03-18 16:37:46.613858 | [controller] Waiting on logger
2026-03-18 16:37:55.957753 | [controller] Waiting on logger
2026-03-18 16:37:57.327286 | [Zuul] Log Stream did not terminate
2026-03-18 16:37:57.327471 | controller | changed
2026-03-18 16:37:57.332217 | 
2026-03-18 16:37:57.332343 | TASK [Check if we get ci-framework-data basedir]
2026-03-18 16:37:57.746666 | controller | ok
2026-03-18 16:37:57.751204 | 
2026-03-18 16:37:57.751275 | TASK [Create ci-framework-data log directory for zuul]
2026-03-18 16:37:58.176802 | controller | changed
2026-03-18 16:37:58.181864 | 
2026-03-18 16:37:58.181922 | TASK [Copy ci-framework interesting files]
2026-03-18 16:37:58.200483 | [controller] Waiting on logger
2026-03-18 16:38:12.263766 | controller | changed
2026-03-18 16:38:12.268463 | 
2026-03-18 16:38:12.268522 | TASK [Get SELinux listing]
2026-03-18 16:38:12.288915 | [controller] Waiting on logger
2026-03-18 16:38:15.670482 | [controller] Waiting on logger
2026-03-18 16:38:29.850859 | [controller] Waiting on logger
2026-03-18 16:38:37.429851 | [controller] Waiting on logger
2026-03-18 16:38:42.852070 | [Zuul] Log Stream did not terminate
2026-03-18 16:38:42.852283 | controller | changed
2026-03-18 16:38:42.857746 | 
2026-03-18 16:38:42.857811 | TASK [Generate log index]
2026-03-18 16:38:45.391529 | controller | changed
2026-03-18 16:38:45.396428 | 
2026-03-18 16:38:45.396493 | TASK [Get some env related data]
2026-03-18 16:38:50.421491 | controller | changed
2026-03-18 16:38:50.426193 | 
2026-03-18 16:38:50.426251 | TASK [Generate list of logs to collect in home directory]
2026-03-18 16:38:51.520004 | controller | ok: All paths examined
2026-03-18 16:38:51.525203 | 
2026-03-18 16:38:51.525279 | LOOP [Copy logs from home directory]
2026-03-18 16:38:51.573821 | [controller] Waiting on logger
2026-03-18 16:38:54.965669 | [controller] Waiting on logger
2026-03-18 16:39:10.197851 | [controller] Waiting on logger
2026-03-18 16:39:16.726052 | [controller] Waiting on logger
2026-03-18 16:39:30.869962 | [controller] Waiting on logger
2026-03-18 16:39:37.397825 | [controller] Waiting on logger
2026-03-18 16:39:52.629783 | [controller] Waiting on logger
2026-03-18 16:39:56.021883 | [controller] Waiting on logger
2026-03-18 16:40:10.165731 | [controller] Waiting on logger
2026-03-18 16:40:17.781786 | [controller] Waiting on logger
2026-03-18 16:40:31.925910 | [controller] Waiting on logger
2026-03-18 16:40:35.317921 | [controller] Waiting on logger
2026-03-18 16:40:50.549899 | [controller] Waiting on logger
2026-03-18 16:40:57.078054 | [controller] Waiting on logger
2026-03-18 16:41:11.222042 | [controller] Waiting on logger
2026-03-18 16:41:17.749978 | [controller] Waiting on logger
2026-03-18 16:41:29.882354 | [controller] Waiting on logger
2026-03-18 16:41:36.374064 | [controller] Waiting on logger
2026-03-18 16:41:50.517995 | [controller] Waiting on logger
2026-03-18 16:41:57.045876 | [controller] Waiting on logger
2026-03-18 16:42:12.277895 | [controller] Waiting on logger
2026-03-18 16:42:15.669854 | [controller] Waiting on logger
2026-03-18 16:42:29.850629 | [controller] Waiting on logger
2026-03-18 16:42:37.429860 | [controller] Waiting on logger
2026-03-18 16:42:51.573748 | [controller] Waiting on logger
2026-03-18 16:42:54.965857 | [controller] Waiting on logger
2026-03-18 16:43:10.197813 | [controller] Waiting on logger
2026-03-18 16:43:16.725793 | [controller] Waiting on logger
2026-03-18 16:43:30.870509 | [controller] Waiting on logger
2026-03-18 16:43:37.397878 | [controller] Waiting on logger
2026-03-18 16:43:52.630323 | [controller] Waiting on logger
2026-03-18 16:43:56.021771 | [controller] Waiting on logger
2026-03-18 16:44:10.165963 | [controller] Waiting on logger
2026-03-18 16:44:17.782301 | [controller] Waiting on logger
2026-03-18 16:44:31.925863 | [controller] Waiting on logger
2026-03-18 16:44:35.317925 | [controller] Waiting on logger
2026-03-18 16:44:50.549750 | [controller] Waiting on logger
2026-03-18 16:44:57.077829 | [controller] Waiting on logger
2026-03-18 16:45:11.221764 | [controller] Waiting on logger
2026-03-18 16:45:17.750468 | [controller] Waiting on logger
2026-03-18 16:45:29.882989 | [controller] Waiting on logger
2026-03-18 16:45:36.373841 | [controller] Waiting on logger
2026-03-18 16:45:50.517964 | [controller] Waiting on logger
2026-03-18 16:45:57.046031 | [controller] Waiting on logger
2026-03-18 16:46:12.277841 | [controller] Waiting on logger
2026-03-18 16:46:15.669733 | [controller] Waiting on logger
2026-03-18 16:46:29.850323 | [controller] Waiting on logger
2026-03-18 16:46:37.429866 | [controller] Waiting on logger
2026-03-18 16:46:51.574080 | [controller] Waiting on logger
2026-03-18 16:46:54.966237 | [controller] Waiting on logger
2026-03-18 16:47:10.198135 | [controller] Waiting on logger
2026-03-18 16:47:16.726537 | [controller] Waiting on logger
2026-03-18 16:47:30.870089 | [controller] Waiting on logger
2026-03-18 16:47:37.398074 | [controller] Waiting on logger
2026-03-18 16:47:52.629754 | [controller] Waiting on logger
2026-03-18 16:47:56.021798 | [controller] Waiting on logger
2026-03-18 16:48:10.166039 | [controller] Waiting on logger
2026-03-18 16:48:17.781891 | [controller] Waiting on logger
2026-03-18 16:48:31.925740 | [controller] Waiting on logger
2026-03-18 16:48:35.317797 | [controller] Waiting on logger
2026-03-18 16:48:50.549891 | [controller] Waiting on logger
2026-03-18 16:48:57.078068 | [controller] Waiting on logger
2026-03-18 16:49:11.221789 | [controller] Waiting on logger
2026-03-18 16:49:17.749804 | [controller] Waiting on logger
2026-03-18 16:49:29.882502 | [controller] Waiting on logger
2026-03-18 16:49:36.374024 | [controller] Waiting on logger
2026-03-18 16:49:50.517956 | [controller] Waiting on logger
2026-03-18 16:49:57.045911 | [controller] Waiting on logger
2026-03-18 16:50:12.277818 | [controller] Waiting on logger
2026-03-18 16:50:15.669716 | [controller] Waiting on logger
2026-03-18 16:50:29.850496 | [controller] Waiting on logger
2026-03-18 16:50:37.429826 | [controller] Waiting on logger
2026-03-18 16:50:51.573834 | [controller] Waiting on logger
2026-03-18 16:50:54.966019 | [controller] Waiting on logger
2026-03-18 16:51:10.197715 | [controller] Waiting on logger
2026-03-18 16:51:16.725734 | [controller] Waiting on logger
2026-03-18 16:51:30.869762 | [controller] Waiting on logger
2026-03-18 16:51:37.397837 | [controller] Waiting on logger
2026-03-18 16:51:52.629972 | [controller] Waiting on logger
2026-03-18 16:51:54.510378 | controller | changed:
2026-03-18 16:51:54.510480 | controller | {
2026-03-18 16:51:54.510510 | controller |   "atime": 1773350327.2786021,
2026-03-18 16:51:54.510530 | controller |   "ctime": 1773351461.47114,
2026-03-18 16:51:54.510549 | controller |   "dev": 64513,
2026-03-18 16:51:54.510566 | controller |   "gid": 1000,
2026-03-18 16:51:54.510581 | controller |   "gr_name": "zuul",
2026-03-18 16:51:54.510596 | controller |   "inode": 6822,
2026-03-18 16:51:54.510610 | controller |   "isblk": false,
2026-03-18 16:51:54.510625 | controller |   "ischr": false,
2026-03-18 16:51:54.510639 | controller |   "isdir": false,
2026-03-18 16:51:54.510652 | controller |   "isfifo": false,
2026-03-18 16:51:54.510665 | controller |   "isgid": false,
2026-03-18 16:51:54.510679 | controller |   "islnk": false,
2026-03-18 16:51:54.510692 | controller |   "isreg": true,
2026-03-18 16:51:54.510705 | controller |   "issock": false,
2026-03-18 16:51:54.510718 | controller |   "isuid": false,
2026-03-18 16:51:54.510731 | controller |   "mode": "0644",
2026-03-18 16:51:54.510745 | controller |   "mtime": 1773351461.47114,
2026-03-18 16:51:54.510760 | controller |   "nlink": 1,
2026-03-18 16:51:54.510774 | controller |   "path": "/home/zuul/crc-setup.log",
2026-03-18 16:51:54.510789 | controller |   "pw_name": "zuul",
2026-03-18 16:51:54.510805 | controller |   "rgrp": true,
2026-03-18 16:51:54.510820 | controller |   "roth": true,
2026-03-18 16:51:54.510834 | controller |   "rusr": true,
2026-03-18 16:51:54.510848 | controller |   "size": 4108,
2026-03-18 16:51:54.510861 | controller |   "uid": 1000,
2026-03-18 16:51:54.510874 | controller |   "wgrp": false,
2026-03-18 16:51:54.510887 | controller |   "woth": false,
2026-03-18 16:51:54.510900 | controller |   "wusr": true,
2026-03-18 16:51:54.510913 | controller |   "xgrp": false,
2026-03-18 16:51:54.510927 | controller |   "xoth": false,
2026-03-18 16:51:54.510939 | controller |   "xusr": false
2026-03-18 16:51:54.510952 | controller | }
2026-03-18 16:51:56.022004 | [controller] Waiting on logger
2026-03-18 16:52:10.165738 | [controller] Waiting on logger
2026-03-18 16:52:17.781738 | [controller] Waiting on logger
2026-03-18 16:52:31.925890 | [controller] Waiting on logger
2026-03-18 16:52:35.317852 | [controller] Waiting on logger
2026-03-18 16:52:50.550447 | [controller] Waiting on logger
2026-03-18 16:52:57.078191 | [controller] Waiting on logger
2026-03-18 16:53:11.222164 | [controller] Waiting on logger
2026-03-18 16:53:17.749834 | [controller] Waiting on logger
2026-03-18 16:53:29.882374 | [controller] Waiting on logger
2026-03-18 16:53:36.373872 | [controller] Waiting on logger
2026-03-18 16:53:50.518616 | [controller] Waiting on logger
2026-03-18 16:53:57.045730 | [controller] Waiting on logger
2026-03-18 16:54:12.277864 | [controller] Waiting on logger
2026-03-18 16:54:15.669854 | [controller] Waiting on logger
2026-03-18 16:54:29.850397 | [controller] Waiting on logger
2026-03-18 16:54:37.429941 | [controller] Waiting on logger
2026-03-18 16:54:51.573801 | [controller] Waiting on logger
2026-03-18 16:54:54.965719 | [controller] Waiting on logger
2026-03-18 16:55:10.198355 | [controller] Waiting on logger
2026-03-18 16:55:16.725888 | [controller] Waiting on logger
2026-03-18 16:55:30.870299 | [controller] Waiting on logger
2026-03-18 16:55:37.397905 | [controller] Waiting on logger
2026-03-18 16:55:52.629827 | [controller] Waiting on logger
2026-03-18 16:55:56.021743 | [controller] Waiting on logger
2026-03-18 16:56:10.165635 | [controller] Waiting on logger
2026-03-18 16:56:17.781959 | [controller] Waiting on logger
2026-03-18 16:56:31.925827 | [controller] Waiting on logger
2026-03-18 16:56:35.317841 | [controller] Waiting on logger
2026-03-18 16:56:50.550237 | [controller] Waiting on logger
2026-03-18 16:56:57.078349 | [controller] Waiting on logger
2026-03-18 16:57:11.221799 | [controller] Waiting on logger
2026-03-18 16:57:17.749782 | [controller] Waiting on logger
2026-03-18 16:57:29.882968 | [controller] Waiting on logger
2026-03-18 16:57:36.373881 | [controller] Waiting on logger
2026-03-18 16:57:50.517852 | [controller] Waiting on logger
2026-03-18 16:57:57.045835 | [controller] Waiting on logger
2026-03-18 16:58:12.277708 | [controller] Waiting on logger
2026-03-18 16:58:15.669763 | [controller] Waiting on logger
2026-03-18 16:58:29.850447 | [controller] Waiting on logger
2026-03-18 16:58:37.429640 | [controller] Waiting on logger
2026-03-18 16:58:51.573809 | [controller] Waiting on logger
2026-03-18 16:58:54.965793 | [controller] Waiting on logger
2026-03-18 16:59:10.197880 | [controller] Waiting on logger
2026-03-18 16:59:16.726084 | [controller] Waiting on logger
2026-03-18 16:59:30.869821 | [controller] Waiting on logger
2026-03-18 16:59:37.397910 | [controller] Waiting on logger
2026-03-18 16:59:52.630002 | [controller] Waiting on logger
2026-03-18 16:59:56.021783 | [controller] Waiting on logger
2026-03-18 17:00:10.165851 | [controller] Waiting on logger
2026-03-18 17:00:17.781802 | [controller] Waiting on logger
2026-03-18 17:00:31.925860 | [controller] Waiting on logger
2026-03-18 17:00:35.318021 | [controller] Waiting on logger
2026-03-18 17:00:50.549842 | [controller] Waiting on logger
2026-03-18 17:00:57.077868 | [controller] Waiting on logger
2026-03-18 17:01:11.221820 | [controller] Waiting on logger
2026-03-18 17:01:17.749708 | [controller] Waiting on logger
2026-03-18 17:01:29.882158 | [controller] Waiting on logger
2026-03-18 17:01:36.374094 | [controller] Waiting on logger
2026-03-18 17:01:50.518162 | [controller] Waiting on logger
2026-03-18 17:01:57.045873 | [controller] Waiting on logger
2026-03-18 17:02:12.277858 | [controller] Waiting on logger
2026-03-18 17:02:15.669878 | [controller] Waiting on logger
2026-03-18 17:02:29.850424 | [controller] Waiting on logger
2026-03-18 17:02:37.429949 | [controller] Waiting on logger
2026-03-18 17:02:51.573887 | [controller] Waiting on logger
2026-03-18 17:02:54.965754 | [controller] Waiting on logger
2026-03-18 17:03:10.197867 | [controller] Waiting on logger
2026-03-18 17:03:16.725734 | [controller] Waiting on logger
2026-03-18 17:03:30.869756 | [controller] Waiting on logger
2026-03-18 17:03:37.397919 | [controller] Waiting on logger
2026-03-18 17:03:52.629861 | [controller] Waiting on logger
2026-03-18 17:03:56.021757 | [controller] Waiting on logger
2026-03-18 17:04:01.473826 | controller | changed:
2026-03-18 17:04:01.473925 | controller | {
2026-03-18 17:04:01.473951 | controller |   "atime": 1773351463.1371913,
2026-03-18 17:04:01.473969 | controller |   "ctime": 1773352236.2951868,
2026-03-18 17:04:01.473986 | controller |   "dev": 64513,
2026-03-18 17:04:01.474001 | controller |   "gid": 1000,
2026-03-18 17:04:01.474017 | controller |   "gr_name": "zuul",
2026-03-18 17:04:01.474032 | controller |   "inode": 6833,
2026-03-18 17:04:01.474047 | controller |   "isblk": false,
2026-03-18 17:04:01.474061 | controller |   "ischr": false,
2026-03-18 17:04:01.474074 | controller |   "isdir": false,
2026-03-18 17:04:01.474090 | controller |   "isfifo": false,
2026-03-18 17:04:01.474104 | controller |   "isgid": false,
2026-03-18 17:04:01.474130 | controller |   "islnk": false,
2026-03-18 17:04:01.474147 | controller |   "isreg": true,
2026-03-18 17:04:01.474162 | controller |   "issock": false,
2026-03-18 17:04:01.474176 | controller |   "isuid": false,
2026-03-18 17:04:01.474190 | controller |   "mode": "0644",
2026-03-18 17:04:01.474204 | controller |   "mtime": 1773352236.2951868,
2026-03-18 17:04:01.474217 | controller |   "nlink": 1,
2026-03-18 17:04:01.474231 | controller |   "path": "/home/zuul/crc-start.log",
2026-03-18 17:04:01.474246 | controller |   "pw_name": "zuul",
2026-03-18 17:04:01.474260 | controller |   "rgrp": true,
2026-03-18 17:04:01.474297 | controller |   "roth": true,
2026-03-18 17:04:01.474317 | controller |   "rusr": true,
2026-03-18 17:04:01.474332 | controller |   "size": 4527,
2026-03-18 17:04:01.474346 | controller |   "uid": 1000,
2026-03-18 17:04:01.474360 | controller |   "wgrp": false,
2026-03-18 17:04:01.474375 | controller |   "woth": false,
2026-03-18 17:04:01.474391 | controller |   "wusr": true,
2026-03-18 17:04:01.474405 | controller |   "xgrp": false,
2026-03-18 17:04:01.474419 | controller |   "xoth": false,
2026-03-18 17:04:01.474444 | controller |   "xusr": false
2026-03-18 17:04:01.474460 | controller | }
2026-03-18 17:04:10.166772 | [controller] Waiting on logger
2026-03-18 17:04:17.781890 | [controller] Waiting on logger
2026-03-18 17:04:31.926001 | [controller] Waiting on logger
2026-03-18 17:04:35.317983 | [controller] Waiting on logger
2026-03-18 17:04:50.549975 | [controller] Waiting on logger
2026-03-18 17:04:57.077748 | [controller] Waiting on logger
2026-03-18 17:05:11.221753 | [controller] Waiting on logger
2026-03-18 17:05:17.749896 | [controller] Waiting on logger
2026-03-18 17:05:29.882314 | [controller] Waiting on logger
2026-03-18 17:05:36.373810 | [controller] Waiting on logger
2026-03-18 17:05:50.517869 | [controller] Waiting on logger
2026-03-18 17:05:57.045925 | [controller] Waiting on logger
2026-03-18 17:06:12.277745 | [controller] Waiting on logger
2026-03-18 17:06:15.669779 | [controller] Waiting on logger
2026-03-18 17:06:29.850299 | [controller] Waiting on logger
2026-03-18 17:06:37.430080 | [controller] Waiting on logger
2026-03-18 17:06:51.574361 | [controller] Waiting on logger
2026-03-18 17:06:54.965749 | [controller] Waiting on logger
2026-03-18 17:07:10.197903 | [controller] Waiting on logger
2026-03-18 17:07:16.725984 | [controller] Waiting on logger
2026-03-18 17:07:30.870247 | [controller] Waiting on logger
2026-03-18 17:07:37.397757 | [controller] Waiting on logger
2026-03-18 17:07:52.629751 | [controller] Waiting on logger
2026-03-18 17:07:56.021824 | [controller] Waiting on logger
2026-03-18 17:08:10.166109 | [controller] Waiting on logger
2026-03-18 17:08:17.781842 | [controller] Waiting on logger
2026-03-18 17:08:31.925833 | [controller] Waiting on logger
2026-03-18 17:08:35.317913 | [controller] Waiting on logger
2026-03-18 17:08:50.549850 | [controller] Waiting on logger
2026-03-18 17:08:57.078084 | [controller] Waiting on logger
2026-03-18 17:09:11.221761 | [controller] Waiting on logger
2026-03-18 17:09:17.750188 | [controller] Waiting on logger
2026-03-18 17:09:29.882563 | [controller] Waiting on logger
2026-03-18 17:09:36.373760 | [controller] Waiting on logger
2026-03-18 17:09:50.517821 | [controller] Waiting on logger
2026-03-18 17:09:57.046212 | [controller] Waiting on logger
2026-03-18 17:10:12.278087 | [controller] Waiting on logger
2026-03-18 17:10:15.669610 | [controller] Waiting on logger
2026-03-18 17:10:29.850794 | [controller] Waiting on logger
2026-03-18 17:10:37.430221 | [controller] Waiting on logger
2026-03-18 17:10:51.573798 | [controller] Waiting on logger
2026-03-18 17:10:54.965760 | [controller] Waiting on logger
2026-03-18 17:11:10.197835 | [controller] Waiting on logger
2026-03-18 17:11:16.725778 | [controller] Waiting on logger
2026-03-18 17:11:30.870057 | [controller] Waiting on logger
2026-03-18 17:11:37.397741 | [controller] Waiting on logger
2026-03-18 17:11:52.629847 | [controller] Waiting on logger
2026-03-18 17:11:56.022088 | [controller] Waiting on logger
2026-03-18 17:12:10.166297 | [controller] Waiting on logger
2026-03-18 17:12:17.781898 | [controller] Waiting on logger
2026-03-18 17:12:31.925726 | [controller] Waiting on logger
2026-03-18 17:12:35.317801 | [controller] Waiting on logger
2026-03-18 17:12:50.549917 | [controller] Waiting on logger
2026-03-18 17:12:57.078011 | [controller] Waiting on logger
2026-03-18 17:13:11.221789 | [controller] Waiting on logger
2026-03-18 17:13:17.750250 | [controller] Waiting on logger
2026-03-18 17:13:29.882536 | [controller] Waiting on logger
2026-03-18 17:13:36.374076 | [controller] Waiting on logger
2026-03-18 17:13:50.517778 | [controller] Waiting on logger
2026-03-18 17:13:57.045780 | [controller] Waiting on logger
2026-03-18 17:14:12.278058 | [controller] Waiting on logger
2026-03-18 17:14:15.669835 | [controller] Waiting on logger
2026-03-18 17:14:29.850397 | [controller] Waiting on logger
2026-03-18 17:14:37.430180 | [controller] Waiting on logger
2026-03-18 17:14:51.574447 | [controller] Waiting on logger
2026-03-18 17:14:54.965842 | [controller] Waiting on logger
2026-03-18 17:15:10.197752 | [controller] Waiting on logger
2026-03-18 17:15:16.726371 | [controller] Waiting on logger
2026-03-18 17:15:30.870778 | [controller] Waiting on logger
2026-03-18 17:15:37.397820 | [controller] Waiting on logger
2026-03-18 17:15:52.629737 | [controller] Waiting on logger
2026-03-18 17:15:56.021783 | [controller] Waiting on logger
2026-03-18 17:16:10.166297 | [controller] Waiting on logger
2026-03-18 17:16:17.781836 | [controller] Waiting on logger
2026-03-18 17:16:31.926305 | [controller] Waiting on logger
2026-03-18 17:16:35.317904 | [controller] Waiting on logger
2026-03-18 17:16:50.549822 | [controller] Waiting on logger
2026-03-18 17:16:57.077703 | [controller] Waiting on logger
2026-03-18 17:17:11.222423 | [controller] Waiting on logger
2026-03-18 17:17:17.750149 | [controller] Waiting on logger
2026-03-18 17:17:29.883044 | [controller] Waiting on logger
2026-03-18 17:17:36.374007 | [controller] Waiting on logger
2026-03-18 17:17:50.517905 | [controller] Waiting on logger
2026-03-18 17:17:57.045718 | [controller] Waiting on logger
2026-03-18 17:18:12.277676 | [controller] Waiting on logger
2026-03-18 17:18:15.669657 | [controller] Waiting on logger
2026-03-18 17:18:29.850444 | [controller] Waiting on logger
2026-03-18 17:18:37.429886 | [controller] Waiting on logger
2026-03-18 17:18:51.575059 | [controller] Waiting on logger
2026-03-18 17:18:54.966106 | [controller] Waiting on logger
2026-03-18 17:19:10.581865 | [controller] Waiting on logger
2026-03-18 17:19:19.962475 | [controller] Waiting on logger
2026-03-18 17:19:30.358332 | [controller] Waiting on logger
2026-03-18 17:19:40.790052 | [controller] Waiting on logger
2026-03-18 17:19:50.133790 | [controller] Waiting on logger
2026-03-18 17:20:00.565762 | [controller] Waiting on logger
2026-03-18 17:20:09.946224 | [controller] Waiting on logger
2026-03-18 17:20:20.341746 | [controller] Waiting on logger
2026-03-18 17:20:30.773960 | [controller] Waiting on logger
2026-03-18 17:20:40.117907 | [controller] Waiting on logger
2026-03-18 17:20:50.549904 | [controller] Waiting on logger
2026-03-18 17:20:59.935678 | [controller] Waiting on logger
2026-03-18 17:21:10.325870 | [controller] Waiting on logger
2026-03-18 17:21:20.758627 | [controller] Waiting on logger
2026-03-18 17:21:30.101893 | [controller] Waiting on logger
2026-03-18 17:21:32.006333 | controller | changed:
2026-03-18 17:21:32.006435 | controller | {
2026-03-18 17:21:32.006466 | controller |   "atime": 1773851238.1979384,
2026-03-18 17:21:32.006487 | controller |   "ctime": 1773851255.6240127,
2026-03-18 17:21:32.006509 | controller |   "dev": 64513,
2026-03-18 17:21:32.006525 | controller |   "gid": 1000,
2026-03-18 17:21:32.006541 | controller |   "gr_name": "zuul",
2026-03-18 17:21:32.006716 | controller |   "inode": 1426752,
2026-03-18 17:21:32.006746 | controller |   "isblk": false,
2026-03-18 17:21:32.006763 | controller |   "ischr": false,
2026-03-18 17:21:32.006777 | controller |   "isdir": false,
2026-03-18 17:21:32.006802 | controller |   "isfifo": false,
2026-03-18 17:21:32.006818 | controller |   "isgid": false,
2026-03-18 17:21:32.006832 | controller |   "islnk": false,
2026-03-18 17:21:32.006846 | controller |   "isreg": true,
2026-03-18 17:21:32.006859 | controller |   "issock": false,
2026-03-18 17:21:32.006872 | controller |   "isuid": false,
2026-03-18 17:21:32.006886 | controller |   "mode": "0644",
2026-03-18 17:21:32.006899 | controller |   "mtime": 1773851255.6240127,
2026-03-18 17:21:32.006912 | controller |   "nlink": 1,
2026-03-18 17:21:32.006925 | controller |   "path": "/home/zuul/ansible.log",
2026-03-18 17:21:32.006937 | controller |   "pw_name": "zuul",
2026-03-18 17:21:32.006950 | controller |   "rgrp": true,
2026-03-18 17:21:32.006962 | controller |   "roth": true,
2026-03-18 17:21:32.006974 | controller |   "rusr": true,
2026-03-18 17:21:32.006987 | controller |   "size": 6749,
2026-03-18 17:21:32.006999 | controller |   "uid": 1000,
2026-03-18 17:21:32.007012 | controller |   "wgrp": false,
2026-03-18 17:21:32.007024 | controller |   "woth": false,
2026-03-18 17:21:32.007037 | controller |   "wusr": true,
2026-03-18 17:21:32.007051 | controller |   "xgrp": false,
2026-03-18 17:21:32.007063 | controller |   "xoth": false,
2026-03-18 17:21:32.007076 | controller |   "xusr": false
2026-03-18 17:21:32.007088 | controller | }
2026-03-18 17:21:32.023121 | 
2026-03-18 17:21:32.023237 | TASK [Copy crio stats log file]
2026-03-18 17:21:32.037446 | controller | skipping: Conditional result was False
2026-03-18 17:21:32.042783 | 
2026-03-18 17:21:32.042845 | TASK [Get SELinux related data]
2026-03-18 17:21:32.086222 | [controller] Waiting on logger
2026-03-18 17:21:42.518844 | [controller] Waiting on logger
2026-03-18 17:21:52.858906 | [controller] Waiting on logger
2026-03-18 17:22:03.253935 | [controller] Waiting on logger
2026-03-18 17:22:13.685902 | [controller] Waiting on logger
2026-03-18 17:22:23.029914 | [controller] Waiting on logger
2026-03-18 17:22:33.461814 | [controller] Waiting on logger
2026-03-18 17:22:42.842461 | [controller] Waiting on logger
2026-03-18 17:22:53.237736 | [controller] Waiting on logger
2026-03-18 17:23:03.670105 | [controller] Waiting on logger
2026-03-18 17:23:13.013677 | [controller] Waiting on logger
2026-03-18 17:23:23.445999 | [controller] Waiting on logger
2026-03-18 17:23:33.878138 | [controller] Waiting on logger
2026-03-18 17:23:43.221907 | [controller] Waiting on logger
2026-03-18 17:23:53.654052 | [controller] Waiting on logger
2026-03-18 17:24:02.997891 | [controller] Waiting on logger
2026-03-18 17:24:13.429730 | [controller] Waiting on logger
2026-03-18 17:24:14.189590 | [Zuul] Log Stream did not terminate
2026-03-18 17:24:14.189763 | controller | ERROR
2026-03-18 17:24:14.189907 | controller | {
2026-03-18 17:24:14.189956 | controller |   "msg": "Timeout (32s) waiting for privilege escalation prompt: "
2026-03-18 17:24:14.189991 | controller | }
2026-03-18 17:24:14.190029 | controller | ERROR: Ignoring Errors
2026-03-18 17:24:14.194971 | 
2026-03-18 17:24:14.195032 | TASK [Create system configuration directory]
2026-03-18 17:24:23.861701 | [controller] Waiting on logger
2026-03-18 17:24:33.205807 | [controller] Waiting on logger
2026-03-18 17:24:43.637645 | [controller] Waiting on logger
2026-03-18 17:24:52.981883 | [controller] Waiting on logger
2026-03-18 17:25:03.414250 | [controller] Waiting on logger
2026-03-18 17:25:13.846144 | [controller] Waiting on logger
2026-03-18 17:25:23.189979 | [controller] Waiting on logger
2026-03-18 17:25:33.621731 | [controller] Waiting on logger
2026-03-18 17:25:42.965753 | [controller] Waiting on logger
2026-03-18 17:25:53.397882 | [controller] Waiting on logger
2026-03-18 17:26:03.829824 | [controller] Waiting on logger
2026-03-18 17:26:13.173708 | [controller] Waiting on logger
2026-03-18 17:26:23.605849 | [controller] Waiting on logger
2026-03-18 17:26:32.986416 | [controller] Waiting on logger
2026-03-18 17:26:43.381837 | [controller] Waiting on logger
2026-03-18 17:26:53.813929 | [controller] Waiting on logger
2026-03-18 17:27:03.157831 | [controller] Waiting on logger
2026-03-18 17:27:13.589737 | [controller] Waiting on logger
2026-03-18 17:27:22.970349 | [controller] Waiting on logger
2026-03-18 17:27:33.365754 | [controller] Waiting on logger
2026-03-18 17:27:43.798081 | [controller] Waiting on logger
2026-03-18 17:27:53.141932 | [controller] Waiting on logger
2026-03-18 17:28:03.573870 | [controller] Waiting on logger
2026-03-18 17:28:12.955037 | [controller] Waiting on logger
2026-03-18 17:28:17.054509 | controller | changed
2026-03-18 17:28:17.059145 | 
2026-03-18 17:28:17.059211 | TASK [Get some of the system configurations]
2026-03-18 17:28:17.079254 | [controller] Waiting on logger
2026-03-18 17:28:27.509716 | [controller] Waiting on logger
2026-03-18 17:28:36.890439 | [controller] Waiting on logger
2026-03-18 17:28:47.286150 | [controller] Waiting on logger
2026-03-18 17:28:47.470129 | [Zuul] Log Stream did not terminate
2026-03-18 17:28:47.470317 | controller | changed
2026-03-18 17:28:47.475261 | 
2026-03-18 17:28:47.475343 | TASK [Copy generated documentation if available]
2026-03-18 17:28:47.488482 | controller | skipping: Conditional result was False
2026-03-18 17:28:47.493675 | 
2026-03-18 17:28:47.493735 | TASK [Copy generated AsciiDoc documentation if available]
2026-03-18 17:28:47.506053 | controller | skipping: Conditional result was False
2026-03-18 17:28:47.511096 | 
2026-03-18 17:28:47.511157 | TASK [Compress logs bigger than 2MB]
2026-03-18 17:28:50.613792 | [controller] Waiting on logger
2026-03-18 17:28:59.957822 | [controller] Waiting on logger
2026-03-18 17:29:10.389852 | [controller] Waiting on logger
2026-03-18 17:29:17.811332 | [Zuul] Log Stream did not terminate
2026-03-18 17:29:17.811577 | controller | changed
2026-03-18 17:29:17.816530 | 
2026-03-18 17:29:17.816586 | TASK [Copy files from workspace on node]
2026-03-18 17:29:17.834064 | controller | ok
2026-03-18 17:29:17.854470 | 
2026-03-18 17:29:17.854547 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-18 17:29:17.867706 | controller | skipping: Conditional result was False
2026-03-18 17:29:17.874012 | 
2026-03-18 17:29:17.874079 | TASK [fetch-output : Set log path for single node]
2026-03-18 17:29:17.901499 | controller | ok
2026-03-18 17:29:17.906732 | 
2026-03-18 17:29:17.906798 | LOOP [fetch-output : Ensure local output dirs]
2026-03-18 17:29:18.090770 | controller -> localhost | ok: "/var/lib/zuul/builds/b91f0e2af46b42aa97c0c1f37d76ea08/work/logs"
2026-03-18 17:29:18.091198 | controller -> localhost | changed: All items complete
2026-03-18 17:29:18.091225 | 
2026-03-18 17:29:18.255097 | controller -> localhost | changed: "/var/lib/zuul/builds/b91f0e2af46b42aa97c0c1f37d76ea08/work/artifacts"
2026-03-18 17:29:18.414647 | controller -> localhost | changed: "/var/lib/zuul/builds/b91f0e2af46b42aa97c0c1f37d76ea08/work/docs"
2026-03-18 17:29:18.422983 | 
2026-03-18 17:29:18.423085 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-18 17:29:19.062337 | controller | changed:
2026-03-18 17:29:19.062511 | controller | .d..t...... ./
2026-03-18 17:29:19.062541 | controller | >f+++++++++ README.html
2026-03-18 17:29:19.062563 | controller | >f+++++++++ ansible-execution.log
2026-03-18 17:29:19.062583 | controller | >f+++++++++ ansible.log
2026-03-18 17:29:19.062602 | controller | >f+++++++++ crc-setup.log
2026-03-18 17:29:19.062619 | controller | >f+++++++++ crc-start.log
2026-03-18 17:29:19.062636 | controller | >f+++++++++ dmesg.log
2026-03-18 17:29:19.062654 | controller | >f+++++++++ installed-pkgs.log
2026-03-18 17:29:19.062671 | controller | >f+++++++++ python.log
2026-03-18 17:29:19.062688 | controller | >f+++++++++ registries.conf
2026-03-18 17:29:19.062705 | controller | >f+++++++++ report.html
2026-03-18 17:29:19.062723 | controller | >f+++++++++ selinux-listing.log
2026-03-18 17:29:19.062741 | controller | cd+++++++++ ci-framework-data/
2026-03-18 17:29:19.062759 | controller | cd+++++++++ ci-framework-data/artifacts/
2026-03-18 17:29:19.062777 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml
2026-03-18 17:29:19.062799 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/
2026-03-18 17:29:19.062817 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/addresses.conf
2026-03-18 17:29:19.062834 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/cifmw-dnsmasq.conf
2026-03-18 17:29:19.062851 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/crc-local.conf
2026-03-18 17:29:19.062868 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dns.conf
2026-03-18 17:29:19.062885 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/host_records.conf
2026-03-18 17:29:19.062901 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/journalctl.log
2026-03-18 17:29:19.062917 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/listener.conf
2026-03-18 17:29:19.062933 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/osp_trunk.conf
2026-03-18 17:29:19.062949 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/public.conf
2026-03-18 17:29:19.062965 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/utility.conf
2026-03-18 17:29:19.062981 | controller | cd+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/
2026-03-18 17:29:19.062996 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_compute-0_52:54:00:7e:b4:24
2026-03-18 17:29:19.063014 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_controller-0_52:54:01:f8:7f:21
2026-03-18 17:29:19.063030 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/osp_trunk_crc-0_52:54:02:aa:75:1a
2026-03-18 17:29:19.063046 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_compute-0_52:54:00:b2:d4:13
2026-03-18 17:29:19.063063 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_controller-0_52:54:01:c4:bb:2c
2026-03-18 17:29:19.063079 | controller | >f+++++++++ ci-framework-data/artifacts/dnsmasq/dhcp-hosts.d/public_crc-0_52:54:02:a7:2b:c8
2026-03-18 17:29:19.063096 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/
2026-03-18 17:29:19.063113 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml
2026-03-18 17:29:19.063130 | controller | cd+++++++++ ci-framework-data/logs/
2026-03-18 17:29:19.063146 | controller | >f+++++++++ ci-framework-data/logs/molecule-execution.log
2026-03-18 17:29:19.063166 | controller | cd+++++++++ ci-framework-data/logs/controller-0/
2026-03-18 17:29:19.063187 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ansible.log
2026-03-18 17:29:19.063205 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/
2026-03-18 17:29:19.063222 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/
2026-03-18 17:29:19.063239 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/networking-mapper-instances-facts.yml
2026-03-18 17:29:19.063256 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/zuul_inventory.yml
2026-03-18 17:29:19.063299 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/
2026-03-18 17:29:19.063330 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/
2026-03-18 17:29:19.063348 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/manifests/openstack/cr/
2026-03-18 17:29:19.063364 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/
2026-03-18 17:29:19.063382 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/custom-params.yml
2026-03-18 17:29:19.063398 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/parameters/install-yamls-params.yml
2026-03-18 17:29:19.063414 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/
2026-03-18 17:29:19.063434 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo
2026-03-18 17:29:19.063451 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo
2026-03-18 17:29:19.063468 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/delorean.repo.md5
2026-03-18 17:29:19.063485 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo
2026-03-18 17:29:19.063502 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo
2026-03-18 17:29:19.063518 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo
2026-03-18 17:29:19.063535 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo
2026-03-18 17:29:19.063551 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/roles/
2026-03-18 17:29:19.063567 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/
2026-03-18 17:29:19.063583 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/.htpasswd
2026-03-18 17:29:19.063599 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/config.conf
2026-03-18 17:29:19.063616 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/artifacts/sushy_emulator/known_hosts
2026-03-18 17:29:19.063632 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/logs/
2026-03-18 17:29:19.063649 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/
2026-03-18 17:29:19.063665 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/baremetal-info.yml
2026-03-18 17:29:19.063682 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/interfaces-info.yml
2026-03-18 17:29:19.063698 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/openshift-environment.yml
2026-03-18 17:29:19.063715 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/parameters/reproducer-variables.yml
2026-03-18 17:29:19.063731 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/
2026-03-18 17:29:19.063747 | controller | >f+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/secrets/default.txt
2026-03-18 17:29:19.063763 | controller | cd+++++++++ ci-framework-data/logs/controller-0/ci-framework-data/volumes/
2026-03-18 17:29:19.063779 | controller | cd+++++++++ ci-framework-data/logs/controller-0/motd.d/
2026-03-18 17:29:19.063795 | controller | >f+++++++++ ci-framework-data/logs/controller-0/motd.d/cifmw.motd
2026-03-18 17:29:19.063810 | controller | cd+++++++++ registries.conf.d/
2026-03-18 17:29:19.063826 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf
2026-03-18 17:29:19.063842 | controller | cd+++++++++ system-config/
2026-03-18 17:29:19.063858 | controller | cd+++++++++ system-config/libvirt/
2026-03-18 17:29:19.063874 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf
2026-03-18 17:29:19.063890 | controller | >f+++++++++ system-config/libvirt/libvirt.conf
2026-03-18 17:29:19.063907 | controller | >f+++++++++ system-config/libvirt/libvirtd.conf
2026-03-18 17:29:19.063924 | controller | >f+++++++++ system-config/libvirt/network.conf
2026-03-18 17:29:19.063940 | controller | >f+++++++++ system-config/libvirt/qemu-lockd.conf
2026-03-18 17:29:19.063957 | controller | >f+++++++++ system-config/libvirt/qemu.conf
2026-03-18 17:29:19.063976 | controller | >f+++++++++ system-config/libvirt/virtinterfaced.conf
2026-03-18 17:29:19.063993 | controller | >f+++++++++ system-config/libvirt/virtlockd.conf
2026-03-18 17:29:19.064009 | controller | >f+++++++++ system-config/libvirt/virtlogd.conf
2026-03-18 17:29:19.064025 | controller | >f+++++++++ system-config/libvirt/virtnetworkd.conf
2026-03-18 17:29:19.064040 | controller | >f+++++++++ system-config/libvirt/virtnodedevd.conf
2026-03-18 17:29:19.064056 | controller | >f+++++++++ system-config/libvirt/virtnwfilterd.conf
2026-03-18 17:29:19.064071 | controller | >f+++++++++ system-config/libvirt/virtproxyd.conf
2026-03-18 17:29:19.064087 | controller | >f+++++++++ system-config/libvirt/virtqemud.conf
2026-03-18 17:29:19.064104 | controller | >f+++++++++ system-config/libvirt/virtsecretd.conf
2026-03-18 17:29:19.064122 | controller | >f+++++++++ system-config/libvirt/virtstoraged.conf
2026-03-18 17:29:19.513094 | controller | changed: .d..t...... ./
2026-03-18 17:29:19.947449 | controller | changed: .d..t...... ./
2026-03-18 17:29:19.959794 | 
2026-03-18 17:29:19.959880 | TASK [Return artifact to Zuul]
2026-03-18 17:29:19.999831 | controller | ok
2026-03-18 17:29:20.044933 | 
2026-03-18 17:29:20.045018 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host]
2026-03-18 17:29:20.045111 | 
2026-03-18 17:29:20.045136 | PLAY RECAP
2026-03-18 17:29:20.045172 | controller | ok: 18 changed: 12 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 1
2026-03-18 17:29:20.045192 | 
2026-03-18 17:29:20.125445 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main]
2026-03-18 17:29:20.126427 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-03-18 17:29:20.617819 | 
2026-03-18 17:29:20.617915 | PLAY [all]
2026-03-18 17:29:20.634844 | 
2026-03-18 17:29:20.634910 | TASK [include_role : fetch-output]
2026-03-18 17:29:20.664230 | controller | ok
2026-03-18 17:29:20.679911 | 
2026-03-18 17:29:20.679986 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-18 17:29:20.714591 | controller | skipping: Conditional result was False
2026-03-18 17:29:20.719838 | 
2026-03-18 17:29:20.719904 | TASK [fetch-output : Set log path for single node]
2026-03-18 17:29:20.748047 | controller | ok
2026-03-18 17:29:20.752540 | 
2026-03-18 17:29:20.752604 | LOOP [fetch-output : Ensure local output dirs]
2026-03-18 17:29:21.049221 | controller -> localhost | ok: "/var/lib/zuul/builds/b91f0e2af46b42aa97c0c1f37d76ea08/work/logs"
2026-03-18 17:29:21.225734 | controller -> localhost | ok: "/var/lib/zuul/builds/b91f0e2af46b42aa97c0c1f37d76ea08/work/artifacts"
2026-03-18 17:29:21.393515 | controller -> localhost | ok: "/var/lib/zuul/builds/b91f0e2af46b42aa97c0c1f37d76ea08/work/docs"
2026-03-18 17:29:21.410845 | 
2026-03-18 17:29:21.410948 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-18 17:29:21.992599 | controller | ok
2026-03-18 17:29:21.992880 | controller | ok: All items complete
2026-03-18 17:29:21.992918 | 
2026-03-18 17:29:22.431010 | controller | ok
2026-03-18 17:29:22.871015 | controller | ok
2026-03-18 17:29:22.885856 | 
2026-03-18 17:29:22.885957 | TASK [include_role : fetch-output-openshift]
2026-03-18 17:29:22.899505 | controller | skipping: Conditional result was False
2026-03-18 17:29:22.904958 | 
2026-03-18 17:29:22.905021 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-18 17:29:23.208360 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.005906
2026-03-18 17:29:23.382282 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.005907
2026-03-18 17:29:23.407118 | 
2026-03-18 17:29:23.407208 | PLAY [all]
2026-03-18 17:29:23.419906 | 
2026-03-18 17:29:23.419977 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-18 17:29:23.946298 | controller | changed
2026-03-18 17:29:23.965666 | 
2026-03-18 17:29:23.965720 | PLAY RECAP
2026-03-18 17:29:23.965759 | controller | ok: 5 changed: 2 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0
2026-03-18 17:29:23.965785 | 
2026-03-18 17:29:24.028070 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-ssh.yaml@master]
2026-03-18 17:29:24.029044 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/post-logs.yaml@master]
2026-03-18 17:29:24.524750 | 
2026-03-18 17:29:24.524850 | PLAY [localhost]
2026-03-18 17:29:24.541458 | 
2026-03-18 17:29:24.541537 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-18 17:29:24.832279 | localhost | changed
2026-03-18 17:29:24.836616 | 
2026-03-18 17:29:24.836696 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-18 17:29:24.853975 | localhost | ok
2026-03-18 17:29:24.861193 | 
2026-03-18 17:29:24.861261 | TASK [add-fileserver : Create SSH private key tempfile]
2026-03-18 17:29:25.132628 | localhost | changed
2026-03-18 17:29:25.137664 | 
2026-03-18 17:29:25.137729 | TASK [add-fileserver : Create SSH private key from secret]
2026-03-18 17:29:25.631484 | localhost | changed
2026-03-18 17:29:25.635948 | 
2026-03-18 17:29:25.636011 | TASK [add-fileserver : Add fileserver ssh key]
2026-03-18 17:29:25.936182 | localhost | Identity added: /var/lib/zuul/builds/b91f0e2af46b42aa97c0c1f37d76ea08/work/tmp/ansible.iwd7tgv1 (/var/lib/zuul/builds/b91f0e2af46b42aa97c0c1f37d76ea08/work/tmp/ansible.iwd7tgv1)
2026-03-18 17:29:25.936382 | localhost | ok: Runtime: 0:00:00.005741
2026-03-18 17:29:25.940341 | 
2026-03-18 17:29:25.940410 | TASK [add-fileserver : Remove SSH private key from disk]
2026-03-18 17:29:26.139348 | localhost | ok: Runtime: 0:00:00.004012
2026-03-18 17:29:26.143512 | 
2026-03-18 17:29:26.143576 | TASK [add-fileserver : Add fileserver to inventory]
2026-03-18 17:29:26.190819 | localhost | changed
2026-03-18 17:29:26.195409 | 
2026-03-18 17:29:26.195474 | TASK [add-fileserver : Add fileserver server to known hosts]
2026-03-18 17:29:26.485939 | localhost | changed
2026-03-18 17:29:26.503607 | 
2026-03-18 17:29:26.503658 | PLAY [localhost]
2026-03-18 17:29:26.513600 | 
2026-03-18 17:29:26.513655 | TASK [Generate bulk log download script]
2026-03-18 17:29:26.531087 | localhost | ok
2026-03-18 17:29:26.541415 | 
2026-03-18 17:29:26.541477 | TASK [local-log-download : Check API endpoint is defined]
2026-03-18 17:29:26.568234 | localhost | ok: All assertions passed
2026-03-18 17:29:26.572198 | 
2026-03-18 17:29:26.572256 | TASK [local-log-download : Create download script]
2026-03-18 17:29:26.889598 | localhost -> localhost | changed
2026-03-18 17:29:26.896975 | 
2026-03-18 17:29:26.897033 | TASK [Register quick-download link]
2026-03-18 17:29:26.913128 | localhost | ok
2026-03-18 17:29:26.942950 | 
2026-03-18 17:29:26.943017 | PLAY [logserver.rdoproject.org]
2026-03-18 17:29:26.951358 | 
2026-03-18 17:29:26.951413 | TASK [Set zuul-log-path fact]
2026-03-18 17:29:26.966512 | logserver.rdoproject.org | ok
2026-03-18 17:29:26.974311 | 
2026-03-18 17:29:26.974371 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-18 17:29:26.990770 | logserver.rdoproject.org | ok
2026-03-18 17:29:26.995623 | 
2026-03-18 17:29:26.995683 | TASK [upload-logs : Create log directories]
2026-03-18 17:29:28.813790 | logserver.rdoproject.org | changed
2026-03-18 17:29:28.816540 | 
2026-03-18 17:29:28.816600 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-18 17:29:29.012860 | logserver.rdoproject.org -> localhost | ok: Runtime: 0:00:00.005195
2026-03-18 17:29:29.016979 | 
2026-03-18 17:29:29.017038 | TASK [upload-logs : Upload logs to log server]
2026-03-18 17:29:30.569482 | logserver.rdoproject.org | Output suppressed because no_log was given
2026-03-18 17:29:30.572910 | 
2026-03-18 17:29:30.572988 | LOOP [upload-logs : Compress console log and json output]
2026-03-18 17:29:30.612975 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-18 17:29:30.620094 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-18 17:29:30.633747 | 
2026-03-18 17:29:30.633866 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-18 17:29:30.672873 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-18 17:29:30.673120 | 
2026-03-18 17:29:30.674919 | logserver.rdoproject.org | skipping: Conditional result was False
2026-03-18 17:29:30.683920 | 
2026-03-18 17:29:30.684041 | LOOP [upload-logs : Upload console log and json output]